-- Logs begin at Sat 2022-03-05 20:01:15 UTC, end at Sat 2022-03-05 22:06:10 UTC. -- Mar 05 20:37:59.301804 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Mar 05 20:37:59.309772 ncdv-master-1 devstack@n-api.service[125824]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 05 20:37:59.312412 ncdv-master-1 devstack@n-api.service[125824]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Mar 5 20:37:59 2022] *** Mar 05 20:37:59.312558 ncdv-master-1 devstack@n-api.service[125824]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 05 20:37:59.312702 ncdv-master-1 devstack@n-api.service[125824]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 05 20:37:59.312702 ncdv-master-1 devstack@n-api.service[125824]: nodename: ncdv-master-1 Mar 05 20:37:59.312702 ncdv-master-1 devstack@n-api.service[125824]: machine: x86_64 Mar 05 20:37:59.312702 ncdv-master-1 devstack@n-api.service[125824]: clock source: unix Mar 05 20:37:59.312702 ncdv-master-1 devstack@n-api.service[125824]: pcre jit disabled Mar 05 20:37:59.312702 ncdv-master-1 devstack@n-api.service[125824]: detected number of CPU cores: 4 Mar 05 20:37:59.312702 ncdv-master-1 devstack@n-api.service[125824]: current working directory: / Mar 05 20:37:59.312702 ncdv-master-1 devstack@n-api.service[125824]: detected binary path: /usr/bin/uwsgi-core Mar 05 20:37:59.312702 ncdv-master-1 devstack@n-api.service[125824]: your processes number limit is 47680 Mar 05 20:37:59.312702 ncdv-master-1 devstack@n-api.service[125824]: your memory page size is 4096 bytes Mar 05 20:37:59.312702 ncdv-master-1 devstack@n-api.service[125824]: detected max file descriptor number: 2048 Mar 05 20:37:59.312702 ncdv-master-1 devstack@n-api.service[125824]: lock engine: pthread robust mutexes Mar 05 20:37:59.313562 ncdv-master-1 devstack@n-api.service[125824]: thunder lock: enabled Mar 05 20:37:59.313562 ncdv-master-1 devstack@n-api.service[125824]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 05 20:37:59.313562 ncdv-master-1 devstack@n-api.service[125824]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 05 20:37:59.361914 ncdv-master-1 devstack@n-api.service[125824]: Python main interpreter initialized at 0x55f43d3369c0 Mar 05 20:37:59.361914 ncdv-master-1 devstack@n-api.service[125824]: python threads support enabled Mar 05 20:37:59.361914 ncdv-master-1 devstack@n-api.service[125824]: your server socket listen backlog is limited to 100 connections Mar 05 20:37:59.361914 ncdv-master-1 devstack@n-api.service[125824]: your mercy for graceful operations on workers is 90 seconds Mar 05 20:37:59.362268 ncdv-master-1 devstack@n-api.service[125824]: mapped 403077 bytes (393 KB) for 2 cores Mar 05 20:37:59.362344 ncdv-master-1 devstack@n-api.service[125824]: *** Operational MODE: preforking *** Mar 05 20:37:59.362552 ncdv-master-1 devstack@n-api.service[125824]: *** uWSGI is running in multiple interpreter mode *** Mar 05 20:37:59.362552 ncdv-master-1 devstack@n-api.service[125824]: spawned uWSGI master process (pid: 125824) Mar 05 20:37:59.362745 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Mar 05 20:37:59.363921 ncdv-master-1 devstack@n-api.service[125824]: spawned uWSGI worker 1 (pid: 125825, cores: 1) Mar 05 20:37:59.363921 ncdv-master-1 devstack@n-api.service[125824]: spawned uWSGI worker 2 (pid: 125826, cores: 1) Mar 05 20:37:59.363921 ncdv-master-1 devstack@n-api.service[125824]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 05 20:38:01.300752 ncdv-master-1 devstack@n-api.service[125825]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 20:38:01.300752 ncdv-master-1 devstack@n-api.service[125825]: from cryptography.utils import int_from_bytes Mar 05 20:38:01.301376 ncdv-master-1 devstack@n-api.service[125825]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 20:38:01.301376 ncdv-master-1 devstack@n-api.service[125825]: from cryptography.utils import int_from_bytes Mar 05 20:38:01.318618 ncdv-master-1 devstack@n-api.service[125826]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 20:38:01.318618 ncdv-master-1 devstack@n-api.service[125826]: from cryptography.utils import int_from_bytes Mar 05 20:38:01.319147 ncdv-master-1 devstack@n-api.service[125826]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 20:38:01.319147 ncdv-master-1 devstack@n-api.service[125826]: from cryptography.utils import int_from_bytes Mar 05 20:38:03.914699 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 05 20:38:03.915221 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 05 20:38:03.915389 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 05 20:38:03.915800 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 05 20:38:03.916064 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 05 20:38:03.916456 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.916788 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.917115 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.917695 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.918032 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.918348 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.918671 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.918996 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.919333 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.919598 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.919957 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.920284 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.920617 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.920760 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 05 20:38:03.921131 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.921206 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 05 20:38:03.921271 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.921436 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 05 20:38:03.921579 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.921782 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 05 20:38:03.921924 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.922059 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 05 20:38:03.922176 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.922412 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.922539 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.922743 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.922921 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.923060 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.923361 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.923504 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.923776 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.923910 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.924023 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.924153 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.924406 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.924554 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.924662 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.924774 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.925025 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.925165 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.925286 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.925404 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.925597 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.925719 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.925932 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.926067 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.926185 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.926311 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.926507 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.926711 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.926903 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.927103 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.927343 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.927534 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.927645 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.927982 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.928203 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.928439 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.928639 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.928841 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.929034 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.929248 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.929455 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.929657 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.929855 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.930068 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.930239 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.930456 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.930456 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.930456 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.930931 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.931122 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.931264 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.931421 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.931574 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.931746 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.931940 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.932096 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.932238 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.932380 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.932532 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.932673 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.932814 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.932963 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.933104 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.933352 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.933352 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.933644 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.933796 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.933938 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.934078 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.934225 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.934378 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.934524 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.934672 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.934828 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.934967 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.935109 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.935258 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.935419 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.935595 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.935803 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.935969 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.936121 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.936271 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.936412 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.936552 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.936694 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.936835 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.936984 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.937125 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.937279 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.937423 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.937563 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.937710 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.937861 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.938002 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.938142 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.938290 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.938446 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.938618 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.938773 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.938913 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.939053 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.939201 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.939349 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.939498 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.939639 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.939806 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.939959 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.940102 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.940242 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.940391 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.940533 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.940682 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.940823 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.940823 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.941160 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.941316 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.941458 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.941458 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.941742 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.941742 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.942094 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.942239 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.942379 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.942526 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.942677 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.942823 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.942980 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.943123 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.943291 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.943497 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.943640 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.943808 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.943968 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.944117 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.944258 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.944258 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.944530 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.944680 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.944827 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.944969 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.945646 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.945810 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.945951 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.946121 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.946299 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.946442 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.946442 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.946442 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.946839 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.946988 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.947138 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.947284 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.947433 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.947581 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.947764 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.947924 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.948067 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.948217 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.948359 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.948503 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.948675 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.948830 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.948972 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.949120 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.949270 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.949420 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.949642 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.949807 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.949950 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.950093 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.950235 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.950377 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.950530 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.950672 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.950813 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.950961 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.951110 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.951264 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.951439 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.951593 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.951796 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.951938 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.952080 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.952228 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.952382 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.952523 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.952664 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.952806 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.952946 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.953091 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.953256 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.953422 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.953644 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.953835 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.953985 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.954127 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.954278 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.954278 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.954554 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.954696 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.954837 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.954987 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.955141 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.955283 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.955424 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.955575 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.955764 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.955936 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.956081 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.956223 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.956366 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.956508 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.956652 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.956652 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.956933 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.957081 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.957223 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.957372 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.957521 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.957674 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.957819 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.957961 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.958112 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.958253 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.958396 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.958546 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.958689 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.958855 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.959013 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.959158 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.959303 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.959459 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.959605 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.959781 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.959923 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.960066 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.960221 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.960469 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.960624 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.961329 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.961506 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.961506 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.961831 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.962089 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.962248 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.962248 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.962535 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.962686 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.962846 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.962993 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.963139 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.963317 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.963462 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.963636 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.963903 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.964059 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.964203 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.964345 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.964497 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.964651 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.964801 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.964944 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.965083 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.965231 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.965387 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.965575 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.965733 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.965900 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.966068 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.966218 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.966359 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.966508 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.966649 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.966789 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.966929 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.967079 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.967220 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:38:03.967376 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.967531 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.967694 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.967850 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.968004 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.968157 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.968302 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.968451 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.968594 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.968737 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.969008 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.969171 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.969315 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.969460 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.969617 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.969776 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.969926 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.970076 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.970220 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.970369 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.970511 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.970652 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.970795 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.970946 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.971095 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.971248 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.971437 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.971609 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.971794 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.971953 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.972097 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.972239 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.972380 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.972520 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.972667 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.972820 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.972970 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.973112 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.973253 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.973409 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.973563 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.973706 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.973847 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.974066 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.974208 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.974352 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.974505 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.974653 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.974793 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.974949 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.975113 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.975262 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.975416 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.975560 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.975739 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.975896 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.976053 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.976217 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.976428 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.976626 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.976797 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.976941 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.977092 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.977272 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.977417 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.977574 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.977718 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.977718 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.977990 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.978147 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.978290 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.978438 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.978583 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.978734 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.978877 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.979050 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.979214 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.979362 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.979512 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.979661 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.979862 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.980016 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.980157 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.980307 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.980455 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.980596 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.980747 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.980889 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.981038 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.981179 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.981325 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.981466 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.981632 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.981798 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.981940 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.982081 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.982223 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.982363 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.982513 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.982661 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.982805 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.982946 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.983095 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.983242 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.983394 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.983534 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.983712 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.983862 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.984004 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.984237 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.984381 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.984532 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.984674 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.984814 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.984956 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.985106 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.985254 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.985397 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.985537 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.985678 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.985818 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.985968 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.986123 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.986293 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.986435 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.986576 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.986719 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.986874 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.987017 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.987164 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.987307 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.987447 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.987597 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.987765 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.987909 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.988055 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.988197 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.988339 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.988506 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.988649 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.988799 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.988956 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.989134 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.989310 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.989472 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.989618 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.989764 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.989915 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.990061 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.990215 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.990369 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.990514 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.990660 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.990812 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.990964 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.991118 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.991265 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.991423 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.991569 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.991798 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.991949 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.992169 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.992328 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.992471 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.992612 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.992789 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.992789 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.993075 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.993224 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.993378 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.993520 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.993520 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.993796 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.993947 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.994095 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.994256 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.994472 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.994622 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.994773 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.994922 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.995070 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.995070 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.995351 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.995500 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.995657 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.995831 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.995984 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.996128 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.996295 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.996493 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.996648 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.996799 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.996950 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.997095 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.997238 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.997387 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.997541 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.997684 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.997826 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.997976 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.998124 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.998267 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.998418 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.998563 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.998705 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.998861 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.999012 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.999165 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.999323 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.999489 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.999636 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.999819 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:03.999966 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.000123 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.000268 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.000411 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.000552 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.000695 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.000842 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.000997 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.001141 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.001285 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.001427 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.001570 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.001720 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.001889 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.002053 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.002198 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.002343 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.002490 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.002644 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.002806 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.002958 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.003104 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.003249 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.003400 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.003555 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.003737 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.003883 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.004026 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.004166 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.004306 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.004477 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.004685 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.004834 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.004984 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.005125 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.005267 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.005417 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.005560 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.005708 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.005851 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.005992 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.006143 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.006285 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.006444 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.006607 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.006750 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.006892 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.007043 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.007184 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.007327 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.007469 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.008154 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.008301 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.008455 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.008614 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.008614 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.008906 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.009024 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.009148 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.009286 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.009419 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.009595 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.009743 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.009896 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.010044 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.010203 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.010356 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.010502 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.010648 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.010801 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.010961 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.011109 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.011262 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.011412 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.011558 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.011762 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.011920 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.012088 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.012235 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.012377 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.012525 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.012667 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.012821 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.012969 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.013110 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.013260 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.013402 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.013568 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.013721 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.013887 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.014031 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.014204 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.014350 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.014503 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.014645 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.014868 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.015017 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.015161 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.015304 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.015456 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.015598 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.015766 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.015910 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.016053 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.016195 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.016353 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.016517 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.016692 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.016847 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.016991 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.017139 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.017291 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.017435 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.017578 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.017721 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.017870 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.018021 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.018170 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.018313 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.018463 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.018607 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.018757 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.018912 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.019056 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.019198 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.019341 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.019485 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.019644 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.019889 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.020112 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.020266 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.020417 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.020560 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.020701 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.020920 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.021064 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.021207 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.021362 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.021563 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.021717 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.021865 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.022044 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.022211 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.022360 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.022501 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.022653 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.022800 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.022941 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.023083 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.023828 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.024008 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.024206 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.024502 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.024664 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.024818 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.025059 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.025220 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.025381 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.025537 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.025687 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.025859 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.026010 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.026154 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.026304 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.026480 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.026638 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.026810 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.026957 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.027104 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.027249 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.027403 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.027549 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.027734 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.027880 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.028021 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.028173 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.028316 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.028484 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.028628 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.028776 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.028928 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.029081 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.029223 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.029372 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.029521 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.029687 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.029855 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.030013 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.030156 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.030297 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.030465 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.030608 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.030750 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.030901 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.031076 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.031216 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.031356 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.031502 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.031653 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.031834 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.031979 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.032131 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.032289 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.032462 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.032615 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.032766 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.032916 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.033071 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.033215 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.033358 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.033504 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.033655 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.033820 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.033967 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.034111 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.034262 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.034416 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.034569 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.034716 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.034861 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.035020 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.035233 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.035380 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.035541 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.035723 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.035868 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.036030 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.036197 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.036351 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.036493 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.036635 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.036800 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.036961 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.037110 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.037263 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.037405 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.037551 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.037693 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.037835 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.037983 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.038134 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.038282 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.038433 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.038574 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.038715 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.038878 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.039028 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.039193 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.039380 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.039612 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.039843 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.040029 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.040176 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.040322 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.040470 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.040617 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.040763 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.040919 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.041066 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.041212 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.041364 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.041524 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.041672 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.041827 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.041975 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.042119 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.042270 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.042676 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.042823 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.042977 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.043122 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.043267 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.043412 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.043564 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.043752 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.043899 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.044050 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.044194 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.044338 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.044489 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.044642 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.044789 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.044933 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.045084 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.045250 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.045460 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.045683 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.045837 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.045981 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.046141 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.046309 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.046454 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.046605 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.046750 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.046904 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.047075 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.047225 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.047380 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.047525 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.047692 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.047848 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.047989 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.048131 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.048283 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.048431 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.048574 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.048714 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.048855 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.049008 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.049159 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.049307 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.049455 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.049603 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.049745 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.049887 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.050066 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.050211 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.050352 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.050493 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.050633 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.050788 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.050931 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.051071 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.051218 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.051358 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.051511 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.051751 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.051914 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.052060 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.052202 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.052344 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.052344 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.052624 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.052768 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.052910 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.053053 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.053201 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.053344 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.053509 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.053654 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.053819 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.053972 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.054115 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.054287 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.054531 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.054720 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.054894 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.054894 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.055309 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.055480 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.055728 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.055891 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.056033 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.056176 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.056338 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.056500 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.056643 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.056784 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.056926 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.057085 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.057243 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.057399 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.057543 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.057693 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.057843 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.057985 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.058140 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.058284 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.058427 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.058568 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.058709 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.058850 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.058999 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.059141 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.059281 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.059423 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.059569 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.059755 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.059916 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.060077 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.060249 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.060395 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.060537 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.060680 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.060831 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.060976 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.061119 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.061262 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.061405 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.061562 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.061707 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.061850 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.061992 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.062150 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.062327 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.062491 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.062638 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.062787 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.062933 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.063081 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.063227 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.063386 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.063548 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.063752 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.063899 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.064041 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.064187 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.064343 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.064493 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.064637 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.064782 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.064924 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.065073 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.065214 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.065369 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.065551 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.065710 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.065918 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.066069 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.066213 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.066365 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.066543 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.066543 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.066816 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.066967 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.067118 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.067288 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.067438 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.067588 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.067757 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.067916 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.068062 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.068204 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.068348 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.068492 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.068635 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.068791 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.068934 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.069085 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.069235 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.069387 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.069539 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.069683 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.069827 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.070507 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.070728 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.070942 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.071099 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.071099 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.071379 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.071571 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.071748 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.071892 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.072052 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.072197 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.072340 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.072483 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.072638 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.072789 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.072931 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.073073 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.073213 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.073354 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.073501 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.073652 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.073800 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.073947 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.074091 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.074239 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.074379 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.074598 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.074741 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.074884 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.075026 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.075189 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.075352 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.075505 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.075645 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.075831 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.076059 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.076204 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.076364 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.076541 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.076700 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.076843 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.076988 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.077134 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.077306 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.077482 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.077631 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.077814 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.077968 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.078121 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.078276 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.078424 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.078570 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.078722 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.078869 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.079020 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.079175 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.079344 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.079508 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.079655 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.079837 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.079987 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.080130 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.080275 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.080431 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.080574 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.080736 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.080890 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.081032 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.081175 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.081331 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.081473 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.081613 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.081760 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.081902 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.082056 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.082206 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.082422 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.082584 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.082736 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.082879 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.083030 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.083172 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.083314 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.083459 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.083601 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.083883 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.084041 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.084199 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.084344 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.084494 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.084637 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.084782 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.084961 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.085106 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.085249 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.085396 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.085538 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.086282 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.086512 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.086675 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.086895 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.087069 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.087214 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.087365 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.087548 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.087733 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.087891 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.088042 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.088191 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.088342 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.088493 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.088636 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.088792 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.088934 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.089110 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.089270 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.089453 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.089607 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.089786 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.089930 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.090106 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.090257 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.090421 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.090571 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.090714 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.090882 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.091039 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.091191 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.091334 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.091475 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.091616 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.091813 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.091971 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.092123 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.092275 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.092437 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.092592 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.092747 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.092920 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.093072 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.093224 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.093377 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.093524 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.093677 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.093832 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.093980 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.094127 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.094273 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.094424 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.094584 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.094739 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.094886 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.095035 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.095183 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.095330 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.095493 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.095641 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.095812 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.095965 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.096111 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.096260 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.096418 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.096666 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.096824 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.096824 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.097123 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.097123 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.097406 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.097406 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.097720 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.097863 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.098003 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.098160 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.098311 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.098462 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.098611 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.098752 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.098893 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.099044 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.099188 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.099330 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.099470 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.099610 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.099821 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.099968 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.100117 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.100262 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.100413 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.100557 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.100709 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.100853 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.101025 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.101177 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.101353 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.101624 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.101824 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.101974 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.102162 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.102461 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.102612 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.102767 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.102920 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.103067 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.103221 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.103369 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.103516 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.103705 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.103854 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.103996 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.104137 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.104278 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.104422 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.104581 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.104726 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.104898 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.105049 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.105192 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.105341 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.105498 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.105655 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.105809 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.105952 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.106103 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.106246 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.106397 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.106548 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.106750 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.106888 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.107075 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.107250 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.107395 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.107540 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.107740 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.107901 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.108043 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.108195 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.108338 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.108485 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.108640 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.108782 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.108960 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.109105 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.109280 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.109422 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.109600 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.109752 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.109902 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.110043 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.110223 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.110379 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.110521 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.110662 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.110838 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.110983 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.111151 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.111296 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.111436 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.111578 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.111802 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.111949 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.112092 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.112306 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.112461 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.112638 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.112784 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.112957 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.113100 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.113276 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.113420 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.113593 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.113738 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.113914 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.114059 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.114231 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.114381 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.114533 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.114746 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.114893 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.115065 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.115208 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.115405 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.115549 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.115785 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.115947 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.116099 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.116244 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.116430 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.116580 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.116776 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.117579 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.117733 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.118096 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.118258 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.118423 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.118568 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.118748 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.118892 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.119048 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.119197 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.119346 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.119488 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.119663 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.119864 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.120017 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.120187 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.120351 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.120495 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.120636 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.120780 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.120931 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.121073 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.121275 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.121430 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.121574 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.121768 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.121914 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.122091 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.122247 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.122422 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.122568 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.122755 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.122901 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.123078 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.123230 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.123380 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.123520 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.123878 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.124041 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.124041 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.124321 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.124466 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.124619 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.124764 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.124907 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.125064 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.125210 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.125368 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.125536 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.125681 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.125832 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.125976 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.126131 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.126280 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.126436 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.126588 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.126733 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.126877 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.127021 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.127167 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.127325 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.127470 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.127746 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.127894 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.128075 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.128237 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.128381 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.128525 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.128668 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.128809 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.128950 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.129102 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.129245 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.129394 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.129538 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.129681 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.129823 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.129975 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.130118 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.130261 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.130402 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.130544 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.130686 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.130902 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.131046 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.131194 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.131355 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.131521 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.131701 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.131872 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.132019 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.132168 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.132316 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.132463 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.133170 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.133322 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.133621 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.133865 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.134021 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.134193 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.134354 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.134504 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.134652 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.134828 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.134990 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.135139 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.135298 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.135445 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.135598 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.135766 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.135912 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.136073 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.136349 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.136495 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.136673 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.136816 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.136990 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.137145 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.137288 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.137434 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.137598 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.137847 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.138002 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.138183 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.138353 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.138507 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.138696 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.138848 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.138994 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.139215 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.139361 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.139502 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.139652 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.139832 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.139990 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.140136 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.140295 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.140441 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.140587 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.140738 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.140940 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.141098 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.141253 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.141405 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.141570 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.141714 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.141867 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.142010 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.142160 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.142310 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.142466 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.142610 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.142766 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.142947 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.143094 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.143264 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.143444 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.143601 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.143784 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.143927 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.144069 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.144217 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.144362 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.144517 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.144672 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.144815 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.144963 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.145105 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.145249 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.145405 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.145549 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.145691 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.145844 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.145992 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.146147 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.146292 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.146436 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.146598 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.146752 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.146895 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.146895 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.147176 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.147327 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.147475 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.147616 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.147816 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.148067 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.148250 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.148423 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.148582 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.148727 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.148727 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.149042 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.149188 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.149334 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.149479 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.149631 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.149784 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.149927 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.150079 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.150235 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.150381 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.150526 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.150680 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.150825 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.150968 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.151112 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.151257 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.151403 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.151572 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.151767 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.151918 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.152064 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.152212 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.152363 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.152506 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.152651 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.152802 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.152943 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.153085 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.153238 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.153381 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.153523 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.153699 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.153854 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.154007 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.154160 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.154308 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.154460 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.154602 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.154746 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.154902 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.155053 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.155220 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.155381 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.155525 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.155766 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.155927 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.156072 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.156215 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.156360 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.156505 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.156651 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.156804 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.156957 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.157102 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.157247 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.157394 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.157538 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.157695 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.157840 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.158037 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.158037 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.158416 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.158586 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.158730 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.158880 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.159026 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.159170 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.159312 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.159491 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.159640 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.159844 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.160000 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.160143 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.160286 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.160443 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.160592 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.160746 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.160887 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.161029 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.161181 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.161324 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.161465 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.161613 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.161781 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.161928 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.162085 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.162236 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.162420 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.162581 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.162726 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.162870 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.163021 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.163167 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.163309 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.163452 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.163604 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.163807 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.164016 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.164165 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.164165 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.164440 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.164583 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.164777 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.164924 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.165068 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.165220 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.165391 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.165568 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.165729 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.165880 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.166029 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.166182 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.166331 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.166478 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.166635 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.166781 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.166928 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.167073 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.167230 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.167759 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.167914 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.168072 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.168259 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.168472 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.168644 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.168805 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.168957 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.169101 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.169254 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.169400 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.169555 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.169711 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.169868 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.170021 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.170174 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.170319 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.170464 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.170616 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.170766 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.170911 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.171055 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.171200 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.171352 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.171498 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.171658 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.171899 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.172067 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.172213 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.172365 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.172518 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.172663 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.172813 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.172968 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.173111 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.173262 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.173405 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.173547 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.173691 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 05 20:38:04.173847 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.173847 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.174130 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.174372 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.174686 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.175002 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.175319 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.175634 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.175971 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.176287 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.176616 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.176948 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.177259 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.177591 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.177914 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.178243 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.178562 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.178876 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.179212 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.180478 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.180806 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.181132 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.181451 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.181771 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.182095 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.182417 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.182750 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.183084 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.183419 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.183782 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.184139 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.184458 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.184811 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.185143 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.185464 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.185782 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.186091 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:38:04.186336 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 05 20:38:04.196153 ncdv-master-1 devstack@n-api.service[125825]: DEBUG oslo_db.sqlalchemy.engines [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:38:04.209159 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_db.sqlalchemy.engines [None req-f206d2ec-4f7a-4cd2-a5aa-56ea78a3550e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:38:04.260682 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.context [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),591cc087-7d9b-4967-a4cd-9c96e8077593(cell1) {{(pid=125825) load_cells /opt/stack/nova/nova/context.py:464}} Mar 05 20:38:04.264908 ncdv-master-1 devstack@n-api.service[125825]: DEBUG oslo_concurrency.lockutils [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:38:04.266750 ncdv-master-1 devstack@n-api.service[125825]: DEBUG oslo_concurrency.lockutils [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:38:04.267590 ncdv-master-1 devstack@n-api.service[125825]: DEBUG oslo_concurrency.lockutils [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:38:04.269529 ncdv-master-1 devstack@n-api.service[125825]: DEBUG oslo_concurrency.lockutils [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:38:04.277841 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.context [None req-f206d2ec-4f7a-4cd2-a5aa-56ea78a3550e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),591cc087-7d9b-4967-a4cd-9c96e8077593(cell1) {{(pid=125826) load_cells /opt/stack/nova/nova/context.py:464}} Mar 05 20:38:04.280488 ncdv-master-1 devstack@n-api.service[125825]: DEBUG oslo_db.sqlalchemy.engines [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:38:04.282193 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_concurrency.lockutils [None req-f206d2ec-4f7a-4cd2-a5aa-56ea78a3550e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:38:04.282357 ncdv-master-1 devstack@n-api.service[125825]: DEBUG oslo_db.sqlalchemy.engines [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:38:04.283805 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_concurrency.lockutils [None req-f206d2ec-4f7a-4cd2-a5aa-56ea78a3550e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:38:04.284630 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_concurrency.lockutils [None req-f206d2ec-4f7a-4cd2-a5aa-56ea78a3550e None None] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:38:04.286577 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_concurrency.lockutils [None req-f206d2ec-4f7a-4cd2-a5aa-56ea78a3550e None None] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:38:04.300286 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_db.sqlalchemy.engines [None req-f206d2ec-4f7a-4cd2-a5aa-56ea78a3550e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:38:04.303034 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_db.sqlalchemy.engines [None req-f206d2ec-4f7a-4cd2-a5aa-56ea78a3550e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:38:04.449284 ncdv-master-1 devstack@n-api.service[125825]: DEBUG oslo_db.sqlalchemy.engines [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:38:04.466812 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_db.sqlalchemy.engines [None req-f206d2ec-4f7a-4cd2-a5aa-56ea78a3550e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:38:04.790620 ncdv-master-1 devstack@n-api.service[125825]: WARNING keystonemiddleware.auth_token [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 20:38:04.796390 ncdv-master-1 devstack@n-api.service[125826]: WARNING keystonemiddleware.auth_token [None req-f206d2ec-4f7a-4cd2-a5aa-56ea78a3550e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 20:38:04.797503 ncdv-master-1 devstack@n-api.service[125825]: WARNING keystonemiddleware.auth_token [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 20:38:04.802930 ncdv-master-1 devstack@n-api.service[125826]: WARNING keystonemiddleware.auth_token [None req-f206d2ec-4f7a-4cd2-a5aa-56ea78a3550e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 20:38:05.137694 ncdv-master-1 devstack@n-api.service[125825]: WARNING keystonemiddleware.auth_token [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 20:38:05.142920 ncdv-master-1 devstack@n-api.service[125825]: WARNING keystonemiddleware.auth_token [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 20:38:05.148516 ncdv-master-1 devstack@n-api.service[125825]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f43d3369c0 pid: 125825 (default app) Mar 05 20:38:05.150580 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:38:05.151770 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001716 Mar 05 20:38:05.152188 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Sat Mar 5 20:38:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:38:05.157903 ncdv-master-1 devstack@n-api.service[125826]: WARNING keystonemiddleware.auth_token [None req-f206d2ec-4f7a-4cd2-a5aa-56ea78a3550e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 20:38:05.163030 ncdv-master-1 devstack@n-api.service[125826]: WARNING keystonemiddleware.auth_token [None req-f206d2ec-4f7a-4cd2-a5aa-56ea78a3550e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 20:38:05.169211 ncdv-master-1 devstack@n-api.service[125826]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f43d3369c0 pid: 125826 (default app) Mar 05 20:39:28.229032 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:28.230671 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Mar 05 20:39:28.231059 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:39:28.658823 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-e6cdc190-6e23-4095-9ea5-9ad7b23acea5 admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:28.688224 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-e6cdc190-6e23-4095-9ea5-9ad7b23acea5 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.450169 Mar 05 20:39:28.690336 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1291 bytes} [Sat Mar 5 20:39:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:39:31.112480 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:31.113998 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-68731901-2388-4d1b-86b3-0317ef313773 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002070 Mar 05 20:39:31.115701 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:39:31.175147 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-96efdf46-e1b2-453b-9979-8cc342f57ffd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "id": "c1"}} {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:31.198780 ncdv-master-1 devstack@n-api.service[125826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:39:31.198780 ncdv-master-1 devstack@n-api.service[125826]: warnings.warn(msg) Mar 05 20:39:31.231040 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-96efdf46-e1b2-453b-9979-8cc342f57ffd admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109914 Mar 05 20:39:31.231596 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1282 bytes} [Sat Mar 5 20:39:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 20:39:31.456961 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-c6c54146-3fcd-43f5-95c4-58d2340377d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:31.460131 ncdv-master-1 devstack@n-api.service[125825]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:39:31.460131 ncdv-master-1 devstack@n-api.service[125825]: warnings.warn(msg) Mar 05 20:39:31.510799 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-c6c54146-3fcd-43f5-95c4-58d2340377d8 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.271204 Mar 05 20:39:31.518188 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1335 bytes} [Sat Mar 5 20:39:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:39:33.930527 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-96efdf46-e1b2-453b-9979-8cc342f57ffd admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:33.931538 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-96efdf46-e1b2-453b-9979-8cc342f57ffd admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Mar 05 20:39:33.931970 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:39:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:39:34.033565 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-ff5af155-a46b-4963-97da-e5a6a50e4b93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 5, "id": "d1"}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:34.059630 ncdv-master-1 devstack@n-api.service[125825]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:39:34.059630 ncdv-master-1 devstack@n-api.service[125825]: warnings.warn(msg) Mar 05 20:39:34.072363 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-ff5af155-a46b-4963-97da-e5a6a50e4b93 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134656 Mar 05 20:39:34.072935 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1282 bytes} [Sat Mar 5 20:39:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:39:34.085019 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-2dd20d35-5833-472d-a327-381692b4ab17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:34.086497 ncdv-master-1 devstack@n-api.service[125826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:39:34.086497 ncdv-master-1 devstack@n-api.service[125826]: warnings.warn(msg) Mar 05 20:39:34.118756 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-2dd20d35-5833-472d-a327-381692b4ab17 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037624 Mar 05 20:39:34.119343 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1335 bytes} [Sat Mar 5 20:39:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:39:36.595961 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-ff5af155-a46b-4963-97da-e5a6a50e4b93 admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:36.597596 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-ff5af155-a46b-4963-97da-e5a6a50e4b93 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002139 Mar 05 20:39:36.598422 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:39:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:39:36.701728 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-a8b04363-7862-4928-b4ee-544c386dd4ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:36.722404 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-a8b04363-7862-4928-b4ee-544c386dd4ea admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.117093 Mar 05 20:39:36.730958 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1282 bytes} [Sat Mar 5 20:39:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:39:36.736155 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-c14621a6-00f5-42b8-a874-3343ceeb1ec9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:36.762769 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-c14621a6-00f5-42b8-a874-3343ceeb1ec9 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030703 Mar 05 20:39:36.764365 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1335 bytes} [Sat Mar 5 20:39:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:39:39.367484 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-a8b04363-7862-4928-b4ee-544c386dd4ea admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:39.369319 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-a8b04363-7862-4928-b4ee-544c386dd4ea admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002326 Mar 05 20:39:39.369904 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:39:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:39:39.438258 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-78d16f8e-ddba-400b-80dc-f75b4e8d847e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "swap": 0}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:39.459190 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-78d16f8e-ddba-400b-80dc-f75b4e8d847e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082527 Mar 05 20:39:39.466918 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1282 bytes} [Sat Mar 5 20:39:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:39:39.471947 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-3308169f-991e-4548-bd5e-f45eee974630 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:39.501457 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-3308169f-991e-4548-bd5e-f45eee974630 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033211 Mar 05 20:39:39.502907 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1335 bytes} [Sat Mar 5 20:39:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:39:42.154107 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-78d16f8e-ddba-400b-80dc-f75b4e8d847e admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:42.155305 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-78d16f8e-ddba-400b-80dc-f75b4e8d847e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Mar 05 20:39:42.165572 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:39:42 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:39:42.218448 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-56a7fbed-bace-4fab-9551-65f434516264 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "vcpus": 4, "id": "d4", "disk": 20}} {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:42.238422 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-56a7fbed-bace-4fab-9551-65f434516264 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077004 Mar 05 20:39:42.239360 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1282 bytes} [Sat Mar 5 20:39:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:39:42.251501 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-469b27bb-ec5f-4768-a0f6-084d92d9de6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:42.276644 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-469b27bb-ec5f-4768-a0f6-084d92d9de6b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028705 Mar 05 20:39:42.277599 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1335 bytes} [Sat Mar 5 20:39:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:39:44.830060 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-56a7fbed-bace-4fab-9551-65f434516264 admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:44.831066 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-56a7fbed-bace-4fab-9551-65f434516264 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Mar 05 20:39:44.831627 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:39:44.902466 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-64d6de08-5c49-425d-bae2-0d27f2d8bcb0 admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:44.927846 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-64d6de08-5c49-425d-bae2-0d27f2d8bcb0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.089552 Mar 05 20:39:44.928377 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1291 bytes} [Sat Mar 5 20:39:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:39:47.389620 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-56a7fbed-bace-4fab-9551-65f434516264 admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:47.390630 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-56a7fbed-bace-4fab-9551-65f434516264 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Mar 05 20:39:47.391029 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:39:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:39:47.451969 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-45143b39-1cea-4cc8-adcf-a6329bedd0b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1"}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:47.470080 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-45143b39-1cea-4cc8-adcf-a6329bedd0b9 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072025 Mar 05 20:39:47.471045 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1282 bytes} [Sat Mar 5 20:39:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:39:47.482459 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-4c254db6-f94d-403a-89fc-44bc70691102 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:47.505690 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-4c254db6-f94d-403a-89fc-44bc70691102 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026204 Mar 05 20:39:47.506631 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1332 bytes} [Sat Mar 5 20:39:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:39:50.241090 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-45143b39-1cea-4cc8-adcf-a6329bedd0b9 admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:50.242086 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-45143b39-1cea-4cc8-adcf-a6329bedd0b9 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Mar 05 20:39:50.242486 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:39:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:39:50.302447 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-63ebcc1a-38fa-4609-a24c-a3f2b5a2f264 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "swap": 0, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small"}} {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:50.319506 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-63ebcc1a-38fa-4609-a24c-a3f2b5a2f264 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070856 Mar 05 20:39:50.325204 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1282 bytes} [Sat Mar 5 20:39:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 20:39:50.348456 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-d4ae28f7-5d39-4d90-8f07-7a4206547d0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:50.370468 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-d4ae28f7-5d39-4d90-8f07-7a4206547d0c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025727 Mar 05 20:39:50.371005 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1332 bytes} [Sat Mar 5 20:39:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:39:53.018096 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-63ebcc1a-38fa-4609-a24c-a3f2b5a2f264 admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:53.019102 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-63ebcc1a-38fa-4609-a24c-a3f2b5a2f264 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Mar 05 20:39:53.019497 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:39:53.080540 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-39546411-39af-46b9-9a1f-ce9ff735a4c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "id": "3"}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:53.098780 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-39546411-39af-46b9-9a1f-ce9ff735a4c3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073274 Mar 05 20:39:53.099369 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1282 bytes} [Sat Mar 5 20:39:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:39:53.113324 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-9f43db72-6959-4eab-a668-adeed42dc740 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:53.136758 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-9f43db72-6959-4eab-a668-adeed42dc740 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027197 Mar 05 20:39:53.137340 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1332 bytes} [Sat Mar 5 20:39:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:39:55.993855 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-39546411-39af-46b9-9a1f-ce9ff735a4c3 admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:55.994804 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-39546411-39af-46b9-9a1f-ce9ff735a4c3 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Mar 05 20:39:55.995204 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:39:56.053424 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-b88ffbf8-afea-4f03-a645-0afb3b0754d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "vcpus": 4, "name": "m1.large", "swap": 0, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:56.070300 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-b88ffbf8-afea-4f03-a645-0afb3b0754d9 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069428 Mar 05 20:39:56.070839 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1282 bytes} [Sat Mar 5 20:39:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:39:56.082491 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-9ecc4731-c9a6-43c2-a42d-53f79923bdcd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:56.105523 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-9ecc4731-c9a6-43c2-a42d-53f79923bdcd admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026783 Mar 05 20:39:56.106088 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1332 bytes} [Sat Mar 5 20:39:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:39:58.523214 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-b88ffbf8-afea-4f03-a645-0afb3b0754d9 admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:39:58.524343 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-b88ffbf8-afea-4f03-a645-0afb3b0754d9 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Mar 05 20:39:58.524745 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:39:58.581530 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-df59fccb-4d87-4ad3-9908-e778a833dfbd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:58.598061 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-df59fccb-4d87-4ad3-9908-e778a833dfbd admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.067440 Mar 05 20:39:58.599129 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1282 bytes} [Sat Mar 5 20:39:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:39:58.611308 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-8df31ca4-ad06-4974-91a1-3d1c9527a69b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:39:58.634925 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-8df31ca4-ad06-4974-91a1-3d1c9527a69b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027131 Mar 05 20:39:58.635509 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1332 bytes} [Sat Mar 5 20:39:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:40:25.459812 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-df59fccb-4d87-4ad3-9908-e778a833dfbd admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:25.460812 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-df59fccb-4d87-4ad3-9908-e778a833dfbd admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Mar 05 20:40:25.461200 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:40:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:40:25.520028 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-e6870808-09f8-4abe-a00c-bce4df469982 admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:25.536486 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-e6870808-09f8-4abe-a00c-bce4df469982 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069625 Mar 05 20:40:25.537009 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1291 bytes} [Sat Mar 5 20:40:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:40:27.011974 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-df59fccb-4d87-4ad3-9908-e778a833dfbd admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:27.012965 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-df59fccb-4d87-4ad3-9908-e778a833dfbd admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Mar 05 20:40:27.013355 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Sat Mar 5 20:40:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:40:27.256058 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-62a1f9a5-cd17-4688-8c28-d9ecc9988ead admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:27.261397 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.wsgi [None req-62a1f9a5-cd17-4688-8c28-d9ecc9988ead admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 05 20:40:27.261964 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-62a1f9a5-cd17-4688-8c28-d9ecc9988ead admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=125826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:40:27.262755 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-62a1f9a5-cd17-4688-8c28-d9ecc9988ead admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058597 Mar 05 20:40:27.263261 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Sat Mar 5 20:40:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Mar 05 20:40:27.273641 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-aed9f8a4-fff0-47f6-a958-b6421dd2a4a2 admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:27.294590 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-aed9f8a4-fff0-47f6-a958-b6421dd2a4a2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025758 Mar 05 20:40:27.295130 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Sat Mar 5 20:40:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:40:27.309458 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-d8b1b124-fa36-4148-bca2-4dab93708766 admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:27.330646 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-d8b1b124-fa36-4148-bca2-4dab93708766 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024682 Mar 05 20:40:27.331164 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Sat Mar 5 20:40:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:40:27.341184 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-672f7577-23f0-4d13-92bd-99397cc09ca2 admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:27.346545 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.wsgi [None req-672f7577-23f0-4d13-92bd-99397cc09ca2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 05 20:40:27.347105 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-672f7577-23f0-4d13-92bd-99397cc09ca2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=125825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:40:27.348431 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-672f7577-23f0-4d13-92bd-99397cc09ca2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011018 Mar 05 20:40:27.348920 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Sat Mar 5 20:40:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 05 20:40:28.678335 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-d8b1b124-fa36-4148-bca2-4dab93708766 admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:28.679337 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-d8b1b124-fa36-4148-bca2-4dab93708766 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Mar 05 20:40:28.679758 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Sat Mar 5 20:40:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:40:28.877758 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-b25216db-a42d-4100-b7fb-78a1e51b301e admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:28.883060 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.wsgi [None req-b25216db-a42d-4100-b7fb-78a1e51b301e admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 05 20:40:28.883622 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-b25216db-a42d-4100-b7fb-78a1e51b301e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=125825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:40:28.884455 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-b25216db-a42d-4100-b7fb-78a1e51b301e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059182 Mar 05 20:40:28.884974 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Sat Mar 5 20:40:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 05 20:40:28.894906 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-55861ee5-c46e-4808-986c-7ce38ca464f2 admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:28.909730 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-55861ee5-c46e-4808-986c-7ce38ca464f2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019077 Mar 05 20:40:28.910927 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Sat Mar 5 20:40:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:40:28.920610 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-bb76318b-5132-492b-bcfa-dfdfe27b58c2 admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:28.935920 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-bb76318b-5132-492b-bcfa-dfdfe27b58c2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018792 Mar 05 20:40:28.936457 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Sat Mar 5 20:40:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:40:28.945557 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-3ea04456-0e05-4808-a61b-6ab55b09f533 admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:28.950657 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.wsgi [None req-3ea04456-0e05-4808-a61b-6ab55b09f533 admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 05 20:40:28.951204 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-3ea04456-0e05-4808-a61b-6ab55b09f533 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=125826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:40:28.952006 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-3ea04456-0e05-4808-a61b-6ab55b09f533 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009944 Mar 05 20:40:28.952486 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Sat Mar 5 20:40:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Mar 05 20:40:30.289986 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-bb76318b-5132-492b-bcfa-dfdfe27b58c2 admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:30.291280 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-bb76318b-5132-492b-bcfa-dfdfe27b58c2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Mar 05 20:40:30.291663 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Sat Mar 5 20:40:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:40:30.489525 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-006a31c8-d931-4c44-b505-0e193252b237 admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:30.494664 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.wsgi [None req-006a31c8-d931-4c44-b505-0e193252b237 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 05 20:40:30.495226 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-006a31c8-d931-4c44-b505-0e193252b237 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=125826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:40:30.496049 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-006a31c8-d931-4c44-b505-0e193252b237 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057994 Mar 05 20:40:30.496557 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 20:40:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 05 20:40:30.506530 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-36c93a88-a2cd-407d-be3e-6992084d70ce admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:30.519933 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-36c93a88-a2cd-407d-be3e-6992084d70ce admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017694 Mar 05 20:40:30.520467 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Sat Mar 5 20:40:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:40:30.530848 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:30.544097 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017564 Mar 05 20:40:30.544616 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Sat Mar 5 20:40:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:40:30.554958 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-9947f102-7200-4d06-a299-5eafc348649f admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:30.560165 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.wsgi [None req-9947f102-7200-4d06-a299-5eafc348649f admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 05 20:40:30.560720 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-9947f102-7200-4d06-a299-5eafc348649f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=125825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:40:30.561490 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-9947f102-7200-4d06-a299-5eafc348649f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011070 Mar 05 20:40:30.561975 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 20:40:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Mar 05 20:40:31.898374 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:31.899388 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Mar 05 20:40:31.899840 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Sat Mar 5 20:40:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:40:32.099282 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-05fd97f2-62f1-442b-94df-2f2c9d29dfda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:40:32.116416 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-05fd97f2-62f1-442b-94df-2f2c9d29dfda admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069230 Mar 05 20:40:32.116957 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Sat Mar 5 20:40:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:40:33.449702 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:33.450703 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Mar 05 20:40:33.451101 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Sat Mar 5 20:40:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:40:33.651532 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-c594ad2f-7333-4c7b-8d5a-77db4796ba16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:40:33.668561 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-c594ad2f-7333-4c7b-8d5a-77db4796ba16 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068542 Mar 05 20:40:33.669036 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Sat Mar 5 20:40:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:40:35.015349 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:35.016384 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Mar 05 20:40:35.016775 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Sat Mar 5 20:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:40:35.213305 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-7b2f2fba-2a54-42a3-babb-08ba133d4f6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:40:35.230270 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-7b2f2fba-2a54-42a3-babb-08ba133d4f6d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069669 Mar 05 20:40:35.230797 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Sat Mar 5 20:40:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:40:36.562517 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:36.563508 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Mar 05 20:40:36.563937 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Sat Mar 5 20:40:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:40:36.777574 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-db310f65-7a2f-4225-aff1-44bccc52d8d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:40:36.795948 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-db310f65-7a2f-4225-aff1-44bccc52d8d7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.081684 Mar 05 20:40:36.796495 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Sat Mar 5 20:40:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:40:38.140698 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:38.141690 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Mar 05 20:40:38.142079 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Sat Mar 5 20:40:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:40:38.335933 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-3fa1b7ad-ff6b-4d23-a00c-286c66fd7236 admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:40:38.355250 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-3fa1b7ad-ff6b-4d23-a00c-286c66fd7236 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069544 Mar 05 20:40:38.355731 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Sat Mar 5 20:40:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:41:31.248102 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:41:31.249112 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-7ee51535-49e8-408b-b182-9c22ce5c771b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Mar 05 20:41:31.249510 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 930 bytes} [Sat Mar 5 20:41:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:41:31.306463 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-22d7df38-412a-4321-b212-4d43833dcbda admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:41:31.325903 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-22d7df38-412a-4321-b212-4d43833dcbda admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069573 Mar 05 20:41:31.326439 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1291 bytes} [Sat Mar 5 20:41:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:41:31.349731 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-6cc87066-262e-4153-a7ab-24f717ef3a53 admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:41:31.357177 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-6cc87066-262e-4153-a7ab-24f717ef3a53 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012054 Mar 05 20:41:31.357690 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1282 bytes} [Sat Mar 5 20:41:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:41:31.369841 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-57f38702-d4d6-4583-90dd-e645e12e78ee admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:41:31.378354 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-57f38702-d4d6-4583-90dd-e645e12e78ee admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012038 Mar 05 20:41:31.378897 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1285 bytes} [Sat Mar 5 20:41:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:41:31.390247 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-ee739cb0-9004-4cfa-a4ff-9a32d48515cd admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:41:31.401457 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-ee739cb0-9004-4cfa-a4ff-9a32d48515cd admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014876 Mar 05 20:41:31.401982 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1285 bytes} [Sat Mar 5 20:41:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:41:31.413389 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-64dc0bce-0b6d-4a43-981b-d90a2b09dc14 admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:41:31.421089 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-64dc0bce-0b6d-4a43-981b-d90a2b09dc14 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011270 Mar 05 20:41:31.421603 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1282 bytes} [Sat Mar 5 20:41:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:43:03.664756 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-df637895-791f-4fb1-b1e9-262dd67ead65 tempest-verify_tempest_config-469199531 tempest-verify_tempest_config-469199531-project] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:43:03.666662 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-df637895-791f-4fb1-b1e9-262dd67ead65 tempest-verify_tempest_config-469199531 tempest-verify_tempest_config-469199531-project] 10.222.0.15 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.110074 Mar 05 20:43:03.667192 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 34/69] 10.222.0.15 () {58 vars in 1133 bytes} [Sat Mar 5 20:43:03 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:46:48.968975 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-64dc0bce-0b6d-4a43-981b-d90a2b09dc14 admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:46:48.970060 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-64dc0bce-0b6d-4a43-981b-d90a2b09dc14 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Mar 05 20:46:48.970713 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 36/70] 10.222.0.15 () {56 vars in 1074 bytes} [Sat Mar 5 20:46:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:46:49.225413 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-38a23a5e-1d5b-4ea9-bec7-7818d130d4cf admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:46:49.226545 ncdv-master-1 devstack@n-api.service[125826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:46:49.226545 ncdv-master-1 devstack@n-api.service[125826]: warnings.warn(msg) Mar 05 20:46:49.227749 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_concurrency.lockutils [None req-38a23a5e-1d5b-4ea9-bec7-7818d130d4cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:46:49.228185 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_concurrency.lockutils [None req-38a23a5e-1d5b-4ea9-bec7-7818d130d4cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:46:49.228949 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_concurrency.lockutils [None req-38a23a5e-1d5b-4ea9-bec7-7818d130d4cf admin admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:46:49.229367 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_concurrency.lockutils [None req-38a23a5e-1d5b-4ea9-bec7-7818d130d4cf admin admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:46:49.267695 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-38a23a5e-1d5b-4ea9-bec7-7818d130d4cf admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.153977 Mar 05 20:46:49.268248 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 35/71] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 20:46:49 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:46:50.650202 ncdv-master-1 devstack@n-api.service[125825]: DEBUG nova.api.openstack.wsgi [None req-64dc0bce-0b6d-4a43-981b-d90a2b09dc14 admin admin] Calling method '>' {{(pid=125825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:46:50.651194 ncdv-master-1 devstack@n-api.service[125825]: INFO nova.api.openstack.requestlog [None req-64dc0bce-0b6d-4a43-981b-d90a2b09dc14 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Mar 05 20:46:50.651848 ncdv-master-1 devstack@n-api.service[125825]: [pid: 125825|app: 0|req: 37/72] 10.222.0.15 () {56 vars in 1074 bytes} [Sat Mar 5 20:46:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:46:50.848564 ncdv-master-1 devstack@n-api.service[125826]: DEBUG nova.api.openstack.wsgi [None req-d96e92ab-b7ad-44c4-aa01-d2d60d949327 admin admin] Calling method '>' {{(pid=125826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:46:50.849729 ncdv-master-1 devstack@n-api.service[125826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:46:50.849729 ncdv-master-1 devstack@n-api.service[125826]: warnings.warn(msg) Mar 05 20:46:50.850916 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_concurrency.lockutils [None req-d96e92ab-b7ad-44c4-aa01-d2d60d949327 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:46:50.851383 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_concurrency.lockutils [None req-d96e92ab-b7ad-44c4-aa01-d2d60d949327 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:46:50.852188 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_concurrency.lockutils [None req-d96e92ab-b7ad-44c4-aa01-d2d60d949327 admin admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:46:50.852634 ncdv-master-1 devstack@n-api.service[125826]: DEBUG oslo_concurrency.lockutils [None req-d96e92ab-b7ad-44c4-aa01-d2d60d949327 admin admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:46:50.875319 ncdv-master-1 devstack@n-api.service[125826]: INFO nova.api.openstack.requestlog [None req-d96e92ab-b7ad-44c4-aa01-d2d60d949327 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.079372 Mar 05 20:46:50.875840 ncdv-master-1 devstack@n-api.service[125826]: [pid: 125826|app: 0|req: 36/73] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 20:46:50 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:47:38.698262 ncdv-master-1 devstack@n-api.service[125824]: Sat Mar 5 20:47:38 2022 - graceful shutdown triggered... Mar 05 20:47:38.698876 ncdv-master-1 devstack@n-api.service[125825]: Gracefully killing worker 1 (pid: 125825)... Mar 05 20:47:38.698387 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Mar 05 20:47:38.699784 ncdv-master-1 devstack@n-api.service[125826]: Gracefully killing worker 2 (pid: 125826)... Mar 05 20:47:39.699391 ncdv-master-1 devstack@n-api.service[125824]: worker 1 buried after 1 seconds Mar 05 20:47:39.699391 ncdv-master-1 devstack@n-api.service[125824]: worker 2 buried after 1 seconds Mar 05 20:47:39.699391 ncdv-master-1 devstack@n-api.service[125824]: goodbye to uWSGI. Mar 05 20:47:39.700947 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Mar 05 20:47:39.701521 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Mar 05 20:47:39.704283 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Mar 05 20:47:39.759139 ncdv-master-1 devstack@n-api.service[141469]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Mar 5 20:47:39 2022] *** Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: nodename: ncdv-master-1 Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: machine: x86_64 Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: clock source: unix Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: pcre jit disabled Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: detected number of CPU cores: 4 Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: current working directory: / Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: detected binary path: /usr/bin/uwsgi-core Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: your processes number limit is 47680 Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: your memory page size is 4096 bytes Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: detected max file descriptor number: 2048 Mar 05 20:47:39.808654 ncdv-master-1 devstack@n-api.service[141469]: lock engine: pthread robust mutexes Mar 05 20:47:39.809784 ncdv-master-1 devstack@n-api.service[141469]: thunder lock: enabled Mar 05 20:47:39.809784 ncdv-master-1 devstack@n-api.service[141469]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 05 20:47:39.809784 ncdv-master-1 devstack@n-api.service[141469]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 05 20:47:39.859342 ncdv-master-1 devstack@n-api.service[141469]: Python main interpreter initialized at 0x5611b1e9f9c0 Mar 05 20:47:39.859342 ncdv-master-1 devstack@n-api.service[141469]: python threads support enabled Mar 05 20:47:39.859342 ncdv-master-1 devstack@n-api.service[141469]: your server socket listen backlog is limited to 100 connections Mar 05 20:47:39.859342 ncdv-master-1 devstack@n-api.service[141469]: your mercy for graceful operations on workers is 90 seconds Mar 05 20:47:39.859768 ncdv-master-1 devstack@n-api.service[141469]: mapped 403077 bytes (393 KB) for 2 cores Mar 05 20:47:39.859849 ncdv-master-1 devstack@n-api.service[141469]: *** Operational MODE: preforking *** Mar 05 20:47:39.860087 ncdv-master-1 devstack@n-api.service[141469]: *** uWSGI is running in multiple interpreter mode *** Mar 05 20:47:39.860087 ncdv-master-1 devstack@n-api.service[141469]: spawned uWSGI master process (pid: 141469) Mar 05 20:47:39.860293 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Mar 05 20:47:39.860883 ncdv-master-1 devstack@n-api.service[141469]: spawned uWSGI worker 1 (pid: 141478, cores: 1) Mar 05 20:47:39.861794 ncdv-master-1 devstack@n-api.service[141469]: spawned uWSGI worker 2 (pid: 141479, cores: 1) Mar 05 20:47:39.861794 ncdv-master-1 devstack@n-api.service[141469]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 05 20:47:41.876097 ncdv-master-1 devstack@n-api.service[141479]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 20:47:41.876097 ncdv-master-1 devstack@n-api.service[141479]: from cryptography.utils import int_from_bytes Mar 05 20:47:41.876892 ncdv-master-1 devstack@n-api.service[141479]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 20:47:41.876892 ncdv-master-1 devstack@n-api.service[141479]: from cryptography.utils import int_from_bytes Mar 05 20:47:41.886723 ncdv-master-1 devstack@n-api.service[141478]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 20:47:41.886723 ncdv-master-1 devstack@n-api.service[141478]: from cryptography.utils import int_from_bytes Mar 05 20:47:41.887240 ncdv-master-1 devstack@n-api.service[141478]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 20:47:41.887240 ncdv-master-1 devstack@n-api.service[141478]: from cryptography.utils import int_from_bytes Mar 05 20:47:44.326554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 05 20:47:44.327213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 05 20:47:44.327213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 05 20:47:44.327805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 05 20:47:44.327960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 05 20:47:44.328045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 05 20:47:44.328045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 05 20:47:44.328192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 05 20:47:44.328276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 05 20:47:44.328351 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 05 20:47:44.328429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.328508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.328647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.328745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.328973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.329079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.329300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.329406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.329635 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.329739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.329951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.330046 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.330276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.330376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.330602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.330695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.330936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.331034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.331190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.331287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.331515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.331612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.331879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.331978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.332210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.332320 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.332524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.332623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.332842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.332937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.333163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.333259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.333518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.333612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.333852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.334048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.334309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.334409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.334817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.334932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.335264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.335391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.335589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.335752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.335945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.336123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.336244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.336364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.336589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.336735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.336874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.336960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.337196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.337297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.337515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.337670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.337844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.337952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.338159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.338262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.338563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.338653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.338888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.339038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.339210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.339306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.339528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.339627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.339983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.340075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.340303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.340406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.340620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.340719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.340949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.341082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.341280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.341381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.341595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.341693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.341930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.342018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.342258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.342379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.342586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.342697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.342916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.343065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.343219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.343318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.343534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.343633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.343879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.343972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.344206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.344340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.344517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.344621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.344827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.344922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.345079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.345177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.345394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.345498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.345725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.345812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.346055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.346173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.346385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.346523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.346635 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.346746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.346881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.347230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.347230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.347436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.347520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.347625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.347870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.348705 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.348857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.348978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.349086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.349201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.349315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.349441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.349564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.349680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.349795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.349909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.350023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.350144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.350268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.350380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.350492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.350599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.350806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.350923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.351140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.351263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.351458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.351583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.351815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.351945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.352228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.352360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.353566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.353699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.353821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.353957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.354062 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.354154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.354236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.354356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.354570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.354675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.354758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.354846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.354936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.355034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.355116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.355202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.355283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.355362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.355453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.355541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.355628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.355745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.355926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.356017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.356244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.356359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.356500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.356601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.356815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.356954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.357130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.357270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.357461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.357564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.357777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.357943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.358094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.358184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.358409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.358499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.358718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.358821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.359030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.359120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.359346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.359452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.359659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.359783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.360000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.360094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.360312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.360409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.360625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.360721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.360940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.361027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.361252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.361348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.361565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.361707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.361894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.361991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.362221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.362307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.362539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.362626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.362848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.362989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.363165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.363263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.363475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.363624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.363829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.364003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.364143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.364237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.364458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.364553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.365445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.365612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.365780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.365922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.366089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.366181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.366420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.366522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.366736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.366839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.367056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.367165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.367381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.367528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.367715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.367830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.368036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.368131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.368364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.368452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.368680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.368779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.368994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.369091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.369306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.369395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.369619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.369715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.369925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.370021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.370239 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.370327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.370553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.370654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.370861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.370947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.371167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.371267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.371492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.371592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.371850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.371951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.372176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.372265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.372499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.372593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.372817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.372912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.373146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.373289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 20:47:44.373491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.373581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.373834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.373921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.374182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.374275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.374505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.374600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.374848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.374945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.375192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.375287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.375516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.375610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.375865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.375956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.376189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.376294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.376515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.376621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.376829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.376929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.377152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.377270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.377467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.377637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.377796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.377919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.378118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.378254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.378456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.378592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.378780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.378897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.379208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.379350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.379469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.379586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.379765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.379880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.380065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.380240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.381016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.381307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.381488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.381612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.381728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.381850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.381969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.382395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.382509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.382595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.382801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.382910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.383135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.383281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.383479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.383594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.383845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.383978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.384141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.384268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.384471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.384564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.384791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.384880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.385121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.385218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.385451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.385540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.385771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.385861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.386092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.386182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.386412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.386502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.386731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.386832 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.387051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.387148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.387373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.387479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.387730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.387913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.389530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.389637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.389724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.389814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.389896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.389985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.390077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.390171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.390262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.390359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.390448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.390530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.390617 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.390705 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.390786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.390873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.390953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.391040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.391120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.391198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.391284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.391373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.391530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.391713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.392036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.392187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.392367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.392524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.392702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.392825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.393024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.393135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.393370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.393478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.394003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.394118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.394118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.394268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.394373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.394464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.394605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.394769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.394924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.395019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.395236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.395327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.395555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.395644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.395974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.396113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.396317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.396533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.396832 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.397001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.397157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.397257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.397473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.397569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.397802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.397902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.398118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.398217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.398439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.398535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.398760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.398848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.399080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.399180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.399405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.399501 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.399750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.399855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.400074 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.400173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.400398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.400494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.400726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.400813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.401037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.401125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.401367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.401465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.401699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.401787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.402024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.402122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.402335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.402432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.402665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.402777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.402957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.403048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.403267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.403371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.403577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.403690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.403929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.404041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.404243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.404344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.404552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.404651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.404863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.404992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.405172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.405263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.405482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.405585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.405812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.405901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.406123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.406218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.406431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.406527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.406743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.406839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.407052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.407152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.407370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.407460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.407743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.407853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.408064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.408153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.408379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.408726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.408975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.409070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.409308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.409397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.409629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.409726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.409953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.410050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.410272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.410377 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.410591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.410683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.410909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.411005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.411232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.411366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.411589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.411760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.411934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.412175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.412255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.412516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.412606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.412848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.412939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.413182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.413273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.413506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.413604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.413819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.413909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.414143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.414251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.414471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.414577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.414790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.414880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.415120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.415209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.415442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.415537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.415790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.415921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.416113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.416239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.416430 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.416531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.416749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.416848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.417068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.417171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.417385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.417481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.417703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.417804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.418035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.418154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.418341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.418434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.418650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.418745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.418981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.419079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.419297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.419393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.419615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.419727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.419955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.420100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.420275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.420376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.420600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.420695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.420919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.421009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.421236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.421330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.421555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.421653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.421882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.421981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.422198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.422295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.422514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.422649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.422874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.422996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.423131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.423231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.423443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.423571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.423786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.423914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.424115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.424242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.424425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.424672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.424793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.424909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.425058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.425167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.425369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.425494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.425692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.425808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.426010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.426133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.426335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.426460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.426652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.426766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.426963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.427586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.427862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.428018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.428178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.428298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.428514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.428630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.428828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.428957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.429143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.429334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.429479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.429602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.429793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.429932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.430102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.430223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.430415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.430556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.430728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.430852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.431042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.431163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.431361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.431531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.431644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.431751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.432015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.432213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.432337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.432448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.432652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.432748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.432976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.433101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.433294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.433472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.433611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.433701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.433932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.434020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.434250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.434348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.434569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.434667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.434887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.434976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.435207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.435305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.435519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.435607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.435860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.435980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.436196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.436311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.436512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.436610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.436828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.437000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.437146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.437656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.437851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.437964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.438049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.438130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.438220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.438308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.438390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.438654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.438753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.438995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.439093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.439320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.439583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.439746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.439960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.440087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.440293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.440394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.440626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.440732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.440959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.441113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.441285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.441425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.441607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.441696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.441927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.442079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.442239 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.442382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.442551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.442683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.443603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.443807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.443930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.444006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.444170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.444352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.444490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.444581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.444809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.445006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.445159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.445328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.445433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.445531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.445710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.445804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.446022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.446122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.446331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.446429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.446642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.446728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.446953 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.447040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.447262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.447364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.447579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.447716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.447927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.448024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.448239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.448341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.448547 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.448635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.448857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.448946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.449188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.449276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.449501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.449597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.449816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.449904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.450164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.450251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.450477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.450572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.450813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.450908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.451164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.451302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.451452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.451545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.451797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.451891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.452112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.452203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.452424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.452514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.452742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.452841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.453052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.453174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.453355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.453454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.453672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.453808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.453985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.454072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.454292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.454387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.454606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.454707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.454917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.455014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.455266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.455375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.455535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.455639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.455869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.455960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.456185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.456274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.456496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.456584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.456801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.456889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.457119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.457208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.457429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.457525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.457734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.457829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.458051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.458176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.458381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.458544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.458707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.458987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.459076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.459166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.459312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.459412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.459623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.459748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.459982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.460079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.460296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.460391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.460605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.460703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.460920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.461019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.461275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.461429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.461546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.461662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.461841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.461947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.462158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.462283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.462468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.462563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.462776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.462873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.463090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.463187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.463400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.463487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.463735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.463877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.464053 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.464153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.464372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.464461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.464684 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.464774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.464994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.465082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.465301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.465469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.465613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.465708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.465918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.466004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.466226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.466322 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.466537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.466626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.466845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.466932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.467151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.467248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.467459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.467624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.467896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.467987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.468212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.468355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.468524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.468661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.468862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.469163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.469270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.469521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.469839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.470210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.470527 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.470855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.471183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.471772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.471891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.471969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.472040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.472164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.472483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.472580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.472812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.472913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.473136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.473228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.473463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.473579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.473773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.473867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.474279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.474384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.474590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.474682 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.474928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.475091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.475266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.475424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.475593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.475800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.476078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.476251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.476409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.476559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.476736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.477017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.477139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.477242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.477372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.477504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.477688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.477788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.478013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.478103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.478334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.478433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.478656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.478746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.478979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.479067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.479302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.479472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.479627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.479775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.479976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.480064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.480292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.480391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.480612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.480702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.480932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.481029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.481246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.481335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.481568 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.481692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.481889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.481980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.482204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.482428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.482519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.482598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.482824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.482913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.483143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.483233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.483456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.483561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.483804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.483942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.484129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.484256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.484474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.484572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.484803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.484902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.485125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.485213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.485453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.485541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.485776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.485873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.486103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.486199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.486419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.486516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.486847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.486949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.487172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.487268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.487495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.487601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.487844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.487948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.488161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.488251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.488487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.488642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.488828 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.488972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.489159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.489310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.489479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.490147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.490464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.490668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.490787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.491104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.491257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.491419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.491540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.492501 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.492637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.492637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.492786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.492866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.492971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.493051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.493122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.493199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.493270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.493348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.493522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.493644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.493958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.494097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.494297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.494440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.494619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.494776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.494957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.495113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.495394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.495503 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.495753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.495849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.496072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.496173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.496408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.496510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.496743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.496839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.497067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.497166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.497392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.497492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.497707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.497805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.498042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.498140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.498381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.498471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.498705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.498797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.499024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.499133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.499387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.499525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.499734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.499865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.500064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.500179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.500396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.500514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.500732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.501050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.501363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.501526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.501693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.501843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.501999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.502181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.502344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.502501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.502663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.502842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.503058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.503254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.503425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.503687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.503877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.504027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.504175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.504401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.504747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.505069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.506007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.506339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.506665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.506991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.507335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.507659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.507962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.508089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.508321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.508515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.508633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.508748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.508952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.509076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.509784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.509920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.510041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.510152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.510260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.510367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.510483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.510593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.510709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.510824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.510944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.511060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.511179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.511388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.511509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.511818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.511994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.512144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.512302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.512532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.512683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.512830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.512978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.513138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.513296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.513462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.513661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.513891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.514044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.514200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.514350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.514505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.514653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.514806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.514961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.515117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.515309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.515587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.515799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.515991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.516323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.516547 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.516702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.516903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.517058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.517257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.517428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.517577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.517757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.517907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.518073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.518222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.518379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.518537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.518693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.518841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.518989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.519143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.519303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.519452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.519607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.519793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.519952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.520111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.520322 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.520658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.521380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.521676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.521833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.521989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.522139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.522294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.522450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.522606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.522763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.522956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.523131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.523926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.524158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.524314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.524462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.524625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.524782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.524930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.524930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.525267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.525428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.525585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.525732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.525895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.526072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.526072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.526380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.526540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.526540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.526827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.526984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.527131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.527448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.527610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.527809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.527982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.528139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.528295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.528453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.528633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.528789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.528978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.529298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.529539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.529702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.529851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.530006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.530155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.530323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.530481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.530639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.530831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.530986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.531171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.531334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.531496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.531644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.531848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.532002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.532162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.532318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.532490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.532804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.532963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.533139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.533294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.533728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.534083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.534331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.534493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.534725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.534878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.535035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.535201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.535359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.535747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.535909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.536069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.536266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.536441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.537461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.537622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.537948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.538153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.538304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.538466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.538628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.538778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.538924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.539080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.539080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.539368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.539524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.539699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.539865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.540016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.540164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.540322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.540479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.540629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.540789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.540938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.541094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.541250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.541405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.541561 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.541721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.542492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.542653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.542816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.542972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.542972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.543277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.543424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.543571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.543769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.543932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.544090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.544238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.544484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.544639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.544841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.544992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.545154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.545310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.545466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.545614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.545769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.545996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.546146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.546327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.546650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.546813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.546962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.547129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.547279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.547567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.547756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.547938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.548096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.548258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.548456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.548616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.548764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.548948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.549108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.549291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.549458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.549630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.549794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.550111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.550271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.550454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.550609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.550785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.550939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.551096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.551256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.551413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.551583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.551767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.551919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.552104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.552396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.552557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.552715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.552864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.553010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.553167 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.553317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.553464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.553617 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.553776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.553932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.554154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.554305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.554485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.554716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.554870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.554870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.555175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.555325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.555472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.555618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.555861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.556021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.556179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.556336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.556484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.557298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.557298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.557615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.557766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.557766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.558065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.558213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.558379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.558553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.558702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.558848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.559002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.559150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.559150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.559438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.559593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.559775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.559926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.560072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.560227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.560383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.560543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.560700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.560847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.561003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.561160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.561307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.561463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.561612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.561758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.561911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.562067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.562222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.562378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.562545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.562702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.562858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.563016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.563163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.563318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.563474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.563623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.563914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.564084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.564242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.564462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.564636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.564908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.565146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.565309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.565557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.565712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.565867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.566179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.566342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.566500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.566648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.566805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.567068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.567233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.567389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.567537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.567826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.568034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.568185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.568345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.568494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.568671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.568834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.568990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.569137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.569316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.569489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.569638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.569793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.569950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.570099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.570295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.570458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.570607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.570755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.570952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.571114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.571272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.571437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.571592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.571768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.571943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.572113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.572263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.572418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.572575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.572730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.572879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.573040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.573197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.573346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.573504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.573653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.573809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.574123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.574279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.574429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.574582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.574732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.574907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.575162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.575329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.575487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.575720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.575880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.576146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.576301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.576470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.576676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.576842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.577182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.577354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.577503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.577651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.577800 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.578067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.578232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.578413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.578578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.578727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.578873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.579062 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.579232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.579385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.579610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.579798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.579959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.580107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.580281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.580440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.580596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.580752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.580902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.581056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.581216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.581373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.581520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.581668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.581816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.581975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.582123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.582281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.582439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.582595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.582751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.582913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.583069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.583217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.583937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.584101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.584257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.584413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.584563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.584721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.584869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.585023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.585260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.585424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.585573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.585720 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.585867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.586022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.586315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.586481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.586639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.586795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.586957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.587218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.587384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.587612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.587806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.587965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.588201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.588355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.588549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.588713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.588862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.589017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.589195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.589368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.589517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.589671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.589843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.590003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.590160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.590322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.590678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.590836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.590985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.591131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.591278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.591450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.591600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.591827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.591979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.592127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.592288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.592436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.592591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.592739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.592894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.593054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.593218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.593367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.593531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.593687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.593844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.594002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.594204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.594361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.594509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.594656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.594803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.594950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.595106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.595280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.595531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.595531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.595903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.596074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.596232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.596387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.596536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.596691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.596839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.596994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.597144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.597394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.597558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.597717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.597956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.598121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.598277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.598426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.598579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.598734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.598891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.599738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.599915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.600078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.600296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.600461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.600625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.600775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.600921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.601069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.601215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.601417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.601582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.601740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.601896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.602045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.602200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.602398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.602577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.602726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.602881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.603036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.603232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.603399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 05 20:47:44.603549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.603760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.604094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.604437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.604767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.605109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.605685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.606036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.606651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.607011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.607649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.608009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.608798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.608981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.609313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.609653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.610007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.610356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.610686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.611035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.611420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.611747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.612087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.612420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.612771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.613103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.613433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.613768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.614097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.614427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.614822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.615162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.615510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.616093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.616724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.617085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.617772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.618109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.618714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.619078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.619415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.619773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.620100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 20:47:44.620361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 05 20:47:44.626679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_db.sqlalchemy.engines [None req-585dfa89-980a-4daa-a072-24c0fa350f0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:47:44.648606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_db.sqlalchemy.engines [None req-49edd921-5b61-404c-adea-fbdb8f5483cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:47:44.695061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.context [None req-585dfa89-980a-4daa-a072-24c0fa350f0a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),591cc087-7d9b-4967-a4cd-9c96e8077593(cell1) {{(pid=141479) load_cells /opt/stack/nova/nova/context.py:464}} Mar 05 20:47:44.699316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-585dfa89-980a-4daa-a072-24c0fa350f0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:47:44.700953 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-585dfa89-980a-4daa-a072-24c0fa350f0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:47:44.701781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-585dfa89-980a-4daa-a072-24c0fa350f0a None None] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:47:44.703784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-585dfa89-980a-4daa-a072-24c0fa350f0a None None] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:47:44.715772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_db.sqlalchemy.engines [None req-585dfa89-980a-4daa-a072-24c0fa350f0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:47:44.715891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.context [None req-49edd921-5b61-404c-adea-fbdb8f5483cb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),591cc087-7d9b-4967-a4cd-9c96e8077593(cell1) {{(pid=141478) load_cells /opt/stack/nova/nova/context.py:464}} Mar 05 20:47:44.720257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49edd921-5b61-404c-adea-fbdb8f5483cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:47:44.722022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49edd921-5b61-404c-adea-fbdb8f5483cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:47:44.722879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49edd921-5b61-404c-adea-fbdb8f5483cb None None] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:47:44.725159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49edd921-5b61-404c-adea-fbdb8f5483cb None None] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:47:44.736231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_db.sqlalchemy.engines [None req-49edd921-5b61-404c-adea-fbdb8f5483cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:47:44.738114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_db.sqlalchemy.engines [None req-49edd921-5b61-404c-adea-fbdb8f5483cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:47:44.861528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_db.sqlalchemy.engines [None req-585dfa89-980a-4daa-a072-24c0fa350f0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:47:44.881249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_db.sqlalchemy.engines [None req-585dfa89-980a-4daa-a072-24c0fa350f0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:47:44.903922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_db.sqlalchemy.engines [None req-49edd921-5b61-404c-adea-fbdb8f5483cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 20:47:45.332740 ncdv-master-1 devstack@n-api.service[141479]: WARNING keystonemiddleware.auth_token [None req-585dfa89-980a-4daa-a072-24c0fa350f0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 20:47:45.340422 ncdv-master-1 devstack@n-api.service[141479]: WARNING keystonemiddleware.auth_token [None req-585dfa89-980a-4daa-a072-24c0fa350f0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 20:47:45.347905 ncdv-master-1 devstack@n-api.service[141478]: WARNING keystonemiddleware.auth_token [None req-49edd921-5b61-404c-adea-fbdb8f5483cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 20:47:45.355395 ncdv-master-1 devstack@n-api.service[141478]: WARNING keystonemiddleware.auth_token [None req-49edd921-5b61-404c-adea-fbdb8f5483cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 20:47:45.581792 ncdv-master-1 devstack@n-api.service[141479]: WARNING keystonemiddleware.auth_token [None req-585dfa89-980a-4daa-a072-24c0fa350f0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 20:47:45.582999 ncdv-master-1 devstack@n-api.service[141478]: WARNING keystonemiddleware.auth_token [None req-49edd921-5b61-404c-adea-fbdb8f5483cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 20:47:45.588023 ncdv-master-1 devstack@n-api.service[141479]: WARNING keystonemiddleware.auth_token [None req-585dfa89-980a-4daa-a072-24c0fa350f0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 20:47:45.589128 ncdv-master-1 devstack@n-api.service[141478]: WARNING keystonemiddleware.auth_token [None req-49edd921-5b61-404c-adea-fbdb8f5483cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 20:47:45.594028 ncdv-master-1 devstack@n-api.service[141479]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611b1e9f9c0 pid: 141479 (default app) Mar 05 20:47:45.594595 ncdv-master-1 devstack@n-api.service[141478]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611b1e9f9c0 pid: 141478 (default app) Mar 05 20:48:30.167429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fa77d754-4e8e-4314-8f6f-0714344b6d3a tempest-InstanceUsageAuditLogTestJSON-1825115862 tempest-InstanceUsageAuditLogTestJSON-1825115862-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:30.169465 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:30.169465 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:30.190780 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fa77d754-4e8e-4314-8f6f-0714344b6d3a tempest-InstanceUsageAuditLogTestJSON-1825115862 tempest-InstanceUsageAuditLogTestJSON-1825115862-project-admin] 10.222.0.15 "GET /compute/v2.1/os-instance_usage_audit_log/2022-03-05 20:48:29" status: 200 len: 318 microversion: 2.1 time: 0.985714 Mar 05 20:48:30.192281 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1/1] 10.222.0.15 () {58 vars in 1250 bytes} [Sat Mar 5 20:48:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-03-05%2020%3A48%3A29 => generated 318 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:30.209288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-07b8cd13-bfae-4e31-a06d-376b1ca06c67 tempest-InstanceUsageAuditLogTestJSON-1825115862 tempest-InstanceUsageAuditLogTestJSON-1825115862-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:30.211149 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:30.211149 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:30.228159 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-07b8cd13-bfae-4e31-a06d-376b1ca06c67 tempest-InstanceUsageAuditLogTestJSON-1825115862 tempest-InstanceUsageAuditLogTestJSON-1825115862-project-admin] 10.222.0.15 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.026794 Mar 05 20:48:30.229733 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2/2] 10.222.0.15 () {58 vars in 1184 bytes} [Sat Mar 5 20:48:30 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:48:30.713653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4fef4b9a-c305-47d0-affe-fda07db5cb1d tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2064655850", "id": 135979820, "os-flavor-access:is_public": "True"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:30.737537 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:30.737537 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:30.798919 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4fef4b9a-c305-47d0-affe-fda07db5cb1d tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 1.426418 Mar 05 20:48:30.799543 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:29 2022] POST /compute/v2.1/flavors => generated 427 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:31.263025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-845f720a-a190-4d5b-9180-9c463344834e tempest-AZAdminV2TestJSON-1294265732 tempest-AZAdminV2TestJSON-1294265732-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:31.267452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3d405e4b-3d5b-45d2-9065-8d60bd27f352 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Calling method '.version_select at 0x7fed5ee28ee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:31.271089 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:31.271089 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:31.273479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-845f720a-a190-4d5b-9180-9c463344834e tempest-AZAdminV2TestJSON-1294265732 tempest-AZAdminV2TestJSON-1294265732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.275908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-845f720a-a190-4d5b-9180-9c463344834e tempest-AZAdminV2TestJSON-1294265732 tempest-AZAdminV2TestJSON-1294265732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.276985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-845f720a-a190-4d5b-9180-9c463344834e tempest-AZAdminV2TestJSON-1294265732 tempest-AZAdminV2TestJSON-1294265732-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.277647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-845f720a-a190-4d5b-9180-9c463344834e tempest-AZAdminV2TestJSON-1294265732 tempest-AZAdminV2TestJSON-1294265732-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.294924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3d405e4b-3d5b-45d2-9065-8d60bd27f352 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),591cc087-7d9b-4967-a4cd-9c96e8077593(cell1) {{(pid=141479) load_cells /opt/stack/nova/nova/compute/api.py:306}} Mar 05 20:48:31.296131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d405e4b-3d5b-45d2-9065-8d60bd27f352 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.296826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d405e4b-3d5b-45d2-9065-8d60bd27f352 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.345766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d405e4b-3d5b-45d2-9065-8d60bd27f352 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.347075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d405e4b-3d5b-45d2-9065-8d60bd27f352 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.357410 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-845f720a-a190-4d5b-9180-9c463344834e tempest-AZAdminV2TestJSON-1294265732 tempest-AZAdminV2TestJSON-1294265732-project-admin] 10.222.0.15 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.554365 Mar 05 20:48:31.358611 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1163 bytes} [Sat Mar 5 20:48:30 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:31.374443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d405e4b-3d5b-45d2-9065-8d60bd27f352 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.374618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d405e4b-3d5b-45d2-9065-8d60bd27f352 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.383620 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3d405e4b-3d5b-45d2-9065-8d60bd27f352 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.806952 Mar 05 20:48:31.384568 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3/5] 10.222.0.15 () {60 vars in 1207 bytes} [Sat Mar 5 20:48:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:48:31.389740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-52fbda6e-fd27-4978-9713-f74abadd0531 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:31.390659 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:31.390659 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:31.447604 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-52fbda6e-fd27-4978-9713-f74abadd0531 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/135979820" status: 202 len: 0 microversion: 2.1 time: 0.061814 Mar 05 20:48:31.449095 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 4/6] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 20:48:31 2022] DELETE /compute/v2.1/flavors/135979820 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:48:31.524059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6eed63e8-5301-4b74-bfdd-fd4e59a060fd tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Calling method '.version_select at 0x7fed5ed73670>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:31.525554 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:31.525554 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:31.527830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6eed63e8-5301-4b74-bfdd-fd4e59a060fd tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.528761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6eed63e8-5301-4b74-bfdd-fd4e59a060fd tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.529862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6eed63e8-5301-4b74-bfdd-fd4e59a060fd tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.530528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6eed63e8-5301-4b74-bfdd-fd4e59a060fd tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.578027 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6eed63e8-5301-4b74-bfdd-fd4e59a060fd tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.217597 Mar 05 20:48:31.578978 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3/7] 10.222.0.15 () {58 vars in 1127 bytes} [Sat Mar 5 20:48:31 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:31.587374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bc7e10f0-79c1-452d-bf5c-45c7a38280ae tempest-AZAdminV2TestJSON-1294265732 tempest-AZAdminV2TestJSON-1294265732-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:31.588508 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:31.588508 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:31.589945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc7e10f0-79c1-452d-bf5c-45c7a38280ae tempest-AZAdminV2TestJSON-1294265732 tempest-AZAdminV2TestJSON-1294265732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.590592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc7e10f0-79c1-452d-bf5c-45c7a38280ae tempest-AZAdminV2TestJSON-1294265732 tempest-AZAdminV2TestJSON-1294265732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.600885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc7e10f0-79c1-452d-bf5c-45c7a38280ae tempest-AZAdminV2TestJSON-1294265732 tempest-AZAdminV2TestJSON-1294265732-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.601666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc7e10f0-79c1-452d-bf5c-45c7a38280ae tempest-AZAdminV2TestJSON-1294265732 tempest-AZAdminV2TestJSON-1294265732-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.638254 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bc7e10f0-79c1-452d-bf5c-45c7a38280ae tempest-AZAdminV2TestJSON-1294265732 tempest-AZAdminV2TestJSON-1294265732-project-admin] 10.222.0.15 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.057829 Mar 05 20:48:31.647329 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1184 bytes} [Sat Mar 5 20:48:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:31.652203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8a6515ac-4117-489a-8f76-e811d05c31ef tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1275317218"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:31.653682 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:31.653682 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:31.654581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.aggregate [None req-8a6515ac-4117-489a-8f76-e811d05c31ef tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Generated uuid 08856249-967d-4047-bd92-80006c75bc68 for aggregate {{(pid=141478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:48:31.706248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-82c3e0cf-c278-4cac-a97c-3cd6c134c273 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '.version_select at 0x7fed5edbb5e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:31.708498 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:31.708498 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:31.710750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82c3e0cf-c278-4cac-a97c-3cd6c134c273 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.711440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82c3e0cf-c278-4cac-a97c-3cd6c134c273 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.736783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82c3e0cf-c278-4cac-a97c-3cd6c134c273 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.737502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82c3e0cf-c278-4cac-a97c-3cd6c134c273 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.754995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82c3e0cf-c278-4cac-a97c-3cd6c134c273 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.755867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82c3e0cf-c278-4cac-a97c-3cd6c134c273 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.765335 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-82c3e0cf-c278-4cac-a97c-3cd6c134c273 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.314898 Mar 05 20:48:31.766786 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 5/9] 10.222.0.15 () {58 vars in 1166 bytes} [Sat Mar 5 20:48:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:31.772353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-433c583c-b801-4418-8155-a4d6852c8991 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:31.813341 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8a6515ac-4117-489a-8f76-e811d05c31ef tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.164729 Mar 05 20:48:31.813968 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 5/10] 10.222.0.15 () {62 vars in 1204 bytes} [Sat Mar 5 20:48:31 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:48:31.819529 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-09521cc7-b03e-4a6b-848e-0a4473d2f321 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Calling method '.version_select at 0x7fed5ed41b80>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:31.820860 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:31.820860 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:31.828695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09521cc7-b03e-4a6b-848e-0a4473d2f321 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.829202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09521cc7-b03e-4a6b-848e-0a4473d2f321 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.830050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09521cc7-b03e-4a6b-848e-0a4473d2f321 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:31.830491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09521cc7-b03e-4a6b-848e-0a4473d2f321 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:31.900815 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-09521cc7-b03e-4a6b-848e-0a4473d2f321 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.085775 Mar 05 20:48:31.908723 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-433c583c-b801-4418-8155-a4d6852c8991 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.140589 Mar 05 20:48:31.910420 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 6/11] 10.222.0.15 () {58 vars in 1138 bytes} [Sat Mar 5 20:48:31 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:31.912366 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:31.932539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-058a1ab6-2d9e-4a5c-9ab3-f23fc8f17ea8 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-628303029"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:32.073644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-618054773", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:32.122187 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:32.122187 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:32.327010 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-058a1ab6-2d9e-4a5c-9ab3-f23fc8f17ea8 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.413382 Mar 05 20:48:32.328480 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 7/13] 10.222.0.15 () {62 vars in 1209 bytes} [Sat Mar 5 20:48:31 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:48:32.333161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-29ba4aa7-b97d-4e02-9b24-edcb963c24f9 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Calling method '.version_select at 0x7fed5ecefc10>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:32.334992 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:32.334992 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:32.336715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29ba4aa7-b97d-4e02-9b24-edcb963c24f9 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:32.337379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29ba4aa7-b97d-4e02-9b24-edcb963c24f9 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:32.338380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29ba4aa7-b97d-4e02-9b24-edcb963c24f9 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:32.339074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29ba4aa7-b97d-4e02-9b24-edcb963c24f9 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:32.385018 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-29ba4aa7-b97d-4e02-9b24-edcb963c24f9 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.055298 Mar 05 20:48:32.386232 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 8/14] 10.222.0.15 () {58 vars in 1144 bytes} [Sat Mar 5 20:48:32 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:32.395913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-079f51df-bad8-49a5-9025-cb217307f934 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1233599482", "id": 748098164, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:32.414599 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:32.414599 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:32.451265 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-079f51df-bad8-49a5-9025-cb217307f934 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.063462 Mar 05 20:48:32.452131 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 9/15] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:32 2022] POST /compute/v2.1/flavors => generated 414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:32.462082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-028e214b-ce09-4b4d-a643-66021c86bce8 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:32.463194 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:32.463194 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:32.475082 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-028e214b-ce09-4b4d-a643-66021c86bce8 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.021554 Mar 05 20:48:32.477384 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 10/16] 10.222.0.15 () {60 vars in 1189 bytes} [Sat Mar 5 20:48:32 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:48:32.483016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3cbbae3f-7314-4552-aa65-493d0b6bd45a tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:32.515925 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3cbbae3f-7314-4552-aa65-493d0b6bd45a tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.036276 Mar 05 20:48:32.517000 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 11/17] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:32 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:32.533465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a033a6bf-6f6b-4dda-b874-a785923d4d40 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:32.537461 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:32.537461 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:32.549868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a033a6bf-6f6b-4dda-b874-a785923d4d40 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:32.551803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a033a6bf-6f6b-4dda-b874-a785923d4d40 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:33.134359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:48:33.153959 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a033a6bf-6f6b-4dda-b874-a785923d4d40 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.634532 Mar 05 20:48:33.161478 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 12/18] 10.222.0.15 () {62 vars in 1231 bytes} [Sat Mar 5 20:48:32 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:48:33.168112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ad06ff86-b4c9-44f4-8785-5aaaee91df90 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:33.168944 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:33.168944 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:33.189186 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ad06ff86-b4c9-44f4-8785-5aaaee91df90 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/748098164" status: 202 len: 0 microversion: 2.1 time: 0.026307 Mar 05 20:48:33.190131 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 13/19] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 20:48:33 2022] DELETE /compute/v2.1/flavors/748098164 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:48:33.211926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3f65a605-535a-426d-9467-5e29c038375c tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:33.213744 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:33.213744 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:33.227748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f65a605-535a-426d-9467-5e29c038375c tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:33.228212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f65a605-535a-426d-9467-5e29c038375c tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:33.419124 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3f65a605-535a-426d-9467-5e29c038375c tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.227766 Mar 05 20:48:33.421077 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 14/20] 10.222.0.15 () {62 vars in 1231 bytes} [Sat Mar 5 20:48:33 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:48:33.427060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-08340f0c-cc4b-4dcb-8ca0-cb5acfed1b74 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:33.464134 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-08340f0c-cc4b-4dcb-8ca0-cb5acfed1b74 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041927 Mar 05 20:48:33.465320 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 15/21] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:33.481610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-38d3df9c-ef6d-4385-a034-0b995670eb66 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:33.482689 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:33.482689 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:33.509131 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-38d3df9c-ef6d-4385-a034-0b995670eb66 tempest-AggregatesAdminTestV241-1900303128 tempest-AggregatesAdminTestV241-1900303128-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.042418 Mar 05 20:48:33.510861 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 16/22] 10.222.0.15 () {60 vars in 1192 bytes} [Sat Mar 5 20:48:33 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:33.525915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ec589eac-4505-47e8-9ffd-8720b26a008f tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-708126481", "id": 1962581553, "os-flavor-access:is_public": "True"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:33.528387 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:33.528387 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:33.552625 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ec589eac-4505-47e8-9ffd-8720b26a008f tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.040468 Mar 05 20:48:33.553875 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 17/23] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:33 2022] POST /compute/v2.1/flavors => generated 428 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:33.558691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5ef1b6e1-acad-4819-a116-4da79ce1a1f8 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2053864637", "name": "tempest-test_aggregate-638750746"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:33.580680 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:33.580680 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:33.582428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.aggregate [None req-5ef1b6e1-acad-4819-a116-4da79ce1a1f8 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Generated uuid 49740ee4-797a-4812-b8f8-10b7ae160d34 for aggregate {{(pid=141479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:48:33.623414 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5ef1b6e1-acad-4819-a116-4da79ce1a1f8 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.067014 Mar 05 20:48:33.625122 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 18/24] 10.222.0.15 () {60 vars in 1164 bytes} [Sat Mar 5 20:48:33 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:33.630714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d9881a6d-6f2e-4813-b1d7-9fe2f0231cef tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:33.631937 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:33.631937 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:33.657050 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d9881a6d-6f2e-4813-b1d7-9fe2f0231cef tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1962581553" status: 202 len: 0 microversion: 2.1 time: 0.030743 Mar 05 20:48:33.658815 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 19/25] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 20:48:33 2022] DELETE /compute/v2.1/flavors/1962581553 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:48:33.668234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d1628485-924f-4eee-9c9d-47178c579b56 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:33.669706 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:33.669706 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:33.684572 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d1628485-924f-4eee-9c9d-47178c579b56 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.023838 Mar 05 20:48:33.685588 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 20/26] 10.222.0.15 () {58 vars in 1142 bytes} [Sat Mar 5 20:48:33 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:33.691644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-afe0d841-9d5f-4af8-b4bd-dff60adb96c4 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:33.719047 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-afe0d841-9d5f-4af8-b4bd-dff60adb96c4 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032064 Mar 05 20:48:33.731698 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 21/27] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:33.731698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0f5eabe-60a1-4db5-bd2a-c2a05b0df183 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:33.731698 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:33.731698 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:33.740218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0f5eabe-60a1-4db5-bd2a-c2a05b0df183 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:33.740847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0f5eabe-60a1-4db5-bd2a-c2a05b0df183 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:33.774451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:48:33.775205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:48:33.775955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:48:33.776588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:48:33.777338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:48:33.799999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:33.799999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:33.801333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:33.805114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:33.849632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Getting quotas for project bc979e049ee9421d8f6e41c1b6723f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:48:33.857286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Getting quotas for user 8b27750446fb4a75a0b4247065203706 and project bc979e049ee9421d8f6e41c1b6723f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:48:33.873717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:48:33.877792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:48:33.941844 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0f5eabe-60a1-4db5-bd2a-c2a05b0df183 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 0.219561 Mar 05 20:48:33.943048 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 22/28] 10.222.0.15 () {60 vars in 1190 bytes} [Sat Mar 5 20:48:33 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:33.947694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1cfc247f-7561-49d2-9629-7c00a0658062 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-943930294", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:33.949273 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:33.949273 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:33.980429 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2dcc13e4-7c38-4382-a095-c7f3291e82ea tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.068641 Mar 05 20:48:33.981361 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 7/29] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:48:33.996293 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1cfc247f-7561-49d2-9629-7c00a0658062 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.046706 Mar 05 20:48:33.996767 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 23/30] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:33 2022] POST /compute/v2.1/flavors => generated 506 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:34.009141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74cad34b-179b-496c-bee8-426b00257f42 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:34.010068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-74cad34b-179b-496c-bee8-426b00257f42 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:34.024970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-737da4d3-b344-4e2a-9943-d0ee488351f1 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:34.025737 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:34.025737 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:34.100417 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-737da4d3-b344-4e2a-9943-d0ee488351f1 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/835bab17-dc45-4efe-a2f1-3d861c8e4985" status: 202 len: 0 microversion: 2.1 time: 0.085587 Mar 05 20:48:34.102604 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 24/31] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:48:34 2022] DELETE /compute/v2.1/flavors/835bab17-dc45-4efe-a2f1-3d861c8e4985 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:48:34.116661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7b938b44-7d5e-4d50-a949-b97d377ee27a tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:34.171058 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7b938b44-7d5e-4d50-a949-b97d377ee27a tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064817 Mar 05 20:48:34.172161 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 25/32] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:34.188924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f3a1fd48-c552-40a3-92aa-cfbc234759d8 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-427472805", "id": "86109611-6c91-4827-9008-e8b09aed936b", "os-flavor-access:is_public": "True"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:34.216851 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f3a1fd48-c552-40a3-92aa-cfbc234759d8 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.030012 Mar 05 20:48:34.218077 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 26/33] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:34 2022] POST /compute/v2.1/flavors => generated 506 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:48:34.229127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-47b959e0-2ed1-470d-85b7-adc8972c713d tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:34.272393 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-47b959e0-2ed1-470d-85b7-adc8972c713d tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/86109611-6c91-4827-9008-e8b09aed936b" status: 202 len: 0 microversion: 2.1 time: 0.047452 Mar 05 20:48:34.273128 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 27/34] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:48:34 2022] DELETE /compute/v2.1/flavors/86109611-6c91-4827-9008-e8b09aed936b => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:48:34.298389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-74cad34b-179b-496c-bee8-426b00257f42 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:34.323809 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-74cad34b-179b-496c-bee8-426b00257f42 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1219 microversion: 2.1 time: 0.335548 Mar 05 20:48:34.335489 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 8/35] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:33 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1219 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:34.354652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-66a8cc16-8c49-4334-9974-f07aac588324 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:34.430138 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-66a8cc16-8c49-4334-9974-f07aac588324 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088654 Mar 05 20:48:34.440353 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 9/36] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:34.452917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c54d117f-8ade-4902-8b48-ef84e74e2535 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-711738378", "id": 1167951945, "os-flavor-access:is_public": "True"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:34.455496 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:34.455496 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:34.498375 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c54d117f-8ade-4902-8b48-ef84e74e2535 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.049287 Mar 05 20:48:34.501075 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 10/37] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:34 2022] POST /compute/v2.1/flavors => generated 413 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:34.514681 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2c8a8ab9-be55-4f82-aa14-468317e5f224 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:34.549584 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2c8a8ab9-be55-4f82-aa14-468317e5f224 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/1167951945" status: 200 len: 413 microversion: 2.1 time: 0.041651 Mar 05 20:48:34.552059 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 11/38] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 20:48:34 2022] GET /compute/v2.1/flavors/1167951945 => generated 413 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:34.723526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1399048109", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "availability_zone": "tempest-test_az-2053864637"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:34.786176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:34.787876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:34.794039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:34.795897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:34.917309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1903d626-3d4e-440d-8f3e-49a3e2a2dc2b tempest-FlavorsAdminTestJSON-2014749348 tempest-FlavorsAdminTestJSON-2014749348-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:34.997110 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1903d626-3d4e-440d-8f3e-49a3e2a2dc2b tempest-FlavorsAdminTestJSON-2014749348 tempest-FlavorsAdminTestJSON-2014749348-project] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.439307 Mar 05 20:48:34.999409 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 12/39] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:34 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:48:35.014109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-93d4d818-fa34-430f-be66-53b4fcc10136 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:35.014782 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:35.014782 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:35.086355 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-93d4d818-fa34-430f-be66-53b4fcc10136 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1167951945" status: 202 len: 0 microversion: 2.1 time: 0.075961 Mar 05 20:48:35.087393 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 13/40] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 20:48:35 2022] DELETE /compute/v2.1/flavors/1167951945 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:48:35.100653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-135da85e-0d91-43c4-afc4-5320903bfe35 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:35.152346 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-135da85e-0d91-43c4-afc4-5320903bfe35 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056600 Mar 05 20:48:35.154663 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 14/41] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:35.170778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9bca4cdf-55b3-42ff-9314-a5481852a93d tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1770749199", "id": 1221930788, "os-flavor-access:is_public": "False"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:35.235377 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9bca4cdf-55b3-42ff-9314-a5481852a93d tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.068147 Mar 05 20:48:35.239164 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 15/42] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:35 2022] POST /compute/v2.1/flavors => generated 430 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:48:35.255075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d2447b33-6805-4591-9898-0787584953b1 tempest-FlavorsAdminTestJSON-2014749348 tempest-FlavorsAdminTestJSON-2014749348-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "1221930788"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:35.304173 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-d2447b33-6805-4591-9898-0787584953b1 tempest-FlavorsAdminTestJSON-2014749348 tempest-FlavorsAdminTestJSON-2014749348-project] HTTP exception thrown: Flavor 1221930788 could not be found. Mar 05 20:48:35.306892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d2447b33-6805-4591-9898-0787584953b1 tempest-FlavorsAdminTestJSON-2014749348 tempest-FlavorsAdminTestJSON-2014749348-project] Returning 400 to user: Flavor 1221930788 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:35.308541 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d2447b33-6805-4591-9898-0787584953b1 tempest-FlavorsAdminTestJSON-2014749348 tempest-FlavorsAdminTestJSON-2014749348-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.061689 Mar 05 20:48:35.309626 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 16/43] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:35 2022] POST /compute/v2.1/servers => generated 81 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 05 20:48:35.322484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-12f9ddfd-2b21-42a1-aa02-ade9e5925a4f tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:35.367794 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-12f9ddfd-2b21-42a1-aa02-ade9e5925a4f tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1221930788" status: 202 len: 0 microversion: 2.1 time: 0.051342 Mar 05 20:48:35.368746 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 17/44] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 20:48:35 2022] DELETE /compute/v2.1/flavors/1221930788 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:48:35.379029 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-43141633-4dd2-407a-b0ae-d84fe36613b4 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:35.379726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-43141633-4dd2-407a-b0ae-d84fe36613b4 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:35.470731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:48:35.531222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-43141633-4dd2-407a-b0ae-d84fe36613b4 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:35.543495 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-43141633-4dd2-407a-b0ae-d84fe36613b4 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1219 microversion: 2.1 time: 0.173562 Mar 05 20:48:35.544757 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 18/45] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:35 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:35.568009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-69e05679-6b13-4559-9a89-ea57c990110b tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:35.605721 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-69e05679-6b13-4559-9a89-ea57c990110b tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059154 Mar 05 20:48:35.616961 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 19/46] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:35.629701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dde3d882-39b3-4293-b775-878aa8586744 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1454873975", "id": 1428874264, "os-flavor-access:is_public": "False"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:35.632834 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:35.632834 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:35.656267 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dde3d882-39b3-4293-b775-878aa8586744 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.036449 Mar 05 20:48:35.657026 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 20/47] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:35 2022] POST /compute/v2.1/flavors => generated 415 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:35.669418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cef46187-2f7f-4667-888b-2d05acef58f5 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1542906031", "id": 1497839089, "os-flavor-access:is_public": "True"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:35.704966 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cef46187-2f7f-4667-888b-2d05acef58f5 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.040121 Mar 05 20:48:35.705577 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 21/48] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:35 2022] POST /compute/v2.1/flavors => generated 414 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:35.720984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2a23ba67-8b0a-40cb-9753-a29fca8645c9 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:35.756346 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2a23ba67-8b0a-40cb-9753-a29fca8645c9 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.043568 Mar 05 20:48:35.762146 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 22/49] 10.222.0.15 () {58 vars in 1168 bytes} [Sat Mar 5 20:48:35 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:48:35.769173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b7482b75-b262-4562-b3db-a8c068e03249 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:35.786199 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b7482b75-b262-4562-b3db-a8c068e03249 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.021515 Mar 05 20:48:35.790201 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 23/50] 10.222.0.15 () {58 vars in 1176 bytes} [Sat Mar 5 20:48:35 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:35.797496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-29298005-9c59-4290-b7ff-825286e56cf3 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:35.819441 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-29298005-9c59-4290-b7ff-825286e56cf3 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.025417 Mar 05 20:48:35.828819 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 24/51] 10.222.0.15 () {58 vars in 1170 bytes} [Sat Mar 5 20:48:35 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:35.836890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-314123c7-b66a-4ffa-8f84-c241c0660c17 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:35.854441 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-314123c7-b66a-4ffa-8f84-c241c0660c17 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.023149 Mar 05 20:48:35.855844 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 25/52] 10.222.0.15 () {58 vars in 1168 bytes} [Sat Mar 5 20:48:35 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:35.867094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-341fb676-cce0-4b8a-a887-aeeef0d42c1f tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:35.914404 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-341fb676-cce0-4b8a-a887-aeeef0d42c1f tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.051587 Mar 05 20:48:35.924426 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 26/53] 10.222.0.15 () {58 vars in 1168 bytes} [Sat Mar 5 20:48:35 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:48:35.931734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-616fc816-f5a7-431e-bea6-2134842aa78c tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:35.953775 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-616fc816-f5a7-431e-bea6-2134842aa78c tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.027903 Mar 05 20:48:35.964947 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 27/54] 10.222.0.15 () {58 vars in 1174 bytes} [Sat Mar 5 20:48:35 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:48:35.970301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1d506710-5895-40f7-8ddc-2314a877774f tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:35.994930 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1d506710-5895-40f7-8ddc-2314a877774f tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.028586 Mar 05 20:48:36.017188 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 28/55] 10.222.0.15 () {58 vars in 1172 bytes} [Sat Mar 5 20:48:35 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:36.024361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-069c5d4f-c13e-48b5-9e74-34ed62cd92f8 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:36.073371 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-069c5d4f-c13e-48b5-9e74-34ed62cd92f8 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.054442 Mar 05 20:48:36.073992 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 29/56] 10.222.0.15 () {58 vars in 1168 bytes} [Sat Mar 5 20:48:36 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:36.099703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ee6d0c61-e653-4ff3-8c27-61ae89b86604 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:36.100390 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:36.100390 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:36.164065 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ee6d0c61-e653-4ff3-8c27-61ae89b86604 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1497839089" status: 202 len: 0 microversion: 2.1 time: 0.072799 Mar 05 20:48:36.164796 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 30/57] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 20:48:36 2022] DELETE /compute/v2.1/flavors/1497839089 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:48:36.174004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3c0fa9ff-6b41-4687-afe8-0d331499e7a7 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:36.204494 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3c0fa9ff-6b41-4687-afe8-0d331499e7a7 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035117 Mar 05 20:48:36.208962 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 31/58] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:48:36.228483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8b7fd16f-401e-4643-b084-feb561d02244 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:36.273615 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8b7fd16f-401e-4643-b084-feb561d02244 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1428874264" status: 202 len: 0 microversion: 2.1 time: 0.056535 Mar 05 20:48:36.274708 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 32/59] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 20:48:36 2022] DELETE /compute/v2.1/flavors/1428874264 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:48:36.284004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6cd2fb3-3630-480c-8109-54cd39ffcc3c tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:36.326088 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6cd2fb3-3630-480c-8109-54cd39ffcc3c tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046761 Mar 05 20:48:36.343181 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 33/60] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:36.362731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c7b256aa-2e1a-4e47-b8f5-264e8a98ea4f tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-719300848", "id": 10939916, "os-flavor-access:is_public": "False"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:36.409125 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c7b256aa-2e1a-4e47-b8f5-264e8a98ea4f tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.051605 Mar 05 20:48:36.413534 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 34/61] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:36.422823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b0b5343b-3c57-4af4-a18b-96bfeb3c0ba5 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:36.457471 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b0b5343b-3c57-4af4-a18b-96bfeb3c0ba5 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039198 Mar 05 20:48:36.467144 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 35/62] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:36.473385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-38511bc6-d5c2-45d4-a8f4-5bf57a5bb802 tempest-FlavorsAdminTestJSON-2014749348 tempest-FlavorsAdminTestJSON-2014749348-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:36.498431 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-38511bc6-d5c2-45d4-a8f4-5bf57a5bb802 tempest-FlavorsAdminTestJSON-2014749348 tempest-FlavorsAdminTestJSON-2014749348-project] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029318 Mar 05 20:48:36.499233 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 36/63] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:48:36.513807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-02292fc7-c310-4e62-b49d-5c87a41f5480 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:36.552970 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-02292fc7-c310-4e62-b49d-5c87a41f5480 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/10939916" status: 202 len: 0 microversion: 2.1 time: 0.042984 Mar 05 20:48:36.553604 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 37/64] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:48:36 2022] DELETE /compute/v2.1/flavors/10939916 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:48:36.562413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-962286a9-c70f-43d1-abbc-a6a92b70bfb9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:36.563224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-962286a9-c70f-43d1-abbc-a6a92b70bfb9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:36.571746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-962286a9-c70f-43d1-abbc-a6a92b70bfb9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:36.572491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-962286a9-c70f-43d1-abbc-a6a92b70bfb9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:36.573798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-962286a9-c70f-43d1-abbc-a6a92b70bfb9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:36.574430 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-962286a9-c70f-43d1-abbc-a6a92b70bfb9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:36.853145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:48:36.853645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:48:36.854044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:48:36.854455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:48:36.855058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:48:36.891231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:36.896942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:36.898298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:36.900205 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:36.941679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-962286a9-c70f-43d1-abbc-a6a92b70bfb9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:36.962796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Getting quotas for project dd43fe9254d04dbead327aa06baa059a. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:48:36.973176 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-962286a9-c70f-43d1-abbc-a6a92b70bfb9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1237 microversion: 2.1 time: 0.411481 Mar 05 20:48:36.986462 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 38/65] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:36 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1237 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:36.986656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Getting quotas for user acb30e1069fe4b74b7125cd36b6ef75f and project dd43fe9254d04dbead327aa06baa059a. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:48:37.001739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0534716b-4c1c-47fb-ac04-96d4c5f42424 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:37.010861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:48:37.021657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:48:37.031126 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0534716b-4c1c-47fb-ac04-96d4c5f42424 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042250 Mar 05 20:48:37.032447 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 39/66] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:37.053796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f294a780-0fd5-4d8c-b0de-0ae7c5cc68ed tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1052706696", "id": 2020660118, "os-flavor-access:is_public": "True"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:37.055414 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:37.055414 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:37.078116 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f294a780-0fd5-4d8c-b0de-0ae7c5cc68ed tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.028393 Mar 05 20:48:37.101367 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 40/67] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:37 2022] POST /compute/v2.1/flavors => generated 414 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:37.106263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3682c5f8-3e37-4077-8dd6-33108c05df9e tempest-FlavorsAdminTestJSON-2014749348 tempest-FlavorsAdminTestJSON-2014749348-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:37.149842 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-463680fd-f614-483a-8749-bd668cb790f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.875324 Mar 05 20:48:37.150759 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 28/68] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:48:37.158169 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3682c5f8-3e37-4077-8dd6-33108c05df9e tempest-FlavorsAdminTestJSON-2014749348 tempest-FlavorsAdminTestJSON-2014749348-project] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.055335 Mar 05 20:48:37.167228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fce2c383-7765-4ba8-b5b6-375a4a7add7a tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:37.167435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fce2c383-7765-4ba8-b5b6-375a4a7add7a tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:37.177650 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 41/69] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:37 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:37.188891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a8a83b2e-975a-46dc-a49f-9eef530ce2a9 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:37.189326 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:37.189326 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:37.229618 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a8a83b2e-975a-46dc-a49f-9eef530ce2a9 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/2020660118" status: 202 len: 0 microversion: 2.1 time: 0.048558 Mar 05 20:48:37.234179 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 42/70] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 20:48:37 2022] DELETE /compute/v2.1/flavors/2020660118 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:48:37.240988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a37012b5-48a6-4099-bee6-46f78316fac2 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:37.287229 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a37012b5-48a6-4099-bee6-46f78316fac2 tempest-FlavorsAdminTestJSON-1076957557 tempest-FlavorsAdminTestJSON-1076957557-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051778 Mar 05 20:48:37.291631 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 43/71] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:37.390971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fce2c383-7765-4ba8-b5b6-375a4a7add7a tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:37.425133 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fce2c383-7765-4ba8-b5b6-375a4a7add7a tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1243 microversion: 2.1 time: 0.267627 Mar 05 20:48:37.429744 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 29/72] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:37 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1243 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:48:37.991955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2d7c075e-1e9b-4863-9a24-ed48e3be2241 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:37.993187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2d7c075e-1e9b-4863-9a24-ed48e3be2241 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:38.011611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d7c075e-1e9b-4863-9a24-ed48e3be2241 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:38.012672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d7c075e-1e9b-4863-9a24-ed48e3be2241 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:38.014352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d7c075e-1e9b-4863-9a24-ed48e3be2241 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:38.015040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d7c075e-1e9b-4863-9a24-ed48e3be2241 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:38.180838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d7c075e-1e9b-4863-9a24-ed48e3be2241 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:38.197565 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2d7c075e-1e9b-4863-9a24-ed48e3be2241 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1299 microversion: 2.1 time: 0.210214 Mar 05 20:48:38.199499 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 44/73] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:37 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1299 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:38.446982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f7293350-c353-476d-93a9-31e2d160fc58 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:38.447680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f7293350-c353-476d-93a9-31e2d160fc58 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:38.603077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f7293350-c353-476d-93a9-31e2d160fc58 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:38.612451 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f7293350-c353-476d-93a9-31e2d160fc58 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1243 microversion: 2.1 time: 0.170372 Mar 05 20:48:38.613085 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 30/74] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:38 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1243 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:39.230005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-08d44f45-2a2b-4d84-a64e-be0d1ffb53f5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:39.232320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-08d44f45-2a2b-4d84-a64e-be0d1ffb53f5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:39.270337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08d44f45-2a2b-4d84-a64e-be0d1ffb53f5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:39.270834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08d44f45-2a2b-4d84-a64e-be0d1ffb53f5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:39.272757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08d44f45-2a2b-4d84-a64e-be0d1ffb53f5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:39.273334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08d44f45-2a2b-4d84-a64e-be0d1ffb53f5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:39.437606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-08d44f45-2a2b-4d84-a64e-be0d1ffb53f5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:39.464621 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-08d44f45-2a2b-4d84-a64e-be0d1ffb53f5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1299 microversion: 2.1 time: 0.251812 Mar 05 20:48:39.468293 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 45/75] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:39 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1299 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:39.635287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e98049c2-9050-4861-bebd-0d9c4f7d901d tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:39.637237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e98049c2-9050-4861-bebd-0d9c4f7d901d tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:39.660516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e98049c2-9050-4861-bebd-0d9c4f7d901d tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:39.662226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e98049c2-9050-4861-bebd-0d9c4f7d901d tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:39.664914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e98049c2-9050-4861-bebd-0d9c4f7d901d tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:39.669499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e98049c2-9050-4861-bebd-0d9c4f7d901d tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:40.180740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e98049c2-9050-4861-bebd-0d9c4f7d901d tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:40.207084 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e98049c2-9050-4861-bebd-0d9c4f7d901d tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1297 microversion: 2.1 time: 0.580440 Mar 05 20:48:40.213471 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 31/76] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:39 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1297 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:40.481921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3e4037e8-0f80-4ff0-9420-008b46f06d53 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:40.484528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3e4037e8-0f80-4ff0-9420-008b46f06d53 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:40.495486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e4037e8-0f80-4ff0-9420-008b46f06d53 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:40.496272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e4037e8-0f80-4ff0-9420-008b46f06d53 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:40.497644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e4037e8-0f80-4ff0-9420-008b46f06d53 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:40.499087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e4037e8-0f80-4ff0-9420-008b46f06d53 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:40.949974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3e4037e8-0f80-4ff0-9420-008b46f06d53 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:40.968641 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3e4037e8-0f80-4ff0-9420-008b46f06d53 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 0.482814 Mar 05 20:48:40.970985 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 32/77] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:40 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:41.230981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cfb7f6cf-d8ac-45cb-8c3e-60d3a6f49861 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:41.232084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cfb7f6cf-d8ac-45cb-8c3e-60d3a6f49861 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:41.244342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfb7f6cf-d8ac-45cb-8c3e-60d3a6f49861 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:41.245265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfb7f6cf-d8ac-45cb-8c3e-60d3a6f49861 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:41.246893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfb7f6cf-d8ac-45cb-8c3e-60d3a6f49861 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:41.248329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfb7f6cf-d8ac-45cb-8c3e-60d3a6f49861 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:41.423878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cfb7f6cf-d8ac-45cb-8c3e-60d3a6f49861 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:41.444107 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cfb7f6cf-d8ac-45cb-8c3e-60d3a6f49861 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1297 microversion: 2.1 time: 0.217599 Mar 05 20:48:41.446079 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 33/78] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:41 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1297 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:41.446957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd026925-9354-4741-87d1-b5aa2cc2efc1 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1816575568", "id": 315759707, "os-flavor-access:is_public": "False"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:41.448518 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:41.448518 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:41.481180 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd026925-9354-4741-87d1-b5aa2cc2efc1 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 1.079416 Mar 05 20:48:41.481800 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 46/79] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:40 2022] POST /compute/v2.1/flavors => generated 428 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:41.496985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4c62e3cd-9435-4592-b484-a5a0e254bd66 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9dd60ab30a324c369d65abe314ddeb75"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:41.498844 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:41.498844 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:41.987743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d39a7b45-6271-430f-a6d5-f5a72e7c39bb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:41.988670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d39a7b45-6271-430f-a6d5-f5a72e7c39bb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:41.997808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d39a7b45-6271-430f-a6d5-f5a72e7c39bb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:42.004829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d39a7b45-6271-430f-a6d5-f5a72e7c39bb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:42.008961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d39a7b45-6271-430f-a6d5-f5a72e7c39bb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:42.012160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d39a7b45-6271-430f-a6d5-f5a72e7c39bb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:42.429826 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4c62e3cd-9435-4592-b484-a5a0e254bd66 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/315759707/action" status: 200 len: 96 microversion: 2.1 time: 0.935115 Mar 05 20:48:42.431488 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 34/80] 10.222.0.15 () {60 vars in 1196 bytes} [Sat Mar 5 20:48:41 2022] POST /compute/v2.1/flavors/315759707/action => generated 96 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:42.986834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d39a7b45-6271-430f-a6d5-f5a72e7c39bb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:43.009870 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d39a7b45-6271-430f-a6d5-f5a72e7c39bb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 1.024620 Mar 05 20:48:43.020531 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 47/81] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:41 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:48:43.043028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-605a6948-f377-436b-a752-1b6bd45f4d64 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:43.043695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-605a6948-f377-436b-a752-1b6bd45f4d64 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:43.044468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cd1f96e0-3a5a-4e1d-b53d-b3e7d9f4e3fe tempest-FlavorsAccessTestJSON-1884930491 tempest-FlavorsAccessTestJSON-1884930491-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:43.054695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-605a6948-f377-436b-a752-1b6bd45f4d64 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:43.057552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-605a6948-f377-436b-a752-1b6bd45f4d64 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:43.058396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-605a6948-f377-436b-a752-1b6bd45f4d64 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:43.058902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-605a6948-f377-436b-a752-1b6bd45f4d64 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:43.207532 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cd1f96e0-3a5a-4e1d-b53d-b3e7d9f4e3fe tempest-FlavorsAccessTestJSON-1884930491 tempest-FlavorsAccessTestJSON-1884930491-project] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.770074 Mar 05 20:48:43.225998 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 35/82] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:42 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:43.259936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7cd054ba-b3b9-45e4-b294-982d5f5ead8d tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9dd60ab30a324c369d65abe314ddeb75"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:43.269173 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:43.269173 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:43.813496 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7cd054ba-b3b9-45e4-b294-982d5f5ead8d tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/315759707/action" status: 200 len: 21 microversion: 2.1 time: 0.572179 Mar 05 20:48:43.816854 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 36/83] 10.222.0.15 () {60 vars in 1196 bytes} [Sat Mar 5 20:48:43 2022] POST /compute/v2.1/flavors/315759707/action => generated 21 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:43.835090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-06545f9e-53c9-4085-a283-5fac5f7db4d6 tempest-FlavorsAccessTestJSON-1884930491 tempest-FlavorsAccessTestJSON-1884930491-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:43.876577 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-06545f9e-53c9-4085-a283-5fac5f7db4d6 tempest-FlavorsAccessTestJSON-1884930491 tempest-FlavorsAccessTestJSON-1884930491-project] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054818 Mar 05 20:48:43.877895 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 37/84] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:48:43.895244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-86020814-6664-4d69-a1c1-5fd441fdc559 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:43.897029 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:43.897029 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:43.956506 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-86020814-6664-4d69-a1c1-5fd441fdc559 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/315759707" status: 202 len: 0 microversion: 2.1 time: 0.066332 Mar 05 20:48:43.958240 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 38/85] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 20:48:43 2022] DELETE /compute/v2.1/flavors/315759707 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 20:48:43.967567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b149d3d0-4fd5-441f-bcf2-b108c6c6fbb8 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:44.029890 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b149d3d0-4fd5-441f-bcf2-b108c6c6fbb8 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064775 Mar 05 20:48:44.035464 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 39/86] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:44.060496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-770b92ab-b10f-44a8-b019-eded36c8a3b1 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:44.061267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-770b92ab-b10f-44a8-b019-eded36c8a3b1 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:44.108119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-770b92ab-b10f-44a8-b019-eded36c8a3b1 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:44.108583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-770b92ab-b10f-44a8-b019-eded36c8a3b1 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:44.109401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-770b92ab-b10f-44a8-b019-eded36c8a3b1 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:44.109978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-770b92ab-b10f-44a8-b019-eded36c8a3b1 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:44.220948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-605a6948-f377-436b-a752-1b6bd45f4d64 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:44.245081 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-605a6948-f377-436b-a752-1b6bd45f4d64 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1339 microversion: 2.1 time: 1.209435 Mar 05 20:48:44.247907 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 48/87] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:43 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1339 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:44.266441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2e987585-69a2-422a-91a9-1bacd2226491 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1255023191", "id": 477688464, "os-flavor-access:is_public": "False"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:44.271943 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:44.271943 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:44.301292 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2e987585-69a2-422a-91a9-1bacd2226491 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.052092 Mar 05 20:48:44.307708 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 49/88] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:44 2022] POST /compute/v2.1/flavors => generated 428 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:44.329712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-79981978-7ede-47e9-9a65-0bfd34dee21a tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:44.332076 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:44.332076 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:44.360488 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-79981978-7ede-47e9-9a65-0bfd34dee21a tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/477688464/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.045056 Mar 05 20:48:44.366570 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 50/89] 10.222.0.15 () {58 vars in 1205 bytes} [Sat Mar 5 20:48:44 2022] GET /compute/v2.1/flavors/477688464/os-flavor-access => generated 21 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:44.376762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-54a2fc57-b070-4468-8c12-20889ed84068 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:44.377946 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:44.377946 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:44.418209 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-54a2fc57-b070-4468-8c12-20889ed84068 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/477688464" status: 202 len: 0 microversion: 2.1 time: 0.045608 Mar 05 20:48:44.419175 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 51/90] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 20:48:44 2022] DELETE /compute/v2.1/flavors/477688464 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:48:44.429879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fe93157c-eb87-4e05-a5ab-11b1306ad676 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:44.477878 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fe93157c-eb87-4e05-a5ab-11b1306ad676 tempest-FlavorsAccessTestJSON-1422143778 tempest-FlavorsAccessTestJSON-1422143778-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052318 Mar 05 20:48:44.478973 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 52/91] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:45.267387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-635c21f0-d7d7-47fa-a464-4d3bbf720fe9 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:45.268115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-635c21f0-d7d7-47fa-a464-4d3bbf720fe9 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:45.269695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-770b92ab-b10f-44a8-b019-eded36c8a3b1 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:45.282890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-635c21f0-d7d7-47fa-a464-4d3bbf720fe9 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:45.283392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-635c21f0-d7d7-47fa-a464-4d3bbf720fe9 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:45.284246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-635c21f0-d7d7-47fa-a464-4d3bbf720fe9 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:45.285432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-635c21f0-d7d7-47fa-a464-4d3bbf720fe9 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:45.290792 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-770b92ab-b10f-44a8-b019-eded36c8a3b1 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 1.248837 Mar 05 20:48:45.301899 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 40/92] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:44 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:46.311417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b56d7a64-4e61-465d-9e91-da2831015910 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:46.312266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b56d7a64-4e61-465d-9e91-da2831015910 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:46.339043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b56d7a64-4e61-465d-9e91-da2831015910 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:46.341981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b56d7a64-4e61-465d-9e91-da2831015910 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:46.344779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b56d7a64-4e61-465d-9e91-da2831015910 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:46.346296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b56d7a64-4e61-465d-9e91-da2831015910 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:47.341310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-635c21f0-d7d7-47fa-a464-4d3bbf720fe9 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:47.358085 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-635c21f0-d7d7-47fa-a464-4d3bbf720fe9 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1339 microversion: 2.1 time: 2.097286 Mar 05 20:48:47.358688 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 53/93] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:45 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1339 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:47.414348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b56d7a64-4e61-465d-9e91-da2831015910 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:47.425977 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b56d7a64-4e61-465d-9e91-da2831015910 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 1.120638 Mar 05 20:48:47.437690 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 41/94] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:46 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:47.563202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-cfa8c26f-db58-43f6-af4b-6e049dd70d76 req-f2789ba1-78c6-4573-b730-d7cf13ab54c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3bafedc-69d2-4784-8413-e4f9060b4acf", "tag": "326c6caa-2b24-4f53-a872-561f3573012c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:47.563767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-df30b4ee-114f-46b3-a0bf-8ef57ed6345b tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-631253685", "ram": 512, "vcpus": 1, "disk": 10, "id": 1745002326, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:47.570378 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:47.570378 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:47.595814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-cfa8c26f-db58-43f6-af4b-6e049dd70d76 req-f2789ba1-78c6-4573-b730-d7cf13ab54c6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:47.601485 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-df30b4ee-114f-46b3-a0bf-8ef57ed6345b tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.241677 Mar 05 20:48:47.605305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-cfa8c26f-db58-43f6-af4b-6e049dd70d76 req-f2789ba1-78c6-4573-b730-d7cf13ab54c6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:47.615577 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 54/95] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:47 2022] POST /compute/v2.1/flavors => generated 415 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:47.660089 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-cfa8c26f-db58-43f6-af4b-6e049dd70d76 req-f2789ba1-78c6-4573-b730-d7cf13ab54c6 service nova] Creating event network-changed:326c6caa-2b24-4f53-a872-561f3573012c for instance f3bafedc-69d2-4784-8413-e4f9060b4acf on nch1-master-1 Mar 05 20:48:47.660945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-cfa8c26f-db58-43f6-af4b-6e049dd70d76 req-f2789ba1-78c6-4573-b730-d7cf13ab54c6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 20:48:47.666491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e66cb0ea-6e41-44c0-9833-11df92d149a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:47.667234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e66cb0ea-6e41-44c0-9833-11df92d149a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:47.670712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e66cb0ea-6e41-44c0-9833-11df92d149a2 None None] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:47.671422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e66cb0ea-6e41-44c0-9833-11df92d149a2 None None] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:47.693640 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.compute.rpcapi [None req-e66cb0ea-6e41-44c0-9833-11df92d149a2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 05 20:48:47.701099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e66cb0ea-6e41-44c0-9833-11df92d149a2 None None] Releasing lock "compute-rpcapi-router" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 20:48:47.737055 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e66cb0ea-6e41-44c0-9833-11df92d149a2 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297841 Mar 05 20:48:47.738109 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 42/96] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:47.744208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4f9baf99-86da-484e-96d5-1051a02a3ef4 tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:47.747619 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:47.747619 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:47.785710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8cd7bca6-a99b-44f6-8681-b6818600fd64 req-cff891c2-5884-4218-9f0d-3c359d72dce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf55fc7-8496-4922-9291-4b258266c92b", "tag": "ed241cfc-58db-4f9b-adfb-a457a1c0e3e4"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:47.805969 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4f9baf99-86da-484e-96d5-1051a02a3ef4 tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/1745002326/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066398 Mar 05 20:48:47.815213 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 43/97] 10.222.0.15 () {60 vars in 1223 bytes} [Sat Mar 5 20:48:47 2022] POST /compute/v2.1/flavors/1745002326/os-extra_specs => generated 66 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:47.822145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8cd7bca6-a99b-44f6-8681-b6818600fd64 req-cff891c2-5884-4218-9f0d-3c359d72dce3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:47.823828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8cd7bca6-a99b-44f6-8681-b6818600fd64 req-cff891c2-5884-4218-9f0d-3c359d72dce3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:47.875792 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8cd7bca6-a99b-44f6-8681-b6818600fd64 req-cff891c2-5884-4218-9f0d-3c359d72dce3 service nova] Creating event network-changed:ed241cfc-58db-4f9b-adfb-a457a1c0e3e4 for instance ebf55fc7-8496-4922-9291-4b258266c92b on nch1-master-1 Mar 05 20:48:47.876591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8cd7bca6-a99b-44f6-8681-b6818600fd64 req-cff891c2-5884-4218-9f0d-3c359d72dce3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=141478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 20:48:47.878546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f10bd8d1-4b05-4bc8-9e04-fa4041bae3ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:47.879484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f10bd8d1-4b05-4bc8-9e04-fa4041bae3ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:47.881105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f10bd8d1-4b05-4bc8-9e04-fa4041bae3ff None None] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:47.881947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f10bd8d1-4b05-4bc8-9e04-fa4041bae3ff None None] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:47.914710 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.compute.rpcapi [None req-f10bd8d1-4b05-4bc8-9e04-fa4041bae3ff None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 05 20:48:47.915982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f10bd8d1-4b05-4bc8-9e04-fa4041bae3ff None None] Releasing lock "compute-rpcapi-router" {{(pid=141478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 20:48:47.935309 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f10bd8d1-4b05-4bc8-9e04-fa4041bae3ff None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315461 Mar 05 20:48:47.937503 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 55/98] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:48.023569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-98c1989d-954b-49d8-9621-37923c845bc3 tempest-FlavorsExtraSpecsTestJSON-1212377362 tempest-FlavorsExtraSpecsTestJSON-1212377362-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:48.036295 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-98c1989d-954b-49d8-9621-37923c845bc3 tempest-FlavorsExtraSpecsTestJSON-1212377362 tempest-FlavorsExtraSpecsTestJSON-1212377362-project] 10.222.0.15 "GET /compute/v2.1/flavors/1745002326/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.218884 Mar 05 20:48:48.042245 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 44/99] 10.222.0.15 () {58 vars in 1202 bytes} [Sat Mar 5 20:48:47 2022] GET /compute/v2.1/flavors/1745002326/os-extra_specs => generated 66 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:48.053385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7f2fadfc-3f1c-4105-83b9-05646ac8e7f8 tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:48.057831 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:48.057831 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:48.188122 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7f2fadfc-3f1c-4105-83b9-05646ac8e7f8 tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/1745002326/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.143841 Mar 05 20:48:48.196416 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 56/100] 10.222.0.15 () {60 vars in 1223 bytes} [Sat Mar 5 20:48:48 2022] POST /compute/v2.1/flavors/1745002326/os-extra_specs => generated 66 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:48.213534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2373bc1a-dcfb-447e-945f-083a0f4facd6 tempest-FlavorsExtraSpecsTestJSON-1212377362 tempest-FlavorsExtraSpecsTestJSON-1212377362-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:48.248240 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2373bc1a-dcfb-447e-945f-083a0f4facd6 tempest-FlavorsExtraSpecsTestJSON-1212377362 tempest-FlavorsExtraSpecsTestJSON-1212377362-project] 10.222.0.15 "GET /compute/v2.1/flavors/1745002326/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.044479 Mar 05 20:48:48.249950 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 45/101] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:48:48 2022] GET /compute/v2.1/flavors/1745002326/os-extra_specs/hw:numa_nodes => generated 22 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:48.262397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1c666679-3eb0-4f78-b93b-507db100960a tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:48.338076 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1c666679-3eb0-4f78-b93b-507db100960a tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/1745002326/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.080100 Mar 05 20:48:48.341095 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 57/102] 10.222.0.15 () {60 vars in 1223 bytes} [Sat Mar 5 20:48:48 2022] POST /compute/v2.1/flavors/1745002326/os-extra_specs => generated 66 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:48.349708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aa25f74d-5183-4a70-9bfb-7faa0f436d2e tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:48.381330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-db874a15-8afe-4010-b9c5-b03396407b2e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:48.387601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-db874a15-8afe-4010-b9c5-b03396407b2e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:48.395447 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aa25f74d-5183-4a70-9bfb-7faa0f436d2e tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/1745002326/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.045869 Mar 05 20:48:48.398611 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 46/103] 10.222.0.15 () {58 vars in 1202 bytes} [Sat Mar 5 20:48:48 2022] GET /compute/v2.1/flavors/1745002326/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:48.419284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ef3da50a-629d-456b-af46-d9d519ea13aa tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:48.420044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db874a15-8afe-4010-b9c5-b03396407b2e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:48.423822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db874a15-8afe-4010-b9c5-b03396407b2e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:48.426850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db874a15-8afe-4010-b9c5-b03396407b2e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:48.429400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db874a15-8afe-4010-b9c5-b03396407b2e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:48.430239 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:48.430239 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:48.544754 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ef3da50a-629d-456b-af46-d9d519ea13aa tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] 10.222.0.15 "PUT /compute/v2.1/flavors/1745002326/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.138525 Mar 05 20:48:48.545486 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 47/104] 10.222.0.15 () {60 vars in 1264 bytes} [Sat Mar 5 20:48:48 2022] PUT /compute/v2.1/flavors/1745002326/os-extra_specs/hw:numa_nodes => generated 22 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:48.558136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a68c6ca6-ba0c-415e-b9e1-119ad89f982e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:48.564001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a68c6ca6-ba0c-415e-b9e1-119ad89f982e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:48.578782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a68c6ca6-ba0c-415e-b9e1-119ad89f982e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:48.579938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a68c6ca6-ba0c-415e-b9e1-119ad89f982e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:48.581090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a68c6ca6-ba0c-415e-b9e1-119ad89f982e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:48.583187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a68c6ca6-ba0c-415e-b9e1-119ad89f982e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:49.283373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a68c6ca6-ba0c-415e-b9e1-119ad89f982e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:49.294424 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a68c6ca6-ba0c-415e-b9e1-119ad89f982e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 0.745569 Mar 05 20:48:49.308389 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 48/105] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:48 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:49.317905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-472301b4-6bc4-4b4f-9907-8c8c7c55bcb7 tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:49.323182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-db874a15-8afe-4010-b9c5-b03396407b2e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:49.329279 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-472301b4-6bc4-4b4f-9907-8c8c7c55bcb7 tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/1745002326/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018899 Mar 05 20:48:49.330439 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 49/106] 10.222.0.15 () {58 vars in 1202 bytes} [Sat Mar 5 20:48:49 2022] GET /compute/v2.1/flavors/1745002326/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:49.338096 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-db874a15-8afe-4010-b9c5-b03396407b2e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1339 microversion: 2.1 time: 0.963846 Mar 05 20:48:49.342004 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 58/107] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:48 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1339 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:49.346139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-326d5b86-8a5f-4f4e-a75c-703309e7819f tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:49.351763 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:49.351763 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:49.410279 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-326d5b86-8a5f-4f4e-a75c-703309e7819f tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1745002326/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.066303 Mar 05 20:48:49.411558 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 50/108] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 20:48:49 2022] DELETE /compute/v2.1/flavors/1745002326/os-extra_specs/hw:numa_nodes => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:48:49.419644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4be82473-010f-4634-a706-765b1c1becd5 tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:49.420489 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:49.420489 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:49.446206 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4be82473-010f-4634-a706-765b1c1becd5 tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1745002326/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.030573 Mar 05 20:48:49.447402 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 59/109] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 20:48:49 2022] DELETE /compute/v2.1/flavors/1745002326/os-extra_specs/hw:cpu_policy => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:48:49.457697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ffaa4b30-d359-41b4-846d-00d841eab52c tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:49.468351 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ffaa4b30-d359-41b4-846d-00d841eab52c tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/1745002326/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015928 Mar 05 20:48:49.470398 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 51/110] 10.222.0.15 () {58 vars in 1202 bytes} [Sat Mar 5 20:48:49 2022] GET /compute/v2.1/flavors/1745002326/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 05 20:48:49.483638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-464e6f19-1771-484c-817c-24e8ae172a86 tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:49.486994 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:49.486994 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:49.536309 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-464e6f19-1771-484c-817c-24e8ae172a86 tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1745002326" status: 202 len: 0 microversion: 2.1 time: 0.055995 Mar 05 20:48:49.540921 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 60/111] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 20:48:49 2022] DELETE /compute/v2.1/flavors/1745002326 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:48:49.552609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fe1abf5c-aae9-447c-9631-9af06313ba72 tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:49.603733 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fe1abf5c-aae9-447c-9631-9af06313ba72 tempest-FlavorsExtraSpecsTestJSON-613011605 tempest-FlavorsExtraSpecsTestJSON-613011605-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057327 Mar 05 20:48:49.606038 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 52/112] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:48:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:50.320718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41fc18aa-497b-4206-9c93-f4da1956f27c tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:50.321794 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-41fc18aa-497b-4206-9c93-f4da1956f27c tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:50.356884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2c175213-6d9c-48ef-b7c5-222711b198e6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:50.357724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2c175213-6d9c-48ef-b7c5-222711b198e6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:50.358866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41fc18aa-497b-4206-9c93-f4da1956f27c tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:50.359373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41fc18aa-497b-4206-9c93-f4da1956f27c tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:50.362651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41fc18aa-497b-4206-9c93-f4da1956f27c tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:50.366152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41fc18aa-497b-4206-9c93-f4da1956f27c tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:50.374327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c175213-6d9c-48ef-b7c5-222711b198e6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:50.377158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c175213-6d9c-48ef-b7c5-222711b198e6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:50.379001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c175213-6d9c-48ef-b7c5-222711b198e6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:50.385497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c175213-6d9c-48ef-b7c5-222711b198e6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:51.457190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2c175213-6d9c-48ef-b7c5-222711b198e6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:51.467754 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2c175213-6d9c-48ef-b7c5-222711b198e6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1339 microversion: 2.1 time: 1.115414 Mar 05 20:48:51.478242 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 53/113] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:50 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1339 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:48:51.661541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-41fc18aa-497b-4206-9c93-f4da1956f27c tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:51.675838 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-41fc18aa-497b-4206-9c93-f4da1956f27c tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 1.361613 Mar 05 20:48:51.678182 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 61/114] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:50 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:52.485603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6f481b78-4eb7-400f-9302-3b81881cb6c6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:52.486262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6f481b78-4eb7-400f-9302-3b81881cb6c6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:52.496377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f481b78-4eb7-400f-9302-3b81881cb6c6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:52.496714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f481b78-4eb7-400f-9302-3b81881cb6c6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:52.498414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f481b78-4eb7-400f-9302-3b81881cb6c6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:52.499553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f481b78-4eb7-400f-9302-3b81881cb6c6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:52.956013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-37b7b7c0-b31e-435f-8e47-aab67b64bcc4 tempest-AZAdminNegativeTestJSON-448372008 tempest-AZAdminNegativeTestJSON-448372008-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:52.956887 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:52.956887 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:52.958451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-37b7b7c0-b31e-435f-8e47-aab67b64bcc4 tempest-AZAdminNegativeTestJSON-448372008 tempest-AZAdminNegativeTestJSON-448372008-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'd71cd5ca0a664f128a63027d5eadce05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5255a43ef7ab4672af1c54f15559ba9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:52.959717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-37b7b7c0-b31e-435f-8e47-aab67b64bcc4 tempest-AZAdminNegativeTestJSON-448372008 tempest-AZAdminNegativeTestJSON-448372008-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:52.960665 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-37b7b7c0-b31e-435f-8e47-aab67b64bcc4 tempest-AZAdminNegativeTestJSON-448372008 tempest-AZAdminNegativeTestJSON-448372008-project] 10.222.0.15 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.495090 Mar 05 20:48:52.961374 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 54/115] 10.222.0.15 () {58 vars in 1184 bytes} [Sat Mar 5 20:48:52 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 496 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:48:52.970997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b28fa10f-22f6-48bd-99f5-60d843bc3740 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:52.976728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b28fa10f-22f6-48bd-99f5-60d843bc3740 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:52.980637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6f481b78-4eb7-400f-9302-3b81881cb6c6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:52.988663 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6f481b78-4eb7-400f-9302-3b81881cb6c6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1339 microversion: 2.1 time: 0.506913 Mar 05 20:48:52.992007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b28fa10f-22f6-48bd-99f5-60d843bc3740 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:52.992724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b28fa10f-22f6-48bd-99f5-60d843bc3740 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:52.993722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b28fa10f-22f6-48bd-99f5-60d843bc3740 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:52.994570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b28fa10f-22f6-48bd-99f5-60d843bc3740 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:52.995254 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 62/116] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:52 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1339 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:48:53.186591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b28fa10f-22f6-48bd-99f5-60d843bc3740 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:53.195482 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b28fa10f-22f6-48bd-99f5-60d843bc3740 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 0.232912 Mar 05 20:48:53.196089 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 55/117] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:52 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:54.014088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ad892b7b-5824-48a1-af7f-5efce7a5f282 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:54.014768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ad892b7b-5824-48a1-af7f-5efce7a5f282 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:54.029274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad892b7b-5824-48a1-af7f-5efce7a5f282 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:54.029732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad892b7b-5824-48a1-af7f-5efce7a5f282 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:54.030562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad892b7b-5824-48a1-af7f-5efce7a5f282 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:54.030999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad892b7b-5824-48a1-af7f-5efce7a5f282 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:54.216949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e79e6449-81c1-44fc-a3d5-171dacfd0c8e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:54.218409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e79e6449-81c1-44fc-a3d5-171dacfd0c8e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:54.235385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e79e6449-81c1-44fc-a3d5-171dacfd0c8e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:54.237216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e79e6449-81c1-44fc-a3d5-171dacfd0c8e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:54.240589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e79e6449-81c1-44fc-a3d5-171dacfd0c8e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:54.242312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e79e6449-81c1-44fc-a3d5-171dacfd0c8e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:54.458741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad892b7b-5824-48a1-af7f-5efce7a5f282 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:54.474097 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ad892b7b-5824-48a1-af7f-5efce7a5f282 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1339 microversion: 2.1 time: 0.466402 Mar 05 20:48:54.476731 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 63/118] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:54 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1339 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:54.580438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e79e6449-81c1-44fc-a3d5-171dacfd0c8e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:54.589891 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e79e6449-81c1-44fc-a3d5-171dacfd0c8e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 0.377757 Mar 05 20:48:54.597464 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 56/119] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:54 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:48:55.495869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b3438d4d-04c1-4b6d-9723-c68f05a63de3 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:55.496759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b3438d4d-04c1-4b6d-9723-c68f05a63de3 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:55.511037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3438d4d-04c1-4b6d-9723-c68f05a63de3 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:55.511515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3438d4d-04c1-4b6d-9723-c68f05a63de3 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:55.514614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3438d4d-04c1-4b6d-9723-c68f05a63de3 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:55.515083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3438d4d-04c1-4b6d-9723-c68f05a63de3 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:55.680915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2ae46bba-028d-44cd-a7c8-7bb4f59035e7 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Calling method '.version_select at 0x7fed5d3ea280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:55.682155 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:55.682155 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:55.683326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ae46bba-028d-44cd-a7c8-7bb4f59035e7 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:55.684232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ae46bba-028d-44cd-a7c8-7bb4f59035e7 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:55.685203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ae46bba-028d-44cd-a7c8-7bb4f59035e7 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:55.685815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ae46bba-028d-44cd-a7c8-7bb4f59035e7 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:55.750166 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2ae46bba-028d-44cd-a7c8-7bb4f59035e7 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.400624 Mar 05 20:48:55.760509 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 64/120] 10.222.0.15 () {58 vars in 1127 bytes} [Sat Mar 5 20:48:55 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:55.765688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8e053e58-4867-43b8-8b8f-6c3261db2bb6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:55.774584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8e053e58-4867-43b8-8b8f-6c3261db2bb6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:55.789663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e053e58-4867-43b8-8b8f-6c3261db2bb6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:55.790470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e053e58-4867-43b8-8b8f-6c3261db2bb6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:55.794376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e053e58-4867-43b8-8b8f-6c3261db2bb6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:55.794777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e053e58-4867-43b8-8b8f-6c3261db2bb6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:55.899985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b3438d4d-04c1-4b6d-9723-c68f05a63de3 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:55.914541 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b3438d4d-04c1-4b6d-9723-c68f05a63de3 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1339 microversion: 2.1 time: 0.424391 Mar 05 20:48:55.924089 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 57/121] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:55 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1339 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:56.274668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8e053e58-4867-43b8-8b8f-6c3261db2bb6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:56.290367 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8e053e58-4867-43b8-8b8f-6c3261db2bb6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 0.521240 Mar 05 20:48:56.291033 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 65/122] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:55 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:56.576773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-426f3e27-ff6d-4a14-82bf-b7dc0e375bac tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Calling method '.version_select at 0x7fed5d2a0310>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:56.578309 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:56.578309 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:56.579405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-426f3e27-ff6d-4a14-82bf-b7dc0e375bac tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '709fd7fb398448799573dd2ad758bf7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686bb93cea174f2fb0ab0d0e0a5f00b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:56.580661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-426f3e27-ff6d-4a14-82bf-b7dc0e375bac tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.581915 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-426f3e27-ff6d-4a14-82bf-b7dc0e375bac tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] 10.222.0.15 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.655375 Mar 05 20:48:56.583807 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 58/123] 10.222.0.15 () {58 vars in 1127 bytes} [Sat Mar 5 20:48:55 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 659 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:48:56.601396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85df931a-b185-4661-8cfa-a5d2c2a5ae95 tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Calling method '.version_select at 0x7fed5d37b0d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:56.602402 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:56.602402 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:56.604011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-85df931a-b185-4661-8cfa-a5d2c2a5ae95 tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '709fd7fb398448799573dd2ad758bf7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686bb93cea174f2fb0ab0d0e0a5f00b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:56.604791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85df931a-b185-4661-8cfa-a5d2c2a5ae95 tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.605736 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-85df931a-b185-4661-8cfa-a5d2c2a5ae95 tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] 10.222.0.15 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.016939 Mar 05 20:48:56.609065 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 66/124] 10.222.0.15 () {58 vars in 1190 bytes} [Sat Mar 5 20:48:56 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:48:56.628930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-276f86ee-293a-4b0e-bbff-9ca3fc958759 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Calling method '.version_select at 0x7fed5d27b9d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:56.630273 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:56.630273 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:56.646097 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-276f86ee-293a-4b0e-bbff-9ca3fc958759 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 05 20:48:56.646789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-276f86ee-293a-4b0e-bbff-9ca3fc958759 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.648286 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-276f86ee-293a-4b0e-bbff-9ca3fc958759 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.032689 Mar 05 20:48:56.650305 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 59/125] 10.222.0.15 () {58 vars in 1211 bytes} [Sat Mar 5 20:48:56 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:48:56.661694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-88d168a8-268b-45fa-a491-fd186bc6e934 tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Calling method '.version_select at 0x7fed5d2974c0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:56.662483 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:56.662483 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:56.663864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-88d168a8-268b-45fa-a491-fd186bc6e934 tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '709fd7fb398448799573dd2ad758bf7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686bb93cea174f2fb0ab0d0e0a5f00b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:56.664659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-88d168a8-268b-45fa-a491-fd186bc6e934 tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.665836 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-88d168a8-268b-45fa-a491-fd186bc6e934 tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] 10.222.0.15 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.008956 Mar 05 20:48:56.666855 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 67/126] 10.222.0.15 () {58 vars in 1169 bytes} [Sat Mar 5 20:48:56 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:48:56.676196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-620be4ef-76d5-43c4-b7d3-207ace71164e tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Calling method '.version_select at 0x7fed5d3141f0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:56.677222 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:56.677222 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:56.684197 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-620be4ef-76d5-43c4-b7d3-207ace71164e tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 05 20:48:56.685767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-620be4ef-76d5-43c4-b7d3-207ace71164e tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.686794 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-620be4ef-76d5-43c4-b7d3-207ace71164e tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.015129 Mar 05 20:48:56.687815 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 60/127] 10.222.0.15 () {58 vars in 1190 bytes} [Sat Mar 5 20:48:56 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:48:56.699136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b7c56e9d-4903-4eab-a7e3-83b0353071ea tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Calling method '.version_select at 0x7fed5d2974c0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:56.700623 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:56.700623 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:56.701961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b7c56e9d-4903-4eab-a7e3-83b0353071ea tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '709fd7fb398448799573dd2ad758bf7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686bb93cea174f2fb0ab0d0e0a5f00b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:56.702776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b7c56e9d-4903-4eab-a7e3-83b0353071ea tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.703768 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b7c56e9d-4903-4eab-a7e3-83b0353071ea tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] 10.222.0.15 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.010596 Mar 05 20:48:56.704959 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 68/128] 10.222.0.15 () {58 vars in 1196 bytes} [Sat Mar 5 20:48:56 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:48:56.716935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-02f1f1a7-9171-4a22-9941-39548e55587d tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Calling method '.version_select at 0x7fed5f3c2e50>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:56.718515 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:56.718515 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:56.730706 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-02f1f1a7-9171-4a22-9941-39548e55587d tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 05 20:48:56.731547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-02f1f1a7-9171-4a22-9941-39548e55587d tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.734354 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-02f1f1a7-9171-4a22-9941-39548e55587d tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.021618 Mar 05 20:48:56.735640 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 61/129] 10.222.0.15 () {58 vars in 1217 bytes} [Sat Mar 5 20:48:56 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:48:56.751635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-94df057a-3873-4edb-98e0-3e075acae5db tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Calling method '.version_select at 0x7fed5d27b1f0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:56.753232 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:56.753232 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:56.755411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-94df057a-3873-4edb-98e0-3e075acae5db tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '709fd7fb398448799573dd2ad758bf7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686bb93cea174f2fb0ab0d0e0a5f00b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:56.756760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-94df057a-3873-4edb-98e0-3e075acae5db tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.757789 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-94df057a-3873-4edb-98e0-3e075acae5db tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] 10.222.0.15 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.010714 Mar 05 20:48:56.759223 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 62/130] 10.222.0.15 () {58 vars in 1193 bytes} [Sat Mar 5 20:48:56 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:48:56.773983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fd066e5b-8a54-40e8-8509-cf41f541cb3a tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Calling method '.version_select at 0x7fed5d2a01f0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:56.790901 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-fd066e5b-8a54-40e8-8509-cf41f541cb3a tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 05 20:48:56.791722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fd066e5b-8a54-40e8-8509-cf41f541cb3a tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.793172 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fd066e5b-8a54-40e8-8509-cf41f541cb3a tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.027469 Mar 05 20:48:56.794008 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 63/131] 10.222.0.15 () {58 vars in 1214 bytes} [Sat Mar 5 20:48:56 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:48:56.804542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c90b4024-96c7-4f8a-93cb-bceee3febf71 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Action: 'update', calling method: .version_select at 0x7fed5d27b1f0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:56.805713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c90b4024-96c7-4f8a-93cb-bceee3febf71 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.806522 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c90b4024-96c7-4f8a-93cb-bceee3febf71 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.007009 Mar 05 20:48:56.807330 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 64/132] 10.222.0.15 () {60 vars in 1189 bytes} [Sat Mar 5 20:48:56 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:48:56.816117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8623a1ba-55af-4f25-a870-a0f4beba42d5 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Action: 'update', calling method: .version_select at 0x7fed5d25dd30>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:56.817957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8623a1ba-55af-4f25-a870-a0f4beba42d5 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.819042 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8623a1ba-55af-4f25-a870-a0f4beba42d5 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.006996 Mar 05 20:48:56.821100 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 65/133] 10.222.0.15 () {60 vars in 1189 bytes} [Sat Mar 5 20:48:56 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:48:56.834806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7ab27194-2a78-4555-b3b7-f355b5ce6d3b tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Action: 'update', calling method: .version_select at 0x7fed5d25ddc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:56.836700 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:56.836700 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:56.838692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7ab27194-2a78-4555-b3b7-f355b5ce6d3b tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '709fd7fb398448799573dd2ad758bf7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686bb93cea174f2fb0ab0d0e0a5f00b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:56.841189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7ab27194-2a78-4555-b3b7-f355b5ce6d3b tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.842234 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7ab27194-2a78-4555-b3b7-f355b5ce6d3b tempest-HostsAdminNegativeTestJSON-1918499039 tempest-HostsAdminNegativeTestJSON-1918499039-project] 10.222.0.15 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.014226 Mar 05 20:48:56.843297 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 66/134] 10.222.0.15 () {60 vars in 1189 bytes} [Sat Mar 5 20:48:56 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:48:56.853242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ab989a08-e426-4b96-85a4-23ab0c997110 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Action: 'update', calling method: .version_select at 0x7fed5d27b160>, body: {"status": null, "maintenance_mode": null} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:56.854357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ab989a08-e426-4b96-85a4-23ab0c997110 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.855147 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ab989a08-e426-4b96-85a4-23ab0c997110 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.006387 Mar 05 20:48:56.855943 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 67/135] 10.222.0.15 () {60 vars in 1189 bytes} [Sat Mar 5 20:48:56 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 05 20:48:56.869200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-04491b4c-a8b1-49a8-b30e-f94cda276945 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Action: 'update', calling method: .version_select at 0x7fed5d2a04c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:56.871862 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.hosts [None req-04491b4c-a8b1-49a8-b30e-f94cda276945 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Enabling host nonexistent_hostname. Mar 05 20:48:56.880986 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-04491b4c-a8b1-49a8-b30e-f94cda276945 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 05 20:48:56.881855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-04491b4c-a8b1-49a8-b30e-f94cda276945 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:48:56.883139 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-04491b4c-a8b1-49a8-b30e-f94cda276945 tempest-HostsAdminNegativeTestJSON-1575303025 tempest-HostsAdminNegativeTestJSON-1575303025-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.017332 Mar 05 20:48:56.884373 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 68/136] 10.222.0.15 () {60 vars in 1210 bytes} [Sat Mar 5 20:48:56 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:48:56.934607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e7325574-2b5b-4075-b684-7109aa8422f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:56.935224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e7325574-2b5b-4075-b684-7109aa8422f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:56.943213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7325574-2b5b-4075-b684-7109aa8422f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:56.943213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7325574-2b5b-4075-b684-7109aa8422f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:56.943687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7325574-2b5b-4075-b684-7109aa8422f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:56.944275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7325574-2b5b-4075-b684-7109aa8422f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:57.030178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0bc6cdc6-e552-4694-8cf4-f46517f7ddd4 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:57.045888 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0bc6cdc6-e552-4694-8cf4-f46517f7ddd4 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.306378 Mar 05 20:48:57.051614 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 69/137] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:48:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:48:57.154256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e7325574-2b5b-4075-b684-7109aa8422f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:57.165126 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e7325574-2b5b-4075-b684-7109aa8422f8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1339 microversion: 2.1 time: 0.234306 Mar 05 20:48:57.175960 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 69/138] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:56 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1339 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:48:57.307008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-51900675-2160-4d7a-8bdb-4e01b724b91d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:57.311318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-51900675-2160-4d7a-8bdb-4e01b724b91d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:57.316846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51900675-2160-4d7a-8bdb-4e01b724b91d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:57.317366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51900675-2160-4d7a-8bdb-4e01b724b91d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:57.318284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51900675-2160-4d7a-8bdb-4e01b724b91d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:57.318890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51900675-2160-4d7a-8bdb-4e01b724b91d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:57.484678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-51900675-2160-4d7a-8bdb-4e01b724b91d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:57.492837 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-51900675-2160-4d7a-8bdb-4e01b724b91d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 0.189573 Mar 05 20:48:57.493542 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 70/139] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:57 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:57.591190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4ba31da9-8ce6-4665-812e-53b9b55349f3 tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-535006634", "id": 1413646340, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:57.593878 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:57.593878 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:48:57.618634 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4ba31da9-8ce6-4665-812e-53b9b55349f3 tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.560325 Mar 05 20:48:57.619707 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 70/140] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:57 2022] POST /compute/v2.1/flavors => generated 424 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:48:57.633418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d3f34d54-51fd-4182-a89c-6ea6b63283bd tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:57.645564 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d3f34d54-51fd-4182-a89c-6ea6b63283bd tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017988 Mar 05 20:48:57.646775 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 71/141] 10.222.0.15 () {58 vars in 1181 bytes} [Sat Mar 5 20:48:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:48:57.659209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-81d5829d-e607-4d39-b009-d198cc83c449 tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-155375737", "id": 17424052, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:57.689682 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-81d5829d-e607-4d39-b009-d198cc83c449 tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 418 microversion: 2.1 time: 0.035002 Mar 05 20:48:57.701755 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 72/142] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:48:57 2022] POST /compute/v2.1/flavors => generated 418 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:57.712745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-066b6751-521b-4bec-bafd-d2f9d8d75333 tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:57.733885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a6043716-bceb-478a-88f5-1a37bbc47d81 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Calling method '.version_select at 0x7fed5d2a0f70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:57.737423 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:57.737423 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:57.737870 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-066b6751-521b-4bec-bafd-d2f9d8d75333 tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031277 Mar 05 20:48:57.738502 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 73/143] 10.222.0.15 () {58 vars in 1181 bytes} [Sat Mar 5 20:48:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 05 20:48:57.748112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6043716-bceb-478a-88f5-1a37bbc47d81 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:57.749091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6043716-bceb-478a-88f5-1a37bbc47d81 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:57.752320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4017f7aa-235d-4cc3-87c7-0d9c8b21b071 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Action: 'create', calling method: .version_select at 0x7fed5d2975e0>, body: {"keypair": {"name": "tempest-keypair-234183081"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:48:57.791139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6043716-bceb-478a-88f5-1a37bbc47d81 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:57.795393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6043716-bceb-478a-88f5-1a37bbc47d81 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:57.918571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6043716-bceb-478a-88f5-1a37bbc47d81 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:57.920718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6043716-bceb-478a-88f5-1a37bbc47d81 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:57.942088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6043716-bceb-478a-88f5-1a37bbc47d81 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:57.943207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6043716-bceb-478a-88f5-1a37bbc47d81 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:57.971233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6043716-bceb-478a-88f5-1a37bbc47d81 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:57.972961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6043716-bceb-478a-88f5-1a37bbc47d81 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:57.983134 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a6043716-bceb-478a-88f5-1a37bbc47d81 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 0.488426 Mar 05 20:48:57.984948 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 71/144] 10.222.0.15 () {60 vars in 1242 bytes} [Sat Mar 5 20:48:57 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:48:58.005882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5c42370a-0d30-4737-950e-ea6fd246d115 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Calling method '.version_select at 0x7fed5d2a0ee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:58.010009 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:58.010009 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:58.012189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c42370a-0d30-4737-950e-ea6fd246d115 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:58.016777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c42370a-0d30-4737-950e-ea6fd246d115 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:58.064063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c42370a-0d30-4737-950e-ea6fd246d115 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:58.068665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c42370a-0d30-4737-950e-ea6fd246d115 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:58.153018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c42370a-0d30-4737-950e-ea6fd246d115 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:58.153480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c42370a-0d30-4737-950e-ea6fd246d115 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:58.158942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-4017f7aa-235d-4cc3-87c7-0d9c8b21b071 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Getting quotas for project 4e0a2d8f510f49999fc3094858af40d6. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:48:58.170720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-4017f7aa-235d-4cc3-87c7-0d9c8b21b071 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Getting quotas for user 839c64fcb5d249ffac671c90d252e1e3 and project 4e0a2d8f510f49999fc3094858af40d6. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:48:58.179017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c42370a-0d30-4737-950e-ea6fd246d115 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:58.179480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c42370a-0d30-4737-950e-ea6fd246d115 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:58.217535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c42370a-0d30-4737-950e-ea6fd246d115 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:58.218039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c42370a-0d30-4737-950e-ea6fd246d115 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:58.225414 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5c42370a-0d30-4737-950e-ea6fd246d115 tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 436 microversion: 2.53 time: 0.228555 Mar 05 20:48:58.226330 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 72/145] 10.222.0.15 () {60 vars in 1221 bytes} [Sat Mar 5 20:48:57 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 436 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:48:58.230949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-689bf71f-7fe7-4a6e-8401-04f979449c31 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:58.231567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-689bf71f-7fe7-4a6e-8401-04f979449c31 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:58.252562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-689bf71f-7fe7-4a6e-8401-04f979449c31 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:58.254301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-689bf71f-7fe7-4a6e-8401-04f979449c31 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:58.255174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-689bf71f-7fe7-4a6e-8401-04f979449c31 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:58.255607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-689bf71f-7fe7-4a6e-8401-04f979449c31 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:58.535513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-689bf71f-7fe7-4a6e-8401-04f979449c31 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:58.545086 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-689bf71f-7fe7-4a6e-8401-04f979449c31 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1339 microversion: 2.1 time: 0.317714 Mar 05 20:48:58.549068 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 73/146] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:58 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1339 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:58.568978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a21532f8-04b3-4aee-a37f-3c676231753e tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Calling method '.version_select at 0x7fed5d27b9d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:58.574880 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:48:58.574880 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:48:58.578283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a21532f8-04b3-4aee-a37f-3c676231753e tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:58.579141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a21532f8-04b3-4aee-a37f-3c676231753e tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:58.603903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a21532f8-04b3-4aee-a37f-3c676231753e tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:58.604610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a21532f8-04b3-4aee-a37f-3c676231753e tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:58.611223 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a21532f8-04b3-4aee-a37f-3c676231753e tempest-HypervisorAdminV253TestBase-124474941 tempest-HypervisorAdminV253TestBase-124474941-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/1cbca502-96a2-4e39-ad91-0a23c22046ca" status: 200 len: 792 microversion: 2.53 time: 0.060133 Mar 05 20:48:58.613788 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 74/147] 10.222.0.15 () {60 vars in 1297 bytes} [Sat Mar 5 20:48:58 2022] GET /compute/v2.1/os-hypervisors/1cbca502-96a2-4e39-ad91-0a23c22046ca => generated 792 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:48:58.746671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-4017f7aa-235d-4cc3-87c7-0d9c8b21b071 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Getting quotas for project 4e0a2d8f510f49999fc3094858af40d6. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:48:58.753363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-4017f7aa-235d-4cc3-87c7-0d9c8b21b071 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Getting quotas for user 839c64fcb5d249ffac671c90d252e1e3 and project 4e0a2d8f510f49999fc3094858af40d6. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:48:58.772265 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4017f7aa-235d-4cc3-87c7-0d9c8b21b071 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.024892 Mar 05 20:48:58.773099 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 74/148] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:48:57 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:48:58.779831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6906c52-1c88-44a6-974d-7979c3ddceb5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:58.780603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6906c52-1c88-44a6-974d-7979c3ddceb5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:58.788723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6906c52-1c88-44a6-974d-7979c3ddceb5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:58.789334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6906c52-1c88-44a6-974d-7979c3ddceb5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:58.790188 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6906c52-1c88-44a6-974d-7979c3ddceb5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:58.790890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6906c52-1c88-44a6-974d-7979c3ddceb5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:58.930445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c2813b83-fea5-4b36-9ea0-4aae25dd15d2 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Calling method '.version_select at 0x7fed5d27b820>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:59.054723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6906c52-1c88-44a6-974d-7979c3ddceb5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:48:59.062965 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6906c52-1c88-44a6-974d-7979c3ddceb5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 0.288609 Mar 05 20:48:59.066707 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 75/149] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:58 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:48:59.564195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f8b331df-99ed-457c-9f01-c4627780b79f tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:48:59.564705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f8b331df-99ed-457c-9f01-c4627780b79f tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:48:59.576299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8b331df-99ed-457c-9f01-c4627780b79f tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:59.579318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8b331df-99ed-457c-9f01-c4627780b79f tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:59.582795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8b331df-99ed-457c-9f01-c4627780b79f tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:48:59.583318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8b331df-99ed-457c-9f01-c4627780b79f tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:48:59.980299 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c2813b83-fea5-4b36-9ea0-4aae25dd15d2 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/673fdcfaf3af45cb9b2de80097220651" status: 200 len: 371 microversion: 2.1 time: 1.365153 Mar 05 20:48:59.985828 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 75/150] 10.222.0.15 () {58 vars in 1241 bytes} [Sat Mar 5 20:48:58 2022] GET /compute/v2.1/os-quota-sets/673fdcfaf3af45cb9b2de80097220651 => generated 371 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:48:59.997992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ff06a1b-a137-40c1-93f3-4ecb87b4eef8 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Action: 'update', calling method: .version_select at 0x7fed5d1f09d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:00.128486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f8b331df-99ed-457c-9f01-c4627780b79f tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:00.141128 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f8b331df-99ed-457c-9f01-c4627780b79f tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1339 microversion: 2.1 time: 0.581890 Mar 05 20:49:00.143014 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 76/151] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:48:59 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1339 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:00.476931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ff06a1b-a137-40c1-93f3-4ecb87b4eef8 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:00.477106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ff06a1b-a137-40c1-93f3-4ecb87b4eef8 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:00.480185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ff06a1b-a137-40c1-93f3-4ecb87b4eef8 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:00.480649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ff06a1b-a137-40c1-93f3-4ecb87b4eef8 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:00.620267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cd739434-ba20-47ab-88b6-6656ac06712e tempest-FlavorMetadataValidation-362201572 tempest-FlavorMetadataValidation-362201572-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1847089340", "id": 1475562898, "os-flavor-access:is_public": "True"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:00.623546 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ff06a1b-a137-40c1-93f3-4ecb87b4eef8 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/673fdcfaf3af45cb9b2de80097220651" status: 200 len: 328 microversion: 2.1 time: 0.630110 Mar 05 20:49:00.628467 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 76/152] 10.222.0.15 () {60 vars in 1261 bytes} [Sat Mar 5 20:48:59 2022] PUT /compute/v2.1/os-quota-sets/673fdcfaf3af45cb9b2de80097220651 => generated 328 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:00.628611 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:00.628611 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:00.636468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6152b62e-7666-4216-9662-8f6f64f7244a tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:00.637111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6152b62e-7666-4216-9662-8f6f64f7244a tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:00.657002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6152b62e-7666-4216-9662-8f6f64f7244a tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:00.659273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6152b62e-7666-4216-9662-8f6f64f7244a tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:00.661882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6152b62e-7666-4216-9662-8f6f64f7244a tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:00.662666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6152b62e-7666-4216-9662-8f6f64f7244a tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:00.691206 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cd739434-ba20-47ab-88b6-6656ac06712e tempest-FlavorMetadataValidation-362201572 tempest-FlavorMetadataValidation-362201572-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.543085 Mar 05 20:49:00.696090 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 77/153] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 20:49:00 2022] POST /compute/v2.1/flavors => generated 471 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:49:00.728992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-48dbb891-3667-4490-87f3-0e0ebae3d524 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:00.766755 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-48dbb891-3667-4490-87f3-0e0ebae3d524 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-quota-sets/673fdcfaf3af45cb9b2de80097220651" status: 202 len: 0 microversion: 2.1 time: 0.067343 Mar 05 20:49:00.767764 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 78/154] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:49:00 2022] DELETE /compute/v2.1/os-quota-sets/673fdcfaf3af45cb9b2de80097220651 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:49:00.782834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f8db9345-e211-4cb0-8485-7530551cc0ff tempest-FlavorMetadataValidation-362201572 tempest-FlavorMetadataValidation-362201572-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:00.785280 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:00.785280 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:01.031689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6152b62e-7666-4216-9662-8f6f64f7244a tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:01.043615 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6152b62e-7666-4216-9662-8f6f64f7244a tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 0.413286 Mar 05 20:49:01.053239 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 77/155] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:00 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:01.060144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7828cfcc-e417-450f-8c47-71b7f4024418 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Calling method '.version_select at 0x7fed5d18cca0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:01.165219 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f8db9345-e211-4cb0-8485-7530551cc0ff tempest-FlavorMetadataValidation-362201572 tempest-FlavorMetadataValidation-362201572-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/1475562898/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.394813 Mar 05 20:49:01.167356 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 79/156] 10.222.0.15 () {62 vars in 1264 bytes} [Sat Mar 5 20:49:00 2022] POST /compute/v2.1/flavors/1475562898/os-extra_specs => generated 62 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:01.178346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-feae666c-8d18-4254-9287-e08cbf149ed6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:01.179141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-feae666c-8d18-4254-9287-e08cbf149ed6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:01.199114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-feae666c-8d18-4254-9287-e08cbf149ed6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:01.199649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-feae666c-8d18-4254-9287-e08cbf149ed6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:01.200523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-feae666c-8d18-4254-9287-e08cbf149ed6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:01.201049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-feae666c-8d18-4254-9287-e08cbf149ed6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:01.492538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-feae666c-8d18-4254-9287-e08cbf149ed6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:01.504406 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-feae666c-8d18-4254-9287-e08cbf149ed6 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1339 microversion: 2.1 time: 0.335197 Mar 05 20:49:01.505014 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 80/157] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:01 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1339 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:01.535823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f484557d-c1d2-4734-9bf0-d06df872ee43 tempest-FlavorMetadataValidation-362201572 tempest-FlavorMetadataValidation-362201572-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:01.537342 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:01.537342 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:01.599303 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f484557d-c1d2-4734-9bf0-d06df872ee43 tempest-FlavorMetadataValidation-362201572 tempest-FlavorMetadataValidation-362201572-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1475562898" status: 202 len: 0 microversion: 2.86 time: 0.091514 Mar 05 20:49:01.610583 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 81/158] 10.222.0.15 () {60 vars in 1201 bytes} [Sat Mar 5 20:49:01 2022] DELETE /compute/v2.1/flavors/1475562898 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:49:01.619097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-972400559", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "17424052", "adminPass": "***", "networks": [{"uuid": "da32bc16-2a34-4e4f-9967-3e30a71f2738"}], "security_groups": [{"name": "tempest-securitygroup--1333199342"}], "key_name": "tempest-keypair-234183081", "user_data": "}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:01.742549 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7828cfcc-e417-450f-8c47-71b7f4024418 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/673fdcfaf3af45cb9b2de80097220651" status: 200 len: 371 microversion: 2.1 time: 0.696534 Mar 05 20:49:01.744630 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 78/159] 10.222.0.15 () {58 vars in 1241 bytes} [Sat Mar 5 20:49:01 2022] GET /compute/v2.1/os-quota-sets/673fdcfaf3af45cb9b2de80097220651 => generated 371 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:01.763369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8cd6b356-a40e-4b68-b478-ced2c5b8d205 tempest-FlavorMetadataValidation-362201572 tempest-FlavorMetadataValidation-362201572-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:01.791311 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8cd6b356-a40e-4b68-b478-ced2c5b8d205 tempest-FlavorMetadataValidation-362201572 tempest-FlavorMetadataValidation-362201572-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 6677 microversion: 2.86 time: 0.043812 Mar 05 20:49:01.793147 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 79/160] 10.222.0.15 () {60 vars in 1186 bytes} [Sat Mar 5 20:49:01 2022] GET /compute/v2.1/flavors/detail => generated 6677 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:49:01.970415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] validate_networks() for [('da32bc16-2a34-4e4f-9967-3e30a71f2738', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:02.369881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-14a8ff9e-ab79-451b-b152-265443fc6594 req-ede549f5-afe0-4f85-9ee7-5bf3542c5be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf55fc7-8496-4922-9291-4b258266c92b", "name": "network-vif-plugged", "status": "completed", "tag": "ed241cfc-58db-4f9b-adfb-a457a1c0e3e4"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:02.384416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-14a8ff9e-ab79-451b-b152-265443fc6594 req-ede549f5-afe0-4f85-9ee7-5bf3542c5be9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:02.384861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-14a8ff9e-ab79-451b-b152-265443fc6594 req-ede549f5-afe0-4f85-9ee7-5bf3542c5be9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:02.415462 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-14a8ff9e-ab79-451b-b152-265443fc6594 req-ede549f5-afe0-4f85-9ee7-5bf3542c5be9 service nova] Creating event network-vif-plugged:ed241cfc-58db-4f9b-adfb-a457a1c0e3e4 for instance ebf55fc7-8496-4922-9291-4b258266c92b on nch1-master-1 Mar 05 20:49:02.426377 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-14a8ff9e-ab79-451b-b152-265443fc6594 req-ede549f5-afe0-4f85-9ee7-5bf3542c5be9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.493786 Mar 05 20:49:02.429546 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 80/161] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:49:02.444276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-37ebb4e6-053f-422e-991f-258b70222407 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Calling method '.version_select at 0x7fed5d2a0040>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:02.916143 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-37ebb4e6-053f-422e-991f-258b70222407 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/d154636ca59542d79cbe76a54d4c9d63/defaults" status: 200 len: 371 microversion: 2.1 time: 0.483396 Mar 05 20:49:02.916852 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 81/162] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 20:49:02 2022] GET /compute/v2.1/os-quota-sets/d154636ca59542d79cbe76a54d4c9d63/defaults => generated 371 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:02.921727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dfe859dd-86c4-4571-9343-bc5c65d91176 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:02.925433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dfe859dd-86c4-4571-9343-bc5c65d91176 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:02.934108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dfe859dd-86c4-4571-9343-bc5c65d91176 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:02.934603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dfe859dd-86c4-4571-9343-bc5c65d91176 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:02.939236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dfe859dd-86c4-4571-9343-bc5c65d91176 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:02.939236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dfe859dd-86c4-4571-9343-bc5c65d91176 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:03.186170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dfe859dd-86c4-4571-9343-bc5c65d91176 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:03.195465 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dfe859dd-86c4-4571-9343-bc5c65d91176 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 0.277460 Mar 05 20:49:03.197996 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 82/163] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:02 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:03.206658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ef4c1727-4d61-4447-93fc-5df9adfce8e4 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:03.211985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ef4c1727-4d61-4447-93fc-5df9adfce8e4 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:03.220807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef4c1727-4d61-4447-93fc-5df9adfce8e4 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:03.222566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef4c1727-4d61-4447-93fc-5df9adfce8e4 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:03.223865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef4c1727-4d61-4447-93fc-5df9adfce8e4 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:03.224709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef4c1727-4d61-4447-93fc-5df9adfce8e4 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:03.270592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:03.271148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:03.271562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:03.272317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:03.272767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:03.288320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:03.291048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:03.293195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:03.293892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:03.316175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Getting quotas for project 4e0a2d8f510f49999fc3094858af40d6. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:03.322066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Getting quotas for user 839c64fcb5d249ffac671c90d252e1e3 and project 4e0a2d8f510f49999fc3094858af40d6. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:03.344504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:49:03.347908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:03.425456 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d99f81c1-bcb6-4366-b559-58b79022ee70 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.812600 Mar 05 20:49:03.426324 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 82/164] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:49:03.436419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0c46e19b-d356-447e-8d40-bf8cdf36ad14 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Action: 'update', calling method: .version_select at 0x7fed5f74b160>, body: {"quota_set": {"ram": "5120"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:03.437034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ef4c1727-4d61-4447-93fc-5df9adfce8e4 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:03.447489 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ef4c1727-4d61-4447-93fc-5df9adfce8e4 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1339 microversion: 2.1 time: 0.245195 Mar 05 20:49:03.457413 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 83/165] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:03 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1339 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:03.462756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-25477caf-d8b8-48a9-a53b-f049ebec6060 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:03.463549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-25477caf-d8b8-48a9-a53b-f049ebec6060 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:03.540310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-25477caf-d8b8-48a9-a53b-f049ebec6060 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:03.547403 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-25477caf-d8b8-48a9-a53b-f049ebec6060 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1259 microversion: 2.1 time: 0.089420 Mar 05 20:49:03.548094 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 84/166] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:03 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1259 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:03.884562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c46e19b-d356-447e-8d40-bf8cdf36ad14 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:03.885214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c46e19b-d356-447e-8d40-bf8cdf36ad14 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:03.886153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c46e19b-d356-447e-8d40-bf8cdf36ad14 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:03.886743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c46e19b-d356-447e-8d40-bf8cdf36ad14 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:03.979105 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0c46e19b-d356-447e-8d40-bf8cdf36ad14 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/645debb6911b42d7a1dd1a5237fdbf5c" status: 200 len: 328 microversion: 2.1 time: 0.550453 Mar 05 20:49:03.983865 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 83/167] 10.222.0.15 () {60 vars in 1261 bytes} [Sat Mar 5 20:49:03 2022] PUT /compute/v2.1/os-quota-sets/645debb6911b42d7a1dd1a5237fdbf5c => generated 328 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:03.989402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-952664681", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:04.012326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-71264309-3294-4b4c-90ae-08d121bcbac8 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Calling method '.version_select at 0x7fed5d37b940>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:04.068035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:04.365246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71264309-3294-4b4c-90ae-08d121bcbac8 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:04.366396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71264309-3294-4b4c-90ae-08d121bcbac8 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:04.367395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71264309-3294-4b4c-90ae-08d121bcbac8 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:04.368018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71264309-3294-4b4c-90ae-08d121bcbac8 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:04.371940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:04.372357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:04.372820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:04.373392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:04.374126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:04.391263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:04.391747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:04.392575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:04.393239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:04.421164 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-71264309-3294-4b4c-90ae-08d121bcbac8 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/645debb6911b42d7a1dd1a5237fdbf5c/detail" status: 200 len: 916 microversion: 2.1 time: 0.424805 Mar 05 20:49:04.422167 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 84/168] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:49:03 2022] GET /compute/v2.1/os-quota-sets/645debb6911b42d7a1dd1a5237fdbf5c/detail => generated 916 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:04.424045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:04.428583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:04.437838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c7efce4a-96fc-4e0e-945d-c378e2631fac tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:04.439797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c7efce4a-96fc-4e0e-945d-c378e2631fac tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:04.446803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:49:04.450391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:04.474927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7efce4a-96fc-4e0e-945d-c378e2631fac tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:04.476777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7efce4a-96fc-4e0e-945d-c378e2631fac tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:04.478980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7efce4a-96fc-4e0e-945d-c378e2631fac tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:04.481110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7efce4a-96fc-4e0e-945d-c378e2631fac tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:04.539154 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-da9938c3-54cc-4aea-8743-0758e3da2239 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704028 Mar 05 20:49:04.541021 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 85/169] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 20:49:04.560931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-50978baa-7e4f-4f76-b34d-2a690190a95a req-79904c63-955f-470a-bf49-6085172a2d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bafedc-69d2-4784-8413-e4f9060b4acf", "name": "network-vif-plugged", "status": "completed", "tag": "326c6caa-2b24-4f53-a872-561f3573012c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:04.588439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-50978baa-7e4f-4f76-b34d-2a690190a95a req-79904c63-955f-470a-bf49-6085172a2d4d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:04.590379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-50978baa-7e4f-4f76-b34d-2a690190a95a req-79904c63-955f-470a-bf49-6085172a2d4d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:04.624488 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-50978baa-7e4f-4f76-b34d-2a690190a95a req-79904c63-955f-470a-bf49-6085172a2d4d service nova] Creating event network-vif-plugged:326c6caa-2b24-4f53-a872-561f3573012c for instance f3bafedc-69d2-4784-8413-e4f9060b4acf on nch1-master-1 Mar 05 20:49:04.631397 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-50978baa-7e4f-4f76-b34d-2a690190a95a req-79904c63-955f-470a-bf49-6085172a2d4d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087968 Mar 05 20:49:04.633604 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 86/170] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:04.653772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-55e4b2bb-5aa2-4a0b-8ef6-003d6775bc6e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:04.655018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-55e4b2bb-5aa2-4a0b-8ef6-003d6775bc6e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:04.663476 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55e4b2bb-5aa2-4a0b-8ef6-003d6775bc6e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:04.664029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55e4b2bb-5aa2-4a0b-8ef6-003d6775bc6e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:04.665022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55e4b2bb-5aa2-4a0b-8ef6-003d6775bc6e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:04.665796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55e4b2bb-5aa2-4a0b-8ef6-003d6775bc6e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:04.733270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c7efce4a-96fc-4e0e-945d-c378e2631fac tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:04.766424 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c7efce4a-96fc-4e0e-945d-c378e2631fac tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 0.338627 Mar 05 20:49:04.772561 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 85/171] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:04 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:04.785052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ca56b9ca-a5e2-4121-95c4-82a90f0cda29 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:04.789000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ca56b9ca-a5e2-4121-95c4-82a90f0cda29 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:04.986855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-55e4b2bb-5aa2-4a0b-8ef6-003d6775bc6e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:04.998334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ca56b9ca-a5e2-4121-95c4-82a90f0cda29 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:04.999353 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-55e4b2bb-5aa2-4a0b-8ef6-003d6775bc6e tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1339 microversion: 2.1 time: 0.360668 Mar 05 20:49:05.006045 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 87/172] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:04 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1339 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:05.016590 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ca56b9ca-a5e2-4121-95c4-82a90f0cda29 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1216 microversion: 2.1 time: 0.242754 Mar 05 20:49:05.016776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2ab11372-b0fa-4158-9428-eb7c8184820d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:05.020873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2ab11372-b0fa-4158-9428-eb7c8184820d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:05.030189 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 86/173] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:04 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1216 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:05.036026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ab11372-b0fa-4158-9428-eb7c8184820d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:05.036495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ab11372-b0fa-4158-9428-eb7c8184820d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:05.037365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ab11372-b0fa-4158-9428-eb7c8184820d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:05.037814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ab11372-b0fa-4158-9428-eb7c8184820d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:05.148998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2ab11372-b0fa-4158-9428-eb7c8184820d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:05.163249 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2ab11372-b0fa-4158-9428-eb7c8184820d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1317 microversion: 2.1 time: 0.155850 Mar 05 20:49:05.166063 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 88/174] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:05 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:05.273275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c364a33f-dafe-42b8-bf85-562935d26a59 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Action: 'update', calling method: .version_select at 0x7fed5d37b0d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:05.531784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c364a33f-dafe-42b8-bf85-562935d26a59 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:05.532709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c364a33f-dafe-42b8-bf85-562935d26a59 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:05.533748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c364a33f-dafe-42b8-bf85-562935d26a59 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:05.535061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c364a33f-dafe-42b8-bf85-562935d26a59 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:05.573099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c364a33f-dafe-42b8-bf85-562935d26a59 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:05.573563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c364a33f-dafe-42b8-bf85-562935d26a59 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:05.574447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c364a33f-dafe-42b8-bf85-562935d26a59 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:05.574956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c364a33f-dafe-42b8-bf85-562935d26a59 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:05.656915 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c364a33f-dafe-42b8-bf85-562935d26a59 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/645debb6911b42d7a1dd1a5237fdbf5c?user_id=fd2268a052c04fb6a8490fab4036186c" status: 200 len: 328 microversion: 2.1 time: 0.387592 Mar 05 20:49:05.658268 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 87/175] 10.222.0.15 () {60 vars in 1342 bytes} [Sat Mar 5 20:49:05 2022] PUT /compute/v2.1/os-quota-sets/645debb6911b42d7a1dd1a5237fdbf5c?user_id=fd2268a052c04fb6a8490fab4036186c => generated 328 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:05.670406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-50b0fb96-1fa6-4304-a306-81beb8c8f793 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Calling method '.version_select at 0x7fed5d297820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:05.776172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-99fbfe49-0a50-4a5b-af72-72c69cbc7cb1 tempest-InstanceUsageAuditLogNegativeTestJSON-1786718815 tempest-InstanceUsageAuditLogNegativeTestJSON-1786718815-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:05.777212 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:05.777212 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:05.778426 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-99fbfe49-0a50-4a5b-af72-72c69cbc7cb1 tempest-InstanceUsageAuditLogNegativeTestJSON-1786718815 tempest-InstanceUsageAuditLogNegativeTestJSON-1786718815-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Mar 05 20:49:05.779002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-99fbfe49-0a50-4a5b-af72-72c69cbc7cb1 tempest-InstanceUsageAuditLogNegativeTestJSON-1786718815 tempest-InstanceUsageAuditLogNegativeTestJSON-1786718815-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:05.780090 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-99fbfe49-0a50-4a5b-af72-72c69cbc7cb1 tempest-InstanceUsageAuditLogNegativeTestJSON-1786718815 tempest-InstanceUsageAuditLogNegativeTestJSON-1786718815-project-admin] 10.222.0.15 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.132797 Mar 05 20:49:05.780719 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 89/176] 10.222.0.15 () {58 vars in 1223 bytes} [Sat Mar 5 20:49:05 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 05 20:49:05.788533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67221b1e-3dc7-4cf4-8e55-db999d3319fa tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:05.789226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-67221b1e-3dc7-4cf4-8e55-db999d3319fa tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:05.796171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67221b1e-3dc7-4cf4-8e55-db999d3319fa tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:05.796751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67221b1e-3dc7-4cf4-8e55-db999d3319fa tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:05.797713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67221b1e-3dc7-4cf4-8e55-db999d3319fa tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:05.798244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67221b1e-3dc7-4cf4-8e55-db999d3319fa tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:05.956801 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-50b0fb96-1fa6-4304-a306-81beb8c8f793 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/645debb6911b42d7a1dd1a5237fdbf5c?user_id=fd2268a052c04fb6a8490fab4036186c" status: 200 len: 370 microversion: 2.1 time: 0.289749 Mar 05 20:49:05.962087 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 88/177] 10.222.0.15 () {58 vars in 1322 bytes} [Sat Mar 5 20:49:05 2022] GET /compute/v2.1/os-quota-sets/645debb6911b42d7a1dd1a5237fdbf5c?user_id=fd2268a052c04fb6a8490fab4036186c => generated 370 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:49:05.988080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-67221b1e-3dc7-4cf4-8e55-db999d3319fa tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:05.997770 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67221b1e-3dc7-4cf4-8e55-db999d3319fa tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1341 microversion: 2.1 time: 0.215813 Mar 05 20:49:06.005860 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 90/178] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:05 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1341 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:06.016642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-13179198-4193-4e32-beb9-7bf6c359eb7b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:06.017441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-13179198-4193-4e32-beb9-7bf6c359eb7b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:06.023983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-13179198-4193-4e32-beb9-7bf6c359eb7b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:06.024517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-13179198-4193-4e32-beb9-7bf6c359eb7b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:06.025308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-13179198-4193-4e32-beb9-7bf6c359eb7b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:06.025753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-13179198-4193-4e32-beb9-7bf6c359eb7b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:06.209093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-13179198-4193-4e32-beb9-7bf6c359eb7b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:06.225418 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-13179198-4193-4e32-beb9-7bf6c359eb7b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1489 microversion: 2.1 time: 0.212462 Mar 05 20:49:06.226255 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 91/179] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:06 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1489 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:06.231065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8b7e0f0d-3c69-4b53-b3f6-8372ca650892 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:06.231708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8b7e0f0d-3c69-4b53-b3f6-8372ca650892 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:06.258106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b7e0f0d-3c69-4b53-b3f6-8372ca650892 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:06.261920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b7e0f0d-3c69-4b53-b3f6-8372ca650892 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:06.263004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b7e0f0d-3c69-4b53-b3f6-8372ca650892 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:06.263641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b7e0f0d-3c69-4b53-b3f6-8372ca650892 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:06.356501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8b7e0f0d-3c69-4b53-b3f6-8372ca650892 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:06.375197 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8b7e0f0d-3c69-4b53-b3f6-8372ca650892 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1220 microversion: 2.1 time: 0.144394 Mar 05 20:49:06.375941 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 92/180] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:06 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1220 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:06.381836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5f2a9dfb-9e53-4946-ac7c-794a5e62a594 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:06.382618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5f2a9dfb-9e53-4946-ac7c-794a5e62a594 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:06.394847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41e465d1-be12-4190-813b-197ef1413c3a tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565 tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:06.395987 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:06.395987 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:06.397333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-41e465d1-be12-4190-813b-197ef1413c3a tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565 tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '2103a562b34546e1922382cca699cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230e1cf17f114844a1e058c75e1c9948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:06.397985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41e465d1-be12-4190-813b-197ef1413c3a tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565 tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:06.398949 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-41e465d1-be12-4190-813b-197ef1413c3a tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565 tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565-project] 10.222.0.15 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.435686 Mar 05 20:49:06.399412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f2a9dfb-9e53-4946-ac7c-794a5e62a594 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:06.400118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f2a9dfb-9e53-4946-ac7c-794a5e62a594 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:06.400635 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 89/181] 10.222.0.15 () {58 vars in 1184 bytes} [Sat Mar 5 20:49:05 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 438 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:06.404944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f2a9dfb-9e53-4946-ac7c-794a5e62a594 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:06.405845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f2a9dfb-9e53-4946-ac7c-794a5e62a594 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:06.410960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2e0973c1-db29-4d29-a66a-42bf16c9cc67 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:06.413571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2e0973c1-db29-4d29-a66a-42bf16c9cc67 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:06.429947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e0973c1-db29-4d29-a66a-42bf16c9cc67 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:06.430405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e0973c1-db29-4d29-a66a-42bf16c9cc67 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:06.431316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e0973c1-db29-4d29-a66a-42bf16c9cc67 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:06.431896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e0973c1-db29-4d29-a66a-42bf16c9cc67 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:06.497807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5f2a9dfb-9e53-4946-ac7c-794a5e62a594 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:06.506823 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5f2a9dfb-9e53-4946-ac7c-794a5e62a594 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1317 microversion: 2.1 time: 0.129849 Mar 05 20:49:06.516862 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 93/182] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:06 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:06.522524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ca2266da-d2b1-4e0b-845f-19a8b919f087 tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565 tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:06.523275 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:06.523275 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:06.524957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ca2266da-d2b1-4e0b-845f-19a8b919f087 tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565 tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '2103a562b34546e1922382cca699cd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230e1cf17f114844a1e058c75e1c9948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:06.525934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ca2266da-d2b1-4e0b-845f-19a8b919f087 tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565 tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:06.526927 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ca2266da-d2b1-4e0b-845f-19a8b919f087 tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565 tempest-InstanceUsageAuditLogNegativeTestJSON-2078436565-project] 10.222.0.15 "GET /compute/v2.1/os-instance_usage_audit_log/2022-03-05 20:49:06" status: 403 len: 128 microversion: 2.1 time: 0.008968 Mar 05 20:49:06.527441 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 94/183] 10.222.0.15 () {58 vars in 1250 bytes} [Sat Mar 5 20:49:06 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-03-05%2020%3A49%3A06 => generated 128 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:06.588029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0a644345-e460-4a46-a284-ecf94fcb3f3c tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Calling method '.version_select at 0x7fed5d25d280>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:06.986481 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2e0973c1-db29-4d29-a66a-42bf16c9cc67 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1640 microversion: 2.1 time: 0.583952 Mar 05 20:49:06.993803 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 90/184] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:06 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1640 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:07.030568 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0a644345-e460-4a46-a284-ecf94fcb3f3c tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/d154636ca59542d79cbe76a54d4c9d63/defaults" status: 200 len: 371 microversion: 2.1 time: 0.449982 Mar 05 20:49:07.031219 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 95/185] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 20:49:06 2022] GET /compute/v2.1/os-quota-sets/d154636ca59542d79cbe76a54d4c9d63/defaults => generated 371 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:07.042504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-08d05edf-cff3-4632-a1e7-f1a13080de13 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:07.042992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-08d05edf-cff3-4632-a1e7-f1a13080de13 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:07.050365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-08d05edf-cff3-4632-a1e7-f1a13080de13 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:07.050818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-08d05edf-cff3-4632-a1e7-f1a13080de13 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:07.051617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-08d05edf-cff3-4632-a1e7-f1a13080de13 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:07.052094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-08d05edf-cff3-4632-a1e7-f1a13080de13 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:07.079624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-08d05edf-cff3-4632-a1e7-f1a13080de13 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:49:07.159974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5571ad4f-1700-49e3-9d26-82d13d51e02d tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-42455001", "ram": 512, "vcpus": 1, "disk": 10, "id": 1714699542, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:07.161943 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:07.161943 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:07.187023 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5571ad4f-1700-49e3-9d26-82d13d51e02d tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.192058 Mar 05 20:49:07.187951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 91/186] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:06 2022] POST /compute/v2.1/flavors => generated 414 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:07.198215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-28e62d46-3933-4bf7-8beb-107e6c376a14 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:07.198986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-28e62d46-3933-4bf7-8beb-107e6c376a14 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:07.216989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28e62d46-3933-4bf7-8beb-107e6c376a14 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:07.218380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28e62d46-3933-4bf7-8beb-107e6c376a14 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:07.219372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28e62d46-3933-4bf7-8beb-107e6c376a14 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:07.219811 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-08d05edf-cff3-4632-a1e7-f1a13080de13 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 204 len: 0 microversion: 2.1 time: 0.187595 Mar 05 20:49:07.219975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28e62d46-3933-4bf7-8beb-107e6c376a14 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:07.220406 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 96/187] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:49:07 2022] DELETE /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:49:07.227414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e2fc3897-21a4-454d-87ff-abfa48ac5952 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Action: 'update', calling method: .version_select at 0x7fed5d15d430>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:07.301793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2fc3897-21a4-454d-87ff-abfa48ac5952 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:07.302255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2fc3897-21a4-454d-87ff-abfa48ac5952 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:07.303086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2fc3897-21a4-454d-87ff-abfa48ac5952 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:07.303622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2fc3897-21a4-454d-87ff-abfa48ac5952 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:07.463309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-28e62d46-3933-4bf7-8beb-107e6c376a14 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:07.488180 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-28e62d46-3933-4bf7-8beb-107e6c376a14 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1491 microversion: 2.1 time: 0.297431 Mar 05 20:49:07.489879 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 92/188] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:07 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1491 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:07.547740 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e2fc3897-21a4-454d-87ff-abfa48ac5952 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/d154636ca59542d79cbe76a54d4c9d63" status: 200 len: 329 microversion: 2.1 time: 0.321244 Mar 05 20:49:07.547740 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 97/189] 10.222.0.15 () {60 vars in 1262 bytes} [Sat Mar 5 20:49:07 2022] PUT /compute/v2.1/os-quota-sets/d154636ca59542d79cbe76a54d4c9d63 => generated 329 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:07.551718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-69fadfbc-f178-47f6-a124-b8725970f16b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:07.552565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-69fadfbc-f178-47f6-a124-b8725970f16b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:07.560634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69fadfbc-f178-47f6-a124-b8725970f16b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:07.561332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69fadfbc-f178-47f6-a124-b8725970f16b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:07.562422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69fadfbc-f178-47f6-a124-b8725970f16b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:07.563105 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69fadfbc-f178-47f6-a124-b8725970f16b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:07.656514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0b02632c-e015-4341-8fb7-f8af26e22e71 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:07.671661 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-0b02632c-e015-4341-8fb7-f8af26e22e71 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] HTTP exception thrown: Flavor 1714699542 has no extra specs with key hw:cpu_thread_policy. Mar 05 20:49:07.672559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0b02632c-e015-4341-8fb7-f8af26e22e71 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] Returning 404 to user: Flavor 1714699542 has no extra specs with key hw:cpu_thread_policy. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:07.677422 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0b02632c-e015-4341-8fb7-f8af26e22e71 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] 10.222.0.15 "GET /compute/v2.1/flavors/1714699542/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.184432 Mar 05 20:49:07.678485 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 93/190] 10.222.0.15 () {58 vars in 1265 bytes} [Sat Mar 5 20:49:07 2022] GET /compute/v2.1/flavors/1714699542/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:07.686904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fe218edb-ed44-4a92-aab8-bf217b812d6d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:07.687557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fe218edb-ed44-4a92-aab8-bf217b812d6d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:07.696698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe218edb-ed44-4a92-aab8-bf217b812d6d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:07.697150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe218edb-ed44-4a92-aab8-bf217b812d6d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:07.697936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe218edb-ed44-4a92-aab8-bf217b812d6d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:07.698504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe218edb-ed44-4a92-aab8-bf217b812d6d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:07.768770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fe218edb-ed44-4a92-aab8-bf217b812d6d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:07.776496 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fe218edb-ed44-4a92-aab8-bf217b812d6d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1220 microversion: 2.1 time: 0.097350 Mar 05 20:49:07.777090 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 94/191] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:07 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:07.919196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-69fadfbc-f178-47f6-a124-b8725970f16b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:07.928570 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-69fadfbc-f178-47f6-a124-b8725970f16b tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1495 microversion: 2.1 time: 0.382913 Mar 05 20:49:07.929723 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 98/192] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:07 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1495 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:07.941742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b778ae79-b59e-4608-baec-07cf36f19fd9 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:07.943061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b778ae79-b59e-4608-baec-07cf36f19fd9 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:07.954857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b778ae79-b59e-4608-baec-07cf36f19fd9 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:07.955284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b778ae79-b59e-4608-baec-07cf36f19fd9 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:07.956977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b778ae79-b59e-4608-baec-07cf36f19fd9 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:07.957505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b778ae79-b59e-4608-baec-07cf36f19fd9 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:08.026482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b778ae79-b59e-4608-baec-07cf36f19fd9 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:08.028528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-809db38b-419b-4793-95fa-b4e11a5cbee6 tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:08.029185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-809db38b-419b-4793-95fa-b4e11a5cbee6 tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:08.034976 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b778ae79-b59e-4608-baec-07cf36f19fd9 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1317 microversion: 2.1 time: 0.103933 Mar 05 20:49:08.035560 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 99/193] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:07 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1317 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:08.040218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-77c3a060-e9a5-4241-8082-c37960f23772 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Action: 'update', calling method: .version_select at 0x7fed5d0de700>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:08.041785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-809db38b-419b-4793-95fa-b4e11a5cbee6 tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:08.042694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-809db38b-419b-4793-95fa-b4e11a5cbee6 tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:08.043755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-809db38b-419b-4793-95fa-b4e11a5cbee6 tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:08.044574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-809db38b-419b-4793-95fa-b4e11a5cbee6 tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:08.081299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-809db38b-419b-4793-95fa-b4e11a5cbee6 tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:49:08.248007 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-809db38b-419b-4793-95fa-b4e11a5cbee6 tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] 10.222.0.15 "DELETE /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 204 len: 0 microversion: 2.1 time: 0.469459 Mar 05 20:49:08.248903 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 95/194] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:49:07 2022] DELETE /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:49:08.255525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23b19f98-7bad-4cff-a676-dc95f5650a12 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:08.257242 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:08.257242 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:08.258087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-23b19f98-7bad-4cff-a676-dc95f5650a12 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'f13c0896f5e84518b049ef57e0e09822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341d672412cd4c459d517a4981979f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:08.258728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23b19f98-7bad-4cff-a676-dc95f5650a12 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:08.259529 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-23b19f98-7bad-4cff-a676-dc95f5650a12 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] 10.222.0.15 "POST /compute/v2.1/flavors/1714699542/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.009141 Mar 05 20:49:08.264605 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 96/195] 10.222.0.15 () {60 vars in 1223 bytes} [Sat Mar 5 20:49:08 2022] POST /compute/v2.1/flavors/1714699542/os-extra_specs => generated 124 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:08.265773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7263f9f9-2fb8-4fdd-b495-053c26038103 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:08.266889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7263f9f9-2fb8-4fdd-b495-053c26038103 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:08.276716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7263f9f9-2fb8-4fdd-b495-053c26038103 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:08.277393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7263f9f9-2fb8-4fdd-b495-053c26038103 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:08.278365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7263f9f9-2fb8-4fdd-b495-053c26038103 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:08.278966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7263f9f9-2fb8-4fdd-b495-053c26038103 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:08.281131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77c3a060-e9a5-4241-8082-c37960f23772 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:08.281669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77c3a060-e9a5-4241-8082-c37960f23772 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:08.284494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77c3a060-e9a5-4241-8082-c37960f23772 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:08.285548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77c3a060-e9a5-4241-8082-c37960f23772 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:08.460620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7263f9f9-2fb8-4fdd-b495-053c26038103 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:08.470119 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7263f9f9-2fb8-4fdd-b495-053c26038103 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1497 microversion: 2.1 time: 0.208837 Mar 05 20:49:08.470924 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 97/196] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:08 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:08.478173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-14316cb5-9e86-45cc-a4ff-a46fcedaba46 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:08.479586 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:08.479586 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:08.512145 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-14316cb5-9e86-45cc-a4ff-a46fcedaba46 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/1714699542/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038547 Mar 05 20:49:08.512885 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 98/197] 10.222.0.15 () {60 vars in 1223 bytes} [Sat Mar 5 20:49:08 2022] POST /compute/v2.1/flavors/1714699542/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:49:08.524233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-59aa8b7b-7c42-4015-ab2b-4a17ab8daa1e tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:08.524997 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:08.524997 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:08.525842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-59aa8b7b-7c42-4015-ab2b-4a17ab8daa1e tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'f13c0896f5e84518b049ef57e0e09822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341d672412cd4c459d517a4981979f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:08.526568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-59aa8b7b-7c42-4015-ab2b-4a17ab8daa1e tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:08.527414 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-59aa8b7b-7c42-4015-ab2b-4a17ab8daa1e tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] 10.222.0.15 "DELETE /compute/v2.1/flavors/1714699542/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.007071 Mar 05 20:49:08.527966 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 99/198] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 20:49:08 2022] DELETE /compute/v2.1/flavors/1714699542/os-extra_specs/hw:numa_nodes => generated 124 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:49:08.541212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9692ce0b-1624-4b4b-bfb4-fb7b554e287a tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:08.565880 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9692ce0b-1624-4b4b-bfb4-fb7b554e287a tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/1714699542/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028493 Mar 05 20:49:08.568170 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 100/199] 10.222.0.15 () {60 vars in 1223 bytes} [Sat Mar 5 20:49:08 2022] POST /compute/v2.1/flavors/1714699542/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:49:08.578352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c0cd306b-7ea7-4a02-9a97-ebed7424a1ae tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:08.581007 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:08.581007 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:08.582316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c0cd306b-7ea7-4a02-9a97-ebed7424a1ae tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'f13c0896f5e84518b049ef57e0e09822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341d672412cd4c459d517a4981979f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:08.583154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c0cd306b-7ea7-4a02-9a97-ebed7424a1ae tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:08.584079 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c0cd306b-7ea7-4a02-9a97-ebed7424a1ae tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479 tempest-FlavorsExtraSpecsNegativeTestJSON-1496155479-project] 10.222.0.15 "PUT /compute/v2.1/flavors/1714699542/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010928 Mar 05 20:49:08.584890 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 101/200] 10.222.0.15 () {60 vars in 1264 bytes} [Sat Mar 5 20:49:08 2022] PUT /compute/v2.1/flavors/1714699542/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:08.593650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cb21bf8d-523e-4696-acbe-e06688e6f547 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:08.604397 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-cb21bf8d-523e-4696-acbe-e06688e6f547 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] HTTP exception thrown: Flavor 1714699542 has no extra specs with key hw:cpu_thread_policy. Mar 05 20:49:08.608609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cb21bf8d-523e-4696-acbe-e06688e6f547 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] Returning 404 to user: Flavor 1714699542 has no extra specs with key hw:cpu_thread_policy. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:08.611973 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cb21bf8d-523e-4696-acbe-e06688e6f547 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1714699542/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.020025 Mar 05 20:49:08.612658 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 102/201] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 20:49:08 2022] DELETE /compute/v2.1/flavors/1714699542/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:08.622506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4a61d15e-c687-4e57-b312-ad4b0d430fe6 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:08.624535 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4a61d15e-c687-4e57-b312-ad4b0d430fe6 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] HTTP exception thrown: Request body and URI mismatch Mar 05 20:49:08.625167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4a61d15e-c687-4e57-b312-ad4b0d430fe6 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:08.626033 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4a61d15e-c687-4e57-b312-ad4b0d430fe6 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] 10.222.0.15 "PUT /compute/v2.1/flavors/1714699542/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.007631 Mar 05 20:49:08.626613 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 103/202] 10.222.0.15 () {60 vars in 1264 bytes} [Sat Mar 5 20:49:08 2022] PUT /compute/v2.1/flavors/1714699542/os-extra_specs/hw:numa_nodes => generated 73 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Mar 05 20:49:08.636410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ee9d4386-ac90-4902-9718-7cad40fdd327 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:08.638298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ee9d4386-ac90-4902-9718-7cad40fdd327 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:08.653443 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ee9d4386-ac90-4902-9718-7cad40fdd327 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] 10.222.0.15 "PUT /compute/v2.1/flavors/1714699542/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.006736 Mar 05 20:49:08.654345 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 104/203] 10.222.0.15 () {60 vars in 1264 bytes} [Sat Mar 5 20:49:08 2022] PUT /compute/v2.1/flavors/1714699542/os-extra_specs/hw:numa_nodes => generated 117 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:49:08.668216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23478b54-ac7a-47ae-bd26-f52dc54f771c tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:08.668962 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:08.668962 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:08.687995 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-23478b54-ac7a-47ae-bd26-f52dc54f771c tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1714699542" status: 202 len: 0 microversion: 2.1 time: 0.024568 Mar 05 20:49:08.688840 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 105/204] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 20:49:08 2022] DELETE /compute/v2.1/flavors/1714699542 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 20:49:08.703089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a012c829-7b9b-411a-97b5-12e7250bdb93 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:08.740343 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a012c829-7b9b-411a-97b5-12e7250bdb93 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833 tempest-FlavorsExtraSpecsNegativeTestJSON-372466833-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.045186 Mar 05 20:49:08.743733 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 106/205] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:49:08 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:08.774106 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-77c3a060-e9a5-4241-8082-c37960f23772 tempest-QuotasAdminTestJSON-187038300 tempest-QuotasAdminTestJSON-187038300-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/d154636ca59542d79cbe76a54d4c9d63" status: 200 len: 329 microversion: 2.1 time: 0.737302 Mar 05 20:49:08.775282 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 100/206] 10.222.0.15 () {60 vars in 1262 bytes} [Sat Mar 5 20:49:08 2022] PUT /compute/v2.1/os-quota-sets/d154636ca59542d79cbe76a54d4c9d63 => generated 329 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:08.803207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-02ea103d-5517-49eb-8858-666231fa0fb0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:08.803888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-02ea103d-5517-49eb-8858-666231fa0fb0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:08.810961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-02ea103d-5517-49eb-8858-666231fa0fb0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:08.811412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-02ea103d-5517-49eb-8858-666231fa0fb0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:08.812227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-02ea103d-5517-49eb-8858-666231fa0fb0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:08.812685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-02ea103d-5517-49eb-8858-666231fa0fb0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:08.908913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-02ea103d-5517-49eb-8858-666231fa0fb0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:08.924028 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-02ea103d-5517-49eb-8858-666231fa0fb0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1220 microversion: 2.1 time: 0.128839 Mar 05 20:49:08.925031 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 107/207] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:08 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:08.948621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af645d28-8901-4fde-9ba2-a6a67ea84bdc tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:08.949748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-af645d28-8901-4fde-9ba2-a6a67ea84bdc tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:08.961932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af645d28-8901-4fde-9ba2-a6a67ea84bdc tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:08.962394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af645d28-8901-4fde-9ba2-a6a67ea84bdc tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:08.963195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af645d28-8901-4fde-9ba2-a6a67ea84bdc tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:08.963630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af645d28-8901-4fde-9ba2-a6a67ea84bdc tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:09.054181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c67b7992-1416-4dc5-aa93-172908c2a2c5 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:09.054830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c67b7992-1416-4dc5-aa93-172908c2a2c5 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:09.063465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c67b7992-1416-4dc5-aa93-172908c2a2c5 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:09.066320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c67b7992-1416-4dc5-aa93-172908c2a2c5 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:09.068549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c67b7992-1416-4dc5-aa93-172908c2a2c5 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:09.069002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c67b7992-1416-4dc5-aa93-172908c2a2c5 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:09.168005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-af645d28-8901-4fde-9ba2-a6a67ea84bdc tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:09.177981 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-af645d28-8901-4fde-9ba2-a6a67ea84bdc tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1495 microversion: 2.1 time: 0.233935 Mar 05 20:49:09.178909 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 101/208] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:08 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1495 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:09.191861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c67b7992-1416-4dc5-aa93-172908c2a2c5 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:09.201594 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c67b7992-1416-4dc5-aa93-172908c2a2c5 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1317 microversion: 2.1 time: 0.153622 Mar 05 20:49:09.202792 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 108/209] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:09 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:09.491310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-68e4afb2-ef35-43a5-9194-c901dbb1c6f8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:09.492179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-68e4afb2-ef35-43a5-9194-c901dbb1c6f8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:09.507368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68e4afb2-ef35-43a5-9194-c901dbb1c6f8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:09.507903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68e4afb2-ef35-43a5-9194-c901dbb1c6f8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:09.508696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68e4afb2-ef35-43a5-9194-c901dbb1c6f8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:09.509135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68e4afb2-ef35-43a5-9194-c901dbb1c6f8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:09.618882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-60ac14b1-9344-4463-86f1-9708b3b28d03 req-73b900bc-1005-420c-b0c6-dc5a06a6895d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf55fc7-8496-4922-9291-4b258266c92b", "name": "network-vif-deleted", "tag": "ed241cfc-58db-4f9b-adfb-a457a1c0e3e4"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:09.645753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-60ac14b1-9344-4463-86f1-9708b3b28d03 req-73b900bc-1005-420c-b0c6-dc5a06a6895d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:09.648233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-60ac14b1-9344-4463-86f1-9708b3b28d03 req-73b900bc-1005-420c-b0c6-dc5a06a6895d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:09.687376 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-60ac14b1-9344-4463-86f1-9708b3b28d03 req-73b900bc-1005-420c-b0c6-dc5a06a6895d service nova] Creating event network-vif-deleted:ed241cfc-58db-4f9b-adfb-a457a1c0e3e4 for instance ebf55fc7-8496-4922-9291-4b258266c92b on nch1-master-1 Mar 05 20:49:09.700154 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-60ac14b1-9344-4463-86f1-9708b3b28d03 req-73b900bc-1005-420c-b0c6-dc5a06a6895d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085490 Mar 05 20:49:09.701299 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 109/210] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:49:09.944009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f5eb3740-434e-42c6-9f17-26c889080a9e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:09.945157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f5eb3740-434e-42c6-9f17-26c889080a9e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:09.952594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5eb3740-434e-42c6-9f17-26c889080a9e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:09.953512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5eb3740-434e-42c6-9f17-26c889080a9e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:09.954309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5eb3740-434e-42c6-9f17-26c889080a9e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:09.954754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5eb3740-434e-42c6-9f17-26c889080a9e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:10.019043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-68e4afb2-ef35-43a5-9194-c901dbb1c6f8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:10.028052 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-68e4afb2-ef35-43a5-9194-c901dbb1c6f8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1497 microversion: 2.1 time: 0.541929 Mar 05 20:49:10.028998 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 102/211] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:09 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1497 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:10.093148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f5eb3740-434e-42c6-9f17-26c889080a9e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:10.104714 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f5eb3740-434e-42c6-9f17-26c889080a9e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1220 microversion: 2.1 time: 0.166939 Mar 05 20:49:10.108527 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 110/212] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:09 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1220 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:10.195272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-704fce8c-e4f6-4884-a322-bedafa855a49 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:10.196609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-704fce8c-e4f6-4884-a322-bedafa855a49 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:10.211292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-704fce8c-e4f6-4884-a322-bedafa855a49 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:10.212142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-704fce8c-e4f6-4884-a322-bedafa855a49 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:10.213142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-704fce8c-e4f6-4884-a322-bedafa855a49 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:10.214008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-704fce8c-e4f6-4884-a322-bedafa855a49 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:10.220525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6f55e9c8-16c7-431b-bb24-b441a3687a6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:10.222789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6f55e9c8-16c7-431b-bb24-b441a3687a6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:10.229782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f55e9c8-16c7-431b-bb24-b441a3687a6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:10.235559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f55e9c8-16c7-431b-bb24-b441a3687a6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:10.241126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f55e9c8-16c7-431b-bb24-b441a3687a6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:10.244202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f55e9c8-16c7-431b-bb24-b441a3687a6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:10.334920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-704fce8c-e4f6-4884-a322-bedafa855a49 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:10.338597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-704fce8c-e4f6-4884-a322-bedafa855a49 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:10.339165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-704fce8c-e4f6-4884-a322-bedafa855a49 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lazy-loading 'fault' on Instance uuid ebf55fc7-8496-4922-9291-4b258266c92b {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:49:10.369942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6f55e9c8-16c7-431b-bb24-b441a3687a6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:10.390915 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6f55e9c8-16c7-431b-bb24-b441a3687a6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1317 microversion: 2.1 time: 0.172720 Mar 05 20:49:10.392650 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 111/213] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:10 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:10.461894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-704fce8c-e4f6-4884-a322-bedafa855a49 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb30e1069fe4b74b7125cd36b6ef75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43fe9254d04dbead327aa06baa059a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:10.477247 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-704fce8c-e4f6-4884-a322-bedafa855a49 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 200 len: 1329 microversion: 2.1 time: 0.283943 Mar 05 20:49:10.481423 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 103/214] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:10 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 1329 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:10.793052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-94b71cef-dd6b-4ac2-ba90-a3432c92c966 req-2ce00699-bfee-4b09-87ec-34e247a5c6de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bafedc-69d2-4784-8413-e4f9060b4acf", "name": "network-vif-deleted", "tag": "326c6caa-2b24-4f53-a872-561f3573012c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:10.809259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-94b71cef-dd6b-4ac2-ba90-a3432c92c966 req-2ce00699-bfee-4b09-87ec-34e247a5c6de service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:10.811468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-94b71cef-dd6b-4ac2-ba90-a3432c92c966 req-2ce00699-bfee-4b09-87ec-34e247a5c6de service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:10.841273 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-94b71cef-dd6b-4ac2-ba90-a3432c92c966 req-2ce00699-bfee-4b09-87ec-34e247a5c6de service nova] Creating event network-vif-deleted:326c6caa-2b24-4f53-a872-561f3573012c for instance f3bafedc-69d2-4784-8413-e4f9060b4acf on nch1-master-1 Mar 05 20:49:10.850809 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-94b71cef-dd6b-4ac2-ba90-a3432c92c966 req-2ce00699-bfee-4b09-87ec-34e247a5c6de service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062080 Mar 05 20:49:10.854036 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 112/215] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:11.049747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c00ae785-5604-4c63-b6a7-663d16917445 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:11.050908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c00ae785-5604-4c63-b6a7-663d16917445 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:11.068312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c00ae785-5604-4c63-b6a7-663d16917445 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:11.073118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c00ae785-5604-4c63-b6a7-663d16917445 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:11.077543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c00ae785-5604-4c63-b6a7-663d16917445 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:11.078292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c00ae785-5604-4c63-b6a7-663d16917445 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:11.125414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2fc54e60-0231-405d-aed2-51e214fbd772 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:11.126119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2fc54e60-0231-405d-aed2-51e214fbd772 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:11.139311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2fc54e60-0231-405d-aed2-51e214fbd772 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:11.139804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2fc54e60-0231-405d-aed2-51e214fbd772 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:11.140593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2fc54e60-0231-405d-aed2-51e214fbd772 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:11.141057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2fc54e60-0231-405d-aed2-51e214fbd772 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:11.149920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c00ae785-5604-4c63-b6a7-663d16917445 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:11.150657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c00ae785-5604-4c63-b6a7-663d16917445 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:11.151396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-c00ae785-5604-4c63-b6a7-663d16917445 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lazy-loading 'fault' on Instance uuid f3bafedc-69d2-4784-8413-e4f9060b4acf {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:49:11.267778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c00ae785-5604-4c63-b6a7-663d16917445 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:11.291816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2fc54e60-0231-405d-aed2-51e214fbd772 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:11.304123 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c00ae785-5604-4c63-b6a7-663d16917445 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 200 len: 1331 microversion: 2.1 time: 0.258157 Mar 05 20:49:11.313423 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2fc54e60-0231-405d-aed2-51e214fbd772 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1276 microversion: 2.1 time: 0.192349 Mar 05 20:49:11.315009 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 113/216] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:11 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:11.321262 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 104/217] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:11 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 1331 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:11.410009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85d969df-e5a0-47d3-a259-2d94487e97ed tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:11.410617 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-85d969df-e5a0-47d3-a259-2d94487e97ed tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:11.429233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85d969df-e5a0-47d3-a259-2d94487e97ed tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:11.429678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85d969df-e5a0-47d3-a259-2d94487e97ed tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:11.430447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85d969df-e5a0-47d3-a259-2d94487e97ed tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:11.431052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85d969df-e5a0-47d3-a259-2d94487e97ed tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:11.497396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-65915193-7e6c-4a2c-bf45-ecd548192bcf tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:11.498010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-65915193-7e6c-4a2c-bf45-ecd548192bcf tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:11.506165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65915193-7e6c-4a2c-bf45-ecd548192bcf tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:11.507458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65915193-7e6c-4a2c-bf45-ecd548192bcf tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:11.508699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65915193-7e6c-4a2c-bf45-ecd548192bcf tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:11.509520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65915193-7e6c-4a2c-bf45-ecd548192bcf tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:11.537099 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-65915193-7e6c-4a2c-bf45-ecd548192bcf tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] HTTP exception thrown: Instance ebf55fc7-8496-4922-9291-4b258266c92b could not be found. Mar 05 20:49:11.538291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-65915193-7e6c-4a2c-bf45-ecd548192bcf tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Returning 404 to user: Instance ebf55fc7-8496-4922-9291-4b258266c92b could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:11.539837 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-65915193-7e6c-4a2c-bf45-ecd548192bcf tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 404 len: 111 microversion: 2.1 time: 0.046249 Mar 05 20:49:11.544927 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 105/218] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:11 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:11.552280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aac694fe-474a-4f25-8134-64b89a393aa6 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:11.554442 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:11.554442 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:11.577310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aac694fe-474a-4f25-8134-64b89a393aa6 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:11.580293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aac694fe-474a-4f25-8134-64b89a393aa6 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:11.749412 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aac694fe-474a-4f25-8134-64b89a393aa6 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.201737 Mar 05 20:49:11.750849 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 106/219] 10.222.0.15 () {60 vars in 1190 bytes} [Sat Mar 5 20:49:11 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:11.942436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-85d969df-e5a0-47d3-a259-2d94487e97ed tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:11.955030 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-85d969df-e5a0-47d3-a259-2d94487e97ed tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1385 microversion: 2.1 time: 0.548929 Mar 05 20:49:11.956346 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 114/220] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:11 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1385 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:11.972942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-329fb492-813c-49ff-b945-1701d9ffc707 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:11.974109 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:11.974109 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:12.063805 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-329fb492-813c-49ff-b945-1701d9ffc707 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.094893 Mar 05 20:49:12.073667 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 115/221] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:11 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:12.081978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2628a1ac-ae23-4d56-84b5-d2a90ffe4881 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-625639633"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:12.086002 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:12.086002 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:12.088292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.aggregate [None req-2628a1ac-ae23-4d56-84b5-d2a90ffe4881 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Generated uuid 6b424d4f-27b8-4370-b34f-bd204d42bdea for aggregate {{(pid=141478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:12.099861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-631961086", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:12.128262 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2628a1ac-ae23-4d56-84b5-d2a90ffe4881 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.050979 Mar 05 20:49:12.132185 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 116/222] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:12 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:12.143550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-84c786df-f13b-413e-a127-01e584bd4550 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:12.147628 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:12.147628 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:12.168991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84c786df-f13b-413e-a127-01e584bd4550 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:12.169459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84c786df-f13b-413e-a127-01e584bd4550 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:12.209536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:12.485247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:12.488161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:12.488942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:12.490168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:12.491090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:12.506735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:12.507513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:12.508652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:12.509367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:12.537091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Getting quotas for project f138bfc479e24b3d9017a7cb9e73bdd2. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:12.548484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Getting quotas for user 38c78359372d4628b29d5c5456d61d50 and project f138bfc479e24b3d9017a7cb9e73bdd2. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:12.563515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:49:12.566150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:12.631992 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d1e7dd88-69e6-444d-a054-109522df0106 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.879970 Mar 05 20:49:12.633062 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 107/223] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:49:12.637992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-74d7d620-a79e-49a0-a484-df311ccf6391 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:12.638543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-74d7d620-a79e-49a0-a484-df311ccf6391 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:12.647641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74d7d620-a79e-49a0-a484-df311ccf6391 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:12.648248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74d7d620-a79e-49a0-a484-df311ccf6391 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:12.649109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74d7d620-a79e-49a0-a484-df311ccf6391 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:12.649594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74d7d620-a79e-49a0-a484-df311ccf6391 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:12.669897 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-74d7d620-a79e-49a0-a484-df311ccf6391 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] HTTP exception thrown: Instance f3bafedc-69d2-4784-8413-e4f9060b4acf could not be found. Mar 05 20:49:12.670697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-74d7d620-a79e-49a0-a484-df311ccf6391 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Returning 404 to user: Instance f3bafedc-69d2-4784-8413-e4f9060b4acf could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:12.671885 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-74d7d620-a79e-49a0-a484-df311ccf6391 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 404 len: 111 microversion: 2.1 time: 0.037452 Mar 05 20:49:12.681411 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 108/224] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:12 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:12.687346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fa2ab935-eba5-472e-8066-c19e6637cc8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:12.687996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fa2ab935-eba5-472e-8066-c19e6637cc8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:12.695993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa2ab935-eba5-472e-8066-c19e6637cc8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:12.696443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa2ab935-eba5-472e-8066-c19e6637cc8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:12.697225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa2ab935-eba5-472e-8066-c19e6637cc8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:12.697660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa2ab935-eba5-472e-8066-c19e6637cc8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:12.760163 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-84c786df-f13b-413e-a127-01e584bd4550 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.621418 Mar 05 20:49:12.761047 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 117/225] 10.222.0.15 () {60 vars in 1190 bytes} [Sat Mar 5 20:49:12 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:12.771779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d8114725-ed01-44fc-b763-15fe96457788 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:12.772864 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:12.772864 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:12.775871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fa2ab935-eba5-472e-8066-c19e6637cc8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:12.786402 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fa2ab935-eba5-472e-8066-c19e6637cc8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1274 microversion: 2.1 time: 0.104069 Mar 05 20:49:12.787814 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 109/226] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:12 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:12.800166 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d8114725-ed01-44fc-b763-15fe96457788 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.032317 Mar 05 20:49:12.800812 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 118/227] 10.222.0.15 () {58 vars in 1148 bytes} [Sat Mar 5 20:49:12 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:12.812128 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-41c940df-ddce-44a6-9b13-4b7c65e2d2ce tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:12.813424 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:12.813424 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:12.836821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41c940df-ddce-44a6-9b13-4b7c65e2d2ce tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:12.838708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41c940df-ddce-44a6-9b13-4b7c65e2d2ce tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:12.936466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-752731451", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:13.029122 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-41c940df-ddce-44a6-9b13-4b7c65e2d2ce tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.221375 Mar 05 20:49:13.030024 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 110/228] 10.222.0.15 () {60 vars in 1190 bytes} [Sat Mar 5 20:49:12 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:13.040733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-30df85d4-bcc2-42a0-94b4-180c80f74f23 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:13.041451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-30df85d4-bcc2-42a0-94b4-180c80f74f23 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:13.053624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-30df85d4-bcc2-42a0-94b4-180c80f74f23 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:13.054126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-30df85d4-bcc2-42a0-94b4-180c80f74f23 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:13.054972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-30df85d4-bcc2-42a0-94b4-180c80f74f23 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:13.056473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-30df85d4-bcc2-42a0-94b4-180c80f74f23 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:13.071322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:13.254144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-30df85d4-bcc2-42a0-94b4-180c80f74f23 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:13.263371 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-30df85d4-bcc2-42a0-94b4-180c80f74f23 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1385 microversion: 2.1 time: 0.232241 Mar 05 20:49:13.269226 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 111/229] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:13 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1385 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:13.280890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a662c205-50a5-4bf2-984d-a4c26b296b83 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:13.285406 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:13.285406 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:13.335457 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a662c205-50a5-4bf2-984d-a4c26b296b83 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.064764 Mar 05 20:49:13.339974 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 112/230] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:13 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:13.349427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1697687711", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:13.413982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:13.742914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:13.743370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:13.743842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:13.744254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:13.744668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:13.785278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:13.785752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:13.789451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:13.792373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:13.823488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:13.823488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:13.824625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:13.825046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:13.825646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:13.856098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:13.856762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:13.858271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:13.865821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:13.882998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Getting quotas for project f138bfc479e24b3d9017a7cb9e73bdd2. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:13.912853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Getting quotas for user 38c78359372d4628b29d5c5456d61d50 and project f138bfc479e24b3d9017a7cb9e73bdd2. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:13.940535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Getting quotas for project bc979e049ee9421d8f6e41c1b6723f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:13.950367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Getting quotas for user 8b27750446fb4a75a0b4247065203706 and project bc979e049ee9421d8f6e41c1b6723f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:13.956801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:49:13.963595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:13.978792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:49:13.981193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:14.038007 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-221be29a-7ce0-4a81-906f-d32566ae7174 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696164 Mar 05 20:49:14.038957 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 113/231] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:49:14.054175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-33cd804f-6c81-4043-83da-41f2da23744d tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Calling method '.version_select at 0x7fed5d09a310>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:14.073184 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:14.073184 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:14.090218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-33cd804f-6c81-4043-83da-41f2da23744d tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:14.090697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-33cd804f-6c81-4043-83da-41f2da23744d tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:14.091558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-33cd804f-6c81-4043-83da-41f2da23744d tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:14.098766 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-78f56d3a-cbfe-4b41-8146-73d4490004f2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166694 Mar 05 20:49:14.099418 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 119/232] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 20:49:14.108657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-33cd804f-6c81-4043-83da-41f2da23744d tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:14.118989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9427eb96-9bbb-4711-a4e5-15d1548a24ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:14.119823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9427eb96-9bbb-4711-a4e5-15d1548a24ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:14.150690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9427eb96-9bbb-4711-a4e5-15d1548a24ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:14.151746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9427eb96-9bbb-4711-a4e5-15d1548a24ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:14.156490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9427eb96-9bbb-4711-a4e5-15d1548a24ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:14.158047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9427eb96-9bbb-4711-a4e5-15d1548a24ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:14.188084 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-33cd804f-6c81-4043-83da-41f2da23744d tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.142868 Mar 05 20:49:14.195882 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 114/233] 10.222.0.15 () {58 vars in 1127 bytes} [Sat Mar 5 20:49:14 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:14.207346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-31c0f0a6-5f62-477b-8ea0-5dfd7cc3ebd9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:14.211810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-31c0f0a6-5f62-477b-8ea0-5dfd7cc3ebd9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:14.405464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-31c0f0a6-5f62-477b-8ea0-5dfd7cc3ebd9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:14.414556 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-31c0f0a6-5f62-477b-8ea0-5dfd7cc3ebd9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1220 microversion: 2.1 time: 0.219553 Mar 05 20:49:14.426885 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 115/234] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:14 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1220 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:14.437584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-05cec5b7-97ac-45e5-bf71-ad9215609522 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:14.442682 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-05cec5b7-97ac-45e5-bf71-ad9215609522 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:14.729536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-05cec5b7-97ac-45e5-bf71-ad9215609522 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:14.743220 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-05cec5b7-97ac-45e5-bf71-ad9215609522 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1213 microversion: 2.1 time: 0.323050 Mar 05 20:49:14.744141 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 116/235] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:14 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1213 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:14.761836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-96753409-ad23-4d33-89c7-403105a55dfb tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Calling method '.version_select at 0x7fed5d0efb80>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:14.764412 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:14.764412 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:14.765755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96753409-ad23-4d33-89c7-403105a55dfb tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:14.766203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96753409-ad23-4d33-89c7-403105a55dfb tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:14.767088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96753409-ad23-4d33-89c7-403105a55dfb tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:14.767538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96753409-ad23-4d33-89c7-403105a55dfb tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:14.824667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9427eb96-9bbb-4711-a4e5-15d1548a24ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:14.836564 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9427eb96-9bbb-4711-a4e5-15d1548a24ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1316 microversion: 2.1 time: 0.727231 Mar 05 20:49:14.837157 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 120/236] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:14 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1316 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:14.848848 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-96753409-ad23-4d33-89c7-403105a55dfb tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.102953 Mar 05 20:49:14.857290 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 117/237] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:49:14 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:14.860187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-32e0cdfc-4351-44af-b504-aaa2d8eeda95 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:14.864394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-96b60fc9-9aff-444d-a920-43acd4be3fdc tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Calling method '.version_select at 0x7fed5d0ef820>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:14.865542 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:14.865542 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:14.866238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-32e0cdfc-4351-44af-b504-aaa2d8eeda95 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:14.875733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32e0cdfc-4351-44af-b504-aaa2d8eeda95 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:14.876188 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32e0cdfc-4351-44af-b504-aaa2d8eeda95 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:14.880466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b60fc9-9aff-444d-a920-43acd4be3fdc tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:14.880925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b60fc9-9aff-444d-a920-43acd4be3fdc tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:14.881836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b60fc9-9aff-444d-a920-43acd4be3fdc tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:14.882263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b60fc9-9aff-444d-a920-43acd4be3fdc tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:14.892801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32e0cdfc-4351-44af-b504-aaa2d8eeda95 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:14.895545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32e0cdfc-4351-44af-b504-aaa2d8eeda95 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:14.984539 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-96b60fc9-9aff-444d-a920-43acd4be3fdc tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.126071 Mar 05 20:49:15.000649 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 118/238] 10.222.0.15 () {58 vars in 1127 bytes} [Sat Mar 5 20:49:14 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:15.011409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-04af1bad-f8aa-4646-b52b-b2b7aa6d3fd4 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1803049333"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:15.013788 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:15.013788 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:15.020409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.aggregate [None req-04af1bad-f8aa-4646-b52b-b2b7aa6d3fd4 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Generated uuid 46d3c924-812c-4c52-81d7-4a8295cde7fc for aggregate {{(pid=141479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:15.081801 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-04af1bad-f8aa-4646-b52b-b2b7aa6d3fd4 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077926 Mar 05 20:49:15.082410 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 119/239] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:15.092965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c9a8eaa7-0b4e-4ad8-b209-a94372e5b423 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Calling method '.version_select at 0x7fed5d04ea60>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:15.092965 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:15.092965 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:15.137227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9a8eaa7-0b4e-4ad8-b209-a94372e5b423 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:15.137720 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9a8eaa7-0b4e-4ad8-b209-a94372e5b423 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:15.170425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9a8eaa7-0b4e-4ad8-b209-a94372e5b423 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:15.171152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9a8eaa7-0b4e-4ad8-b209-a94372e5b423 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:15.195080 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c9a8eaa7-0b4e-4ad8-b209-a94372e5b423 tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.111465 Mar 05 20:49:15.196511 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 120/240] 10.222.0.15 () {58 vars in 1169 bytes} [Sat Mar 5 20:49:15 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:15.708041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-32e0cdfc-4351-44af-b504-aaa2d8eeda95 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:15.709708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ec940621-69ff-4650-912c-6fa4beb4b0de tempest-FlavorsV255TestJSON-1943954072 tempest-FlavorsV255TestJSON-1943954072-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1485096168", "id": 1996446469, "os-flavor-access:is_public": "True"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:15.712350 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:15.712350 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:15.716490 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-32e0cdfc-4351-44af-b504-aaa2d8eeda95 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1385 microversion: 2.1 time: 0.871756 Mar 05 20:49:15.717085 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 121/241] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:14 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1385 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:15.732557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-25891306-f79c-4499-b795-ee512814e27b req-29dcb55c-24cd-4e9c-a763-02e94d116208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d89c14-aebf-4565-9719-229a9abd3ebd", "tag": "3d09975a-2c78-4565-9441-09dcee0a67e2"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:15.742256 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ec940621-69ff-4650-912c-6fa4beb4b0de tempest-FlavorsV255TestJSON-1943954072 tempest-FlavorsV255TestJSON-1943954072-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.544389 Mar 05 20:49:15.746689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-25891306-f79c-4499-b795-ee512814e27b req-29dcb55c-24cd-4e9c-a763-02e94d116208 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:15.747259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-25891306-f79c-4499-b795-ee512814e27b req-29dcb55c-24cd-4e9c-a763-02e94d116208 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:15.749607 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 121/242] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 20:49:15 2022] POST /compute/v2.1/flavors => generated 449 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:49:15.755442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a610c856-02ea-4b3c-b1f3-648198975dd9 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:15.756813 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:15.756813 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:15.765870 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-25891306-f79c-4499-b795-ee512814e27b req-29dcb55c-24cd-4e9c-a763-02e94d116208 service nova] Creating event network-changed:3d09975a-2c78-4565-9441-09dcee0a67e2 for instance 80d89c14-aebf-4565-9719-229a9abd3ebd on nch2-master-1 Mar 05 20:49:15.766103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a610c856-02ea-4b3c-b1f3-648198975dd9 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:15.766475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a610c856-02ea-4b3c-b1f3-648198975dd9 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:15.774102 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-25891306-f79c-4499-b795-ee512814e27b req-29dcb55c-24cd-4e9c-a763-02e94d116208 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051939 Mar 05 20:49:15.775266 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 122/243] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:15.780506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8bb26b26-5ec8-4e9f-b8fb-be52f726badf tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Calling method '.version_select at 0x7fed5d1a8280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:15.781364 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:15.781364 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:15.789814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bb26b26-5ec8-4e9f-b8fb-be52f726badf tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:15.790524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bb26b26-5ec8-4e9f-b8fb-be52f726badf tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:15.810004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bb26b26-5ec8-4e9f-b8fb-be52f726badf tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:15.810566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bb26b26-5ec8-4e9f-b8fb-be52f726badf tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:15.896568 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8bb26b26-5ec8-4e9f-b8fb-be52f726badf tempest-HostsAdminTestJSON-1388252505 tempest-HostsAdminTestJSON-1388252505-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 598 microversion: 2.1 time: 0.119917 Mar 05 20:49:15.899025 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 123/244] 10.222.0.15 () {58 vars in 1169 bytes} [Sat Mar 5 20:49:15 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 598 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:15.911830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a022e28f-ba09-4708-9940-71c0bc8ce6ef tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:15.913036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a022e28f-ba09-4708-9940-71c0bc8ce6ef tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:15.919939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a022e28f-ba09-4708-9940-71c0bc8ce6ef tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:15.920618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a022e28f-ba09-4708-9940-71c0bc8ce6ef tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:15.921552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a022e28f-ba09-4708-9940-71c0bc8ce6ef tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:15.922131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a022e28f-ba09-4708-9940-71c0bc8ce6ef tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:15.969073 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a610c856-02ea-4b3c-b1f3-648198975dd9 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.218369 Mar 05 20:49:15.970322 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 122/245] 10.222.0.15 () {60 vars in 1190 bytes} [Sat Mar 5 20:49:15 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:16.082846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2006736041", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:16.138242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a022e28f-ba09-4708-9940-71c0bc8ce6ef tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:16.154801 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a022e28f-ba09-4708-9940-71c0bc8ce6ef tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1272 microversion: 2.1 time: 0.253211 Mar 05 20:49:16.155726 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 124/246] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:15 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:16.211013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:16.495772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9a540745-d95d-4e5f-bcaa-1426b2d28088 tempest-FlavorsV255TestJSON-1498379367 tempest-FlavorsV255TestJSON-1498379367-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:16.516306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:16.516547 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9a540745-d95d-4e5f-bcaa-1426b2d28088 tempest-FlavorsV255TestJSON-1498379367 tempest-FlavorsV255TestJSON-1498379367-project] 10.222.0.15 "GET /compute/v2.1/flavors/1996446469" status: 200 len: 449 microversion: 2.55 time: 0.358260 Mar 05 20:49:16.517097 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 125/247] 10.222.0.15 () {60 vars in 1198 bytes} [Sat Mar 5 20:49:16 2022] GET /compute/v2.1/flavors/1996446469 => generated 449 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:49:16.527723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:16.528600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:16.529210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:16.529901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:16.536610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5e87276e-1f02-45b9-b772-4141fbcf63f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:16.537239 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5e87276e-1f02-45b9-b772-4141fbcf63f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:16.541530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:16.541986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:16.542794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:16.543230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:16.551803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e87276e-1f02-45b9-b772-4141fbcf63f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:16.552591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e87276e-1f02-45b9-b772-4141fbcf63f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:16.553832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e87276e-1f02-45b9-b772-4141fbcf63f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:16.554505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e87276e-1f02-45b9-b772-4141fbcf63f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:16.570761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Getting quotas for project 46a689a4e8aa4d1fb19c10217e5986ac. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:16.575663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Getting quotas for user fa730ea7740944abaf69f0e977fd3c34 and project 46a689a4e8aa4d1fb19c10217e5986ac. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:16.591941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:49:16.594637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:16.649304 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-465e9177-eebe-4623-98f2-c60141f9a9c0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677654 Mar 05 20:49:16.658171 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 123/248] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:49:16.666888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b349da3f-5529-442d-ba4d-039b37349469 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:16.667901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b349da3f-5529-442d-ba4d-039b37349469 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:16.694837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b349da3f-5529-442d-ba4d-039b37349469 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:16.695250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b349da3f-5529-442d-ba4d-039b37349469 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:16.696116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b349da3f-5529-442d-ba4d-039b37349469 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:16.696558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b349da3f-5529-442d-ba4d-039b37349469 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:16.791031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5e87276e-1f02-45b9-b772-4141fbcf63f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:16.812161 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5e87276e-1f02-45b9-b772-4141fbcf63f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1283 microversion: 2.1 time: 0.284058 Mar 05 20:49:16.822607 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 126/249] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:16 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1283 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:16.823942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-629d68e0-37ed-4749-88b6-9745a7f9df8c tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:16.825093 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:16.825093 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:16.837066 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-629d68e0-37ed-4749-88b6-9745a7f9df8c tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.022737 Mar 05 20:49:16.838136 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 127/250] 10.222.0.15 () {58 vars in 1142 bytes} [Sat Mar 5 20:49:16 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:16.843615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c33435b5-8618-42a7-a9bb-1ef63020d4ff tempest-FlavorsV255TestJSON-1943954072 tempest-FlavorsV255TestJSON-1943954072-project-admin] Action: 'update', calling method: .version_select at 0x7fed5f2a2310>, body: {"flavor": {"description": "new"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:16.854475 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:16.854475 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:16.885152 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c33435b5-8618-42a7-a9bb-1ef63020d4ff tempest-FlavorsV255TestJSON-1943954072 tempest-FlavorsV255TestJSON-1943954072-project-admin] 10.222.0.15 "PUT /compute/v2.1/flavors/1996446469" status: 200 len: 450 microversion: 2.55 time: 0.045711 Mar 05 20:49:16.885817 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 128/251] 10.222.0.15 () {62 vars in 1218 bytes} [Sat Mar 5 20:49:16 2022] PUT /compute/v2.1/flavors/1996446469 => generated 450 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:49:16.890443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6ee4a46-aae7-4424-a139-a7a8336fd0f4 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:16.891609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c6ee4a46-aae7-4424-a139-a7a8336fd0f4 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:17.024396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c6ee4a46-aae7-4424-a139-a7a8336fd0f4 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:17.043578 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c6ee4a46-aae7-4424-a139-a7a8336fd0f4 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1222 microversion: 2.1 time: 0.156207 Mar 05 20:49:17.045407 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 129/252] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:16 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:17.055097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-665380e2-a122-4fea-a6a3-a73399252606 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:17.056586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-665380e2-a122-4fea-a6a3-a73399252606 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:17.074167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-665380e2-a122-4fea-a6a3-a73399252606 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:17.074801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-665380e2-a122-4fea-a6a3-a73399252606 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:17.076257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-665380e2-a122-4fea-a6a3-a73399252606 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:17.077843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-665380e2-a122-4fea-a6a3-a73399252606 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:17.288985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b349da3f-5529-442d-ba4d-039b37349469 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:17.297398 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b349da3f-5529-442d-ba4d-039b37349469 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1316 microversion: 2.1 time: 0.636737 Mar 05 20:49:17.309028 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 124/253] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:16 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1316 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:17.314056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6235cf52-055c-490d-b91a-0d74719e2bf4 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:17.317105 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:17.317105 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:17.326733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6235cf52-055c-490d-b91a-0d74719e2bf4 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:17.327419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6235cf52-055c-490d-b91a-0d74719e2bf4 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:17.463320 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6235cf52-055c-490d-b91a-0d74719e2bf4 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.152854 Mar 05 20:49:17.464225 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 125/254] 10.222.0.15 () {60 vars in 1190 bytes} [Sat Mar 5 20:49:17 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:17.469813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e075f097-8d84-4c89-907f-65eb6bd56297 tempest-FlavorsV255TestJSON-1498379367 tempest-FlavorsV255TestJSON-1498379367-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:17.512549 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e075f097-8d84-4c89-907f-65eb6bd56297 tempest-FlavorsV255TestJSON-1498379367 tempest-FlavorsV255TestJSON-1498379367-project] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 6589 microversion: 2.55 time: 0.046777 Mar 05 20:49:17.513666 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 126/255] 10.222.0.15 () {60 vars in 1186 bytes} [Sat Mar 5 20:49:17 2022] GET /compute/v2.1/flavors/detail => generated 6589 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:49:17.528265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cef6eafa-d545-4ea6-a697-f7407b207f32 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:17.528985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cef6eafa-d545-4ea6-a697-f7407b207f32 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:17.539139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cef6eafa-d545-4ea6-a697-f7407b207f32 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:17.539489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cef6eafa-d545-4ea6-a697-f7407b207f32 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:17.540599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cef6eafa-d545-4ea6-a697-f7407b207f32 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:17.541198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cef6eafa-d545-4ea6-a697-f7407b207f32 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:17.645310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cef6eafa-d545-4ea6-a697-f7407b207f32 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:17.659629 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cef6eafa-d545-4ea6-a697-f7407b207f32 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1278 microversion: 2.1 time: 0.141267 Mar 05 20:49:17.660711 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 127/256] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:17 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1278 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:17.666405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ab05f89b-19bf-4b83-a65f-18680279cb00 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:17.667344 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:17.667344 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:17.691707 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ab05f89b-19bf-4b83-a65f-18680279cb00 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.028817 Mar 05 20:49:17.697392 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 128/257] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:17 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:17.697977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c09d68a-e7ee-435e-a5cb-bd867aed9bb4 tempest-FlavorsV255TestJSON-1498379367 tempest-FlavorsV255TestJSON-1498379367-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:17.720505 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3c09d68a-e7ee-435e-a5cb-bd867aed9bb4 tempest-FlavorsV255TestJSON-1498379367 tempest-FlavorsV255TestJSON-1498379367-project] 10.222.0.15 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.55 time: 0.026526 Mar 05 20:49:17.733271 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 129/258] 10.222.0.15 () {60 vars in 1165 bytes} [Sat Mar 5 20:49:17 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:49:17.739611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-42a1a91f-7d3f-4e4c-9730-da1f0a2c7ec1 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1060329135"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:17.741138 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:17.741138 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:17.742270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.aggregate [None req-42a1a91f-7d3f-4e4c-9730-da1f0a2c7ec1 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Generated uuid dbc2b54c-883d-45b9-8d3e-e29c183427fa for aggregate {{(pid=141479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:17.764943 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-42a1a91f-7d3f-4e4c-9730-da1f0a2c7ec1 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.030241 Mar 05 20:49:17.769118 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 130/259] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:17.771709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-76e16074-cf88-43e2-a84d-366b0b9c2439 tempest-FlavorsV255TestJSON-1943954072 tempest-FlavorsV255TestJSON-1943954072-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:17.772561 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:17.772561 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:17.793066 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-76e16074-cf88-43e2-a84d-366b0b9c2439 tempest-FlavorsV255TestJSON-1943954072 tempest-FlavorsV255TestJSON-1943954072-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1996446469" status: 202 len: 0 microversion: 2.55 time: 0.025940 Mar 05 20:49:17.794128 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 131/260] 10.222.0.15 () {60 vars in 1201 bytes} [Sat Mar 5 20:49:17 2022] DELETE /compute/v2.1/flavors/1996446469 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:49:17.802870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91b33acc-25b6-426f-b29e-38050f1221cd tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:17.804501 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:17.804501 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:17.813013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91b33acc-25b6-426f-b29e-38050f1221cd tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:17.813472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91b33acc-25b6-426f-b29e-38050f1221cd tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:18.010186 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91b33acc-25b6-426f-b29e-38050f1221cd tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.214465 Mar 05 20:49:18.011823 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 132/261] 10.222.0.15 () {60 vars in 1190 bytes} [Sat Mar 5 20:49:17 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:18.019961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e43caad2-3cfa-4376-b7d9-4e39bc8ff37d tempest-FlavorsV255TestJSON-1943954072 tempest-FlavorsV255TestJSON-1943954072-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:18.053743 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e43caad2-3cfa-4376-b7d9-4e39bc8ff37d tempest-FlavorsV255TestJSON-1943954072 tempest-FlavorsV255TestJSON-1943954072-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 6149 microversion: 2.55 time: 0.040440 Mar 05 20:49:18.070039 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 133/262] 10.222.0.15 () {60 vars in 1186 bytes} [Sat Mar 5 20:49:18 2022] GET /compute/v2.1/flavors/detail => generated 6149 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:49:18.076262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-f62f2e20-281c-47bf-a76a-2f4b2c0370b8 req-f6e9e60a-e749-4be1-b985-d3368378659a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f00577b-ab4a-4e3c-b42d-53f30d4a34bd", "tag": "641ae876-922a-4e29-be45-f8fac1e96f2e"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:18.091245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f62f2e20-281c-47bf-a76a-2f4b2c0370b8 req-f6e9e60a-e749-4be1-b985-d3368378659a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:18.092424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f62f2e20-281c-47bf-a76a-2f4b2c0370b8 req-f6e9e60a-e749-4be1-b985-d3368378659a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:18.109045 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-f62f2e20-281c-47bf-a76a-2f4b2c0370b8 req-f6e9e60a-e749-4be1-b985-d3368378659a service nova] Creating event network-changed:641ae876-922a-4e29-be45-f8fac1e96f2e for instance 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd on nch2-master-1 Mar 05 20:49:18.116310 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-f62f2e20-281c-47bf-a76a-2f4b2c0370b8 req-f6e9e60a-e749-4be1-b985-d3368378659a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043619 Mar 05 20:49:18.116976 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 134/263] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:18.122065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91fc91f6-e186-4193-a810-3b04d370c067 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:18.122760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91fc91f6-e186-4193-a810-3b04d370c067 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:18.130963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91fc91f6-e186-4193-a810-3b04d370c067 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:18.131477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91fc91f6-e186-4193-a810-3b04d370c067 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:18.134727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91fc91f6-e186-4193-a810-3b04d370c067 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:18.134727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91fc91f6-e186-4193-a810-3b04d370c067 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:18.150103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-665380e2-a122-4fea-a6a3-a73399252606 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:18.166761 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-665380e2-a122-4fea-a6a3-a73399252606 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1385 microversion: 2.1 time: 1.116046 Mar 05 20:49:18.184474 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 130/264] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:17 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1385 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:18.192319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-84bfea5f-c0f6-4a5b-a24d-07564034a486 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:18.196729 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:18.196729 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:18.216321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84bfea5f-c0f6-4a5b-a24d-07564034a486 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:18.217024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84bfea5f-c0f6-4a5b-a24d-07564034a486 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:18.414878 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-84bfea5f-c0f6-4a5b-a24d-07564034a486 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.228086 Mar 05 20:49:18.422365 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 131/265] 10.222.0.15 () {60 vars in 1190 bytes} [Sat Mar 5 20:49:18 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:18.435266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-61a39ce8-1538-452f-99ef-32d804db6171 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:18.437125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-61a39ce8-1538-452f-99ef-32d804db6171 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:18.444935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-91fc91f6-e186-4193-a810-3b04d370c067 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:18.454211 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91fc91f6-e186-4193-a810-3b04d370c067 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1271 microversion: 2.1 time: 0.336012 Mar 05 20:49:18.456337 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 135/266] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:18 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1271 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:18.461638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aa702bee-a254-47f9-9cc4-656eb4f13625 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:18.470051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61a39ce8-1538-452f-99ef-32d804db6171 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:18.470515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61a39ce8-1538-452f-99ef-32d804db6171 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:18.472159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61a39ce8-1538-452f-99ef-32d804db6171 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:18.472602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-aa702bee-a254-47f9-9cc4-656eb4f13625 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:18.478470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61a39ce8-1538-452f-99ef-32d804db6171 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:18.493262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa702bee-a254-47f9-9cc4-656eb4f13625 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:18.494177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa702bee-a254-47f9-9cc4-656eb4f13625 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:18.496759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa702bee-a254-47f9-9cc4-656eb4f13625 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:18.497256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa702bee-a254-47f9-9cc4-656eb4f13625 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:18.676700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-61a39ce8-1538-452f-99ef-32d804db6171 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:18.692467 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-61a39ce8-1538-452f-99ef-32d804db6171 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1280 microversion: 2.1 time: 0.273755 Mar 05 20:49:18.694173 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 132/267] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:18 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1280 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:18.700382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-870ba772-a2c8-4275-a63d-3f3badeb86c6 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:18.701877 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:18.701877 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:18.757954 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-870ba772-a2c8-4275-a63d-3f3badeb86c6 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.061654 Mar 05 20:49:18.764938 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 133/268] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:18 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:18.777689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8e6f60e8-6988-4832-ab37-1602a89b27c5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:18.779746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8e6f60e8-6988-4832-ab37-1602a89b27c5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:18.794395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e6f60e8-6988-4832-ab37-1602a89b27c5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:18.800060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e6f60e8-6988-4832-ab37-1602a89b27c5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:18.801537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e6f60e8-6988-4832-ab37-1602a89b27c5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:18.802171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e6f60e8-6988-4832-ab37-1602a89b27c5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:18.914008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-aa702bee-a254-47f9-9cc4-656eb4f13625 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:18.925147 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aa702bee-a254-47f9-9cc4-656eb4f13625 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1316 microversion: 2.1 time: 0.467458 Mar 05 20:49:18.934483 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 136/269] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:18 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:18.934483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ae12c1d2-cb99-4ec2-a53b-33269e40b864 req-41460619-0e53-4688-84c2-b727f41e1889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d196df64-5f99-4c5a-b30b-92751e6f7702", "tag": "cd12eb23-3086-4db9-babd-0ffb56ce7a27"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:18.944520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ae12c1d2-cb99-4ec2-a53b-33269e40b864 req-41460619-0e53-4688-84c2-b727f41e1889 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:18.952242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8e6f60e8-6988-4832-ab37-1602a89b27c5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:18.957182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ae12c1d2-cb99-4ec2-a53b-33269e40b864 req-41460619-0e53-4688-84c2-b727f41e1889 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:18.964093 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8e6f60e8-6988-4832-ab37-1602a89b27c5 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1278 microversion: 2.1 time: 0.197954 Mar 05 20:49:18.974285 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 134/270] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:18 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:18.974285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cfcb494d-b803-48c6-b599-f17e8ad4f470 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-936981468"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:18.975715 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:18.975715 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:18.975715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.aggregate [None req-cfcb494d-b803-48c6-b599-f17e8ad4f470 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Generated uuid 6a6d31d9-eeda-4b15-9519-8cc39d4e3b4d for aggregate {{(pid=141478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:18.982443 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ae12c1d2-cb99-4ec2-a53b-33269e40b864 req-41460619-0e53-4688-84c2-b727f41e1889 service nova] Creating event network-changed:cd12eb23-3086-4db9-babd-0ffb56ce7a27 for instance d196df64-5f99-4c5a-b30b-92751e6f7702 on nch1-master-1 Mar 05 20:49:18.992810 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ae12c1d2-cb99-4ec2-a53b-33269e40b864 req-41460619-0e53-4688-84c2-b727f41e1889 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064795 Mar 05 20:49:18.995141 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 137/271] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:19.006477 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cfcb494d-b803-48c6-b599-f17e8ad4f470 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.037505 Mar 05 20:49:19.007219 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 135/272] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:18 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:19.021438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0090b701-e3a1-4961-858c-77ecfa888ef3 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:19.022304 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.022304 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:19.066932 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0090b701-e3a1-4961-858c-77ecfa888ef3 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.047746 Mar 05 20:49:19.070960 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 138/273] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:19 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:19.078892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-466e3bbc-a927-474d-90a3-ee44a7768950 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:19.079662 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.079662 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:19.087571 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-466e3bbc-a927-474d-90a3-ee44a7768950 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Mar 05 20:49:19.088206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-466e3bbc-a927-474d-90a3-ee44a7768950 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:19.089042 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-466e3bbc-a927-474d-90a3-ee44a7768950 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.015747 Mar 05 20:49:19.093292 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 136/274] 10.222.0.15 () {58 vars in 1148 bytes} [Sat Mar 5 20:49:19 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:49:19.099225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1c5a0c8a-2c24-4b69-9df8-4aee29a2b25a tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:19.100127 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.100127 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:19.114065 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-1c5a0c8a-2c24-4b69-9df8-4aee29a2b25a tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Mar 05 20:49:19.116376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1c5a0c8a-2c24-4b69-9df8-4aee29a2b25a tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:19.116749 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1c5a0c8a-2c24-4b69-9df8-4aee29a2b25a tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.021806 Mar 05 20:49:19.121326 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 139/275] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:19 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:49:19.129282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a9dbd058-3add-4e80-af6b-a38d37887482 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-244816214", "name": "tempest-test_aggregate-283810759"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:19.150966 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.150966 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:19.152075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.aggregate [None req-a9dbd058-3add-4e80-af6b-a38d37887482 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Generated uuid 8fb75da3-006f-4791-9f93-ccaad20bb25e for aggregate {{(pid=141478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:19.199012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-68a2d312-dea6-4ab2-8533-f7e5d4b64272 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:19.204119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-68a2d312-dea6-4ab2-8533-f7e5d4b64272 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:19.206763 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a9dbd058-3add-4e80-af6b-a38d37887482 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.082693 Mar 05 20:49:19.208534 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 137/276] 10.222.0.15 () {60 vars in 1164 bytes} [Sat Mar 5 20:49:19 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:19.222399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68a2d312-dea6-4ab2-8533-f7e5d4b64272 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:19.223044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4f65f195-988b-45dd-baa7-f93ec7bbcc40 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:19.223588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68a2d312-dea6-4ab2-8533-f7e5d4b64272 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:19.225247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68a2d312-dea6-4ab2-8533-f7e5d4b64272 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:19.225528 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.225528 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:19.225947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68a2d312-dea6-4ab2-8533-f7e5d4b64272 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:19.266438 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4f65f195-988b-45dd-baa7-f93ec7bbcc40 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.049382 Mar 05 20:49:19.269362 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 138/277] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:19 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:19.282518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8ce48c72-5e3d-4b28-98ac-a12731baf775 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:19.286034 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.286034 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:19.293964 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-8ce48c72-5e3d-4b28-98ac-a12731baf775 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Mar 05 20:49:19.294807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8ce48c72-5e3d-4b28-98ac-a12731baf775 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:19.295643 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8ce48c72-5e3d-4b28-98ac-a12731baf775 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.018833 Mar 05 20:49:19.297836 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 139/278] 10.222.0.15 () {58 vars in 1148 bytes} [Sat Mar 5 20:49:19 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:49:19.305832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d4f81a37-033d-4d8b-bf9a-fea77d7d5361 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:19.306857 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.306857 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:19.322174 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-d4f81a37-033d-4d8b-bf9a-fea77d7d5361 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Mar 05 20:49:19.322773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d4f81a37-033d-4d8b-bf9a-fea77d7d5361 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:19.323800 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d4f81a37-033d-4d8b-bf9a-fea77d7d5361 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.021620 Mar 05 20:49:19.324542 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 140/279] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:19 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 05 20:49:19.347783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-af52145b-2549-4407-b5df-4761e2f47652 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1902762949"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:19.350147 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.350147 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:19.351118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.aggregate [None req-af52145b-2549-4407-b5df-4761e2f47652 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Generated uuid 85be36c2-dd5b-4b7f-acd9-3d14fc9e5159 for aggregate {{(pid=141478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:19.375290 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-af52145b-2549-4407-b5df-4761e2f47652 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.034702 Mar 05 20:49:19.376568 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 141/280] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:19.395909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7e8ccc55-d4c5-44ee-b723-59a0d5621b87 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:19.397063 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.397063 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:19.428898 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7e8ccc55-d4c5-44ee-b723-59a0d5621b87 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.044143 Mar 05 20:49:19.431747 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 142/281] 10.222.0.15 () {58 vars in 1148 bytes} [Sat Mar 5 20:49:19 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:19.444096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-04eb0c08-85fe-4e4c-9c17-12afe664cfd8 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:19.447119 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.447119 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:19.496673 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-04eb0c08-85fe-4e4c-9c17-12afe664cfd8 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.059453 Mar 05 20:49:19.503879 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 143/282] 10.222.0.15 () {60 vars in 1190 bytes} [Sat Mar 5 20:49:19 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:19.516879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9850cc58-4a49-4e27-b0d3-772f47e0de19 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:19.520041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9850cc58-4a49-4e27-b0d3-772f47e0de19 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:19.528429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9850cc58-4a49-4e27-b0d3-772f47e0de19 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:19.529203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9850cc58-4a49-4e27-b0d3-772f47e0de19 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:19.529875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9850cc58-4a49-4e27-b0d3-772f47e0de19 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:19.531255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9850cc58-4a49-4e27-b0d3-772f47e0de19 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:19.655414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-68a2d312-dea6-4ab2-8533-f7e5d4b64272 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:19.664431 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-68a2d312-dea6-4ab2-8533-f7e5d4b64272 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1385 microversion: 2.1 time: 0.471365 Mar 05 20:49:19.665399 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 140/283] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:19 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1385 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:19.674896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e91a24e1-e8cb-4130-955e-3a551bd455ab tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:19.676503 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.676503 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:19.683794 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e91a24e1-e8cb-4130-955e-3a551bd455ab tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.016405 Mar 05 20:49:19.684417 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 141/284] 10.222.0.15 () {58 vars in 1148 bytes} [Sat Mar 5 20:49:19 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:19.695071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f523ed07-971f-4dcf-be4c-de7c109467d4 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:19.695979 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.695979 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:19.717436 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f523ed07-971f-4dcf-be4c-de7c109467d4 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.026005 Mar 05 20:49:19.718703 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 142/285] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:19 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:19.726895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ac5afe6e-2adc-4959-ac96-8d9b0b062ad1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:19.727813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ac5afe6e-2adc-4959-ac96-8d9b0b062ad1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:19.735752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac5afe6e-2adc-4959-ac96-8d9b0b062ad1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:19.736205 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac5afe6e-2adc-4959-ac96-8d9b0b062ad1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:19.737212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac5afe6e-2adc-4959-ac96-8d9b0b062ad1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:19.737805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac5afe6e-2adc-4959-ac96-8d9b0b062ad1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:19.832427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ac5afe6e-2adc-4959-ac96-8d9b0b062ad1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:19.843101 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ac5afe6e-2adc-4959-ac96-8d9b0b062ad1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1280 microversion: 2.1 time: 0.122977 Mar 05 20:49:19.844332 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 143/286] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:19 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1280 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:19.854241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e7bdeea5-3be3-4e0a-8bc7-20dd718c8163 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1231267158", "availability_zone": "tempest-test_az-975337733"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:19.856706 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.856706 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:19.858152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.aggregate [None req-e7bdeea5-3be3-4e0a-8bc7-20dd718c8163 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Generated uuid bd3af8d4-35d5-4691-8c68-2cf43e83ab7e for aggregate {{(pid=141479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:19.900724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9850cc58-4a49-4e27-b0d3-772f47e0de19 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:19.919550 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9850cc58-4a49-4e27-b0d3-772f47e0de19 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1271 microversion: 2.1 time: 0.419047 Mar 05 20:49:19.928260 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 144/287] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:19 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1271 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:19.932675 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e7bdeea5-3be3-4e0a-8bc7-20dd718c8163 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.086211 Mar 05 20:49:19.933941 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 144/288] 10.222.0.15 () {60 vars in 1164 bytes} [Sat Mar 5 20:49:19 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:19.944041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f42b195d-3e03-472c-b3b2-a56d0ba2faf9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:19.944658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f42b195d-3e03-472c-b3b2-a56d0ba2faf9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:19.952064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f42b195d-3e03-472c-b3b2-a56d0ba2faf9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:19.952512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f42b195d-3e03-472c-b3b2-a56d0ba2faf9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:19.953299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f42b195d-3e03-472c-b3b2-a56d0ba2faf9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:19.953734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f42b195d-3e03-472c-b3b2-a56d0ba2faf9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:19.963210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c6cd0a32-fb90-464e-b0f3-ce41fe5ec58c tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1231267158_new", "availability_zone": "tempest-test_az-975337733_new"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:19.965292 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:19.965292 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:20.036911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6cd0a32-fb90-464e-b0f3-ce41fe5ec58c tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:20.037536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6cd0a32-fb90-464e-b0f3-ce41fe5ec58c tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:20.080062 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c6cd0a32-fb90-464e-b0f3-ce41fe5ec58c tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 334 microversion: 2.1 time: 0.129703 Mar 05 20:49:20.089255 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 145/289] 10.222.0.15 () {60 vars in 1169 bytes} [Sat Mar 5 20:49:19 2022] PUT /compute/v2.1/os-aggregates/9 => generated 334 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:20.096485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7216944d-8a89-4c65-ab74-9c3e6a2f0156 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:20.097812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7216944d-8a89-4c65-ab74-9c3e6a2f0156 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:20.108149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7216944d-8a89-4c65-ab74-9c3e6a2f0156 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:20.108599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7216944d-8a89-4c65-ab74-9c3e6a2f0156 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:20.109617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7216944d-8a89-4c65-ab74-9c3e6a2f0156 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:20.110201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7216944d-8a89-4c65-ab74-9c3e6a2f0156 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:20.419374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7216944d-8a89-4c65-ab74-9c3e6a2f0156 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:20.429373 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7216944d-8a89-4c65-ab74-9c3e6a2f0156 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1320 microversion: 2.1 time: 0.337450 Mar 05 20:49:20.438849 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 146/290] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:20 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1320 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:20.438849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a65d58df-9da5-4996-b4a5-a73544dcbf92 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:20.438849 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:20.438849 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:20.445648 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a65d58df-9da5-4996-b4a5-a73544dcbf92 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.014790 Mar 05 20:49:20.446454 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 147/291] 10.222.0.15 () {58 vars in 1142 bytes} [Sat Mar 5 20:49:20 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:20.456739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b0c601a7-4d68-4dd1-a692-f753ac5c944e tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:20.457508 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:20.457508 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:20.478241 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b0c601a7-4d68-4dd1-a692-f753ac5c944e tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.025475 Mar 05 20:49:20.483181 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 148/292] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:20 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Mar 05 20:49:20.490306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-39801cca-be78-4dc6-b676-08d61d3af816 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1932126869"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:20.491863 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:20.491863 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:20.492871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.aggregate [None req-39801cca-be78-4dc6-b676-08d61d3af816 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Generated uuid ea7821af-0451-45ba-8e40-41c1b1c855d3 for aggregate {{(pid=141479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:20.520347 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-39801cca-be78-4dc6-b676-08d61d3af816 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.035548 Mar 05 20:49:20.521660 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 149/293] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:20 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:20.534738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-61ddd2d2-e4e7-4a0e-aa2f-9afb9e1a7b29 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:20.535630 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:20.535630 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:20.545612 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-61ddd2d2-e4e7-4a0e-aa2f-9afb9e1a7b29 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.017076 Mar 05 20:49:20.546578 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 150/294] 10.222.0.15 () {58 vars in 1142 bytes} [Sat Mar 5 20:49:20 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:20.559482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-25c8df4d-2c15-4e16-ab43-3025b2e12005 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:20.560841 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:20.560841 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:20.591099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f42b195d-3e03-472c-b3b2-a56d0ba2faf9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:20.606403 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-25c8df4d-2c15-4e16-ab43-3025b2e12005 tempest-AggregatesAdminTestJSON-527496842 tempest-AggregatesAdminTestJSON-527496842-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.052181 Mar 05 20:49:20.609840 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 151/295] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:49:20 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:20.620512 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f42b195d-3e03-472c-b3b2-a56d0ba2faf9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1316 microversion: 2.1 time: 0.665222 Mar 05 20:49:20.622690 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 145/296] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:19 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1316 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:20.638864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-62228369-7283-44f1-ad5d-56682a78c7b8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:20.640074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-62228369-7283-44f1-ad5d-56682a78c7b8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:20.650663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62228369-7283-44f1-ad5d-56682a78c7b8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:20.652698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62228369-7283-44f1-ad5d-56682a78c7b8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:20.656940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62228369-7283-44f1-ad5d-56682a78c7b8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:20.658685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62228369-7283-44f1-ad5d-56682a78c7b8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:20.680204 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-62228369-7283-44f1-ad5d-56682a78c7b8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] HTTP exception thrown: Instance ebf55fc7-8496-4922-9291-4b258266c92b could not be found. Mar 05 20:49:20.681029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-62228369-7283-44f1-ad5d-56682a78c7b8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Returning 404 to user: Instance ebf55fc7-8496-4922-9291-4b258266c92b could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:20.682011 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-62228369-7283-44f1-ad5d-56682a78c7b8 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 404 len: 111 microversion: 2.1 time: 0.064043 Mar 05 20:49:20.683206 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 152/297] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:49:20 2022] DELETE /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:20.687401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d52119da-e282-4544-afcc-c384e84db3cc tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:20.688381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d52119da-e282-4544-afcc-c384e84db3cc tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:20.695592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d52119da-e282-4544-afcc-c384e84db3cc tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:20.695869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f267843f-17d6-4900-b7cd-14722862e1d5 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:20.696577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d52119da-e282-4544-afcc-c384e84db3cc tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:20.697818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d52119da-e282-4544-afcc-c384e84db3cc tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:20.698686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d52119da-e282-4544-afcc-c384e84db3cc tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:20.701155 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f267843f-17d6-4900-b7cd-14722862e1d5 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] [instance: ebf55fc7-8496-4922-9291-4b258266c92b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:20.720531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f267843f-17d6-4900-b7cd-14722862e1d5 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:20.721073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f267843f-17d6-4900-b7cd-14722862e1d5 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:20.722160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f267843f-17d6-4900-b7cd-14722862e1d5 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:20.724483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f267843f-17d6-4900-b7cd-14722862e1d5 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:20.758993 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-f267843f-17d6-4900-b7cd-14722862e1d5 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] HTTP exception thrown: Instance ebf55fc7-8496-4922-9291-4b258266c92b could not be found. Mar 05 20:49:20.759907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f267843f-17d6-4900-b7cd-14722862e1d5 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] Returning 404 to user: Instance ebf55fc7-8496-4922-9291-4b258266c92b could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:20.761090 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f267843f-17d6-4900-b7cd-14722862e1d5 tempest-AggregatesAdminTestJSON-1349367239 tempest-AggregatesAdminTestJSON-1349367239-project] 10.222.0.15 "GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b" status: 404 len: 111 microversion: 2.1 time: 0.074219 Mar 05 20:49:20.763512 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 153/298] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:20 2022] GET /compute/v2.1/servers/ebf55fc7-8496-4922-9291-4b258266c92b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:20.860333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e5657c66-bde7-4537-9815-f855513467c3 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:20.860950 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e5657c66-bde7-4537-9815-f855513467c3 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:20.873789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5657c66-bde7-4537-9815-f855513467c3 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:20.874410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5657c66-bde7-4537-9815-f855513467c3 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:20.880084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5657c66-bde7-4537-9815-f855513467c3 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:20.880463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5657c66-bde7-4537-9815-f855513467c3 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:21.127683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d52119da-e282-4544-afcc-c384e84db3cc tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:21.139796 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d52119da-e282-4544-afcc-c384e84db3cc tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1385 microversion: 2.1 time: 0.460504 Mar 05 20:49:21.150580 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 146/299] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:20 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1385 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:21.155451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a9dca3a2-f1e4-4506-8bd2-92510aabc80b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:21.156099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a9dca3a2-f1e4-4506-8bd2-92510aabc80b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:21.172467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9dca3a2-f1e4-4506-8bd2-92510aabc80b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:21.172952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9dca3a2-f1e4-4506-8bd2-92510aabc80b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:21.174621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9dca3a2-f1e4-4506-8bd2-92510aabc80b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:21.175415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9dca3a2-f1e4-4506-8bd2-92510aabc80b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:21.657124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a9dca3a2-f1e4-4506-8bd2-92510aabc80b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:21.668962 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a9dca3a2-f1e4-4506-8bd2-92510aabc80b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1313 microversion: 2.1 time: 0.517232 Mar 05 20:49:21.672598 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 147/300] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:21 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1313 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:21.688271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-abd7e23d-6380-4d9c-8768-ad3d8106e7f4 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:21.689669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-abd7e23d-6380-4d9c-8768-ad3d8106e7f4 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:21.702086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abd7e23d-6380-4d9c-8768-ad3d8106e7f4 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:21.702629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abd7e23d-6380-4d9c-8768-ad3d8106e7f4 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:21.703620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abd7e23d-6380-4d9c-8768-ad3d8106e7f4 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:21.704172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abd7e23d-6380-4d9c-8768-ad3d8106e7f4 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:21.955468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e5657c66-bde7-4537-9815-f855513467c3 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:21.980576 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e5657c66-bde7-4537-9815-f855513467c3 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1322 microversion: 2.1 time: 1.122964 Mar 05 20:49:21.985429 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 154/301] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:20 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1322 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:21.998787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ce235806-16d2-48ad-aafb-124fcd3fdd00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:22.002014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ce235806-16d2-48ad-aafb-124fcd3fdd00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:22.022108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce235806-16d2-48ad-aafb-124fcd3fdd00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:22.023931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce235806-16d2-48ad-aafb-124fcd3fdd00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:22.024812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce235806-16d2-48ad-aafb-124fcd3fdd00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:22.025272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce235806-16d2-48ad-aafb-124fcd3fdd00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:22.374912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-abd7e23d-6380-4d9c-8768-ad3d8106e7f4 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:22.386414 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-abd7e23d-6380-4d9c-8768-ad3d8106e7f4 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1320 microversion: 2.1 time: 0.712186 Mar 05 20:49:22.389315 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 148/302] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:21 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1320 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:22.399422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c80d2e35-1a38-4fbf-9173-0a8d3bcb68a1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:22.404215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c80d2e35-1a38-4fbf-9173-0a8d3bcb68a1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:22.417016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c80d2e35-1a38-4fbf-9173-0a8d3bcb68a1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:22.417534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c80d2e35-1a38-4fbf-9173-0a8d3bcb68a1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:22.422500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c80d2e35-1a38-4fbf-9173-0a8d3bcb68a1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:22.423636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c80d2e35-1a38-4fbf-9173-0a8d3bcb68a1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:23.170218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c80d2e35-1a38-4fbf-9173-0a8d3bcb68a1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:23.183332 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c80d2e35-1a38-4fbf-9173-0a8d3bcb68a1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1385 microversion: 2.1 time: 0.792862 Mar 05 20:49:23.188409 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 149/303] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:22 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1385 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:23.196324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-725cc8b2-3335-46e8-8a63-c68f27b8dbf7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:23.209917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-725cc8b2-3335-46e8-8a63-c68f27b8dbf7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:23.230638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-725cc8b2-3335-46e8-8a63-c68f27b8dbf7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:23.232257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-725cc8b2-3335-46e8-8a63-c68f27b8dbf7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:23.233720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-725cc8b2-3335-46e8-8a63-c68f27b8dbf7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:23.234735 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-725cc8b2-3335-46e8-8a63-c68f27b8dbf7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:23.303791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ce235806-16d2-48ad-aafb-124fcd3fdd00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:23.326538 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ce235806-16d2-48ad-aafb-124fcd3fdd00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1316 microversion: 2.1 time: 1.336889 Mar 05 20:49:23.326930 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 155/304] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:21 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1316 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:23.344493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-888e6a27-06b2-4c4c-90a9-2f2d0974c691 req-18f50b07-1778-4849-aa76-274bfaec4af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d96e01cc-e3b1-464e-8032-9e86fcb22824", "tag": "f2a014b4-b464-4203-8c89-db1d813f0118"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:23.361880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-888e6a27-06b2-4c4c-90a9-2f2d0974c691 req-18f50b07-1778-4849-aa76-274bfaec4af7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:23.362615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-888e6a27-06b2-4c4c-90a9-2f2d0974c691 req-18f50b07-1778-4849-aa76-274bfaec4af7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:23.378913 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-888e6a27-06b2-4c4c-90a9-2f2d0974c691 req-18f50b07-1778-4849-aa76-274bfaec4af7 service nova] Creating event network-changed:f2a014b4-b464-4203-8c89-db1d813f0118 for instance d96e01cc-e3b1-464e-8032-9e86fcb22824 on nch1-master-1 Mar 05 20:49:23.392308 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-888e6a27-06b2-4c4c-90a9-2f2d0974c691 req-18f50b07-1778-4849-aa76-274bfaec4af7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062020 Mar 05 20:49:23.394620 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 156/305] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:23.404801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fe7d3cca-7143-488d-9545-7ee38c76470b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:23.406132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fe7d3cca-7143-488d-9545-7ee38c76470b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:23.420488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe7d3cca-7143-488d-9545-7ee38c76470b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:23.421188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe7d3cca-7143-488d-9545-7ee38c76470b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:23.422143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe7d3cca-7143-488d-9545-7ee38c76470b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:23.422939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe7d3cca-7143-488d-9545-7ee38c76470b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:23.846266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fe7d3cca-7143-488d-9545-7ee38c76470b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:23.858424 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fe7d3cca-7143-488d-9545-7ee38c76470b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1322 microversion: 2.1 time: 0.461618 Mar 05 20:49:23.863950 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 157/306] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:23 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1322 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:24.150351 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e283e308-b0e4-40db-a9e2-9cc0883cc034 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Calling method '.version_select at 0x7fed5d09af70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:24.151259 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:24.151259 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:24.152634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e283e308-b0e4-40db-a9e2-9cc0883cc034 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.153088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e283e308-b0e4-40db-a9e2-9cc0883cc034 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.183275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e283e308-b0e4-40db-a9e2-9cc0883cc034 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.184013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e283e308-b0e4-40db-a9e2-9cc0883cc034 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.198301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e283e308-b0e4-40db-a9e2-9cc0883cc034 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.198975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e283e308-b0e4-40db-a9e2-9cc0883cc034 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.209306 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e283e308-b0e4-40db-a9e2-9cc0883cc034 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.342393 Mar 05 20:49:24.214657 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 158/307] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:49:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:24.232463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-13fc786d-c3b8-4da5-8871-f707b0ff7d7d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:24.239767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-13fc786d-c3b8-4da5-8871-f707b0ff7d7d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:24.249284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-13fc786d-c3b8-4da5-8871-f707b0ff7d7d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.249743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-13fc786d-c3b8-4da5-8871-f707b0ff7d7d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.250535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-13fc786d-c3b8-4da5-8871-f707b0ff7d7d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.250975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-13fc786d-c3b8-4da5-8871-f707b0ff7d7d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.270276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-725cc8b2-3335-46e8-8a63-c68f27b8dbf7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:24.284663 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-725cc8b2-3335-46e8-8a63-c68f27b8dbf7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1313 microversion: 2.1 time: 1.091945 Mar 05 20:49:24.286824 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 150/308] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:23 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1313 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:24.309000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-05132d72-d979-424d-829d-39c7972d794e req-43bad96d-2b59-496d-87e5-34be4a97c65e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e68fe7-4232-4918-aa20-4dda276362ed", "tag": "11733f46-438a-4683-b8ae-9561dfb31a38"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:24.325993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-05132d72-d979-424d-829d-39c7972d794e req-43bad96d-2b59-496d-87e5-34be4a97c65e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.326916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-05132d72-d979-424d-829d-39c7972d794e req-43bad96d-2b59-496d-87e5-34be4a97c65e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.349730 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-05132d72-d979-424d-829d-39c7972d794e req-43bad96d-2b59-496d-87e5-34be4a97c65e service nova] Creating event network-changed:11733f46-438a-4683-b8ae-9561dfb31a38 for instance 97e68fe7-4232-4918-aa20-4dda276362ed on nch2-master-1 Mar 05 20:49:24.363888 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-05132d72-d979-424d-829d-39c7972d794e req-43bad96d-2b59-496d-87e5-34be4a97c65e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072513 Mar 05 20:49:24.366324 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 151/309] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:24.376639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-46e5497f-7472-4edf-ba7e-d2e686842a10 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:24.380152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-46e5497f-7472-4edf-ba7e-d2e686842a10 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:24.394566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46e5497f-7472-4edf-ba7e-d2e686842a10 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.395017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46e5497f-7472-4edf-ba7e-d2e686842a10 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.397442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46e5497f-7472-4edf-ba7e-d2e686842a10 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.397890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46e5497f-7472-4edf-ba7e-d2e686842a10 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.559478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-13fc786d-c3b8-4da5-8871-f707b0ff7d7d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:24.568209 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-13fc786d-c3b8-4da5-8871-f707b0ff7d7d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1320 microversion: 2.1 time: 0.352186 Mar 05 20:49:24.572174 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 159/310] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:24 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1320 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:24.573779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f857e69d-98d5-49f3-bc33-5ae13bbb31cf tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Calling method '.version_select at 0x7fed5d0a3790>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:24.574861 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:24.574861 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:24.576218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f857e69d-98d5-49f3-bc33-5ae13bbb31cf tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.576845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f857e69d-98d5-49f3-bc33-5ae13bbb31cf tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.593684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f857e69d-98d5-49f3-bc33-5ae13bbb31cf tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.594138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f857e69d-98d5-49f3-bc33-5ae13bbb31cf tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.619804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f857e69d-98d5-49f3-bc33-5ae13bbb31cf tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.620244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f857e69d-98d5-49f3-bc33-5ae13bbb31cf tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.626180 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f857e69d-98d5-49f3-bc33-5ae13bbb31cf tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 354 microversion: 2.1 time: 0.056306 Mar 05 20:49:24.627645 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 160/311] 10.222.0.15 () {58 vars in 1211 bytes} [Sat Mar 5 20:49:24 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:24.632969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9d5a2c3b-fd97-43d9-b1f8-40ceee637491 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:24.632969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9d5a2c3b-fd97-43d9-b1f8-40ceee637491 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:24.638617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d5a2c3b-fd97-43d9-b1f8-40ceee637491 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.639616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d5a2c3b-fd97-43d9-b1f8-40ceee637491 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.640425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d5a2c3b-fd97-43d9-b1f8-40ceee637491 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.641922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d5a2c3b-fd97-43d9-b1f8-40ceee637491 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.835275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9d5a2c3b-fd97-43d9-b1f8-40ceee637491 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:24.837597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-46e5497f-7472-4edf-ba7e-d2e686842a10 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:24.846258 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-46e5497f-7472-4edf-ba7e-d2e686842a10 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1385 microversion: 2.1 time: 0.476743 Mar 05 20:49:24.847333 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 152/312] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:24 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1385 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:24.856860 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9d5a2c3b-fd97-43d9-b1f8-40ceee637491 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1316 microversion: 2.1 time: 0.218287 Mar 05 20:49:24.863786 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 161/313] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:24 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:24.875966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4b271bb3-a7ed-4beb-af1b-93820672f6d5 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Calling method '.version_select at 0x7fed5d09a550>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:24.878490 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:24.878490 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:24.881044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b271bb3-a7ed-4beb-af1b-93820672f6d5 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.881642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b271bb3-a7ed-4beb-af1b-93820672f6d5 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.905988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b271bb3-a7ed-4beb-af1b-93820672f6d5 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.907093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b271bb3-a7ed-4beb-af1b-93820672f6d5 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.921485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b271bb3-a7ed-4beb-af1b-93820672f6d5 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.922066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b271bb3-a7ed-4beb-af1b-93820672f6d5 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.933799 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4b271bb3-a7ed-4beb-af1b-93820672f6d5 tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.066820 Mar 05 20:49:24.934484 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 162/314] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:49:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:24.941271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-457bb50d-9c43-4cd6-8ffa-c2b4b6ab7b51 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:24.941891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-457bb50d-9c43-4cd6-8ffa-c2b4b6ab7b51 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:24.949264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-457bb50d-9c43-4cd6-8ffa-c2b4b6ab7b51 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.949721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-457bb50d-9c43-4cd6-8ffa-c2b4b6ab7b51 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:24.951050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-457bb50d-9c43-4cd6-8ffa-c2b4b6ab7b51 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:24.951560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-457bb50d-9c43-4cd6-8ffa-c2b4b6ab7b51 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.077986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-77ddcf3e-5c65-47f7-bf05-3863a53e84ef tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Calling method '.version_select at 0x7fed5d070e50>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:25.078986 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:25.078986 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:25.086335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-77ddcf3e-5c65-47f7-bf05-3863a53e84ef tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),591cc087-7d9b-4967-a4cd-9c96e8077593(cell1) {{(pid=141478) load_cells /opt/stack/nova/nova/compute/api.py:306}} Mar 05 20:49:25.100823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77ddcf3e-5c65-47f7-bf05-3863a53e84ef tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.102549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77ddcf3e-5c65-47f7-bf05-3863a53e84ef tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.147637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77ddcf3e-5c65-47f7-bf05-3863a53e84ef tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.148105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77ddcf3e-5c65-47f7-bf05-3863a53e84ef tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.177119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77ddcf3e-5c65-47f7-bf05-3863a53e84ef tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.177822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77ddcf3e-5c65-47f7-bf05-3863a53e84ef tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.189984 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-77ddcf3e-5c65-47f7-bf05-3863a53e84ef tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.340731 Mar 05 20:49:25.197779 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 153/315] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:49:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:25.205767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ae09a8f6-5640-4196-ad92-51cc0e8a89bd tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Calling method '.version_select at 0x7fed5d0f6160>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:25.207811 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:25.207811 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:25.211822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae09a8f6-5640-4196-ad92-51cc0e8a89bd tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.217824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae09a8f6-5640-4196-ad92-51cc0e8a89bd tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.247932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-457bb50d-9c43-4cd6-8ffa-c2b4b6ab7b51 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:25.258891 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-457bb50d-9c43-4cd6-8ffa-c2b4b6ab7b51 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1322 microversion: 2.1 time: 0.320818 Mar 05 20:49:25.270406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae09a8f6-5640-4196-ad92-51cc0e8a89bd tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.271099 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 163/316] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:24 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:25.271182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae09a8f6-5640-4196-ad92-51cc0e8a89bd tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.276497 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ae09a8f6-5640-4196-ad92-51cc0e8a89bd tempest-HypervisorAdminUnderV252Test-1065053765 tempest-HypervisorAdminUnderV252Test-1065053765-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.077325 Mar 05 20:49:25.282575 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 154/317] 10.222.0.15 () {58 vars in 1208 bytes} [Sat Mar 5 20:49:25 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:25.288678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b49cdc4a-0f1d-4e51-81b1-43334babf82a tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Calling method '.version_select at 0x7fed5d0dec10>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:25.290611 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:25.290611 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:25.299861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b49cdc4a-0f1d-4e51-81b1-43334babf82a tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.300260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b49cdc4a-0f1d-4e51-81b1-43334babf82a tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.303375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2e19278d-787e-418a-8f13-34dbe0c21556 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:25.304150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2e19278d-787e-418a-8f13-34dbe0c21556 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:25.315924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e19278d-787e-418a-8f13-34dbe0c21556 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.316702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e19278d-787e-418a-8f13-34dbe0c21556 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.317602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e19278d-787e-418a-8f13-34dbe0c21556 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.318261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e19278d-787e-418a-8f13-34dbe0c21556 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.327237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b49cdc4a-0f1d-4e51-81b1-43334babf82a tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.328157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b49cdc4a-0f1d-4e51-81b1-43334babf82a tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.346564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b49cdc4a-0f1d-4e51-81b1-43334babf82a tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.348014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b49cdc4a-0f1d-4e51-81b1-43334babf82a tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.360461 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b49cdc4a-0f1d-4e51-81b1-43334babf82a tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.097309 Mar 05 20:49:25.363861 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 164/318] 10.222.0.15 () {58 vars in 1166 bytes} [Sat Mar 5 20:49:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:25.380758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e1c95aee-2f0b-44a7-a176-3a930bcdfaf1 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Calling method '.version_select at 0x7fed5d0de8b0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:25.381817 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:25.381817 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:25.383259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1c95aee-2f0b-44a7-a176-3a930bcdfaf1 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.383895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1c95aee-2f0b-44a7-a176-3a930bcdfaf1 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.403478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1c95aee-2f0b-44a7-a176-3a930bcdfaf1 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.404304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1c95aee-2f0b-44a7-a176-3a930bcdfaf1 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.421644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1c95aee-2f0b-44a7-a176-3a930bcdfaf1 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.422752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1c95aee-2f0b-44a7-a176-3a930bcdfaf1 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.430537 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e1c95aee-2f0b-44a7-a176-3a930bcdfaf1 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.055146 Mar 05 20:49:25.436632 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 165/319] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:49:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:25.442238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-1363fb57-4813-48ed-af54-ee1501b3b37d req-83d4efa4-5bee-4a76-846c-485479fc24c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d196df64-5f99-4c5a-b30b-92751e6f7702", "name": "network-vif-plugged", "status": "completed", "tag": "cd12eb23-3086-4db9-babd-0ffb56ce7a27"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:25.452209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1363fb57-4813-48ed-af54-ee1501b3b37d req-83d4efa4-5bee-4a76-846c-485479fc24c3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.453613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1363fb57-4813-48ed-af54-ee1501b3b37d req-83d4efa4-5bee-4a76-846c-485479fc24c3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.478872 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-1363fb57-4813-48ed-af54-ee1501b3b37d req-83d4efa4-5bee-4a76-846c-485479fc24c3 service nova] Creating event network-vif-plugged:cd12eb23-3086-4db9-babd-0ffb56ce7a27 for instance d196df64-5f99-4c5a-b30b-92751e6f7702 on nch1-master-1 Mar 05 20:49:25.492619 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-1363fb57-4813-48ed-af54-ee1501b3b37d req-83d4efa4-5bee-4a76-846c-485479fc24c3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054440 Mar 05 20:49:25.493720 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 166/320] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:25.502592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-53e4afd5-bdb3-47dc-8c23-239d4560121b tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Calling method '.version_select at 0x7fed5d04e5e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:25.503643 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:25.503643 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:25.504895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53e4afd5-bdb3-47dc-8c23-239d4560121b tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.505340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53e4afd5-bdb3-47dc-8c23-239d4560121b tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.533855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53e4afd5-bdb3-47dc-8c23-239d4560121b tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.534327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53e4afd5-bdb3-47dc-8c23-239d4560121b tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.545040 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-53e4afd5-bdb3-47dc-8c23-239d4560121b tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.048605 Mar 05 20:49:25.545336 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 167/321] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:25.561393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-48fe9060-728e-4be7-85b1-ab8078b7a525 req-5184727a-af44-4ed3-9b66-12ba6b591e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c1af88-614e-45b4-a82b-5e8b1eb60180", "tag": "a3db8299-9220-413a-b709-391f3fa944d7"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:25.587907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-48fe9060-728e-4be7-85b1-ab8078b7a525 req-5184727a-af44-4ed3-9b66-12ba6b591e5b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.588748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-48fe9060-728e-4be7-85b1-ab8078b7a525 req-5184727a-af44-4ed3-9b66-12ba6b591e5b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.606426 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-48fe9060-728e-4be7-85b1-ab8078b7a525 req-5184727a-af44-4ed3-9b66-12ba6b591e5b service nova] Creating event network-changed:a3db8299-9220-413a-b709-391f3fa944d7 for instance 42c1af88-614e-45b4-a82b-5e8b1eb60180 on nch1-master-1 Mar 05 20:49:25.613112 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-48fe9060-728e-4be7-85b1-ab8078b7a525 req-5184727a-af44-4ed3-9b66-12ba6b591e5b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055484 Mar 05 20:49:25.614161 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 168/322] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:25.620016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0a14897-7f7a-4f9e-aa43-d2bb50a7c097 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Calling method '.version_select at 0x7fed5d04e5e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:25.620873 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:25.620873 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:25.622041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a14897-7f7a-4f9e-aa43-d2bb50a7c097 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.622808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a14897-7f7a-4f9e-aa43-d2bb50a7c097 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.646059 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0a14897-7f7a-4f9e-aa43-d2bb50a7c097 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.030772 Mar 05 20:49:25.646920 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 169/323] 10.222.0.15 () {58 vars in 1178 bytes} [Sat Mar 5 20:49:25 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:25.662815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-65625bad-dc88-4c57-961a-960975fc9b7e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:25.663538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-65625bad-dc88-4c57-961a-960975fc9b7e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:25.672648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65625bad-dc88-4c57-961a-960975fc9b7e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.673098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65625bad-dc88-4c57-961a-960975fc9b7e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.675090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65625bad-dc88-4c57-961a-960975fc9b7e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.675529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65625bad-dc88-4c57-961a-960975fc9b7e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.916420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2e19278d-787e-418a-8f13-34dbe0c21556 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:25.926129 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2e19278d-787e-418a-8f13-34dbe0c21556 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1313 microversion: 2.1 time: 0.627691 Mar 05 20:49:25.937807 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 155/324] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:25 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:25.958413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-47271e27-e37a-459f-9bb1-2a31446abc3e tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Calling method '.version_select at 0x7fed5d24aca0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:25.959482 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:25.959482 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:25.962899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47271e27-e37a-459f-9bb1-2a31446abc3e tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.963653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47271e27-e37a-459f-9bb1-2a31446abc3e tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:25.993818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47271e27-e37a-459f-9bb1-2a31446abc3e tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:25.995698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47271e27-e37a-459f-9bb1-2a31446abc3e tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.010232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-65625bad-dc88-4c57-961a-960975fc9b7e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:26.018293 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-65625bad-dc88-4c57-961a-960975fc9b7e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1320 microversion: 2.1 time: 0.362246 Mar 05 20:49:26.021294 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 170/325] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:25 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:26.023332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47271e27-e37a-459f-9bb1-2a31446abc3e tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.028442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47271e27-e37a-459f-9bb1-2a31446abc3e tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.029516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0828c384-b54a-49eb-afc2-eaecf209162f tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:26.035646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0828c384-b54a-49eb-afc2-eaecf209162f tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:26.044967 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-47271e27-e37a-459f-9bb1-2a31446abc3e tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.095460 Mar 05 20:49:26.046058 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 156/326] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:49:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:26.048049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0828c384-b54a-49eb-afc2-eaecf209162f tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.054569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0828c384-b54a-49eb-afc2-eaecf209162f tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.055593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0828c384-b54a-49eb-afc2-eaecf209162f tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.056298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-930bd7e7-7cfb-44ae-99d8-4196ee7843e0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:26.056449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0828c384-b54a-49eb-afc2-eaecf209162f tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.058845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-930bd7e7-7cfb-44ae-99d8-4196ee7843e0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:26.075219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-930bd7e7-7cfb-44ae-99d8-4196ee7843e0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.075752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-930bd7e7-7cfb-44ae-99d8-4196ee7843e0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.080112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-930bd7e7-7cfb-44ae-99d8-4196ee7843e0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.080702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-930bd7e7-7cfb-44ae-99d8-4196ee7843e0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.294870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-930bd7e7-7cfb-44ae-99d8-4196ee7843e0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:26.306992 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-930bd7e7-7cfb-44ae-99d8-4196ee7843e0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1316 microversion: 2.1 time: 0.259724 Mar 05 20:49:26.308231 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 157/327] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:26 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:26.315238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-10beaf8d-d5c6-408c-a1c3-0bbeed700990 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Calling method '.version_select at 0x7fed5cfe2940>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:26.316292 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:26.316292 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:26.318716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-10beaf8d-d5c6-408c-a1c3-0bbeed700990 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.319323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-10beaf8d-d5c6-408c-a1c3-0bbeed700990 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.335921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-10beaf8d-d5c6-408c-a1c3-0bbeed700990 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.337221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-10beaf8d-d5c6-408c-a1c3-0bbeed700990 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.343824 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-10beaf8d-d5c6-408c-a1c3-0bbeed700990 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.034400 Mar 05 20:49:26.344733 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 158/328] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:26 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:26.350316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8129a209-690b-4b66-bd8e-5fd4c7d8980b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:26.351179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8129a209-690b-4b66-bd8e-5fd4c7d8980b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:26.357530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8129a209-690b-4b66-bd8e-5fd4c7d8980b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.358286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8129a209-690b-4b66-bd8e-5fd4c7d8980b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.359226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8129a209-690b-4b66-bd8e-5fd4c7d8980b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.359850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8129a209-690b-4b66-bd8e-5fd4c7d8980b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.376717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0828c384-b54a-49eb-afc2-eaecf209162f tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:26.387257 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0828c384-b54a-49eb-afc2-eaecf209162f tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1385 microversion: 2.1 time: 0.362516 Mar 05 20:49:26.389655 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 171/329] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:26 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1385 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:26.395393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-90d1eea6-0d18-4704-b9fa-cb88fed5e7c2 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Calling method '.version_select at 0x7fed5d09a4c0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:26.408064 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:26.408064 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:26.421573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90d1eea6-0d18-4704-b9fa-cb88fed5e7c2 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.422271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90d1eea6-0d18-4704-b9fa-cb88fed5e7c2 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.437532 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90d1eea6-0d18-4704-b9fa-cb88fed5e7c2 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.438004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90d1eea6-0d18-4704-b9fa-cb88fed5e7c2 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.470312 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-90d1eea6-0d18-4704-b9fa-cb88fed5e7c2 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.077085 Mar 05 20:49:26.478296 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 172/330] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:26 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:26.486543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-30421d77-e787-4ca2-b176-57db9d46df38 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Calling method '.version_select at 0x7fed5d0ef310>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:26.489615 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:26.489615 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:26.493285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-30421d77-e787-4ca2-b176-57db9d46df38 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.493761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-30421d77-e787-4ca2-b176-57db9d46df38 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.524439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-30421d77-e787-4ca2-b176-57db9d46df38 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.525293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-30421d77-e787-4ca2-b176-57db9d46df38 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.545058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-30421d77-e787-4ca2-b176-57db9d46df38 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.546018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-30421d77-e787-4ca2-b176-57db9d46df38 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.566956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8129a209-690b-4b66-bd8e-5fd4c7d8980b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:26.578339 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8129a209-690b-4b66-bd8e-5fd4c7d8980b tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1322 microversion: 2.1 time: 0.231057 Mar 05 20:49:26.580865 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 159/331] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:26 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:26.597782 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-30421d77-e787-4ca2-b176-57db9d46df38 tempest-HypervisorAdminTestJSON-108483660 tempest-HypervisorAdminTestJSON-108483660-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.117230 Mar 05 20:49:26.604490 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 173/332] 10.222.0.15 () {58 vars in 1172 bytes} [Sat Mar 5 20:49:26 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:26.954213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f3ab46f-2c8d-4861-8cdc-681a8e794df3 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:26.954933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5f3ab46f-2c8d-4861-8cdc-681a8e794df3 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:26.961430 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f3ab46f-2c8d-4861-8cdc-681a8e794df3 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.961888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f3ab46f-2c8d-4861-8cdc-681a8e794df3 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:26.962665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f3ab46f-2c8d-4861-8cdc-681a8e794df3 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:26.963259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f3ab46f-2c8d-4861-8cdc-681a8e794df3 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:27.038691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7b54aa1a-eb2a-4eac-9cb1-251518fd490b tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:27.039387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7b54aa1a-eb2a-4eac-9cb1-251518fd490b tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:27.047691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b54aa1a-eb2a-4eac-9cb1-251518fd490b tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:27.048256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b54aa1a-eb2a-4eac-9cb1-251518fd490b tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:27.049643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b54aa1a-eb2a-4eac-9cb1-251518fd490b tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:27.050014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b54aa1a-eb2a-4eac-9cb1-251518fd490b tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:27.170149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5f3ab46f-2c8d-4861-8cdc-681a8e794df3 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:27.178503 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5f3ab46f-2c8d-4861-8cdc-681a8e794df3 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1313 microversion: 2.1 time: 0.228052 Mar 05 20:49:27.181929 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 160/333] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:26 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:27.248462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7b54aa1a-eb2a-4eac-9cb1-251518fd490b tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:27.257734 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7b54aa1a-eb2a-4eac-9cb1-251518fd490b tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1320 microversion: 2.1 time: 0.223095 Mar 05 20:49:27.259387 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 174/334] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:27 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1320 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:27.325612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-632a2ac7-a60c-4f7e-a803-b2944344c2cb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:27.326461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-632a2ac7-a60c-4f7e-a803-b2944344c2cb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:27.343287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-632a2ac7-a60c-4f7e-a803-b2944344c2cb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:27.343777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-632a2ac7-a60c-4f7e-a803-b2944344c2cb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:27.344563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-632a2ac7-a60c-4f7e-a803-b2944344c2cb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:27.350926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-632a2ac7-a60c-4f7e-a803-b2944344c2cb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:27.488051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2e80492e-abab-4451-acbd-876951b5f6ab tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:27.490976 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:27.490976 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:27.492666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e80492e-abab-4451-acbd-876951b5f6ab tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:27.493842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e80492e-abab-4451-acbd-876951b5f6ab tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:27.495021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e80492e-abab-4451-acbd-876951b5f6ab tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:27.497434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e80492e-abab-4451-acbd-876951b5f6ab tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:27.525606 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2e80492e-abab-4451-acbd-876951b5f6ab tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.342210 Mar 05 20:49:27.526417 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 161/335] 10.222.0.15 () {58 vars in 1175 bytes} [Sat Mar 5 20:49:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:27.531337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5642118b-954e-429c-b6ae-8a66919dac12 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:27.532456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5642118b-954e-429c-b6ae-8a66919dac12 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:27.540532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5642118b-954e-429c-b6ae-8a66919dac12 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:27.541215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5642118b-954e-429c-b6ae-8a66919dac12 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:27.542172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5642118b-954e-429c-b6ae-8a66919dac12 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:27.542826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5642118b-954e-429c-b6ae-8a66919dac12 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:27.566801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-632a2ac7-a60c-4f7e-a803-b2944344c2cb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:27.576060 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-632a2ac7-a60c-4f7e-a803-b2944344c2cb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1316 microversion: 2.1 time: 0.254494 Mar 05 20:49:27.586310 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 175/336] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:27 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:27.591465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-87fc7b19-f8e1-4549-ab0b-913a25cd7a68 req-4b537773-d3ef-4f01-a67b-94cc85840b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f00577b-ab4a-4e3c-b42d-53f30d4a34bd", "name": "network-vif-plugged", "status": "completed", "tag": "641ae876-922a-4e29-be45-f8fac1e96f2e"}, {"server_uuid": "80d89c14-aebf-4565-9719-229a9abd3ebd", "name": "network-vif-plugged", "status": "completed", "tag": "3d09975a-2c78-4565-9441-09dcee0a67e2"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:27.602190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-87fc7b19-f8e1-4549-ab0b-913a25cd7a68 req-4b537773-d3ef-4f01-a67b-94cc85840b07 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:27.602906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-87fc7b19-f8e1-4549-ab0b-913a25cd7a68 req-4b537773-d3ef-4f01-a67b-94cc85840b07 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:27.633536 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-87fc7b19-f8e1-4549-ab0b-913a25cd7a68 req-4b537773-d3ef-4f01-a67b-94cc85840b07 service nova] Creating event network-vif-plugged:641ae876-922a-4e29-be45-f8fac1e96f2e for instance 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd on nch2-master-1 Mar 05 20:49:27.633536 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-87fc7b19-f8e1-4549-ab0b-913a25cd7a68 req-4b537773-d3ef-4f01-a67b-94cc85840b07 service nova] Creating event network-vif-plugged:3d09975a-2c78-4565-9441-09dcee0a67e2 for instance 80d89c14-aebf-4565-9719-229a9abd3ebd on nch2-master-1 Mar 05 20:49:27.641427 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-87fc7b19-f8e1-4549-ab0b-913a25cd7a68 req-4b537773-d3ef-4f01-a67b-94cc85840b07 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053065 Mar 05 20:49:27.641427 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 176/337] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:27.648318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2c24a73a-5eb5-471d-b015-83ae4a2eec66 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1133657744"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:27.649827 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:27.649827 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:27.650896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.aggregate [None req-2c24a73a-5eb5-471d-b015-83ae4a2eec66 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Generated uuid 5e7bf7a1-60c4-4755-88a3-9d41b9abe623 for aggregate {{(pid=141479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:27.703972 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2c24a73a-5eb5-471d-b015-83ae4a2eec66 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060531 Mar 05 20:49:27.706400 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 177/338] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:27.718154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f1e7c48e-94fa-4918-bc81-f44f8186636c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:27.722134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f1e7c48e-94fa-4918-bc81-f44f8186636c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:27.729872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5642118b-954e-429c-b6ae-8a66919dac12 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:27.732108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1e7c48e-94fa-4918-bc81-f44f8186636c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:27.732878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1e7c48e-94fa-4918-bc81-f44f8186636c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:27.733840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1e7c48e-94fa-4918-bc81-f44f8186636c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:27.734395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1e7c48e-94fa-4918-bc81-f44f8186636c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:27.739105 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5642118b-954e-429c-b6ae-8a66919dac12 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1385 microversion: 2.1 time: 0.211404 Mar 05 20:49:27.739935 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 162/339] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:27 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1385 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:27.759484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9d3aa54c-6875-4be7-a674-cb2b996ad644 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:27.765518 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:27.765518 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:27.785957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d3aa54c-6875-4be7-a674-cb2b996ad644 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:27.786729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d3aa54c-6875-4be7-a674-cb2b996ad644 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:27.964472 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9d3aa54c-6875-4be7-a674-cb2b996ad644 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.213084 Mar 05 20:49:27.965553 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 163/340] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 20:49:27 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:27.976537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-db5d83e6-e07b-4c83-9308-9073ecefdb93 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:27.978377 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:27.978377 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:27.986827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db5d83e6-e07b-4c83-9308-9073ecefdb93 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:27.987464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db5d83e6-e07b-4c83-9308-9073ecefdb93 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:28.012881 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-db5d83e6-e07b-4c83-9308-9073ecefdb93 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] HTTP exception thrown: Aggregate 11 already has host nch1-master-1. Mar 05 20:49:28.013990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-db5d83e6-e07b-4c83-9308-9073ecefdb93 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Returning 409 to user: Aggregate 11 already has host nch1-master-1. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:28.015748 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-db5d83e6-e07b-4c83-9308-9073ecefdb93 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.043159 Mar 05 20:49:28.017870 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 164/341] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 20:49:27 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Mar 05 20:49:28.030536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c32b9ec5-0e73-4cce-b4dc-3181e1e6a0cb tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:28.032988 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:28.032988 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:28.044288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c32b9ec5-0e73-4cce-b4dc-3181e1e6a0cb tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:28.045237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c32b9ec5-0e73-4cce-b4dc-3181e1e6a0cb tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:28.048109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f1e7c48e-94fa-4918-bc81-f44f8186636c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:28.057980 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f1e7c48e-94fa-4918-bc81-f44f8186636c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1322 microversion: 2.1 time: 0.349433 Mar 05 20:49:28.059211 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 178/342] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:27 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:28.153554 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c32b9ec5-0e73-4cce-b4dc-3181e1e6a0cb tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.128165 Mar 05 20:49:28.154259 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 165/343] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 20:49:28 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:28.168432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-24e548b9-77e0-4b5a-80eb-f6cbcb874284 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:28.169481 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:28.169481 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:28.196965 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-24e548b9-77e0-4b5a-80eb-f6cbcb874284 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.032527 Mar 05 20:49:28.197952 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 179/344] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:49:28 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:28.200253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c1762fc7-d0b3-46dc-9b98-b090b0937ee6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:28.201997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c1762fc7-d0b3-46dc-9b98-b090b0937ee6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:28.211442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c1762fc7-d0b3-46dc-9b98-b090b0937ee6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:28.211934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c1762fc7-d0b3-46dc-9b98-b090b0937ee6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:28.212964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c1762fc7-d0b3-46dc-9b98-b090b0937ee6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:28.213402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c1762fc7-d0b3-46dc-9b98-b090b0937ee6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:28.215002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a9623c5a-7141-4b79-a323-53f09dae5d08 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1587818301"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:28.217706 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:28.217706 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:28.219737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.aggregate [None req-a9623c5a-7141-4b79-a323-53f09dae5d08 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Generated uuid 6d2aaa8f-fc17-4c1d-9ced-d6124f4cf5bb for aggregate {{(pid=141479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:28.248441 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a9623c5a-7141-4b79-a323-53f09dae5d08 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.042020 Mar 05 20:49:28.250035 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 180/345] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:49:28.421153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c1762fc7-d0b3-46dc-9b98-b090b0937ee6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:28.432902 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c1762fc7-d0b3-46dc-9b98-b090b0937ee6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1313 microversion: 2.1 time: 0.239385 Mar 05 20:49:28.434543 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 166/346] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:28 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:28.448340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-14579fc7-27bc-4682-8348-e17cc8311c88 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:28.449767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-14579fc7-27bc-4682-8348-e17cc8311c88 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:28.458590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14579fc7-27bc-4682-8348-e17cc8311c88 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:28.459376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14579fc7-27bc-4682-8348-e17cc8311c88 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:28.460397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14579fc7-27bc-4682-8348-e17cc8311c88 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:28.461452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14579fc7-27bc-4682-8348-e17cc8311c88 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:28.477379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-84705e2e-85e5-478f-9843-0a2e33f64088 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:28.478955 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:28.478955 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:28.480238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-84705e2e-85e5-478f-9843-0a2e33f64088 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '587688af27be47c3b8e7dcf7d5eb5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b65a4de94b4798b9d9f34e15451b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:28.481165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-84705e2e-85e5-478f-9843-0a2e33f64088 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:28.482285 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-84705e2e-85e5-478f-9843-0a2e33f64088 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] 10.222.0.15 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.225027 Mar 05 20:49:28.483276 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 181/347] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 20:49:28 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 227 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:49:28.494420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-df88f47b-d419-4754-99bd-da247b6e4bf3 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:28.495368 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:28.495368 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:28.527152 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-df88f47b-d419-4754-99bd-da247b6e4bf3 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.038687 Mar 05 20:49:28.528184 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 182/348] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:49:28 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Mar 05 20:49:28.538363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-415c3448-9834-4415-81ba-195eb9258bc6 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-141656044"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:28.539879 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:28.539879 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:28.540931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.aggregate [None req-415c3448-9834-4415-81ba-195eb9258bc6 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Generated uuid 4f410ce5-44e8-4013-84d6-3110d6e1843e for aggregate {{(pid=141479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:28.582162 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-415c3448-9834-4415-81ba-195eb9258bc6 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047762 Mar 05 20:49:28.589774 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 183/349] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:28.594448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ff6ca03-236a-41b9-a35d-3125f66d98f0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:28.595073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ff6ca03-236a-41b9-a35d-3125f66d98f0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:28.612667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ff6ca03-236a-41b9-a35d-3125f66d98f0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:28.616209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ff6ca03-236a-41b9-a35d-3125f66d98f0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:28.617423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ff6ca03-236a-41b9-a35d-3125f66d98f0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:28.617938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ff6ca03-236a-41b9-a35d-3125f66d98f0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:28.683072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-14579fc7-27bc-4682-8348-e17cc8311c88 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:28.692145 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-14579fc7-27bc-4682-8348-e17cc8311c88 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1320 microversion: 2.1 time: 0.255330 Mar 05 20:49:28.693285 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 167/350] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:28 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1320 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:28.700535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c9d9986d-1ac2-4563-9432-0eeca82041aa tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1399050865"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:28.702281 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:28.702281 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:28.713540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c9d9986d-1ac2-4563-9432-0eeca82041aa tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:28.714293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c9d9986d-1ac2-4563-9432-0eeca82041aa tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:28.724502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c9d9986d-1ac2-4563-9432-0eeca82041aa tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:28.725305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c9d9986d-1ac2-4563-9432-0eeca82041aa tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:28.734536 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-c9d9986d-1ac2-4563-9432-0eeca82041aa tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1399050865 could not be found. Mar 05 20:49:28.735446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c9d9986d-1ac2-4563-9432-0eeca82041aa tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1399050865 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:28.736562 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c9d9986d-1ac2-4563-9432-0eeca82041aa tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.042114 Mar 05 20:49:28.737431 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 168/351] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 20:49:28 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:28.746514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a5b2c7c4-da3e-43e0-9e5b-fa7375ffd5a0 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:28.747378 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:28.747378 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:28.778926 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a5b2c7c4-da3e-43e0-9e5b-fa7375ffd5a0 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.036608 Mar 05 20:49:28.781057 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 169/352] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:49:28 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Mar 05 20:49:28.788657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c9fa4bd-3819-475e-8fb2-f53b6223e2d1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:28.790013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c9fa4bd-3819-475e-8fb2-f53b6223e2d1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:28.797836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c9fa4bd-3819-475e-8fb2-f53b6223e2d1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:28.799963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c9fa4bd-3819-475e-8fb2-f53b6223e2d1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:28.801139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c9fa4bd-3819-475e-8fb2-f53b6223e2d1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:28.801668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c9fa4bd-3819-475e-8fb2-f53b6223e2d1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:28.808581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9ff6ca03-236a-41b9-a35d-3125f66d98f0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:28.817971 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ff6ca03-236a-41b9-a35d-3125f66d98f0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1316 microversion: 2.1 time: 0.227093 Mar 05 20:49:28.818756 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 184/353] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:28 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:28.832982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-16c089d5-5d57-4c51-8112-7f903e3c24f6 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:28.835601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-16c089d5-5d57-4c51-8112-7f903e3c24f6 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:28.837541 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-16c089d5-5d57-4c51-8112-7f903e3c24f6 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.016844 Mar 05 20:49:28.838473 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 185/354] 10.222.0.15 () {60 vars in 1164 bytes} [Sat Mar 5 20:49:28 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:49:28.852268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0c90a70e-a222-467b-8142-80dc5b349e65 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:28.854565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0c90a70e-a222-467b-8142-80dc5b349e65 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:28.855705 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0c90a70e-a222-467b-8142-80dc5b349e65 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.010496 Mar 05 20:49:28.856325 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 186/355] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:28 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 05 20:49:28.881525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5dce344a-9b77-4c48-98c6-e2df61d0eac5 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-457621905"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:28.883204 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:28.883204 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:28.884450 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5dce344a-9b77-4c48-98c6-e2df61d0eac5 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '587688af27be47c3b8e7dcf7d5eb5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b65a4de94b4798b9d9f34e15451b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:28.885679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5dce344a-9b77-4c48-98c6-e2df61d0eac5 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:28.886713 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5dce344a-9b77-4c48-98c6-e2df61d0eac5 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.017439 Mar 05 20:49:28.892065 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 187/356] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:28 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:28.901662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ba940b72-e49a-4351-ac97-67ed8e251c6d tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-543174711"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:28.904421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.aggregate [None req-ba940b72-e49a-4351-ac97-67ed8e251c6d tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Generated uuid 0c327545-6750-4c7a-be0e-96791fbd31f0 for aggregate {{(pid=141479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:28.940362 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ba940b72-e49a-4351-ac97-67ed8e251c6d tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046374 Mar 05 20:49:28.948006 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 188/357] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:28.953608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b227ba5a-a3ca-4db6-9e42-8bc32b868ccb tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-543174711"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:28.956207 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:28.956207 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:28.957359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.aggregate [None req-b227ba5a-a3ca-4db6-9e42-8bc32b868ccb tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Generated uuid 25c60feb-faf8-4a4e-ac70-41c564fc9ca8 for aggregate {{(pid=141479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:28.968186 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-b227ba5a-a3ca-4db6-9e42-8bc32b868ccb tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-543174711 already exists. Mar 05 20:49:28.968803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b227ba5a-a3ca-4db6-9e42-8bc32b868ccb tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-543174711 already exists. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:28.970513 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b227ba5a-a3ca-4db6-9e42-8bc32b868ccb tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.019867 Mar 05 20:49:28.976798 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 189/358] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:28 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 27 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:49:28.982326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e061f75a-b7eb-4657-bfa7-07ce32e61c83 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:28.989888 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:28.989888 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:29.037828 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e061f75a-b7eb-4657-bfa7-07ce32e61c83 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.061192 Mar 05 20:49:29.045516 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 190/359] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:49:28 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:29.051425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8c9fa4bd-3819-475e-8fb2-f53b6223e2d1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:29.058406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9200bb60-eb80-407e-b201-20034a96c227 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1985950125"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:29.060791 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8c9fa4bd-3819-475e-8fb2-f53b6223e2d1 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1385 microversion: 2.1 time: 0.278153 Mar 05 20:49:29.061916 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 170/360] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:28 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1385 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:29.063075 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:29.063075 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:29.064872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.aggregate [None req-9200bb60-eb80-407e-b201-20034a96c227 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Generated uuid 6432946e-9231-47e4-abb6-68c63d13fc6c for aggregate {{(pid=141479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:29.074272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1869d053-b262-4fc7-8828-018cd4931d81 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:29.075020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1869d053-b262-4fc7-8828-018cd4931d81 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:29.083439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1869d053-b262-4fc7-8828-018cd4931d81 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:29.084220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1869d053-b262-4fc7-8828-018cd4931d81 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:29.087202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1869d053-b262-4fc7-8828-018cd4931d81 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:29.089063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1869d053-b262-4fc7-8828-018cd4931d81 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:29.109773 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9200bb60-eb80-407e-b201-20034a96c227 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061435 Mar 05 20:49:29.117294 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 191/361] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:29.122874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f3733652-4083-4fa2-8554-2b5397f2de85 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:29.133167 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:29.133167 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:29.136790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f3733652-4083-4fa2-8554-2b5397f2de85 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '587688af27be47c3b8e7dcf7d5eb5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b65a4de94b4798b9d9f34e15451b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:29.138231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f3733652-4083-4fa2-8554-2b5397f2de85 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:29.139330 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f3733652-4083-4fa2-8554-2b5397f2de85 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.020261 Mar 05 20:49:29.141057 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 192/362] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:49:29 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:29.158284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-03ecd206-2d3d-49ac-bc2a-d9a02f1dfdf5 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:29.209741 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-03ecd206-2d3d-49ac-bc2a-d9a02f1dfdf5 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.062231 Mar 05 20:49:29.211921 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 193/363] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:49:29 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:29.227701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b3f4ec9f-1ab9-435b-b8fa-dae1f8e03bb0 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:29.229187 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:29.229187 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:29.254177 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-b3f4ec9f-1ab9-435b-b8fa-dae1f8e03bb0 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Mar 05 20:49:29.254861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b3f4ec9f-1ab9-435b-b8fa-dae1f8e03bb0 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:29.256074 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b3f4ec9f-1ab9-435b-b8fa-dae1f8e03bb0 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.039008 Mar 05 20:49:29.256930 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 194/364] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:49:29 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:49:29.271140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e6465ff0-7d64-4c82-8307-1ce5f846d331 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-107510707"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:29.272771 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:29.272771 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:29.273939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.aggregate [None req-e6465ff0-7d64-4c82-8307-1ce5f846d331 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Generated uuid a122857b-1c4c-45ef-8cbf-77acc32b68a8 for aggregate {{(pid=141479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:29.310752 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e6465ff0-7d64-4c82-8307-1ce5f846d331 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044052 Mar 05 20:49:29.313294 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 195/365] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:29.325447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9561e9e0-2e67-44c2-9f6f-397e230aec7e tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:29.332490 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:29.332490 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:29.333654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9561e9e0-2e67-44c2-9f6f-397e230aec7e tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '587688af27be47c3b8e7dcf7d5eb5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b65a4de94b4798b9d9f34e15451b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:29.336153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9561e9e0-2e67-44c2-9f6f-397e230aec7e tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:29.337105 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9561e9e0-2e67-44c2-9f6f-397e230aec7e tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] 10.222.0.15 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.016220 Mar 05 20:49:29.339603 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 196/366] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:29 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:29.349970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fde77b8d-596a-4b0b-8e0d-8d90426e8864 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:29.355768 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:29.355768 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:29.375363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1869d053-b262-4fc7-8828-018cd4931d81 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:29.386242 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1869d053-b262-4fc7-8828-018cd4931d81 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1322 microversion: 2.1 time: 0.315209 Mar 05 20:49:29.387084 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 171/367] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:29 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:29.408686 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fde77b8d-596a-4b0b-8e0d-8d90426e8864 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.064297 Mar 05 20:49:29.410611 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 197/368] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:49:29 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:29.428145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-66c5eb11-d10f-4c13-9a73-ab0fb1cdc13c tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:29.429906 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:29.429906 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:29.438637 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-66c5eb11-d10f-4c13-9a73-ab0fb1cdc13c tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Mar 05 20:49:29.440037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-66c5eb11-d10f-4c13-9a73-ab0fb1cdc13c tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:29.440981 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-66c5eb11-d10f-4c13-9a73-ab0fb1cdc13c tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.024037 Mar 05 20:49:29.441691 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 172/369] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:49:29 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:49:29.450684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6a52e9f2-f2e9-400d-98fa-539f63877a62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:29.451315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6a52e9f2-f2e9-400d-98fa-539f63877a62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:29.457612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a52e9f2-f2e9-400d-98fa-539f63877a62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:29.458068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a52e9f2-f2e9-400d-98fa-539f63877a62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:29.458842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a52e9f2-f2e9-400d-98fa-539f63877a62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:29.458965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-403ca77f-107f-49a5-b27b-247f4bfa8ffe tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:29.459861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a52e9f2-f2e9-400d-98fa-539f63877a62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:29.460247 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:29.460247 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:29.461514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-403ca77f-107f-49a5-b27b-247f4bfa8ffe tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '587688af27be47c3b8e7dcf7d5eb5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b65a4de94b4798b9d9f34e15451b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:29.462418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-403ca77f-107f-49a5-b27b-247f4bfa8ffe tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:29.463724 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-403ca77f-107f-49a5-b27b-247f4bfa8ffe tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] 10.222.0.15 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010713 Mar 05 20:49:29.470654 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 173/370] 10.222.0.15 () {58 vars in 1142 bytes} [Sat Mar 5 20:49:29 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:29.477117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bdcf7f9a-2f01-4540-b1b1-346b5991abc3 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-179058998"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:29.478728 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:29.478728 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:29.480029 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.aggregate [None req-bdcf7f9a-2f01-4540-b1b1-346b5991abc3 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Generated uuid 45a11824-ff96-4ad7-9d58-26e5b9813add for aggregate {{(pid=141478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:29.515310 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bdcf7f9a-2f01-4540-b1b1-346b5991abc3 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042847 Mar 05 20:49:29.523446 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 174/371] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:29.528665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-971231c7-82b6-4c33-8c6a-5a451153e3a9 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:29.530241 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:29.530241 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:29.540215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-971231c7-82b6-4c33-8c6a-5a451153e3a9 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:29.540763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-971231c7-82b6-4c33-8c6a-5a451153e3a9 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:29.694419 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-971231c7-82b6-4c33-8c6a-5a451153e3a9 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.169499 Mar 05 20:49:29.695070 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 175/372] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 20:49:29 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:29.711531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6a52e9f2-f2e9-400d-98fa-539f63877a62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:29.722171 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6a52e9f2-f2e9-400d-98fa-539f63877a62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1313 microversion: 2.1 time: 0.275656 Mar 05 20:49:29.726143 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 198/373] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:29 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:29.739865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-79845caa-3262-4bfb-8bdc-7c7c824053d4 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:29.746186 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:29.746186 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:29.747138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-79845caa-3262-4bfb-8bdc-7c7c824053d4 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '587688af27be47c3b8e7dcf7d5eb5abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b65a4de94b4798b9d9f34e15451b06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:29.747822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-79845caa-3262-4bfb-8bdc-7c7c824053d4 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:29.748642 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-79845caa-3262-4bfb-8bdc-7c7c824053d4 tempest-AggregatesAdminNegativeTestJSON-460768575 tempest-AggregatesAdminNegativeTestJSON-460768575-project] 10.222.0.15 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.021151 Mar 05 20:49:29.753109 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 199/374] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 20:49:29 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:29.758034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bc0ac57b-8734-4a12-ba12-fa4bd4046092 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:29.764581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bc0ac57b-8734-4a12-ba12-fa4bd4046092 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:29.775957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc0ac57b-8734-4a12-ba12-fa4bd4046092 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:29.786830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc0ac57b-8734-4a12-ba12-fa4bd4046092 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:29.786830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc0ac57b-8734-4a12-ba12-fa4bd4046092 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:29.786830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc0ac57b-8734-4a12-ba12-fa4bd4046092 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:29.988394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bc0ac57b-8734-4a12-ba12-fa4bd4046092 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:29.999291 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bc0ac57b-8734-4a12-ba12-fa4bd4046092 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1320 microversion: 2.1 time: 0.244860 Mar 05 20:49:29.999920 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 200/375] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:29 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1320 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:30.015072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1ccbf660-b2a5-4d30-8569-9c5a34d9faca tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:30.017043 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:30.017043 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:30.027023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ccbf660-b2a5-4d30-8569-9c5a34d9faca tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.027862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ccbf660-b2a5-4d30-8569-9c5a34d9faca tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.153478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dcdbceff-3691-4be6-968e-9ace54532d17 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] Calling method '.version_select at 0x7fed5cfe2550>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:30.154397 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:30.154397 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:30.155952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dcdbceff-3691-4be6-968e-9ace54532d17 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.156871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dcdbceff-3691-4be6-968e-9ace54532d17 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.164661 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1ccbf660-b2a5-4d30-8569-9c5a34d9faca tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.153560 Mar 05 20:49:30.165419 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 201/376] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 20:49:29 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:30.171169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2cb4e368-4306-4a6f-b507-e243d0d95b8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:30.171821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2cb4e368-4306-4a6f-b507-e243d0d95b8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:30.178169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2cb4e368-4306-4a6f-b507-e243d0d95b8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.178629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2cb4e368-4306-4a6f-b507-e243d0d95b8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.179408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2cb4e368-4306-4a6f-b507-e243d0d95b8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.179903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2cb4e368-4306-4a6f-b507-e243d0d95b8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.182782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dcdbceff-3691-4be6-968e-9ace54532d17 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.183396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dcdbceff-3691-4be6-968e-9ace54532d17 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.194430 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dcdbceff-3691-4be6-968e-9ace54532d17 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.195182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dcdbceff-3691-4be6-968e-9ace54532d17 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.201775 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dcdbceff-3691-4be6-968e-9ace54532d17 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.500682 Mar 05 20:49:30.202535 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 176/377] 10.222.0.15 () {60 vars in 1186 bytes} [Sat Mar 5 20:49:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:49:30.208366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9a47410a-172a-4710-b636-f139564fbdde tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:30.209075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9a47410a-172a-4710-b636-f139564fbdde tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:30.215893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a47410a-172a-4710-b636-f139564fbdde tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.216342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a47410a-172a-4710-b636-f139564fbdde tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.217128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a47410a-172a-4710-b636-f139564fbdde tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.217568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a47410a-172a-4710-b636-f139564fbdde tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.334669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2cb4e368-4306-4a6f-b507-e243d0d95b8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:30.342882 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2cb4e368-4306-4a6f-b507-e243d0d95b8b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1465 microversion: 2.1 time: 0.176493 Mar 05 20:49:30.343453 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 202/378] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:30 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1465 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:30.359448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c0d37a25-29b7-4eb8-b519-b0a90ce0ebcc tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:30.360182 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:30.360182 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:30.369716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9a47410a-172a-4710-b636-f139564fbdde tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:30.382012 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c0d37a25-29b7-4eb8-b519-b0a90ce0ebcc tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.037236 Mar 05 20:49:30.382394 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9a47410a-172a-4710-b636-f139564fbdde tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1584 microversion: 2.1 time: 0.178617 Mar 05 20:49:30.382583 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 203/379] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:49:30 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:30.387910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67cdd19c-3ff5-4552-928d-bd4301aeec85 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] Calling method '.version_select at 0x7fed5d0de790>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:30.388703 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:30.388703 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:30.389870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67cdd19c-3ff5-4552-928d-bd4301aeec85 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.390314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67cdd19c-3ff5-4552-928d-bd4301aeec85 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.393856 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 177/380] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:30 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1584 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:30.408896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67cdd19c-3ff5-4552-928d-bd4301aeec85 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.409899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67cdd19c-3ff5-4552-928d-bd4301aeec85 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.416206 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67cdd19c-3ff5-4552-928d-bd4301aeec85 tempest-HypervisorAdminV228Test-1246254108 tempest-HypervisorAdminV228Test-1246254108-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.032495 Mar 05 20:49:30.416796 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 204/381] 10.222.0.15 () {60 vars in 1192 bytes} [Sat Mar 5 20:49:30 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:49:30.421557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ed5b637a-2620-44ca-b678-ce9201d63122 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1081368261"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:30.424894 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:30.424894 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:30.425092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.aggregate [None req-ed5b637a-2620-44ca-b678-ce9201d63122 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Generated uuid 3e9172fd-231e-4286-a0e5-08f5b082c989 for aggregate {{(pid=141479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 20:49:30.449706 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ed5b637a-2620-44ca-b678-ce9201d63122 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.031600 Mar 05 20:49:30.450570 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 205/382] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 20:49:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:30.462677 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c8efbbeb-0f50-4386-b1d6-133d94cdff05 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:30.463172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c8efbbeb-0f50-4386-b1d6-133d94cdff05 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:30.469782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8efbbeb-0f50-4386-b1d6-133d94cdff05 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.470276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8efbbeb-0f50-4386-b1d6-133d94cdff05 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.474904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8efbbeb-0f50-4386-b1d6-133d94cdff05 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.475378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8efbbeb-0f50-4386-b1d6-133d94cdff05 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.568476 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c8efbbeb-0f50-4386-b1d6-133d94cdff05 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110126 Mar 05 20:49:30.569618 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 206/383] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 20:49:30 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:30.578066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ee54d927-8aed-41a9-8646-5624596d7b63 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:30.578962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ee54d927-8aed-41a9-8646-5624596d7b63 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:30.586198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f8f48377-c13c-4bf4-9488-deb7619946be tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:30.586818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f8f48377-c13c-4bf4-9488-deb7619946be tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:30.599043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8f48377-c13c-4bf4-9488-deb7619946be tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.599609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8f48377-c13c-4bf4-9488-deb7619946be tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.600326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8f48377-c13c-4bf4-9488-deb7619946be tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.600767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8f48377-c13c-4bf4-9488-deb7619946be tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.603890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee54d927-8aed-41a9-8646-5624596d7b63 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.604479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee54d927-8aed-41a9-8646-5624596d7b63 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.608160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee54d927-8aed-41a9-8646-5624596d7b63 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.608655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee54d927-8aed-41a9-8646-5624596d7b63 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.806450 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ee54d927-8aed-41a9-8646-5624596d7b63 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:30.824457 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ee54d927-8aed-41a9-8646-5624596d7b63 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1322 microversion: 2.1 time: 0.241690 Mar 05 20:49:30.825370 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 207/384] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:30 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:30.839170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a761c54c-60b1-408e-9c78-3465706b856f tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:30.840533 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:30.840533 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:30.849389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a761c54c-60b1-408e-9c78-3465706b856f tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.849767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a761c54c-60b1-408e-9c78-3465706b856f tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.859353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a761c54c-60b1-408e-9c78-3465706b856f tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.860002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a761c54c-60b1-408e-9c78-3465706b856f tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.878808 ncdv-master-1 devstack@n-api.service[141479]: ERROR nova.api.openstack.compute.aggregates [None req-a761c54c-60b1-408e-9c78-3465706b856f tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Mar 05 20:49:30.879692 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-a761c54c-60b1-408e-9c78-3465706b856f tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Mar 05 20:49:30.880310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a761c54c-60b1-408e-9c78-3465706b856f tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:30.881231 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a761c54c-60b1-408e-9c78-3465706b856f tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.046036 Mar 05 20:49:30.885359 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 208/385] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 20:49:30 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:49:30.897835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d841b391-5d0f-43d3-93d6-31c14cb9c989 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:30.898471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d841b391-5d0f-43d3-93d6-31c14cb9c989 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:30.914210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d841b391-5d0f-43d3-93d6-31c14cb9c989 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.914678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d841b391-5d0f-43d3-93d6-31c14cb9c989 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:30.915496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d841b391-5d0f-43d3-93d6-31c14cb9c989 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:30.915982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d841b391-5d0f-43d3-93d6-31c14cb9c989 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:31.206632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d841b391-5d0f-43d3-93d6-31c14cb9c989 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:31.218306 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d841b391-5d0f-43d3-93d6-31c14cb9c989 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1313 microversion: 2.1 time: 0.331685 Mar 05 20:49:31.229193 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 209/386] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:30 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:31.234052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-155aec1f-53e3-4894-a410-8678f6eeb049 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:31.235073 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:31.235073 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:31.261601 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-155aec1f-53e3-4894-a410-8678f6eeb049 tempest-AggregatesAdminNegativeTestJSON-1284186763 tempest-AggregatesAdminNegativeTestJSON-1284186763-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.030973 Mar 05 20:49:31.268466 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 210/387] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:49:31 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 20:49:31.514566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-492085772", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:31.603044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:31.758439 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f8f48377-c13c-4bf4-9488-deb7619946be tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1616 microversion: 2.1 time: 1.363269 Mar 05 20:49:31.761582 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 178/388] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:30 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1616 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:31.778935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-815c6886-7764-4f5f-a54c-dcd1da45ce7f tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:31.786100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-815c6886-7764-4f5f-a54c-dcd1da45ce7f tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:31.815751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-815c6886-7764-4f5f-a54c-dcd1da45ce7f tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:31.816479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-815c6886-7764-4f5f-a54c-dcd1da45ce7f tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:31.817453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-815c6886-7764-4f5f-a54c-dcd1da45ce7f tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:31.825242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-815c6886-7764-4f5f-a54c-dcd1da45ce7f tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:32.094851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:32.096841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:32.097720 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:32.098256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:32.098730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:32.110297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:32.110844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:32.112434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:32.113094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:32.130159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-815c6886-7764-4f5f-a54c-dcd1da45ce7f tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:32.133265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Getting quotas for project 3501f5d56344468ebc4d50db1a5c5bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:32.137918 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-815c6886-7764-4f5f-a54c-dcd1da45ce7f tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1320 microversion: 2.1 time: 0.362782 Mar 05 20:49:32.138198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Getting quotas for user 52cc30e265f94e3caa91b6adff365209 and project 3501f5d56344468ebc4d50db1a5c5bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:32.148231 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 179/389] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:31 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:32.153132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:49:32.153575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-6fda4954-bd57-4bfa-91d4-96fe77ee8c63 req-1224e2c9-079d-453d-aa9d-9d31f560966a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c1af88-614e-45b4-a82b-5e8b1eb60180", "name": "network-vif-plugged", "status": "completed", "tag": "a3db8299-9220-413a-b709-391f3fa944d7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:32.156041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:32.162669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6fda4954-bd57-4bfa-91d4-96fe77ee8c63 req-1224e2c9-079d-453d-aa9d-9d31f560966a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:32.163304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6fda4954-bd57-4bfa-91d4-96fe77ee8c63 req-1224e2c9-079d-453d-aa9d-9d31f560966a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:32.175732 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-6fda4954-bd57-4bfa-91d4-96fe77ee8c63 req-1224e2c9-079d-453d-aa9d-9d31f560966a service nova] Creating event network-vif-plugged:a3db8299-9220-413a-b709-391f3fa944d7 for instance 42c1af88-614e-45b4-a82b-5e8b1eb60180 on nch1-master-1 Mar 05 20:49:32.181534 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-6fda4954-bd57-4bfa-91d4-96fe77ee8c63 req-1224e2c9-079d-453d-aa9d-9d31f560966a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031741 Mar 05 20:49:32.182585 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 180/390] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:32.192941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-91d83b75-f074-4888-88c5-69a6b286cf69 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Action: 'create', calling method: .version_select at 0x7fed5cfe2430>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1887014435", "policies": ["affinity"]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:32.212242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-91d83b75-f074-4888-88c5-69a6b286cf69 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_groups'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:32.217867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-91d83b75-f074-4888-88c5-69a6b286cf69 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_groups'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:32.234974 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-206a3d83-e840-44eb-8772-06ab863a1d0e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.965236 Mar 05 20:49:32.241947 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 211/391] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:49:32.247719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91d8cc7b-4411-4253-aa1d-2b2d8f89db21 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:32.248359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91d8cc7b-4411-4253-aa1d-2b2d8f89db21 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:32.262028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91d8cc7b-4411-4253-aa1d-2b2d8f89db21 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:32.262486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91d8cc7b-4411-4253-aa1d-2b2d8f89db21 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:32.266042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91d8cc7b-4411-4253-aa1d-2b2d8f89db21 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:32.266502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91d8cc7b-4411-4253-aa1d-2b2d8f89db21 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:32.308019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-91d83b75-f074-4888-88c5-69a6b286cf69 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_groups'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:32.312899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-91d83b75-f074-4888-88c5-69a6b286cf69 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_groups'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:32.335043 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-91d83b75-f074-4888-88c5-69a6b286cf69 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.145787 Mar 05 20:49:32.336303 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 181/392] 10.222.0.15 () {60 vars in 1173 bytes} [Sat Mar 5 20:49:32 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:32.355520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ac41d4ac-40ff-4e88-ac88-123b2456bd59 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:32.356719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ac41d4ac-40ff-4e88-ac88-123b2456bd59 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:32.363977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac41d4ac-40ff-4e88-ac88-123b2456bd59 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:32.364687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac41d4ac-40ff-4e88-ac88-123b2456bd59 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:32.365884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac41d4ac-40ff-4e88-ac88-123b2456bd59 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:32.366782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac41d4ac-40ff-4e88-ac88-123b2456bd59 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:32.675492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ac41d4ac-40ff-4e88-ac88-123b2456bd59 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:32.683089 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ac41d4ac-40ff-4e88-ac88-123b2456bd59 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1313 microversion: 2.1 time: 0.331622 Mar 05 20:49:32.683900 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 182/393] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:32 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:32.695537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b8ffa978-80c9-4d45-b37a-80e7782c740c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:32.699370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b8ffa978-80c9-4d45-b37a-80e7782c740c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:32.792300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-91d8cc7b-4411-4253-aa1d-2b2d8f89db21 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:32.809412 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91d8cc7b-4411-4253-aa1d-2b2d8f89db21 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1322 microversion: 2.1 time: 0.559596 Mar 05 20:49:32.812939 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 212/394] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:32 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:32.823553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1721301526", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "61eb2945-c0e1-4883-981b-181a2824a316"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:32.843023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b8ffa978-80c9-4d45-b37a-80e7782c740c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:32.857128 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b8ffa978-80c9-4d45-b37a-80e7782c740c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1212 microversion: 2.1 time: 0.167283 Mar 05 20:49:32.858708 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 183/395] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:32 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1212 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:32.959807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:33.033266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6c6c9a7-d5c1-4b0f-b515-4c9d4d328323 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:33.033913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c6c6c9a7-d5c1-4b0f-b515-4c9d4d328323 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:33.043269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6c6c9a7-d5c1-4b0f-b515-4c9d4d328323 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:33.046493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6c6c9a7-d5c1-4b0f-b515-4c9d4d328323 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:33.047529 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6c6c9a7-d5c1-4b0f-b515-4c9d4d328323 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:33.050100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6c6c9a7-d5c1-4b0f-b515-4c9d4d328323 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:33.270824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c6c6c9a7-d5c1-4b0f-b515-4c9d4d328323 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:33.280207 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c6c6c9a7-d5c1-4b0f-b515-4c9d4d328323 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 200 len: 1584 microversion: 2.1 time: 0.251653 Mar 05 20:49:33.280877 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 184/396] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:33 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 1584 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:33.303393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-2fe39541-02b9-4a61-af9e-09d21c1daffd req-06effa47-99e9-4216-9875-3a2a64af4605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d89c14-aebf-4565-9719-229a9abd3ebd", "tag": "3d09975a-2c78-4565-9441-09dcee0a67e2"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:33.320740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-2fe39541-02b9-4a61-af9e-09d21c1daffd req-06effa47-99e9-4216-9875-3a2a64af4605 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:33.321183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-2fe39541-02b9-4a61-af9e-09d21c1daffd req-06effa47-99e9-4216-9875-3a2a64af4605 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:33.337214 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-2fe39541-02b9-4a61-af9e-09d21c1daffd req-06effa47-99e9-4216-9875-3a2a64af4605 service nova] Creating event network-changed:3d09975a-2c78-4565-9441-09dcee0a67e2 for instance 80d89c14-aebf-4565-9719-229a9abd3ebd on nch2-master-1 Mar 05 20:49:33.346746 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-2fe39541-02b9-4a61-af9e-09d21c1daffd req-06effa47-99e9-4216-9875-3a2a64af4605 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062583 Mar 05 20:49:33.348180 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 185/397] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:33.374528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1509269a-b7a3-49a2-98a6-f3036451d8cb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:33.376532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1509269a-b7a3-49a2-98a6-f3036451d8cb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:33.386600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1509269a-b7a3-49a2-98a6-f3036451d8cb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:33.387515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1509269a-b7a3-49a2-98a6-f3036451d8cb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:33.388760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1509269a-b7a3-49a2-98a6-f3036451d8cb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:33.389428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1509269a-b7a3-49a2-98a6-f3036451d8cb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:33.482844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:33.483949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:33.484620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:33.485198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:33.485769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:33.552626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:33.553470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:33.554896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:33.556738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:33.584051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:33.605878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:33.624461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Going to run 2 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:49:33.628440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: d13582ed-3ac6-46fe-9e71-a3af018d2402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:33.675843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=141479) is_qfd_populated /opt/stack/nova/nova/quota.py:1248}} Mar 05 20:49:33.700337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:33.706349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:33.758934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1509269a-b7a3-49a2-98a6-f3036451d8cb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:33.768816 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1509269a-b7a3-49a2-98a6-f3036451d8cb tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1320 microversion: 2.1 time: 0.419100 Mar 05 20:49:33.782354 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 186/398] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:33 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1320 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:33.794654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e15b0854-33c2-46d2-a28e-c4c9ebfaed08 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:33.795287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e15b0854-33c2-46d2-a28e-c4c9ebfaed08 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:33.810141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e15b0854-33c2-46d2-a28e-c4c9ebfaed08 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:33.811181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e15b0854-33c2-46d2-a28e-c4c9ebfaed08 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:33.812027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e15b0854-33c2-46d2-a28e-c4c9ebfaed08 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:33.812467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e15b0854-33c2-46d2-a28e-c4c9ebfaed08 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:33.823550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:33.839241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:33.860026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=d13582ed-3ac6-46fe-9e71-a3af018d2402,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:33.948493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:33.953368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:34.029824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:34.035791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:34.093645 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bce84d0c-f90d-49d6-84a9-1f5ebac07f32 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.278306 Mar 05 20:49:34.093645 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 213/399] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:32 2022] POST /compute/v2.1/servers => generated 32 bytes in 1280 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Mar 05 20:49:34.099442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c46b332e-560d-4295-97c4-34b22c5c1f88 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:34.100265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c46b332e-560d-4295-97c4-34b22c5c1f88 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:34.107336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c46b332e-560d-4295-97c4-34b22c5c1f88 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:34.108089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c46b332e-560d-4295-97c4-34b22c5c1f88 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:34.109166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c46b332e-560d-4295-97c4-34b22c5c1f88 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:34.109815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c46b332e-560d-4295-97c4-34b22c5c1f88 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:34.189688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e15b0854-33c2-46d2-a28e-c4c9ebfaed08 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:34.203759 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e15b0854-33c2-46d2-a28e-c4c9ebfaed08 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1313 microversion: 2.1 time: 0.420500 Mar 05 20:49:34.206830 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 187/400] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:33 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:34.229136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0fc84a7c-e0b0-4caa-9adb-32a0f1fb6f60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:34.229777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0fc84a7c-e0b0-4caa-9adb-32a0f1fb6f60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:34.242031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fc84a7c-e0b0-4caa-9adb-32a0f1fb6f60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:34.242487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fc84a7c-e0b0-4caa-9adb-32a0f1fb6f60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:34.243269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fc84a7c-e0b0-4caa-9adb-32a0f1fb6f60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:34.243786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fc84a7c-e0b0-4caa-9adb-32a0f1fb6f60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:34.334936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0fc84a7c-e0b0-4caa-9adb-32a0f1fb6f60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:34.342211 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0fc84a7c-e0b0-4caa-9adb-32a0f1fb6f60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1270 microversion: 2.1 time: 0.119697 Mar 05 20:49:34.342783 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 188/401] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:34 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:34.372580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7a1e7ea7-6861-47a0-a04d-31345958377c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:34.386967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7a1e7ea7-6861-47a0-a04d-31345958377c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:34.390939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7a1e7ea7-6861-47a0-a04d-31345958377c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Searching by: {'deleted': False, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:49:34.452728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a1e7ea7-6861-47a0-a04d-31345958377c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:34.453143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a1e7ea7-6861-47a0-a04d-31345958377c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:34.454011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a1e7ea7-6861-47a0-a04d-31345958377c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:34.454540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a1e7ea7-6861-47a0-a04d-31345958377c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:34.655642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-7a1e7ea7-6861-47a0-a04d-31345958377c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:49:34.819397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c46b332e-560d-4295-97c4-34b22c5c1f88 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:34.837147 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c46b332e-560d-4295-97c4-34b22c5c1f88 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1322 microversion: 2.1 time: 0.740093 Mar 05 20:49:34.838384 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 214/402] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:34 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1322 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:34.868142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-dec7ac1f-3f83-4179-8b6f-22d117ea3162 req-97ac2655-87dd-4514-9abf-465ed2d5d46f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e68fe7-4232-4918-aa20-4dda276362ed", "name": "network-vif-plugged", "status": "completed", "tag": "11733f46-438a-4683-b8ae-9561dfb31a38"}, {"server_uuid": "d96e01cc-e3b1-464e-8032-9e86fcb22824", "name": "network-vif-plugged", "status": "completed", "tag": "f2a014b4-b464-4203-8c89-db1d813f0118"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:34.880210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-dec7ac1f-3f83-4179-8b6f-22d117ea3162 req-97ac2655-87dd-4514-9abf-465ed2d5d46f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:34.881104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-dec7ac1f-3f83-4179-8b6f-22d117ea3162 req-97ac2655-87dd-4514-9abf-465ed2d5d46f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:34.912272 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-dec7ac1f-3f83-4179-8b6f-22d117ea3162 req-97ac2655-87dd-4514-9abf-465ed2d5d46f service nova] Creating event network-vif-plugged:11733f46-438a-4683-b8ae-9561dfb31a38 for instance 97e68fe7-4232-4918-aa20-4dda276362ed on nch2-master-1 Mar 05 20:49:34.917295 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-dec7ac1f-3f83-4179-8b6f-22d117ea3162 req-97ac2655-87dd-4514-9abf-465ed2d5d46f service nova] Creating event network-vif-plugged:f2a014b4-b464-4203-8c89-db1d813f0118 for instance d96e01cc-e3b1-464e-8032-9e86fcb22824 on nch1-master-1 Mar 05 20:49:34.945505 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-dec7ac1f-3f83-4179-8b6f-22d117ea3162 req-97ac2655-87dd-4514-9abf-465ed2d5d46f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091983 Mar 05 20:49:34.953143 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 215/403] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:34.966937 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7a1e7ea7-6861-47a0-a04d-31345958377c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.612562 Mar 05 20:49:34.977384 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 189/404] 10.222.0.15 () {58 vars in 1124 bytes} [Sat Mar 5 20:49:34 2022] GET /compute/v2.1/servers => generated 1003 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:34.979793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cd259609-b0b5-49c9-be54-c04891ca6e8d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:34.983354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cd259609-b0b5-49c9-be54-c04891ca6e8d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:34.992862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f59804c8-a04f-4d14-ac2d-e57f0138c16f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:34.994063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f59804c8-a04f-4d14-ac2d-e57f0138c16f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:35.003441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd259609-b0b5-49c9-be54-c04891ca6e8d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:35.008790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd259609-b0b5-49c9-be54-c04891ca6e8d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:35.015297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd259609-b0b5-49c9-be54-c04891ca6e8d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:35.020024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd259609-b0b5-49c9-be54-c04891ca6e8d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:35.160775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f59804c8-a04f-4d14-ac2d-e57f0138c16f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:35.171962 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f59804c8-a04f-4d14-ac2d-e57f0138c16f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1219 microversion: 2.1 time: 0.189624 Mar 05 20:49:35.172984 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 190/405] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:34 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1219 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:35.225930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0d4e0c72-8239-46c0-9fa1-222c6c5e78a4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:35.227420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0d4e0c72-8239-46c0-9fa1-222c6c5e78a4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:35.235534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d4e0c72-8239-46c0-9fa1-222c6c5e78a4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:35.237470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d4e0c72-8239-46c0-9fa1-222c6c5e78a4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:35.238295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d4e0c72-8239-46c0-9fa1-222c6c5e78a4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:35.240464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d4e0c72-8239-46c0-9fa1-222c6c5e78a4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:35.539312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0d4e0c72-8239-46c0-9fa1-222c6c5e78a4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:35.553750 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0d4e0c72-8239-46c0-9fa1-222c6c5e78a4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1463 microversion: 2.1 time: 0.332355 Mar 05 20:49:35.554341 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 191/406] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:35 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1463 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:35.559020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-19ef8fe6-d963-4f60-a80f-a05de528ccbd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:35.560206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-19ef8fe6-d963-4f60-a80f-a05de528ccbd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:35.575899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19ef8fe6-d963-4f60-a80f-a05de528ccbd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:35.576359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19ef8fe6-d963-4f60-a80f-a05de528ccbd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:35.577151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19ef8fe6-d963-4f60-a80f-a05de528ccbd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:35.577598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19ef8fe6-d963-4f60-a80f-a05de528ccbd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:35.661156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cd259609-b0b5-49c9-be54-c04891ca6e8d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:35.670113 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cd259609-b0b5-49c9-be54-c04891ca6e8d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1320 microversion: 2.1 time: 0.714019 Mar 05 20:49:35.672378 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 216/407] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:34 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1320 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:35.685103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-211f61d0-7d4a-4b32-bbe6-d2c5725e2d7d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:35.688129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-211f61d0-7d4a-4b32-bbe6-d2c5725e2d7d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:35.694750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-19ef8fe6-d963-4f60-a80f-a05de528ccbd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:35.703387 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-19ef8fe6-d963-4f60-a80f-a05de528ccbd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1270 microversion: 2.1 time: 0.147742 Mar 05 20:49:35.703817 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 192/408] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:35 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:35.707096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-211f61d0-7d4a-4b32-bbe6-d2c5725e2d7d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:35.707408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-211f61d0-7d4a-4b32-bbe6-d2c5725e2d7d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:35.708391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-211f61d0-7d4a-4b32-bbe6-d2c5725e2d7d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:35.708839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-211f61d0-7d4a-4b32-bbe6-d2c5725e2d7d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:35.856053 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d0d6c329-e9dc-4d57-9cdd-9eb43e77e8fd tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:35.856668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d0d6c329-e9dc-4d57-9cdd-9eb43e77e8fd tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:35.866338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d0d6c329-e9dc-4d57-9cdd-9eb43e77e8fd tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:35.867282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d0d6c329-e9dc-4d57-9cdd-9eb43e77e8fd tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:35.867575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d0d6c329-e9dc-4d57-9cdd-9eb43e77e8fd tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:35.868038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d0d6c329-e9dc-4d57-9cdd-9eb43e77e8fd tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:36.073346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d0d6c329-e9dc-4d57-9cdd-9eb43e77e8fd tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:36.082277 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d0d6c329-e9dc-4d57-9cdd-9eb43e77e8fd tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1322 microversion: 2.1 time: 0.230347 Mar 05 20:49:36.083541 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 193/409] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:35 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:36.097009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-211f61d0-7d4a-4b32-bbe6-d2c5725e2d7d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:36.109240 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-211f61d0-7d4a-4b32-bbe6-d2c5725e2d7d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1463 microversion: 2.1 time: 0.434316 Mar 05 20:49:36.110119 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 217/410] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:35 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1463 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:36.189690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-44dd8353-07d8-477f-a4ae-2099bc6b09df tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:36.190563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-44dd8353-07d8-477f-a4ae-2099bc6b09df tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:36.198115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44dd8353-07d8-477f-a4ae-2099bc6b09df tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:36.198793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44dd8353-07d8-477f-a4ae-2099bc6b09df tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:36.201008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44dd8353-07d8-477f-a4ae-2099bc6b09df tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:36.201793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44dd8353-07d8-477f-a4ae-2099bc6b09df tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:36.255121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1292336727", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d196df64-5f99-4c5a-b30b-92751e6f7702"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:36.341622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-44dd8353-07d8-477f-a4ae-2099bc6b09df tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:36.350624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:36.359830 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-44dd8353-07d8-477f-a4ae-2099bc6b09df tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1271 microversion: 2.1 time: 0.174433 Mar 05 20:49:36.361047 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 194/411] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:36 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:37.044672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f06e3f68-88ff-4d41-96b0-1e2e99817373 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Action: 'create', calling method: .version_select at 0x7fed5cf0e700>, body: {"keypair": {"name": "tempest-keypair-1467855376", "type": "ssh", "user_id": "7abe4834dcdc41d7a5bc554f92b35bea"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:37.059556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f06e3f68-88ff-4d41-96b0-1e2e99817373 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Getting quotas for project 9cb2f2fde8d14659b7fdc1c4f6650f8e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:37.065096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f06e3f68-88ff-4d41-96b0-1e2e99817373 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Getting quotas for user 4cf74efbd12d4730a93abf6cfd3ab0c8 and project 9cb2f2fde8d14659b7fdc1c4f6650f8e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:37.323876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:37.325101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:37.325791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:37.326838 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:37.327456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:37.341708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:37.343055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:37.346910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:37.347602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:37.367001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Getting quotas for project f138bfc479e24b3d9017a7cb9e73bdd2. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:37.371804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Getting quotas for user 38c78359372d4628b29d5c5456d61d50 and project f138bfc479e24b3d9017a7cb9e73bdd2. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:37.384000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:49:37.386643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:37.446710 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c121c5b5-b486-4cb4-a33e-27d4d205c199 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.195832 Mar 05 20:49:37.448530 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 218/412] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:49:37.456154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cee814f0-52d2-4d10-ac88-0069c450aea8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:37.457603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cee814f0-52d2-4d10-ac88-0069c450aea8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:37.467985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cee814f0-52d2-4d10-ac88-0069c450aea8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:37.468834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cee814f0-52d2-4d10-ac88-0069c450aea8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:37.470223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cee814f0-52d2-4d10-ac88-0069c450aea8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:37.470930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cee814f0-52d2-4d10-ac88-0069c450aea8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:37.598716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f06e3f68-88ff-4d41-96b0-1e2e99817373 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Getting quotas for project 9cb2f2fde8d14659b7fdc1c4f6650f8e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:37.604481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f06e3f68-88ff-4d41-96b0-1e2e99817373 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Getting quotas for user 4cf74efbd12d4730a93abf6cfd3ab0c8 and project 9cb2f2fde8d14659b7fdc1c4f6650f8e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:37.623782 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f06e3f68-88ff-4d41-96b0-1e2e99817373 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.10 time: 1.112455 Mar 05 20:49:37.624351 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 195/413] 10.222.0.15 () {62 vars in 1199 bytes} [Sat Mar 5 20:49:36 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1114 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:49:37.630621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-73e37d93-802d-4d5d-bc40-f6de1392d284 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:37.631722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-73e37d93-802d-4d5d-bc40-f6de1392d284 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:37.637963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-73e37d93-802d-4d5d-bc40-f6de1392d284 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:37.638473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-73e37d93-802d-4d5d-bc40-f6de1392d284 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:37.639265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-73e37d93-802d-4d5d-bc40-f6de1392d284 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:37.639797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-73e37d93-802d-4d5d-bc40-f6de1392d284 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:37.781824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cee814f0-52d2-4d10-ac88-0069c450aea8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:37.796900 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cee814f0-52d2-4d10-ac88-0069c450aea8 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1469 microversion: 2.1 time: 0.346407 Mar 05 20:49:37.807719 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 219/414] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:37 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1469 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:37.807719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-09103244-0ca1-44ad-8322-2c64a470f072 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:37.807719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-09103244-0ca1-44ad-8322-2c64a470f072 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:37.825912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09103244-0ca1-44ad-8322-2c64a470f072 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:37.826394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09103244-0ca1-44ad-8322-2c64a470f072 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:37.827367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09103244-0ca1-44ad-8322-2c64a470f072 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:37.828113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09103244-0ca1-44ad-8322-2c64a470f072 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:37.978199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-73e37d93-802d-4d5d-bc40-f6de1392d284 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:37.990753 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-73e37d93-802d-4d5d-bc40-f6de1392d284 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1312 microversion: 2.1 time: 0.365334 Mar 05 20:49:37.992620 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 196/415] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:37 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1312 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:38.008598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f713da88-e47d-4625-9848-e97e7e59a17e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:38.009240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f713da88-e47d-4625-9848-e97e7e59a17e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:38.020143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f713da88-e47d-4625-9848-e97e7e59a17e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:38.020943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f713da88-e47d-4625-9848-e97e7e59a17e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:38.021982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f713da88-e47d-4625-9848-e97e7e59a17e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:38.022852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f713da88-e47d-4625-9848-e97e7e59a17e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:38.094030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-09103244-0ca1-44ad-8322-2c64a470f072 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:38.102789 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-09103244-0ca1-44ad-8322-2c64a470f072 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1471 microversion: 2.1 time: 0.303348 Mar 05 20:49:38.103944 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 220/416] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:37 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1471 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:38.108588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b076955e-5564-44ba-ae39-5fc6784d672e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:38.109424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b076955e-5564-44ba-ae39-5fc6784d672e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:38.117288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b076955e-5564-44ba-ae39-5fc6784d672e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:38.118041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b076955e-5564-44ba-ae39-5fc6784d672e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:38.119093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b076955e-5564-44ba-ae39-5fc6784d672e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:38.119812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b076955e-5564-44ba-ae39-5fc6784d672e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:38.141211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f713da88-e47d-4625-9848-e97e7e59a17e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:38.151567 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f713da88-e47d-4625-9848-e97e7e59a17e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1277 microversion: 2.1 time: 0.153435 Mar 05 20:49:38.153827 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 197/417] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:37 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:38.286499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b076955e-5564-44ba-ae39-5fc6784d672e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:38.306906 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b076955e-5564-44ba-ae39-5fc6784d672e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 200 len: 1210 microversion: 2.1 time: 0.201676 Mar 05 20:49:38.309622 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 221/418] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:38 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 1210 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:38.326003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d5cf529a-a24b-437d-b899-edbbcb9c80e9 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Action: 'create', calling method: .version_select at 0x7fed5cfb3dc0>, body: {"keypair": {"name": "tempest-keypair-1376892319", "type": "ssh", "user_id": "7abe4834dcdc41d7a5bc554f92b35bea"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:38.380738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d5cf529a-a24b-437d-b899-edbbcb9c80e9 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Getting quotas for project 9cb2f2fde8d14659b7fdc1c4f6650f8e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:38.390613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d5cf529a-a24b-437d-b899-edbbcb9c80e9 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Getting quotas for user 4cf74efbd12d4730a93abf6cfd3ab0c8 and project 9cb2f2fde8d14659b7fdc1c4f6650f8e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:38.475933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eb3d4546-7943-419e-b776-06f831dd843e tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-875308944", "id": 103204372, "os-flavor-access:is_public": "False"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:38.478420 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:38.478420 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:38.521160 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eb3d4546-7943-419e-b776-06f831dd843e tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.366262 Mar 05 20:49:38.522161 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 198/419] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:38 2022] POST /compute/v2.1/flavors => generated 435 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:38.534815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fdfe6756-b1c9-4fdd-8998-20622de7f8da tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:38.536220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fdfe6756-b1c9-4fdd-8998-20622de7f8da tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:38.543084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdfe6756-b1c9-4fdd-8998-20622de7f8da tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:38.543871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdfe6756-b1c9-4fdd-8998-20622de7f8da tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:38.560585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdfe6756-b1c9-4fdd-8998-20622de7f8da tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:38.565350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdfe6756-b1c9-4fdd-8998-20622de7f8da tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:38.707215 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fdfe6756-b1c9-4fdd-8998-20622de7f8da tempest-DeleteServersAdminTestJSON-137981646 tempest-DeleteServersAdminTestJSON-137981646-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824/action" status: 202 len: 0 microversion: 2.1 time: 0.177034 Mar 05 20:49:38.712436 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 199/420] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:49:38 2022] POST /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:49:38.749217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d5cf529a-a24b-437d-b899-edbbcb9c80e9 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Getting quotas for project 9cb2f2fde8d14659b7fdc1c4f6650f8e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:38.759659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d5cf529a-a24b-437d-b899-edbbcb9c80e9 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Getting quotas for user 4cf74efbd12d4730a93abf6cfd3ab0c8 and project 9cb2f2fde8d14659b7fdc1c4f6650f8e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:38.793499 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d5cf529a-a24b-437d-b899-edbbcb9c80e9 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.10 time: 0.482174 Mar 05 20:49:38.799096 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 222/421] 10.222.0.15 () {62 vars in 1199 bytes} [Sat Mar 5 20:49:38 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 488 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:49:38.811653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-fb06c1eb-d3f8-47ee-a202-f3de4e6a0dfe req-a01befce-3e73-4f86-b162-956883417f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3261ac3a-9665-44b0-965d-06ac66c07d82", "tag": "de504aa3-bfc4-44ec-a4bc-0df77d0e7550"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:38.832630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fb06c1eb-d3f8-47ee-a202-f3de4e6a0dfe req-a01befce-3e73-4f86-b162-956883417f65 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:38.833348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fb06c1eb-d3f8-47ee-a202-f3de4e6a0dfe req-a01befce-3e73-4f86-b162-956883417f65 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:38.852227 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-fb06c1eb-d3f8-47ee-a202-f3de4e6a0dfe req-a01befce-3e73-4f86-b162-956883417f65 service nova] Creating event network-changed:de504aa3-bfc4-44ec-a4bc-0df77d0e7550 for instance 3261ac3a-9665-44b0-965d-06ac66c07d82 on nch1-master-1 Mar 05 20:49:38.857260 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-fb06c1eb-d3f8-47ee-a202-f3de4e6a0dfe req-a01befce-3e73-4f86-b162-956883417f65 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056775 Mar 05 20:49:38.858040 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 223/422] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:38.864036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b64052bb-3dad-40dc-974f-9fe764e1a27b tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6b3ca5296cbb409b877cbd196f489b04"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:38.865585 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:38.865585 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:38.973217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4e100b13-9ee6-4922-a611-607fd7f0b807 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:38.974139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4e100b13-9ee6-4922-a611-607fd7f0b807 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] [instance: 7dc229fa-869f-44d0-a10a-f002ca220824] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:38.983947 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4e100b13-9ee6-4922-a611-607fd7f0b807 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] HTTP exception thrown: Instance 7dc229fa-869f-44d0-a10a-f002ca220824 could not be found. Mar 05 20:49:38.984763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4e100b13-9ee6-4922-a611-607fd7f0b807 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Returning 404 to user: Instance 7dc229fa-869f-44d0-a10a-f002ca220824 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:38.985530 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4e100b13-9ee6-4922-a611-607fd7f0b807 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/7dc229fa-869f-44d0-a10a-f002ca220824/action" status: 404 len: 111 microversion: 2.1 time: 0.271975 Mar 05 20:49:38.987123 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 200/423] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:49:38 2022] POST /compute/v2.1/servers/7dc229fa-869f-44d0-a10a-f002ca220824/action => generated 111 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:39.006072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-22ff00d9-69d4-410d-b789-f39588e6035e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:39.006696 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-22ff00d9-69d4-410d-b789-f39588e6035e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:39.029271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22ff00d9-69d4-410d-b789-f39588e6035e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:39.029757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22ff00d9-69d4-410d-b789-f39588e6035e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:39.031044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22ff00d9-69d4-410d-b789-f39588e6035e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:39.031840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22ff00d9-69d4-410d-b789-f39588e6035e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:39.071902 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b64052bb-3dad-40dc-974f-9fe764e1a27b tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/103204372/action" status: 200 len: 96 microversion: 2.1 time: 0.212680 Mar 05 20:49:39.076803 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 224/424] 10.222.0.15 () {60 vars in 1196 bytes} [Sat Mar 5 20:49:38 2022] POST /compute/v2.1/flavors/103204372/action => generated 96 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:49:39.088035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0e77229-0650-4211-a484-a80e4dd5749a tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Calling method '.version_select at 0x7fed5ce4c8b0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:39.115956 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0e77229-0650-4211-a484-a80e4dd5749a tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] 10.222.0.15 "GET /compute/v2.1/os-keypairs/tempest-keypair-1467855376?user_id=7abe4834dcdc41d7a5bc554f92b35bea" status: 200 len: 706 microversion: 2.10 time: 0.031551 Mar 05 20:49:39.118255 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 225/425] 10.222.0.15 () {60 vars in 1339 bytes} [Sat Mar 5 20:49:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1467855376?user_id=7abe4834dcdc41d7a5bc554f92b35bea => generated 706 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:49:39.130451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c35710fd-d975-49cf-ad3d-deaf35e18a81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:39.131463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c35710fd-d975-49cf-ad3d-deaf35e18a81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:39.138983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22ff00d9-69d4-410d-b789-f39588e6035e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:39.139434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22ff00d9-69d4-410d-b789-f39588e6035e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:39.139942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-22ff00d9-69d4-410d-b789-f39588e6035e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lazy-loading 'fault' on Instance uuid d96e01cc-e3b1-464e-8032-9e86fcb22824 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:49:39.149367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c35710fd-d975-49cf-ad3d-deaf35e18a81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:39.150166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c35710fd-d975-49cf-ad3d-deaf35e18a81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:39.151187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c35710fd-d975-49cf-ad3d-deaf35e18a81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:39.152912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c35710fd-d975-49cf-ad3d-deaf35e18a81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:39.576568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-22ff00d9-69d4-410d-b789-f39588e6035e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:39.585962 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-22ff00d9-69d4-410d-b789-f39588e6035e tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1452 microversion: 2.1 time: 0.598217 Mar 05 20:49:39.592231 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 201/426] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:38 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1452 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:39.603121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3441f216-ddf7-401f-a312-ec9098c48d7f tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6b3ca5296cbb409b877cbd196f489b04"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:39.604274 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:39.604274 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:39.679940 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-3441f216-ddf7-401f-a312-ec9098c48d7f tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] HTTP exception thrown: Flavor access already exists for flavor 34 and project 6b3ca5296cbb409b877cbd196f489b04 combination. Mar 05 20:49:39.680619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3441f216-ddf7-401f-a312-ec9098c48d7f tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Returning 409 to user: Flavor access already exists for flavor 34 and project 6b3ca5296cbb409b877cbd196f489b04 combination. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:39.681547 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3441f216-ddf7-401f-a312-ec9098c48d7f tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/103204372/action" status: 409 len: 152 microversion: 2.1 time: 0.087871 Mar 05 20:49:39.686815 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 202/427] 10.222.0.15 () {60 vars in 1196 bytes} [Sat Mar 5 20:49:39 2022] POST /compute/v2.1/flavors/103204372/action => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:49:39.694108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9a3c9385-adcb-49e3-b018-91a0d0c49d81 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Action: 'create', calling method: .version_select at 0x7fed5ce20940>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1790493604", "type": "ssh"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:39.705624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c35710fd-d975-49cf-ad3d-deaf35e18a81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:39.712332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-9a3c9385-adcb-49e3-b018-91a0d0c49d81 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Getting quotas for project 9cb2f2fde8d14659b7fdc1c4f6650f8e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:39.717069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-9a3c9385-adcb-49e3-b018-91a0d0c49d81 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Getting quotas for user 4cf74efbd12d4730a93abf6cfd3ab0c8 and project 9cb2f2fde8d14659b7fdc1c4f6650f8e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:39.718580 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c35710fd-d975-49cf-ad3d-deaf35e18a81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1312 microversion: 2.1 time: 0.595980 Mar 05 20:49:39.719711 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 226/428] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:39 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1312 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:39.725325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-128f6220-af09-43f9-b691-fb16c5b0777a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:39.725924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-128f6220-af09-43f9-b691-fb16c5b0777a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:39.741876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-128f6220-af09-43f9-b691-fb16c5b0777a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:39.742324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-128f6220-af09-43f9-b691-fb16c5b0777a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:39.745214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-128f6220-af09-43f9-b691-fb16c5b0777a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:39.745830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-128f6220-af09-43f9-b691-fb16c5b0777a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:39.847267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-9a3c9385-adcb-49e3-b018-91a0d0c49d81 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Getting quotas for project 9cb2f2fde8d14659b7fdc1c4f6650f8e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:39.854614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-9a3c9385-adcb-49e3-b018-91a0d0c49d81 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Getting quotas for user 4cf74efbd12d4730a93abf6cfd3ab0c8 and project 9cb2f2fde8d14659b7fdc1c4f6650f8e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:39.870946 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9a3c9385-adcb-49e3-b018-91a0d0c49d81 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2337 microversion: 2.10 time: 0.181020 Mar 05 20:49:39.876766 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 203/429] 10.222.0.15 () {62 vars in 1198 bytes} [Sat Mar 5 20:49:39 2022] POST /compute/v2.1/os-keypairs => generated 2337 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:49:39.889288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-428700020", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:39.959921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:40.111417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-128f6220-af09-43f9-b691-fb16c5b0777a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:40.121151 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-128f6220-af09-43f9-b691-fb16c5b0777a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1319 microversion: 2.1 time: 0.399543 Mar 05 20:49:40.122183 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 227/430] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:39 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:40.127422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e4284d93-ab83-4bbb-89e8-ba312bcac667 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:40.128089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e4284d93-ab83-4bbb-89e8-ba312bcac667 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:40.134379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4284d93-ab83-4bbb-89e8-ba312bcac667 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:40.134769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4284d93-ab83-4bbb-89e8-ba312bcac667 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:40.136000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4284d93-ab83-4bbb-89e8-ba312bcac667 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:40.136446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4284d93-ab83-4bbb-89e8-ba312bcac667 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:40.222702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e4284d93-ab83-4bbb-89e8-ba312bcac667 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:40.232708 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e4284d93-ab83-4bbb-89e8-ba312bcac667 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 200 len: 1272 microversion: 2.1 time: 0.109076 Mar 05 20:49:40.233515 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 228/431] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:40 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 1272 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:40.249452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6d421811-bf82-4545-8154-382e55f79c33 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:40.250184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6d421811-bf82-4545-8154-382e55f79c33 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:40.258214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d421811-bf82-4545-8154-382e55f79c33 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:40.258666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d421811-bf82-4545-8154-382e55f79c33 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:40.259442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d421811-bf82-4545-8154-382e55f79c33 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:40.260071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d421811-bf82-4545-8154-382e55f79c33 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:40.291987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6d421811-bf82-4545-8154-382e55f79c33 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:49:40.392399 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6d421811-bf82-4545-8154-382e55f79c33 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 204 len: 0 microversion: 2.1 time: 0.156802 Mar 05 20:49:40.394961 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 229/432] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:49:40 2022] DELETE /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:49:40.401997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-639144c2-2836-43a7-9872-bcd915b7725a tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6b3ca5296cbb409b877cbd196f489b04"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:40.403336 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:40.403336 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:40.509605 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-639144c2-2836-43a7-9872-bcd915b7725a tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/103204372/action" status: 200 len: 21 microversion: 2.1 time: 0.112758 Mar 05 20:49:40.510979 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 230/433] 10.222.0.15 () {60 vars in 1196 bytes} [Sat Mar 5 20:49:40 2022] POST /compute/v2.1/flavors/103204372/action => generated 21 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:49:40.519147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3ee6ac0b-57f6-4d05-b70b-2ca527205ef1 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Calling method '.version_select at 0x7fed5ce0b5e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:40.522513 ncdv-master-1 devstack@n-api.service[141479]: WARNING oslo_db.sqlalchemy.utils [None req-3ee6ac0b-57f6-4d05-b70b-2ca527205ef1 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Mar 05 20:49:40.531876 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3ee6ac0b-57f6-4d05-b70b-2ca527205ef1 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] 10.222.0.15 "GET /compute/v2.1/os-keypairs?user_id=7abe4834dcdc41d7a5bc554f92b35bea" status: 200 len: 1114 microversion: 2.10 time: 0.019075 Mar 05 20:49:40.533467 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 231/434] 10.222.0.15 () {60 vars in 1258 bytes} [Sat Mar 5 20:49:40 2022] GET /compute/v2.1/os-keypairs?user_id=7abe4834dcdc41d7a5bc554f92b35bea => generated 1114 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:49:40.543057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-bb80c668-3926-4238-81dd-bcb3df5c3b2c req-34f3ad6f-3022-4561-a4c2-8367ecb787fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13582ed-3ac6-46fe-9e71-a3af018d2402", "tag": "18ba91e4-2032-4765-b352-295315061de5"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:40.556067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-bb80c668-3926-4238-81dd-bcb3df5c3b2c req-34f3ad6f-3022-4561-a4c2-8367ecb787fe service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:40.556722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-bb80c668-3926-4238-81dd-bcb3df5c3b2c req-34f3ad6f-3022-4561-a4c2-8367ecb787fe service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:40.568083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:40.568514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:40.569160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:40.569574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:40.570323 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-bb80c668-3926-4238-81dd-bcb3df5c3b2c req-34f3ad6f-3022-4561-a4c2-8367ecb787fe service nova] Creating event network-changed:18ba91e4-2032-4765-b352-295315061de5 for instance d13582ed-3ac6-46fe-9e71-a3af018d2402 on nch2-master-1 Mar 05 20:49:40.570459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:40.576593 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-bb80c668-3926-4238-81dd-bcb3df5c3b2c req-34f3ad6f-3022-4561-a4c2-8367ecb787fe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041200 Mar 05 20:49:40.577675 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 232/435] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:40.583965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5559a83e-b008-46c5-a959-21ff753038f2 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:40.585014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5559a83e-b008-46c5-a959-21ff753038f2 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:40.590033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:40.593700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:40.593881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5559a83e-b008-46c5-a959-21ff753038f2 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:40.594469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5559a83e-b008-46c5-a959-21ff753038f2 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:40.594594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:40.595459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:40.596374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5559a83e-b008-46c5-a959-21ff753038f2 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:40.596961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5559a83e-b008-46c5-a959-21ff753038f2 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:40.649731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5559a83e-b008-46c5-a959-21ff753038f2 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:40.650555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5559a83e-b008-46c5-a959-21ff753038f2 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:40.651167 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-5559a83e-b008-46c5-a959-21ff753038f2 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lazy-loading 'fault' on Instance uuid d96e01cc-e3b1-464e-8032-9e86fcb22824 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:49:40.670244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Getting quotas for project 46a689a4e8aa4d1fb19c10217e5986ac. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:40.678489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Getting quotas for user fa730ea7740944abaf69f0e977fd3c34 and project 46a689a4e8aa4d1fb19c10217e5986ac. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:40.715220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:49:40.717964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:40.790611 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-25af804f-1369-4b62-b84f-bf4dd5941055 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912039 Mar 05 20:49:40.792454 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 204/436] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:49:40.802128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2d453f59-a4eb-4f6d-8cea-e81516b445fb tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:40.803126 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:40.803126 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:40.826310 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2d453f59-a4eb-4f6d-8cea-e81516b445fb tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/103204372" status: 202 len: 0 microversion: 2.1 time: 0.028614 Mar 05 20:49:40.828222 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 205/437] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 20:49:40 2022] DELETE /compute/v2.1/flavors/103204372 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:49:40.840128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4f9c9a66-88f5-4ea3-b079-e186674e0cdf tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Calling method '.version_select at 0x7fed5cde21f0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:40.874818 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4f9c9a66-88f5-4ea3-b079-e186674e0cdf tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1790493604" status: 204 len: 0 microversion: 2.10 time: 0.043719 Mar 05 20:49:40.880116 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 206/438] 10.222.0.15 () {60 vars in 1324 bytes} [Sat Mar 5 20:49:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1790493604 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:49:40.888807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-91ec11b9-82c3-4542-8d62-e1218ece2000 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:40.889478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-91ec11b9-82c3-4542-8d62-e1218ece2000 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:40.911466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91ec11b9-82c3-4542-8d62-e1218ece2000 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:40.912185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91ec11b9-82c3-4542-8d62-e1218ece2000 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:40.915772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91ec11b9-82c3-4542-8d62-e1218ece2000 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:40.916441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91ec11b9-82c3-4542-8d62-e1218ece2000 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:41.179865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5559a83e-b008-46c5-a959-21ff753038f2 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:41.191509 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5559a83e-b008-46c5-a959-21ff753038f2 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1458 microversion: 2.1 time: 0.612208 Mar 05 20:49:41.192689 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 233/439] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:40 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1458 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:41.199116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f12d73a8-2e54-4e8c-aee8-a5ebf06468fc tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:41.200130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f12d73a8-2e54-4e8c-aee8-a5ebf06468fc tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:41.276416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f12d73a8-2e54-4e8c-aee8-a5ebf06468fc tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:41.285646 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f12d73a8-2e54-4e8c-aee8-a5ebf06468fc tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1221 microversion: 2.1 time: 0.091705 Mar 05 20:49:41.286778 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 234/440] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:41 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:41.292893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a7ad7fae-15c6-426b-bd89-9f2fae2685c6 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:41.326800 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a7ad7fae-15c6-426b-bd89-9f2fae2685c6 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.038124 Mar 05 20:49:41.329321 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 235/441] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:49:41 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:41.344111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8c521269-5641-47e7-b93b-ea97f71e3087 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Calling method '.version_select at 0x7fed5ce768b0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:41.369499 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8c521269-5641-47e7-b93b-ea97f71e3087 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376892319?user_id=7abe4834dcdc41d7a5bc554f92b35bea" status: 204 len: 0 microversion: 2.10 time: 0.027874 Mar 05 20:49:41.370467 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 236/442] 10.222.0.15 () {60 vars in 1342 bytes} [Sat Mar 5 20:49:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376892319?user_id=7abe4834dcdc41d7a5bc554f92b35bea => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:49:41.382695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7ebe940c-9198-4054-8cf5-1e178dc4f9a6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:41.383617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7ebe940c-9198-4054-8cf5-1e178dc4f9a6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:41.393078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ebe940c-9198-4054-8cf5-1e178dc4f9a6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:41.393633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ebe940c-9198-4054-8cf5-1e178dc4f9a6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:41.394870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ebe940c-9198-4054-8cf5-1e178dc4f9a6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:41.395315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ebe940c-9198-4054-8cf5-1e178dc4f9a6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:41.425300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-91ec11b9-82c3-4542-8d62-e1218ece2000 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:41.460395 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-91ec11b9-82c3-4542-8d62-e1218ece2000 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1312 microversion: 2.1 time: 0.576817 Mar 05 20:49:41.471983 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 207/443] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:40 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1312 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:41.478741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e98bd068-f616-4b06-b5c1-884b4454322d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:41.479638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e98bd068-f616-4b06-b5c1-884b4454322d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:41.487589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e98bd068-f616-4b06-b5c1-884b4454322d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:41.488285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e98bd068-f616-4b06-b5c1-884b4454322d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:41.489414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e98bd068-f616-4b06-b5c1-884b4454322d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:41.489998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e98bd068-f616-4b06-b5c1-884b4454322d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:41.788179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7ebe940c-9198-4054-8cf5-1e178dc4f9a6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:41.797664 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7ebe940c-9198-4054-8cf5-1e178dc4f9a6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1319 microversion: 2.1 time: 0.422081 Mar 05 20:49:41.806803 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 237/444] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:41 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:41.807275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c22a0ea-d809-4bb1-b91e-3d9c3df67eaf tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1829810516", "id": 401286403, "os-flavor-access:is_public": "True"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:41.808662 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:41.808662 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:41.841330 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3c22a0ea-d809-4bb1-b91e-3d9c3df67eaf tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.041131 Mar 05 20:49:41.843309 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 238/445] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:41 2022] POST /compute/v2.1/flavors => generated 435 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:41.854144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e98bd068-f616-4b06-b5c1-884b4454322d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:41.854646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-858624b8-0f3b-4143-a431-785bb1092e72 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] Calling method '.version_select at 0x7fed5cfe55e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:41.872769 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e98bd068-f616-4b06-b5c1-884b4454322d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 200 len: 1314 microversion: 2.1 time: 0.399193 Mar 05 20:49:41.885390 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 208/446] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:41 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:41.892875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a5eacc4f-4046-4a8d-bb24-553583e5eae1 req-ef8a9207-109c-413b-96c6-fa01d3041348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa21d40-79bf-46fd-8cd9-0b00668e875c", "tag": "7816a992-0d79-44b6-8e6b-38df5012bd45"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:41.912507 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-858624b8-0f3b-4143-a431-785bb1092e72 tempest-KeyPairsV210TestJSON-76191357 tempest-KeyPairsV210TestJSON-76191357-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467855376?user_id=7abe4834dcdc41d7a5bc554f92b35bea" status: 204 len: 0 microversion: 2.10 time: 0.052126 Mar 05 20:49:41.917518 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 239/447] 10.222.0.15 () {60 vars in 1342 bytes} [Sat Mar 5 20:49:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467855376?user_id=7abe4834dcdc41d7a5bc554f92b35bea => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:49:41.918851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0f1ca23d-f394-4a82-becd-17a3088e5e4c tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:41.919955 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:41.919955 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:41.930123 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-0f1ca23d-f394-4a82-becd-17a3088e5e4c tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] HTTP exception thrown: Access list not available for public flavors. Mar 05 20:49:41.930369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a5eacc4f-4046-4a8d-bb24-553583e5eae1 req-ef8a9207-109c-413b-96c6-fa01d3041348 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:41.930469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0f1ca23d-f394-4a82-becd-17a3088e5e4c tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:41.930469 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0f1ca23d-f394-4a82-becd-17a3088e5e4c tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/401286403/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.014844 Mar 05 20:49:41.930645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a5eacc4f-4046-4a8d-bb24-553583e5eae1 req-ef8a9207-109c-413b-96c6-fa01d3041348 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:41.930910 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 240/448] 10.222.0.15 () {58 vars in 1205 bytes} [Sat Mar 5 20:49:41 2022] GET /compute/v2.1/flavors/401286403/os-flavor-access => generated 91 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:49:41.940510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fbfb68c5-4b68-4066-803e-abe3d611bd9c tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:41.941440 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:41.941440 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:41.960107 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a5eacc4f-4046-4a8d-bb24-553583e5eae1 req-ef8a9207-109c-413b-96c6-fa01d3041348 service nova] Creating event network-changed:7816a992-0d79-44b6-8e6b-38df5012bd45 for instance caa21d40-79bf-46fd-8cd9-0b00668e875c on nch2-master-1 Mar 05 20:49:41.968187 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fbfb68c5-4b68-4066-803e-abe3d611bd9c tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/401286403" status: 202 len: 0 microversion: 2.1 time: 0.031431 Mar 05 20:49:41.969014 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 241/449] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 20:49:41 2022] DELETE /compute/v2.1/flavors/401286403 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:49:41.973445 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a5eacc4f-4046-4a8d-bb24-553583e5eae1 req-ef8a9207-109c-413b-96c6-fa01d3041348 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086377 Mar 05 20:49:41.976022 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 209/450] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:41.985344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3eec399b-44f1-4ec5-a6d3-d89ea5307f9d tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:42.019278 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3eec399b-44f1-4ec5-a6d3-d89ea5307f9d tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.044737 Mar 05 20:49:42.024049 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 242/451] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:49:41 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:42.041334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bb3ffc29-768f-4b5a-b65d-11cd34684a26 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1232914631", "id": 1815490682, "os-flavor-access:is_public": "False"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:42.043075 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:42.043075 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:42.074103 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bb3ffc29-768f-4b5a-b65d-11cd34684a26 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.039299 Mar 05 20:49:42.087374 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 210/452] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:42 2022] POST /compute/v2.1/flavors => generated 439 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:42.211324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9d331a73-2d00-440a-a1e0-a94e7bf41634 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:42.212995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9d331a73-2d00-440a-a1e0-a94e7bf41634 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:42.229691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d331a73-2d00-440a-a1e0-a94e7bf41634 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:42.230154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d331a73-2d00-440a-a1e0-a94e7bf41634 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:42.231243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d331a73-2d00-440a-a1e0-a94e7bf41634 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:42.234831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d331a73-2d00-440a-a1e0-a94e7bf41634 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:42.274923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9df74f3d-80c1-4772-9053-3df810872965 tempest-FlavorsAccessNegativeTestJSON-631796273 tempest-FlavorsAccessNegativeTestJSON-631796273-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6b3ca5296cbb409b877cbd196f489b04"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:42.277126 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:42.277126 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:42.278425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9df74f3d-80c1-4772-9053-3df810872965 tempest-FlavorsAccessNegativeTestJSON-631796273 tempest-FlavorsAccessNegativeTestJSON-631796273-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '96b60a4fcba244449cec2faa740d131c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ca5296cbb409b877cbd196f489b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:42.279507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9df74f3d-80c1-4772-9053-3df810872965 tempest-FlavorsAccessNegativeTestJSON-631796273 tempest-FlavorsAccessNegativeTestJSON-631796273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:42.280815 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9df74f3d-80c1-4772-9053-3df810872965 tempest-FlavorsAccessNegativeTestJSON-631796273 tempest-FlavorsAccessNegativeTestJSON-631796273-project] 10.222.0.15 "POST /compute/v2.1/flavors/1815490682/action" status: 403 len: 130 microversion: 2.1 time: 0.198399 Mar 05 20:49:42.284047 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 243/453] 10.222.0.15 () {60 vars in 1199 bytes} [Sat Mar 5 20:49:42 2022] POST /compute/v2.1/flavors/1815490682/action => generated 130 bytes in 202 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:42.294551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-261c8763-09a9-4347-ad1f-17e0d07811fb tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:42.311361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d331a73-2d00-440a-a1e0-a94e7bf41634 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:42.315296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d331a73-2d00-440a-a1e0-a94e7bf41634 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:42.315948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-9d331a73-2d00-440a-a1e0-a94e7bf41634 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lazy-loading 'fault' on Instance uuid d96e01cc-e3b1-464e-8032-9e86fcb22824 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:49:42.322619 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-261c8763-09a9-4347-ad1f-17e0d07811fb tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1815490682" status: 202 len: 0 microversion: 2.1 time: 0.034191 Mar 05 20:49:42.324302 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 244/454] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 20:49:42 2022] DELETE /compute/v2.1/flavors/1815490682 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:49:42.333160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-18ab5bcc-c0f5-4771-8c5d-0fcebcb437f1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:42.334329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-18ab5bcc-c0f5-4771-8c5d-0fcebcb437f1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:42.343486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18ab5bcc-c0f5-4771-8c5d-0fcebcb437f1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:42.344447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18ab5bcc-c0f5-4771-8c5d-0fcebcb437f1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:42.345602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18ab5bcc-c0f5-4771-8c5d-0fcebcb437f1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:42.346318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18ab5bcc-c0f5-4771-8c5d-0fcebcb437f1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:42.482654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-18ab5bcc-c0f5-4771-8c5d-0fcebcb437f1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:42.501098 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-18ab5bcc-c0f5-4771-8c5d-0fcebcb437f1 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1291 microversion: 2.1 time: 0.174951 Mar 05 20:49:42.503514 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 245/455] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:42 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1291 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:42.511119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f8f49c52-ed0e-4678-a3ce-589c2225096b tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:42.539919 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f8f49c52-ed0e-4678-a3ce-589c2225096b tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.033896 Mar 05 20:49:42.541271 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 246/456] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:49:42 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:42.547895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3f97df26-b265-4ca9-8334-5d9f2a418fba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:42.549659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3f97df26-b265-4ca9-8334-5d9f2a418fba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:42.558591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f97df26-b265-4ca9-8334-5d9f2a418fba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:42.559384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f97df26-b265-4ca9-8334-5d9f2a418fba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:42.560615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f97df26-b265-4ca9-8334-5d9f2a418fba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:42.561379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f97df26-b265-4ca9-8334-5d9f2a418fba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:42.876858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9d331a73-2d00-440a-a1e0-a94e7bf41634 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:42.894757 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9d331a73-2d00-440a-a1e0-a94e7bf41634 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1458 microversion: 2.1 time: 0.687333 Mar 05 20:49:42.896258 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 211/457] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:42 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1458 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:42.933929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f06af8d0-5115-4689-8c87-0a6e70d3cde9 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-489154760", "id": 676400976, "os-flavor-access:is_public": "False"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:42.960892 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:42.960892 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:42.976335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3f97df26-b265-4ca9-8334-5d9f2a418fba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:42.997101 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3f97df26-b265-4ca9-8334-5d9f2a418fba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1312 microversion: 2.1 time: 0.451894 Mar 05 20:49:42.997880 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 247/458] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:42 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1312 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:43.008899 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f06af8d0-5115-4689-8c87-0a6e70d3cde9 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.110755 Mar 05 20:49:43.011606 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 212/459] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:42 2022] POST /compute/v2.1/flavors => generated 435 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:43.012983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8a880047-c4dc-4060-be05-7690836d4087 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:43.015529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8a880047-c4dc-4060-be05-7690836d4087 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:43.025835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aa06e7a8-de19-454e-b2f5-12ed4e3cc9ae tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:43.030678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aa06e7a8-de19-454e-b2f5-12ed4e3cc9ae tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:43.037826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a880047-c4dc-4060-be05-7690836d4087 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:43.039279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a880047-c4dc-4060-be05-7690836d4087 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:43.041900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a880047-c4dc-4060-be05-7690836d4087 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:43.042348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a880047-c4dc-4060-be05-7690836d4087 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:43.049445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa06e7a8-de19-454e-b2f5-12ed4e3cc9ae tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:43.050203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa06e7a8-de19-454e-b2f5-12ed4e3cc9ae tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:43.051691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa06e7a8-de19-454e-b2f5-12ed4e3cc9ae tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:43.052336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa06e7a8-de19-454e-b2f5-12ed4e3cc9ae tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:43.623152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aa06e7a8-de19-454e-b2f5-12ed4e3cc9ae tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:43.644977 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aa06e7a8-de19-454e-b2f5-12ed4e3cc9ae tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 200 len: 1314 microversion: 2.1 time: 0.630641 Mar 05 20:49:43.646362 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 213/460] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:43 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:43.651579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-bf21cdab-1081-4e99-bb10-aa50b4047ce0 req-3b001c8b-0b21-4dd5-8639-9a9752dcaef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f1f3af1-178f-48ef-84cf-406044a37585", "tag": "231b7fe1-ac2c-471c-96ed-df1619c4cf5c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:43.674292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-bf21cdab-1081-4e99-bb10-aa50b4047ce0 req-3b001c8b-0b21-4dd5-8639-9a9752dcaef9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:43.679730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8a880047-c4dc-4060-be05-7690836d4087 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:43.680271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-bf21cdab-1081-4e99-bb10-aa50b4047ce0 req-3b001c8b-0b21-4dd5-8639-9a9752dcaef9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:43.686870 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8a880047-c4dc-4060-be05-7690836d4087 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1319 microversion: 2.1 time: 0.685358 Mar 05 20:49:43.687809 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 248/461] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:42 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1319 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:43.698551 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-bf21cdab-1081-4e99-bb10-aa50b4047ce0 req-3b001c8b-0b21-4dd5-8639-9a9752dcaef9 service nova] Creating event network-changed:231b7fe1-ac2c-471c-96ed-df1619c4cf5c for instance 7f1f3af1-178f-48ef-84cf-406044a37585 on nch1-master-1 Mar 05 20:49:43.700098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-257dd0a4-db7a-4fa3-bdee-768778dd1c36 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6b3ca5296cbb409b877cbd196f489b04"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:43.702044 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:43.702044 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:43.713494 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-bf21cdab-1081-4e99-bb10-aa50b4047ce0 req-3b001c8b-0b21-4dd5-8639-9a9752dcaef9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063985 Mar 05 20:49:43.715712 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 214/462] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:43.724310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ae9da07f-da06-41f6-ad26-a5362b661f90 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:43.725338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ae9da07f-da06-41f6-ad26-a5362b661f90 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:43.732013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae9da07f-da06-41f6-ad26-a5362b661f90 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:43.732792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae9da07f-da06-41f6-ad26-a5362b661f90 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:43.733916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae9da07f-da06-41f6-ad26-a5362b661f90 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:43.734590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae9da07f-da06-41f6-ad26-a5362b661f90 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:43.907893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ae9da07f-da06-41f6-ad26-a5362b661f90 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:43.920983 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ae9da07f-da06-41f6-ad26-a5362b661f90 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1279 microversion: 2.1 time: 0.202233 Mar 05 20:49:43.921726 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 215/463] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:43 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1279 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:43.929020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-663b28bb-012e-47d8-ad8e-f4346091e667 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:43.929683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-663b28bb-012e-47d8-ad8e-f4346091e667 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:43.939832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-663b28bb-012e-47d8-ad8e-f4346091e667 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:43.940281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-663b28bb-012e-47d8-ad8e-f4346091e667 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:43.941683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-663b28bb-012e-47d8-ad8e-f4346091e667 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:43.942863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-663b28bb-012e-47d8-ad8e-f4346091e667 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:43.960413 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-257dd0a4-db7a-4fa3-bdee-768778dd1c36 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/676400976/action" status: 200 len: 96 microversion: 2.1 time: 0.269248 Mar 05 20:49:43.963079 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 249/464] 10.222.0.15 () {60 vars in 1196 bytes} [Sat Mar 5 20:49:43 2022] POST /compute/v2.1/flavors/676400976/action => generated 96 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:49:43.973411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fc449510-ef84-4f64-a7b0-de6339203cce tempest-FlavorsAccessNegativeTestJSON-631796273 tempest-FlavorsAccessNegativeTestJSON-631796273-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6b3ca5296cbb409b877cbd196f489b04"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:43.975634 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:43.975634 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:43.978589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fc449510-ef84-4f64-a7b0-de6339203cce tempest-FlavorsAccessNegativeTestJSON-631796273 tempest-FlavorsAccessNegativeTestJSON-631796273-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '96b60a4fcba244449cec2faa740d131c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ca5296cbb409b877cbd196f489b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:43.978589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fc449510-ef84-4f64-a7b0-de6339203cce tempest-FlavorsAccessNegativeTestJSON-631796273 tempest-FlavorsAccessNegativeTestJSON-631796273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:43.978589 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fc449510-ef84-4f64-a7b0-de6339203cce tempest-FlavorsAccessNegativeTestJSON-631796273 tempest-FlavorsAccessNegativeTestJSON-631796273-project] 10.222.0.15 "POST /compute/v2.1/flavors/676400976/action" status: 403 len: 133 microversion: 2.1 time: 0.010285 Mar 05 20:49:43.979437 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 250/465] 10.222.0.15 () {60 vars in 1196 bytes} [Sat Mar 5 20:49:43 2022] POST /compute/v2.1/flavors/676400976/action => generated 133 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:43.993120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-663b28bb-012e-47d8-ad8e-f4346091e667 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:43.993578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-663b28bb-012e-47d8-ad8e-f4346091e667 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:43.993682 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-146a7bed-e6d8-4520-98a4-7102111d24c8 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6b3ca5296cbb409b877cbd196f489b04"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:43.994300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-663b28bb-012e-47d8-ad8e-f4346091e667 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lazy-loading 'fault' on Instance uuid d96e01cc-e3b1-464e-8032-9e86fcb22824 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:49:44.094349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-663b28bb-012e-47d8-ad8e-f4346091e667 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b27750446fb4a75a0b4247065203706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc979e049ee9421d8f6e41c1b6723f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:44.109297 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-663b28bb-012e-47d8-ad8e-f4346091e667 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 200 len: 1310 microversion: 2.1 time: 0.185398 Mar 05 20:49:44.110414 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 216/466] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:43 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 1310 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:44.117443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-14c43689-bf1d-4810-9df9-1142b3fcabea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:44.118243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-14c43689-bf1d-4810-9df9-1142b3fcabea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:44.129792 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-146a7bed-e6d8-4520-98a4-7102111d24c8 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/676400976/action" status: 200 len: 21 microversion: 2.1 time: 0.143511 Mar 05 20:49:44.131735 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 251/467] 10.222.0.15 () {60 vars in 1196 bytes} [Sat Mar 5 20:49:43 2022] POST /compute/v2.1/flavors/676400976/action => generated 21 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:49:44.140571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-4d1ff992-a937-438d-ba1f-773b6088a18a req-a9455baa-3421-4b26-a186-d11aebeab2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d96e01cc-e3b1-464e-8032-9e86fcb22824", "name": "network-vif-deleted", "tag": "f2a014b4-b464-4203-8c89-db1d813f0118"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:44.167555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4d1ff992-a937-438d-ba1f-773b6088a18a req-a9455baa-3421-4b26-a186-d11aebeab2e8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:44.169228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4d1ff992-a937-438d-ba1f-773b6088a18a req-a9455baa-3421-4b26-a186-d11aebeab2e8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:44.181599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14c43689-bf1d-4810-9df9-1142b3fcabea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:44.182602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14c43689-bf1d-4810-9df9-1142b3fcabea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:44.182602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14c43689-bf1d-4810-9df9-1142b3fcabea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:44.183023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14c43689-bf1d-4810-9df9-1142b3fcabea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:44.199055 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-4d1ff992-a937-438d-ba1f-773b6088a18a req-a9455baa-3421-4b26-a186-d11aebeab2e8 service nova] Creating event network-vif-deleted:f2a014b4-b464-4203-8c89-db1d813f0118 for instance d96e01cc-e3b1-464e-8032-9e86fcb22824 on nch1-master-1 Mar 05 20:49:44.209099 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-4d1ff992-a937-438d-ba1f-773b6088a18a req-a9455baa-3421-4b26-a186-d11aebeab2e8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074505 Mar 05 20:49:44.209905 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 252/468] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:44.227235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-44f31098-2e97-4cf7-b8ad-847cdef0bee2 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:44.228007 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:44.228007 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:44.257560 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-44f31098-2e97-4cf7-b8ad-847cdef0bee2 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/676400976" status: 202 len: 0 microversion: 2.1 time: 0.046603 Mar 05 20:49:44.258172 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 253/469] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 20:49:44 2022] DELETE /compute/v2.1/flavors/676400976 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:49:44.268886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-15638c26-f5e7-4b5f-8d5e-2f39c325c188 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:44.292698 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-15638c26-f5e7-4b5f-8d5e-2f39c325c188 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.029722 Mar 05 20:49:44.307370 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 254/470] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:49:44 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:44.317141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f23be267-255a-4539-872e-6ba1f3172abd tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1749609986", "id": 1652392752, "os-flavor-access:is_public": "False"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:44.320453 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:44.320453 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:44.345632 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f23be267-255a-4539-872e-6ba1f3172abd tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.036178 Mar 05 20:49:44.346803 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 255/471] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:44 2022] POST /compute/v2.1/flavors => generated 439 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:44.371028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-355f3175-2676-41f5-a380-b9bead018fcc tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "94a94ca351cc49f4aea3aaacdfccedc7"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:44.374243 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:44.374243 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:44.557411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-14c43689-bf1d-4810-9df9-1142b3fcabea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:44.566476 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-14c43689-bf1d-4810-9df9-1142b3fcabea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1312 microversion: 2.1 time: 0.454159 Mar 05 20:49:44.576552 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 217/472] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:44 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1312 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:44.671016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b1425852-b85a-4e4a-ab93-045fbdab632f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:44.671829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b1425852-b85a-4e4a-ab93-045fbdab632f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:44.692479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1425852-b85a-4e4a-ab93-045fbdab632f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:44.693036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1425852-b85a-4e4a-ab93-045fbdab632f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:44.693908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1425852-b85a-4e4a-ab93-045fbdab632f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:44.694425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1425852-b85a-4e4a-ab93-045fbdab632f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:44.761803 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-355f3175-2676-41f5-a380-b9bead018fcc tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] HTTP exception thrown: Flavor access not found for 38 / 94a94ca351cc49f4aea3aaacdfccedc7 combination. Mar 05 20:49:44.762341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-355f3175-2676-41f5-a380-b9bead018fcc tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Returning 404 to user: Flavor access not found for 38 / 94a94ca351cc49f4aea3aaacdfccedc7 combination. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:44.763255 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-355f3175-2676-41f5-a380-b9bead018fcc tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors/1652392752/action" status: 404 len: 124 microversion: 2.1 time: 0.401388 Mar 05 20:49:44.767734 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 256/473] 10.222.0.15 () {60 vars in 1199 bytes} [Sat Mar 5 20:49:44 2022] POST /compute/v2.1/flavors/1652392752/action => generated 124 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:44.771770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8044db2f-1aac-470a-965b-da7fcba701ab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:44.773819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8044db2f-1aac-470a-965b-da7fcba701ab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:44.783388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8044db2f-1aac-470a-965b-da7fcba701ab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:44.783920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8044db2f-1aac-470a-965b-da7fcba701ab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:44.784742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8044db2f-1aac-470a-965b-da7fcba701ab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:44.785559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8044db2f-1aac-470a-965b-da7fcba701ab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:44.993156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8044db2f-1aac-470a-965b-da7fcba701ab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:45.002851 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8044db2f-1aac-470a-965b-da7fcba701ab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1319 microversion: 2.1 time: 0.237502 Mar 05 20:49:45.003646 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 257/474] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:44 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:45.018953 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-85aa03b7-05d7-43dc-a491-9c9e7a3b4e5f tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:45.019793 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:45.019793 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:45.037348 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-85aa03b7-05d7-43dc-a491-9c9e7a3b4e5f tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1652392752" status: 202 len: 0 microversion: 2.1 time: 0.023102 Mar 05 20:49:45.038763 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 258/475] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 20:49:45 2022] DELETE /compute/v2.1/flavors/1652392752 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:49:45.045335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b2c4b0ce-9edd-4e6c-bcdf-b2746d719589 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:45.046136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b2c4b0ce-9edd-4e6c-bcdf-b2746d719589 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:45.053535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2c4b0ce-9edd-4e6c-bcdf-b2746d719589 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.054138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2c4b0ce-9edd-4e6c-bcdf-b2746d719589 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.055043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2c4b0ce-9edd-4e6c-bcdf-b2746d719589 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.055592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2c4b0ce-9edd-4e6c-bcdf-b2746d719589 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.218519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b2c4b0ce-9edd-4e6c-bcdf-b2746d719589 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:45.228794 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b2c4b0ce-9edd-4e6c-bcdf-b2746d719589 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1321 microversion: 2.1 time: 0.187506 Mar 05 20:49:45.238930 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 259/476] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:45 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:45.243854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f1a7de66-14cc-4804-b41d-c4cedca6e0d9 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:45.263308 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f1a7de66-14cc-4804-b41d-c4cedca6e0d9 tempest-FlavorsAccessNegativeTestJSON-1739265830 tempest-FlavorsAccessNegativeTestJSON-1739265830-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.023038 Mar 05 20:49:45.264129 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 260/477] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:49:45 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:45.293639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bf42d941-fe1e-4010-8d43-8371f1a08aae tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:45.294547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bf42d941-fe1e-4010-8d43-8371f1a08aae tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:45.304816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf42d941-fe1e-4010-8d43-8371f1a08aae tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.305426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf42d941-fe1e-4010-8d43-8371f1a08aae tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.306794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf42d941-fe1e-4010-8d43-8371f1a08aae tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.307353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf42d941-fe1e-4010-8d43-8371f1a08aae tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.328309 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-bf42d941-fe1e-4010-8d43-8371f1a08aae tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] HTTP exception thrown: Instance d96e01cc-e3b1-464e-8032-9e86fcb22824 could not be found. Mar 05 20:49:45.329306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bf42d941-fe1e-4010-8d43-8371f1a08aae tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Returning 404 to user: Instance d96e01cc-e3b1-464e-8032-9e86fcb22824 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:45.329897 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bf42d941-fe1e-4010-8d43-8371f1a08aae tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 404 len: 111 microversion: 2.1 time: 0.053496 Mar 05 20:49:45.330673 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 261/478] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:45 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:45.335420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-845913ee-4460-42d5-a095-2baa738d5885 req-46198f6f-db2c-4f6d-a7b6-da305d3be24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3261ac3a-9665-44b0-965d-06ac66c07d82", "name": "network-vif-plugged", "status": "completed", "tag": "de504aa3-bfc4-44ec-a4bc-0df77d0e7550"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:45.349564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-845913ee-4460-42d5-a095-2baa738d5885 req-46198f6f-db2c-4f6d-a7b6-da305d3be24a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.350056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-845913ee-4460-42d5-a095-2baa738d5885 req-46198f6f-db2c-4f6d-a7b6-da305d3be24a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.365559 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-845913ee-4460-42d5-a095-2baa738d5885 req-46198f6f-db2c-4f6d-a7b6-da305d3be24a service nova] Creating event network-vif-plugged:de504aa3-bfc4-44ec-a4bc-0df77d0e7550 for instance 3261ac3a-9665-44b0-965d-06ac66c07d82 on nch1-master-1 Mar 05 20:49:45.372101 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-845913ee-4460-42d5-a095-2baa738d5885 req-46198f6f-db2c-4f6d-a7b6-da305d3be24a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040272 Mar 05 20:49:45.373724 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 262/479] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:45.380949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8fff4b15-1e98-4d30-9b23-5ae8fdcf9cc6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:45.381723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8fff4b15-1e98-4d30-9b23-5ae8fdcf9cc6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:45.402874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fff4b15-1e98-4d30-9b23-5ae8fdcf9cc6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.404852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fff4b15-1e98-4d30-9b23-5ae8fdcf9cc6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.408207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fff4b15-1e98-4d30-9b23-5ae8fdcf9cc6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.408671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fff4b15-1e98-4d30-9b23-5ae8fdcf9cc6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.434521 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-8fff4b15-1e98-4d30-9b23-5ae8fdcf9cc6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] HTTP exception thrown: Instance d96e01cc-e3b1-464e-8032-9e86fcb22824 could not be found. Mar 05 20:49:45.435262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8fff4b15-1e98-4d30-9b23-5ae8fdcf9cc6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Returning 404 to user: Instance d96e01cc-e3b1-464e-8032-9e86fcb22824 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:45.436265 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8fff4b15-1e98-4d30-9b23-5ae8fdcf9cc6 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 404 len: 111 microversion: 2.1 time: 0.061194 Mar 05 20:49:45.442443 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 263/480] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:49:45 2022] DELETE /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:45.450000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d2b3a8db-fc65-4eff-b531-c1b9ca24512d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:45.450924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d2b3a8db-fc65-4eff-b531-c1b9ca24512d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: d96e01cc-e3b1-464e-8032-9e86fcb22824] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:45.460934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2b3a8db-fc65-4eff-b531-c1b9ca24512d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.461911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b1425852-b85a-4e4a-ab93-045fbdab632f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:45.463526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2b3a8db-fc65-4eff-b531-c1b9ca24512d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.464651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2b3a8db-fc65-4eff-b531-c1b9ca24512d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.465330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2b3a8db-fc65-4eff-b531-c1b9ca24512d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.470778 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b1425852-b85a-4e4a-ab93-045fbdab632f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 200 len: 1314 microversion: 2.1 time: 0.810172 Mar 05 20:49:45.477450 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 218/481] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:44 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 1314 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:45.484160 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-d2b3a8db-fc65-4eff-b531-c1b9ca24512d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] HTTP exception thrown: Instance d96e01cc-e3b1-464e-8032-9e86fcb22824 could not be found. Mar 05 20:49:45.484961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d2b3a8db-fc65-4eff-b531-c1b9ca24512d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Returning 404 to user: Instance d96e01cc-e3b1-464e-8032-9e86fcb22824 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:45.485993 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d2b3a8db-fc65-4eff-b531-c1b9ca24512d tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824" status: 404 len: 111 microversion: 2.1 time: 0.041756 Mar 05 20:49:45.489909 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 264/482] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:45 2022] GET /compute/v2.1/servers/d96e01cc-e3b1-464e-8032-9e86fcb22824 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:45.495641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d6f48754-f29e-4085-8dc9-3cf81cb97645 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:45.496088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d6f48754-f29e-4085-8dc9-3cf81cb97645 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:45.505589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6f48754-f29e-4085-8dc9-3cf81cb97645 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.506450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6f48754-f29e-4085-8dc9-3cf81cb97645 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.507659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6f48754-f29e-4085-8dc9-3cf81cb97645 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.508323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6f48754-f29e-4085-8dc9-3cf81cb97645 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.535260 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-d6f48754-f29e-4085-8dc9-3cf81cb97645 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] HTTP exception thrown: Instance f3bafedc-69d2-4784-8413-e4f9060b4acf could not be found. Mar 05 20:49:45.536300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d6f48754-f29e-4085-8dc9-3cf81cb97645 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Returning 404 to user: Instance f3bafedc-69d2-4784-8413-e4f9060b4acf could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:45.537366 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d6f48754-f29e-4085-8dc9-3cf81cb97645 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 404 len: 111 microversion: 2.1 time: 0.046205 Mar 05 20:49:45.548668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-61c1573b-2f53-4ece-aad6-aa988da07fe9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:45.549850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-61c1573b-2f53-4ece-aad6-aa988da07fe9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] [instance: f3bafedc-69d2-4784-8413-e4f9060b4acf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:45.554784 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 219/483] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:49:45 2022] DELETE /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:49:45.557520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61c1573b-2f53-4ece-aad6-aa988da07fe9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.558220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61c1573b-2f53-4ece-aad6-aa988da07fe9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.559241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61c1573b-2f53-4ece-aad6-aa988da07fe9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.560471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61c1573b-2f53-4ece-aad6-aa988da07fe9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.587622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dfe8a205-e22b-477c-9bbf-dc77f294aeb9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:45.589017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dfe8a205-e22b-477c-9bbf-dc77f294aeb9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:45.598304 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-61c1573b-2f53-4ece-aad6-aa988da07fe9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] HTTP exception thrown: Instance f3bafedc-69d2-4784-8413-e4f9060b4acf could not be found. Mar 05 20:49:45.600965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-61c1573b-2f53-4ece-aad6-aa988da07fe9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] Returning 404 to user: Instance f3bafedc-69d2-4784-8413-e4f9060b4acf could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:45.602411 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-61c1573b-2f53-4ece-aad6-aa988da07fe9 tempest-DeleteServersAdminTestJSON-602250000 tempest-DeleteServersAdminTestJSON-602250000-project] 10.222.0.15 "GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf" status: 404 len: 111 microversion: 2.1 time: 0.058923 Mar 05 20:49:45.609369 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 265/484] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:45 2022] GET /compute/v2.1/servers/f3bafedc-69d2-4784-8413-e4f9060b4acf => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:45.609845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dfe8a205-e22b-477c-9bbf-dc77f294aeb9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.610688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dfe8a205-e22b-477c-9bbf-dc77f294aeb9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:45.612363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dfe8a205-e22b-477c-9bbf-dc77f294aeb9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:45.612363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dfe8a205-e22b-477c-9bbf-dc77f294aeb9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:46.022177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-681f13b4-958a-4fc9-ba89-bcaa108b7d5c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:46.022777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-681f13b4-958a-4fc9-ba89-bcaa108b7d5c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:46.040470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-681f13b4-958a-4fc9-ba89-bcaa108b7d5c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:46.041030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-681f13b4-958a-4fc9-ba89-bcaa108b7d5c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:46.042343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-681f13b4-958a-4fc9-ba89-bcaa108b7d5c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:46.042343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-681f13b4-958a-4fc9-ba89-bcaa108b7d5c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:46.106688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dfe8a205-e22b-477c-9bbf-dc77f294aeb9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:46.120330 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dfe8a205-e22b-477c-9bbf-dc77f294aeb9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1312 microversion: 2.1 time: 0.538918 Mar 05 20:49:46.122529 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 220/485] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:45 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1312 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:46.247004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ccbcbb02-8270-4ba3-af33-363401cf3977 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:46.247785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ccbcbb02-8270-4ba3-af33-363401cf3977 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:46.262054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ccbcbb02-8270-4ba3-af33-363401cf3977 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:46.262505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ccbcbb02-8270-4ba3-af33-363401cf3977 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:46.264630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ccbcbb02-8270-4ba3-af33-363401cf3977 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:46.265224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ccbcbb02-8270-4ba3-af33-363401cf3977 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:46.384473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-681f13b4-958a-4fc9-ba89-bcaa108b7d5c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:46.398399 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-681f13b4-958a-4fc9-ba89-bcaa108b7d5c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1319 microversion: 2.1 time: 0.379454 Mar 05 20:49:46.418359 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 266/486] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:46 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:46.429960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-74159b5b-7005-4341-ac42-3b7610950156 req-143d3706-8d9c-4859-b467-642e66853d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c46afc9-db69-4609-a26c-acf26b922ce7", "tag": "5cfde395-3c68-4fc7-a3b1-d62814d069b8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:46.444991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-74159b5b-7005-4341-ac42-3b7610950156 req-143d3706-8d9c-4859-b467-642e66853d09 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:46.445750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-74159b5b-7005-4341-ac42-3b7610950156 req-143d3706-8d9c-4859-b467-642e66853d09 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:46.484760 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-74159b5b-7005-4341-ac42-3b7610950156 req-143d3706-8d9c-4859-b467-642e66853d09 service nova] Creating event network-changed:5cfde395-3c68-4fc7-a3b1-d62814d069b8 for instance 3c46afc9-db69-4609-a26c-acf26b922ce7 on nch1-master-1 Mar 05 20:49:46.496682 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-74159b5b-7005-4341-ac42-3b7610950156 req-143d3706-8d9c-4859-b467-642e66853d09 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073744 Mar 05 20:49:46.499903 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 267/487] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:46.519957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f3032628-51f6-4c27-8bfa-0331a2a8c9e6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:46.521240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f3032628-51f6-4c27-8bfa-0331a2a8c9e6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:46.532138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3032628-51f6-4c27-8bfa-0331a2a8c9e6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:46.533424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3032628-51f6-4c27-8bfa-0331a2a8c9e6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:46.534847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3032628-51f6-4c27-8bfa-0331a2a8c9e6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:46.535403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3032628-51f6-4c27-8bfa-0331a2a8c9e6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:46.601505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ccbcbb02-8270-4ba3-af33-363401cf3977 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:46.610692 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ccbcbb02-8270-4ba3-af33-363401cf3977 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1321 microversion: 2.1 time: 0.368084 Mar 05 20:49:46.613538 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 221/488] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:46 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:46.861608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f3032628-51f6-4c27-8bfa-0331a2a8c9e6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:46.874646 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f3032628-51f6-4c27-8bfa-0331a2a8c9e6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 200 len: 1314 microversion: 2.1 time: 0.371359 Mar 05 20:49:46.875892 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 268/489] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:46 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:47.147307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f39478fa-a363-4676-963b-7f7da8cf9f0a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:47.148214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f39478fa-a363-4676-963b-7f7da8cf9f0a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:47.159251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f39478fa-a363-4676-963b-7f7da8cf9f0a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:47.159719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f39478fa-a363-4676-963b-7f7da8cf9f0a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:47.160798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f39478fa-a363-4676-963b-7f7da8cf9f0a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:47.161693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f39478fa-a363-4676-963b-7f7da8cf9f0a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:47.416608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2a217849-5249-4013-a3ec-4ffcff1df7f2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:47.417227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2a217849-5249-4013-a3ec-4ffcff1df7f2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:47.432238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a217849-5249-4013-a3ec-4ffcff1df7f2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:47.432899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a217849-5249-4013-a3ec-4ffcff1df7f2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:47.434944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a217849-5249-4013-a3ec-4ffcff1df7f2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:47.435547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a217849-5249-4013-a3ec-4ffcff1df7f2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:47.618909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f39478fa-a363-4676-963b-7f7da8cf9f0a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:47.637928 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f39478fa-a363-4676-963b-7f7da8cf9f0a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1460 microversion: 2.1 time: 0.502105 Mar 05 20:49:47.638564 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 222/490] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:47 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1460 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:47.648148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0a6dc3ab-1baf-4e91-859b-bb606d621807 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:47.649900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0a6dc3ab-1baf-4e91-859b-bb606d621807 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:47.661483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a6dc3ab-1baf-4e91-859b-bb606d621807 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:47.662822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a6dc3ab-1baf-4e91-859b-bb606d621807 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:47.667620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a6dc3ab-1baf-4e91-859b-bb606d621807 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:47.668736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a6dc3ab-1baf-4e91-859b-bb606d621807 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:47.762684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2a217849-5249-4013-a3ec-4ffcff1df7f2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:47.776125 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2a217849-5249-4013-a3ec-4ffcff1df7f2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1319 microversion: 2.1 time: 0.363429 Mar 05 20:49:47.776713 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 269/491] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:47 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:47.781629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9a1897e2-d5a8-4e36-b1da-46aa7fb26de8 req-1f0fa357-d0f4-4a3a-81ec-0b1fb521434e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13582ed-3ac6-46fe-9e71-a3af018d2402", "name": "network-vif-plugged", "status": "completed", "tag": "18ba91e4-2032-4765-b352-295315061de5"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:47.806678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9a1897e2-d5a8-4e36-b1da-46aa7fb26de8 req-1f0fa357-d0f4-4a3a-81ec-0b1fb521434e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:47.807294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9a1897e2-d5a8-4e36-b1da-46aa7fb26de8 req-1f0fa357-d0f4-4a3a-81ec-0b1fb521434e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:47.830979 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9a1897e2-d5a8-4e36-b1da-46aa7fb26de8 req-1f0fa357-d0f4-4a3a-81ec-0b1fb521434e service nova] Creating event network-vif-plugged:18ba91e4-2032-4765-b352-295315061de5 for instance d13582ed-3ac6-46fe-9e71-a3af018d2402 on nch2-master-1 Mar 05 20:49:47.838716 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9a1897e2-d5a8-4e36-b1da-46aa7fb26de8 req-1f0fa357-d0f4-4a3a-81ec-0b1fb521434e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060639 Mar 05 20:49:47.846069 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 270/492] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:47.964535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0a6dc3ab-1baf-4e91-859b-bb606d621807 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:47.972689 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0a6dc3ab-1baf-4e91-859b-bb606d621807 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1321 microversion: 2.1 time: 0.332676 Mar 05 20:49:47.973272 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 223/493] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:47 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:47.986534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e95b9ce4-a1e3-4e30-9798-ab3661be2fcb tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:47.987154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e95b9ce4-a1e3-4e30-9798-ab3661be2fcb tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:48.003348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e95b9ce4-a1e3-4e30-9798-ab3661be2fcb tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:48.003833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e95b9ce4-a1e3-4e30-9798-ab3661be2fcb tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:48.004627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e95b9ce4-a1e3-4e30-9798-ab3661be2fcb tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:48.005075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e95b9ce4-a1e3-4e30-9798-ab3661be2fcb tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:48.290410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e95b9ce4-a1e3-4e30-9798-ab3661be2fcb tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:48.298478 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e95b9ce4-a1e3-4e30-9798-ab3661be2fcb tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 200 len: 1314 microversion: 2.1 time: 0.316112 Mar 05 20:49:48.299272 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 224/494] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:47 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:48.318057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-625c0c7b-622c-49ed-8537-2f88121e2426 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:48.318783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-625c0c7b-622c-49ed-8537-2f88121e2426 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:48.325380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-625c0c7b-622c-49ed-8537-2f88121e2426 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:48.325745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-625c0c7b-622c-49ed-8537-2f88121e2426 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:48.326721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-625c0c7b-622c-49ed-8537-2f88121e2426 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:48.327170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-625c0c7b-622c-49ed-8537-2f88121e2426 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:48.636270 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-625c0c7b-622c-49ed-8537-2f88121e2426 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1611 microversion: 2.1 time: 0.787704 Mar 05 20:49:48.647893 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 271/495] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:47 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1611 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:48.653260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6f97a556-6ae5-4d13-ab9e-441b70246ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:48.653844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6f97a556-6ae5-4d13-ab9e-441b70246ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:48.660916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f97a556-6ae5-4d13-ab9e-441b70246ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:48.661375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f97a556-6ae5-4d13-ab9e-441b70246ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:48.662160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f97a556-6ae5-4d13-ab9e-441b70246ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:48.662606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f97a556-6ae5-4d13-ab9e-441b70246ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:48.802903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2145122652", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:48.859065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:48.997745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6f97a556-6ae5-4d13-ab9e-441b70246ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f1f722649c2248979f72bded84130ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95ff6b8169b4a6e91d0a2a28c1220cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:48.998522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6f97a556-6ae5-4d13-ab9e-441b70246ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] flavor_id is None. Assuming migration. {{(pid=141479) resize /opt/stack/nova/nova/compute/api.py:4140}} Mar 05 20:49:48.999138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6f97a556-6ae5-4d13-ab9e-441b70246ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141479) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 20:49:49.188113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:49.189370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:49.190316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:49.190929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:49.191682 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:49.208342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:49.209023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:49.211007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:49.211609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:49.233967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Getting quotas for project 20c17cd80f57435e83687f847a73abd4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:49.239222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Getting quotas for user 7eaf06f561734f4b8471344612a4eb2a and project 20c17cd80f57435e83687f847a73abd4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:49.267463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:49:49.276546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:49.346891 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-be38623b-06f0-4b4d-9c6d-ec78cd4d5666 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942690 Mar 05 20:49:49.348321 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 225/496] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:49:49.359895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e22c62b8-076c-4695-8b1c-2bbf2108b556 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:49.360711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e22c62b8-076c-4695-8b1c-2bbf2108b556 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:49.368541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e22c62b8-076c-4695-8b1c-2bbf2108b556 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:49.369374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e22c62b8-076c-4695-8b1c-2bbf2108b556 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:49.370451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e22c62b8-076c-4695-8b1c-2bbf2108b556 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:49.371062 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e22c62b8-076c-4695-8b1c-2bbf2108b556 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:49.708680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e22c62b8-076c-4695-8b1c-2bbf2108b556 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:49.718405 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e22c62b8-076c-4695-8b1c-2bbf2108b556 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1319 microversion: 2.1 time: 0.368825 Mar 05 20:49:49.727899 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 226/497] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:49 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:49.737067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c0e2ddb4-ff41-4893-b621-86d4808431ba tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:49.739330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c0e2ddb4-ff41-4893-b621-86d4808431ba tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:49.752669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c0e2ddb4-ff41-4893-b621-86d4808431ba tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:49.755710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c0e2ddb4-ff41-4893-b621-86d4808431ba tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:49.758229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c0e2ddb4-ff41-4893-b621-86d4808431ba tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:49.758702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c0e2ddb4-ff41-4893-b621-86d4808431ba tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:49.872548 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6f97a556-6ae5-4d13-ab9e-441b70246ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82/action" status: 202 len: 0 microversion: 2.1 time: 1.222610 Mar 05 20:49:49.875515 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 272/498] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:49:48 2022] POST /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82/action => generated 0 bytes in 1227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:49:49.894146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aab8240b-d7c7-4373-b76e-51426e1208f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:49.895068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-aab8240b-d7c7-4373-b76e-51426e1208f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:49.911561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aab8240b-d7c7-4373-b76e-51426e1208f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:49.912144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aab8240b-d7c7-4373-b76e-51426e1208f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:49.913547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aab8240b-d7c7-4373-b76e-51426e1208f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:49.914157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aab8240b-d7c7-4373-b76e-51426e1208f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:50.096144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c0e2ddb4-ff41-4893-b621-86d4808431ba tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:50.106453 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c0e2ddb4-ff41-4893-b621-86d4808431ba tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1321 microversion: 2.1 time: 0.379943 Mar 05 20:49:50.107029 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 227/499] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:49 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1321 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:50.115770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a416d1c1-1eab-41a5-b5db-b83a0ed095e4 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:50.116759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a416d1c1-1eab-41a5-b5db-b83a0ed095e4 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:50.135180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a416d1c1-1eab-41a5-b5db-b83a0ed095e4 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:50.136035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a416d1c1-1eab-41a5-b5db-b83a0ed095e4 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:50.137077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a416d1c1-1eab-41a5-b5db-b83a0ed095e4 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:50.137742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a416d1c1-1eab-41a5-b5db-b83a0ed095e4 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:50.209331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a416d1c1-1eab-41a5-b5db-b83a0ed095e4 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:50.218287 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a416d1c1-1eab-41a5-b5db-b83a0ed095e4 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1223 microversion: 2.1 time: 0.110126 Mar 05 20:49:50.220913 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 228/500] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:50 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:50.230999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-aab8240b-d7c7-4373-b76e-51426e1208f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:50.234378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-dcff6713-8662-44c3-8f90-8021f14dbf1a req-9703d8f3-adbc-4000-85c8-615820017509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa21d40-79bf-46fd-8cd9-0b00668e875c", "name": "network-vif-plugged", "status": "completed", "tag": "7816a992-0d79-44b6-8e6b-38df5012bd45"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:50.241794 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aab8240b-d7c7-4373-b76e-51426e1208f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 200 len: 1314 microversion: 2.1 time: 0.362690 Mar 05 20:49:50.242937 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 273/501] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:49 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:50.256574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-dcff6713-8662-44c3-8f90-8021f14dbf1a req-9703d8f3-adbc-4000-85c8-615820017509 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:50.257906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-dcff6713-8662-44c3-8f90-8021f14dbf1a req-9703d8f3-adbc-4000-85c8-615820017509 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:50.259866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8989e35c-bcb9-4dc9-bb92-861b14ad04ea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:50.262007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8989e35c-bcb9-4dc9-bb92-861b14ad04ea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:50.273378 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-dcff6713-8662-44c3-8f90-8021f14dbf1a req-9703d8f3-adbc-4000-85c8-615820017509 service nova] Creating event network-vif-plugged:7816a992-0d79-44b6-8e6b-38df5012bd45 for instance caa21d40-79bf-46fd-8cd9-0b00668e875c on nch2-master-1 Mar 05 20:49:50.278405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8989e35c-bcb9-4dc9-bb92-861b14ad04ea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:50.278903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8989e35c-bcb9-4dc9-bb92-861b14ad04ea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:50.279597 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-dcff6713-8662-44c3-8f90-8021f14dbf1a req-9703d8f3-adbc-4000-85c8-615820017509 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057217 Mar 05 20:49:50.280442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8989e35c-bcb9-4dc9-bb92-861b14ad04ea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:50.281383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8989e35c-bcb9-4dc9-bb92-861b14ad04ea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:50.284741 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 229/502] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:50.475023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8989e35c-bcb9-4dc9-bb92-861b14ad04ea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:50.485113 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8989e35c-bcb9-4dc9-bb92-861b14ad04ea tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1469 microversion: 2.1 time: 0.239169 Mar 05 20:49:50.486058 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 274/503] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:50 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1469 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:50.740074 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-092e15a2-9a2a-4ae0-b8f9-bbbe43888cbd tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:50.740880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-092e15a2-9a2a-4ae0-b8f9-bbbe43888cbd tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:50.747937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-092e15a2-9a2a-4ae0-b8f9-bbbe43888cbd tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:50.754979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-092e15a2-9a2a-4ae0-b8f9-bbbe43888cbd tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:50.755820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-092e15a2-9a2a-4ae0-b8f9-bbbe43888cbd tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:50.756271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-092e15a2-9a2a-4ae0-b8f9-bbbe43888cbd tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:51.036175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-092e15a2-9a2a-4ae0-b8f9-bbbe43888cbd tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:51.051761 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-092e15a2-9a2a-4ae0-b8f9-bbbe43888cbd tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1319 microversion: 2.1 time: 0.314141 Mar 05 20:49:51.052915 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 230/504] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:50 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:51.127501 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e796b17f-2197-4f58-8db8-99849c081314 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:51.129513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e796b17f-2197-4f58-8db8-99849c081314 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:51.139022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e796b17f-2197-4f58-8db8-99849c081314 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:51.139745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e796b17f-2197-4f58-8db8-99849c081314 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:51.141100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e796b17f-2197-4f58-8db8-99849c081314 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:51.142170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e796b17f-2197-4f58-8db8-99849c081314 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:51.200668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1fa3f1b0-5ce9-4245-bf15-2a96393cf1b4 tempest-FlavorsV261TestJSON-404649705 tempest-FlavorsV261TestJSON-404649705-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-146193974", "id": 501214867, "os-flavor-access:is_public": "True"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:51.202886 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:51.202886 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:49:51.234456 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1fa3f1b0-5ce9-4245-bf15-2a96393cf1b4 tempest-FlavorsV261TestJSON-404649705 tempest-FlavorsV261TestJSON-404649705-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.472372 Mar 05 20:49:51.235759 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 275/505] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 20:49:50 2022] POST /compute/v2.1/flavors => generated 464 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:49:51.245872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-841ade93-e319-4385-9eb4-50c43dafa350 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:51.248652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-841ade93-e319-4385-9eb4-50c43dafa350 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:51.261092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-841ade93-e319-4385-9eb4-50c43dafa350 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:51.261546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-841ade93-e319-4385-9eb4-50c43dafa350 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:51.262334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-841ade93-e319-4385-9eb4-50c43dafa350 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:51.262769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-841ade93-e319-4385-9eb4-50c43dafa350 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:51.343994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-841ade93-e319-4385-9eb4-50c43dafa350 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:51.354422 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-841ade93-e319-4385-9eb4-50c43dafa350 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1277 microversion: 2.1 time: 0.116165 Mar 05 20:49:51.365982 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 276/506] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:51 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:51.427995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e796b17f-2197-4f58-8db8-99849c081314 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:51.445416 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e796b17f-2197-4f58-8db8-99849c081314 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1321 microversion: 2.1 time: 0.323996 Mar 05 20:49:51.456930 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 231/507] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:51 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:51.469814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-438bd885-6174-4e99-b626-87574fd14075 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:51.470499 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-438bd885-6174-4e99-b626-87574fd14075 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:51.483429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-438bd885-6174-4e99-b626-87574fd14075 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:51.488558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-438bd885-6174-4e99-b626-87574fd14075 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:51.489428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-438bd885-6174-4e99-b626-87574fd14075 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:51.489844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-438bd885-6174-4e99-b626-87574fd14075 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:51.737753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3e963e16-63d1-4402-bce6-b8c5fc93a39c tempest-FlavorsV261TestJSON-603825210 tempest-FlavorsV261TestJSON-603825210-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:51.760698 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3e963e16-63d1-4402-bce6-b8c5fc93a39c tempest-FlavorsV261TestJSON-603825210 tempest-FlavorsV261TestJSON-603825210-project] 10.222.0.15 "GET /compute/v2.1/flavors/501214867" status: 200 len: 464 microversion: 2.61 time: 0.393129 Mar 05 20:49:51.766597 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 277/508] 10.222.0.15 () {60 vars in 1195 bytes} [Sat Mar 5 20:49:51 2022] GET /compute/v2.1/flavors/501214867 => generated 464 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:49:51.776170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b51fbdce-383d-4318-8e87-544e405ffe6f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:51.776792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b51fbdce-383d-4318-8e87-544e405ffe6f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:51.787114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b51fbdce-383d-4318-8e87-544e405ffe6f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:51.787567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b51fbdce-383d-4318-8e87-544e405ffe6f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:51.794270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b51fbdce-383d-4318-8e87-544e405ffe6f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:51.797395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b51fbdce-383d-4318-8e87-544e405ffe6f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:51.823305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-438bd885-6174-4e99-b626-87574fd14075 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:51.836043 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-438bd885-6174-4e99-b626-87574fd14075 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 200 len: 1314 microversion: 2.1 time: 0.374324 Mar 05 20:49:51.836746 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 232/509] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:51 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:51.841390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d2c845fc-60b0-4f3a-88a0-59d186e278c6 tempest-FlavorsV261TestJSON-404649705 tempest-FlavorsV261TestJSON-404649705-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:51.842772 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:51.842772 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:51.903173 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d2c845fc-60b0-4f3a-88a0-59d186e278c6 tempest-FlavorsV261TestJSON-404649705 tempest-FlavorsV261TestJSON-404649705-project-admin] 10.222.0.15 "PUT /compute/v2.1/flavors/501214867" status: 200 len: 465 microversion: 2.61 time: 0.064325 Mar 05 20:49:51.912430 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 233/510] 10.222.0.15 () {62 vars in 1215 bytes} [Sat Mar 5 20:49:51 2022] PUT /compute/v2.1/flavors/501214867 => generated 465 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:49:51.932911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-89ab6bf6-1027-4eb9-8047-6fd84ccadf0b tempest-FlavorsV261TestJSON-603825210 tempest-FlavorsV261TestJSON-603825210-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:52.002109 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-89ab6bf6-1027-4eb9-8047-6fd84ccadf0b tempest-FlavorsV261TestJSON-603825210 tempest-FlavorsV261TestJSON-603825210-project] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 7148 microversion: 2.61 time: 0.080079 Mar 05 20:49:52.009027 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 234/511] 10.222.0.15 () {60 vars in 1186 bytes} [Sat Mar 5 20:49:51 2022] GET /compute/v2.1/flavors/detail => generated 7148 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:49:52.028486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3548b1bf-c28d-4c75-88fc-bf79d4bdadb1 tempest-FlavorsV261TestJSON-603825210 tempest-FlavorsV261TestJSON-603825210-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:52.048348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b51fbdce-383d-4318-8e87-544e405ffe6f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:52.051959 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3548b1bf-c28d-4c75-88fc-bf79d4bdadb1 tempest-FlavorsV261TestJSON-603825210 tempest-FlavorsV261TestJSON-603825210-project] 10.222.0.15 "GET /compute/v2.1/flavors" status: 200 len: 3675 microversion: 2.61 time: 0.027076 Mar 05 20:49:52.053116 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 235/512] 10.222.0.15 () {60 vars in 1165 bytes} [Sat Mar 5 20:49:52 2022] GET /compute/v2.1/flavors => generated 3675 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:49:52.067397 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b51fbdce-383d-4318-8e87-544e405ffe6f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1469 microversion: 2.1 time: 0.297605 Mar 05 20:49:52.070285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-553949a6-26b2-4428-bcfe-fcfad9107660 tempest-FlavorsV261TestJSON-404649705 tempest-FlavorsV261TestJSON-404649705-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:52.071291 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:49:52.071291 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:49:52.072478 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 278/513] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:51 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1469 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:52.095520 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-553949a6-26b2-4428-bcfe-fcfad9107660 tempest-FlavorsV261TestJSON-404649705 tempest-FlavorsV261TestJSON-404649705-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/501214867" status: 202 len: 0 microversion: 2.61 time: 0.030851 Mar 05 20:49:52.104122 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 236/514] 10.222.0.15 () {60 vars in 1198 bytes} [Sat Mar 5 20:49:52 2022] DELETE /compute/v2.1/flavors/501214867 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:49:52.112598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e90b3c02-7ca4-4996-9b4b-9e05e17e56ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:52.113227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e90b3c02-7ca4-4996-9b4b-9e05e17e56ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:52.119274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e90b3c02-7ca4-4996-9b4b-9e05e17e56ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:52.119982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e90b3c02-7ca4-4996-9b4b-9e05e17e56ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:52.120773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e90b3c02-7ca4-4996-9b4b-9e05e17e56ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:52.121212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e90b3c02-7ca4-4996-9b4b-9e05e17e56ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:52.217094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-efe562c1-8872-4530-b8c7-f29a60029c13 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Calling method '.version_select at 0x7fed5ce534c0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:52.290709 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-efe562c1-8872-4530-b8c7-f29a60029c13 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81" status: 200 len: 371 microversion: 2.1 time: 0.217136 Mar 05 20:49:52.291298 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 279/515] 10.222.0.15 () {58 vars in 1241 bytes} [Sat Mar 5 20:49:52 2022] GET /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81 => generated 371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:52.297186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ef42479c-6bf5-4e09-a919-3da26993f1f8 tempest-FlavorsV261TestJSON-404649705 tempest-FlavorsV261TestJSON-404649705-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:52.317882 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ef42479c-6bf5-4e09-a919-3da26993f1f8 tempest-FlavorsV261TestJSON-404649705 tempest-FlavorsV261TestJSON-404649705-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 6693 microversion: 2.61 time: 0.024934 Mar 05 20:49:52.323804 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 280/516] 10.222.0.15 () {60 vars in 1186 bytes} [Sat Mar 5 20:49:52 2022] GET /compute/v2.1/flavors/detail => generated 6693 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:49:52.327816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e4de086b-ebf9-4b93-acdb-bb9af01e8ebe req-f414acf7-97a1-4f13-820e-fcd748221a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1f3af1-178f-48ef-84cf-406044a37585", "name": "network-vif-plugged", "status": "completed", "tag": "231b7fe1-ac2c-471c-96ed-df1619c4cf5c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:52.338924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e4de086b-ebf9-4b93-acdb-bb9af01e8ebe req-f414acf7-97a1-4f13-820e-fcd748221a5d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:52.339948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e4de086b-ebf9-4b93-acdb-bb9af01e8ebe req-f414acf7-97a1-4f13-820e-fcd748221a5d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:52.352722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e90b3c02-7ca4-4996-9b4b-9e05e17e56ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:52.362666 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e90b3c02-7ca4-4996-9b4b-9e05e17e56ea tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1469 microversion: 2.1 time: 0.254403 Mar 05 20:49:52.363370 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 237/517] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:52 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1469 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:52.375552 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e4de086b-ebf9-4b93-acdb-bb9af01e8ebe req-f414acf7-97a1-4f13-820e-fcd748221a5d service nova] Creating event network-vif-plugged:231b7fe1-ac2c-471c-96ed-df1619c4cf5c for instance 7f1f3af1-178f-48ef-84cf-406044a37585 on nch1-master-1 Mar 05 20:49:52.375552 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e4de086b-ebf9-4b93-acdb-bb9af01e8ebe req-f414acf7-97a1-4f13-820e-fcd748221a5d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053207 Mar 05 20:49:52.377321 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 281/518] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:52.380127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-25f94ea8-9bf8-462f-8517-77433d6f4bde tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Action: 'update', calling method: .version_select at 0x7fed5cde23a0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:52.414540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-08a06561-3ad4-4bb5-864a-04ff89d61a3d tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:52.415295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-08a06561-3ad4-4bb5-864a-04ff89d61a3d tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:52.424058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-08a06561-3ad4-4bb5-864a-04ff89d61a3d tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:52.425146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-08a06561-3ad4-4bb5-864a-04ff89d61a3d tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:52.426471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-08a06561-3ad4-4bb5-864a-04ff89d61a3d tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:52.427356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-08a06561-3ad4-4bb5-864a-04ff89d61a3d tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:52.543376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25f94ea8-9bf8-462f-8517-77433d6f4bde tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:52.544045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25f94ea8-9bf8-462f-8517-77433d6f4bde tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:52.545131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25f94ea8-9bf8-462f-8517-77433d6f4bde tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:52.545932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25f94ea8-9bf8-462f-8517-77433d6f4bde tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:52.648392 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-25f94ea8-9bf8-462f-8517-77433d6f4bde tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81" status: 200 len: 328 microversion: 2.1 time: 0.283559 Mar 05 20:49:52.649886 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 238/519] 10.222.0.15 () {60 vars in 1261 bytes} [Sat Mar 5 20:49:52 2022] PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81 => generated 328 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:52.657227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2d917a13-5f5b-43fd-80e7-141bf6a91d3a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:52.659179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2d917a13-5f5b-43fd-80e7-141bf6a91d3a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: d13582ed-3ac6-46fe-9e71-a3af018d2402] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:52.680423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d917a13-5f5b-43fd-80e7-141bf6a91d3a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:52.682700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d917a13-5f5b-43fd-80e7-141bf6a91d3a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:52.683688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d917a13-5f5b-43fd-80e7-141bf6a91d3a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:52.685797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d917a13-5f5b-43fd-80e7-141bf6a91d3a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:52.696168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-08a06561-3ad4-4bb5-864a-04ff89d61a3d tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:52.718187 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-08a06561-3ad4-4bb5-864a-04ff89d61a3d tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1319 microversion: 2.1 time: 0.339435 Mar 05 20:49:52.719090 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 282/520] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:52 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:52.737903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d9f8b2b-df4a-4357-9ee8-3e04ed85e5d2 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:52.738596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7d9f8b2b-df4a-4357-9ee8-3e04ed85e5d2 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:52.746786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d9f8b2b-df4a-4357-9ee8-3e04ed85e5d2 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:52.747343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d9f8b2b-df4a-4357-9ee8-3e04ed85e5d2 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:52.748342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d9f8b2b-df4a-4357-9ee8-3e04ed85e5d2 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:52.748885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d9f8b2b-df4a-4357-9ee8-3e04ed85e5d2 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:53.036122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d9f8b2b-df4a-4357-9ee8-3e04ed85e5d2 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:53.048951 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7d9f8b2b-df4a-4357-9ee8-3e04ed85e5d2 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1321 microversion: 2.1 time: 0.316378 Mar 05 20:49:53.049558 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 283/521] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:52 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:53.261491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1079475972", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:53.323467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:53.376912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d917a13-5f5b-43fd-80e7-141bf6a91d3a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:53.384694 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2d917a13-5f5b-43fd-80e7-141bf6a91d3a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402" status: 200 len: 1469 microversion: 2.1 time: 0.732073 Mar 05 20:49:53.385544 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 239/522] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:52 2022] GET /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402 => generated 1469 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:53.390591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1bbf6967-98cc-446e-be54-c9bb91ccba8b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:53.392177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1bbf6967-98cc-446e-be54-c9bb91ccba8b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:53.398231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bbf6967-98cc-446e-be54-c9bb91ccba8b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:53.398907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bbf6967-98cc-446e-be54-c9bb91ccba8b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:53.399938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bbf6967-98cc-446e-be54-c9bb91ccba8b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:53.400561 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bbf6967-98cc-446e-be54-c9bb91ccba8b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:53.627000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:53.628078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:53.628835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:53.629530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:53.630157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:53.644769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:53.647555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:53.648455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:53.648909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:53.680752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Getting quotas for project 919ba8f1159b4d3c9792c0d7ea550d81. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:53.686167 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Getting quotas for user b677e8e9aee742869ae5817278e352eb and project 919ba8f1159b4d3c9792c0d7ea550d81. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:53.698479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.utils [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] cores quota exceeded for 919ba8f1159b4d3c9792c0d7ea550d81, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=141479) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Mar 05 20:49:53.699634 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Mar 05 20:49:53.700474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:53.701487 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b1105650-2762-4fcd-b193-b257b71afb3c tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.646184 Mar 05 20:49:53.706707 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 284/523] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:53 2022] POST /compute/v2.1/servers => generated 111 bytes in 652 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:53.712597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2b2a7197-a37b-4cbe-9d6a-305dcbfbdc42 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:53.713247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2b2a7197-a37b-4cbe-9d6a-305dcbfbdc42 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:53.720315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b2a7197-a37b-4cbe-9d6a-305dcbfbdc42 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:53.721052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b2a7197-a37b-4cbe-9d6a-305dcbfbdc42 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:53.721731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b2a7197-a37b-4cbe-9d6a-305dcbfbdc42 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:53.722178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b2a7197-a37b-4cbe-9d6a-305dcbfbdc42 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:53.782664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1bbf6967-98cc-446e-be54-c9bb91ccba8b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:53.793407 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1bbf6967-98cc-446e-be54-c9bb91ccba8b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 200 len: 1314 microversion: 2.1 time: 0.406485 Mar 05 20:49:53.794243 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 240/524] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:53 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:53.800009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-df52c73a-9a40-45a5-970b-2b7d957182d0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:53.812025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-df52c73a-9a40-45a5-970b-2b7d957182d0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:53.812835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-df52c73a-9a40-45a5-970b-2b7d957182d0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Searching by: {'reservation_id': 'r-so1d0yf0', 'deleted': False, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:49:53.821818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df52c73a-9a40-45a5-970b-2b7d957182d0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:53.822497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df52c73a-9a40-45a5-970b-2b7d957182d0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:53.823447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df52c73a-9a40-45a5-970b-2b7d957182d0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:53.824063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df52c73a-9a40-45a5-970b-2b7d957182d0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:53.917573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2b2a7197-a37b-4cbe-9d6a-305dcbfbdc42 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:53.927043 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2b2a7197-a37b-4cbe-9d6a-305dcbfbdc42 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1469 microversion: 2.1 time: 0.219194 Mar 05 20:49:53.933722 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 285/525] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:53 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:53.950324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-37c57498-333e-4533-99de-74588ae100e9 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Action: 'update', calling method: .version_select at 0x7fed5cd48940>, body: {"quota_set": {"cores": 20}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:54.083531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-df52c73a-9a40-45a5-970b-2b7d957182d0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:49:54.259318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-df52c73a-9a40-45a5-970b-2b7d957182d0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:54.281556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df52c73a-9a40-45a5-970b-2b7d957182d0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:54.283445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df52c73a-9a40-45a5-970b-2b7d957182d0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:54.325371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-37c57498-333e-4533-99de-74588ae100e9 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:54.326588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-37c57498-333e-4533-99de-74588ae100e9 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:54.328758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-37c57498-333e-4533-99de-74588ae100e9 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:54.330265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-37c57498-333e-4533-99de-74588ae100e9 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:54.405680 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-37c57498-333e-4533-99de-74588ae100e9 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81" status: 200 len: 329 microversion: 2.1 time: 0.462022 Mar 05 20:49:54.407156 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 286/526] 10.222.0.15 () {60 vars in 1261 bytes} [Sat Mar 5 20:49:53 2022] PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81 => generated 329 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:54.412379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-716f8adf-3590-4e4c-bf29-5c19c263723b tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:54.413188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-716f8adf-3590-4e4c-bf29-5c19c263723b tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:54.419898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-716f8adf-3590-4e4c-bf29-5c19c263723b tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:54.420355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-716f8adf-3590-4e4c-bf29-5c19c263723b tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:54.421135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-716f8adf-3590-4e4c-bf29-5c19c263723b tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:54.421593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-716f8adf-3590-4e4c-bf29-5c19c263723b tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:54.588448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-716f8adf-3590-4e4c-bf29-5c19c263723b tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:54.597296 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-716f8adf-3590-4e4c-bf29-5c19c263723b tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1319 microversion: 2.1 time: 0.188844 Mar 05 20:49:54.598216 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 287/527] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:54 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:54.603709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1789a559-6a3f-4c97-b2d2-49df7feef5bc tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:54.604601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1789a559-6a3f-4c97-b2d2-49df7feef5bc tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:54.612652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1789a559-6a3f-4c97-b2d2-49df7feef5bc tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:54.614207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1789a559-6a3f-4c97-b2d2-49df7feef5bc tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:54.615633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1789a559-6a3f-4c97-b2d2-49df7feef5bc tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:54.616463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1789a559-6a3f-4c97-b2d2-49df7feef5bc tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:54.663386 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-df52c73a-9a40-45a5-970b-2b7d957182d0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/detail?reservation_id=r-so1d0yf0" status: 200 len: 2931 microversion: 2.1 time: 0.867593 Mar 05 20:49:54.664897 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 241/528] 10.222.0.15 () {58 vars in 1196 bytes} [Sat Mar 5 20:49:53 2022] GET /compute/v2.1/servers/detail?reservation_id=r-so1d0yf0 => generated 2931 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:54.672129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a728460f-b337-4507-a331-686d784285f5 req-11574eb7-027a-4c87-9874-a4819f3a7ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f230ca64-ecae-4706-a59a-45da927e38a9", "tag": "f735b1e1-9320-4212-b3ea-1aa7016452b8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:54.686249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a728460f-b337-4507-a331-686d784285f5 req-11574eb7-027a-4c87-9874-a4819f3a7ea7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:54.686696 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a728460f-b337-4507-a331-686d784285f5 req-11574eb7-027a-4c87-9874-a4819f3a7ea7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:54.698509 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a728460f-b337-4507-a331-686d784285f5 req-11574eb7-027a-4c87-9874-a4819f3a7ea7 service nova] Creating event network-changed:f735b1e1-9320-4212-b3ea-1aa7016452b8 for instance f230ca64-ecae-4706-a59a-45da927e38a9 on nch1-master-1 Mar 05 20:49:54.704870 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a728460f-b337-4507-a331-686d784285f5 req-11574eb7-027a-4c87-9874-a4819f3a7ea7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037493 Mar 05 20:49:54.706800 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 242/529] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:54.714645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-83a75ac0-6a2c-4abd-b353-df18dd372b0c req-9f0e1ca2-4fe3-4024-af19-9bf827eadd40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c46afc9-db69-4609-a26c-acf26b922ce7", "name": "network-vif-plugged", "status": "completed", "tag": "5cfde395-3c68-4fc7-a3b1-d62814d069b8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:54.726460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-83a75ac0-6a2c-4abd-b353-df18dd372b0c req-9f0e1ca2-4fe3-4024-af19-9bf827eadd40 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:54.727120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-83a75ac0-6a2c-4abd-b353-df18dd372b0c req-9f0e1ca2-4fe3-4024-af19-9bf827eadd40 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:54.740626 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-83a75ac0-6a2c-4abd-b353-df18dd372b0c req-9f0e1ca2-4fe3-4024-af19-9bf827eadd40 service nova] Creating event network-vif-plugged:5cfde395-3c68-4fc7-a3b1-d62814d069b8 for instance 3c46afc9-db69-4609-a26c-acf26b922ce7 on nch1-master-1 Mar 05 20:49:54.746238 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-83a75ac0-6a2c-4abd-b353-df18dd372b0c req-9f0e1ca2-4fe3-4024-af19-9bf827eadd40 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037576 Mar 05 20:49:54.747178 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 243/530] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:54.754601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ad167956-295b-4d72-b3cf-fdb269c3d3b9 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Calling method '.version_select at 0x7fed5cf30e50>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:54.802538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1789a559-6a3f-4c97-b2d2-49df7feef5bc tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:54.810312 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1789a559-6a3f-4c97-b2d2-49df7feef5bc tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1321 microversion: 2.1 time: 0.210824 Mar 05 20:49:54.812454 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 288/531] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:54 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:54.817894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a5179e17-9135-4452-b954-d9a464725068 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:54.842177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.compute.server_groups [None req-a5179e17-9135-4452-b954-d9a464725068 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Querying cell 591cc087-7d9b-4967-a4cd-9c96e8077593(cell1) for 2 instances {{(pid=141479) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 05 20:49:54.843588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a5179e17-9135-4452-b954-d9a464725068 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:54.844267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a5179e17-9135-4452-b954-d9a464725068 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:54.881841 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a5179e17-9135-4452-b954-d9a464725068 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/os-server-groups/61eb2945-c0e1-4883-981b-181a2824a316" status: 200 len: 266 microversion: 2.1 time: 0.068459 Mar 05 20:49:54.888094 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 289/532] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:49:54 2022] GET /compute/v2.1/os-server-groups/61eb2945-c0e1-4883-981b-181a2824a316 => generated 266 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:54.893269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1d9750f2-9531-40dc-976c-dc691dbbda2a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:54.894706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1d9750f2-9531-40dc-976c-dc691dbbda2a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:54.901495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d9750f2-9531-40dc-976c-dc691dbbda2a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:54.902152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d9750f2-9531-40dc-976c-dc691dbbda2a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:54.903093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d9750f2-9531-40dc-976c-dc691dbbda2a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:54.903716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d9750f2-9531-40dc-976c-dc691dbbda2a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.090937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1d9750f2-9531-40dc-976c-dc691dbbda2a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:55.101676 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1d9750f2-9531-40dc-976c-dc691dbbda2a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 200 len: 1464 microversion: 2.1 time: 0.212203 Mar 05 20:49:55.104247 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 290/533] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:54 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 1464 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:55.109940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6de5e2ff-e841-454b-aeb9-38753a186ce7 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:55.111177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6de5e2ff-e841-454b-aeb9-38753a186ce7 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:55.119377 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6de5e2ff-e841-454b-aeb9-38753a186ce7 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.119878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6de5e2ff-e841-454b-aeb9-38753a186ce7 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.120633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6de5e2ff-e841-454b-aeb9-38753a186ce7 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.121074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6de5e2ff-e841-454b-aeb9-38753a186ce7 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.165733 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ad167956-295b-4d72-b3cf-fdb269c3d3b9 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81" status: 200 len: 371 microversion: 2.1 time: 0.416987 Mar 05 20:49:55.166327 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 244/534] 10.222.0.15 () {58 vars in 1241 bytes} [Sat Mar 5 20:49:54 2022] GET /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81 => generated 371 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:55.171456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2520bc3c-dc83-43fb-a25a-fc244365e15c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:55.172118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2520bc3c-dc83-43fb-a25a-fc244365e15c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:55.179406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2520bc3c-dc83-43fb-a25a-fc244365e15c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.179935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2520bc3c-dc83-43fb-a25a-fc244365e15c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.180708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2520bc3c-dc83-43fb-a25a-fc244365e15c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.181149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2520bc3c-dc83-43fb-a25a-fc244365e15c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.263958 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6de5e2ff-e841-454b-aeb9-38753a186ce7 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1620 microversion: 2.1 time: 0.157814 Mar 05 20:49:55.265260 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 291/535] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:55 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1620 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:55.403213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2520bc3c-dc83-43fb-a25a-fc244365e15c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:55.414010 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2520bc3c-dc83-43fb-a25a-fc244365e15c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.246402 Mar 05 20:49:55.414654 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 245/536] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:55 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:55.420739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b27dee19-1102-4d38-80f6-9e780fc2d88b tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Action: 'update', calling method: .version_select at 0x7fed5ce089d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:55.522347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5bdcb84f-132c-49c1-b4cf-5673cdff5e08 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:55.526904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5bdcb84f-132c-49c1-b4cf-5673cdff5e08 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Searching by: {'deleted': False, 'project_id': '76ee1cf3cff9473c888e35db68368b8c'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:49:55.539289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bdcb84f-132c-49c1-b4cf-5673cdff5e08 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.540095 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bdcb84f-132c-49c1-b4cf-5673cdff5e08 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.541311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bdcb84f-132c-49c1-b4cf-5673cdff5e08 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.541900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bdcb84f-132c-49c1-b4cf-5673cdff5e08 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.656493 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5bdcb84f-132c-49c1-b4cf-5673cdff5e08 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.389397 Mar 05 20:49:55.657635 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 292/537] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:49:55 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:49:55.662590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d78f664f-8491-4cc9-811e-15fb229cb115 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:55.663348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d78f664f-8491-4cc9-811e-15fb229cb115 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] [instance: d13582ed-3ac6-46fe-9e71-a3af018d2402] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:55.670361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d78f664f-8491-4cc9-811e-15fb229cb115 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.670870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d78f664f-8491-4cc9-811e-15fb229cb115 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.671653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d78f664f-8491-4cc9-811e-15fb229cb115 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.672117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d78f664f-8491-4cc9-811e-15fb229cb115 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.731047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b27dee19-1102-4d38-80f6-9e780fc2d88b tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.731653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b27dee19-1102-4d38-80f6-9e780fc2d88b tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.732506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b27dee19-1102-4d38-80f6-9e780fc2d88b tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.732948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b27dee19-1102-4d38-80f6-9e780fc2d88b tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.789534 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b27dee19-1102-4d38-80f6-9e780fc2d88b tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81" status: 200 len: 328 microversion: 2.1 time: 0.373731 Mar 05 20:49:55.790332 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 246/538] 10.222.0.15 () {60 vars in 1261 bytes} [Sat Mar 5 20:49:55 2022] PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81 => generated 328 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:55.795310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bce5c592-1b92-4f54-8ba0-19cf5231f73c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:55.796181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bce5c592-1b92-4f54-8ba0-19cf5231f73c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:55.814777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bce5c592-1b92-4f54-8ba0-19cf5231f73c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.819947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bce5c592-1b92-4f54-8ba0-19cf5231f73c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.829823 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d78f664f-8491-4cc9-811e-15fb229cb115 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402" status: 200 len: 1620 microversion: 2.1 time: 0.169623 Mar 05 20:49:55.830764 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 293/539] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:55 2022] GET /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402 => generated 1620 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:55.831940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bce5c592-1b92-4f54-8ba0-19cf5231f73c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.832673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bce5c592-1b92-4f54-8ba0-19cf5231f73c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.845431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4a96675e-44ad-4fc8-9812-ca32d8c67ebd tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:55.850924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4a96675e-44ad-4fc8-9812-ca32d8c67ebd tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Searching by: {'deleted': False} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:49:55.856765 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a96675e-44ad-4fc8-9812-ca32d8c67ebd tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.857414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a96675e-44ad-4fc8-9812-ca32d8c67ebd tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.858398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a96675e-44ad-4fc8-9812-ca32d8c67ebd tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:55.858982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a96675e-44ad-4fc8-9812-ca32d8c67ebd tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:55.978395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-4a96675e-44ad-4fc8-9812-ca32d8c67ebd tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:49:56.062906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bce5c592-1b92-4f54-8ba0-19cf5231f73c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:56.071120 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bce5c592-1b92-4f54-8ba0-19cf5231f73c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1319 microversion: 2.1 time: 0.279464 Mar 05 20:49:56.071808 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 247/540] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:55 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:56.084974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ca058efa-0cf2-4338-96a8-a097ec4b136c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:56.085589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ca058efa-0cf2-4338-96a8-a097ec4b136c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:56.092505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca058efa-0cf2-4338-96a8-a097ec4b136c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:56.092966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca058efa-0cf2-4338-96a8-a097ec4b136c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:56.093747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca058efa-0cf2-4338-96a8-a097ec4b136c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:56.094370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca058efa-0cf2-4338-96a8-a097ec4b136c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:56.103152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a96675e-44ad-4fc8-9812-ca32d8c67ebd tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:56.103608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a96675e-44ad-4fc8-9812-ca32d8c67ebd tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:56.234905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ca058efa-0cf2-4338-96a8-a097ec4b136c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:56.242254 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ca058efa-0cf2-4338-96a8-a097ec4b136c tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1321 microversion: 2.1 time: 0.169331 Mar 05 20:49:56.242823 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 248/541] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:56 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:56.247211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8b9aa080-1320-4df4-8f58-160e1285977d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Action: 'create', calling method: .version_select at 0x7fed5ce274c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-591971344", "policies": ["anti-affinity"]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:56.262860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8b9aa080-1320-4df4-8f58-160e1285977d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_groups'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:56.267708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8b9aa080-1320-4df4-8f58-160e1285977d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_groups'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:56.312843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8b9aa080-1320-4df4-8f58-160e1285977d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_groups'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:56.317118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8b9aa080-1320-4df4-8f58-160e1285977d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_groups'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:56.329053 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8b9aa080-1320-4df4-8f58-160e1285977d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.085069 Mar 05 20:49:56.329631 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 249/542] 10.222.0.15 () {60 vars in 1173 bytes} [Sat Mar 5 20:49:56 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:56.334264 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-775067551", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:56.403616 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4a96675e-44ad-4fc8-9812-ca32d8c67ebd tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17643 microversion: 2.1 time: 0.571956 Mar 05 20:49:56.404338 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 294/543] 10.222.0.15 () {58 vars in 1170 bytes} [Sat Mar 5 20:49:55 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17643 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:49:56.405505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4a96675e-44ad-4fc8-9812-ca32d8c67ebd tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:56.407902 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4a96675e-44ad-4fc8-9812-ca32d8c67ebd tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002515 Mar 05 20:49:56.408488 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 295/544] 10.222.0.15 () {56 vars in 885 bytes} [Sat Mar 5 20:49:56 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 05 20:49:56.428774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:56.431780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d5b07b21-e8b1-409c-ab88-cc77495b4553 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:56.436732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d5b07b21-e8b1-409c-ab88-cc77495b4553 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:56.450871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5b07b21-e8b1-409c-ab88-cc77495b4553 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:56.451596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5b07b21-e8b1-409c-ab88-cc77495b4553 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:56.452629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5b07b21-e8b1-409c-ab88-cc77495b4553 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:56.453228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5b07b21-e8b1-409c-ab88-cc77495b4553 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:56.624858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d5b07b21-e8b1-409c-ab88-cc77495b4553 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:56.633805 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d5b07b21-e8b1-409c-ab88-cc77495b4553 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.206104 Mar 05 20:49:56.634392 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 296/545] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:56 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:49:56.647454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1bce6664-24a2-4d9a-bf2a-cd760e98bc86 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:56.651192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1bce6664-24a2-4d9a-bf2a-cd760e98bc86 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Searching by: {'deleted': False, 'project_id': '76ee1cf3cff9473c888e35db68368b8c'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:49:56.656382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1bce6664-24a2-4d9a-bf2a-cd760e98bc86 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:56.656829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1bce6664-24a2-4d9a-bf2a-cd760e98bc86 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:56.658462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1bce6664-24a2-4d9a-bf2a-cd760e98bc86 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:56.658892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1bce6664-24a2-4d9a-bf2a-cd760e98bc86 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:56.667959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:56.668602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:56.669240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:56.669656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:56.670071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:56.679964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:56.680424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:56.681227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:56.681668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:56.690273 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1bce6664-24a2-4d9a-bf2a-cd760e98bc86 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/detail?tenant_id=f138bfc479e24b3d9017a7cb9e73bdd2" status: 200 len: 15 microversion: 2.1 time: 0.054838 Mar 05 20:49:56.691066 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 297/546] 10.222.0.15 () {58 vars in 1230 bytes} [Sat Mar 5 20:49:56 2022] GET /compute/v2.1/servers/detail?tenant_id=f138bfc479e24b3d9017a7cb9e73bdd2 => generated 15 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:49:56.695731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1192548376", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ae192161-3ff8-408b-8a55-08a2736d1044"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:56.699406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Getting quotas for project 919ba8f1159b4d3c9792c0d7ea550d81. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:56.706220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Getting quotas for user b677e8e9aee742869ae5817278e352eb and project 919ba8f1159b4d3c9792c0d7ea550d81. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:56.720223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.utils [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] instances quota exceeded for 919ba8f1159b4d3c9792c0d7ea550d81, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=141478) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Mar 05 20:49:56.721783 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Mar 05 20:49:56.722777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:56.724613 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9c773e38-51f9-4b6a-8d3c-8cbc5d741dc9 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.393974 Mar 05 20:49:56.725664 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 250/547] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:56 2022] POST /compute/v2.1/servers => generated 119 bytes in 395 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:56.731030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0cb9f25c-8837-42c6-adde-fb08d485ca89 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:56.743329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0cb9f25c-8837-42c6-adde-fb08d485ca89 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Searching by: {'tenant_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'deleted': False} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:49:56.751762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0cb9f25c-8837-42c6-adde-fb08d485ca89 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:56.752230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:56.752371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0cb9f25c-8837-42c6-adde-fb08d485ca89 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:56.753402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0cb9f25c-8837-42c6-adde-fb08d485ca89 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:56.753947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0cb9f25c-8837-42c6-adde-fb08d485ca89 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:56.849361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-0cb9f25c-8837-42c6-adde-fb08d485ca89 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:49:56.936269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0cb9f25c-8837-42c6-adde-fb08d485ca89 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:56.936715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0cb9f25c-8837-42c6-adde-fb08d485ca89 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:56.984695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:56.985678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:56.986152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:56.986580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:56.986990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:57.002107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.002528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:57.003515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.004116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:57.021889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:57.025927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:57.038422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Going to run 2 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:49:57.040750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 441213dc-2cba-4629-8bfc-3a01bbec6942] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:57.096721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:57.102152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:57.123139 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0cb9f25c-8837-42c6-adde-fb08d485ca89 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f138bfc479e24b3d9017a7cb9e73bdd2" status: 200 len: 4826 microversion: 2.1 time: 0.395823 Mar 05 20:49:57.138194 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 251/548] 10.222.0.15 () {58 vars in 1256 bytes} [Sat Mar 5 20:49:56 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f138bfc479e24b3d9017a7cb9e73bdd2 => generated 4826 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:57.138194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ed9bc71a-4a46-4b40-913c-1a66706afbee tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Action: 'update', calling method: .version_select at 0x7fed5ce085e0>, body: {"quota_set": {"instances": 10}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:57.168870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:57.174628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:57.189935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=441213dc-2cba-4629-8bfc-3a01bbec6942,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:49:57.256784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:57.260755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:57.296650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:57.303507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'server_group_members'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:57.338677 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4016f14d-dbe0-4137-934a-d9c925afd880 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.646790 Mar 05 20:49:57.342123 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 298/549] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:56 2022] POST /compute/v2.1/servers => generated 32 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Mar 05 20:49:57.346846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-07cf2fc4-d8a1-4392-819f-b18cf165d018 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:57.347403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-07cf2fc4-d8a1-4392-819f-b18cf165d018 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:57.354940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07cf2fc4-d8a1-4392-819f-b18cf165d018 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.355403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07cf2fc4-d8a1-4392-819f-b18cf165d018 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:57.356228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07cf2fc4-d8a1-4392-819f-b18cf165d018 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.356668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07cf2fc4-d8a1-4392-819f-b18cf165d018 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:57.415365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed9bc71a-4a46-4b40-913c-1a66706afbee tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.416194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed9bc71a-4a46-4b40-913c-1a66706afbee tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:57.417353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed9bc71a-4a46-4b40-913c-1a66706afbee tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.417672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed9bc71a-4a46-4b40-913c-1a66706afbee tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:57.493486 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ed9bc71a-4a46-4b40-913c-1a66706afbee tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81" status: 200 len: 329 microversion: 2.1 time: 0.368378 Mar 05 20:49:57.494400 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 252/550] 10.222.0.15 () {60 vars in 1261 bytes} [Sat Mar 5 20:49:57 2022] PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81 => generated 329 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:57.498778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d10042d7-4c57-4ba2-b640-a604fa60016e tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:57.504874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d10042d7-4c57-4ba2-b640-a604fa60016e tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Searching by: {'tenant_id': '76ee1cf3cff9473c888e35db68368b8c', 'deleted': False} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:49:57.522022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d10042d7-4c57-4ba2-b640-a604fa60016e tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.522473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d10042d7-4c57-4ba2-b640-a604fa60016e tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:57.523428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d10042d7-4c57-4ba2-b640-a604fa60016e tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.523979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d10042d7-4c57-4ba2-b640-a604fa60016e tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:57.551573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-07cf2fc4-d8a1-4392-819f-b18cf165d018 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:57.557436 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d10042d7-4c57-4ba2-b640-a604fa60016e tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=76ee1cf3cff9473c888e35db68368b8c" status: 200 len: 15 microversion: 2.1 time: 0.061979 Mar 05 20:49:57.570362 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 253/551] 10.222.0.15 () {58 vars in 1256 bytes} [Sat Mar 5 20:49:57 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=76ee1cf3cff9473c888e35db68368b8c => generated 15 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:49:57.570362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e57a6074-2645-4337-96c6-07d10b300ab8 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:57.570362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e57a6074-2645-4337-96c6-07d10b300ab8 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:57.572062 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-07cf2fc4-d8a1-4392-819f-b18cf165d018 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1319 microversion: 2.1 time: 0.225465 Mar 05 20:49:57.572062 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 299/552] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:57 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:57.583871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e57a6074-2645-4337-96c6-07d10b300ab8 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.584327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e57a6074-2645-4337-96c6-07d10b300ab8 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:57.584920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-806396e2-1c10-42d6-bc7e-31e457644b2d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:57.585117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e57a6074-2645-4337-96c6-07d10b300ab8 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.585531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e57a6074-2645-4337-96c6-07d10b300ab8 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:57.591539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-806396e2-1c10-42d6-bc7e-31e457644b2d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:57.592872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-806396e2-1c10-42d6-bc7e-31e457644b2d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Searching by: {'deleted': False, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:49:57.614229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-806396e2-1c10-42d6-bc7e-31e457644b2d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.614730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-806396e2-1c10-42d6-bc7e-31e457644b2d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:57.615878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-806396e2-1c10-42d6-bc7e-31e457644b2d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.616330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-806396e2-1c10-42d6-bc7e-31e457644b2d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:57.728120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-806396e2-1c10-42d6-bc7e-31e457644b2d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:49:57.780575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e57a6074-2645-4337-96c6-07d10b300ab8 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:57.788417 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e57a6074-2645-4337-96c6-07d10b300ab8 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1471 microversion: 2.1 time: 0.228851 Mar 05 20:49:57.789556 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 254/553] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:57 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:57.794222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b0dbaec4-96e0-4507-9b46-482716681239 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Calling method '.version_select at 0x7fed5cd47280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:57.819574 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-806396e2-1c10-42d6-bc7e-31e457644b2d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.246250 Mar 05 20:49:57.820094 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 300/554] 10.222.0.15 () {58 vars in 1124 bytes} [Sat Mar 5 20:49:57 2022] GET /compute/v2.1/servers => generated 1665 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:57.836310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-90d27d6a-1897-41ab-a302-0a82c60deb2b tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:57.843471 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-90d27d6a-1897-41ab-a302-0a82c60deb2b tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.021878 Mar 05 20:49:57.856371 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 301/555] 10.222.0.15 () {58 vars in 1188 bytes} [Sat Mar 5 20:49:57 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:49:57.863685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-863aa39f-97b6-4917-aeab-84ae5d834be5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:57.864458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-863aa39f-97b6-4917-aeab-84ae5d834be5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:57.873271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-863aa39f-97b6-4917-aeab-84ae5d834be5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.874667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-863aa39f-97b6-4917-aeab-84ae5d834be5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:57.875479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-863aa39f-97b6-4917-aeab-84ae5d834be5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:57.875972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-863aa39f-97b6-4917-aeab-84ae5d834be5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:58.071562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-863aa39f-97b6-4917-aeab-84ae5d834be5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:58.082712 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-863aa39f-97b6-4917-aeab-84ae5d834be5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.236382 Mar 05 20:49:58.083312 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 302/556] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:57 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:58.096316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-42f01aa0-a546-4a6c-992c-3972c58ea130 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:58.096892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-42f01aa0-a546-4a6c-992c-3972c58ea130 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:58.109271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42f01aa0-a546-4a6c-992c-3972c58ea130 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:58.109587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42f01aa0-a546-4a6c-992c-3972c58ea130 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:58.110444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42f01aa0-a546-4a6c-992c-3972c58ea130 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:58.110877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42f01aa0-a546-4a6c-992c-3972c58ea130 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:58.214863 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b0dbaec4-96e0-4507-9b46-482716681239 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81" status: 200 len: 371 microversion: 2.1 time: 0.423993 Mar 05 20:49:58.216410 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 255/557] 10.222.0.15 () {58 vars in 1241 bytes} [Sat Mar 5 20:49:57 2022] GET /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81 => generated 371 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:58.222514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-234e9fba-f8a8-4268-bca8-9fb978f3d55f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:58.223524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-234e9fba-f8a8-4268-bca8-9fb978f3d55f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:58.308144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-234e9fba-f8a8-4268-bca8-9fb978f3d55f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:58.316200 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-234e9fba-f8a8-4268-bca8-9fb978f3d55f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 200 len: 1219 microversion: 2.1 time: 0.098465 Mar 05 20:49:58.316981 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 256/558] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:58 2022] GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:58.323976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bd87dc15-82c1-47be-b5c4-9a30cd875fcc tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:58.325210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bd87dc15-82c1-47be-b5c4-9a30cd875fcc tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:58.334341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd87dc15-82c1-47be-b5c4-9a30cd875fcc tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:58.335050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd87dc15-82c1-47be-b5c4-9a30cd875fcc tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:58.336408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd87dc15-82c1-47be-b5c4-9a30cd875fcc tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:58.337165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd87dc15-82c1-47be-b5c4-9a30cd875fcc tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:58.423236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-42f01aa0-a546-4a6c-992c-3972c58ea130 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lazy-loading 'flavor' on Instance uuid 3c46afc9-db69-4609-a26c-acf26b922ce7 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:49:58.445979 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bd87dc15-82c1-47be-b5c4-9a30cd875fcc tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action" status: 202 len: 0 microversion: 2.1 time: 0.127425 Mar 05 20:49:58.446729 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 257/559] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:49:58 2022] POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:49:58.451985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-addd34cf-5197-4d15-9a5b-a80d0f6a3c73 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Action: 'update', calling method: .version_select at 0x7fed5d297b80>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:58.554188 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-42f01aa0-a546-4a6c-992c-3972c58ea130 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7/action" status: 202 len: 0 microversion: 2.1 time: 0.469229 Mar 05 20:49:58.558084 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 303/560] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:49:58 2022] POST /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:49:58.562216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-906c2d55-452c-41a4-9203-e1364add8a9c tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:58.566854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-906c2d55-452c-41a4-9203-e1364add8a9c tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:58.567827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-906c2d55-452c-41a4-9203-e1364add8a9c tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:49:58.574075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-906c2d55-452c-41a4-9203-e1364add8a9c tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:58.574636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-906c2d55-452c-41a4-9203-e1364add8a9c tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:58.575561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-906c2d55-452c-41a4-9203-e1364add8a9c tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:58.576062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-906c2d55-452c-41a4-9203-e1364add8a9c tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:58.669193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-addd34cf-5197-4d15-9a5b-a80d0f6a3c73 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:58.669743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-addd34cf-5197-4d15-9a5b-a80d0f6a3c73 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:58.670804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-addd34cf-5197-4d15-9a5b-a80d0f6a3c73 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:58.671239 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-addd34cf-5197-4d15-9a5b-a80d0f6a3c73 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:58.681478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-906c2d55-452c-41a4-9203-e1364add8a9c tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:49:58.721954 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-addd34cf-5197-4d15-9a5b-a80d0f6a3c73 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81" status: 200 len: 325 microversion: 2.1 time: 0.273837 Mar 05 20:49:58.722602 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 258/561] 10.222.0.15 () {60 vars in 1261 bytes} [Sat Mar 5 20:49:58 2022] PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81 => generated 325 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:58.738531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-92062848-1c8f-4584-87f4-d8693f02d83d tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:58.739324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-92062848-1c8f-4584-87f4-d8693f02d83d tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:58.746973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92062848-1c8f-4584-87f4-d8693f02d83d tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:58.747141 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-906c2d55-452c-41a4-9203-e1364add8a9c tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.190279 Mar 05 20:49:58.747589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92062848-1c8f-4584-87f4-d8693f02d83d tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:58.748872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92062848-1c8f-4584-87f4-d8693f02d83d tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:58.749369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92062848-1c8f-4584-87f4-d8693f02d83d tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:58.753375 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 304/562] 10.222.0.15 () {58 vars in 1149 bytes} [Sat Mar 5 20:49:58 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:49:58.758665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b08772df-b2ef-4cf6-9287-c56780ccd58e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:58.759470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b08772df-b2ef-4cf6-9287-c56780ccd58e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:58.766726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b08772df-b2ef-4cf6-9287-c56780ccd58e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:58.767403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b08772df-b2ef-4cf6-9287-c56780ccd58e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:58.768456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b08772df-b2ef-4cf6-9287-c56780ccd58e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:58.769028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b08772df-b2ef-4cf6-9287-c56780ccd58e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:58.961632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b08772df-b2ef-4cf6-9287-c56780ccd58e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:58.974292 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b08772df-b2ef-4cf6-9287-c56780ccd58e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1319 microversion: 2.1 time: 0.219646 Mar 05 20:49:58.979533 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 305/563] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:58 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:58.990354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-28b6a64b-1fe9-4aa0-81ae-9db1509527d0 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:58.991812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-28b6a64b-1fe9-4aa0-81ae-9db1509527d0 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:59.010291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28b6a64b-1fe9-4aa0-81ae-9db1509527d0 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:59.010759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28b6a64b-1fe9-4aa0-81ae-9db1509527d0 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:59.011783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28b6a64b-1fe9-4aa0-81ae-9db1509527d0 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:59.012388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28b6a64b-1fe9-4aa0-81ae-9db1509527d0 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:59.093352 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-92062848-1c8f-4584-87f4-d8693f02d83d tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1630 microversion: 2.1 time: 0.360298 Mar 05 20:49:59.106664 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 259/564] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:58 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1630 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:59.137340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1523761298", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:59.169153 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-28b6a64b-1fe9-4aa0-81ae-9db1509527d0 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action" status: 202 len: 0 microversion: 2.1 time: 0.186838 Mar 05 20:49:59.174473 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 306/565] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:49:58 2022] POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:49:59.187639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f220fb04-a762-4b96-a0ca-a496bec40dba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:59.193976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f220fb04-a762-4b96-a0ca-a496bec40dba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:59.206323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f220fb04-a762-4b96-a0ca-a496bec40dba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:59.206929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f220fb04-a762-4b96-a0ca-a496bec40dba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:59.207908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f220fb04-a762-4b96-a0ca-a496bec40dba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:59.208403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f220fb04-a762-4b96-a0ca-a496bec40dba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:59.235141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:49:59.600571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f220fb04-a762-4b96-a0ca-a496bec40dba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:59.614478 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f220fb04-a762-4b96-a0ca-a496bec40dba tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.438916 Mar 05 20:49:59.615298 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 307/566] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:59 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:59.619990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0211ec4-91bc-4f5b-af13-fa0ce7878704 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:59.620764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e0211ec4-91bc-4f5b-af13-fa0ce7878704 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:59.631658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:49:59.632525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:49:59.632998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:49:59.633398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:49:59.633807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:49:59.640854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0211ec4-91bc-4f5b-af13-fa0ce7878704 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:59.641954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0211ec4-91bc-4f5b-af13-fa0ce7878704 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:59.643056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0211ec4-91bc-4f5b-af13-fa0ce7878704 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:59.643573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0211ec4-91bc-4f5b-af13-fa0ce7878704 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:59.647489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:59.647965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:59.650019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:59.650498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:59.696665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Getting quotas for project 919ba8f1159b4d3c9792c0d7ea550d81. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:49:59.701509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Getting quotas for user b677e8e9aee742869ae5817278e352eb and project 919ba8f1159b4d3c9792c0d7ea550d81. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:49:59.718405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.utils [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] ram quota exceeded for 919ba8f1159b4d3c9792c0d7ea550d81, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=141478) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Mar 05 20:49:59.719270 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Mar 05 20:49:59.720285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:49:59.721371 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8f7e7add-9112-4f16-8868-fdc10ae5ae2f tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.620913 Mar 05 20:49:59.725382 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 260/567] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:49:59 2022] POST /compute/v2.1/servers => generated 110 bytes in 627 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:49:59.731104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f9060d6c-de33-4afb-8f6f-c79a1cb620bf tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:49:59.731918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f9060d6c-de33-4afb-8f6f-c79a1cb620bf tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:49:59.739935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9060d6c-de33-4afb-8f6f-c79a1cb620bf tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:59.740750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9060d6c-de33-4afb-8f6f-c79a1cb620bf tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:59.741817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9060d6c-de33-4afb-8f6f-c79a1cb620bf tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:49:59.742401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9060d6c-de33-4afb-8f6f-c79a1cb620bf tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:49:59.882674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f9060d6c-de33-4afb-8f6f-c79a1cb620bf tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:49:59.900264 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f9060d6c-de33-4afb-8f6f-c79a1cb620bf tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 200 len: 1277 microversion: 2.1 time: 0.171660 Mar 05 20:49:59.901420 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 261/568] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:59 2022] GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:49:59.910796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5525a13f-11ac-431f-8cab-45cff357d0e6 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Action: 'update', calling method: .version_select at 0x7fed5cd47310>, body: {"quota_set": {"ram": 51200}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:49:59.925697 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0211ec4-91bc-4f5b-af13-fa0ce7878704 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1614 microversion: 2.1 time: 0.309141 Mar 05 20:49:59.926442 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 308/569] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:49:59 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1614 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:00.059729 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9a5aa11d-9c4f-4258-8c41-892ee0b5555b tempest-NetworksTest-540911942 tempest-NetworksTest-540911942-project-admin] Calling method '.version_select at 0x7fed5d09a0d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:00.121111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5525a13f-11ac-431f-8cab-45cff357d0e6 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:00.121630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5525a13f-11ac-431f-8cab-45cff357d0e6 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:00.122333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5525a13f-11ac-431f-8cab-45cff357d0e6 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:00.122761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5525a13f-11ac-431f-8cab-45cff357d0e6 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:00.177766 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5525a13f-11ac-431f-8cab-45cff357d0e6 tempest-QuotasAdminNegativeTest-1213244595 tempest-QuotasAdminNegativeTest-1213244595-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81" status: 200 len: 329 microversion: 2.1 time: 0.274813 Mar 05 20:50:00.184861 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 262/570] 10.222.0.15 () {60 vars in 1261 bytes} [Sat Mar 5 20:49:59 2022] PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81 => generated 329 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:00.185657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74346ca9-3310-4af2-ab40-a73e8aab7b93 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:00.186287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-74346ca9-3310-4af2-ab40-a73e8aab7b93 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:00.193228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74346ca9-3310-4af2-ab40-a73e8aab7b93 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:00.193564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74346ca9-3310-4af2-ab40-a73e8aab7b93 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:00.194341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74346ca9-3310-4af2-ab40-a73e8aab7b93 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:00.194777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74346ca9-3310-4af2-ab40-a73e8aab7b93 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:00.281850 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9a5aa11d-9c4f-4258-8c41-892ee0b5555b tempest-NetworksTest-540911942 tempest-NetworksTest-540911942-project-admin] 10.222.0.15 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.354384 Mar 05 20:50:00.282437 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 309/571] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:49:59 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:00.287265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6d52c608-5606-4658-997e-5daef698cd46 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:00.288225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6d52c608-5606-4658-997e-5daef698cd46 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:00.308777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d52c608-5606-4658-997e-5daef698cd46 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:00.309236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d52c608-5606-4658-997e-5daef698cd46 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:00.310398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d52c608-5606-4658-997e-5daef698cd46 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:00.310844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d52c608-5606-4658-997e-5daef698cd46 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:00.464947 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-74346ca9-3310-4af2-ab40-a73e8aab7b93 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1614 microversion: 2.1 time: 0.285501 Mar 05 20:50:00.468534 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 263/572] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:00 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1614 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:00.474218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7ac12676-f473-411a-860e-1880c543113b tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:00.474934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7ac12676-f473-411a-860e-1880c543113b tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:00.494765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ac12676-f473-411a-860e-1880c543113b tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:00.495367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ac12676-f473-411a-860e-1880c543113b tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:00.496302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ac12676-f473-411a-860e-1880c543113b tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:00.500338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ac12676-f473-411a-860e-1880c543113b tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:00.789233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6d52c608-5606-4658-997e-5daef698cd46 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:00.801821 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6d52c608-5606-4658-997e-5daef698cd46 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1319 microversion: 2.1 time: 0.517921 Mar 05 20:50:00.815194 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 310/573] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:00 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:00.822255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3a8cda66-da02-495c-a341-df51b81db032 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Action: 'update', calling method: .version_select at 0x7fed5ce6aaf0>, body: {"quota_set": {"ram": 0}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:00.826594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3a8cda66-da02-495c-a341-df51b81db032 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'b677e8e9aee742869ae5817278e352eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919ba8f1159b4d3c9792c0d7ea550d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:00.828131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3a8cda66-da02-495c-a341-df51b81db032 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:00.829945 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3a8cda66-da02-495c-a341-df51b81db032 tempest-QuotasAdminNegativeTest-1055502458 tempest-QuotasAdminNegativeTest-1055502458-project] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81" status: 403 len: 116 microversion: 2.1 time: 0.012221 Mar 05 20:50:00.840380 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 311/574] 10.222.0.15 () {60 vars in 1261 bytes} [Sat Mar 5 20:50:00 2022] PUT /compute/v2.1/os-quota-sets/919ba8f1159b4d3c9792c0d7ea550d81 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:50:00.848042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c7660148-ebee-433e-a5b7-bb9758500947 tempest-NetworksTest-540911942 tempest-NetworksTest-540911942-project-admin] Calling method '.version_select at 0x7fed5cee5d30>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:01.051732 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7ac12676-f473-411a-860e-1880c543113b tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1613 microversion: 2.1 time: 0.580883 Mar 05 20:50:01.052633 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 264/575] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:00 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1613 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:01.059212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c289fe1-d739-46b7-922f-1c78f3d87538 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:01.065726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c289fe1-d739-46b7-922f-1c78f3d87538 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:50:01.079603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c289fe1-d739-46b7-922f-1c78f3d87538 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:01.080378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c289fe1-d739-46b7-922f-1c78f3d87538 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:01.081392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c289fe1-d739-46b7-922f-1c78f3d87538 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:01.082010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c289fe1-d739-46b7-922f-1c78f3d87538 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:01.215379 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c7660148-ebee-433e-a5b7-bb9758500947 tempest-NetworksTest-540911942 tempest-NetworksTest-540911942-project-admin] 10.222.0.15 "GET /compute/v2.1/os-networks/8f09a79f-b6b0-4bcb-886e-948c40f55161" status: 200 len: 652 microversion: 2.1 time: 0.372766 Mar 05 20:50:01.215988 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 312/576] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 20:50:00 2022] GET /compute/v2.1/os-networks/8f09a79f-b6b0-4bcb-886e-948c40f55161 => generated 652 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:01.224274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ad94067-59db-49d7-bfdb-4cc166720302 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:01.225808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ad94067-59db-49d7-bfdb-4cc166720302 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:01.240728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ad94067-59db-49d7-bfdb-4cc166720302 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:01.246237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ad94067-59db-49d7-bfdb-4cc166720302 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:01.248243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ad94067-59db-49d7-bfdb-4cc166720302 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:01.251847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-8c289fe1-d739-46b7-922f-1c78f3d87538 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:50:01.252950 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ad94067-59db-49d7-bfdb-4cc166720302 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:01.361505 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8c289fe1-d739-46b7-922f-1c78f3d87538 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 2308 microversion: 2.1 time: 0.306083 Mar 05 20:50:01.363002 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 265/577] 10.222.0.15 () {58 vars in 1189 bytes} [Sat Mar 5 20:50:01 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 2308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:01.368776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1da3f205-8d43-4df3-ada6-549f37fadfa2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:01.369913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1da3f205-8d43-4df3-ada6-549f37fadfa2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:01.380840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1da3f205-8d43-4df3-ada6-549f37fadfa2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:01.382857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1da3f205-8d43-4df3-ada6-549f37fadfa2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:01.384353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1da3f205-8d43-4df3-ada6-549f37fadfa2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:01.385030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1da3f205-8d43-4df3-ada6-549f37fadfa2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:01.565279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9ad94067-59db-49d7-bfdb-4cc166720302 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:01.573062 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ad94067-59db-49d7-bfdb-4cc166720302 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.355648 Mar 05 20:50:01.573646 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 313/578] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:01 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:01.590949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5561603e-0c75-47ff-8cb8-7c5c9c81c112 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:01.595421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5561603e-0c75-47ff-8cb8-7c5c9c81c112 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:01.609463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5561603e-0c75-47ff-8cb8-7c5c9c81c112 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:01.610365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5561603e-0c75-47ff-8cb8-7c5c9c81c112 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:01.611506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5561603e-0c75-47ff-8cb8-7c5c9c81c112 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:01.612198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5561603e-0c75-47ff-8cb8-7c5c9c81c112 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:01.647953 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-5561603e-0c75-47ff-8cb8-7c5c9c81c112 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] HTTP exception thrown: Cannot 'migrate' instance 3c46afc9-db69-4609-a26c-acf26b922ce7 while it is in vm_state suspended Mar 05 20:50:01.648578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5561603e-0c75-47ff-8cb8-7c5c9c81c112 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Returning 409 to user: Cannot 'migrate' instance 3c46afc9-db69-4609-a26c-acf26b922ce7 while it is in vm_state suspended {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:01.649594 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5561603e-0c75-47ff-8cb8-7c5c9c81c112 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7/action" status: 409 len: 148 microversion: 2.1 time: 0.062315 Mar 05 20:50:01.654968 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 314/579] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:50:01 2022] POST /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7/action => generated 148 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:50:01.656457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4cff0c0a-fb91-4aee-be85-7dc6399a8eee tempest-NetworksTest-540911942 tempest-NetworksTest-540911942-project-admin] Calling method '.version_select at 0x7fed5c9e1160>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:01.778180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1da3f205-8d43-4df3-ada6-549f37fadfa2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:01.788047 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1da3f205-8d43-4df3-ada6-549f37fadfa2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 200 len: 1319 microversion: 2.1 time: 0.423301 Mar 05 20:50:01.789136 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 266/580] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:01 2022] GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:01.803051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6d277250-b32f-4be5-88d5-da73fcdcf482 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:01.808887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6d277250-b32f-4be5-88d5-da73fcdcf482 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:50:01.815918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d277250-b32f-4be5-88d5-da73fcdcf482 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:01.816339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d277250-b32f-4be5-88d5-da73fcdcf482 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:01.817285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d277250-b32f-4be5-88d5-da73fcdcf482 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:01.818278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d277250-b32f-4be5-88d5-da73fcdcf482 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:01.971211 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4cff0c0a-fb91-4aee-be85-7dc6399a8eee tempest-NetworksTest-540911942 tempest-NetworksTest-540911942-project-admin] 10.222.0.15 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.319448 Mar 05 20:50:01.977622 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 315/581] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:01 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:01.983984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-31600ec6-4e05-41f1-afa0-beb1939557e0 req-24a71168-5b81-44f7-992b-075f9a0e63ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f230ca64-ecae-4706-a59a-45da927e38a9", "name": "network-vif-plugged", "status": "completed", "tag": "f735b1e1-9320-4212-b3ea-1aa7016452b8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:01.998815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-31600ec6-4e05-41f1-afa0-beb1939557e0 req-24a71168-5b81-44f7-992b-075f9a0e63ba service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:01.999905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-31600ec6-4e05-41f1-afa0-beb1939557e0 req-24a71168-5b81-44f7-992b-075f9a0e63ba service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.043747 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-31600ec6-4e05-41f1-afa0-beb1939557e0 req-24a71168-5b81-44f7-992b-075f9a0e63ba service nova] Creating event network-vif-plugged:f735b1e1-9320-4212-b3ea-1aa7016452b8 for instance f230ca64-ecae-4706-a59a-45da927e38a9 on nch1-master-1 Mar 05 20:50:02.052214 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-31600ec6-4e05-41f1-afa0-beb1939557e0 req-24a71168-5b81-44f7-992b-075f9a0e63ba service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072514 Mar 05 20:50:02.054062 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 316/582] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:02.086923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e83d9fab-722e-479e-ba51-716c85117778 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:02.089795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e83d9fab-722e-479e-ba51-716c85117778 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:02.097536 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e83d9fab-722e-479e-ba51-716c85117778 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed/action" status: 400 len: 144 microversion: 2.1 time: 0.037318 Mar 05 20:50:02.098832 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 317/583] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:50:02 2022] POST /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed/action => generated 144 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:50:02.111132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-55f440bc-ba15-4dbe-aacc-dcafe1f2f1a8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:02.113022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-55f440bc-ba15-4dbe-aacc-dcafe1f2f1a8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:02.141995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55f440bc-ba15-4dbe-aacc-dcafe1f2f1a8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.142132 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6d277250-b32f-4be5-88d5-da73fcdcf482 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.351000 Mar 05 20:50:02.142600 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 267/584] 10.222.0.15 () {58 vars in 1195 bytes} [Sat Mar 5 20:50:01 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:50:02.150867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55f440bc-ba15-4dbe-aacc-dcafe1f2f1a8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.152037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55f440bc-ba15-4dbe-aacc-dcafe1f2f1a8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.152503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55f440bc-ba15-4dbe-aacc-dcafe1f2f1a8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.158345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7f19c701-0b0d-456b-9b65-a2dadf6c016c req-68b40849-8b6a-4244-8a48-b41c6239b010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "441213dc-2cba-4629-8bfc-3a01bbec6942", "tag": "2ce9941d-9f5c-480d-b176-f639f34c5f2f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:02.167561 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7f19c701-0b0d-456b-9b65-a2dadf6c016c req-68b40849-8b6a-4244-8a48-b41c6239b010 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.168039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7f19c701-0b0d-456b-9b65-a2dadf6c016c req-68b40849-8b6a-4244-8a48-b41c6239b010 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.189519 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7f19c701-0b0d-456b-9b65-a2dadf6c016c req-68b40849-8b6a-4244-8a48-b41c6239b010 service nova] Creating event network-changed:2ce9941d-9f5c-480d-b176-f639f34c5f2f for instance 441213dc-2cba-4629-8bfc-3a01bbec6942 on nch2-master-1 Mar 05 20:50:02.194702 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7f19c701-0b0d-456b-9b65-a2dadf6c016c req-68b40849-8b6a-4244-8a48-b41c6239b010 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042728 Mar 05 20:50:02.195768 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 268/585] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:02.208224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1aaa2d96-a0a3-4c51-981d-791285d61a5d tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:02.209505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1aaa2d96-a0a3-4c51-981d-791285d61a5d tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:02.210341 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1aaa2d96-a0a3-4c51-981d-791285d61a5d tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed/action" status: 400 len: 120 microversion: 2.1 time: 0.012952 Mar 05 20:50:02.210923 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 269/586] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:50:02 2022] POST /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed/action => generated 120 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:50:02.224681 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d2d6b5dc-810a-4c57-8254-bebcdccf711b tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:02.227127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d2d6b5dc-810a-4c57-8254-bebcdccf711b tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:02.240966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2d6b5dc-810a-4c57-8254-bebcdccf711b tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.241603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2d6b5dc-810a-4c57-8254-bebcdccf711b tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.242714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2d6b5dc-810a-4c57-8254-bebcdccf711b tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.243555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2d6b5dc-810a-4c57-8254-bebcdccf711b tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.370623 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d2d6b5dc-810a-4c57-8254-bebcdccf711b tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action" status: 202 len: 0 microversion: 2.1 time: 0.150031 Mar 05 20:50:02.375406 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 270/587] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:50:02 2022] POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:50:02.381342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1a648e9c-a66e-4835-be3e-994f03567890 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:02.382536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1a648e9c-a66e-4835-be3e-994f03567890 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Failed to fetch instance by id 999 {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 05 20:50:02.383427 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-1a648e9c-a66e-4835-be3e-994f03567890 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] HTTP exception thrown: Instance 999 could not be found. Mar 05 20:50:02.384252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1a648e9c-a66e-4835-be3e-994f03567890 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:02.385282 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1a648e9c-a66e-4835-be3e-994f03567890 tempest-ServersAdminNegativeTestJSON-1545891716 tempest-ServersAdminNegativeTestJSON-1545891716-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.008120 Mar 05 20:50:02.386348 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 271/588] 10.222.0.15 () {60 vars in 1178 bytes} [Sat Mar 5 20:50:02 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:50:02.393275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:02.395187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:02.408680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.409349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.410298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.410894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.552832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:50:02.553262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:50:02.553760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:50:02.558658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:50:02.559119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:50:02.739119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:02.766573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.767152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.768028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.773673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.826625 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-904a7efb-9691-464a-9d0a-4d6f38141218 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action" status: 202 len: 1067 microversion: 2.1 time: 0.438825 Mar 05 20:50:02.839856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-55f440bc-ba15-4dbe-aacc-dcafe1f2f1a8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:02.847731 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 272/589] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:50:02 2022] POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action => generated 1067 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 05 20:50:02.853873 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-55f440bc-ba15-4dbe-aacc-dcafe1f2f1a8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1319 microversion: 2.1 time: 0.752796 Mar 05 20:50:02.855505 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 318/590] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:02 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1319 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:02.856854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c638c1ff-ecf0-4be9-b777-a50f0b647ac0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:02.857523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c638c1ff-ecf0-4be9-b777-a50f0b647ac0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:02.864056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-154028fd-c413-48a4-bde9-969e0f3fe703 req-04406289-9a5b-4e96-80be-e1b560927eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3e95742-638c-44fa-b25e-327896dbc669", "tag": "687346d5-cf6b-4895-b648-b214a9d0b985"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:02.872677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c638c1ff-ecf0-4be9-b777-a50f0b647ac0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.874538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c638c1ff-ecf0-4be9-b777-a50f0b647ac0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.876653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-154028fd-c413-48a4-bde9-969e0f3fe703 req-04406289-9a5b-4e96-80be-e1b560927eaf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.877027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c638c1ff-ecf0-4be9-b777-a50f0b647ac0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.877186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-154028fd-c413-48a4-bde9-969e0f3fe703 req-04406289-9a5b-4e96-80be-e1b560927eaf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.877991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c638c1ff-ecf0-4be9-b777-a50f0b647ac0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.898739 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-154028fd-c413-48a4-bde9-969e0f3fe703 req-04406289-9a5b-4e96-80be-e1b560927eaf service nova] Creating event network-changed:687346d5-cf6b-4895-b648-b214a9d0b985 for instance c3e95742-638c-44fa-b25e-327896dbc669 on nch1-master-1 Mar 05 20:50:02.912595 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-154028fd-c413-48a4-bde9-969e0f3fe703 req-04406289-9a5b-4e96-80be-e1b560927eaf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048672 Mar 05 20:50:02.913441 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 319/591] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:02.930577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c6bf0b5-a505-44f4-b95d-98ccf0d43ef1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:02.931303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9c6bf0b5-a505-44f4-b95d-98ccf0d43ef1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:02.949955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c6bf0b5-a505-44f4-b95d-98ccf0d43ef1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.952630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c6bf0b5-a505-44f4-b95d-98ccf0d43ef1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:02.954885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c638c1ff-ecf0-4be9-b777-a50f0b647ac0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:50:02.956937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c6bf0b5-a505-44f4-b95d-98ccf0d43ef1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:02.957624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c6bf0b5-a505-44f4-b95d-98ccf0d43ef1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:03.098396 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c638c1ff-ecf0-4be9-b777-a50f0b647ac0 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 204 len: 0 microversion: 2.1 time: 0.247573 Mar 05 20:50:03.101227 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 273/592] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:50:02 2022] DELETE /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:50:03.115740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-70c89c9f-770c-4a3f-93c8-ba65f3403a7a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:03.116666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-70c89c9f-770c-4a3f-93c8-ba65f3403a7a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:03.131922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70c89c9f-770c-4a3f-93c8-ba65f3403a7a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:03.133248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70c89c9f-770c-4a3f-93c8-ba65f3403a7a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:03.134328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70c89c9f-770c-4a3f-93c8-ba65f3403a7a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:03.134906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70c89c9f-770c-4a3f-93c8-ba65f3403a7a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:03.329563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9c6bf0b5-a505-44f4-b95d-98ccf0d43ef1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:03.345427 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c6bf0b5-a505-44f4-b95d-98ccf0d43ef1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.426959 Mar 05 20:50:03.356076 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 320/593] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:02 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:03.361990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-438ba8e5-0048-4a68-b9b3-6e129608fee9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:03.362962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-438ba8e5-0048-4a68-b9b3-6e129608fee9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:03.371077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-438ba8e5-0048-4a68-b9b3-6e129608fee9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:03.371706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-438ba8e5-0048-4a68-b9b3-6e129608fee9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:03.372832 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-438ba8e5-0048-4a68-b9b3-6e129608fee9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:03.373382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-438ba8e5-0048-4a68-b9b3-6e129608fee9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:03.376380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-70c89c9f-770c-4a3f-93c8-ba65f3403a7a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:03.386738 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-70c89c9f-770c-4a3f-93c8-ba65f3403a7a tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 200 len: 1319 microversion: 2.1 time: 0.282957 Mar 05 20:50:03.387324 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 274/594] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:03 2022] GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:03.393619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-029f1cef-9a7d-4c91-9ff2-a71c3f437255 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:03.394230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-029f1cef-9a7d-4c91-9ff2-a71c3f437255 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:03.405482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-029f1cef-9a7d-4c91-9ff2-a71c3f437255 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:03.406437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-029f1cef-9a7d-4c91-9ff2-a71c3f437255 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:03.407932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-029f1cef-9a7d-4c91-9ff2-a71c3f437255 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:03.408622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-029f1cef-9a7d-4c91-9ff2-a71c3f437255 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:03.587404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-029f1cef-9a7d-4c91-9ff2-a71c3f437255 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:03.596874 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-029f1cef-9a7d-4c91-9ff2-a71c3f437255 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1468 microversion: 2.1 time: 0.206850 Mar 05 20:50:03.597693 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 275/595] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:03 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1468 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:03.789011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-438ba8e5-0048-4a68-b9b3-6e129608fee9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:03.801502 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-438ba8e5-0048-4a68-b9b3-6e129608fee9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1471 microversion: 2.1 time: 0.443327 Mar 05 20:50:03.803013 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 321/596] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:03 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1471 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:03.871713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e85fbaec-5a5d-43b5-824a-fc55d10d6705 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:03.872701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e85fbaec-5a5d-43b5-824a-fc55d10d6705 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:03.879288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e85fbaec-5a5d-43b5-824a-fc55d10d6705 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:03.879798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e85fbaec-5a5d-43b5-824a-fc55d10d6705 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:03.880590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e85fbaec-5a5d-43b5-824a-fc55d10d6705 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:03.881028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e85fbaec-5a5d-43b5-824a-fc55d10d6705 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:04.131358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e85fbaec-5a5d-43b5-824a-fc55d10d6705 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:04.140791 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e85fbaec-5a5d-43b5-824a-fc55d10d6705 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1319 microversion: 2.1 time: 0.271060 Mar 05 20:50:04.157739 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 276/597] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:03 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:04.362557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2d1f37a4-2165-48f2-975e-607b6bd7fa83 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:04.363234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2d1f37a4-2165-48f2-975e-607b6bd7fa83 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:04.369144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d1f37a4-2165-48f2-975e-607b6bd7fa83 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:04.369544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d1f37a4-2165-48f2-975e-607b6bd7fa83 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:04.370651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d1f37a4-2165-48f2-975e-607b6bd7fa83 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:04.371245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d1f37a4-2165-48f2-975e-607b6bd7fa83 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:04.404105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5d409de3-12fc-4ede-afbd-6ac7bef29dde tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:04.404748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5d409de3-12fc-4ede-afbd-6ac7bef29dde tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:04.415920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d409de3-12fc-4ede-afbd-6ac7bef29dde tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:04.416385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d409de3-12fc-4ede-afbd-6ac7bef29dde tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:04.417189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d409de3-12fc-4ede-afbd-6ac7bef29dde tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:04.417629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d409de3-12fc-4ede-afbd-6ac7bef29dde tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:04.533767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2d1f37a4-2165-48f2-975e-607b6bd7fa83 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:04.549815 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2d1f37a4-2165-48f2-975e-607b6bd7fa83 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.191203 Mar 05 20:50:04.550404 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 322/598] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:04 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:04.614839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7c5ac99c-808f-4a26-a04d-2459da676211 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:04.615408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7c5ac99c-808f-4a26-a04d-2459da676211 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:04.621004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5d409de3-12fc-4ede-afbd-6ac7bef29dde tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:04.629556 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5d409de3-12fc-4ede-afbd-6ac7bef29dde tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 200 len: 1319 microversion: 2.1 time: 0.229610 Mar 05 20:50:04.629942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c5ac99c-808f-4a26-a04d-2459da676211 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:04.630747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c5ac99c-808f-4a26-a04d-2459da676211 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:04.630989 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 277/599] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:04 2022] GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:04.632040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c5ac99c-808f-4a26-a04d-2459da676211 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:04.632672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c5ac99c-808f-4a26-a04d-2459da676211 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:04.791892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7c5ac99c-808f-4a26-a04d-2459da676211 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:04.799855 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7c5ac99c-808f-4a26-a04d-2459da676211 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1468 microversion: 2.1 time: 0.188677 Mar 05 20:50:04.800654 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 323/600] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:04 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1468 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:04.824275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-94d9af97-ae8b-44cd-8bbc-d075929b119f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:04.824275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-94d9af97-ae8b-44cd-8bbc-d075929b119f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:04.827218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94d9af97-ae8b-44cd-8bbc-d075929b119f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:04.827218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94d9af97-ae8b-44cd-8bbc-d075929b119f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:04.827941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94d9af97-ae8b-44cd-8bbc-d075929b119f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:04.828454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94d9af97-ae8b-44cd-8bbc-d075929b119f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:04.987977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-94d9af97-ae8b-44cd-8bbc-d075929b119f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:04.996092 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-94d9af97-ae8b-44cd-8bbc-d075929b119f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1471 microversion: 2.1 time: 0.180516 Mar 05 20:50:04.996965 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 278/601] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:04 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:05.164857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-41080c06-bb7b-4533-9bac-6418db6d28e1 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:05.165765 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-41080c06-bb7b-4533-9bac-6418db6d28e1 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:05.173579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41080c06-bb7b-4533-9bac-6418db6d28e1 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:05.174974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41080c06-bb7b-4533-9bac-6418db6d28e1 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:05.176311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41080c06-bb7b-4533-9bac-6418db6d28e1 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:05.176949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41080c06-bb7b-4533-9bac-6418db6d28e1 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:05.330361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-41080c06-bb7b-4533-9bac-6418db6d28e1 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:05.338341 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-41080c06-bb7b-4533-9bac-6418db6d28e1 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1469 microversion: 2.1 time: 0.177302 Mar 05 20:50:05.339276 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 324/602] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:05 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1469 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:05.566991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-05a8b2ae-f5b0-4171-8507-e9242a444438 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:05.567611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-05a8b2ae-f5b0-4171-8507-e9242a444438 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:05.585077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05a8b2ae-f5b0-4171-8507-e9242a444438 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:05.585647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05a8b2ae-f5b0-4171-8507-e9242a444438 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:05.586460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05a8b2ae-f5b0-4171-8507-e9242a444438 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:05.586900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05a8b2ae-f5b0-4171-8507-e9242a444438 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:05.661946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b368338c-0c4c-4c01-af54-b8bb3c00d7d0 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-398809237", "block_migration": true, "disk_over_commit": false}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:05.663263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b368338c-0c4c-4c01-af54-b8bb3c00d7d0 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:05.679450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b368338c-0c4c-4c01-af54-b8bb3c00d7d0 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:05.680191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b368338c-0c4c-4c01-af54-b8bb3c00d7d0 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:05.682857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b368338c-0c4c-4c01-af54-b8bb3c00d7d0 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:05.683493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b368338c-0c4c-4c01-af54-b8bb3c00d7d0 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:05.865714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-b368338c-0c4c-4c01-af54-b8bb3c00d7d0 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lazy-loading 'flavor' on Instance uuid f230ca64-ecae-4706-a59a-45da927e38a9 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:50:05.931390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b368338c-0c4c-4c01-af54-b8bb3c00d7d0 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Going to try to live migrate instance to tempest-host-398809237 {{(pid=141478) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 05 20:50:05.941679 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-b368338c-0c4c-4c01-af54-b8bb3c00d7d0 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] HTTP exception thrown: Compute host tempest-host-398809237 could not be found. Mar 05 20:50:05.942491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b368338c-0c4c-4c01-af54-b8bb3c00d7d0 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Returning 400 to user: Compute host tempest-host-398809237 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:05.943536 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b368338c-0c4c-4c01-af54-b8bb3c00d7d0 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9/action" status: 400 len: 99 microversion: 2.1 time: 0.590411 Mar 05 20:50:05.944616 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 279/603] 10.222.0.15 () {60 vars in 1278 bytes} [Sat Mar 5 20:50:05 2022] POST /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9/action => generated 99 bytes in 592 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 05 20:50:05.949852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f76c82f-8fd2-4847-8838-9dd152bd99ed tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:05.950727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5f76c82f-8fd2-4847-8838-9dd152bd99ed tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:05.956893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f76c82f-8fd2-4847-8838-9dd152bd99ed tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:05.957623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f76c82f-8fd2-4847-8838-9dd152bd99ed tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:05.958600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f76c82f-8fd2-4847-8838-9dd152bd99ed tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:05.959238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f76c82f-8fd2-4847-8838-9dd152bd99ed tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:05.997695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-05a8b2ae-f5b0-4171-8507-e9242a444438 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:06.013357 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-05a8b2ae-f5b0-4171-8507-e9242a444438 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.450932 Mar 05 20:50:06.017499 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 325/604] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:05 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:06.041085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-3c36adb0-046d-4541-aaeb-d91c2cc9be03 req-030ecc03-55ae-43a4-9663-bff8ee03d221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c46afc9-db69-4609-a26c-acf26b922ce7", "name": "network-vif-deleted", "tag": "5cfde395-3c68-4fc7-a3b1-d62814d069b8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:06.051058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3c36adb0-046d-4541-aaeb-d91c2cc9be03 req-030ecc03-55ae-43a4-9663-bff8ee03d221 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:06.051716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3c36adb0-046d-4541-aaeb-d91c2cc9be03 req-030ecc03-55ae-43a4-9663-bff8ee03d221 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:06.064242 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-3c36adb0-046d-4541-aaeb-d91c2cc9be03 req-030ecc03-55ae-43a4-9663-bff8ee03d221 service nova] Creating event network-vif-deleted:5cfde395-3c68-4fc7-a3b1-d62814d069b8 for instance 3c46afc9-db69-4609-a26c-acf26b922ce7 on nch1-master-1 Mar 05 20:50:06.070680 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-3c36adb0-046d-4541-aaeb-d91c2cc9be03 req-030ecc03-55ae-43a4-9663-bff8ee03d221 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051578 Mar 05 20:50:06.072317 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 326/605] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:06.077607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e760e896-8bb5-4403-bfd0-5727c6ea159f tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:06.078756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e760e896-8bb5-4403-bfd0-5727c6ea159f tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:06.085897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e760e896-8bb5-4403-bfd0-5727c6ea159f tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:06.086562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e760e896-8bb5-4403-bfd0-5727c6ea159f tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:06.087550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e760e896-8bb5-4403-bfd0-5727c6ea159f tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:06.088206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e760e896-8bb5-4403-bfd0-5727c6ea159f tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:06.146945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e760e896-8bb5-4403-bfd0-5727c6ea159f tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:06.147508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e760e896-8bb5-4403-bfd0-5727c6ea159f tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:06.148019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-e760e896-8bb5-4403-bfd0-5727c6ea159f tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lazy-loading 'fault' on Instance uuid 3c46afc9-db69-4609-a26c-acf26b922ce7 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:50:06.158680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5f76c82f-8fd2-4847-8838-9dd152bd99ed tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:06.171412 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5f76c82f-8fd2-4847-8838-9dd152bd99ed tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 200 len: 1319 microversion: 2.1 time: 0.224837 Mar 05 20:50:06.173113 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 280/606] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:05 2022] GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:06.179355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a81301ed-8c9d-49f6-bfb2-d9b283375e26 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:06.180293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a81301ed-8c9d-49f6-bfb2-d9b283375e26 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:06.189440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a81301ed-8c9d-49f6-bfb2-d9b283375e26 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:06.190171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a81301ed-8c9d-49f6-bfb2-d9b283375e26 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:06.191181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a81301ed-8c9d-49f6-bfb2-d9b283375e26 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:06.192189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a81301ed-8c9d-49f6-bfb2-d9b283375e26 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:06.207153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e760e896-8bb5-4403-bfd0-5727c6ea159f tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:06.218665 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e760e896-8bb5-4403-bfd0-5727c6ea159f tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 200 len: 1311 microversion: 2.1 time: 0.143795 Mar 05 20:50:06.220483 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 327/607] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:06 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 1311 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:06.232109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f1b6ff4d-8d3d-41a9-a085-181e5da3bf1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:06.233730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f1b6ff4d-8d3d-41a9-a085-181e5da3bf1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:06.244605 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1b6ff4d-8d3d-41a9-a085-181e5da3bf1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:06.247409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1b6ff4d-8d3d-41a9-a085-181e5da3bf1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:06.249433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1b6ff4d-8d3d-41a9-a085-181e5da3bf1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:06.251725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1b6ff4d-8d3d-41a9-a085-181e5da3bf1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:06.439295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a81301ed-8c9d-49f6-bfb2-d9b283375e26 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:06.459960 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a81301ed-8c9d-49f6-bfb2-d9b283375e26 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1469 microversion: 2.1 time: 0.285265 Mar 05 20:50:06.460969 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 281/608] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:06 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1469 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:06.506365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f1b6ff4d-8d3d-41a9-a085-181e5da3bf1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:06.518435 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f1b6ff4d-8d3d-41a9-a085-181e5da3bf1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1471 microversion: 2.1 time: 0.295489 Mar 05 20:50:06.519869 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 328/609] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:06 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1471 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:06.601719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-529071039", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:06.665781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:50:06.940205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:50:06.941152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:50:06.941697 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:50:06.942194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:50:06.942814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:50:06.954722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:06.955289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:06.957141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:06.957904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:06.983007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Getting quotas for project 20c17cd80f57435e83687f847a73abd4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:50:06.989724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Getting quotas for user 7eaf06f561734f4b8471344612a4eb2a and project 20c17cd80f57435e83687f847a73abd4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:50:07.004426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:50:07.007386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:50:07.033127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ea28bcea-85e3-488d-ae09-2768ebf8f42d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:07.033760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ea28bcea-85e3-488d-ae09-2768ebf8f42d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:07.045916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea28bcea-85e3-488d-ae09-2768ebf8f42d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:07.046863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea28bcea-85e3-488d-ae09-2768ebf8f42d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:07.048666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea28bcea-85e3-488d-ae09-2768ebf8f42d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:07.049594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea28bcea-85e3-488d-ae09-2768ebf8f42d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:07.068729 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8a245ec8-790a-4e8a-92c4-9146b7b910d5 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.471747 Mar 05 20:50:07.069732 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 282/610] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:50:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:50:07.084273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7bf0062b-6d52-4c1d-881c-2acd8097b85a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:07.084960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7bf0062b-6d52-4c1d-881c-2acd8097b85a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:07.164743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7bf0062b-6d52-4c1d-881c-2acd8097b85a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:07.176743 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7bf0062b-6d52-4c1d-881c-2acd8097b85a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1218 microversion: 2.1 time: 0.097909 Mar 05 20:50:07.185384 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 283/611] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:07 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:07.196333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cba22c9b-e73e-46e4-af4a-c0bee57ed82d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:07.196895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cba22c9b-e73e-46e4-af4a-c0bee57ed82d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:07.208565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cba22c9b-e73e-46e4-af4a-c0bee57ed82d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:07.209501 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cba22c9b-e73e-46e4-af4a-c0bee57ed82d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:07.210509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cba22c9b-e73e-46e4-af4a-c0bee57ed82d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:07.211209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cba22c9b-e73e-46e4-af4a-c0bee57ed82d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:07.478674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cba22c9b-e73e-46e4-af4a-c0bee57ed82d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:07.487157 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cba22c9b-e73e-46e4-af4a-c0bee57ed82d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 200 len: 1319 microversion: 2.1 time: 0.300629 Mar 05 20:50:07.492232 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 284/612] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:07 2022] GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:07.496472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ea28bcea-85e3-488d-ae09-2768ebf8f42d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:07.500624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85759346-3d01-4106-8e83-9af854ac1842 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:07.501921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-85759346-3d01-4106-8e83-9af854ac1842 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 3c46afc9-db69-4609-a26c-acf26b922ce7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:07.510782 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ea28bcea-85e3-488d-ae09-2768ebf8f42d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.481823 Mar 05 20:50:07.512315 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 329/613] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:07 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:07.516671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85759346-3d01-4106-8e83-9af854ac1842 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:07.518558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85759346-3d01-4106-8e83-9af854ac1842 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:07.521293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85759346-3d01-4106-8e83-9af854ac1842 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:07.524329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85759346-3d01-4106-8e83-9af854ac1842 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:07.540817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-823ea14e-8b30-4a89-ba0d-a5ed756be534 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:07.541658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-823ea14e-8b30-4a89-ba0d-a5ed756be534 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:07.543174 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-85759346-3d01-4106-8e83-9af854ac1842 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] HTTP exception thrown: Instance 3c46afc9-db69-4609-a26c-acf26b922ce7 could not be found. Mar 05 20:50:07.544039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85759346-3d01-4106-8e83-9af854ac1842 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Returning 404 to user: Instance 3c46afc9-db69-4609-a26c-acf26b922ce7 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:07.545299 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-85759346-3d01-4106-8e83-9af854ac1842 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7" status: 404 len: 111 microversion: 2.1 time: 0.051822 Mar 05 20:50:07.550352 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 285/614] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:07 2022] GET /compute/v2.1/servers/3c46afc9-db69-4609-a26c-acf26b922ce7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:50:07.555810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2c58b487-2397-49fa-b979-f4c34630f80d tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:07.556603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2c58b487-2397-49fa-b979-f4c34630f80d tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:07.557970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-823ea14e-8b30-4a89-ba0d-a5ed756be534 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:07.558451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-823ea14e-8b30-4a89-ba0d-a5ed756be534 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:07.562490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-823ea14e-8b30-4a89-ba0d-a5ed756be534 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:07.565094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c58b487-2397-49fa-b979-f4c34630f80d tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:07.565881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c58b487-2397-49fa-b979-f4c34630f80d tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:07.566891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c58b487-2397-49fa-b979-f4c34630f80d tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:07.568162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c58b487-2397-49fa-b979-f4c34630f80d tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:07.569609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-823ea14e-8b30-4a89-ba0d-a5ed756be534 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:07.598528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2c58b487-2397-49fa-b979-f4c34630f80d tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:50:07.722940 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2c58b487-2397-49fa-b979-f4c34630f80d tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "DELETE /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 204 len: 0 microversion: 2.1 time: 0.170734 Mar 05 20:50:07.727873 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 286/615] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:50:07 2022] DELETE /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:50:07.738198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-be36a025-7c5c-481b-a7cc-bd5b44bd8e3a tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:07.739230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-be36a025-7c5c-481b-a7cc-bd5b44bd8e3a tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:07.747578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be36a025-7c5c-481b-a7cc-bd5b44bd8e3a tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:07.748338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be36a025-7c5c-481b-a7cc-bd5b44bd8e3a tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:07.749391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be36a025-7c5c-481b-a7cc-bd5b44bd8e3a tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:07.750856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be36a025-7c5c-481b-a7cc-bd5b44bd8e3a tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:07.995316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-be36a025-7c5c-481b-a7cc-bd5b44bd8e3a tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:08.009630 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-be36a025-7c5c-481b-a7cc-bd5b44bd8e3a tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1477 microversion: 2.1 time: 0.279486 Mar 05 20:50:08.028879 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 287/616] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:07 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1477 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:08.071047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-823ea14e-8b30-4a89-ba0d-a5ed756be534 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:08.085111 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-823ea14e-8b30-4a89-ba0d-a5ed756be534 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1471 microversion: 2.1 time: 0.549854 Mar 05 20:50:08.099824 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 330/617] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:07 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1471 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:08.197469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5a027965-a600-4882-af0f-383ba4075820 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:08.203027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5a027965-a600-4882-af0f-383ba4075820 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:08.216386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a027965-a600-4882-af0f-383ba4075820 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:08.216768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a027965-a600-4882-af0f-383ba4075820 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:08.217569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a027965-a600-4882-af0f-383ba4075820 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:08.218182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a027965-a600-4882-af0f-383ba4075820 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:08.313283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5a027965-a600-4882-af0f-383ba4075820 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:08.321000 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5a027965-a600-4882-af0f-383ba4075820 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1270 microversion: 2.1 time: 0.131142 Mar 05 20:50:08.321586 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 288/618] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:08 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:08.510075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-20b2c87d-a63b-410e-9492-a017b8bb4fab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:08.511122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-20b2c87d-a63b-410e-9492-a017b8bb4fab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:08.521593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20b2c87d-a63b-410e-9492-a017b8bb4fab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:08.522060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20b2c87d-a63b-410e-9492-a017b8bb4fab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:08.522924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20b2c87d-a63b-410e-9492-a017b8bb4fab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:08.530097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cc5357fc-9ed4-4d38-9ef7-d4aa7ed9319d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:08.530775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cc5357fc-9ed4-4d38-9ef7-d4aa7ed9319d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:08.541279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20b2c87d-a63b-410e-9492-a017b8bb4fab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:08.542074 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc5357fc-9ed4-4d38-9ef7-d4aa7ed9319d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:08.542716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc5357fc-9ed4-4d38-9ef7-d4aa7ed9319d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:08.543691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc5357fc-9ed4-4d38-9ef7-d4aa7ed9319d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:08.544287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc5357fc-9ed4-4d38-9ef7-d4aa7ed9319d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:08.831404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cc5357fc-9ed4-4d38-9ef7-d4aa7ed9319d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:08.840779 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cc5357fc-9ed4-4d38-9ef7-d4aa7ed9319d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.314925 Mar 05 20:50:08.841370 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 289/619] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:08 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:08.978646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-20b2c87d-a63b-410e-9492-a017b8bb4fab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:08.988199 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-20b2c87d-a63b-410e-9492-a017b8bb4fab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 200 len: 1319 microversion: 2.1 time: 0.483193 Mar 05 20:50:08.988772 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 331/620] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:08 2022] GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:09.035359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a1960183-1808-4a4d-9f99-ff03e0251cc7 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:09.036011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a1960183-1808-4a4d-9f99-ff03e0251cc7 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:09.045175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1960183-1808-4a4d-9f99-ff03e0251cc7 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:09.045633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1960183-1808-4a4d-9f99-ff03e0251cc7 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:09.048757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1960183-1808-4a4d-9f99-ff03e0251cc7 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:09.050490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1960183-1808-4a4d-9f99-ff03e0251cc7 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:09.105002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c19f585-03c9-4028-910e-357f16817a43 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:09.106280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9c19f585-03c9-4028-910e-357f16817a43 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:09.114796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c19f585-03c9-4028-910e-357f16817a43 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:09.115490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c19f585-03c9-4028-910e-357f16817a43 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:09.119401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c19f585-03c9-4028-910e-357f16817a43 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:09.120040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c19f585-03c9-4028-910e-357f16817a43 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:09.369847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a1960183-1808-4a4d-9f99-ff03e0251cc7 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:09.383326 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a1960183-1808-4a4d-9f99-ff03e0251cc7 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1477 microversion: 2.1 time: 0.352734 Mar 05 20:50:09.394117 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 290/621] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:09 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1477 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:09.400084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-04d51bed-d7ea-4115-9624-8644353ea4d8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:09.401027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-04d51bed-d7ea-4115-9624-8644353ea4d8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:09.412412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04d51bed-d7ea-4115-9624-8644353ea4d8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:09.413065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04d51bed-d7ea-4115-9624-8644353ea4d8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:09.414173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04d51bed-d7ea-4115-9624-8644353ea4d8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:09.414835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04d51bed-d7ea-4115-9624-8644353ea4d8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:09.508302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9c19f585-03c9-4028-910e-357f16817a43 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:09.520963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-04d51bed-d7ea-4115-9624-8644353ea4d8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:09.523061 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c19f585-03c9-4028-910e-357f16817a43 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1471 microversion: 2.1 time: 0.422298 Mar 05 20:50:09.526594 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 332/622] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:09 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1471 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:09.542734 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-04d51bed-d7ea-4115-9624-8644353ea4d8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1276 microversion: 2.1 time: 0.147164 Mar 05 20:50:09.543586 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 291/623] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:09 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:09.860913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c34b31f8-cb24-434c-a548-4bd9cc5e6579 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:09.861669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c34b31f8-cb24-434c-a548-4bd9cc5e6579 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:09.873104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c34b31f8-cb24-434c-a548-4bd9cc5e6579 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:09.873662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c34b31f8-cb24-434c-a548-4bd9cc5e6579 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:09.876898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c34b31f8-cb24-434c-a548-4bd9cc5e6579 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:09.879392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c34b31f8-cb24-434c-a548-4bd9cc5e6579 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:10.379345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-df705b33-ced1-436a-92f9-97375b50f7b2 tempest-SecurityGroupsTestAdminJSON-398466210 tempest-SecurityGroupsTestAdminJSON-398466210-project] Action: 'create', calling method: .version_select at 0x7fed5cd47b80>, body: {"security_group": {"name": "tempest-securitygroup-1489388016", "description": "tempest-description-409536665"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:11.189023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c34b31f8-cb24-434c-a548-4bd9cc5e6579 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:11.200428 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c34b31f8-cb24-434c-a548-4bd9cc5e6579 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 1.346229 Mar 05 20:50:11.201011 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 333/624] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:09 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:11.218186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9e8275f0-9f58-414f-b0bd-6ec33894bdcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:11.219968 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9e8275f0-9f58-414f-b0bd-6ec33894bdcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:11.226090 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-df705b33-ced1-436a-92f9-97375b50f7b2 tempest-SecurityGroupsTestAdminJSON-398466210 tempest-SecurityGroupsTestAdminJSON-398466210-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.339770 Mar 05 20:50:11.227601 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 292/625] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:50:09 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:50:11.233779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9d6a7dfe-8a42-49e5-ba53-e35f79c44005 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:11.234857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9d6a7dfe-8a42-49e5-ba53-e35f79c44005 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:11.249973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d6a7dfe-8a42-49e5-ba53-e35f79c44005 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:11.250696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e8275f0-9f58-414f-b0bd-6ec33894bdcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:11.251332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e8275f0-9f58-414f-b0bd-6ec33894bdcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:11.252286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d6a7dfe-8a42-49e5-ba53-e35f79c44005 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:11.252584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e8275f0-9f58-414f-b0bd-6ec33894bdcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:11.253111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d6a7dfe-8a42-49e5-ba53-e35f79c44005 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:11.253333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e8275f0-9f58-414f-b0bd-6ec33894bdcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:11.256420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d6a7dfe-8a42-49e5-ba53-e35f79c44005 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:11.676944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9d6a7dfe-8a42-49e5-ba53-e35f79c44005 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa730ea7740944abaf69f0e977fd3c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a689a4e8aa4d1fb19c10217e5986ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:11.688035 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9d6a7dfe-8a42-49e5-ba53-e35f79c44005 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 200 len: 1477 microversion: 2.1 time: 0.456632 Mar 05 20:50:11.689319 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 293/626] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:11 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 1477 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:11.707753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-90d0757d-613f-4d08-92ea-44bc7c90d18d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:11.708627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-90d0757d-613f-4d08-92ea-44bc7c90d18d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:11.715130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90d0757d-613f-4d08-92ea-44bc7c90d18d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:11.720312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90d0757d-613f-4d08-92ea-44bc7c90d18d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:11.721347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90d0757d-613f-4d08-92ea-44bc7c90d18d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:11.721814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90d0757d-613f-4d08-92ea-44bc7c90d18d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:12.072749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9e8275f0-9f58-414f-b0bd-6ec33894bdcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:12.084444 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9e8275f0-9f58-414f-b0bd-6ec33894bdcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 200 len: 1319 microversion: 2.1 time: 0.879604 Mar 05 20:50:12.095924 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 334/627] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:11 2022] GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 1319 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:12.118481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-90d0757d-613f-4d08-92ea-44bc7c90d18d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:12.131236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-99dd6ac5-36f7-4c82-afbf-c60a65c1b0ab tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:12.133890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-99dd6ac5-36f7-4c82-afbf-c60a65c1b0ab tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:12.139978 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-90d0757d-613f-4d08-92ea-44bc7c90d18d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1471 microversion: 2.1 time: 0.449358 Mar 05 20:50:12.142631 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 294/628] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:11 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1471 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:12.155242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0da49635-e66c-4aac-814a-12f1e97f843e tempest-SecurityGroupsTestAdminJSON-398466210 tempest-SecurityGroupsTestAdminJSON-398466210-project] Action: 'create', calling method: .version_select at 0x7fed5d0f6790>, body: {"security_group": {"name": "tempest-securitygroup-14899225", "description": "tempest-description-68823550"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:12.193142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99dd6ac5-36f7-4c82-afbf-c60a65c1b0ab tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:12.194508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99dd6ac5-36f7-4c82-afbf-c60a65c1b0ab tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:12.197087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99dd6ac5-36f7-4c82-afbf-c60a65c1b0ab tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:12.199312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99dd6ac5-36f7-4c82-afbf-c60a65c1b0ab tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:12.758373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-99dd6ac5-36f7-4c82-afbf-c60a65c1b0ab tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:12.775696 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-99dd6ac5-36f7-4c82-afbf-c60a65c1b0ab tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1318 microversion: 2.1 time: 0.677175 Mar 05 20:50:12.776532 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 335/629] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:12 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:12.790346 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0da49635-e66c-4aac-814a-12f1e97f843e tempest-SecurityGroupsTestAdminJSON-398466210 tempest-SecurityGroupsTestAdminJSON-398466210-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 217 microversion: 2.1 time: 0.645713 Mar 05 20:50:12.792031 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 295/630] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:50:12 2022] POST /compute/v2.1/os-security-groups => generated 217 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:12.799049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-321a8c02-fe67-457d-b7cb-6931c250b96e req-d27eb3e4-e4e2-44f6-ad5f-44f20d39a5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a93d69-84ef-4271-84c0-51db6b478596", "tag": "1e6bd486-5ded-43df-bdec-a261d46a9815"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:12.800748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-215831e1-0ce2-4e5a-8c77-e5a4baa1e9fa req-1ffee1f9-4aa2-40ff-87f7-470451f85eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e95742-638c-44fa-b25e-327896dbc669", "name": "network-vif-plugged", "status": "completed", "tag": "687346d5-cf6b-4895-b648-b214a9d0b985"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:12.819139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-321a8c02-fe67-457d-b7cb-6931c250b96e req-d27eb3e4-e4e2-44f6-ad5f-44f20d39a5f4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:12.820222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-321a8c02-fe67-457d-b7cb-6931c250b96e req-d27eb3e4-e4e2-44f6-ad5f-44f20d39a5f4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:12.841072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-215831e1-0ce2-4e5a-8c77-e5a4baa1e9fa req-1ffee1f9-4aa2-40ff-87f7-470451f85eea service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:12.844797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-215831e1-0ce2-4e5a-8c77-e5a4baa1e9fa req-1ffee1f9-4aa2-40ff-87f7-470451f85eea service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:12.848839 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-321a8c02-fe67-457d-b7cb-6931c250b96e req-d27eb3e4-e4e2-44f6-ad5f-44f20d39a5f4 service nova] Creating event network-changed:1e6bd486-5ded-43df-bdec-a261d46a9815 for instance 21a93d69-84ef-4271-84c0-51db6b478596 on nch1-master-1 Mar 05 20:50:12.858995 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-215831e1-0ce2-4e5a-8c77-e5a4baa1e9fa req-1ffee1f9-4aa2-40ff-87f7-470451f85eea service nova] Creating event network-vif-plugged:687346d5-cf6b-4895-b648-b214a9d0b985 for instance c3e95742-638c-44fa-b25e-327896dbc669 on nch1-master-1 Mar 05 20:50:12.863609 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-321a8c02-fe67-457d-b7cb-6931c250b96e req-d27eb3e4-e4e2-44f6-ad5f-44f20d39a5f4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070023 Mar 05 20:50:12.864482 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 296/631] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:12.872302 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-215831e1-0ce2-4e5a-8c77-e5a4baa1e9fa req-1ffee1f9-4aa2-40ff-87f7-470451f85eea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093407 Mar 05 20:50:12.876690 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 336/632] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:12.883641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-de2650ff-4bc2-461a-9a4e-70fbe8169b43 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:12.884274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-de2650ff-4bc2-461a-9a4e-70fbe8169b43 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:12.886616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-7bf46748-6c1d-444b-801d-823e10a21893 req-845f00f2-9809-478f-b372-6e0635e00504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e68fe7-4232-4918-aa20-4dda276362ed", "name": "network-vif-deleted", "tag": "11733f46-438a-4683-b8ae-9561dfb31a38"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:12.898512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-de2650ff-4bc2-461a-9a4e-70fbe8169b43 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:12.898962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-de2650ff-4bc2-461a-9a4e-70fbe8169b43 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:12.904194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-de2650ff-4bc2-461a-9a4e-70fbe8169b43 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:12.904672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-de2650ff-4bc2-461a-9a4e-70fbe8169b43 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:12.906237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7bf46748-6c1d-444b-801d-823e10a21893 req-845f00f2-9809-478f-b372-6e0635e00504 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:12.907617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7bf46748-6c1d-444b-801d-823e10a21893 req-845f00f2-9809-478f-b372-6e0635e00504 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:12.932815 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-7bf46748-6c1d-444b-801d-823e10a21893 req-845f00f2-9809-478f-b372-6e0635e00504 service nova] Creating event network-vif-deleted:11733f46-438a-4683-b8ae-9561dfb31a38 for instance 97e68fe7-4232-4918-aa20-4dda276362ed on nch2-master-1 Mar 05 20:50:12.949419 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-7bf46748-6c1d-444b-801d-823e10a21893 req-845f00f2-9809-478f-b372-6e0635e00504 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069781 Mar 05 20:50:12.951301 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 337/633] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:12.959476 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-963480f9-07ee-466b-b480-a3dcb29b1809 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:12.965024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-963480f9-07ee-466b-b480-a3dcb29b1809 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:12.977290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-de2650ff-4bc2-461a-9a4e-70fbe8169b43 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:50:12.982697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-963480f9-07ee-466b-b480-a3dcb29b1809 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:12.983869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-963480f9-07ee-466b-b480-a3dcb29b1809 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:12.986461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-963480f9-07ee-466b-b480-a3dcb29b1809 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:12.988658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-963480f9-07ee-466b-b480-a3dcb29b1809 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:13.134965 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-de2650ff-4bc2-461a-9a4e-70fbe8169b43 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "DELETE /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 204 len: 0 microversion: 2.1 time: 0.267517 Mar 05 20:50:13.142739 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 297/634] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:50:12 2022] DELETE /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:50:13.166564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4eb7eef5-e6e6-42f4-8cbd-8c2a91f94f05 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:13.167608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4eb7eef5-e6e6-42f4-8cbd-8c2a91f94f05 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] [instance: 97e68fe7-4232-4918-aa20-4dda276362ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:13.180365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4eb7eef5-e6e6-42f4-8cbd-8c2a91f94f05 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:13.183932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4eb7eef5-e6e6-42f4-8cbd-8c2a91f94f05 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:13.184984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4eb7eef5-e6e6-42f4-8cbd-8c2a91f94f05 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:13.186628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4eb7eef5-e6e6-42f4-8cbd-8c2a91f94f05 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:13.240585 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4eb7eef5-e6e6-42f4-8cbd-8c2a91f94f05 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] HTTP exception thrown: Instance 97e68fe7-4232-4918-aa20-4dda276362ed could not be found. Mar 05 20:50:13.241565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4eb7eef5-e6e6-42f4-8cbd-8c2a91f94f05 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] Returning 404 to user: Instance 97e68fe7-4232-4918-aa20-4dda276362ed could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:13.246804 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4eb7eef5-e6e6-42f4-8cbd-8c2a91f94f05 tempest-ServersAdminNegativeTestJSON-2139377812 tempest-ServersAdminNegativeTestJSON-2139377812-project] 10.222.0.15 "GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed" status: 404 len: 111 microversion: 2.1 time: 0.091618 Mar 05 20:50:13.255100 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 298/635] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:13 2022] GET /compute/v2.1/servers/97e68fe7-4232-4918-aa20-4dda276362ed => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:50:13.463052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-208583a4-92ee-4765-a6e1-e0911dff9068 tempest-SecurityGroupsTestAdminJSON-1345942603 tempest-SecurityGroupsTestAdminJSON-1345942603-project-admin] Action: 'create', calling method: .version_select at 0x7fed5cbe0b80>, body: {"security_group": {"name": "tempest-securitygroup-2063179034", "description": "tempest-description-474014127"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:13.601050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-963480f9-07ee-466b-b480-a3dcb29b1809 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:13.618280 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-963480f9-07ee-466b-b480-a3dcb29b1809 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.660676 Mar 05 20:50:13.621039 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 338/636] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:12 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:13.631813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-95f384e2-a2c5-456b-b47e-c525054d4935 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:13.634526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-95f384e2-a2c5-456b-b47e-c525054d4935 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:13.649961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95f384e2-a2c5-456b-b47e-c525054d4935 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:13.650361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95f384e2-a2c5-456b-b47e-c525054d4935 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:13.654617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95f384e2-a2c5-456b-b47e-c525054d4935 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:13.655104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95f384e2-a2c5-456b-b47e-c525054d4935 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:13.970833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-95f384e2-a2c5-456b-b47e-c525054d4935 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:13.984054 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-95f384e2-a2c5-456b-b47e-c525054d4935 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 200 len: 1319 microversion: 2.1 time: 0.361167 Mar 05 20:50:13.992393 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 339/637] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:13 2022] GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:13.998418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8d83a5b3-95a1-4014-863c-3786d15b4061 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:13.999035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8d83a5b3-95a1-4014-863c-3786d15b4061 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:14.017029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d83a5b3-95a1-4014-863c-3786d15b4061 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:14.017504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d83a5b3-95a1-4014-863c-3786d15b4061 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:14.018923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d83a5b3-95a1-4014-863c-3786d15b4061 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:14.019407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d83a5b3-95a1-4014-863c-3786d15b4061 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:14.559320 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-208583a4-92ee-4765-a6e1-e0911dff9068 tempest-SecurityGroupsTestAdminJSON-1345942603 tempest-SecurityGroupsTestAdminJSON-1345942603-project-admin] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.303253 Mar 05 20:50:14.569439 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 299/638] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:50:13 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:14.575260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-165568602", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "1413646340", "adminPass": "***", "networks": [{"uuid": "da32bc16-2a34-4e4f-9967-3e30a71f2738"}], "security_groups": [{"name": "tempest-securitygroup--1333199342"}], "key_name": "tempest-keypair-234183081", "user_data": "}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:14.743629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8d83a5b3-95a1-4014-863c-3786d15b4061 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:14.752433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] validate_networks() for [('da32bc16-2a34-4e4f-9967-3e30a71f2738', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:50:14.755089 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8d83a5b3-95a1-4014-863c-3786d15b4061 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1471 microversion: 2.1 time: 0.758169 Mar 05 20:50:14.756142 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 340/639] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:13 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1471 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:14.773340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-83a5e0ee-fecc-4beb-903f-0ca72cb7ba9c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:14.776822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-83a5e0ee-fecc-4beb-903f-0ca72cb7ba9c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:14.791835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a5e0ee-fecc-4beb-903f-0ca72cb7ba9c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:14.792711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a5e0ee-fecc-4beb-903f-0ca72cb7ba9c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:14.793669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a5e0ee-fecc-4beb-903f-0ca72cb7ba9c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:14.794434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a5e0ee-fecc-4beb-903f-0ca72cb7ba9c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:15.189001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-83a5e0ee-fecc-4beb-903f-0ca72cb7ba9c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:15.199891 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-83a5e0ee-fecc-4beb-903f-0ca72cb7ba9c tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1318 microversion: 2.1 time: 0.442455 Mar 05 20:50:15.200474 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 341/640] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:14 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:15.218427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a57d9643-21fc-4142-8a2e-cf78755d2073 tempest-SecurityGroupsTestAdminJSON-1345942603 tempest-SecurityGroupsTestAdminJSON-1345942603-project-admin] Action: 'create', calling method: .version_select at 0x7fed5ccf7ca0>, body: {"security_group": {"name": "tempest-securitygroup-1761689318", "description": "tempest-description-1295624213"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:15.839964 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a57d9643-21fc-4142-8a2e-cf78755d2073 tempest-SecurityGroupsTestAdminJSON-1345942603 tempest-SecurityGroupsTestAdminJSON-1345942603-project-admin] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.628561 Mar 05 20:50:15.840806 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 342/641] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:50:15 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:15.848320 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d6debec6-c847-430f-ae1b-e9dbb6665068 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:15.849251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d6debec6-c847-430f-ae1b-e9dbb6665068 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:15.866359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6debec6-c847-430f-ae1b-e9dbb6665068 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:15.867168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6debec6-c847-430f-ae1b-e9dbb6665068 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:15.869130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6debec6-c847-430f-ae1b-e9dbb6665068 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:15.869753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6debec6-c847-430f-ae1b-e9dbb6665068 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:16.123489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:50:16.124688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:50:16.126787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:50:16.129232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:50:16.131727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:50:16.165087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:16.174683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:16.183360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:16.186708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:16.215373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d6debec6-c847-430f-ae1b-e9dbb6665068 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:16.229344 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d6debec6-c847-430f-ae1b-e9dbb6665068 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.387298 Mar 05 20:50:16.234166 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 343/642] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:15 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:16.255804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Getting quotas for project 4e0a2d8f510f49999fc3094858af40d6. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:50:16.261062 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Getting quotas for user 839c64fcb5d249ffac671c90d252e1e3 and project 4e0a2d8f510f49999fc3094858af40d6. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:50:16.267976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-1d18b424-770b-4e8f-bbcb-29698f3bbda9 req-1f73e4d1-eaab-4b67-886e-556b2a0af393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "441213dc-2cba-4629-8bfc-3a01bbec6942", "name": "network-vif-plugged", "status": "completed", "tag": "2ce9941d-9f5c-480d-b176-f639f34c5f2f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:16.290731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:50:16.293260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:50:16.311308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1d18b424-770b-4e8f-bbcb-29698f3bbda9 req-1f73e4d1-eaab-4b67-886e-556b2a0af393 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:16.311795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1d18b424-770b-4e8f-bbcb-29698f3bbda9 req-1f73e4d1-eaab-4b67-886e-556b2a0af393 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:16.353261 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-1d18b424-770b-4e8f-bbcb-29698f3bbda9 req-1f73e4d1-eaab-4b67-886e-556b2a0af393 service nova] Creating event network-vif-plugged:2ce9941d-9f5c-480d-b176-f639f34c5f2f for instance 441213dc-2cba-4629-8bfc-3a01bbec6942 on nch2-master-1 Mar 05 20:50:16.378931 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-1d18b424-770b-4e8f-bbcb-29698f3bbda9 req-1f73e4d1-eaab-4b67-886e-556b2a0af393 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124667 Mar 05 20:50:16.396678 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 344/643] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:16.405026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cc31ad5c-b857-4c67-a6d3-06f38c483787 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:16.407348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cc31ad5c-b857-4c67-a6d3-06f38c483787 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:16.418316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc31ad5c-b857-4c67-a6d3-06f38c483787 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:16.419448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc31ad5c-b857-4c67-a6d3-06f38c483787 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:16.421077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc31ad5c-b857-4c67-a6d3-06f38c483787 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:16.422892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc31ad5c-b857-4c67-a6d3-06f38c483787 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:16.446079 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6ee93f76-0127-4d83-a630-093cf4f62f28 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.875115 Mar 05 20:50:16.466576 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 300/644] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:50:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:50:16.488759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c9c7f856-7a1b-4a30-b164-fa3df860fad7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:16.489382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c9c7f856-7a1b-4a30-b164-fa3df860fad7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:16.518694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c9c7f856-7a1b-4a30-b164-fa3df860fad7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:16.519156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c9c7f856-7a1b-4a30-b164-fa3df860fad7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:16.522661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c9c7f856-7a1b-4a30-b164-fa3df860fad7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:16.524685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c9c7f856-7a1b-4a30-b164-fa3df860fad7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:16.714042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cc31ad5c-b857-4c67-a6d3-06f38c483787 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:16.725224 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cc31ad5c-b857-4c67-a6d3-06f38c483787 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 200 len: 1468 microversion: 2.1 time: 0.326185 Mar 05 20:50:16.726061 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 345/645] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:16 2022] GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 1468 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:16.731203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8abab702-707e-4d98-8fb7-27698ec6f0c7 tempest-SecurityGroupsTestAdminJSON-1345942603 tempest-SecurityGroupsTestAdminJSON-1345942603-project-admin] Calling method '.version_select at 0x7fed5ca8e5e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:17.058532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c9c7f856-7a1b-4a30-b164-fa3df860fad7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:17.067951 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c9c7f856-7a1b-4a30-b164-fa3df860fad7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1471 microversion: 2.1 time: 0.600325 Mar 05 20:50:17.068547 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 301/646] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:16 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1471 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:17.081668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-43f97418-0a35-4141-9193-852a4720b8b7 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:17.082242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-43f97418-0a35-4141-9193-852a4720b8b7 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:17.101059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43f97418-0a35-4141-9193-852a4720b8b7 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:17.101568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43f97418-0a35-4141-9193-852a4720b8b7 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:17.102822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43f97418-0a35-4141-9193-852a4720b8b7 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:17.103199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43f97418-0a35-4141-9193-852a4720b8b7 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:17.578350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-43f97418-0a35-4141-9193-852a4720b8b7 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:17.587126 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-43f97418-0a35-4141-9193-852a4720b8b7 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1318 microversion: 2.1 time: 0.517527 Mar 05 20:50:17.605512 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 302/647] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:17 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:17.611994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23506339-1c2c-47e4-93d8-d4b71888bf35 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:17.612932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-23506339-1c2c-47e4-93d8-d4b71888bf35 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:17.625312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23506339-1c2c-47e4-93d8-d4b71888bf35 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:17.627471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23506339-1c2c-47e4-93d8-d4b71888bf35 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:17.629352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23506339-1c2c-47e4-93d8-d4b71888bf35 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:17.630054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23506339-1c2c-47e4-93d8-d4b71888bf35 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:17.799615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-23506339-1c2c-47e4-93d8-d4b71888bf35 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:17.810957 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-23506339-1c2c-47e4-93d8-d4b71888bf35 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1259 microversion: 2.1 time: 0.203989 Mar 05 20:50:17.824072 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 303/648] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:17 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:17.835901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dd7de0c3-d179-4495-8c9d-f47ba4839346 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:17.841852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dd7de0c3-d179-4495-8c9d-f47ba4839346 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 441213dc-2cba-4629-8bfc-3a01bbec6942] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:17.856581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd7de0c3-d179-4495-8c9d-f47ba4839346 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:17.857466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd7de0c3-d179-4495-8c9d-f47ba4839346 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:17.858900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd7de0c3-d179-4495-8c9d-f47ba4839346 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:17.860679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd7de0c3-d179-4495-8c9d-f47ba4839346 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:18.151805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dd7de0c3-d179-4495-8c9d-f47ba4839346 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:18.171805 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dd7de0c3-d179-4495-8c9d-f47ba4839346 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942" status: 200 len: 1319 microversion: 2.1 time: 0.345138 Mar 05 20:50:18.184376 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 304/649] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:17 2022] GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:18.191300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e9af6f17-f309-455c-a28e-4f6783f59827 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:18.193850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e9af6f17-f309-455c-a28e-4f6783f59827 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:18.211906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9af6f17-f309-455c-a28e-4f6783f59827 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:18.217273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9af6f17-f309-455c-a28e-4f6783f59827 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:18.219518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9af6f17-f309-455c-a28e-4f6783f59827 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:18.221364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9af6f17-f309-455c-a28e-4f6783f59827 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:18.988709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e9af6f17-f309-455c-a28e-4f6783f59827 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:19.005244 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e9af6f17-f309-455c-a28e-4f6783f59827 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.811563 Mar 05 20:50:19.012145 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 305/650] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:18 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:19.029157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-86aae26a-d79b-4aae-9429-b5b1f2f2010f req-1015cbfd-9c0b-48d0-a799-7bf2b42f5ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d89c14-aebf-4565-9719-229a9abd3ebd", "name": "network-vif-deleted", "tag": "3d09975a-2c78-4565-9441-09dcee0a67e2"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:19.054867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-86aae26a-d79b-4aae-9429-b5b1f2f2010f req-1015cbfd-9c0b-48d0-a799-7bf2b42f5ce8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:19.056973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-86aae26a-d79b-4aae-9429-b5b1f2f2010f req-1015cbfd-9c0b-48d0-a799-7bf2b42f5ce8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:19.092721 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-86aae26a-d79b-4aae-9429-b5b1f2f2010f req-1015cbfd-9c0b-48d0-a799-7bf2b42f5ce8 service nova] Creating event network-vif-deleted:3d09975a-2c78-4565-9441-09dcee0a67e2 for instance 80d89c14-aebf-4565-9719-229a9abd3ebd on nch2-master-1 Mar 05 20:50:19.099509 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-86aae26a-d79b-4aae-9429-b5b1f2f2010f req-1015cbfd-9c0b-48d0-a799-7bf2b42f5ce8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085232 Mar 05 20:50:19.100379 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 306/651] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:19.109058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-53572265-6e9a-4d91-8287-4baab7fb0ca1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:19.110718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-53572265-6e9a-4d91-8287-4baab7fb0ca1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:19.118284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53572265-6e9a-4d91-8287-4baab7fb0ca1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:19.119108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53572265-6e9a-4d91-8287-4baab7fb0ca1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:19.120167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53572265-6e9a-4d91-8287-4baab7fb0ca1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:19.120783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53572265-6e9a-4d91-8287-4baab7fb0ca1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:19.467556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-53572265-6e9a-4d91-8287-4baab7fb0ca1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:19.483514 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-53572265-6e9a-4d91-8287-4baab7fb0ca1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1471 microversion: 2.1 time: 0.381158 Mar 05 20:50:19.485181 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 307/652] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:19 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1471 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:19.491323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d8c9b379-7921-4f46-94c1-ab1498af240e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:19.492217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d8c9b379-7921-4f46-94c1-ab1498af240e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:19.504713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d8c9b379-7921-4f46-94c1-ab1498af240e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:19.505473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d8c9b379-7921-4f46-94c1-ab1498af240e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:19.506716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d8c9b379-7921-4f46-94c1-ab1498af240e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:19.507693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d8c9b379-7921-4f46-94c1-ab1498af240e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:19.848130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d8c9b379-7921-4f46-94c1-ab1498af240e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:19.856199 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d8c9b379-7921-4f46-94c1-ab1498af240e tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1318 microversion: 2.1 time: 0.369478 Mar 05 20:50:19.862518 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 308/653] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:19 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:19.875512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b82fbaf7-7246-4c8e-94d3-e0311c9772ea tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:19.879189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b82fbaf7-7246-4c8e-94d3-e0311c9772ea tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:19.892886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b82fbaf7-7246-4c8e-94d3-e0311c9772ea tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:19.893345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b82fbaf7-7246-4c8e-94d3-e0311c9772ea tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:19.894225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b82fbaf7-7246-4c8e-94d3-e0311c9772ea tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:19.897692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b82fbaf7-7246-4c8e-94d3-e0311c9772ea tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:20.471581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b82fbaf7-7246-4c8e-94d3-e0311c9772ea tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:20.481635 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b82fbaf7-7246-4c8e-94d3-e0311c9772ea tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1389 microversion: 2.1 time: 0.617702 Mar 05 20:50:20.496853 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 309/654] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:19 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1389 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:20.503118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-36de19d7-4bd4-4038-a67c-791a0ff43eb7 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:20.504082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-36de19d7-4bd4-4038-a67c-791a0ff43eb7 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 441213dc-2cba-4629-8bfc-3a01bbec6942] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:20.510429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36de19d7-4bd4-4038-a67c-791a0ff43eb7 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:20.511139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36de19d7-4bd4-4038-a67c-791a0ff43eb7 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:20.512185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36de19d7-4bd4-4038-a67c-791a0ff43eb7 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:20.516769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36de19d7-4bd4-4038-a67c-791a0ff43eb7 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:21.264375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-36de19d7-4bd4-4038-a67c-791a0ff43eb7 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:21.287997 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-36de19d7-4bd4-4038-a67c-791a0ff43eb7 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942" status: 200 len: 1468 microversion: 2.1 time: 0.789891 Mar 05 20:50:21.290323 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 310/655] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:20 2022] GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942 => generated 1468 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:21.653190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a841dc18-d7de-4736-a7e9-f21a0f41855c tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:21.655167 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:50:21.655167 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:50:21.657582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a841dc18-d7de-4736-a7e9-f21a0f41855c tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:21.663579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a841dc18-d7de-4736-a7e9-f21a0f41855c tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:21.664742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a841dc18-d7de-4736-a7e9-f21a0f41855c tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:21.665365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a841dc18-d7de-4736-a7e9-f21a0f41855c tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:21.715984 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a841dc18-d7de-4736-a7e9-f21a0f41855c tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.424372 Mar 05 20:50:21.716584 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 311/656] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:21 2022] GET /compute/v2.1/os-services => generated 947 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:21.739996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bc226cd6-dbd7-426d-a215-abbbf8126bdd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:21.741014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bc226cd6-dbd7-426d-a215-abbbf8126bdd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:21.756064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc226cd6-dbd7-426d-a215-abbbf8126bdd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:21.757331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc226cd6-dbd7-426d-a215-abbbf8126bdd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:21.758372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc226cd6-dbd7-426d-a215-abbbf8126bdd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:21.762040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc226cd6-dbd7-426d-a215-abbbf8126bdd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:22.007619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bc226cd6-dbd7-426d-a215-abbbf8126bdd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:22.017040 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bc226cd6-dbd7-426d-a215-abbbf8126bdd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.297620 Mar 05 20:50:22.017951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 312/657] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:21 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:22.023593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ef357211-59a2-477b-8151-e2fcf701e5b2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:22.024257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ef357211-59a2-477b-8151-e2fcf701e5b2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:22.030950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef357211-59a2-477b-8151-e2fcf701e5b2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:22.032135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef357211-59a2-477b-8151-e2fcf701e5b2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:22.033437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef357211-59a2-477b-8151-e2fcf701e5b2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:22.034096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef357211-59a2-477b-8151-e2fcf701e5b2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:22.230612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ef357211-59a2-477b-8151-e2fcf701e5b2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:22.240056 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ef357211-59a2-477b-8151-e2fcf701e5b2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1477 microversion: 2.1 time: 0.220830 Mar 05 20:50:22.250652 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 313/658] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:22 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1477 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:22.250652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-60e4f019-e197-4624-98aa-382972f32085 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:22.250652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-60e4f019-e197-4624-98aa-382972f32085 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:22.254092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60e4f019-e197-4624-98aa-382972f32085 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:22.254546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60e4f019-e197-4624-98aa-382972f32085 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:22.255588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60e4f019-e197-4624-98aa-382972f32085 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:22.256097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60e4f019-e197-4624-98aa-382972f32085 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:22.406682 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8abab702-707e-4d98-8fb7-27698ec6f0c7 tempest-SecurityGroupsTestAdminJSON-1345942603 tempest-SecurityGroupsTestAdminJSON-1345942603-project-admin] 10.222.0.15 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11738 microversion: 2.1 time: 5.679163 Mar 05 20:50:22.407707 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 346/659] 10.222.0.15 () {58 vars in 1190 bytes} [Sat Mar 5 20:50:16 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11738 bytes in 5681 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:50:22.413937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e47a676e-3afd-48d3-82d2-a8f401449959 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:22.423378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e47a676e-3afd-48d3-82d2-a8f401449959 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:22.424577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e47a676e-3afd-48d3-82d2-a8f401449959 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Searching by: {'reservation_id': 'r-b3iaorju', 'deleted': False, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:50:22.455628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e47a676e-3afd-48d3-82d2-a8f401449959 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:22.457918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e47a676e-3afd-48d3-82d2-a8f401449959 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:22.461174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e47a676e-3afd-48d3-82d2-a8f401449959 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:22.461721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e47a676e-3afd-48d3-82d2-a8f401449959 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:22.473897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-60e4f019-e197-4624-98aa-382972f32085 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:22.485367 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-60e4f019-e197-4624-98aa-382972f32085 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1318 microversion: 2.1 time: 0.241044 Mar 05 20:50:22.486321 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 314/660] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:22 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:22.491715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-06ccdca4-2e97-47e8-8605-9217107c801e req-bdb0f9d1-23d9-4f6f-9370-1a603a43ef74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a93d69-84ef-4271-84c0-51db6b478596", "name": "network-vif-plugged", "status": "completed", "tag": "1e6bd486-5ded-43df-bdec-a261d46a9815"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:22.502179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-06ccdca4-2e97-47e8-8605-9217107c801e req-bdb0f9d1-23d9-4f6f-9370-1a603a43ef74 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:22.502629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-06ccdca4-2e97-47e8-8605-9217107c801e req-bdb0f9d1-23d9-4f6f-9370-1a603a43ef74 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:22.524975 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-06ccdca4-2e97-47e8-8605-9217107c801e req-bdb0f9d1-23d9-4f6f-9370-1a603a43ef74 service nova] Creating event network-vif-plugged:1e6bd486-5ded-43df-bdec-a261d46a9815 for instance 21a93d69-84ef-4271-84c0-51db6b478596 on nch1-master-1 Mar 05 20:50:22.535951 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-06ccdca4-2e97-47e8-8605-9217107c801e req-bdb0f9d1-23d9-4f6f-9370-1a603a43ef74 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048038 Mar 05 20:50:22.537954 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 315/661] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:22.568678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-155ddc5c-72ba-42c0-81ba-ef2cd2c94bbc req-1769863a-5cc8-490a-bcd3-aca2d810818d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "499e4dcb-b39f-43e3-9cfc-27d4661dfb97", "tag": "a9d235c2-9ace-436f-8a2f-896e912f51bf"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:22.578935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-155ddc5c-72ba-42c0-81ba-ef2cd2c94bbc req-1769863a-5cc8-490a-bcd3-aca2d810818d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:22.580030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-155ddc5c-72ba-42c0-81ba-ef2cd2c94bbc req-1769863a-5cc8-490a-bcd3-aca2d810818d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:22.594821 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-155ddc5c-72ba-42c0-81ba-ef2cd2c94bbc req-1769863a-5cc8-490a-bcd3-aca2d810818d service nova] Creating event network-changed:a9d235c2-9ace-436f-8a2f-896e912f51bf for instance 499e4dcb-b39f-43e3-9cfc-27d4661dfb97 on nch2-master-1 Mar 05 20:50:22.608427 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-155ddc5c-72ba-42c0-81ba-ef2cd2c94bbc req-1769863a-5cc8-490a-bcd3-aca2d810818d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067189 Mar 05 20:50:22.611341 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 316/662] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:22.637576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-00c7e47f-5e09-4be6-9944-d02706dc55f7 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:22.641203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-00c7e47f-5e09-4be6-9944-d02706dc55f7 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:22.661270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00c7e47f-5e09-4be6-9944-d02706dc55f7 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:22.661942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00c7e47f-5e09-4be6-9944-d02706dc55f7 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:22.666432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00c7e47f-5e09-4be6-9944-d02706dc55f7 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:22.666937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00c7e47f-5e09-4be6-9944-d02706dc55f7 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:22.694793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-e47a676e-3afd-48d3-82d2-a8f401449959 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:50:22.842625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e47a676e-3afd-48d3-82d2-a8f401449959 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:22.858421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e47a676e-3afd-48d3-82d2-a8f401449959 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:22.858880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e47a676e-3afd-48d3-82d2-a8f401449959 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:23.106273 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e47a676e-3afd-48d3-82d2-a8f401449959 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/detail?reservation_id=r-b3iaorju" status: 200 len: 2929 microversion: 2.1 time: 0.697286 Mar 05 20:50:23.106874 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 347/663] 10.222.0.15 () {58 vars in 1196 bytes} [Sat Mar 5 20:50:22 2022] GET /compute/v2.1/servers/detail?reservation_id=r-b3iaorju => generated 2929 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:23.113046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-01ee5dcf-d6e1-4656-ac7a-1ca21ca2f2d9 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:23.114485 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:50:23.114485 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:50:23.117863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01ee5dcf-d6e1-4656-ac7a-1ca21ca2f2d9 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:23.118985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01ee5dcf-d6e1-4656-ac7a-1ca21ca2f2d9 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:23.120999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01ee5dcf-d6e1-4656-ac7a-1ca21ca2f2d9 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:23.121445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01ee5dcf-d6e1-4656-ac7a-1ca21ca2f2d9 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:23.122572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-00c7e47f-5e09-4be6-9944-d02706dc55f7 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:23.134180 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-00c7e47f-5e09-4be6-9944-d02706dc55f7 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1389 microversion: 2.1 time: 0.520756 Mar 05 20:50:23.144768 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 317/664] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:22 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1389 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:23.144768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-00053d7a-be2a-4386-9fd0-6338b6bfca7e tempest-SecurityGroupsTestAdminJSON-398466210 tempest-SecurityGroupsTestAdminJSON-398466210-project] Calling method '.version_select at 0x7fed5ce27700>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:23.190356 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-01ee5dcf-d6e1-4656-ac7a-1ca21ca2f2d9 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.081698 Mar 05 20:50:23.191414 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 348/665] 10.222.0.15 () {58 vars in 1169 bytes} [Sat Mar 5 20:50:23 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:23.212921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-36672adb-6a09-4cc2-a0d3-232693a40c02 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:23.213999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-36672adb-6a09-4cc2-a0d3-232693a40c02 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:23.228659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36672adb-6a09-4cc2-a0d3-232693a40c02 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:23.230662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36672adb-6a09-4cc2-a0d3-232693a40c02 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:23.231479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36672adb-6a09-4cc2-a0d3-232693a40c02 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:23.236616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36672adb-6a09-4cc2-a0d3-232693a40c02 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:23.480081 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-00053d7a-be2a-4386-9fd0-6338b6bfca7e tempest-SecurityGroupsTestAdminJSON-398466210 tempest-SecurityGroupsTestAdminJSON-398466210-project] 10.222.0.15 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1108 microversion: 2.1 time: 0.339610 Mar 05 20:50:23.487648 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 318/666] 10.222.0.15 () {58 vars in 1190 bytes} [Sat Mar 5 20:50:23 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1108 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:23.492253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2297aece-b15a-4846-925e-3e9a8c63447b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:23.519342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.compute.server_groups [None req-2297aece-b15a-4846-925e-3e9a8c63447b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Querying cell 591cc087-7d9b-4967-a4cd-9c96e8077593(cell1) for 2 instances {{(pid=141478) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 05 20:50:23.520223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2297aece-b15a-4846-925e-3e9a8c63447b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:23.520646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2297aece-b15a-4846-925e-3e9a8c63447b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:23.557998 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2297aece-b15a-4846-925e-3e9a8c63447b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/os-server-groups/ae192161-3ff8-408b-8a55-08a2736d1044" status: 200 len: 270 microversion: 2.1 time: 0.075051 Mar 05 20:50:23.566417 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 319/667] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:50:23 2022] GET /compute/v2.1/os-server-groups/ae192161-3ff8-408b-8a55-08a2736d1044 => generated 270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:23.572240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0b6f23d5-a1d1-411d-a1a5-ea35788a2ba9 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:23.573999 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:50:23.573999 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:50:23.576465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b6f23d5-a1d1-411d-a1a5-ea35788a2ba9 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:23.576994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b6f23d5-a1d1-411d-a1a5-ea35788a2ba9 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:23.578499 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b6f23d5-a1d1-411d-a1a5-ea35788a2ba9 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:23.579151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b6f23d5-a1d1-411d-a1a5-ea35788a2ba9 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:23.604580 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0b6f23d5-a1d1-411d-a1a5-ea35788a2ba9 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.036636 Mar 05 20:50:23.605486 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 320/668] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:23 2022] GET /compute/v2.1/os-services => generated 947 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:23.610638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3d26dc8b-9a32-44a6-98be-62cf3ae8fbc0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:23.611580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3d26dc8b-9a32-44a6-98be-62cf3ae8fbc0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:23.618693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3d26dc8b-9a32-44a6-98be-62cf3ae8fbc0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:23.619543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3d26dc8b-9a32-44a6-98be-62cf3ae8fbc0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:23.620659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3d26dc8b-9a32-44a6-98be-62cf3ae8fbc0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:23.621308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3d26dc8b-9a32-44a6-98be-62cf3ae8fbc0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:23.676532 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-36672adb-6a09-4cc2-a0d3-232693a40c02 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:23.685282 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-36672adb-6a09-4cc2-a0d3-232693a40c02 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.484223 Mar 05 20:50:23.686203 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 349/669] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:23 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:23.700322 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-87a7cb65-4651-460d-87b6-405c68785d0c tempest-SecurityGroupsTestAdminJSON-1345942603 tempest-SecurityGroupsTestAdminJSON-1345942603-project-admin] Calling method '.version_select at 0x7fed5ce76550>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:23.917209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3d26dc8b-9a32-44a6-98be-62cf3ae8fbc0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:23.930582 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3d26dc8b-9a32-44a6-98be-62cf3ae8fbc0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1477 microversion: 2.1 time: 0.323731 Mar 05 20:50:23.935104 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 321/670] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:23 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1477 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:23.942354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f113009-79db-4fc2-b787-13dc806ccc68 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:23.945754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5f113009-79db-4fc2-b787-13dc806ccc68 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:23.961635 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f113009-79db-4fc2-b787-13dc806ccc68 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:23.962396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f113009-79db-4fc2-b787-13dc806ccc68 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:23.963522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f113009-79db-4fc2-b787-13dc806ccc68 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:23.965440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f113009-79db-4fc2-b787-13dc806ccc68 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.099973 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-87a7cb65-4651-460d-87b6-405c68785d0c tempest-SecurityGroupsTestAdminJSON-1345942603 tempest-SecurityGroupsTestAdminJSON-1345942603-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/f6669b61-d92b-4aae-b2a7-364b45bce40a" status: 202 len: 0 microversion: 2.1 time: 0.412335 Mar 05 20:50:24.106929 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 350/671] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:50:23 2022] DELETE /compute/v2.1/os-security-groups/f6669b61-d92b-4aae-b2a7-364b45bce40a => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:50:24.112978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c7f60fef-6fdf-43f9-96fa-2ff7bc5668ba tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:24.114433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c7f60fef-6fdf-43f9-96fa-2ff7bc5668ba tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] [instance: 441213dc-2cba-4629-8bfc-3a01bbec6942] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:24.123730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7f60fef-6fdf-43f9-96fa-2ff7bc5668ba tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.124379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7f60fef-6fdf-43f9-96fa-2ff7bc5668ba tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.126697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7f60fef-6fdf-43f9-96fa-2ff7bc5668ba tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.127773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7f60fef-6fdf-43f9-96fa-2ff7bc5668ba tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.207579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5f113009-79db-4fc2-b787-13dc806ccc68 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:24.219644 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5f113009-79db-4fc2-b787-13dc806ccc68 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1318 microversion: 2.1 time: 0.281696 Mar 05 20:50:24.221502 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 322/672] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:23 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:24.240759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d88f2b0e-4054-4fca-a1a2-f1dfc1a10714 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:24.242919 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:50:24.242919 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:50:24.244568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d88f2b0e-4054-4fca-a1a2-f1dfc1a10714 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.245274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d88f2b0e-4054-4fca-a1a2-f1dfc1a10714 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.246471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d88f2b0e-4054-4fca-a1a2-f1dfc1a10714 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.247260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d88f2b0e-4054-4fca-a1a2-f1dfc1a10714 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.296473 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d88f2b0e-4054-4fca-a1a2-f1dfc1a10714 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.073505 Mar 05 20:50:24.297203 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 323/673] 10.222.0.15 () {58 vars in 1195 bytes} [Sat Mar 5 20:50:24 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:50:24.306973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e7e3eee5-367e-4ac0-a135-921f7030f268 tempest-SecurityGroupsTestAdminJSON-1345942603 tempest-SecurityGroupsTestAdminJSON-1345942603-project-admin] Calling method '.version_select at 0x7fed5ce273a0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:24.479739 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c7f60fef-6fdf-43f9-96fa-2ff7bc5668ba tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942" status: 200 len: 1619 microversion: 2.1 time: 0.371470 Mar 05 20:50:24.502234 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 351/674] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:24 2022] GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942 => generated 1619 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:24.511049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5d80537c-5ad8-466a-a48b-0f932553ae82 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:24.512512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5d80537c-5ad8-466a-a48b-0f932553ae82 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:24.521400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d80537c-5ad8-466a-a48b-0f932553ae82 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.522171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d80537c-5ad8-466a-a48b-0f932553ae82 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.523190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d80537c-5ad8-466a-a48b-0f932553ae82 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.524299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d80537c-5ad8-466a-a48b-0f932553ae82 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.584164 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e7e3eee5-367e-4ac0-a135-921f7030f268 tempest-SecurityGroupsTestAdminJSON-1345942603 tempest-SecurityGroupsTestAdminJSON-1345942603-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/18b5c15a-7bad-4a77-97e2-1ee34cfbfea3" status: 202 len: 0 microversion: 2.1 time: 0.280642 Mar 05 20:50:24.585855 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 324/675] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:50:24 2022] DELETE /compute/v2.1/os-security-groups/18b5c15a-7bad-4a77-97e2-1ee34cfbfea3 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:50:24.590819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fa03729b-db94-40f4-8e35-4d60f886a0c7 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:24.593136 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:50:24.593136 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:50:24.596625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa03729b-db94-40f4-8e35-4d60f886a0c7 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.597093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa03729b-db94-40f4-8e35-4d60f886a0c7 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.597910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa03729b-db94-40f4-8e35-4d60f886a0c7 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.598365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa03729b-db94-40f4-8e35-4d60f886a0c7 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.660832 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fa03729b-db94-40f4-8e35-4d60f886a0c7 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.073659 Mar 05 20:50:24.661798 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 325/676] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:24 2022] GET /compute/v2.1/os-services => generated 947 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:24.667869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1e11bd34-8514-497a-a37c-a898f924d8cb tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:24.668493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1e11bd34-8514-497a-a37c-a898f924d8cb tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:24.675619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e11bd34-8514-497a-a37c-a898f924d8cb tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.676116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e11bd34-8514-497a-a37c-a898f924d8cb tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.676906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e11bd34-8514-497a-a37c-a898f924d8cb tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.677343 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e11bd34-8514-497a-a37c-a898f924d8cb tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.833099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5d80537c-5ad8-466a-a48b-0f932553ae82 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:24.838171 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1e11bd34-8514-497a-a37c-a898f924d8cb tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 200 len: 1619 microversion: 2.1 time: 0.175048 Mar 05 20:50:24.838761 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 326/677] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:24 2022] GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 1619 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:24.852004 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5d80537c-5ad8-466a-a48b-0f932553ae82 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1389 microversion: 2.1 time: 0.339271 Mar 05 20:50:24.852004 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 352/678] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:24 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1389 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:24.858441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dcdea2fb-9a59-4a0d-bc95-6d4e761c0f88 tempest-SecurityGroupsTestAdminJSON-398466210 tempest-SecurityGroupsTestAdminJSON-398466210-project] Calling method '.version_select at 0x7fed5ccf1040>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:24.862636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-27ee42aa-3515-4582-b352-77332fd126a1 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:24.864049 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:50:24.864049 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:50:24.865324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27ee42aa-3515-4582-b352-77332fd126a1 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.865769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27ee42aa-3515-4582-b352-77332fd126a1 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.873403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27ee42aa-3515-4582-b352-77332fd126a1 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.873907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27ee42aa-3515-4582-b352-77332fd126a1 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.901555 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-27ee42aa-3515-4582-b352-77332fd126a1 tempest-ServicesAdminNegativeTestJSON-1073795763 tempest-ServicesAdminNegativeTestJSON-1073795763-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.053777 Mar 05 20:50:24.902162 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 353/679] 10.222.0.15 () {58 vars in 1197 bytes} [Sat Mar 5 20:50:24 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:50:24.916734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2813e9ea-4e1d-4219-bb94-23df2723ad1b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:24.917343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2813e9ea-4e1d-4219-bb94-23df2723ad1b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:24.924703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2813e9ea-4e1d-4219-bb94-23df2723ad1b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.925464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2813e9ea-4e1d-4219-bb94-23df2723ad1b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:24.926434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2813e9ea-4e1d-4219-bb94-23df2723ad1b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:24.927051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2813e9ea-4e1d-4219-bb94-23df2723ad1b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:25.154621 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dcdea2fb-9a59-4a0d-bc95-6d4e761c0f88 tempest-SecurityGroupsTestAdminJSON-398466210 tempest-SecurityGroupsTestAdminJSON-398466210-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/08d2bd8f-42eb-4a95-bd73-72a00eda3276" status: 202 len: 0 microversion: 2.1 time: 0.307981 Mar 05 20:50:25.157187 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 327/680] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:50:24 2022] DELETE /compute/v2.1/os-security-groups/08d2bd8f-42eb-4a95-bd73-72a00eda3276 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:50:25.190918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2813e9ea-4e1d-4219-bb94-23df2723ad1b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:25.201773 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2813e9ea-4e1d-4219-bb94-23df2723ad1b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.288015 Mar 05 20:50:25.212824 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 354/681] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:24 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:25.226549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d96c78f0-6ab9-43de-8278-9a1b64e5285a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:25.227188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d96c78f0-6ab9-43de-8278-9a1b64e5285a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:25.246008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d96c78f0-6ab9-43de-8278-9a1b64e5285a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:25.247959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d96c78f0-6ab9-43de-8278-9a1b64e5285a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:25.251122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d96c78f0-6ab9-43de-8278-9a1b64e5285a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:25.251581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d96c78f0-6ab9-43de-8278-9a1b64e5285a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:25.331978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2814cffa-98e9-4bd9-9484-a8de961e23d8 tempest-ServicesAdminNegativeTestJSON-1846295068 tempest-ServicesAdminNegativeTestJSON-1846295068-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:25.333625 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:50:25.333625 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:50:25.335278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2814cffa-98e9-4bd9-9484-a8de961e23d8 tempest-ServicesAdminNegativeTestJSON-1846295068 tempest-ServicesAdminNegativeTestJSON-1846295068-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3ba7654d11564ed9a76c42695a79547a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47da487aef674325ad8438464568c8d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:25.336138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2814cffa-98e9-4bd9-9484-a8de961e23d8 tempest-ServicesAdminNegativeTestJSON-1846295068 tempest-ServicesAdminNegativeTestJSON-1846295068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:25.337527 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2814cffa-98e9-4bd9-9484-a8de961e23d8 tempest-ServicesAdminNegativeTestJSON-1846295068 tempest-ServicesAdminNegativeTestJSON-1846295068-project] 10.222.0.15 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.178855 Mar 05 20:50:25.338227 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 328/682] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:25 2022] GET /compute/v2.1/os-services => generated 112 bytes in 180 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:50:25.351077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1879230018", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "7f00577b-ab4a-4e3c-b42d-53f30d4a34bd"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:25.428526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:50:25.539978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d96c78f0-6ab9-43de-8278-9a1b64e5285a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:25.550165 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d96c78f0-6ab9-43de-8278-9a1b64e5285a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1477 microversion: 2.1 time: 0.331685 Mar 05 20:50:25.557454 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 355/683] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:25 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1477 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:25.570601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c0d5416-1b11-4bde-ac06-4ea5d07ef42d tempest-SecurityGroupsTestAdminJSON-398466210 tempest-SecurityGroupsTestAdminJSON-398466210-project] Calling method '.version_select at 0x7fed5cd488b0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:25.930640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:50:25.931063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:50:25.931766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:50:25.932361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:50:25.932766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:50:25.948263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:25.948721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:25.960585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:25.968574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:26.021912 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c0d5416-1b11-4bde-ac06-4ea5d07ef42d tempest-SecurityGroupsTestAdminJSON-398466210 tempest-SecurityGroupsTestAdminJSON-398466210-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/f9f24f47-ce1a-4147-9d0a-761c1e292d64" status: 202 len: 0 microversion: 2.1 time: 0.463139 Mar 05 20:50:26.031659 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 356/684] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:50:25 2022] DELETE /compute/v2.1/os-security-groups/f9f24f47-ce1a-4147-9d0a-761c1e292d64 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:50:26.038665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-41f24644-9e26-4170-8aa4-192a12a9219a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:26.039964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-41f24644-9e26-4170-8aa4-192a12a9219a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:26.051458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41f24644-9e26-4170-8aa4-192a12a9219a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:26.052357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41f24644-9e26-4170-8aa4-192a12a9219a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:26.053342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41f24644-9e26-4170-8aa4-192a12a9219a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:26.053941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41f24644-9e26-4170-8aa4-192a12a9219a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:26.063632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:50:26.096999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:50:26.135375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:50:26.143317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:50:26.297190 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-14599e92-1423-47ec-923a-66871c30a2b0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957455 Mar 05 20:50:26.302928 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 329/685] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:50:26.317662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-37116a84-b27a-4192-8486-6b4c7f888879 req-43a74fd1-674a-4bee-889b-05261219214a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d196df64-5f99-4c5a-b30b-92751e6f7702", "name": "network-vif-unplugged", "status": "completed", "tag": "cd12eb23-3086-4db9-babd-0ffb56ce7a27"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:26.360591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-37116a84-b27a-4192-8486-6b4c7f888879 req-43a74fd1-674a-4bee-889b-05261219214a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:26.362402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-37116a84-b27a-4192-8486-6b4c7f888879 req-43a74fd1-674a-4bee-889b-05261219214a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:26.425390 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-37116a84-b27a-4192-8486-6b4c7f888879 req-43a74fd1-674a-4bee-889b-05261219214a service nova] Creating event network-vif-unplugged:cd12eb23-3086-4db9-babd-0ffb56ce7a27 for instance d196df64-5f99-4c5a-b30b-92751e6f7702 on nch1-master-1 Mar 05 20:50:26.453599 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-37116a84-b27a-4192-8486-6b4c7f888879 req-43a74fd1-674a-4bee-889b-05261219214a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145030 Mar 05 20:50:26.457606 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 330/686] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:26.477971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-81c50db0-7fe0-4c04-af2a-448bf4e43b6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:26.479030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-81c50db0-7fe0-4c04-af2a-448bf4e43b6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:26.493700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81c50db0-7fe0-4c04-af2a-448bf4e43b6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:26.517699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81c50db0-7fe0-4c04-af2a-448bf4e43b6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:26.518572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81c50db0-7fe0-4c04-af2a-448bf4e43b6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:26.529327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-41f24644-9e26-4170-8aa4-192a12a9219a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:26.538949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81c50db0-7fe0-4c04-af2a-448bf4e43b6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:26.550606 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-41f24644-9e26-4170-8aa4-192a12a9219a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1468 microversion: 2.1 time: 0.505884 Mar 05 20:50:26.551509 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 357/687] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:26 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1468 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:26.584708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7fb291f2-40ce-43fe-ad1d-798bdb06a73f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:26.587390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7fb291f2-40ce-43fe-ad1d-798bdb06a73f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:26.637131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fb291f2-40ce-43fe-ad1d-798bdb06a73f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:26.643050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fb291f2-40ce-43fe-ad1d-798bdb06a73f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:26.650357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fb291f2-40ce-43fe-ad1d-798bdb06a73f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:26.653537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fb291f2-40ce-43fe-ad1d-798bdb06a73f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:27.149673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-81c50db0-7fe0-4c04-af2a-448bf4e43b6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:27.164344 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-81c50db0-7fe0-4c04-af2a-448bf4e43b6e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1389 microversion: 2.1 time: 0.705180 Mar 05 20:50:27.175958 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 331/688] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:26 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1389 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:27.182932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9078ebbf-a5cc-4243-a98f-c3afa17ad6c2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:27.189155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9078ebbf-a5cc-4243-a98f-c3afa17ad6c2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:27.287649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7fb291f2-40ce-43fe-ad1d-798bdb06a73f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:27.300168 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7fb291f2-40ce-43fe-ad1d-798bdb06a73f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1474 microversion: 2.1 time: 0.746255 Mar 05 20:50:27.304059 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 358/689] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:26 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1474 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:27.323109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8855d169-4e82-4078-ad3e-afac806574ab tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:27.325468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8855d169-4e82-4078-ad3e-afac806574ab tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:27.339561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8855d169-4e82-4078-ad3e-afac806574ab tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:27.341414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8855d169-4e82-4078-ad3e-afac806574ab tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:27.344021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8855d169-4e82-4078-ad3e-afac806574ab tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:27.344933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8855d169-4e82-4078-ad3e-afac806574ab tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:27.450925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-8855d169-4e82-4078-ad3e-afac806574ab tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lazy-loading 'flavor' on Instance uuid 21a93d69-84ef-4271-84c0-51db6b478596 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:50:27.494453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9078ebbf-a5cc-4243-a98f-c3afa17ad6c2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:27.510119 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9078ebbf-a5cc-4243-a98f-c3afa17ad6c2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1217 microversion: 2.1 time: 0.332708 Mar 05 20:50:27.528385 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 332/690] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:27 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1217 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:27.541776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2b58afb3-eaf6-4c13-af91-7d7336fc3b1b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:27.549158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2b58afb3-eaf6-4c13-af91-7d7336fc3b1b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:27.571657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b58afb3-eaf6-4c13-af91-7d7336fc3b1b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:27.572426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b58afb3-eaf6-4c13-af91-7d7336fc3b1b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:27.573573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b58afb3-eaf6-4c13-af91-7d7336fc3b1b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:27.574172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b58afb3-eaf6-4c13-af91-7d7336fc3b1b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:27.698648 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8855d169-4e82-4078-ad3e-afac806574ab tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596/action" status: 202 len: 0 microversion: 2.1 time: 0.392925 Mar 05 20:50:27.716406 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 359/691] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:50:27 2022] POST /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:50:27.740272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7c24508c-a6f9-473e-af0b-998f69eaf818 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:27.746392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7c24508c-a6f9-473e-af0b-998f69eaf818 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:27.764389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c24508c-a6f9-473e-af0b-998f69eaf818 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:27.767049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c24508c-a6f9-473e-af0b-998f69eaf818 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:27.777715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c24508c-a6f9-473e-af0b-998f69eaf818 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:27.778191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c24508c-a6f9-473e-af0b-998f69eaf818 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:27.938215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2b58afb3-eaf6-4c13-af91-7d7336fc3b1b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:27.951752 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2b58afb3-eaf6-4c13-af91-7d7336fc3b1b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1477 microversion: 2.1 time: 0.421871 Mar 05 20:50:27.971649 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 333/692] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:27 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1477 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:28.184984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-16d1958d-989f-4937-ae1f-497559aefff8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:28.186155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-16d1958d-989f-4937-ae1f-497559aefff8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:28.227931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16d1958d-989f-4937-ae1f-497559aefff8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:28.231101 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16d1958d-989f-4937-ae1f-497559aefff8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:28.232530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16d1958d-989f-4937-ae1f-497559aefff8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:28.234602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16d1958d-989f-4937-ae1f-497559aefff8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:28.392621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7c24508c-a6f9-473e-af0b-998f69eaf818 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:28.417198 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7c24508c-a6f9-473e-af0b-998f69eaf818 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1476 microversion: 2.1 time: 0.683845 Mar 05 20:50:28.432722 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 360/693] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:27 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1476 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:28.473362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-46d710b3-1566-4b54-9b50-abb67c740348 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:28.474319 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-46d710b3-1566-4b54-9b50-abb67c740348 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:28.507330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46d710b3-1566-4b54-9b50-abb67c740348 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:28.508068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46d710b3-1566-4b54-9b50-abb67c740348 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:28.508999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46d710b3-1566-4b54-9b50-abb67c740348 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:28.509630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46d710b3-1566-4b54-9b50-abb67c740348 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:28.983079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-46d710b3-1566-4b54-9b50-abb67c740348 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:28.998018 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-46d710b3-1566-4b54-9b50-abb67c740348 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1473 microversion: 2.1 time: 0.558144 Mar 05 20:50:29.001372 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 361/694] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:28 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1473 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:29.011477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6ccc3918-628d-41cc-b7a2-2a3d55f80dad tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:29.012905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6ccc3918-628d-41cc-b7a2-2a3d55f80dad tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:29.020793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ccc3918-628d-41cc-b7a2-2a3d55f80dad tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:29.021013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-16d1958d-989f-4937-ae1f-497559aefff8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:29.022188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ccc3918-628d-41cc-b7a2-2a3d55f80dad tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:29.023223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ccc3918-628d-41cc-b7a2-2a3d55f80dad tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:29.027089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ccc3918-628d-41cc-b7a2-2a3d55f80dad tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:29.041847 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-16d1958d-989f-4937-ae1f-497559aefff8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1389 microversion: 2.1 time: 0.863347 Mar 05 20:50:29.042467 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 334/695] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:28 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1389 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:29.065557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-92be821c-3303-4464-8f7b-3de6509f3f62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:29.071275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-92be821c-3303-4464-8f7b-3de6509f3f62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:29.091976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92be821c-3303-4464-8f7b-3de6509f3f62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:29.096770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92be821c-3303-4464-8f7b-3de6509f3f62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:29.097950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92be821c-3303-4464-8f7b-3de6509f3f62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:29.100843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92be821c-3303-4464-8f7b-3de6509f3f62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:29.194714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6ccc3918-628d-41cc-b7a2-2a3d55f80dad tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:29.213408 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6ccc3918-628d-41cc-b7a2-2a3d55f80dad tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1275 microversion: 2.1 time: 0.210336 Mar 05 20:50:29.219863 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 362/696] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:29 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:29.441968 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c13eb66d-9746-4484-8614-af3202df69ea tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:29.443793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c13eb66d-9746-4484-8614-af3202df69ea tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:29.463248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c13eb66d-9746-4484-8614-af3202df69ea tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:29.464455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c13eb66d-9746-4484-8614-af3202df69ea tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:29.467229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c13eb66d-9746-4484-8614-af3202df69ea tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:29.468972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c13eb66d-9746-4484-8614-af3202df69ea tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:29.903516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-92be821c-3303-4464-8f7b-3de6509f3f62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:29.916200 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-92be821c-3303-4464-8f7b-3de6509f3f62 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1477 microversion: 2.1 time: 0.866163 Mar 05 20:50:29.917139 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 335/697] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:29 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1477 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:29.964773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c13eb66d-9746-4484-8614-af3202df69ea tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:29.972916 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c13eb66d-9746-4484-8614-af3202df69ea tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1459 microversion: 2.1 time: 0.536032 Mar 05 20:50:29.980015 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 363/698] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:29 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1459 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:30.010488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-72163ed6-e6c7-462a-a008-f4c8e3192610 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:30.014152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-72163ed6-e6c7-462a-a008-f4c8e3192610 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:30.018397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2eba2fa1-69a6-46ec-a6d6-b13b9d5130d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:30.019306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2eba2fa1-69a6-46ec-a6d6-b13b9d5130d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:30.026225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2eba2fa1-69a6-46ec-a6d6-b13b9d5130d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:30.035871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2eba2fa1-69a6-46ec-a6d6-b13b9d5130d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:30.037085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2eba2fa1-69a6-46ec-a6d6-b13b9d5130d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:30.037762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2eba2fa1-69a6-46ec-a6d6-b13b9d5130d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:30.046396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72163ed6-e6c7-462a-a008-f4c8e3192610 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:30.047176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72163ed6-e6c7-462a-a008-f4c8e3192610 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:30.049267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72163ed6-e6c7-462a-a008-f4c8e3192610 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:30.050150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72163ed6-e6c7-462a-a008-f4c8e3192610 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:30.571313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2eba2fa1-69a6-46ec-a6d6-b13b9d5130d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:30.579339 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2eba2fa1-69a6-46ec-a6d6-b13b9d5130d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1473 microversion: 2.1 time: 0.565342 Mar 05 20:50:30.583702 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 364/699] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:30 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1473 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:30.596821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91784540-6178-4dfd-986f-a6b973de1950 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:30.597035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91784540-6178-4dfd-986f-a6b973de1950 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:30.611436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91784540-6178-4dfd-986f-a6b973de1950 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:30.624089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91784540-6178-4dfd-986f-a6b973de1950 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:30.625484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91784540-6178-4dfd-986f-a6b973de1950 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:30.626021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91784540-6178-4dfd-986f-a6b973de1950 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:30.902500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-91784540-6178-4dfd-986f-a6b973de1950 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:30.919091 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91784540-6178-4dfd-986f-a6b973de1950 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1389 microversion: 2.1 time: 0.334342 Mar 05 20:50:30.937669 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 365/700] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:30 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1389 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:30.951704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4320e1da-bcc3-4bef-8a48-7ca690338735 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:30.952340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4320e1da-bcc3-4bef-8a48-7ca690338735 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:30.984687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4320e1da-bcc3-4bef-8a48-7ca690338735 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:30.985421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4320e1da-bcc3-4bef-8a48-7ca690338735 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:30.986273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4320e1da-bcc3-4bef-8a48-7ca690338735 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:30.986720 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4320e1da-bcc3-4bef-8a48-7ca690338735 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:31.177369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4320e1da-bcc3-4bef-8a48-7ca690338735 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:31.212014 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4320e1da-bcc3-4bef-8a48-7ca690338735 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1275 microversion: 2.1 time: 0.266525 Mar 05 20:50:31.213945 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 366/701] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:30 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1275 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:31.222221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-23eb8c13-6865-46a2-b7a0-491cbdda4b45 req-6e2fe31c-4a1b-445f-aeae-1685134aa5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d196df64-5f99-4c5a-b30b-92751e6f7702", "name": "network-vif-plugged", "status": "completed", "tag": "cd12eb23-3086-4db9-babd-0ffb56ce7a27"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:31.251717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-23eb8c13-6865-46a2-b7a0-491cbdda4b45 req-6e2fe31c-4a1b-445f-aeae-1685134aa5c7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:31.252624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-23eb8c13-6865-46a2-b7a0-491cbdda4b45 req-6e2fe31c-4a1b-445f-aeae-1685134aa5c7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:31.289814 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-23eb8c13-6865-46a2-b7a0-491cbdda4b45 req-6e2fe31c-4a1b-445f-aeae-1685134aa5c7 service nova] Creating event network-vif-plugged:cd12eb23-3086-4db9-babd-0ffb56ce7a27 for instance d196df64-5f99-4c5a-b30b-92751e6f7702 on nch1-master-1 Mar 05 20:50:31.306588 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-23eb8c13-6865-46a2-b7a0-491cbdda4b45 req-6e2fe31c-4a1b-445f-aeae-1685134aa5c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087819 Mar 05 20:50:31.309318 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 367/702] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:31.347446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5b3b4cb0-3b9c-4800-a17c-fceba6c6c4b4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:31.350610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5b3b4cb0-3b9c-4800-a17c-fceba6c6c4b4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:31.386054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5b3b4cb0-3b9c-4800-a17c-fceba6c6c4b4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:31.386685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5b3b4cb0-3b9c-4800-a17c-fceba6c6c4b4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:31.394194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5b3b4cb0-3b9c-4800-a17c-fceba6c6c4b4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:31.395316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5b3b4cb0-3b9c-4800-a17c-fceba6c6c4b4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:31.979035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5b3b4cb0-3b9c-4800-a17c-fceba6c6c4b4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:31.993038 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5b3b4cb0-3b9c-4800-a17c-fceba6c6c4b4 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1477 microversion: 2.1 time: 0.677065 Mar 05 20:50:31.995723 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 368/703] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:31 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1477 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:32.012311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-f19d2b67-15ee-4f1a-8879-a0e150fb48b8 req-b7747287-3579-40b1-982c-97cc0a4f5607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3261ac3a-9665-44b0-965d-06ac66c07d82", "name": "network-vif-unplugged", "status": "completed", "tag": "de504aa3-bfc4-44ec-a4bc-0df77d0e7550"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:32.033305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f19d2b67-15ee-4f1a-8879-a0e150fb48b8 req-b7747287-3579-40b1-982c-97cc0a4f5607 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:32.033772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f19d2b67-15ee-4f1a-8879-a0e150fb48b8 req-b7747287-3579-40b1-982c-97cc0a4f5607 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:32.068006 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-f19d2b67-15ee-4f1a-8879-a0e150fb48b8 req-b7747287-3579-40b1-982c-97cc0a4f5607 service nova] Creating event network-vif-unplugged:de504aa3-bfc4-44ec-a4bc-0df77d0e7550 for instance 3261ac3a-9665-44b0-965d-06ac66c07d82 on nch2-master-1 Mar 05 20:50:32.094240 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-72163ed6-e6c7-462a-a008-f4c8e3192610 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1610 microversion: 2.1 time: 2.093579 Mar 05 20:50:32.101355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-f19d2b67-15ee-4f1a-8879-a0e150fb48b8 req-b7747287-3579-40b1-982c-97cc0a4f5607 service nova] Instance 3261ac3a-9665-44b0-965d-06ac66c07d82 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:50:32.111887 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 336/704] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:29 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1610 bytes in 2117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:32.131276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a5b64a56-d29d-40cd-aef5-cf1cb14d206d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:32.131931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a5b64a56-d29d-40cd-aef5-cf1cb14d206d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:32.138307 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-f19d2b67-15ee-4f1a-8879-a0e150fb48b8 req-b7747287-3579-40b1-982c-97cc0a4f5607 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139693 Mar 05 20:50:32.142254 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 369/705] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:32.160451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5b64a56-d29d-40cd-aef5-cf1cb14d206d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:32.161245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5b64a56-d29d-40cd-aef5-cf1cb14d206d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:32.162396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5b64a56-d29d-40cd-aef5-cf1cb14d206d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:32.164918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5b64a56-d29d-40cd-aef5-cf1cb14d206d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:32.452281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0f81cbbd-7f24-4963-b9f1-0cdb8e4ec06c tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:32.484803 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0f81cbbd-7f24-4963-b9f1-0cdb8e4ec06c tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.340544 Mar 05 20:50:32.487851 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 370/706] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:32.501981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c6ac6085-ec7a-44da-814c-e5bff63ad41b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:32.503037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c6ac6085-ec7a-44da-814c-e5bff63ad41b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:32.515914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6ac6085-ec7a-44da-814c-e5bff63ad41b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:32.523107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6ac6085-ec7a-44da-814c-e5bff63ad41b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:32.524346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6ac6085-ec7a-44da-814c-e5bff63ad41b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:32.525077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6ac6085-ec7a-44da-814c-e5bff63ad41b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:33.189775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c6ac6085-ec7a-44da-814c-e5bff63ad41b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:33.201451 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c6ac6085-ec7a-44da-814c-e5bff63ad41b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1389 microversion: 2.1 time: 0.712288 Mar 05 20:50:33.220040 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 371/707] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:32 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1389 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:33.227830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8efd2aba-a7f0-4a24-8def-73c79b8e7c05 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:33.229381 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:50:33.229381 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:50:33.233483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8efd2aba-a7f0-4a24-8def-73c79b8e7c05 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:33.234282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8efd2aba-a7f0-4a24-8def-73c79b8e7c05 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:33.235337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8efd2aba-a7f0-4a24-8def-73c79b8e7c05 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:33.239926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a5b64a56-d29d-40cd-aef5-cf1cb14d206d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:33.249114 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a5b64a56-d29d-40cd-aef5-cf1cb14d206d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1473 microversion: 2.1 time: 1.136016 Mar 05 20:50:33.250670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8efd2aba-a7f0-4a24-8def-73c79b8e7c05 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:33.257109 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 337/708] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:32 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1473 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:33.276511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-944f5e43-29c0-4661-bd18-0452f366ad95 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:33.279006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-944f5e43-29c0-4661-bd18-0452f366ad95 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:33.308756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-944f5e43-29c0-4661-bd18-0452f366ad95 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:33.309471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-944f5e43-29c0-4661-bd18-0452f366ad95 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:33.310428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-944f5e43-29c0-4661-bd18-0452f366ad95 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:33.311021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-944f5e43-29c0-4661-bd18-0452f366ad95 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:33.344841 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8efd2aba-a7f0-4a24-8def-73c79b8e7c05 tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.122747 Mar 05 20:50:33.364166 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 372/709] 10.222.0.15 () {58 vars in 1175 bytes} [Sat Mar 5 20:50:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:33.373881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-31b5579b-0d50-41e7-912b-7bea74824811 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:33.442855 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-31b5579b-0d50-41e7-912b-7bea74824811 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors" status: 200 len: 3074 microversion: 2.1 time: 0.077177 Mar 05 20:50:33.448766 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 373/710] 10.222.0.15 () {58 vars in 1124 bytes} [Sat Mar 5 20:50:33 2022] GET /compute/v2.1/flavors => generated 3074 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:33.458493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-125c8bc5-d814-407d-a846-7d2c32953459 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:33.464420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-125c8bc5-d814-407d-a846-7d2c32953459 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:33.475180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-125c8bc5-d814-407d-a846-7d2c32953459 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:33.480015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-125c8bc5-d814-407d-a846-7d2c32953459 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:33.480939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-125c8bc5-d814-407d-a846-7d2c32953459 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:33.485472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-125c8bc5-d814-407d-a846-7d2c32953459 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:33.838555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-125c8bc5-d814-407d-a846-7d2c32953459 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:33.849261 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-125c8bc5-d814-407d-a846-7d2c32953459 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1477 microversion: 2.1 time: 0.398479 Mar 05 20:50:33.862296 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 374/711] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:33 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1477 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:33.881921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-380bb23d-ae45-4cfb-837c-29f993e5686d tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:33.883405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-380bb23d-ae45-4cfb-837c-29f993e5686d tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:33.900823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-380bb23d-ae45-4cfb-837c-29f993e5686d tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:33.901284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-380bb23d-ae45-4cfb-837c-29f993e5686d tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:33.902074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-380bb23d-ae45-4cfb-837c-29f993e5686d tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:33.907133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-380bb23d-ae45-4cfb-837c-29f993e5686d tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:34.049704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-380bb23d-ae45-4cfb-837c-29f993e5686d tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Lazy-loading 'flavor' on Instance uuid 21a93d69-84ef-4271-84c0-51db6b478596 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:50:34.075196 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-380bb23d-ae45-4cfb-837c-29f993e5686d tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 21a93d69-84ef-4271-84c0-51db6b478596 while it is in vm_state suspended Mar 05 20:50:34.076075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-380bb23d-ae45-4cfb-837c-29f993e5686d tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 21a93d69-84ef-4271-84c0-51db6b478596 while it is in vm_state suspended {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:34.077086 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-380bb23d-ae45-4cfb-837c-29f993e5686d tempest-LiveMigrationNegativeTest-730568867 tempest-LiveMigrationNegativeTest-730568867-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596/action" status: 409 len: 155 microversion: 2.1 time: 0.213563 Mar 05 20:50:34.085209 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 375/712] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:50:33 2022] POST /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596/action => generated 155 bytes in 222 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:50:34.097752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e9350881-57f6-4cc9-a6db-b5a06a3d5442 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:34.124247 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e9350881-57f6-4cc9-a6db-b5a06a3d5442 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033766 Mar 05 20:50:34.125734 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 376/713] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:34.131034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-23c6785d-3f1f-48c7-8bb2-8f64eb117f0f req-3ed9cc8e-79c4-42c0-8839-cde4cf4c6a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "499e4dcb-b39f-43e3-9cfc-27d4661dfb97", "name": "network-vif-plugged", "status": "completed", "tag": "a9d235c2-9ace-436f-8a2f-896e912f51bf"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:34.147795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-23c6785d-3f1f-48c7-8bb2-8f64eb117f0f req-3ed9cc8e-79c4-42c0-8839-cde4cf4c6a69 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:34.148243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-23c6785d-3f1f-48c7-8bb2-8f64eb117f0f req-3ed9cc8e-79c4-42c0-8839-cde4cf4c6a69 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:34.195918 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-23c6785d-3f1f-48c7-8bb2-8f64eb117f0f req-3ed9cc8e-79c4-42c0-8839-cde4cf4c6a69 service nova] Creating event network-vif-plugged:a9d235c2-9ace-436f-8a2f-896e912f51bf for instance 499e4dcb-b39f-43e3-9cfc-27d4661dfb97 on nch2-master-1 Mar 05 20:50:34.219025 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-23c6785d-3f1f-48c7-8bb2-8f64eb117f0f req-3ed9cc8e-79c4-42c0-8839-cde4cf4c6a69 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079680 Mar 05 20:50:34.222409 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 377/714] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:34.239223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-777be76c-ba7f-4fb7-bbbe-022147000063 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:34.240570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-777be76c-ba7f-4fb7-bbbe-022147000063 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:34.260394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-777be76c-ba7f-4fb7-bbbe-022147000063 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:34.263057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-777be76c-ba7f-4fb7-bbbe-022147000063 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:34.264075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-777be76c-ba7f-4fb7-bbbe-022147000063 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:34.267591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-777be76c-ba7f-4fb7-bbbe-022147000063 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:34.393713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-777be76c-ba7f-4fb7-bbbe-022147000063 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:50:34.546806 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-777be76c-ba7f-4fb7-bbbe-022147000063 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "DELETE /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 204 len: 0 microversion: 2.1 time: 0.322314 Mar 05 20:50:34.549081 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 378/715] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:50:34 2022] DELETE /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:50:34.635229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-944f5e43-29c0-4661-bd18-0452f366ad95 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:34.648664 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-944f5e43-29c0-4661-bd18-0452f366ad95 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1317 microversion: 2.1 time: 1.383682 Mar 05 20:50:34.652158 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 338/716] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:33 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1317 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:34.679614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a0578a32-b7f8-4d1f-9827-a1a18afa5a67 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:34.683492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-50f11116-1f97-4e02-8673-6fc45d6abf1f tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Calling method '.version_select at 0x7fed5d1e54c0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:34.689392 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a0578a32-b7f8-4d1f-9827-a1a18afa5a67 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021255 Mar 05 20:50:34.690659 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 339/717] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:34.704617 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-53f32133-9a95-45e6-8e5f-45a419ae15fe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:34.709104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-53f32133-9a95-45e6-8e5f-45a419ae15fe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:34.730647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG neutronclient.v2_0.client [None req-50f11116-1f97-4e02-8673-6fc45d6abf1f tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d4d3212-7159-4bd1-b72e-2eae7c3e2975 does not exist", "detail": ""}} {{(pid=141479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:50:34.731684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.security_group_api [None req-50f11116-1f97-4e02-8673-6fc45d6abf1f tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Neutron security group 9d4d3212-7159-4bd1-b72e-2eae7c3e2975 not found {{(pid=141479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:50:34.732755 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-50f11116-1f97-4e02-8673-6fc45d6abf1f tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] HTTP exception thrown: Security group 9d4d3212-7159-4bd1-b72e-2eae7c3e2975 does not exist Mar 05 20:50:34.732755 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-adb63358-6183-4eca-be92-4939b6063351'] Mar 05 20:50:34.733318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-50f11116-1f97-4e02-8673-6fc45d6abf1f tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Returning 404 to user: Security group 9d4d3212-7159-4bd1-b72e-2eae7c3e2975 does not exist Mar 05 20:50:34.733318 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-adb63358-6183-4eca-be92-4939b6063351'] {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:34.735033 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-50f11116-1f97-4e02-8673-6fc45d6abf1f tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/9d4d3212-7159-4bd1-b72e-2eae7c3e2975" status: 404 len: 194 microversion: 2.1 time: 0.183861 Mar 05 20:50:34.740940 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 379/718] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:50:34 2022] DELETE /compute/v2.1/os-security-groups/9d4d3212-7159-4bd1-b72e-2eae7c3e2975 => generated 194 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:50:34.747043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53f32133-9a95-45e6-8e5f-45a419ae15fe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:34.749449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-32c27ba9-5fe9-4363-a59d-fb14d86f722a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:34.750146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53f32133-9a95-45e6-8e5f-45a419ae15fe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:34.752302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-32c27ba9-5fe9-4363-a59d-fb14d86f722a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:34.752682 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53f32133-9a95-45e6-8e5f-45a419ae15fe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:34.753241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53f32133-9a95-45e6-8e5f-45a419ae15fe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:34.773609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32c27ba9-5fe9-4363-a59d-fb14d86f722a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:34.774254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32c27ba9-5fe9-4363-a59d-fb14d86f722a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:34.776162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32c27ba9-5fe9-4363-a59d-fb14d86f722a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:34.777868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32c27ba9-5fe9-4363-a59d-fb14d86f722a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:35.052846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-32c27ba9-5fe9-4363-a59d-fb14d86f722a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:35.063220 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-32c27ba9-5fe9-4363-a59d-fb14d86f722a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1473 microversion: 2.1 time: 0.319827 Mar 05 20:50:35.063441 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 380/719] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:34 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1473 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:35.087010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-afe9fea0-2d42-4fce-9cb8-c16ab27fc5b4 req-76d50722-4f5f-403e-bb8c-c8b22dca12ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3261ac3a-9665-44b0-965d-06ac66c07d82", "tag": "de504aa3-bfc4-44ec-a4bc-0df77d0e7550"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:35.103821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-afe9fea0-2d42-4fce-9cb8-c16ab27fc5b4 req-76d50722-4f5f-403e-bb8c-c8b22dca12ce service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:35.104276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-afe9fea0-2d42-4fce-9cb8-c16ab27fc5b4 req-76d50722-4f5f-403e-bb8c-c8b22dca12ce service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:35.123372 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-afe9fea0-2d42-4fce-9cb8-c16ab27fc5b4 req-76d50722-4f5f-403e-bb8c-c8b22dca12ce service nova] Creating event network-changed:de504aa3-bfc4-44ec-a4bc-0df77d0e7550 for instance 3261ac3a-9665-44b0-965d-06ac66c07d82 on nch2-master-1 Mar 05 20:50:35.129474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-afe9fea0-2d42-4fce-9cb8-c16ab27fc5b4 req-76d50722-4f5f-403e-bb8c-c8b22dca12ce service nova] Instance 3261ac3a-9665-44b0-965d-06ac66c07d82 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:50:35.141608 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-afe9fea0-2d42-4fce-9cb8-c16ab27fc5b4 req-76d50722-4f5f-403e-bb8c-c8b22dca12ce service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062301 Mar 05 20:50:35.142060 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 381/720] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:35.152972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5e029f35-81bd-4aae-b0ee-2cc7d5a6b4b0 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:35.154077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5e029f35-81bd-4aae-b0ee-2cc7d5a6b4b0 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:35.169173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e029f35-81bd-4aae-b0ee-2cc7d5a6b4b0 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:35.174028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e029f35-81bd-4aae-b0ee-2cc7d5a6b4b0 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:35.196738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e029f35-81bd-4aae-b0ee-2cc7d5a6b4b0 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:35.197381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e029f35-81bd-4aae-b0ee-2cc7d5a6b4b0 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:35.435826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-53f32133-9a95-45e6-8e5f-45a419ae15fe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:35.449554 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-53f32133-9a95-45e6-8e5f-45a419ae15fe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1389 microversion: 2.1 time: 0.756405 Mar 05 20:50:35.451279 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 340/721] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:34 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1389 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:35.458848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c7709532-c5f3-4116-926d-4a7f02560fe7 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:35.538308 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c7709532-c5f3-4116-926d-4a7f02560fe7 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.085582 Mar 05 20:50:35.551657 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 341/722] 10.222.0.15 () {58 vars in 1164 bytes} [Sat Mar 5 20:50:35 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:35.551657 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-814655e2-e62d-4038-8729-c7e00ab3ae38 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005476 Mar 05 20:50:35.576292 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 342/723] 10.222.0.15 () {58 vars in 1163 bytes} [Sat Mar 5 20:50:35 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 05 20:50:35.590011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7c7676e9-bc0e-4e21-a278-78c8e63c1e30 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:35.591309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7c7676e9-bc0e-4e21-a278-78c8e63c1e30 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:35.618155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c7676e9-bc0e-4e21-a278-78c8e63c1e30 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:35.619293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c7676e9-bc0e-4e21-a278-78c8e63c1e30 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:35.620276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c7676e9-bc0e-4e21-a278-78c8e63c1e30 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:35.623031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c7676e9-bc0e-4e21-a278-78c8e63c1e30 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:35.677963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5e029f35-81bd-4aae-b0ee-2cc7d5a6b4b0 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:35.693713 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5e029f35-81bd-4aae-b0ee-2cc7d5a6b4b0 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1465 microversion: 2.1 time: 0.549924 Mar 05 20:50:35.700260 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 382/724] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:35 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1465 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:35.717983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-05b993a3-f97c-4f62-8c5a-cea375a418e1 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:35.766905 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-05b993a3-f97c-4f62-8c5a-cea375a418e1 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.061347 Mar 05 20:50:35.778842 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 383/725] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:35.797504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ebd36e3-d496-47ac-9a82-356c9870f012 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Calling method '.version_select at 0x7fed5c9e1f70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:36.214532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7c7676e9-bc0e-4e21-a278-78c8e63c1e30 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:36.227138 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7c7676e9-bc0e-4e21-a278-78c8e63c1e30 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1463 microversion: 2.1 time: 0.648693 Mar 05 20:50:36.228372 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 343/726] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:35 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1463 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:36.234708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-db420520-c24c-4a94-865e-2222a8074253 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:36.241383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-db420520-c24c-4a94-865e-2222a8074253 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:36.255274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db420520-c24c-4a94-865e-2222a8074253 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:36.256809 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db420520-c24c-4a94-865e-2222a8074253 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:36.259562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db420520-c24c-4a94-865e-2222a8074253 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:36.264615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db420520-c24c-4a94-865e-2222a8074253 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:36.423251 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ebd36e3-d496-47ac-9a82-356c9870f012 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] 10.222.0.15 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.640137 Mar 05 20:50:36.423251 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 384/727] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 20:50:35 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:36.428290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4072bf1b-1a19-4b9f-b590-371b65cdaf5f tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:36.465078 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4072bf1b-1a19-4b9f-b590-371b65cdaf5f tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.040501 Mar 05 20:50:36.472254 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 385/728] 10.222.0.15 () {58 vars in 1168 bytes} [Sat Mar 5 20:50:36 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:36.480826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0bbdd68d-2eb8-41fc-b45d-e18ea2a5321a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:36.484547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0bbdd68d-2eb8-41fc-b45d-e18ea2a5321a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:36.497431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0bbdd68d-2eb8-41fc-b45d-e18ea2a5321a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:36.498222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0bbdd68d-2eb8-41fc-b45d-e18ea2a5321a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:36.499231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0bbdd68d-2eb8-41fc-b45d-e18ea2a5321a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:36.503240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0bbdd68d-2eb8-41fc-b45d-e18ea2a5321a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:36.755559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0bbdd68d-2eb8-41fc-b45d-e18ea2a5321a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:36.765753 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0bbdd68d-2eb8-41fc-b45d-e18ea2a5321a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1473 microversion: 2.1 time: 0.291277 Mar 05 20:50:36.769942 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 386/729] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:36 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1473 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:36.781044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f03762ad-4bb7-4783-bddf-1b8d9a1aac3d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:36.782165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f03762ad-4bb7-4783-bddf-1b8d9a1aac3d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:36.798223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-db420520-c24c-4a94-865e-2222a8074253 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:36.806086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f03762ad-4bb7-4783-bddf-1b8d9a1aac3d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:36.806577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f03762ad-4bb7-4783-bddf-1b8d9a1aac3d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:36.806929 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-db420520-c24c-4a94-865e-2222a8074253 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1317 microversion: 2.1 time: 0.576255 Mar 05 20:50:36.807500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f03762ad-4bb7-4783-bddf-1b8d9a1aac3d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:36.807994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f03762ad-4bb7-4783-bddf-1b8d9a1aac3d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:36.808117 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 344/730] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:36 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1317 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:36.815199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c76d38d-0697-40cd-b842-232122c5b560 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Calling method '.version_select at 0x7fed5cd47430>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:37.007719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f03762ad-4bb7-4783-bddf-1b8d9a1aac3d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:37.016539 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f03762ad-4bb7-4783-bddf-1b8d9a1aac3d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1463 microversion: 2.1 time: 0.243968 Mar 05 20:50:37.017704 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 387/731] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:36 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1463 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:37.029841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-07af8236-2d87-46b7-97dd-e13050531c7d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:37.031624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-07af8236-2d87-46b7-97dd-e13050531c7d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:37.038996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07af8236-2d87-46b7-97dd-e13050531c7d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:37.039744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07af8236-2d87-46b7-97dd-e13050531c7d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:37.040700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07af8236-2d87-46b7-97dd-e13050531c7d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:37.041291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07af8236-2d87-46b7-97dd-e13050531c7d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:37.224187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-07af8236-2d87-46b7-97dd-e13050531c7d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:37.232096 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-07af8236-2d87-46b7-97dd-e13050531c7d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1588 microversion: 2.1 time: 0.206043 Mar 05 20:50:37.233054 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 388/732] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:37 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1588 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:37.257221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-33c13c9a-ae3f-4635-82f7-852151a8f9ce tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:37.261087 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-33c13c9a-ae3f-4635-82f7-852151a8f9ce tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.020308 Mar 05 20:50:37.261870 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 389/733] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 20:50:37 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:37.266523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-420a7847-1e27-4a30-ad66-35862388be76 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:37.268709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-420a7847-1e27-4a30-ad66-35862388be76 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:37.274817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-420a7847-1e27-4a30-ad66-35862388be76 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:37.275285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-420a7847-1e27-4a30-ad66-35862388be76 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:37.276300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-420a7847-1e27-4a30-ad66-35862388be76 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:37.276751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-420a7847-1e27-4a30-ad66-35862388be76 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:37.323424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-8c76d38d-0697-40cd-b842-232122c5b560 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:50:37.324250 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-8c76d38d-0697-40cd-b842-232122c5b560 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] HTTP exception thrown: Insufficient rights for removing default security group. Mar 05 20:50:37.324250 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-e49886db-648a-4af7-aa21-fcb8c7bdf896'] Mar 05 20:50:37.338445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c76d38d-0697-40cd-b842-232122c5b560 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Returning 400 to user: Insufficient rights for removing default security group. Mar 05 20:50:37.338445 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-e49886db-648a-4af7-aa21-fcb8c7bdf896'] {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:37.340876 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8c76d38d-0697-40cd-b842-232122c5b560 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/2812b226-97d0-4803-aef2-cdc069a19949" status: 400 len: 182 microversion: 2.1 time: 0.529836 Mar 05 20:50:37.341916 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 345/734] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:50:36 2022] DELETE /compute/v2.1/os-security-groups/2812b226-97d0-4803-aef2-cdc069a19949 => generated 182 bytes in 533 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:50:37.346950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:37.350967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:37.362336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:37.364773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:37.366119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:37.366990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:37.465051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-420a7847-1e27-4a30-ad66-35862388be76 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:37.472306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:50:37.472886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:50:37.473555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:50:37.474294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:50:37.475289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:50:37.475840 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-420a7847-1e27-4a30-ad66-35862388be76 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1465 microversion: 2.1 time: 0.212839 Mar 05 20:50:37.477464 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 390/735] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:37 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1465 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:37.485756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-2f401524-c25c-498e-bb56-0e7a4259b07a req-94d09d35-b73b-4251-8a69-dc9ad7ef6bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3378502b-221a-43a1-94fb-a38942c6ea8f", "tag": "a08d1e53-56eb-4fc4-9b82-dc43fcf4a04b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:37.502689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2f401524-c25c-498e-bb56-0e7a4259b07a req-94d09d35-b73b-4251-8a69-dc9ad7ef6bd7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:37.504168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2f401524-c25c-498e-bb56-0e7a4259b07a req-94d09d35-b73b-4251-8a69-dc9ad7ef6bd7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:37.519519 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-2f401524-c25c-498e-bb56-0e7a4259b07a req-94d09d35-b73b-4251-8a69-dc9ad7ef6bd7 service nova] Creating event network-changed:a08d1e53-56eb-4fc4-9b82-dc43fcf4a04b for instance 3378502b-221a-43a1-94fb-a38942c6ea8f on nch1-master-1 Mar 05 20:50:37.533626 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-2f401524-c25c-498e-bb56-0e7a4259b07a req-94d09d35-b73b-4251-8a69-dc9ad7ef6bd7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054511 Mar 05 20:50:37.535219 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 391/736] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:37.541988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-903acf22-2556-42fa-8120-c8feb2b3509c tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:37.553050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-903acf22-2556-42fa-8120-c8feb2b3509c tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:37.561682 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-903acf22-2556-42fa-8120-c8feb2b3509c tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:37.563823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-903acf22-2556-42fa-8120-c8feb2b3509c tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:37.565293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-903acf22-2556-42fa-8120-c8feb2b3509c tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:37.565868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-903acf22-2556-42fa-8120-c8feb2b3509c tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:37.581802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:37.591169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:37.592587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:37.594655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:37.610926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:37.681379 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-31623da7-89f6-4840-a7ee-5771b9e242b0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action" status: 202 len: 1067 microversion: 2.1 time: 0.329187 Mar 05 20:50:37.688626 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 346/737] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:50:37 2022] POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action => generated 1067 bytes in 346 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 05 20:50:37.698004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3a4c38b7-ffe6-4f83-ab88-18eaa9022bda tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:37.714829 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3a4c38b7-ffe6-4f83-ab88-18eaa9022bda tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025153 Mar 05 20:50:37.715758 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 347/738] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:37.721445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cba8372e-3bc7-4a10-81c9-9216c57cb6aa tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Calling method '.version_select at 0x7fed5cb17310>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:37.778397 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-903acf22-2556-42fa-8120-c8feb2b3509c tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.241922 Mar 05 20:50:37.781819 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 392/739] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 20:50:37 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97/os-interface => generated 285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:37.788063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-93117989-8c75-4e32-ad52-c606e1598c1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:37.789081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-93117989-8c75-4e32-ad52-c606e1598c1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:37.803304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93117989-8c75-4e32-ad52-c606e1598c1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:37.805989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93117989-8c75-4e32-ad52-c606e1598c1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:37.806835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93117989-8c75-4e32-ad52-c606e1598c1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:37.807370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93117989-8c75-4e32-ad52-c606e1598c1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:37.817511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-cba8372e-3bc7-4a10-81c9-9216c57cb6aa tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a71eb401-11d7-4f7f-aad6-f454eea957d0 does not exist", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:50:37.818185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.security_group_api [None req-cba8372e-3bc7-4a10-81c9-9216c57cb6aa tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Neutron security group a71eb401-11d7-4f7f-aad6-f454eea957d0 not found {{(pid=141478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:50:37.818717 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-cba8372e-3bc7-4a10-81c9-9216c57cb6aa tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] HTTP exception thrown: Security group a71eb401-11d7-4f7f-aad6-f454eea957d0 does not exist Mar 05 20:50:37.818717 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-200eb04b-6ddf-4cd1-a8b7-19e13a4908ed'] Mar 05 20:50:37.820054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cba8372e-3bc7-4a10-81c9-9216c57cb6aa tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Returning 404 to user: Security group a71eb401-11d7-4f7f-aad6-f454eea957d0 does not exist Mar 05 20:50:37.820054 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-200eb04b-6ddf-4cd1-a8b7-19e13a4908ed'] {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:37.820579 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cba8372e-3bc7-4a10-81c9-9216c57cb6aa tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] 10.222.0.15 "GET /compute/v2.1/os-security-groups/a71eb401-11d7-4f7f-aad6-f454eea957d0" status: 404 len: 194 microversion: 2.1 time: 0.103730 Mar 05 20:50:37.821194 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 348/740] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 20:50:37 2022] GET /compute/v2.1/os-security-groups/a71eb401-11d7-4f7f-aad6-f454eea957d0 => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:50:37.832530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bff1ed6f-5b57-4668-927f-26342ff7a5ff tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:37.951298 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bff1ed6f-5b57-4668-927f-26342ff7a5ff tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.127833 Mar 05 20:50:37.971743 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 349/741] 10.222.0.15 () {58 vars in 1166 bytes} [Sat Mar 5 20:50:37 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:37.980481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2c464f97-19e3-45f6-82ee-49002c6df0ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:37.983132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2c464f97-19e3-45f6-82ee-49002c6df0ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:37.999583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c464f97-19e3-45f6-82ee-49002c6df0ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:38.000411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c464f97-19e3-45f6-82ee-49002c6df0ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:38.001485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c464f97-19e3-45f6-82ee-49002c6df0ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:38.002305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c464f97-19e3-45f6-82ee-49002c6df0ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:38.500778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-93117989-8c75-4e32-ad52-c606e1598c1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:38.516677 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-93117989-8c75-4e32-ad52-c606e1598c1e tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.735079 Mar 05 20:50:38.528085 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 393/742] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:37 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:38.536405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e518e9d9-9302-476c-a0c3-8c0951996c29 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Action: 'update', calling method: .version_select at 0x7fed5c770670>, body: {"security_group": {"name": "tempest-sg-1501888711", "description": "tempest-description-2115695740"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:38.604607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2c464f97-19e3-45f6-82ee-49002c6df0ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:38.628006 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2c464f97-19e3-45f6-82ee-49002c6df0ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1471 microversion: 2.1 time: 0.650251 Mar 05 20:50:38.628919 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 350/743] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:37 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1471 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:38.674442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c3c2f42c-28e3-43ae-8a7b-1e639e006526 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:38.675256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c3c2f42c-28e3-43ae-8a7b-1e639e006526 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:38.728797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c3c2f42c-28e3-43ae-8a7b-1e639e006526 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:38.729310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c3c2f42c-28e3-43ae-8a7b-1e639e006526 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:38.733131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c3c2f42c-28e3-43ae-8a7b-1e639e006526 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:38.733706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c3c2f42c-28e3-43ae-8a7b-1e639e006526 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:38.855037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG neutronclient.v2_0.client [None req-e518e9d9-9302-476c-a0c3-8c0951996c29 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d339da2e-9bfb-4a99-b38e-60d940ab4f10 does not exist", "detail": ""}} {{(pid=141479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:50:38.855978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.security_group_api [None req-e518e9d9-9302-476c-a0c3-8c0951996c29 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Neutron security group d339da2e-9bfb-4a99-b38e-60d940ab4f10 not found {{(pid=141479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:50:38.856657 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-e518e9d9-9302-476c-a0c3-8c0951996c29 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] HTTP exception thrown: Security group d339da2e-9bfb-4a99-b38e-60d940ab4f10 does not exist Mar 05 20:50:38.856657 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-85c60782-49ce-443c-9970-d1fb690f8529'] Mar 05 20:50:38.857847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e518e9d9-9302-476c-a0c3-8c0951996c29 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] Returning 404 to user: Security group d339da2e-9bfb-4a99-b38e-60d940ab4f10 does not exist Mar 05 20:50:38.857847 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-85c60782-49ce-443c-9970-d1fb690f8529'] {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:38.860761 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e518e9d9-9302-476c-a0c3-8c0951996c29 tempest-SecurityGroupsNegativeTestJSON-149679774 tempest-SecurityGroupsNegativeTestJSON-149679774-project] 10.222.0.15 "PUT /compute/v2.1/os-security-groups/d339da2e-9bfb-4a99-b38e-60d940ab4f10" status: 404 len: 194 microversion: 2.1 time: 0.329568 Mar 05 20:50:38.861612 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 394/744] 10.222.0.15 () {60 vars in 1289 bytes} [Sat Mar 5 20:50:38 2022] PUT /compute/v2.1/os-security-groups/d339da2e-9bfb-4a99-b38e-60d940ab4f10 => generated 194 bytes in 333 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:50:38.870066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-18a5adaa-5717-4670-81d4-a8c306c89b0b tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:38.889259 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-18a5adaa-5717-4670-81d4-a8c306c89b0b tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026421 Mar 05 20:50:38.890527 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 395/745] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:38.901359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-88b91265-a585-425f-938f-30c50eb12b1a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:38.902028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-88b91265-a585-425f-938f-30c50eb12b1a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:38.908984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88b91265-a585-425f-938f-30c50eb12b1a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:38.909488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88b91265-a585-425f-938f-30c50eb12b1a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:38.910368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88b91265-a585-425f-938f-30c50eb12b1a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:38.910858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88b91265-a585-425f-938f-30c50eb12b1a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:38.959712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88b91265-a585-425f-938f-30c50eb12b1a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:38.960623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88b91265-a585-425f-938f-30c50eb12b1a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:38.961299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-88b91265-a585-425f-938f-30c50eb12b1a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lazy-loading 'fault' on Instance uuid 21a93d69-84ef-4271-84c0-51db6b478596 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:50:39.046748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c3c2f42c-28e3-43ae-8a7b-1e639e006526 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:39.056668 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c3c2f42c-28e3-43ae-8a7b-1e639e006526 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1317 microversion: 2.1 time: 0.418692 Mar 05 20:50:39.066976 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 351/746] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:38 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:39.071711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-33efc26a-3c3c-4171-959e-417179b8d78c tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:39.092493 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-33efc26a-3c3c-4171-959e-417179b8d78c tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.024386 Mar 05 20:50:39.094049 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 352/747] 10.222.0.15 () {58 vars in 1143 bytes} [Sat Mar 5 20:50:39 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:39.122668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-feddd517-d498-4caa-9df7-44ea0b7933b7 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:39.134186 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-feddd517-d498-4caa-9df7-44ea0b7933b7 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023349 Mar 05 20:50:39.135303 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 353/748] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:39.150443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f812872c-cfe2-47f5-87a5-10061617cecf tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:39.158486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-88b91265-a585-425f-938f-30c50eb12b1a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:39.175118 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-88b91265-a585-425f-938f-30c50eb12b1a tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 200 len: 1308 microversion: 2.1 time: 0.278385 Mar 05 20:50:39.185633 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 396/749] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:38 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 1308 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:39.197553 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f812872c-cfe2-47f5-87a5-10061617cecf tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.052381 Mar 05 20:50:39.198407 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 354/750] 10.222.0.15 () {58 vars in 1147 bytes} [Sat Mar 5 20:50:39 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:39.225029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0ff3bc2d-923e-4da3-8c28-71b58ed064e2 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:39.242139 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0ff3bc2d-923e-4da3-8c28-71b58ed064e2 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.034026 Mar 05 20:50:39.247486 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 397/751] 10.222.0.15 () {58 vars in 1139 bytes} [Sat Mar 5 20:50:39 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:39.255621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-346acee3-c88d-46a5-ba46-b0f982c3edb6 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:39.264827 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-346acee3-c88d-46a5-ba46-b0f982c3edb6 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013651 Mar 05 20:50:39.265902 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 355/752] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:39.278707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-081034db-01c5-4e27-b2c4-3ef4371b1799 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:39.322930 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-081034db-01c5-4e27-b2c4-3ef4371b1799 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.050723 Mar 05 20:50:39.323794 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 398/753] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:50:39 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:39.335804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c7b00b99-86f5-43ef-a4ca-4612b3d16cbc tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:39.360496 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c7b00b99-86f5-43ef-a4ca-4612b3d16cbc tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.026828 Mar 05 20:50:39.361088 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 356/754] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:50:39 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:39.375897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-be58dc55-f8bd-4bad-b685-2b66468f1682 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:39.384327 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-be58dc55-f8bd-4bad-b685-2b66468f1682 tempest-FlavorsV2TestJSON-1376094467 tempest-FlavorsV2TestJSON-1376094467-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012522 Mar 05 20:50:39.391969 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 399/755] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:50:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:39.541974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-780a51f0-42ae-4ef0-b270-9512cc20c2d2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:39.543067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-780a51f0-42ae-4ef0-b270-9512cc20c2d2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:39.558413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-780a51f0-42ae-4ef0-b270-9512cc20c2d2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:39.559080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-780a51f0-42ae-4ef0-b270-9512cc20c2d2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:39.560898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-780a51f0-42ae-4ef0-b270-9512cc20c2d2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:39.561552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-780a51f0-42ae-4ef0-b270-9512cc20c2d2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:39.651091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-07bf51f6-a352-4a43-a130-d10d1c1332d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:39.651984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-07bf51f6-a352-4a43-a130-d10d1c1332d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:39.668966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07bf51f6-a352-4a43-a130-d10d1c1332d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:39.673570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07bf51f6-a352-4a43-a130-d10d1c1332d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:39.681962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07bf51f6-a352-4a43-a130-d10d1c1332d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:39.684983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07bf51f6-a352-4a43-a130-d10d1c1332d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:39.864902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-780a51f0-42ae-4ef0-b270-9512cc20c2d2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:39.873159 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-780a51f0-42ae-4ef0-b270-9512cc20c2d2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.337084 Mar 05 20:50:39.873887 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 357/756] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:39 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:39.879511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-760e69aa-25b3-4c24-8add-baa8b23c14bf req-4ba0df76-01c7-415c-9f89-fcfa19e1f888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a93d69-84ef-4271-84c0-51db6b478596", "name": "network-vif-deleted", "tag": "1e6bd486-5ded-43df-bdec-a261d46a9815"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:39.895889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-760e69aa-25b3-4c24-8add-baa8b23c14bf req-4ba0df76-01c7-415c-9f89-fcfa19e1f888 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:39.896594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-760e69aa-25b3-4c24-8add-baa8b23c14bf req-4ba0df76-01c7-415c-9f89-fcfa19e1f888 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:39.911556 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-760e69aa-25b3-4c24-8add-baa8b23c14bf req-4ba0df76-01c7-415c-9f89-fcfa19e1f888 service nova] Creating event network-vif-deleted:1e6bd486-5ded-43df-bdec-a261d46a9815 for instance 21a93d69-84ef-4271-84c0-51db6b478596 on nch1-master-1 Mar 05 20:50:39.916976 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-760e69aa-25b3-4c24-8add-baa8b23c14bf req-4ba0df76-01c7-415c-9f89-fcfa19e1f888 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041010 Mar 05 20:50:39.918399 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 358/757] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:40.075962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b5ee9b4b-2ad6-4d77-b217-72d47b2ee178 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:40.077026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b5ee9b4b-2ad6-4d77-b217-72d47b2ee178 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:40.091437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5ee9b4b-2ad6-4d77-b217-72d47b2ee178 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:40.093367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5ee9b4b-2ad6-4d77-b217-72d47b2ee178 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:40.098154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5ee9b4b-2ad6-4d77-b217-72d47b2ee178 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:40.098879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5ee9b4b-2ad6-4d77-b217-72d47b2ee178 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:40.231552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-07bf51f6-a352-4a43-a130-d10d1c1332d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:40.239337 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-07bf51f6-a352-4a43-a130-d10d1c1332d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1468 microversion: 2.1 time: 0.592644 Mar 05 20:50:40.239956 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 400/758] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:39 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1468 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:40.253521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7f4c70a2-e9c4-4996-a49c-575d61cbed56 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:40.256494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7f4c70a2-e9c4-4996-a49c-575d61cbed56 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: 21a93d69-84ef-4271-84c0-51db6b478596] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:40.269628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f4c70a2-e9c4-4996-a49c-575d61cbed56 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:40.280791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f4c70a2-e9c4-4996-a49c-575d61cbed56 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:40.281982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f4c70a2-e9c4-4996-a49c-575d61cbed56 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:40.282583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f4c70a2-e9c4-4996-a49c-575d61cbed56 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:40.306266 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-7f4c70a2-e9c4-4996-a49c-575d61cbed56 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] HTTP exception thrown: Instance 21a93d69-84ef-4271-84c0-51db6b478596 could not be found. Mar 05 20:50:40.311100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7f4c70a2-e9c4-4996-a49c-575d61cbed56 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Returning 404 to user: Instance 21a93d69-84ef-4271-84c0-51db6b478596 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:40.313704 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7f4c70a2-e9c4-4996-a49c-575d61cbed56 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596" status: 404 len: 111 microversion: 2.1 time: 0.065138 Mar 05 20:50:40.315945 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 401/759] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:40 2022] GET /compute/v2.1/servers/21a93d69-84ef-4271-84c0-51db6b478596 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:50:40.330201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ef05b447-c5b3-4ddd-a65f-f20ab947e602 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:40.331262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ef05b447-c5b3-4ddd-a65f-f20ab947e602 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:40.375964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef05b447-c5b3-4ddd-a65f-f20ab947e602 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:40.379001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef05b447-c5b3-4ddd-a65f-f20ab947e602 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:40.389706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef05b447-c5b3-4ddd-a65f-f20ab947e602 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:40.391529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef05b447-c5b3-4ddd-a65f-f20ab947e602 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:40.513715 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ef05b447-c5b3-4ddd-a65f-f20ab947e602 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "POST /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82/action" status: 204 len: 0 microversion: 2.1 time: 0.187474 Mar 05 20:50:40.516472 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 402/760] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:50:40 2022] POST /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82/action => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:50:40.528330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b7788f29-dc39-4412-bcc7-ef2bd4d71826 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:40.529375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b7788f29-dc39-4412-bcc7-ef2bd4d71826 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:40.539696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b7788f29-dc39-4412-bcc7-ef2bd4d71826 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:40.540745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b7788f29-dc39-4412-bcc7-ef2bd4d71826 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:40.542205 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b7788f29-dc39-4412-bcc7-ef2bd4d71826 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:40.543042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b7788f29-dc39-4412-bcc7-ef2bd4d71826 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:40.582588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b7788f29-dc39-4412-bcc7-ef2bd4d71826 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:50:40.583872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b5ee9b4b-2ad6-4d77-b217-72d47b2ee178 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:40.592305 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b5ee9b4b-2ad6-4d77-b217-72d47b2ee178 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1317 microversion: 2.1 time: 0.521619 Mar 05 20:50:40.595433 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 359/761] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:40 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:40.604054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3a5e42b9-0c99-4d23-bacf-a29df737fa56 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:40.607896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3a5e42b9-0c99-4d23-bacf-a29df737fa56 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:40.629801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a5e42b9-0c99-4d23-bacf-a29df737fa56 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:40.630156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a5e42b9-0c99-4d23-bacf-a29df737fa56 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:40.631113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a5e42b9-0c99-4d23-bacf-a29df737fa56 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:40.631749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a5e42b9-0c99-4d23-bacf-a29df737fa56 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:40.767403 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b7788f29-dc39-4412-bcc7-ef2bd4d71826 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 204 len: 0 microversion: 2.1 time: 0.244830 Mar 05 20:50:40.771764 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 403/762] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:50:40 2022] DELETE /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:50:40.791957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6bf46032-3aab-447b-bb94-5e3954fab40b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:40.793011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6bf46032-3aab-447b-bb94-5e3954fab40b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:40.803143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bf46032-3aab-447b-bb94-5e3954fab40b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:40.804642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bf46032-3aab-447b-bb94-5e3954fab40b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:40.805626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bf46032-3aab-447b-bb94-5e3954fab40b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:40.806244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bf46032-3aab-447b-bb94-5e3954fab40b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:41.006432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3a5e42b9-0c99-4d23-bacf-a29df737fa56 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:41.019936 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3a5e42b9-0c99-4d23-bacf-a29df737fa56 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1468 microversion: 2.1 time: 0.422581 Mar 05 20:50:41.020740 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 360/763] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:40 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1468 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:41.042787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-9859bed4-f21a-4664-b252-f8138607eb5e req-a34d500f-e0e9-4aba-bcab-787eaeadf214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "499e4dcb-b39f-43e3-9cfc-27d4661dfb97", "tag": "a9d235c2-9ace-436f-8a2f-896e912f51bf"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:41.069593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9859bed4-f21a-4664-b252-f8138607eb5e req-a34d500f-e0e9-4aba-bcab-787eaeadf214 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:41.070328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9859bed4-f21a-4664-b252-f8138607eb5e req-a34d500f-e0e9-4aba-bcab-787eaeadf214 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:41.099180 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-9859bed4-f21a-4664-b252-f8138607eb5e req-a34d500f-e0e9-4aba-bcab-787eaeadf214 service nova] Creating event network-changed:a9d235c2-9ace-436f-8a2f-896e912f51bf for instance 499e4dcb-b39f-43e3-9cfc-27d4661dfb97 on nch2-master-1 Mar 05 20:50:41.106306 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-9859bed4-f21a-4664-b252-f8138607eb5e req-a34d500f-e0e9-4aba-bcab-787eaeadf214 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071222 Mar 05 20:50:41.109403 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 361/764] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:41.121829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6d20ddb6-fd3e-449c-8507-b4bba95e02e9 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:41.123306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6d20ddb6-fd3e-449c-8507-b4bba95e02e9 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:41.132369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d20ddb6-fd3e-449c-8507-b4bba95e02e9 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:41.133490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d20ddb6-fd3e-449c-8507-b4bba95e02e9 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:41.134445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d20ddb6-fd3e-449c-8507-b4bba95e02e9 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:41.135030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d20ddb6-fd3e-449c-8507-b4bba95e02e9 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:41.246433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6bf46032-3aab-447b-bb94-5e3954fab40b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:41.257137 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6bf46032-3aab-447b-bb94-5e3954fab40b tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1588 microversion: 2.1 time: 0.480454 Mar 05 20:50:41.274679 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 404/765] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:40 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1588 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:41.303282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-707e13eb-a095-4041-923f-f2ca8afcd798 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:41.306294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-707e13eb-a095-4041-923f-f2ca8afcd798 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:41.321151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-707e13eb-a095-4041-923f-f2ca8afcd798 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:41.328285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-707e13eb-a095-4041-923f-f2ca8afcd798 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:41.329812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-707e13eb-a095-4041-923f-f2ca8afcd798 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:41.333674 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-707e13eb-a095-4041-923f-f2ca8afcd798 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:41.688569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6d20ddb6-fd3e-449c-8507-b4bba95e02e9 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:41.703734 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6d20ddb6-fd3e-449c-8507-b4bba95e02e9 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1475 microversion: 2.1 time: 0.592962 Mar 05 20:50:41.707400 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 362/766] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:41 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1475 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:41.726870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-042bc034-91bd-48dc-9fb1-3b9ce6aba1be tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:41.727922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-042bc034-91bd-48dc-9fb1-3b9ce6aba1be tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:41.743073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-042bc034-91bd-48dc-9fb1-3b9ce6aba1be tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:41.744234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-042bc034-91bd-48dc-9fb1-3b9ce6aba1be tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:41.747040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-042bc034-91bd-48dc-9fb1-3b9ce6aba1be tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:41.748679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-042bc034-91bd-48dc-9fb1-3b9ce6aba1be tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:41.816144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-707e13eb-a095-4041-923f-f2ca8afcd798 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:41.828834 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-707e13eb-a095-4041-923f-f2ca8afcd798 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.545053 Mar 05 20:50:41.829813 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 405/767] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:41 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:42.038636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b62cae53-02c4-4aa7-aa5b-7519b478e7ed tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:42.039213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b62cae53-02c4-4aa7-aa5b-7519b478e7ed tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:42.052774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b62cae53-02c4-4aa7-aa5b-7519b478e7ed tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:42.054652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b62cae53-02c4-4aa7-aa5b-7519b478e7ed tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:42.058296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b62cae53-02c4-4aa7-aa5b-7519b478e7ed tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:42.063030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b62cae53-02c4-4aa7-aa5b-7519b478e7ed tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:42.241253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-042bc034-91bd-48dc-9fb1-3b9ce6aba1be tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:42.251075 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-042bc034-91bd-48dc-9fb1-3b9ce6aba1be tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1317 microversion: 2.1 time: 0.542214 Mar 05 20:50:42.262379 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 363/768] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:41 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1317 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:42.438919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b62cae53-02c4-4aa7-aa5b-7519b478e7ed tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:42.447137 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b62cae53-02c4-4aa7-aa5b-7519b478e7ed tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1468 microversion: 2.1 time: 0.412833 Mar 05 20:50:42.447738 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 406/769] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:42 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1468 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:42.466805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-bf7f3f84-bd49-43a3-8502-339caa8c3e6f req-db38d377-f9d7-4dc9-bb2e-b8076e02b636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3261ac3a-9665-44b0-965d-06ac66c07d82", "name": "network-vif-plugged", "status": "completed", "tag": "de504aa3-bfc4-44ec-a4bc-0df77d0e7550"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:42.493755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-bf7f3f84-bd49-43a3-8502-339caa8c3e6f req-db38d377-f9d7-4dc9-bb2e-b8076e02b636 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:42.495275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-bf7f3f84-bd49-43a3-8502-339caa8c3e6f req-db38d377-f9d7-4dc9-bb2e-b8076e02b636 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:42.518943 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-bf7f3f84-bd49-43a3-8502-339caa8c3e6f req-db38d377-f9d7-4dc9-bb2e-b8076e02b636 service nova] Creating event network-vif-plugged:de504aa3-bfc4-44ec-a4bc-0df77d0e7550 for instance 3261ac3a-9665-44b0-965d-06ac66c07d82 on nch2-master-1 Mar 05 20:50:42.533890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-bf7f3f84-bd49-43a3-8502-339caa8c3e6f req-db38d377-f9d7-4dc9-bb2e-b8076e02b636 service nova] Instance 3261ac3a-9665-44b0-965d-06ac66c07d82 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:50:42.563635 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-bf7f3f84-bd49-43a3-8502-339caa8c3e6f req-db38d377-f9d7-4dc9-bb2e-b8076e02b636 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113245 Mar 05 20:50:42.564639 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 407/770] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:42.725754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b8221458-bde2-4f1f-995c-3f83c468fa33 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:42.726471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b8221458-bde2-4f1f-995c-3f83c468fa33 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:42.737892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8221458-bde2-4f1f-995c-3f83c468fa33 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:42.738347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8221458-bde2-4f1f-995c-3f83c468fa33 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:42.739143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8221458-bde2-4f1f-995c-3f83c468fa33 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:42.739610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8221458-bde2-4f1f-995c-3f83c468fa33 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:42.841186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ce8ae74a-17d8-4208-8940-e2da280d3cc6 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] Calling method '.version_select at 0x7fed5cfe2280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:42.887943 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-ce8ae74a-17d8-4208-8940-e2da280d3cc6 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] HTTP exception thrown: Image not found. Mar 05 20:50:42.889734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ce8ae74a-17d8-4208-8940-e2da280d3cc6 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] Returning 404 to user: Image not found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:42.892366 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ce8ae74a-17d8-4208-8940-e2da280d3cc6 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] 10.222.0.15 "DELETE /compute/v2.1/images/92af64bc-f182-4fb0-8b55-e272efd1eef7/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.626225 Mar 05 20:50:42.897961 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 364/771] 10.222.0.15 () {58 vars in 1292 bytes} [Sat Mar 5 20:50:42 2022] DELETE /compute/v2.1/images/92af64bc-f182-4fb0-8b55-e272efd1eef7/metadata/os_distro => generated 62 bytes in 633 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:50:42.903442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-89125eea-0561-4bd1-a520-22db1c822cc2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:42.904524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-89125eea-0561-4bd1-a520-22db1c822cc2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:42.913943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89125eea-0561-4bd1-a520-22db1c822cc2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:42.914546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89125eea-0561-4bd1-a520-22db1c822cc2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:42.915545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89125eea-0561-4bd1-a520-22db1c822cc2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:42.916219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89125eea-0561-4bd1-a520-22db1c822cc2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:43.080903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b8221458-bde2-4f1f-995c-3f83c468fa33 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:43.089975 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b8221458-bde2-4f1f-995c-3f83c468fa33 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1475 microversion: 2.1 time: 0.368462 Mar 05 20:50:43.092421 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 408/772] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:42 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1475 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:43.099417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bdd16688-26d8-41ee-ab2e-e77d5e149734 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] Calling method '.version_select at 0x7fed5c79ce50>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:43.125044 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-bdd16688-26d8-41ee-ab2e-e77d5e149734 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] HTTP exception thrown: Image not found. Mar 05 20:50:43.128477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bdd16688-26d8-41ee-ab2e-e77d5e149734 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] Returning 404 to user: Image not found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:43.129626 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bdd16688-26d8-41ee-ab2e-e77d5e149734 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] 10.222.0.15 "GET /compute/v2.1/images/1a3c35ac-5084-40df-b94d-4c4a721d06f5/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.035333 Mar 05 20:50:43.131953 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 409/773] 10.222.0.15 () {58 vars in 1292 bytes} [Sat Mar 5 20:50:43 2022] GET /compute/v2.1/images/1a3c35ac-5084-40df-b94d-4c4a721d06f5/metadata/os_version => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:50:43.141411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-66b1d5d7-16ed-4462-a317-bb43f7160191 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] Calling method '.version_select at 0x7fed5c8081f0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:43.170320 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-66b1d5d7-16ed-4462-a317-bb43f7160191 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] HTTP exception thrown: Image not found. Mar 05 20:50:43.171034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-66b1d5d7-16ed-4462-a317-bb43f7160191 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] Returning 404 to user: Image not found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:43.172526 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-66b1d5d7-16ed-4462-a317-bb43f7160191 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] 10.222.0.15 "GET /compute/v2.1/images/00a1b425-ab2c-42b8-a46f-b1b2b6f3da68/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036190 Mar 05 20:50:43.173075 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 410/774] 10.222.0.15 () {58 vars in 1259 bytes} [Sat Mar 5 20:50:43 2022] GET /compute/v2.1/images/00a1b425-ab2c-42b8-a46f-b1b2b6f3da68/metadata => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 05 20:50:43.183516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8f1c68af-c917-4d00-aaa4-6e90ea29ab67 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] Action: 'update_all', calling method: .version_select at 0x7fed5cfb31f0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:43.221639 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-8f1c68af-c917-4d00-aaa4-6e90ea29ab67 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] HTTP exception thrown: Image not found. Mar 05 20:50:43.222331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8f1c68af-c917-4d00-aaa4-6e90ea29ab67 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] Returning 404 to user: Image not found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:43.223615 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8f1c68af-c917-4d00-aaa4-6e90ea29ab67 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] 10.222.0.15 "PUT /compute/v2.1/images/6b3e9d4c-b26f-4aaf-93b6-9254eedc02de/metadata" status: 404 len: 62 microversion: 2.1 time: 0.044086 Mar 05 20:50:43.224474 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 411/775] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 20:50:43 2022] PUT /compute/v2.1/images/6b3e9d4c-b26f-4aaf-93b6-9254eedc02de/metadata => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 05 20:50:43.237867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-929cb063-0756-494c-ae77-07439666d2ee tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] Action: 'update', calling method: .version_select at 0x7fed5c808940>, body: {"meta": {"os_distro": "alt"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:43.269891 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-929cb063-0756-494c-ae77-07439666d2ee tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] HTTP exception thrown: Image not found. Mar 05 20:50:43.270897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-929cb063-0756-494c-ae77-07439666d2ee tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] Returning 404 to user: Image not found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:43.272111 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-929cb063-0756-494c-ae77-07439666d2ee tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] 10.222.0.15 "PUT /compute/v2.1/images/eaa66c71-e72e-4944-b46b-fdd47e2c0db6/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.040426 Mar 05 20:50:43.272949 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 412/776] 10.222.0.15 () {60 vars in 1309 bytes} [Sat Mar 5 20:50:43 2022] PUT /compute/v2.1/images/eaa66c71-e72e-4944-b46b-fdd47e2c0db6/metadata/os_distro => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 05 20:50:43.284981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4b4ea03a-961e-4961-a4cf-e9836cb0c7eb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:43.286482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4b4ea03a-961e-4961-a4cf-e9836cb0c7eb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:43.293902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b4ea03a-961e-4961-a4cf-e9836cb0c7eb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:43.293902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b4ea03a-961e-4961-a4cf-e9836cb0c7eb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:43.294935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b4ea03a-961e-4961-a4cf-e9836cb0c7eb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:43.295475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b4ea03a-961e-4961-a4cf-e9836cb0c7eb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:43.507126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4b4ea03a-961e-4961-a4cf-e9836cb0c7eb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:43.534354 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4b4ea03a-961e-4961-a4cf-e9836cb0c7eb tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1317 microversion: 2.1 time: 0.256973 Mar 05 20:50:43.539818 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 413/777] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:43 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:43.551096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-20e045b1-8d94-49ff-b6f2-da5bc37fabb6 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] Action: 'create', calling method: .version_select at 0x7fed5cabdb80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:43.581762 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-20e045b1-8d94-49ff-b6f2-da5bc37fabb6 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] HTTP exception thrown: Image not found. Mar 05 20:50:43.582665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-20e045b1-8d94-49ff-b6f2-da5bc37fabb6 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] Returning 404 to user: Image not found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:43.583951 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-20e045b1-8d94-49ff-b6f2-da5bc37fabb6 tempest-ImagesMetadataNegativeTestJSON-309641760 tempest-ImagesMetadataNegativeTestJSON-309641760-project] 10.222.0.15 "POST /compute/v2.1/images/5400a18c-0fc4-4c94-a192-4a0169ecdf89/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047338 Mar 05 20:50:43.585269 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 414/778] 10.222.0.15 () {60 vars in 1280 bytes} [Sat Mar 5 20:50:43 2022] POST /compute/v2.1/images/5400a18c-0fc4-4c94-a192-4a0169ecdf89/metadata => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:50:43.721135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-89125eea-0561-4bd1-a520-22db1c822cc2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:43.739028 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-89125eea-0561-4bd1-a520-22db1c822cc2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.839720 Mar 05 20:50:43.740261 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 365/779] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:42 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:43.752249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f542ee69-db16-4841-b090-1c44ab86f045 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:43.753065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f542ee69-db16-4841-b090-1c44ab86f045 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:43.760801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f542ee69-db16-4841-b090-1c44ab86f045 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:43.763447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f542ee69-db16-4841-b090-1c44ab86f045 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:43.764516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f542ee69-db16-4841-b090-1c44ab86f045 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:43.768224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f542ee69-db16-4841-b090-1c44ab86f045 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:43.768554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dc39feb0-4c01-429e-a5d9-f2e72fea7224 tempest-AZV2TestJSON-865385549 tempest-AZV2TestJSON-865385549-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:43.770918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc39feb0-4c01-429e-a5d9-f2e72fea7224 tempest-AZV2TestJSON-865385549 tempest-AZV2TestJSON-865385549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:43.771526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc39feb0-4c01-429e-a5d9-f2e72fea7224 tempest-AZV2TestJSON-865385549 tempest-AZV2TestJSON-865385549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:43.773036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc39feb0-4c01-429e-a5d9-f2e72fea7224 tempest-AZV2TestJSON-865385549 tempest-AZV2TestJSON-865385549-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:43.773974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc39feb0-4c01-429e-a5d9-f2e72fea7224 tempest-AZV2TestJSON-865385549 tempest-AZV2TestJSON-865385549-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:43.803878 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dc39feb0-4c01-429e-a5d9-f2e72fea7224 tempest-AZV2TestJSON-865385549 tempest-AZV2TestJSON-865385549-project] 10.222.0.15 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.216472 Mar 05 20:50:43.805775 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 415/780] 10.222.0.15 () {58 vars in 1163 bytes} [Sat Mar 5 20:50:43 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:50:44.118824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-afa140d4-4545-40bb-81d7-6e593e2a6ca8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:44.119736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-afa140d4-4545-40bb-81d7-6e593e2a6ca8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:44.129908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f542ee69-db16-4841-b090-1c44ab86f045 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:44.137038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afa140d4-4545-40bb-81d7-6e593e2a6ca8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:44.140827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afa140d4-4545-40bb-81d7-6e593e2a6ca8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:44.142452 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f542ee69-db16-4841-b090-1c44ab86f045 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1468 microversion: 2.1 time: 0.397040 Mar 05 20:50:44.143232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afa140d4-4545-40bb-81d7-6e593e2a6ca8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:44.143920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afa140d4-4545-40bb-81d7-6e593e2a6ca8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:44.145686 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 366/781] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:43 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1468 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:44.441254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-afa140d4-4545-40bb-81d7-6e593e2a6ca8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eaf06f561734f4b8471344612a4eb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c17cd80f57435e83687f847a73abd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:44.451446 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-afa140d4-4545-40bb-81d7-6e593e2a6ca8 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 200 len: 1475 microversion: 2.1 time: 0.345423 Mar 05 20:50:44.466871 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 416/782] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:44 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 1475 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:44.469364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8736a92e-2c45-4d1f-862b-7aedc4f6480f req-51d3f61b-a243-453f-929c-9d94f2ab3df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f230ca64-ecae-4706-a59a-45da927e38a9", "name": "network-vif-deleted", "tag": "f735b1e1-9320-4212-b3ea-1aa7016452b8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:44.488348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8736a92e-2c45-4d1f-862b-7aedc4f6480f req-51d3f61b-a243-453f-929c-9d94f2ab3df4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:44.488800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8736a92e-2c45-4d1f-862b-7aedc4f6480f req-51d3f61b-a243-453f-929c-9d94f2ab3df4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:44.516921 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8736a92e-2c45-4d1f-862b-7aedc4f6480f req-51d3f61b-a243-453f-929c-9d94f2ab3df4 service nova] Creating event network-vif-deleted:f735b1e1-9320-4212-b3ea-1aa7016452b8 for instance f230ca64-ecae-4706-a59a-45da927e38a9 on nch1-master-1 Mar 05 20:50:44.524866 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-8736a92e-2c45-4d1f-862b-7aedc4f6480f req-51d3f61b-a243-453f-929c-9d94f2ab3df4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058605 Mar 05 20:50:44.526043 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 367/783] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:44.551767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b6811d4a-21ed-43d0-9999-09505a0dc59c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:44.552923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b6811d4a-21ed-43d0-9999-09505a0dc59c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:44.559332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6811d4a-21ed-43d0-9999-09505a0dc59c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:44.560414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6811d4a-21ed-43d0-9999-09505a0dc59c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:44.562150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6811d4a-21ed-43d0-9999-09505a0dc59c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:44.563122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6811d4a-21ed-43d0-9999-09505a0dc59c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:44.756963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9fe4cc56-609c-4c58-bb7a-2623d8bef5e7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:44.757675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9fe4cc56-609c-4c58-bb7a-2623d8bef5e7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:44.769507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9fe4cc56-609c-4c58-bb7a-2623d8bef5e7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:44.769973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9fe4cc56-609c-4c58-bb7a-2623d8bef5e7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:44.770768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9fe4cc56-609c-4c58-bb7a-2623d8bef5e7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:44.771222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9fe4cc56-609c-4c58-bb7a-2623d8bef5e7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:45.105347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b6811d4a-21ed-43d0-9999-09505a0dc59c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:45.117562 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b6811d4a-21ed-43d0-9999-09505a0dc59c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1317 microversion: 2.1 time: 0.569672 Mar 05 20:50:45.129654 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 417/784] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:44 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:45.162900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-58a091eb-389a-4176-9fd6-7e12a7e9f87b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:45.163947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-58a091eb-389a-4176-9fd6-7e12a7e9f87b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:45.174166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-58a091eb-389a-4176-9fd6-7e12a7e9f87b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:45.176751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9fe4cc56-609c-4c58-bb7a-2623d8bef5e7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:45.177295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-58a091eb-389a-4176-9fd6-7e12a7e9f87b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:45.178399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-58a091eb-389a-4176-9fd6-7e12a7e9f87b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:45.180595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-58a091eb-389a-4176-9fd6-7e12a7e9f87b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:45.193822 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9fe4cc56-609c-4c58-bb7a-2623d8bef5e7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.440185 Mar 05 20:50:45.195246 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 368/785] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:44 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:45.474566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41e4d7a5-f3c9-4510-ac85-e8b4cb3a3f22 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:45.475766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-41e4d7a5-f3c9-4510-ac85-e8b4cb3a3f22 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] [instance: f230ca64-ecae-4706-a59a-45da927e38a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:45.485187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41e4d7a5-f3c9-4510-ac85-e8b4cb3a3f22 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:45.489344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41e4d7a5-f3c9-4510-ac85-e8b4cb3a3f22 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:45.490498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41e4d7a5-f3c9-4510-ac85-e8b4cb3a3f22 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:45.491259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41e4d7a5-f3c9-4510-ac85-e8b4cb3a3f22 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:45.537617 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-41e4d7a5-f3c9-4510-ac85-e8b4cb3a3f22 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] HTTP exception thrown: Instance f230ca64-ecae-4706-a59a-45da927e38a9 could not be found. Mar 05 20:50:45.539298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41e4d7a5-f3c9-4510-ac85-e8b4cb3a3f22 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] Returning 404 to user: Instance f230ca64-ecae-4706-a59a-45da927e38a9 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:50:45.540589 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-41e4d7a5-f3c9-4510-ac85-e8b4cb3a3f22 tempest-LiveMigrationNegativeTest-638242910 tempest-LiveMigrationNegativeTest-638242910-project] 10.222.0.15 "GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9" status: 404 len: 111 microversion: 2.1 time: 0.070465 Mar 05 20:50:45.543039 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 369/786] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:45 2022] GET /compute/v2.1/servers/f230ca64-ecae-4706-a59a-45da927e38a9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:50:45.600359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-58a091eb-389a-4176-9fd6-7e12a7e9f87b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:45.611165 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-58a091eb-389a-4176-9fd6-7e12a7e9f87b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1460 microversion: 2.1 time: 0.451660 Mar 05 20:50:45.615943 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 418/787] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:45 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1460 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:45.630298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d1105aec-ba0b-4e96-9481-9c4c3dfdc14b req-3253ba90-a121-4cd4-b825-409a8a3a876d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3378502b-221a-43a1-94fb-a38942c6ea8f", "name": "network-vif-plugged", "status": "completed", "tag": "a08d1e53-56eb-4fc4-9b82-dc43fcf4a04b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:45.635884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-29cc333d-4f07-4431-bc12-1f9bfcbde400 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:45.639462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-29cc333d-4f07-4431-bc12-1f9bfcbde400 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:45.641758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d1105aec-ba0b-4e96-9481-9c4c3dfdc14b req-3253ba90-a121-4cd4-b825-409a8a3a876d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:45.644281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d1105aec-ba0b-4e96-9481-9c4c3dfdc14b req-3253ba90-a121-4cd4-b825-409a8a3a876d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:45.653166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29cc333d-4f07-4431-bc12-1f9bfcbde400 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:45.664717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29cc333d-4f07-4431-bc12-1f9bfcbde400 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:45.667711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29cc333d-4f07-4431-bc12-1f9bfcbde400 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:45.669659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29cc333d-4f07-4431-bc12-1f9bfcbde400 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:45.675808 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d1105aec-ba0b-4e96-9481-9c4c3dfdc14b req-3253ba90-a121-4cd4-b825-409a8a3a876d service nova] Creating event network-vif-plugged:a08d1e53-56eb-4fc4-9b82-dc43fcf4a04b for instance 3378502b-221a-43a1-94fb-a38942c6ea8f on nch1-master-1 Mar 05 20:50:45.686334 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d1105aec-ba0b-4e96-9481-9c4c3dfdc14b req-3253ba90-a121-4cd4-b825-409a8a3a876d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068645 Mar 05 20:50:45.688094 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 370/788] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:45.950630 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-29cc333d-4f07-4431-bc12-1f9bfcbde400 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1611 microversion: 2.1 time: 0.318506 Mar 05 20:50:45.951657 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 419/789] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:45 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1611 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:45.974934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1a225bc7-702b-41ec-a021-051d48e7c4c8 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Calling method '.version_select at 0x7fed5cbe0940>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:45.977704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a225bc7-702b-41ec-a021-051d48e7c4c8 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:45.978216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a225bc7-702b-41ec-a021-051d48e7c4c8 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:46.008421 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1a225bc7-702b-41ec-a021-051d48e7c4c8 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.038159 Mar 05 20:50:46.009029 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 371/790] 10.222.0.15 () {58 vars in 1142 bytes} [Sat Mar 5 20:50:45 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:46.135692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2dfb9cad-bfeb-42f1-8243-026fdebcd4ae tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:46.137645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2dfb9cad-bfeb-42f1-8243-026fdebcd4ae tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:46.147240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dfb9cad-bfeb-42f1-8243-026fdebcd4ae tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:46.151968 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dfb9cad-bfeb-42f1-8243-026fdebcd4ae tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:46.153919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dfb9cad-bfeb-42f1-8243-026fdebcd4ae tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:46.156742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dfb9cad-bfeb-42f1-8243-026fdebcd4ae tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:46.210951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1014964993", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:46.305919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:50:46.547982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2dfb9cad-bfeb-42f1-8243-026fdebcd4ae tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:46.559613 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2dfb9cad-bfeb-42f1-8243-026fdebcd4ae tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1317 microversion: 2.1 time: 0.428539 Mar 05 20:50:46.562741 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 420/791] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:46 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:46.575330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-04874712-da98-41d9-9dc2-6c6f93159ef6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:46.576467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-04874712-da98-41d9-9dc2-6c6f93159ef6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:46.607746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04874712-da98-41d9-9dc2-6c6f93159ef6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:46.607746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04874712-da98-41d9-9dc2-6c6f93159ef6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:46.607746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04874712-da98-41d9-9dc2-6c6f93159ef6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:46.607746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04874712-da98-41d9-9dc2-6c6f93159ef6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:46.680760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:50:46.682291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:50:46.683495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:50:46.684664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:50:46.685339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:50:46.701509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:46.702968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:46.704394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:46.704998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:46.728926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Getting quotas for project 3501f5d56344468ebc4d50db1a5c5bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:50:46.735331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Getting quotas for user 52cc30e265f94e3caa91b6adff365209 and project 3501f5d56344468ebc4d50db1a5c5bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:50:46.752381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:50:46.754872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:50:46.818519 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bd3358ae-a4fb-4f55-ac99-6d685d2035b7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612695 Mar 05 20:50:46.819958 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 372/792] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:50:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:50:46.838715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f5d55881-4567-4b6b-9ff3-d52155481996 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:46.841048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f5d55881-4567-4b6b-9ff3-d52155481996 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:46.974845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f5d55881-4567-4b6b-9ff3-d52155481996 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:46.982572 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f5d55881-4567-4b6b-9ff3-d52155481996 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1213 microversion: 2.1 time: 0.155968 Mar 05 20:50:46.983198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-04874712-da98-41d9-9dc2-6c6f93159ef6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:46.986138 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 373/793] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:46 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1213 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:46.998816 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-04874712-da98-41d9-9dc2-6c6f93159ef6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.435029 Mar 05 20:50:47.000057 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 421/794] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:46 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:47.579516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2469409e-d60a-487f-b7e1-5afdcaa1cf23 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:47.580388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2469409e-d60a-487f-b7e1-5afdcaa1cf23 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:47.594776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2469409e-d60a-487f-b7e1-5afdcaa1cf23 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:47.595548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2469409e-d60a-487f-b7e1-5afdcaa1cf23 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:47.596730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2469409e-d60a-487f-b7e1-5afdcaa1cf23 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:47.597641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2469409e-d60a-487f-b7e1-5afdcaa1cf23 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:47.897827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2469409e-d60a-487f-b7e1-5afdcaa1cf23 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:47.911837 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2469409e-d60a-487f-b7e1-5afdcaa1cf23 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1467 microversion: 2.1 time: 0.332664 Mar 05 20:50:47.913419 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 374/795] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:47 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1467 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:47.931775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ee549fd0-36ba-4b11-8915-1ae5e9380cc6 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:47.932923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ee549fd0-36ba-4b11-8915-1ae5e9380cc6 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:47.940346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee549fd0-36ba-4b11-8915-1ae5e9380cc6 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:47.941131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee549fd0-36ba-4b11-8915-1ae5e9380cc6 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:47.942170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee549fd0-36ba-4b11-8915-1ae5e9380cc6 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:47.943478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee549fd0-36ba-4b11-8915-1ae5e9380cc6 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:48.107082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-903270913", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:48.227835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:50:48.244034 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ee549fd0-36ba-4b11-8915-1ae5e9380cc6 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1618 microversion: 2.1 time: 0.306586 Mar 05 20:50:48.246658 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 375/796] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:47 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1618 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:48.253310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d3ab2e6c-089b-4236-b864-8e4a60ff2dc0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:48.256974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d3ab2e6c-089b-4236-b864-8e4a60ff2dc0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:48.270198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d3ab2e6c-089b-4236-b864-8e4a60ff2dc0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:48.270849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d3ab2e6c-089b-4236-b864-8e4a60ff2dc0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:48.271751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d3ab2e6c-089b-4236-b864-8e4a60ff2dc0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:48.272256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d3ab2e6c-089b-4236-b864-8e4a60ff2dc0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:48.464652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d3ab2e6c-089b-4236-b864-8e4a60ff2dc0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:48.474951 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d3ab2e6c-089b-4236-b864-8e4a60ff2dc0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1265 microversion: 2.1 time: 0.226814 Mar 05 20:50:48.475705 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 376/797] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:48 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:48.505621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-52e1202b-327e-462b-a52f-3b6deae4a2ff tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:48.506237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-52e1202b-327e-462b-a52f-3b6deae4a2ff tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:48.527930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52e1202b-327e-462b-a52f-3b6deae4a2ff tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:48.528383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52e1202b-327e-462b-a52f-3b6deae4a2ff tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:48.529175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52e1202b-327e-462b-a52f-3b6deae4a2ff tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:48.529612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52e1202b-327e-462b-a52f-3b6deae4a2ff tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:48.772047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:50:48.772722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:50:48.773376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:50:48.773937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:50:48.774506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:50:48.787748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:48.788406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:48.792673 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:48.793304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:48.849934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Getting quotas for project ffa214a1fdce408095cfce5d20496af7. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:50:48.860887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Getting quotas for user 275c5f63f0e84b32bf036e57586bf59c and project ffa214a1fdce408095cfce5d20496af7. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:50:48.908880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:50:48.918541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:50:49.021545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-52e1202b-327e-462b-a52f-3b6deae4a2ff tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:49.050763 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-52e1202b-327e-462b-a52f-3b6deae4a2ff tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.540543 Mar 05 20:50:49.052045 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 377/798] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:48 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:49.064830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1081585425", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["7f00577b-ab4a-4e3c-b42d-53f30d4a34bd"]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:49.066687 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b83cedaa-63a5-4708-a18d-2b62cbdfa3fb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.367145 Mar 05 20:50:49.070598 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 422/799] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:50:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 20:50:49.103275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0cd4efd-7284-4365-918b-116a9d04cc76 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:49.106197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a0cd4efd-7284-4365-918b-116a9d04cc76 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:49.189117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:50:49.254609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a0cd4efd-7284-4365-918b-116a9d04cc76 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:49.273153 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0cd4efd-7284-4365-918b-116a9d04cc76 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1216 microversion: 2.1 time: 0.196951 Mar 05 20:50:49.274373 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 423/800] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:49 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1216 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:49.495338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1f7cc9ac-7751-4e3f-951f-396da7671a40 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:49.496216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1f7cc9ac-7751-4e3f-951f-396da7671a40 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:49.523584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f7cc9ac-7751-4e3f-951f-396da7671a40 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:49.526141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f7cc9ac-7751-4e3f-951f-396da7671a40 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:49.527527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f7cc9ac-7751-4e3f-951f-396da7671a40 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:49.529854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f7cc9ac-7751-4e3f-951f-396da7671a40 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:49.865606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1f7cc9ac-7751-4e3f-951f-396da7671a40 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:49.876295 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1f7cc9ac-7751-4e3f-951f-396da7671a40 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1271 microversion: 2.1 time: 0.385627 Mar 05 20:50:49.878109 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 424/801] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:49 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1271 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:50.068095 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ebdee746-90b5-4587-bb42-34e96c5a3b98 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:50.068991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ebdee746-90b5-4587-bb42-34e96c5a3b98 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:50.079774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ebdee746-90b5-4587-bb42-34e96c5a3b98 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:50.080536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ebdee746-90b5-4587-bb42-34e96c5a3b98 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:50.081609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ebdee746-90b5-4587-bb42-34e96c5a3b98 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:50.085036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ebdee746-90b5-4587-bb42-34e96c5a3b98 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:50.165855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:50:50.167013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:50:50.167877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:50:50.168445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:50:50.169189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:50:50.195943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:50.196403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:50.200199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:50.200653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:50.247387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:50:50.257784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:50:50.290663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:50:50.299476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:50:50.472120 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-60da8966-b169-4851-be50-7482719aeaee tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.415750 Mar 05 20:50:50.472818 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 378/802] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:50:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:50:50.499136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-98ef7e9a-a3dc-4ac9-acf0-f91104430216 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:50.500038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-98ef7e9a-a3dc-4ac9-acf0-f91104430216 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:50.513960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98ef7e9a-a3dc-4ac9-acf0-f91104430216 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:50.515718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98ef7e9a-a3dc-4ac9-acf0-f91104430216 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:50.516730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98ef7e9a-a3dc-4ac9-acf0-f91104430216 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:50.520452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98ef7e9a-a3dc-4ac9-acf0-f91104430216 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:50.734751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-98ef7e9a-a3dc-4ac9-acf0-f91104430216 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:50.747452 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-98ef7e9a-a3dc-4ac9-acf0-f91104430216 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1268 microversion: 2.1 time: 0.273522 Mar 05 20:50:50.768791 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 379/803] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:50 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1268 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:50.784367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-99f6a625-e2a5-4d10-80ac-a34af5a3b204 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:50.784922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-99f6a625-e2a5-4d10-80ac-a34af5a3b204 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:50.973015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ebdee746-90b5-4587-bb42-34e96c5a3b98 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:50.984742 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ebdee746-90b5-4587-bb42-34e96c5a3b98 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.916949 Mar 05 20:50:50.988876 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 425/804] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:50 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:50.999883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-99f6a625-e2a5-4d10-80ac-a34af5a3b204 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:51.013075 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-99f6a625-e2a5-4d10-80ac-a34af5a3b204 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1217 microversion: 2.1 time: 0.245601 Mar 05 20:50:51.021660 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 380/805] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:50 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1217 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:51.039869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d51f9bff-9ada-4a32-883e-ebd8d171710e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:51.040818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d51f9bff-9ada-4a32-883e-ebd8d171710e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:51.052318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d51f9bff-9ada-4a32-883e-ebd8d171710e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:51.055395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d51f9bff-9ada-4a32-883e-ebd8d171710e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:51.056442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d51f9bff-9ada-4a32-883e-ebd8d171710e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:51.058245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d51f9bff-9ada-4a32-883e-ebd8d171710e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:51.372130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b2d6b876-5444-4738-8bcb-148ece5f7963 tempest-QuotaClassesAdmin257Test-302913453 tempest-QuotaClassesAdmin257Test-302913453-project-admin] Calling method '.version_select at 0x7fed5c77c790>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:51.373015 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:50:51.373015 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:50:51.403502 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b2d6b876-5444-4738-8bcb-148ece5f7963 tempest-QuotaClassesAdmin257Test-302913453 tempest-QuotaClassesAdmin257Test-302913453-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.413079 Mar 05 20:50:51.404192 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 426/806] 10.222.0.15 () {60 vars in 1225 bytes} [Sat Mar 5 20:50:50 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:50:51.419985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-61c54198-57ec-4726-b875-df282fb6fea9 tempest-QuotaClassesAdmin257Test-302913453 tempest-QuotaClassesAdmin257Test-302913453-project-admin] Action: 'update', calling method: .version_select at 0x7fed5c72a9d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:51.428529 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:50:51.428529 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:50:51.564994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d51f9bff-9ada-4a32-883e-ebd8d171710e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:51.611568 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d51f9bff-9ada-4a32-883e-ebd8d171710e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1313 microversion: 2.1 time: 0.576512 Mar 05 20:50:51.614351 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 381/807] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:51 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:51.783312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-876a90e7-1746-48b8-815e-55a32f5b78b7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:51.783950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-876a90e7-1746-48b8-815e-55a32f5b78b7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:51.794188 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-876a90e7-1746-48b8-815e-55a32f5b78b7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:51.795044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-876a90e7-1746-48b8-815e-55a32f5b78b7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:51.801904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-876a90e7-1746-48b8-815e-55a32f5b78b7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:51.802634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-876a90e7-1746-48b8-815e-55a32f5b78b7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:51.896150 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-61c54198-57ec-4726-b875-df282fb6fea9 tempest-QuotaClassesAdmin257Test-302913453 tempest-QuotaClassesAdmin257Test-302913453-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.479350 Mar 05 20:50:51.899213 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 427/808] 10.222.0.15 () {62 vars in 1246 bytes} [Sat Mar 5 20:50:51 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:50:51.914087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-22400c3d-129d-4460-86a5-79739ea31b45 tempest-QuotaClassesAdmin257Test-302913453 tempest-QuotaClassesAdmin257Test-302913453-project-admin] Calling method '.version_select at 0x7fed5c72a430>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:51.927607 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-22400c3d-129d-4460-86a5-79739ea31b45 tempest-QuotaClassesAdmin257Test-302913453 tempest-QuotaClassesAdmin257Test-302913453-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.022278 Mar 05 20:50:51.928850 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 428/809] 10.222.0.15 () {60 vars in 1225 bytes} [Sat Mar 5 20:50:51 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:50:51.944542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e2a0936a-8b84-4273-910d-719449a40d16 tempest-QuotaClassesAdmin257Test-302913453 tempest-QuotaClassesAdmin257Test-302913453-project-admin] Action: 'update', calling method: .version_select at 0x7fed5c729430>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:51.971322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-876a90e7-1746-48b8-815e-55a32f5b78b7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:51.984293 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-876a90e7-1746-48b8-815e-55a32f5b78b7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1274 microversion: 2.1 time: 0.203310 Mar 05 20:50:51.986712 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 382/810] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:51 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1274 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:52.010298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5d155b67-3e1d-40bc-98f5-8df27915c8c9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:52.013145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5d155b67-3e1d-40bc-98f5-8df27915c8c9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:52.029173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d155b67-3e1d-40bc-98f5-8df27915c8c9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:52.030395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d155b67-3e1d-40bc-98f5-8df27915c8c9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:52.031717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d155b67-3e1d-40bc-98f5-8df27915c8c9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:52.032421 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d155b67-3e1d-40bc-98f5-8df27915c8c9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:52.076803 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e2a0936a-8b84-4273-910d-719449a40d16 tempest-QuotaClassesAdmin257Test-302913453 tempest-QuotaClassesAdmin257Test-302913453-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.139123 Mar 05 20:50:52.079776 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 429/811] 10.222.0.15 () {62 vars in 1246 bytes} [Sat Mar 5 20:50:51 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 20:50:52.087544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ab2555c9-9113-49bc-9f2a-15c1fe8504b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:52.088409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ab2555c9-9113-49bc-9f2a-15c1fe8504b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:52.097291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab2555c9-9113-49bc-9f2a-15c1fe8504b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:52.097985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab2555c9-9113-49bc-9f2a-15c1fe8504b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:52.099207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab2555c9-9113-49bc-9f2a-15c1fe8504b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:52.100415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab2555c9-9113-49bc-9f2a-15c1fe8504b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:52.506582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5d155b67-3e1d-40bc-98f5-8df27915c8c9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:52.516102 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5d155b67-3e1d-40bc-98f5-8df27915c8c9 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.512960 Mar 05 20:50:52.527220 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 383/812] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:52 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:52.633293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-43dd220a-2199-4986-ab7b-2ce74083a72a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:52.633969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-43dd220a-2199-4986-ab7b-2ce74083a72a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:52.648786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43dd220a-2199-4986-ab7b-2ce74083a72a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:52.649250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43dd220a-2199-4986-ab7b-2ce74083a72a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:52.650052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43dd220a-2199-4986-ab7b-2ce74083a72a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:52.650497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43dd220a-2199-4986-ab7b-2ce74083a72a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:52.741115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ab2555c9-9113-49bc-9f2a-15c1fe8504b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:52.756654 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ab2555c9-9113-49bc-9f2a-15c1fe8504b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1269 microversion: 2.1 time: 0.673196 Mar 05 20:50:52.756654 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 430/813] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:52 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1269 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:53.007521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2b2cf036-c5fb-48d7-b0de-eea409d5e3e7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:53.008495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2b2cf036-c5fb-48d7-b0de-eea409d5e3e7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:53.024466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b2cf036-c5fb-48d7-b0de-eea409d5e3e7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:53.028406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b2cf036-c5fb-48d7-b0de-eea409d5e3e7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:53.032520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b2cf036-c5fb-48d7-b0de-eea409d5e3e7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:53.032979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b2cf036-c5fb-48d7-b0de-eea409d5e3e7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:53.368493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2b2cf036-c5fb-48d7-b0de-eea409d5e3e7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:53.378532 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2b2cf036-c5fb-48d7-b0de-eea409d5e3e7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1274 microversion: 2.1 time: 0.380038 Mar 05 20:50:53.386492 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 431/814] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:52 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1274 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:53.399055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-43d3bd59-b842-4950-b3d1-b29ff4725290 req-c79b306b-5c84-4a56-9c3a-b3148884c39d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b0401ca-066c-40a5-b076-b4fd5b6ab3d2", "tag": "5c0add0b-e16b-4f33-bad0-f6bb5dbab8ca"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:53.418343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-43d3bd59-b842-4950-b3d1-b29ff4725290 req-c79b306b-5c84-4a56-9c3a-b3148884c39d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:53.423223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-43d3bd59-b842-4950-b3d1-b29ff4725290 req-c79b306b-5c84-4a56-9c3a-b3148884c39d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:53.449280 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-43d3bd59-b842-4950-b3d1-b29ff4725290 req-c79b306b-5c84-4a56-9c3a-b3148884c39d service nova] Creating event network-changed:5c0add0b-e16b-4f33-bad0-f6bb5dbab8ca for instance 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 on nch2-master-1 Mar 05 20:50:53.467061 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-43d3bd59-b842-4950-b3d1-b29ff4725290 req-c79b306b-5c84-4a56-9c3a-b3148884c39d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077498 Mar 05 20:50:53.471587 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 432/815] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:53.549477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dd412979-fe84-4dbd-bd04-e2b9390838ef tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:53.550204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dd412979-fe84-4dbd-bd04-e2b9390838ef tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:53.569465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd412979-fe84-4dbd-bd04-e2b9390838ef tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:53.569667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd412979-fe84-4dbd-bd04-e2b9390838ef tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:53.570328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd412979-fe84-4dbd-bd04-e2b9390838ef tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:53.570780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd412979-fe84-4dbd-bd04-e2b9390838ef tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:53.592252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-43dd220a-2199-4986-ab7b-2ce74083a72a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:53.602397 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-43dd220a-2199-4986-ab7b-2ce74083a72a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1313 microversion: 2.1 time: 0.974525 Mar 05 20:50:53.603553 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 384/816] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:52 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1313 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:53.773366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-103a6e4d-6ec1-401a-858a-29632dd889b3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:53.774718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-103a6e4d-6ec1-401a-858a-29632dd889b3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:53.781385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-103a6e4d-6ec1-401a-858a-29632dd889b3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:53.782147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-103a6e4d-6ec1-401a-858a-29632dd889b3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:53.783156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-103a6e4d-6ec1-401a-858a-29632dd889b3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:53.783824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-103a6e4d-6ec1-401a-858a-29632dd889b3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:53.943662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-103a6e4d-6ec1-401a-858a-29632dd889b3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:53.961019 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-103a6e4d-6ec1-401a-858a-29632dd889b3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1275 microversion: 2.1 time: 0.191384 Mar 05 20:50:53.973907 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 385/817] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:53 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1275 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:54.191089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dd412979-fe84-4dbd-bd04-e2b9390838ef tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:54.203466 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dd412979-fe84-4dbd-bd04-e2b9390838ef tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.659917 Mar 05 20:50:54.206215 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 433/818] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:53 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:54.404707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-be66d543-1565-4112-a396-826ecc2c90fc tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:54.405998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-be66d543-1565-4112-a396-826ecc2c90fc tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:54.422069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be66d543-1565-4112-a396-826ecc2c90fc tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:54.425285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be66d543-1565-4112-a396-826ecc2c90fc tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:54.426640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be66d543-1565-4112-a396-826ecc2c90fc tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:54.427903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be66d543-1565-4112-a396-826ecc2c90fc tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:54.622831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-10fc738e-654b-414e-b62f-f2d0cb20b8ae tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:54.625126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-10fc738e-654b-414e-b62f-f2d0cb20b8ae tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:54.644315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-10fc738e-654b-414e-b62f-f2d0cb20b8ae tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:54.645823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-10fc738e-654b-414e-b62f-f2d0cb20b8ae tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:54.649608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-10fc738e-654b-414e-b62f-f2d0cb20b8ae tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:54.651889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-10fc738e-654b-414e-b62f-f2d0cb20b8ae tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:55.452512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-be66d543-1565-4112-a396-826ecc2c90fc tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:55.467644 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-be66d543-1565-4112-a396-826ecc2c90fc tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1316 microversion: 2.1 time: 1.067662 Mar 05 20:50:55.482175 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 386/819] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:54 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1316 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:55.511107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e84fcd64-1b70-425b-b184-f81ef22bc853 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:55.511966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e84fcd64-1b70-425b-b184-f81ef22bc853 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:55.531951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e84fcd64-1b70-425b-b184-f81ef22bc853 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:55.532579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e84fcd64-1b70-425b-b184-f81ef22bc853 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:55.533590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e84fcd64-1b70-425b-b184-f81ef22bc853 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:55.534033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e84fcd64-1b70-425b-b184-f81ef22bc853 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:56.121776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-10fc738e-654b-414e-b62f-f2d0cb20b8ae tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:56.134575 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-10fc738e-654b-414e-b62f-f2d0cb20b8ae tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1313 microversion: 2.1 time: 1.517371 Mar 05 20:50:56.135525 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 434/820] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:54 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1313 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:56.157034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4c007927-a57a-401d-90c9-4e831562e07a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:56.158647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4c007927-a57a-401d-90c9-4e831562e07a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:56.178987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c007927-a57a-401d-90c9-4e831562e07a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:56.179726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c007927-a57a-401d-90c9-4e831562e07a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:56.180690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c007927-a57a-401d-90c9-4e831562e07a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:56.181286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c007927-a57a-401d-90c9-4e831562e07a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:56.219543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e84fcd64-1b70-425b-b184-f81ef22bc853 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:56.240878 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e84fcd64-1b70-425b-b184-f81ef22bc853 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1317 microversion: 2.1 time: 0.751291 Mar 05 20:50:56.244653 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 387/821] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:55 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1317 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:56.487226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7a690e61-e2b0-437c-9da3-80310f39bfd7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:56.487940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7a690e61-e2b0-437c-9da3-80310f39bfd7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:56.502027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a690e61-e2b0-437c-9da3-80310f39bfd7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:56.502604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a690e61-e2b0-437c-9da3-80310f39bfd7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:56.503594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a690e61-e2b0-437c-9da3-80310f39bfd7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:56.504157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a690e61-e2b0-437c-9da3-80310f39bfd7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:56.913202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4c007927-a57a-401d-90c9-4e831562e07a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:56.921608 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4c007927-a57a-401d-90c9-4e831562e07a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.784206 Mar 05 20:50:56.924223 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 435/822] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:56 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:57.047132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-98ac5ee7-6fe1-493f-895a-46e147c5a96a req-9012c653-41d6-4f1e-ada9-58d7bb12c6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54f039d-1623-4ad6-a4e3-308472493214", "tag": "6c25b98e-729b-490d-bb31-a40e13f1d945"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:57.062272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-98ac5ee7-6fe1-493f-895a-46e147c5a96a req-9012c653-41d6-4f1e-ada9-58d7bb12c6e4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:57.072008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-98ac5ee7-6fe1-493f-895a-46e147c5a96a req-9012c653-41d6-4f1e-ada9-58d7bb12c6e4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:57.102944 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-98ac5ee7-6fe1-493f-895a-46e147c5a96a req-9012c653-41d6-4f1e-ada9-58d7bb12c6e4 service nova] Creating event network-changed:6c25b98e-729b-490d-bb31-a40e13f1d945 for instance d54f039d-1623-4ad6-a4e3-308472493214 on nch2-master-1 Mar 05 20:50:57.111965 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-98ac5ee7-6fe1-493f-895a-46e147c5a96a req-9012c653-41d6-4f1e-ada9-58d7bb12c6e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068974 Mar 05 20:50:57.113289 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 436/823] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:57.162031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-867f44a2-1cd3-4c3d-8042-706a7907f107 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:57.167061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-867f44a2-1cd3-4c3d-8042-706a7907f107 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:57.196222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-867f44a2-1cd3-4c3d-8042-706a7907f107 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:57.202961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-867f44a2-1cd3-4c3d-8042-706a7907f107 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:57.212068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7a690e61-e2b0-437c-9da3-80310f39bfd7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:57.225087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-867f44a2-1cd3-4c3d-8042-706a7907f107 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:57.226928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-867f44a2-1cd3-4c3d-8042-706a7907f107 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:57.231197 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7a690e61-e2b0-437c-9da3-80310f39bfd7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1316 microversion: 2.1 time: 0.749035 Mar 05 20:50:57.245120 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 388/824] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:56 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1316 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:50:57.264029 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b2fac1c3-337a-4862-958d-c0a3115b5428 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:57.265433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b2fac1c3-337a-4862-958d-c0a3115b5428 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:57.290513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2fac1c3-337a-4862-958d-c0a3115b5428 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:57.293351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2fac1c3-337a-4862-958d-c0a3115b5428 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:57.300743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2fac1c3-337a-4862-958d-c0a3115b5428 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:57.301442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2fac1c3-337a-4862-958d-c0a3115b5428 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:57.662248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b2fac1c3-337a-4862-958d-c0a3115b5428 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:57.677221 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b2fac1c3-337a-4862-958d-c0a3115b5428 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1317 microversion: 2.1 time: 0.421268 Mar 05 20:50:57.681034 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 389/825] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:57 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:57.693908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a104a5df-5111-4571-b589-93df66477344 req-edbcbc25-b608-4e9f-a9c4-8b8afafaeada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37d5b76d-41e6-4a10-8687-34fd9582a03e", "tag": "4a95c28f-b4a8-4cd9-9a86-d99e68a231b9"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:57.718184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a104a5df-5111-4571-b589-93df66477344 req-edbcbc25-b608-4e9f-a9c4-8b8afafaeada service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:57.718777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a104a5df-5111-4571-b589-93df66477344 req-edbcbc25-b608-4e9f-a9c4-8b8afafaeada service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:57.744396 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a104a5df-5111-4571-b589-93df66477344 req-edbcbc25-b608-4e9f-a9c4-8b8afafaeada service nova] Creating event network-changed:4a95c28f-b4a8-4cd9-9a86-d99e68a231b9 for instance 37d5b76d-41e6-4a10-8687-34fd9582a03e on nch1-master-1 Mar 05 20:50:57.753574 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a104a5df-5111-4571-b589-93df66477344 req-edbcbc25-b608-4e9f-a9c4-8b8afafaeada service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070841 Mar 05 20:50:57.754893 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 390/826] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:57.778892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-867f44a2-1cd3-4c3d-8042-706a7907f107 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:57.792735 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-867f44a2-1cd3-4c3d-8042-706a7907f107 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1313 microversion: 2.1 time: 0.643224 Mar 05 20:50:57.797049 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 437/827] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:57 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:57.941989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b8079e49-42f2-427a-8f96-53f034b6c1f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:57.942813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b8079e49-42f2-427a-8f96-53f034b6c1f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:57.955364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8079e49-42f2-427a-8f96-53f034b6c1f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:57.958058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8079e49-42f2-427a-8f96-53f034b6c1f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:57.959131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8079e49-42f2-427a-8f96-53f034b6c1f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:57.959889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8079e49-42f2-427a-8f96-53f034b6c1f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:58.252374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f7f69f29-40db-4de1-aa95-d4e7693b7b5c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:58.252992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f7f69f29-40db-4de1-aa95-d4e7693b7b5c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:58.259643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7f69f29-40db-4de1-aa95-d4e7693b7b5c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:58.269044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7f69f29-40db-4de1-aa95-d4e7693b7b5c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:58.270067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7f69f29-40db-4de1-aa95-d4e7693b7b5c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:58.270661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7f69f29-40db-4de1-aa95-d4e7693b7b5c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:58.447475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b8079e49-42f2-427a-8f96-53f034b6c1f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:58.473431 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b8079e49-42f2-427a-8f96-53f034b6c1f6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.535961 Mar 05 20:50:58.485433 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 391/828] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:57 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:58.710571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eef4942c-12ba-4961-a5bd-12dc94b870d3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:58.710571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eef4942c-12ba-4961-a5bd-12dc94b870d3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:58.753952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eef4942c-12ba-4961-a5bd-12dc94b870d3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:58.758496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eef4942c-12ba-4961-a5bd-12dc94b870d3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:58.759348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eef4942c-12ba-4961-a5bd-12dc94b870d3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:58.772064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eef4942c-12ba-4961-a5bd-12dc94b870d3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:59.210956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eef4942c-12ba-4961-a5bd-12dc94b870d3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:59.229099 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eef4942c-12ba-4961-a5bd-12dc94b870d3 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1317 microversion: 2.1 time: 0.535107 Mar 05 20:50:59.231446 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 392/829] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:58 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:59.253282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-03c9c735-6151-47bc-9a70-e2176e9a65ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:59.269277 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-03c9c735-6151-47bc-9a70-e2176e9a65ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:59.293837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-03c9c735-6151-47bc-9a70-e2176e9a65ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:59.294567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-03c9c735-6151-47bc-9a70-e2176e9a65ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:59.295882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-03c9c735-6151-47bc-9a70-e2176e9a65ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:59.309487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-03c9c735-6151-47bc-9a70-e2176e9a65ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:59.502746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f7f69f29-40db-4de1-aa95-d4e7693b7b5c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:59.510536 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f7f69f29-40db-4de1-aa95-d4e7693b7b5c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1316 microversion: 2.1 time: 1.264984 Mar 05 20:50:59.521864 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 438/830] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:58 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1316 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:59.726432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2cc7f4e3-d886-4d41-a6d8-2b234819b899 tempest-QuotaClassesAdminTestJSON-603571884 tempest-QuotaClassesAdminTestJSON-603571884-project-admin] Calling method '.version_select at 0x7fed5c7294c0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:59.727344 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:50:59.727344 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:50:59.745783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-03c9c735-6151-47bc-9a70-e2176e9a65ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:50:59.755152 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2cc7f4e3-d886-4d41-a6d8-2b234819b899 tempest-QuotaClassesAdminTestJSON-603571884 tempest-QuotaClassesAdminTestJSON-603571884-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.231872 Mar 05 20:50:59.757709 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-03c9c735-6151-47bc-9a70-e2176e9a65ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1313 microversion: 2.1 time: 0.520254 Mar 05 20:50:59.763279 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 439/831] 10.222.0.15 () {58 vars in 1184 bytes} [Sat Mar 5 20:50:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:50:59.772543 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 393/832] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:59 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:50:59.775264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e910f2cc-c9bd-41ad-b6a0-9ec1971c0802 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:50:59.776375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e910f2cc-c9bd-41ad-b6a0-9ec1971c0802 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:50:59.784286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e910f2cc-c9bd-41ad-b6a0-9ec1971c0802 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:59.784990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e910f2cc-c9bd-41ad-b6a0-9ec1971c0802 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:59.785955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e910f2cc-c9bd-41ad-b6a0-9ec1971c0802 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:50:59.786081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3ac5e7cc-4cd6-40d7-b782-6703a9721df2 tempest-QuotaClassesAdminTestJSON-603571884 tempest-QuotaClassesAdminTestJSON-603571884-project-admin] Action: 'update', calling method: .version_select at 0x7fed5ccf1f70>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:50:59.786685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e910f2cc-c9bd-41ad-b6a0-9ec1971c0802 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:50:59.789066 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:50:59.789066 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:51:00.218957 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3ac5e7cc-4cd6-40d7-b782-6703a9721df2 tempest-QuotaClassesAdminTestJSON-603571884 tempest-QuotaClassesAdminTestJSON-603571884-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.445183 Mar 05 20:51:00.223279 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 394/833] 10.222.0.15 () {60 vars in 1205 bytes} [Sat Mar 5 20:50:59 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:00.232340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5b622e4e-7459-49cc-8b7e-da99a93e405f tempest-QuotaClassesAdminTestJSON-603571884 tempest-QuotaClassesAdminTestJSON-603571884-project-admin] Calling method '.version_select at 0x7fed5ce27dc0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:00.233245 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:51:00.233245 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:51:00.247757 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5b622e4e-7459-49cc-8b7e-da99a93e405f tempest-QuotaClassesAdminTestJSON-603571884 tempest-QuotaClassesAdminTestJSON-603571884-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.022001 Mar 05 20:51:00.254609 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 395/834] 10.222.0.15 () {58 vars in 1184 bytes} [Sat Mar 5 20:51:00 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:51:00.256169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-15d57f4a-0595-4252-b191-f29980cf6b12 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:00.256798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-15d57f4a-0595-4252-b191-f29980cf6b12 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:00.263388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15d57f4a-0595-4252-b191-f29980cf6b12 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:00.263647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15d57f4a-0595-4252-b191-f29980cf6b12 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:00.265322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15d57f4a-0595-4252-b191-f29980cf6b12 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:00.265814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15d57f4a-0595-4252-b191-f29980cf6b12 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:00.453675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e910f2cc-c9bd-41ad-b6a0-9ec1971c0802 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:00.471699 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e910f2cc-c9bd-41ad-b6a0-9ec1971c0802 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.706369 Mar 05 20:51:00.474020 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 440/835] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:50:59 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:00.485263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-15d57f4a-0595-4252-b191-f29980cf6b12 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:00.494461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-48ada25b-5df8-4c27-b754-f3f1a1c743db tempest-QuotaClassesAdminTestJSON-603571884 tempest-QuotaClassesAdminTestJSON-603571884-project-admin] Action: 'update', calling method: .version_select at 0x7fed5c9e1f70>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:00.496284 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:51:00.496284 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:51:00.500254 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-15d57f4a-0595-4252-b191-f29980cf6b12 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1317 microversion: 2.1 time: 0.249342 Mar 05 20:51:00.500880 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 396/836] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:00 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:00.531488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c399cef-790b-4a58-95a3-d30833f5832a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:00.532160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4c399cef-790b-4a58-95a3-d30833f5832a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:00.551481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c399cef-790b-4a58-95a3-d30833f5832a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:00.552414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c399cef-790b-4a58-95a3-d30833f5832a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:00.552533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c399cef-790b-4a58-95a3-d30833f5832a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:00.553118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c399cef-790b-4a58-95a3-d30833f5832a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:00.683602 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-48ada25b-5df8-4c27-b754-f3f1a1c743db tempest-QuotaClassesAdminTestJSON-603571884 tempest-QuotaClassesAdminTestJSON-603571884-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.207084 Mar 05 20:51:00.685382 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 441/837] 10.222.0.15 () {60 vars in 1205 bytes} [Sat Mar 5 20:51:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:00.783936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-93160957-9481-4151-a200-cc7912dbc33f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:00.784829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-93160957-9481-4151-a200-cc7912dbc33f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:00.812962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93160957-9481-4151-a200-cc7912dbc33f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:00.817335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93160957-9481-4151-a200-cc7912dbc33f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:00.820481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93160957-9481-4151-a200-cc7912dbc33f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:00.821206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93160957-9481-4151-a200-cc7912dbc33f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:00.903094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4c399cef-790b-4a58-95a3-d30833f5832a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:00.923199 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4c399cef-790b-4a58-95a3-d30833f5832a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1316 microversion: 2.1 time: 0.397930 Mar 05 20:51:00.924139 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 397/838] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:00 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:01.292165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-93160957-9481-4151-a200-cc7912dbc33f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:01.305749 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-93160957-9481-4151-a200-cc7912dbc33f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1313 microversion: 2.1 time: 0.532091 Mar 05 20:51:01.307841 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 442/839] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:00 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:01.490479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f3e150cd-7f40-4128-909b-fcbaf1e12138 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:01.496605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f3e150cd-7f40-4128-909b-fcbaf1e12138 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:01.520670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-17c07323-95e6-461a-8dae-8afd7599ebab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:01.521530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-17c07323-95e6-461a-8dae-8afd7599ebab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:01.536793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3e150cd-7f40-4128-909b-fcbaf1e12138 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:01.538812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17c07323-95e6-461a-8dae-8afd7599ebab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:01.539568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3e150cd-7f40-4128-909b-fcbaf1e12138 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:01.541679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3e150cd-7f40-4128-909b-fcbaf1e12138 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:01.543123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17c07323-95e6-461a-8dae-8afd7599ebab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:01.554478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3e150cd-7f40-4128-909b-fcbaf1e12138 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:01.556822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17c07323-95e6-461a-8dae-8afd7599ebab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:01.568222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17c07323-95e6-461a-8dae-8afd7599ebab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:01.816134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f3e150cd-7f40-4128-909b-fcbaf1e12138 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:01.826868 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f3e150cd-7f40-4128-909b-fcbaf1e12138 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.340168 Mar 05 20:51:01.827976 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 398/840] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:01 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:01.940804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74bf0d48-8f74-4226-a891-d2437fd40eed tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:01.942560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-74bf0d48-8f74-4226-a891-d2437fd40eed tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:01.953197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74bf0d48-8f74-4226-a891-d2437fd40eed tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:01.954729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74bf0d48-8f74-4226-a891-d2437fd40eed tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:01.956331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74bf0d48-8f74-4226-a891-d2437fd40eed tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:01.959150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74bf0d48-8f74-4226-a891-d2437fd40eed tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:02.074002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-17c07323-95e6-461a-8dae-8afd7599ebab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:02.084004 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-17c07323-95e6-461a-8dae-8afd7599ebab tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1317 microversion: 2.1 time: 0.570997 Mar 05 20:51:02.084597 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 443/841] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:01 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1317 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:02.260358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-74bf0d48-8f74-4226-a891-d2437fd40eed tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:02.274515 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-74bf0d48-8f74-4226-a891-d2437fd40eed tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1316 microversion: 2.1 time: 0.334419 Mar 05 20:51:02.275882 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 399/842] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:01 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:02.286466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7b53d0cd-333e-4fe7-bb31-cc3393090301 req-cb4a6f95-bbf3-4cb7-a16d-2e082b25cfa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b0401ca-066c-40a5-b076-b4fd5b6ab3d2", "name": "network-vif-plugged", "status": "completed", "tag": "5c0add0b-e16b-4f33-bad0-f6bb5dbab8ca"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:02.301387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7b53d0cd-333e-4fe7-bb31-cc3393090301 req-cb4a6f95-bbf3-4cb7-a16d-2e082b25cfa7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:02.302096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7b53d0cd-333e-4fe7-bb31-cc3393090301 req-cb4a6f95-bbf3-4cb7-a16d-2e082b25cfa7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:02.316975 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7b53d0cd-333e-4fe7-bb31-cc3393090301 req-cb4a6f95-bbf3-4cb7-a16d-2e082b25cfa7 service nova] Creating event network-vif-plugged:5c0add0b-e16b-4f33-bad0-f6bb5dbab8ca for instance 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 on nch2-master-1 Mar 05 20:51:02.322820 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7b53d0cd-333e-4fe7-bb31-cc3393090301 req-cb4a6f95-bbf3-4cb7-a16d-2e082b25cfa7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045519 Mar 05 20:51:02.323709 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 400/843] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:02.330768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-38b4c6d9-a377-47d4-a4b2-8ec01f6f9adc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:02.331736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-38b4c6d9-a377-47d4-a4b2-8ec01f6f9adc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:02.339780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38b4c6d9-a377-47d4-a4b2-8ec01f6f9adc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:02.340791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38b4c6d9-a377-47d4-a4b2-8ec01f6f9adc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:02.342603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38b4c6d9-a377-47d4-a4b2-8ec01f6f9adc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:02.343646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38b4c6d9-a377-47d4-a4b2-8ec01f6f9adc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:02.400925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b88651ff-0738-4638-b7ee-39b21e0953ca tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Action: 'create', calling method: .version_select at 0x7fed5c729dc0>, body: {"keypair": {"name": "tempest-keypair-589748295"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:02.430456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b88651ff-0738-4638-b7ee-39b21e0953ca tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Getting quotas for project 0ff75cc228d249d1b12cd184ad1c4cde. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:02.449779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b88651ff-0738-4638-b7ee-39b21e0953ca tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Getting quotas for user e33c3ba3d26c4664a622711cad0381a9 and project 0ff75cc228d249d1b12cd184ad1c4cde. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:02.551110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-38b4c6d9-a377-47d4-a4b2-8ec01f6f9adc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:02.571520 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-38b4c6d9-a377-47d4-a4b2-8ec01f6f9adc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1313 microversion: 2.1 time: 0.238996 Mar 05 20:51:02.573005 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 401/844] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:02 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:02.848065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4d5cfe6d-af20-47c1-8e1b-f67ca76290c6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:02.849037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4d5cfe6d-af20-47c1-8e1b-f67ca76290c6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:02.862156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d5cfe6d-af20-47c1-8e1b-f67ca76290c6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:02.863304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d5cfe6d-af20-47c1-8e1b-f67ca76290c6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:02.865118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d5cfe6d-af20-47c1-8e1b-f67ca76290c6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:02.865732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d5cfe6d-af20-47c1-8e1b-f67ca76290c6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:03.096951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4d5cfe6d-af20-47c1-8e1b-f67ca76290c6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:03.104065 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4d5cfe6d-af20-47c1-8e1b-f67ca76290c6 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.263705 Mar 05 20:51:03.104654 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 402/845] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:02 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:03.116358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-517cbd27-7151-45ae-a1ac-57b8ac96694e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:03.120058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-517cbd27-7151-45ae-a1ac-57b8ac96694e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:03.131663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-517cbd27-7151-45ae-a1ac-57b8ac96694e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:03.133749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-517cbd27-7151-45ae-a1ac-57b8ac96694e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:03.140971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-517cbd27-7151-45ae-a1ac-57b8ac96694e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:03.141662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-517cbd27-7151-45ae-a1ac-57b8ac96694e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:03.235768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b88651ff-0738-4638-b7ee-39b21e0953ca tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Getting quotas for project 0ff75cc228d249d1b12cd184ad1c4cde. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:03.242377 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b88651ff-0738-4638-b7ee-39b21e0953ca tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Getting quotas for user e33c3ba3d26c4664a622711cad0381a9 and project 0ff75cc228d249d1b12cd184ad1c4cde. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:03.276168 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b88651ff-0738-4638-b7ee-39b21e0953ca tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.185348 Mar 05 20:51:03.277726 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 444/846] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:51:02 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:03.327887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-517cbd27-7151-45ae-a1ac-57b8ac96694e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:03.340292 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-517cbd27-7151-45ae-a1ac-57b8ac96694e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1317 microversion: 2.1 time: 0.231099 Mar 05 20:51:03.343100 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 403/847] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:03 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:03.351968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a4e60972-9361-4e1f-bbb3-c082270142ac tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:03.355955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a4e60972-9361-4e1f-bbb3-c082270142ac tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:03.366609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a4e60972-9361-4e1f-bbb3-c082270142ac tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:03.367451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a4e60972-9361-4e1f-bbb3-c082270142ac tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:03.369306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a4e60972-9361-4e1f-bbb3-c082270142ac tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:03.369984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a4e60972-9361-4e1f-bbb3-c082270142ac tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:03.614661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1380023222", "imageRef": "b7df2a6d-c6a5-412c-9963-10283eda6c91", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c6093dad-5e11-4f5a-9e28-4941e94e098d"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:03.668675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a4e60972-9361-4e1f-bbb3-c082270142ac tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:03.692663 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a4e60972-9361-4e1f-bbb3-c082270142ac tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1316 microversion: 2.1 time: 0.335192 Mar 05 20:51:03.694101 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 404/848] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:03 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:03.695320 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] validate_networks() for [('c6093dad-5e11-4f5a-9e28-4941e94e098d', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:51:03.704816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a8671f6e-c727-4f91-bee8-ea6496af3201 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:03.707547 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a8671f6e-c727-4f91-bee8-ea6496af3201 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:03.721865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a8671f6e-c727-4f91-bee8-ea6496af3201 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:03.722416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a8671f6e-c727-4f91-bee8-ea6496af3201 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:03.723845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a8671f6e-c727-4f91-bee8-ea6496af3201 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:03.726269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a8671f6e-c727-4f91-bee8-ea6496af3201 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:04.249644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a8671f6e-c727-4f91-bee8-ea6496af3201 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:04.265355 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a8671f6e-c727-4f91-bee8-ea6496af3201 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1313 microversion: 2.1 time: 0.567401 Mar 05 20:51:04.267500 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 405/849] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:03 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1313 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:04.272727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-72346679-5c1f-4120-b80f-bd49319d665f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:04.273973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-72346679-5c1f-4120-b80f-bd49319d665f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:04.283404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72346679-5c1f-4120-b80f-bd49319d665f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:04.285539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72346679-5c1f-4120-b80f-bd49319d665f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:04.287343 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72346679-5c1f-4120-b80f-bd49319d665f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:04.288433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72346679-5c1f-4120-b80f-bd49319d665f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:04.473707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:51:04.474137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:51:04.474537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:51:04.474953 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:51:04.475567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:51:04.493582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:04.494571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:04.496176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:04.496882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:04.530435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Getting quotas for project bde93d10dbea40429b16ffe4a6efce79. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:04.543693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Getting quotas for user 7d38e7ad086f42abb908cdfd2e0ebd18 and project bde93d10dbea40429b16ffe4a6efce79. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:04.569833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:51:04.572449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b7df2a6d-c6a5-412c-9963-10283eda6c91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:51:04.603795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-72346679-5c1f-4120-b80f-bd49319d665f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:04.614184 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-72346679-5c1f-4120-b80f-bd49319d665f tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.343100 Mar 05 20:51:04.615996 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 406/850] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:04 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:04.628435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fc1b22ef-0789-454c-b5a7-7fe576202dcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:04.629131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fc1b22ef-0789-454c-b5a7-7fe576202dcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:04.639232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fc1b22ef-0789-454c-b5a7-7fe576202dcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:04.639898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fc1b22ef-0789-454c-b5a7-7fe576202dcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:04.640820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fc1b22ef-0789-454c-b5a7-7fe576202dcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:04.641108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fc1b22ef-0789-454c-b5a7-7fe576202dcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:04.649209 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-05f3f4ca-9108-4e7e-9b18-2f60ad8f57c0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.368692 Mar 05 20:51:04.650452 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 445/851] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:51:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:51:04.678828 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6060adab-478a-430a-b00f-f55ef43bf780 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:04.680116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6060adab-478a-430a-b00f-f55ef43bf780 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:04.773573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6060adab-478a-430a-b00f-f55ef43bf780 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:04.785468 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6060adab-478a-430a-b00f-f55ef43bf780 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1222 microversion: 2.1 time: 0.125880 Mar 05 20:51:04.786462 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 446/852] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:04 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:04.802669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67bef966-0d89-4ffb-ade8-fba17fa725b2 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:04.804080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-67bef966-0d89-4ffb-ade8-fba17fa725b2 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:04.811950 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67bef966-0d89-4ffb-ade8-fba17fa725b2 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:04.812601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67bef966-0d89-4ffb-ade8-fba17fa725b2 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:04.814281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67bef966-0d89-4ffb-ade8-fba17fa725b2 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:04.815450 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67bef966-0d89-4ffb-ade8-fba17fa725b2 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:05.048042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-67bef966-0d89-4ffb-ade8-fba17fa725b2 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:05.064909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fc1b22ef-0789-454c-b5a7-7fe576202dcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:05.073905 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67bef966-0d89-4ffb-ade8-fba17fa725b2 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1316 microversion: 2.1 time: 0.281541 Mar 05 20:51:05.089806 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fc1b22ef-0789-454c-b5a7-7fe576202dcc tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1317 microversion: 2.1 time: 0.472655 Mar 05 20:51:05.090296 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 447/853] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:04 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:05.091295 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 407/854] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:04 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:05.282913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4b4d91ac-c82a-4252-8cd2-da13deec4058 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:05.283433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4b4d91ac-c82a-4252-8cd2-da13deec4058 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:05.296344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b4d91ac-c82a-4252-8cd2-da13deec4058 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:05.297181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b4d91ac-c82a-4252-8cd2-da13deec4058 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:05.298221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b4d91ac-c82a-4252-8cd2-da13deec4058 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:05.308109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b4d91ac-c82a-4252-8cd2-da13deec4058 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:05.523543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4b4d91ac-c82a-4252-8cd2-da13deec4058 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:05.553197 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4b4d91ac-c82a-4252-8cd2-da13deec4058 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1463 microversion: 2.1 time: 0.274433 Mar 05 20:51:05.554842 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 448/855] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:05 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1463 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:05.570568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:05.571524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:05.589098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:05.591506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:05.597459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:05.597914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:05.637657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5d01657f-3335-4a2a-8bd6-c2a341147a39 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:05.638446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5d01657f-3335-4a2a-8bd6-c2a341147a39 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:05.652083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d01657f-3335-4a2a-8bd6-c2a341147a39 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:05.652542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d01657f-3335-4a2a-8bd6-c2a341147a39 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:05.653345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d01657f-3335-4a2a-8bd6-c2a341147a39 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:05.653776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d01657f-3335-4a2a-8bd6-c2a341147a39 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:05.824509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:05.831837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Old instance type m1.heat2, new instance type m1.heat {{(pid=141478) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 20:51:05.850177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:51:05.850602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:51:05.851071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:51:05.851874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:51:05.852450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:51:05.954508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5d01657f-3335-4a2a-8bd6-c2a341147a39 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:05.970391 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5d01657f-3335-4a2a-8bd6-c2a341147a39 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.331490 Mar 05 20:51:05.971382 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 449/856] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:05 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:05.978306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9beacbaa-80e0-4fe6-a7e2-73a2789b72c3 req-057808d9-0ebb-40ef-835b-abdd59c7502d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d5b76d-41e6-4a10-8687-34fd9582a03e", "name": "network-vif-plugged", "status": "completed", "tag": "4a95c28f-b4a8-4cd9-9a86-d99e68a231b9"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:05.988359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9beacbaa-80e0-4fe6-a7e2-73a2789b72c3 req-057808d9-0ebb-40ef-835b-abdd59c7502d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:05.989051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9beacbaa-80e0-4fe6-a7e2-73a2789b72c3 req-057808d9-0ebb-40ef-835b-abdd59c7502d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:06.004071 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9beacbaa-80e0-4fe6-a7e2-73a2789b72c3 req-057808d9-0ebb-40ef-835b-abdd59c7502d service nova] Creating event network-vif-plugged:4a95c28f-b4a8-4cd9-9a86-d99e68a231b9 for instance 37d5b76d-41e6-4a10-8687-34fd9582a03e on nch1-master-1 Mar 05 20:51:06.013756 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9beacbaa-80e0-4fe6-a7e2-73a2789b72c3 req-057808d9-0ebb-40ef-835b-abdd59c7502d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035989 Mar 05 20:51:06.015307 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 450/857] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:06.021995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-933891c2-1c97-48a3-a856-69f073e555b5 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:06.022884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-933891c2-1c97-48a3-a856-69f073e555b5 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:06.030114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-933891c2-1c97-48a3-a856-69f073e555b5 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:06.030806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-933891c2-1c97-48a3-a856-69f073e555b5 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:06.031858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-933891c2-1c97-48a3-a856-69f073e555b5 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:06.032473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-933891c2-1c97-48a3-a856-69f073e555b5 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:06.038112 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8c30953c-10b7-4523-bae8-08a1738d7f4e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "POST /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2/action" status: 202 len: 0 microversion: 2.1 time: 0.471437 Mar 05 20:51:06.038744 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 408/858] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:51:05 2022] POST /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:51:06.051612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-29e71eef-c838-4592-82b8-7b5e7e50589e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:06.052264 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-29e71eef-c838-4592-82b8-7b5e7e50589e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:06.070261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-29e71eef-c838-4592-82b8-7b5e7e50589e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:06.070718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-29e71eef-c838-4592-82b8-7b5e7e50589e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:06.075256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-29e71eef-c838-4592-82b8-7b5e7e50589e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:06.077992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-29e71eef-c838-4592-82b8-7b5e7e50589e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:06.126022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-933891c2-1c97-48a3-a856-69f073e555b5 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:06.141664 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-933891c2-1c97-48a3-a856-69f073e555b5 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1274 microversion: 2.1 time: 0.120518 Mar 05 20:51:06.145957 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 451/859] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:06 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1274 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:06.155492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7c7adf9f-4781-4569-b9b0-47a85beab246 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:06.156644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7c7adf9f-4781-4569-b9b0-47a85beab246 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:06.173478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c7adf9f-4781-4569-b9b0-47a85beab246 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:06.174318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c7adf9f-4781-4569-b9b0-47a85beab246 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:06.176146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c7adf9f-4781-4569-b9b0-47a85beab246 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:06.176602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c7adf9f-4781-4569-b9b0-47a85beab246 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:06.513552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7c7adf9f-4781-4569-b9b0-47a85beab246 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:06.524578 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7c7adf9f-4781-4569-b9b0-47a85beab246 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1316 microversion: 2.1 time: 0.375983 Mar 05 20:51:06.535903 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 452/860] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:06 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:06.554067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-40621593-f63c-4266-a0a4-bd670fc02172 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:06.554746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-40621593-f63c-4266-a0a4-bd670fc02172 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:06.579569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40621593-f63c-4266-a0a4-bd670fc02172 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:06.580181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40621593-f63c-4266-a0a4-bd670fc02172 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:06.581056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40621593-f63c-4266-a0a4-bd670fc02172 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:06.594196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40621593-f63c-4266-a0a4-bd670fc02172 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:06.925160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-29e71eef-c838-4592-82b8-7b5e7e50589e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:06.939706 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-29e71eef-c838-4592-82b8-7b5e7e50589e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1472 microversion: 2.1 time: 0.892110 Mar 05 20:51:06.948835 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 409/861] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:06 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1472 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:06.966391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-40621593-f63c-4266-a0a4-bd670fc02172 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:06.978121 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-40621593-f63c-4266-a0a4-bd670fc02172 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1317 microversion: 2.1 time: 0.438458 Mar 05 20:51:06.979655 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 453/862] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:06 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:06.998426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0bedaca8-fa9e-44c2-8d01-27bda9c395a7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:07.001887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0bedaca8-fa9e-44c2-8d01-27bda9c395a7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:07.015949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0bedaca8-fa9e-44c2-8d01-27bda9c395a7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:07.016422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0bedaca8-fa9e-44c2-8d01-27bda9c395a7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:07.017232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0bedaca8-fa9e-44c2-8d01-27bda9c395a7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:07.017682 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0bedaca8-fa9e-44c2-8d01-27bda9c395a7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:07.218878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0a155dd9-26b2-445e-a833-f4db980150ac tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Action: 'update', calling method: .version_select at 0x7fed5c9ed5e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:07.287935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0bedaca8-fa9e-44c2-8d01-27bda9c395a7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:07.296843 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0bedaca8-fa9e-44c2-8d01-27bda9c395a7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.312052 Mar 05 20:51:07.299855 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 454/863] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:06 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:07.305743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b91e30e5-ba34-4ad1-93f5-a32bc1d16eb0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:07.306574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b91e30e5-ba34-4ad1-93f5-a32bc1d16eb0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:07.314117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b91e30e5-ba34-4ad1-93f5-a32bc1d16eb0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:07.315517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b91e30e5-ba34-4ad1-93f5-a32bc1d16eb0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:07.318621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b91e30e5-ba34-4ad1-93f5-a32bc1d16eb0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:07.319284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b91e30e5-ba34-4ad1-93f5-a32bc1d16eb0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:07.385410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a155dd9-26b2-445e-a833-f4db980150ac tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:07.387956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a155dd9-26b2-445e-a833-f4db980150ac tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:07.390479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a155dd9-26b2-445e-a833-f4db980150ac tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:07.393782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a155dd9-26b2-445e-a833-f4db980150ac tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:07.488530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b91e30e5-ba34-4ad1-93f5-a32bc1d16eb0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:07.520736 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b91e30e5-ba34-4ad1-93f5-a32bc1d16eb0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1280 microversion: 2.1 time: 0.219410 Mar 05 20:51:07.525901 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 455/864] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:07 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1280 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:07.548904 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0a155dd9-26b2-445e-a833-f4db980150ac tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/7688d043a5b54608832ee45d610d0dd0" status: 200 len: 148 microversion: 2.57 time: 0.597654 Mar 05 20:51:07.549555 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 410/865] 10.222.0.15 () {62 vars in 1302 bytes} [Sat Mar 5 20:51:06 2022] PUT /compute/v2.1/os-quota-sets/7688d043a5b54608832ee45d610d0dd0 => generated 148 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:51:07.558753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ea9f104c-1d09-4b5c-96fa-834c032450ca tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:07.559317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-87fa8949-aa6f-4ec4-8320-4f2335aaff67 tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Calling method '.version_select at 0x7fed5c99d5e0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:07.560063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ea9f104c-1d09-4b5c-96fa-834c032450ca tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:07.570132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea9f104c-1d09-4b5c-96fa-834c032450ca tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:07.570888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea9f104c-1d09-4b5c-96fa-834c032450ca tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:07.572211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea9f104c-1d09-4b5c-96fa-834c032450ca tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:07.572843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea9f104c-1d09-4b5c-96fa-834c032450ca tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:07.756761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-87fa8949-aa6f-4ec4-8320-4f2335aaff67 tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:07.757481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-87fa8949-aa6f-4ec4-8320-4f2335aaff67 tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:07.758383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-87fa8949-aa6f-4ec4-8320-4f2335aaff67 tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:07.761310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-87fa8949-aa6f-4ec4-8320-4f2335aaff67 tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:07.829292 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-87fa8949-aa6f-4ec4-8320-4f2335aaff67 tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/7688d043a5b54608832ee45d610d0dd0/detail" status: 200 len: 463 microversion: 2.57 time: 0.273616 Mar 05 20:51:07.832107 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 411/866] 10.222.0.15 () {60 vars in 1303 bytes} [Sat Mar 5 20:51:07 2022] GET /compute/v2.1/os-quota-sets/7688d043a5b54608832ee45d610d0dd0/detail => generated 463 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 20:51:07.966460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b92ff47-8951-468f-ae05-adcc049ff588 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:07.968216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4b92ff47-8951-468f-ae05-adcc049ff588 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:07.984369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b92ff47-8951-468f-ae05-adcc049ff588 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:07.984829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b92ff47-8951-468f-ae05-adcc049ff588 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:07.989616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b92ff47-8951-468f-ae05-adcc049ff588 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:07.990098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b92ff47-8951-468f-ae05-adcc049ff588 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:08.338569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ea9f104c-1d09-4b5c-96fa-834c032450ca tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:08.363242 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ea9f104c-1d09-4b5c-96fa-834c032450ca tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1316 microversion: 2.1 time: 0.806826 Mar 05 20:51:08.363919 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 456/867] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:07 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1316 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:08.384450 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3bc00a14-6cea-4c7b-b483-b23f0292b488 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:08.396488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3bc00a14-6cea-4c7b-b483-b23f0292b488 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:08.416329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3bc00a14-6cea-4c7b-b483-b23f0292b488 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:08.422777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3bc00a14-6cea-4c7b-b483-b23f0292b488 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:08.424119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3bc00a14-6cea-4c7b-b483-b23f0292b488 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:08.427614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3bc00a14-6cea-4c7b-b483-b23f0292b488 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:08.760217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3bc00a14-6cea-4c7b-b483-b23f0292b488 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:08.773354 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3bc00a14-6cea-4c7b-b483-b23f0292b488 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1467 microversion: 2.1 time: 0.401032 Mar 05 20:51:08.773991 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 457/868] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:08 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1467 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:08.793638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-21b043ad-381b-49e3-b73f-8aa938fb7f8c tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Action: 'update', calling method: .version_select at 0x7fed5c808dc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:08.909741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21b043ad-381b-49e3-b73f-8aa938fb7f8c tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:08.910304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21b043ad-381b-49e3-b73f-8aa938fb7f8c tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:08.914256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21b043ad-381b-49e3-b73f-8aa938fb7f8c tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:08.920386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21b043ad-381b-49e3-b73f-8aa938fb7f8c tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:09.054694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21b043ad-381b-49e3-b73f-8aa938fb7f8c tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:09.055060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21b043ad-381b-49e3-b73f-8aa938fb7f8c tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:09.056017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21b043ad-381b-49e3-b73f-8aa938fb7f8c tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:09.056403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21b043ad-381b-49e3-b73f-8aa938fb7f8c tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:09.203294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4b92ff47-8951-468f-ae05-adcc049ff588 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:09.206253 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-21b043ad-381b-49e3-b73f-8aa938fb7f8c tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/7688d043a5b54608832ee45d610d0dd0?user_id=6359741e35bc44179cd7add0437e90f5" status: 200 len: 148 microversion: 2.57 time: 0.416869 Mar 05 20:51:09.216884 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 458/869] 10.222.0.15 () {62 vars in 1383 bytes} [Sat Mar 5 20:51:08 2022] PUT /compute/v2.1/os-quota-sets/7688d043a5b54608832ee45d610d0dd0?user_id=6359741e35bc44179cd7add0437e90f5 => generated 148 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:51:09.217746 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4b92ff47-8951-468f-ae05-adcc049ff588 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1472 microversion: 2.1 time: 1.256271 Mar 05 20:51:09.227489 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 412/870] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:07 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1472 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:09.227698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b152960d-4f6a-4ddb-8a4c-e925e320bb82 req-df8f6762-7c25-4539-b846-0c241b514799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54f039d-1623-4ad6-a4e3-308472493214", "name": "network-vif-plugged", "status": "completed", "tag": "6c25b98e-729b-490d-bb31-a40e13f1d945"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:09.237401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2d27aa27-0d4a-4b49-9ecc-4844b9d412c8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:09.238019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2d27aa27-0d4a-4b49-9ecc-4844b9d412c8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:09.239604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b152960d-4f6a-4ddb-8a4c-e925e320bb82 req-df8f6762-7c25-4539-b846-0c241b514799 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:09.240198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b152960d-4f6a-4ddb-8a4c-e925e320bb82 req-df8f6762-7c25-4539-b846-0c241b514799 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:09.254370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d27aa27-0d4a-4b49-9ecc-4844b9d412c8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:09.254823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d27aa27-0d4a-4b49-9ecc-4844b9d412c8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:09.258497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d27aa27-0d4a-4b49-9ecc-4844b9d412c8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:09.260355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d27aa27-0d4a-4b49-9ecc-4844b9d412c8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:09.260501 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b152960d-4f6a-4ddb-8a4c-e925e320bb82 req-df8f6762-7c25-4539-b846-0c241b514799 service nova] Creating event network-vif-plugged:6c25b98e-729b-490d-bb31-a40e13f1d945 for instance d54f039d-1623-4ad6-a4e3-308472493214 on nch2-master-1 Mar 05 20:51:09.273423 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b152960d-4f6a-4ddb-8a4c-e925e320bb82 req-df8f6762-7c25-4539-b846-0c241b514799 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053779 Mar 05 20:51:09.274120 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 459/871] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:09.293215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-378b3697-09eb-4a4e-9ac7-f669875d190b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:09.294315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-378b3697-09eb-4a4e-9ac7-f669875d190b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:09.312696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-378b3697-09eb-4a4e-9ac7-f669875d190b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:09.314022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-378b3697-09eb-4a4e-9ac7-f669875d190b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:09.317975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-378b3697-09eb-4a4e-9ac7-f669875d190b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:09.318897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-378b3697-09eb-4a4e-9ac7-f669875d190b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:09.423112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-378b3697-09eb-4a4e-9ac7-f669875d190b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:09.436436 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-378b3697-09eb-4a4e-9ac7-f669875d190b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1280 microversion: 2.1 time: 0.151893 Mar 05 20:51:09.442797 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 460/872] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:09 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1280 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:09.450665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c6f3fa6b-d561-4593-b37b-d05812f2e564 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:09.452296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c6f3fa6b-d561-4593-b37b-d05812f2e564 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:09.482159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6f3fa6b-d561-4593-b37b-d05812f2e564 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:09.483894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6f3fa6b-d561-4593-b37b-d05812f2e564 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:09.486243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6f3fa6b-d561-4593-b37b-d05812f2e564 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:09.488387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6f3fa6b-d561-4593-b37b-d05812f2e564 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:09.751299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d27aa27-0d4a-4b49-9ecc-4844b9d412c8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:09.765778 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2d27aa27-0d4a-4b49-9ecc-4844b9d412c8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1472 microversion: 2.1 time: 0.544174 Mar 05 20:51:09.766914 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 413/873] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:09 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1472 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:09.777194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-63d85789-19ce-4538-9a76-f30fbe8945dc tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] Calling method '.version_select at 0x7fed5cf94e50>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:09.832384 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c6f3fa6b-d561-4593-b37b-d05812f2e564 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1618 microversion: 2.1 time: 0.376786 Mar 05 20:51:09.841201 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 461/874] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:09 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1618 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:09.860623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dc6185ee-98d5-47da-88bf-1ff3d029c83c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:09.861751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dc6185ee-98d5-47da-88bf-1ff3d029c83c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:09.903310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc6185ee-98d5-47da-88bf-1ff3d029c83c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:09.903835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc6185ee-98d5-47da-88bf-1ff3d029c83c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:09.906115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc6185ee-98d5-47da-88bf-1ff3d029c83c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:09.907712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc6185ee-98d5-47da-88bf-1ff3d029c83c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:09.970177 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-63d85789-19ce-4538-9a76-f30fbe8945dc tempest-QuotasAdminTestV257-1715092541 tempest-QuotasAdminTestV257-1715092541-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/7688d043a5b54608832ee45d610d0dd0?user_id=6359741e35bc44179cd7add0437e90f5" status: 200 len: 190 microversion: 2.57 time: 0.201735 Mar 05 20:51:09.977222 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 414/875] 10.222.0.15 () {60 vars in 1363 bytes} [Sat Mar 5 20:51:09 2022] GET /compute/v2.1/os-quota-sets/7688d043a5b54608832ee45d610d0dd0?user_id=6359741e35bc44179cd7add0437e90f5 => generated 190 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:51:10.141162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-176182538", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7f00577b-ab4a-4e3c-b42d-53f30d4a34bd"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:10.540438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dc6185ee-98d5-47da-88bf-1ff3d029c83c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:10.552454 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dc6185ee-98d5-47da-88bf-1ff3d029c83c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1316 microversion: 2.1 time: 0.707309 Mar 05 20:51:10.563298 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 462/876] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:09 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1316 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:10.579590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4fc1f559-f41d-4b12-b94e-624a3c203b31 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:10.588157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4fc1f559-f41d-4b12-b94e-624a3c203b31 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:10.631166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4fc1f559-f41d-4b12-b94e-624a3c203b31 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:10.644292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4fc1f559-f41d-4b12-b94e-624a3c203b31 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:10.646442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4fc1f559-f41d-4b12-b94e-624a3c203b31 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:10.647080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4fc1f559-f41d-4b12-b94e-624a3c203b31 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:11.653480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4fc1f559-f41d-4b12-b94e-624a3c203b31 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:11.664835 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4fc1f559-f41d-4b12-b94e-624a3c203b31 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1472 microversion: 2.1 time: 1.092353 Mar 05 20:51:11.669569 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 463/877] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:10 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1472 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:11.683755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8b0a89c0-de9b-4558-af4e-42d8c21e5bc0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:11.689653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8b0a89c0-de9b-4558-af4e-42d8c21e5bc0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:11.700539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b0a89c0-de9b-4558-af4e-42d8c21e5bc0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:11.712887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b0a89c0-de9b-4558-af4e-42d8c21e5bc0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:11.720058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b0a89c0-de9b-4558-af4e-42d8c21e5bc0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:11.728087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b0a89c0-de9b-4558-af4e-42d8c21e5bc0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:12.528174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8b0a89c0-de9b-4558-af4e-42d8c21e5bc0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:12.538449 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8b0a89c0-de9b-4558-af4e-42d8c21e5bc0 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1322 microversion: 2.1 time: 0.866251 Mar 05 20:51:12.558103 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 464/878] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:11 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1322 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:12.566336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-827d32da-bbae-4964-afc0-f1b653f59706 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:12.567900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-827d32da-bbae-4964-afc0-f1b653f59706 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:12.580661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-827d32da-bbae-4964-afc0-f1b653f59706 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:12.584588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-827d32da-bbae-4964-afc0-f1b653f59706 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:12.591327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-827d32da-bbae-4964-afc0-f1b653f59706 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:12.593642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-827d32da-bbae-4964-afc0-f1b653f59706 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:12.887613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-827d32da-bbae-4964-afc0-f1b653f59706 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:12.911973 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-827d32da-bbae-4964-afc0-f1b653f59706 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1478 microversion: 2.1 time: 0.352220 Mar 05 20:51:12.915340 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 465/879] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:12 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1478 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:12.922636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-fb42c53c-55e8-4c97-94ab-4a301092b48f req-10bbecf8-5cf3-4c47-89ee-6850d6bb0704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0c42a3-81a2-42db-9762-46bd15b2d0ba", "tag": "c27fa3bc-53d7-4955-9db1-64fb1ec24675"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:12.968883 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fb42c53c-55e8-4c97-94ab-4a301092b48f req-10bbecf8-5cf3-4c47-89ee-6850d6bb0704 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:12.971932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fb42c53c-55e8-4c97-94ab-4a301092b48f req-10bbecf8-5cf3-4c47-89ee-6850d6bb0704 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:13.031487 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-fb42c53c-55e8-4c97-94ab-4a301092b48f req-10bbecf8-5cf3-4c47-89ee-6850d6bb0704 service nova] Creating event network-changed:c27fa3bc-53d7-4955-9db1-64fb1ec24675 for instance 0c0c42a3-81a2-42db-9762-46bd15b2d0ba on nch1-master-1 Mar 05 20:51:13.084976 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-fb42c53c-55e8-4c97-94ab-4a301092b48f req-10bbecf8-5cf3-4c47-89ee-6850d6bb0704 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148565 Mar 05 20:51:13.085759 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 466/880] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:13.107158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5f37d23b-3064-46d6-a57b-0daf740f8463 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:13.118758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5f37d23b-3064-46d6-a57b-0daf740f8463 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:13.134089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f37d23b-3064-46d6-a57b-0daf740f8463 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:13.134933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f37d23b-3064-46d6-a57b-0daf740f8463 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:13.138041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f37d23b-3064-46d6-a57b-0daf740f8463 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:13.139935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f37d23b-3064-46d6-a57b-0daf740f8463 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:13.584356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5f37d23b-3064-46d6-a57b-0daf740f8463 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:13.615048 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5f37d23b-3064-46d6-a57b-0daf740f8463 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1466 microversion: 2.1 time: 0.517156 Mar 05 20:51:13.616613 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 467/881] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:13 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1466 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:13.627401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67c57d7e-48c5-430b-bb4b-46508b129f64 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:13.631043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-67c57d7e-48c5-430b-bb4b-46508b129f64 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:13.660704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67c57d7e-48c5-430b-bb4b-46508b129f64 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:13.661501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67c57d7e-48c5-430b-bb4b-46508b129f64 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:13.662587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67c57d7e-48c5-430b-bb4b-46508b129f64 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:13.663235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67c57d7e-48c5-430b-bb4b-46508b129f64 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:14.332309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-67c57d7e-48c5-430b-bb4b-46508b129f64 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:14.340291 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67c57d7e-48c5-430b-bb4b-46508b129f64 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.722380 Mar 05 20:51:14.343885 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 468/882] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:13 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:14.354868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fd9efc21-757a-4a9c-8674-8432d7dc5a3c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:14.355496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fd9efc21-757a-4a9c-8674-8432d7dc5a3c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:14.365278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd9efc21-757a-4a9c-8674-8432d7dc5a3c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:14.366100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd9efc21-757a-4a9c-8674-8432d7dc5a3c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:14.367083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd9efc21-757a-4a9c-8674-8432d7dc5a3c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:14.367858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd9efc21-757a-4a9c-8674-8432d7dc5a3c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:14.681086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fd9efc21-757a-4a9c-8674-8432d7dc5a3c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:14.691840 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fd9efc21-757a-4a9c-8674-8432d7dc5a3c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1322 microversion: 2.1 time: 0.346628 Mar 05 20:51:14.696896 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 469/883] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:14 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:14.707514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aa5f89f3-2947-40b4-aee5-0bf309f20bee tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1407113741", "metadata": {"image_type": "test"}}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:14.709131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-aa5f89f3-2947-40b4-aee5-0bf309f20bee tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:14.726527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa5f89f3-2947-40b4-aee5-0bf309f20bee tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:14.727262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa5f89f3-2947-40b4-aee5-0bf309f20bee tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:14.728415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa5f89f3-2947-40b4-aee5-0bf309f20bee tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:14.728918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa5f89f3-2947-40b4-aee5-0bf309f20bee tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:14.793893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-aa5f89f3-2947-40b4-aee5-0bf309f20bee tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Getting quotas for project ffa214a1fdce408095cfce5d20496af7. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:14.814369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-aa5f89f3-2947-40b4-aee5-0bf309f20bee tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Getting quotas for user 275c5f63f0e84b32bf036e57586bf59c and project ffa214a1fdce408095cfce5d20496af7. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:17.651555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:51:17.892646 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aa5f89f3-2947-40b4-aee5-0bf309f20bee tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "POST /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214/action" status: 202 len: 0 microversion: 2.1 time: 3.194039 Mar 05 20:51:17.893946 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 470/884] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:51:14 2022] POST /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214/action => generated 0 bytes in 3196 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 20:51:17.900800 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91faded6-9ada-49f5-89d5-90f262785aa1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:17.901793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91faded6-9ada-49f5-89d5-90f262785aa1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:17.910812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91faded6-9ada-49f5-89d5-90f262785aa1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:17.911449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91faded6-9ada-49f5-89d5-90f262785aa1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:17.912709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91faded6-9ada-49f5-89d5-90f262785aa1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:17.913307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91faded6-9ada-49f5-89d5-90f262785aa1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:17.970392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:51:17.970905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:51:17.971892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:51:17.972477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:51:17.973064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:51:17.991038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:17.991790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:17.992864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:17.993983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:18.021803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:18.028824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Getting quotas for user 19d9d88f4b414d5492bcf673e7105551 and project ce49b47d2cef4fddbfdb7b5f00004b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:18.045012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:51:18.048446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:51:18.125347 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-71d1cd89-93f8-463e-83b3-f70ad66f616c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.990712 Mar 05 20:51:18.126688 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 415/885] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:51:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 7993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:51:18.133749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a30709d0-6647-4136-86b7-fd805e3565d1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:18.134668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a30709d0-6647-4136-86b7-fd805e3565d1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:18.144302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a30709d0-6647-4136-86b7-fd805e3565d1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:18.145364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a30709d0-6647-4136-86b7-fd805e3565d1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:18.146308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a30709d0-6647-4136-86b7-fd805e3565d1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:18.147183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a30709d0-6647-4136-86b7-fd805e3565d1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:18.295920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-91faded6-9ada-49f5-89d5-90f262785aa1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:18.307608 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91faded6-9ada-49f5-89d5-90f262785aa1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1478 microversion: 2.1 time: 0.407275 Mar 05 20:51:18.308319 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 471/886] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:17 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1478 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:18.322683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-2d1e0c9e-f439-4208-a68f-7cb83679c892 req-7e77403e-2343-424b-b611-ceb4d7f5f324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d196df64-5f99-4c5a-b30b-92751e6f7702", "name": "network-vif-unplugged", "status": "completed", "tag": "cd12eb23-3086-4db9-babd-0ffb56ce7a27"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:18.343114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2d1e0c9e-f439-4208-a68f-7cb83679c892 req-7e77403e-2343-424b-b611-ceb4d7f5f324 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:18.343565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2d1e0c9e-f439-4208-a68f-7cb83679c892 req-7e77403e-2343-424b-b611-ceb4d7f5f324 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:18.355420 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-2d1e0c9e-f439-4208-a68f-7cb83679c892 req-7e77403e-2343-424b-b611-ceb4d7f5f324 service nova] Creating event network-vif-unplugged:cd12eb23-3086-4db9-babd-0ffb56ce7a27 for instance d196df64-5f99-4c5a-b30b-92751e6f7702 on nch1-master-1 Mar 05 20:51:18.373614 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-2d1e0c9e-f439-4208-a68f-7cb83679c892 req-7e77403e-2343-424b-b611-ceb4d7f5f324 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054428 Mar 05 20:51:18.376805 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 472/887] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:18.390796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8fca6022-1cc5-4772-bf42-1e33489d9b8d tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:18.392138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8fca6022-1cc5-4772-bf42-1e33489d9b8d tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:18.408279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fca6022-1cc5-4772-bf42-1e33489d9b8d tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:18.409010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fca6022-1cc5-4772-bf42-1e33489d9b8d tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:18.409779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fca6022-1cc5-4772-bf42-1e33489d9b8d tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:18.410563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fca6022-1cc5-4772-bf42-1e33489d9b8d tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:18.629685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a30709d0-6647-4136-86b7-fd805e3565d1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:18.643111 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a30709d0-6647-4136-86b7-fd805e3565d1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.515104 Mar 05 20:51:18.644286 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 416/888] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:18 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:18.651544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-75777c73-ea83-4687-a11a-39e7cbe20d92 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c9ed5e0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:18.749677 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-75777c73-ea83-4687-a11a-39e7cbe20d92 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.104079 Mar 05 20:51:18.750450 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 417/889] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:18 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:18.757312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-12b2f751-18e0-4441-b387-4dce4e956eba tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:18.761861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-12b2f751-18e0-4441-b387-4dce4e956eba tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:18.767510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8fca6022-1cc5-4772-bf42-1e33489d9b8d tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:18.779938 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8fca6022-1cc5-4772-bf42-1e33489d9b8d tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1322 microversion: 2.1 time: 0.400972 Mar 05 20:51:18.780981 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 473/890] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:18 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:18.872125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-12b2f751-18e0-4441-b387-4dce4e956eba tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:18.890384 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-12b2f751-18e0-4441-b387-4dce4e956eba tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1216 microversion: 2.1 time: 0.136856 Mar 05 20:51:18.894714 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 418/891] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:18 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:19.325818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ec988910-9ad9-4a15-8ad0-93dcb1685d4a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:19.327180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ec988910-9ad9-4a15-8ad0-93dcb1685d4a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:19.334961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec988910-9ad9-4a15-8ad0-93dcb1685d4a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:19.336722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec988910-9ad9-4a15-8ad0-93dcb1685d4a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:19.337788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec988910-9ad9-4a15-8ad0-93dcb1685d4a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:19.338449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec988910-9ad9-4a15-8ad0-93dcb1685d4a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:19.561740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ec988910-9ad9-4a15-8ad0-93dcb1685d4a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:19.575075 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ec988910-9ad9-4a15-8ad0-93dcb1685d4a tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1463 microversion: 2.1 time: 0.252906 Mar 05 20:51:19.575986 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 474/892] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:19 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1463 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:19.598199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-83f9931f-78cf-4056-b554-6c8f90bd0da1 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:19.599351 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-83f9931f-78cf-4056-b554-6c8f90bd0da1 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:19.605915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83f9931f-78cf-4056-b554-6c8f90bd0da1 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:19.606444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83f9931f-78cf-4056-b554-6c8f90bd0da1 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:19.611691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1201368470", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "e14d3064-469d-44db-b5a1-15a564781c13"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:19.618547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83f9931f-78cf-4056-b554-6c8f90bd0da1 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:19.619088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83f9931f-78cf-4056-b554-6c8f90bd0da1 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:19.700652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] validate_networks() for [('e14d3064-469d-44db-b5a1-15a564781c13', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:51:19.711849 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-83f9931f-78cf-4056-b554-6c8f90bd0da1 tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action" status: 202 len: 0 microversion: 2.1 time: 0.117905 Mar 05 20:51:19.713100 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 475/893] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:51:19 2022] POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:51:19.721411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91a5923d-4ffe-4ebf-a71a-ffe4ced05912 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:19.722156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91a5923d-4ffe-4ebf-a71a-ffe4ced05912 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:19.728649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91a5923d-4ffe-4ebf-a71a-ffe4ced05912 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:19.729485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91a5923d-4ffe-4ebf-a71a-ffe4ced05912 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:19.731125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91a5923d-4ffe-4ebf-a71a-ffe4ced05912 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:19.732375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91a5923d-4ffe-4ebf-a71a-ffe4ced05912 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:19.903707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-91a5923d-4ffe-4ebf-a71a-ffe4ced05912 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:19.914724 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91a5923d-4ffe-4ebf-a71a-ffe4ced05912 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.200629 Mar 05 20:51:19.915924 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 476/894] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:19 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:19.921507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c7538c2-bae3-4d10-99bb-a60a350950ba tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:19.922595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9c7538c2-bae3-4d10-99bb-a60a350950ba tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:19.929080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c7538c2-bae3-4d10-99bb-a60a350950ba tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:19.929720 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c7538c2-bae3-4d10-99bb-a60a350950ba tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:19.930494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c7538c2-bae3-4d10-99bb-a60a350950ba tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:19.930927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c7538c2-bae3-4d10-99bb-a60a350950ba tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:19.962454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c7538c2-bae3-4d10-99bb-a60a350950ba tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:19.962904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c7538c2-bae3-4d10-99bb-a60a350950ba tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:19.963360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-9c7538c2-bae3-4d10-99bb-a60a350950ba tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lazy-loading 'fault' on Instance uuid d196df64-5f99-4c5a-b30b-92751e6f7702 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:51:20.099994 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c7538c2-bae3-4d10-99bb-a60a350950ba tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1597 microversion: 2.1 time: 0.182609 Mar 05 20:51:20.100888 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 477/895] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:19 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1597 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:20.106129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-239a89f3-69c3-4564-8fa3-11973590b0d7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c660ca0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:20.140257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:51:20.140842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:51:20.141357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:51:20.141938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:51:20.142344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:51:20.152410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.153111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.154133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.155260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.177293 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-239a89f3-69c3-4564-8fa3-11973590b0d7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.074647 Mar 05 20:51:20.178011 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 478/896] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:20 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:20.178823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Getting quotas for project d68ef6fdcc64421f8fb6f1d147edea70. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:20.184816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Getting quotas for user f77d65eda4a24df3bc38b9920f99f2dd and project d68ef6fdcc64421f8fb6f1d147edea70. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:20.189059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bca0456b-0a13-4f10-a31f-0b5e6a681776 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:20.189830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bca0456b-0a13-4f10-a31f-0b5e6a681776 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:20.196827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bca0456b-0a13-4f10-a31f-0b5e6a681776 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.197843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bca0456b-0a13-4f10-a31f-0b5e6a681776 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.198924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bca0456b-0a13-4f10-a31f-0b5e6a681776 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.199572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bca0456b-0a13-4f10-a31f-0b5e6a681776 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.200725 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:51:20.202935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:51:20.277434 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1edfebb3-368e-4a40-9ff3-9344f30f748a tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903516 Mar 05 20:51:20.278558 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 419/897] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:51:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 20:51:20.287442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f557aac7-6a4c-4532-8a3e-7821d4a44d1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:20.288823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f557aac7-6a4c-4532-8a3e-7821d4a44d1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:20.298946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f557aac7-6a4c-4532-8a3e-7821d4a44d1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.299425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f557aac7-6a4c-4532-8a3e-7821d4a44d1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.300402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f557aac7-6a4c-4532-8a3e-7821d4a44d1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.301116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f557aac7-6a4c-4532-8a3e-7821d4a44d1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.385014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f557aac7-6a4c-4532-8a3e-7821d4a44d1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:20.393485 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f557aac7-6a4c-4532-8a3e-7821d4a44d1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1286 microversion: 2.1 time: 0.113919 Mar 05 20:51:20.396265 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 420/898] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:20 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1286 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:20.410895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd8b6b82-6a1b-4ace-8564-884f87d343bb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:20.412034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd8b6b82-6a1b-4ace-8564-884f87d343bb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:20.419477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd8b6b82-6a1b-4ace-8564-884f87d343bb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.420669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd8b6b82-6a1b-4ace-8564-884f87d343bb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.421520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd8b6b82-6a1b-4ace-8564-884f87d343bb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.422158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd8b6b82-6a1b-4ace-8564-884f87d343bb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.514943 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd8b6b82-6a1b-4ace-8564-884f87d343bb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action" status: 202 len: 0 microversion: 2.1 time: 0.106055 Mar 05 20:51:20.515786 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 421/899] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:51:20 2022] POST /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:51:20.521893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-918986d8-8fab-4b84-9991-d60a507f67f2 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:20.522707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-918986d8-8fab-4b84-9991-d60a507f67f2 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:20.585093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-918986d8-8fab-4b84-9991-d60a507f67f2 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:20.594281 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-918986d8-8fab-4b84-9991-d60a507f67f2 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1218 microversion: 2.1 time: 0.077565 Mar 05 20:51:20.594877 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 422/900] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:20 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:20.598381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bca0456b-0a13-4f10-a31f-0b5e6a681776 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:20.600712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e9c73bdf-dba8-41c1-935c-0cfaf85673f1 req-c20d2afc-e348-485b-8cc2-d5397ef2f90d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d196df64-5f99-4c5a-b30b-92751e6f7702", "name": "network-vif-plugged", "status": "completed", "tag": "cd12eb23-3086-4db9-babd-0ffb56ce7a27"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:20.606294 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bca0456b-0a13-4f10-a31f-0b5e6a681776 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1322 microversion: 2.1 time: 0.427201 Mar 05 20:51:20.606892 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 479/901] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:20 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:20.619584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0d1ace6b-8cbe-4fa2-b0dd-c9ad0e3d00cb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:20.620252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0d1ace6b-8cbe-4fa2-b0dd-c9ad0e3d00cb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:20.630585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1ace6b-8cbe-4fa2-b0dd-c9ad0e3d00cb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.631534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1ace6b-8cbe-4fa2-b0dd-c9ad0e3d00cb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.633768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1ace6b-8cbe-4fa2-b0dd-c9ad0e3d00cb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.634684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1ace6b-8cbe-4fa2-b0dd-c9ad0e3d00cb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.640154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e9c73bdf-dba8-41c1-935c-0cfaf85673f1 req-c20d2afc-e348-485b-8cc2-d5397ef2f90d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.640720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e9c73bdf-dba8-41c1-935c-0cfaf85673f1 req-c20d2afc-e348-485b-8cc2-d5397ef2f90d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.664804 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e9c73bdf-dba8-41c1-935c-0cfaf85673f1 req-c20d2afc-e348-485b-8cc2-d5397ef2f90d service nova] Creating event network-vif-plugged:cd12eb23-3086-4db9-babd-0ffb56ce7a27 for instance d196df64-5f99-4c5a-b30b-92751e6f7702 on nch1-master-1 Mar 05 20:51:20.676724 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e9c73bdf-dba8-41c1-935c-0cfaf85673f1 req-c20d2afc-e348-485b-8cc2-d5397ef2f90d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080216 Mar 05 20:51:20.681526 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 423/902] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:20.930264 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0d1ace6b-8cbe-4fa2-b0dd-c9ad0e3d00cb tempest-ServersAdminTestJSON-989760610 tempest-ServersAdminTestJSON-989760610-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1614 microversion: 2.1 time: 0.321889 Mar 05 20:51:20.931399 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 480/903] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:20 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1614 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:20.933144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e7fd2157-c884-4376-b4fb-b19125214621 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:20.933942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e7fd2157-c884-4376-b4fb-b19125214621 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:20.940245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7fd2157-c884-4376-b4fb-b19125214621 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.943112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7fd2157-c884-4376-b4fb-b19125214621 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.944191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7fd2157-c884-4376-b4fb-b19125214621 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.944829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7fd2157-c884-4376-b4fb-b19125214621 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.957617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7ed426d5-34a7-4e01-ad84-48d14c7231c0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:20.958246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7ed426d5-34a7-4e01-ad84-48d14c7231c0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:20.968648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ed426d5-34a7-4e01-ad84-48d14c7231c0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.969261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ed426d5-34a7-4e01-ad84-48d14c7231c0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:20.970250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ed426d5-34a7-4e01-ad84-48d14c7231c0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:20.970968 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ed426d5-34a7-4e01-ad84-48d14c7231c0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:21.010642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7ed426d5-34a7-4e01-ad84-48d14c7231c0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:51:21.125569 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7ed426d5-34a7-4e01-ad84-48d14c7231c0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 204 len: 0 microversion: 2.1 time: 0.180302 Mar 05 20:51:21.127197 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 481/904] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:20 2022] DELETE /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 20:51:21.136376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0123c629-6bc7-449a-9cee-62b4bc1569f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:21.137433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0123c629-6bc7-449a-9cee-62b4bc1569f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:21.145312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0123c629-6bc7-449a-9cee-62b4bc1569f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:21.145767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0123c629-6bc7-449a-9cee-62b4bc1569f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:21.147230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0123c629-6bc7-449a-9cee-62b4bc1569f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:21.147533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0123c629-6bc7-449a-9cee-62b4bc1569f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:21.152002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e7fd2157-c884-4376-b4fb-b19125214621 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:21.161541 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e7fd2157-c884-4376-b4fb-b19125214621 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.232936 Mar 05 20:51:21.162369 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 424/905] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:20 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:21.190816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1d28b4d8-8670-4491-b724-ed4e949bc4da tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c97bc10>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:21.250678 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1d28b4d8-8670-4491-b724-ed4e949bc4da tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.063249 Mar 05 20:51:21.251289 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 425/906] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:21 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:21.413709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7b55e65b-4d4d-40ba-b059-03dcecc93cf1 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:21.414340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7b55e65b-4d4d-40ba-b059-03dcecc93cf1 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:21.429454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b55e65b-4d4d-40ba-b059-03dcecc93cf1 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:21.429911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b55e65b-4d4d-40ba-b059-03dcecc93cf1 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:21.430965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b55e65b-4d4d-40ba-b059-03dcecc93cf1 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:21.431159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b55e65b-4d4d-40ba-b059-03dcecc93cf1 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:21.476738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0123c629-6bc7-449a-9cee-62b4bc1569f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:21.488534 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0123c629-6bc7-449a-9cee-62b4bc1569f0 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 200 len: 1470 microversion: 2.1 time: 0.357249 Mar 05 20:51:21.491952 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 482/907] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:21 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 1470 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:21.610510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9afd2009-743d-4422-8919-020074047fa1 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:21.611163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9afd2009-743d-4422-8919-020074047fa1 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:21.622078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9afd2009-743d-4422-8919-020074047fa1 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:21.622479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9afd2009-743d-4422-8919-020074047fa1 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:21.629670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9afd2009-743d-4422-8919-020074047fa1 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:21.630209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9afd2009-743d-4422-8919-020074047fa1 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:21.750421 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7b55e65b-4d4d-40ba-b059-03dcecc93cf1 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:21.760867 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7b55e65b-4d4d-40ba-b059-03dcecc93cf1 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1316 microversion: 2.1 time: 0.351176 Mar 05 20:51:21.764753 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 426/908] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:21 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:21.770634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d9b790c2-955f-4b7d-8ccb-a68cf03f993c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:21.771933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9afd2009-743d-4422-8919-020074047fa1 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:21.773186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d9b790c2-955f-4b7d-8ccb-a68cf03f993c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:21.786200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d9b790c2-955f-4b7d-8ccb-a68cf03f993c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:21.786657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d9b790c2-955f-4b7d-8ccb-a68cf03f993c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:21.787448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d9b790c2-955f-4b7d-8ccb-a68cf03f993c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:21.787806 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9afd2009-743d-4422-8919-020074047fa1 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1270 microversion: 2.1 time: 0.181177 Mar 05 20:51:21.787946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d9b790c2-955f-4b7d-8ccb-a68cf03f993c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:21.799515 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 483/909] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:21 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1270 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:22.179099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-29b9f5e6-e97e-437e-a125-89345903517d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:22.179750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-29b9f5e6-e97e-437e-a125-89345903517d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:22.190023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29b9f5e6-e97e-437e-a125-89345903517d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:22.190714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29b9f5e6-e97e-437e-a125-89345903517d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:22.192085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29b9f5e6-e97e-437e-a125-89345903517d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:22.192685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29b9f5e6-e97e-437e-a125-89345903517d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:22.597544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d9b790c2-955f-4b7d-8ccb-a68cf03f993c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:22.600286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-29b9f5e6-e97e-437e-a125-89345903517d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:22.605883 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d9b790c2-955f-4b7d-8ccb-a68cf03f993c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1322 microversion: 2.1 time: 0.838771 Mar 05 20:51:22.606465 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 427/910] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:21 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1322 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:22.623276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9ab29e23-322e-4467-b235-cb568e60adc1 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c9a4820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:22.628953 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-29b9f5e6-e97e-437e-a125-89345903517d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.451555 Mar 05 20:51:22.628953 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 484/911] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:22 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:22.674678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ae83de7-7d4d-4ffc-916d-d191a6dd5e91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:22.677470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ae83de7-7d4d-4ffc-916d-d191a6dd5e91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:22.689219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ae83de7-7d4d-4ffc-916d-d191a6dd5e91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:22.691554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ae83de7-7d4d-4ffc-916d-d191a6dd5e91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:22.692568 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ae83de7-7d4d-4ffc-916d-d191a6dd5e91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:22.694486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ae83de7-7d4d-4ffc-916d-d191a6dd5e91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:23.270801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9ae83de7-7d4d-4ffc-916d-d191a6dd5e91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:23.290492 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ae83de7-7d4d-4ffc-916d-d191a6dd5e91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 200 len: 1470 microversion: 2.1 time: 0.647409 Mar 05 20:51:23.303262 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 485/912] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:22 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 1470 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:23.324588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-249f779b-f868-4af6-9ceb-1b44f685b652 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:23.326550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-249f779b-f868-4af6-9ceb-1b44f685b652 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:23.347762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-249f779b-f868-4af6-9ceb-1b44f685b652 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:23.348219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-249f779b-f868-4af6-9ceb-1b44f685b652 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:23.359694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-249f779b-f868-4af6-9ceb-1b44f685b652 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:23.361011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-249f779b-f868-4af6-9ceb-1b44f685b652 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:23.893231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-249f779b-f868-4af6-9ceb-1b44f685b652 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:23.901991 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-249f779b-f868-4af6-9ceb-1b44f685b652 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1316 microversion: 2.1 time: 0.597229 Mar 05 20:51:23.911756 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 486/913] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:23 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1316 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:23.916048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-747fd9fb-b3ea-4438-a412-542b9d3867c4 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:23.919581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-747fd9fb-b3ea-4438-a412-542b9d3867c4 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:23.929545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-747fd9fb-b3ea-4438-a412-542b9d3867c4 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:23.930560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-747fd9fb-b3ea-4438-a412-542b9d3867c4 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:23.931975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-747fd9fb-b3ea-4438-a412-542b9d3867c4 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:23.932670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-747fd9fb-b3ea-4438-a412-542b9d3867c4 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:24.210944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-747fd9fb-b3ea-4438-a412-542b9d3867c4 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:24.223758 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-747fd9fb-b3ea-4438-a412-542b9d3867c4 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.319474 Mar 05 20:51:24.225674 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 487/914] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:23 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:24.231290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-a68b45f3-d056-4ea0-9e6c-e973d00e5b77 req-fc778229-e635-4736-b535-1a648b07bdb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c0be5b-cd1f-401d-b51b-9e5332d2365d", "tag": "e2723169-05a6-45c5-8077-430557c9a549"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:24.244514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a68b45f3-d056-4ea0-9e6c-e973d00e5b77 req-fc778229-e635-4736-b535-1a648b07bdb7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:24.247269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a68b45f3-d056-4ea0-9e6c-e973d00e5b77 req-fc778229-e635-4736-b535-1a648b07bdb7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:24.267209 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-a68b45f3-d056-4ea0-9e6c-e973d00e5b77 req-fc778229-e635-4736-b535-1a648b07bdb7 service nova] Creating event network-changed:e2723169-05a6-45c5-8077-430557c9a549 for instance 22c0be5b-cd1f-401d-b51b-9e5332d2365d on nch2-master-1 Mar 05 20:51:24.274371 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-a68b45f3-d056-4ea0-9e6c-e973d00e5b77 req-fc778229-e635-4736-b535-1a648b07bdb7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046340 Mar 05 20:51:24.275130 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 488/915] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:24.285121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bb08ce9a-073a-45e3-b2ed-4411e0efe6a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:24.286262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bb08ce9a-073a-45e3-b2ed-4411e0efe6a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:24.292990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb08ce9a-073a-45e3-b2ed-4411e0efe6a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:24.293775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb08ce9a-073a-45e3-b2ed-4411e0efe6a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:24.294924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb08ce9a-073a-45e3-b2ed-4411e0efe6a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:24.295711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb08ce9a-073a-45e3-b2ed-4411e0efe6a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:25.121533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb08ce9a-073a-45e3-b2ed-4411e0efe6a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:25.133026 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bb08ce9a-073a-45e3-b2ed-4411e0efe6a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1322 microversion: 2.1 time: 0.851768 Mar 05 20:51:25.134673 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 489/916] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:24 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1322 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:25.148784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2a1cc55f-da99-4558-84a8-cfc89bc426a9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:25.148784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2a1cc55f-da99-4558-84a8-cfc89bc426a9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:25.161613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a1cc55f-da99-4558-84a8-cfc89bc426a9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:25.162013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a1cc55f-da99-4558-84a8-cfc89bc426a9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:25.162802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a1cc55f-da99-4558-84a8-cfc89bc426a9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:25.163245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a1cc55f-da99-4558-84a8-cfc89bc426a9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:25.522474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2a1cc55f-da99-4558-84a8-cfc89bc426a9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:25.534619 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2a1cc55f-da99-4558-84a8-cfc89bc426a9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.398727 Mar 05 20:51:25.536031 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 490/917] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:25 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:25.542097 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ff17dcb6-413e-4896-9496-54ad8490fdea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:25.543070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ff17dcb6-413e-4896-9496-54ad8490fdea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 7f1f3af1-178f-48ef-84cf-406044a37585] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:25.551999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff17dcb6-413e-4896-9496-54ad8490fdea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:25.552890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff17dcb6-413e-4896-9496-54ad8490fdea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:25.554099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff17dcb6-413e-4896-9496-54ad8490fdea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:25.556294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff17dcb6-413e-4896-9496-54ad8490fdea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:25.575418 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-ff17dcb6-413e-4896-9496-54ad8490fdea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] HTTP exception thrown: Instance 7f1f3af1-178f-48ef-84cf-406044a37585 could not be found. Mar 05 20:51:25.576592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ff17dcb6-413e-4896-9496-54ad8490fdea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Returning 404 to user: Instance 7f1f3af1-178f-48ef-84cf-406044a37585 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:25.578407 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ff17dcb6-413e-4896-9496-54ad8490fdea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585" status: 404 len: 111 microversion: 2.1 time: 0.040456 Mar 05 20:51:25.579189 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 491/918] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:25 2022] GET /compute/v2.1/servers/7f1f3af1-178f-48ef-84cf-406044a37585 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:25.586167 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-82df87ec-25c2-4158-af4c-857e058f079f req-817729aa-89e4-4ca5-bf59-2cd1c6196d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1f3af1-178f-48ef-84cf-406044a37585", "name": "network-vif-deleted", "tag": "231b7fe1-ac2c-471c-96ed-df1619c4cf5c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:25.598704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-82df87ec-25c2-4158-af4c-857e058f079f req-817729aa-89e4-4ca5-bf59-2cd1c6196d7f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:25.600957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-82df87ec-25c2-4158-af4c-857e058f079f req-817729aa-89e4-4ca5-bf59-2cd1c6196d7f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:25.628562 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-82df87ec-25c2-4158-af4c-857e058f079f req-817729aa-89e4-4ca5-bf59-2cd1c6196d7f service nova] Creating event network-vif-deleted:231b7fe1-ac2c-471c-96ed-df1619c4cf5c for instance 7f1f3af1-178f-48ef-84cf-406044a37585 on nch1-master-1 Mar 05 20:51:25.636395 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-82df87ec-25c2-4158-af4c-857e058f079f req-817729aa-89e4-4ca5-bf59-2cd1c6196d7f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055605 Mar 05 20:51:25.637821 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 492/919] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:25.645137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c069e0a3-838d-4765-90a7-2bf937c69307 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:25.646189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c069e0a3-838d-4765-90a7-2bf937c69307 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:25.656086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c069e0a3-838d-4765-90a7-2bf937c69307 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:25.656855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c069e0a3-838d-4765-90a7-2bf937c69307 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:25.658096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c069e0a3-838d-4765-90a7-2bf937c69307 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:25.658746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c069e0a3-838d-4765-90a7-2bf937c69307 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:25.964298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c069e0a3-838d-4765-90a7-2bf937c69307 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:25.976396 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c069e0a3-838d-4765-90a7-2bf937c69307 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1316 microversion: 2.1 time: 0.336252 Mar 05 20:51:25.976906 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 493/920] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:25 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:25.996496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-92bd9109-e17a-4af9-b095-bee6a867b311 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:25.997005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-92bd9109-e17a-4af9-b095-bee6a867b311 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:26.012492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92bd9109-e17a-4af9-b095-bee6a867b311 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:26.012941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92bd9109-e17a-4af9-b095-bee6a867b311 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:26.014260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92bd9109-e17a-4af9-b095-bee6a867b311 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:26.014689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92bd9109-e17a-4af9-b095-bee6a867b311 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:26.066957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-92bd9109-e17a-4af9-b095-bee6a867b311 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:51:26.203863 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-92bd9109-e17a-4af9-b095-bee6a867b311 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "DELETE /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 204 len: 0 microversion: 2.1 time: 0.214741 Mar 05 20:51:26.208211 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 494/921] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:25 2022] DELETE /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:51:26.222829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-897cfe61-bea1-4e77-a233-86306cf6b0fb tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:26.225354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-897cfe61-bea1-4e77-a233-86306cf6b0fb tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:26.242395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-897cfe61-bea1-4e77-a233-86306cf6b0fb tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:26.242819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-897cfe61-bea1-4e77-a233-86306cf6b0fb tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:26.243938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-897cfe61-bea1-4e77-a233-86306cf6b0fb tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:26.244376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-897cfe61-bea1-4e77-a233-86306cf6b0fb tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:26.497339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-897cfe61-bea1-4e77-a233-86306cf6b0fb tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:26.508285 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-897cfe61-bea1-4e77-a233-86306cf6b0fb tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.298692 Mar 05 20:51:26.509769 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 495/922] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:26 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:26.516680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-def20b07-bbca-4ff3-b3bc-9eef577726b8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:26.517565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-def20b07-bbca-4ff3-b3bc-9eef577726b8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:26.555199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-def20b07-bbca-4ff3-b3bc-9eef577726b8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:26.559479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-def20b07-bbca-4ff3-b3bc-9eef577726b8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:26.561609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-def20b07-bbca-4ff3-b3bc-9eef577726b8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:26.562313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-def20b07-bbca-4ff3-b3bc-9eef577726b8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:26.596439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-def20b07-bbca-4ff3-b3bc-9eef577726b8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:51:26.714083 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-def20b07-bbca-4ff3-b3bc-9eef577726b8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "DELETE /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 204 len: 0 microversion: 2.1 time: 0.202849 Mar 05 20:51:26.715694 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 496/923] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:26 2022] DELETE /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:51:26.722807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c510e524-a685-460c-8577-55735e8d5c91 req-27955960-38ec-4118-bbaf-e90789e105dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0c42a3-81a2-42db-9762-46bd15b2d0ba", "name": "network-vif-plugged", "status": "completed", "tag": "c27fa3bc-53d7-4955-9db1-64fb1ec24675"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:26.731417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c510e524-a685-460c-8577-55735e8d5c91 req-27955960-38ec-4118-bbaf-e90789e105dc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:26.732605 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c510e524-a685-460c-8577-55735e8d5c91 req-27955960-38ec-4118-bbaf-e90789e105dc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:26.746862 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c510e524-a685-460c-8577-55735e8d5c91 req-27955960-38ec-4118-bbaf-e90789e105dc service nova] Creating event network-vif-plugged:c27fa3bc-53d7-4955-9db1-64fb1ec24675 for instance 0c0c42a3-81a2-42db-9762-46bd15b2d0ba on nch1-master-1 Mar 05 20:51:26.754164 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c510e524-a685-460c-8577-55735e8d5c91 req-27955960-38ec-4118-bbaf-e90789e105dc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036254 Mar 05 20:51:26.755171 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 497/924] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:26.760965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-88974dee-86d1-4f1a-ac78-373e9e08102c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:26.762076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-88974dee-86d1-4f1a-ac78-373e9e08102c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:26.770422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88974dee-86d1-4f1a-ac78-373e9e08102c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:26.771292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88974dee-86d1-4f1a-ac78-373e9e08102c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:26.772360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88974dee-86d1-4f1a-ac78-373e9e08102c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:26.772868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88974dee-86d1-4f1a-ac78-373e9e08102c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:27.001877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-88974dee-86d1-4f1a-ac78-373e9e08102c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:27.010658 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-88974dee-86d1-4f1a-ac78-373e9e08102c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1322 microversion: 2.1 time: 0.254064 Mar 05 20:51:27.011907 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 498/925] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:26 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:27.019508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-05dd2b45-b8b1-405f-af0e-52b248b0892e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:27.020221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-05dd2b45-b8b1-405f-af0e-52b248b0892e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:27.027226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05dd2b45-b8b1-405f-af0e-52b248b0892e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:27.027822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05dd2b45-b8b1-405f-af0e-52b248b0892e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:27.028675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05dd2b45-b8b1-405f-af0e-52b248b0892e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:27.029980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05dd2b45-b8b1-405f-af0e-52b248b0892e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:27.154581 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9ab29e23-322e-4467-b235-cb568e60adc1 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 4.542893 Mar 05 20:51:27.155997 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 428/926] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:22 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 4545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:27.169549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82fbc3dc-0910-4b2d-b7ea-f034d48e8044 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:27.172250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-82fbc3dc-0910-4b2d-b7ea-f034d48e8044 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:27.187865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82fbc3dc-0910-4b2d-b7ea-f034d48e8044 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:27.188633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82fbc3dc-0910-4b2d-b7ea-f034d48e8044 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:27.189647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82fbc3dc-0910-4b2d-b7ea-f034d48e8044 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:27.190561 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82fbc3dc-0910-4b2d-b7ea-f034d48e8044 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:27.242250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-05dd2b45-b8b1-405f-af0e-52b248b0892e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:27.272254 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-05dd2b45-b8b1-405f-af0e-52b248b0892e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1711 microversion: 2.1 time: 0.258284 Mar 05 20:51:27.281151 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 499/927] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:27 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1711 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:27.286656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bd97620c-9b0b-4dca-ba9c-b17f344f9fea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:27.287777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bd97620c-9b0b-4dca-ba9c-b17f344f9fea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:27.299261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bd97620c-9b0b-4dca-ba9c-b17f344f9fea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:27.299845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bd97620c-9b0b-4dca-ba9c-b17f344f9fea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:27.301272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bd97620c-9b0b-4dca-ba9c-b17f344f9fea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:27.301792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bd97620c-9b0b-4dca-ba9c-b17f344f9fea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:27.422092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-82fbc3dc-0910-4b2d-b7ea-f034d48e8044 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:27.430313 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-82fbc3dc-0910-4b2d-b7ea-f034d48e8044 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.273049 Mar 05 20:51:27.432266 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 429/928] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:27 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:27.437274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-66d8b151-202b-4f79-a0c6-eea1564778ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:27.438139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-66d8b151-202b-4f79-a0c6-eea1564778ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:27.444546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66d8b151-202b-4f79-a0c6-eea1564778ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:27.445245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66d8b151-202b-4f79-a0c6-eea1564778ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:27.446213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66d8b151-202b-4f79-a0c6-eea1564778ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:27.446844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66d8b151-202b-4f79-a0c6-eea1564778ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:27.537470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bd97620c-9b0b-4dca-ba9c-b17f344f9fea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:27.547768 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bd97620c-9b0b-4dca-ba9c-b17f344f9fea tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1469 microversion: 2.1 time: 0.263772 Mar 05 20:51:27.548687 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 500/929] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:27 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1469 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:27.553740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-74e4763c-9732-4582-ad24-84d1d568d372 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:27.554349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-74e4763c-9732-4582-ad24-84d1d568d372 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:27.561996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74e4763c-9732-4582-ad24-84d1d568d372 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:27.562463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74e4763c-9732-4582-ad24-84d1d568d372 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:27.563234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74e4763c-9732-4582-ad24-84d1d568d372 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:27.563700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74e4763c-9732-4582-ad24-84d1d568d372 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:27.691639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-66d8b151-202b-4f79-a0c6-eea1564778ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:27.703409 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-66d8b151-202b-4f79-a0c6-eea1564778ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1316 microversion: 2.1 time: 0.266286 Mar 05 20:51:27.704336 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 430/930] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:27 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:27.715952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-6a21e7cd-9231-4bd2-8fb7-25e20183ace6 req-c1a64233-06cc-4c56-ba72-02ae724b63bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e8eaaa7-dba6-4929-a216-6d81195cd7ed", "tag": "1b198d0e-92a5-40ee-a02e-74c9206abe04"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:27.752461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6a21e7cd-9231-4bd2-8fb7-25e20183ace6 req-c1a64233-06cc-4c56-ba72-02ae724b63bf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:27.753464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6a21e7cd-9231-4bd2-8fb7-25e20183ace6 req-c1a64233-06cc-4c56-ba72-02ae724b63bf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:27.771529 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-6a21e7cd-9231-4bd2-8fb7-25e20183ace6 req-c1a64233-06cc-4c56-ba72-02ae724b63bf service nova] Creating event network-changed:1b198d0e-92a5-40ee-a02e-74c9206abe04 for instance 5e8eaaa7-dba6-4929-a216-6d81195cd7ed on nch1-master-1 Mar 05 20:51:27.777811 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-6a21e7cd-9231-4bd2-8fb7-25e20183ace6 req-c1a64233-06cc-4c56-ba72-02ae724b63bf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069199 Mar 05 20:51:27.779905 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 431/931] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:27.798453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-74e4763c-9732-4582-ad24-84d1d568d372 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:27.810553 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-74e4763c-9732-4582-ad24-84d1d568d372 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.259681 Mar 05 20:51:27.811548 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 501/932] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:27 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:28.030695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-df609fbc-82a5-4bfe-b39c-e90ad50d953e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:28.031399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-df609fbc-82a5-4bfe-b39c-e90ad50d953e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:28.040106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df609fbc-82a5-4bfe-b39c-e90ad50d953e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:28.040563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df609fbc-82a5-4bfe-b39c-e90ad50d953e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:28.041356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df609fbc-82a5-4bfe-b39c-e90ad50d953e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:28.041795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df609fbc-82a5-4bfe-b39c-e90ad50d953e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:28.167972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0905bbac-49f0-4898-b0c5-6888ec631223 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c62bc10>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:28.215576 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0905bbac-49f0-4898-b0c5-6888ec631223 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.051438 Mar 05 20:51:28.217549 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 502/933] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:28 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:28.292741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-703f682c-c282-448d-bbe4-eb675f7fbabe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:28.293472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-703f682c-c282-448d-bbe4-eb675f7fbabe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:28.303952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-703f682c-c282-448d-bbe4-eb675f7fbabe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:28.304306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-703f682c-c282-448d-bbe4-eb675f7fbabe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:28.305094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-703f682c-c282-448d-bbe4-eb675f7fbabe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:28.305530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-703f682c-c282-448d-bbe4-eb675f7fbabe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:28.390037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-df609fbc-82a5-4bfe-b39c-e90ad50d953e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:28.407270 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-df609fbc-82a5-4bfe-b39c-e90ad50d953e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1322 microversion: 2.1 time: 0.375394 Mar 05 20:51:28.408314 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 432/934] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:28 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:28.449847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-596f5149-76b0-4d13-be8e-245fb6850f81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:28.451429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-596f5149-76b0-4d13-be8e-245fb6850f81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:28.464761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-596f5149-76b0-4d13-be8e-245fb6850f81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:28.467210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-596f5149-76b0-4d13-be8e-245fb6850f81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:28.469175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-596f5149-76b0-4d13-be8e-245fb6850f81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:28.469839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-596f5149-76b0-4d13-be8e-245fb6850f81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:28.838244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-596f5149-76b0-4d13-be8e-245fb6850f81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:28.847383 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-596f5149-76b0-4d13-be8e-245fb6850f81 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.401597 Mar 05 20:51:28.852775 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 433/935] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:28 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:28.864630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e079779e-0cdc-46f2-93c7-a408e117ead2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:28.865733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e079779e-0cdc-46f2-93c7-a408e117ead2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:28.881595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e079779e-0cdc-46f2-93c7-a408e117ead2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:28.882148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e079779e-0cdc-46f2-93c7-a408e117ead2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:28.883022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e079779e-0cdc-46f2-93c7-a408e117ead2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:28.883577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e079779e-0cdc-46f2-93c7-a408e117ead2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:28.996439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-703f682c-c282-448d-bbe4-eb675f7fbabe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:29.033693 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-703f682c-c282-448d-bbe4-eb675f7fbabe tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1711 microversion: 2.1 time: 0.745733 Mar 05 20:51:29.039471 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 503/936] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:28 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1711 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:29.049631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9e746cf1-15ec-403e-af31-938f21acf929 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:29.051200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9e746cf1-15ec-403e-af31-938f21acf929 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:29.063119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e746cf1-15ec-403e-af31-938f21acf929 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:29.064198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e746cf1-15ec-403e-af31-938f21acf929 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:29.065451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e746cf1-15ec-403e-af31-938f21acf929 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:29.066184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e746cf1-15ec-403e-af31-938f21acf929 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:29.293481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e079779e-0cdc-46f2-93c7-a408e117ead2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:29.304810 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e079779e-0cdc-46f2-93c7-a408e117ead2 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1469 microversion: 2.1 time: 0.443876 Mar 05 20:51:29.305427 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 434/937] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:28 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1469 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:29.320762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d5a34e7e-d0c4-46b5-b611-2f3542e5315d req-31db2f0f-1032-40e0-974f-285b476f0d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54f039d-1623-4ad6-a4e3-308472493214", "name": "network-vif-plugged", "status": "completed", "tag": "6c25b98e-729b-490d-bb31-a40e13f1d945"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:29.330139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d5a34e7e-d0c4-46b5-b611-2f3542e5315d req-31db2f0f-1032-40e0-974f-285b476f0d07 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:29.330830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d5a34e7e-d0c4-46b5-b611-2f3542e5315d req-31db2f0f-1032-40e0-974f-285b476f0d07 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:29.343787 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d5a34e7e-d0c4-46b5-b611-2f3542e5315d req-31db2f0f-1032-40e0-974f-285b476f0d07 service nova] Creating event network-vif-plugged:6c25b98e-729b-490d-bb31-a40e13f1d945 for instance d54f039d-1623-4ad6-a4e3-308472493214 on nch2-master-1 Mar 05 20:51:29.350616 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d5a34e7e-d0c4-46b5-b611-2f3542e5315d req-31db2f0f-1032-40e0-974f-285b476f0d07 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033321 Mar 05 20:51:29.351513 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 435/938] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:29.359702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-db7c68f8-3d6f-4145-8e6c-d54e45a3dbbf tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:29.360640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-db7c68f8-3d6f-4145-8e6c-d54e45a3dbbf tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:29.367641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db7c68f8-3d6f-4145-8e6c-d54e45a3dbbf tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:29.368382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db7c68f8-3d6f-4145-8e6c-d54e45a3dbbf tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:29.369851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db7c68f8-3d6f-4145-8e6c-d54e45a3dbbf tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:29.370878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db7c68f8-3d6f-4145-8e6c-d54e45a3dbbf tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:29.415606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9e746cf1-15ec-403e-af31-938f21acf929 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:29.427804 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9e746cf1-15ec-403e-af31-938f21acf929 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1316 microversion: 2.1 time: 0.386894 Mar 05 20:51:29.429533 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 504/939] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:29 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:29.456705 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0d43c041-097e-4c0a-983c-c398626145d5 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c729430>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:29.518474 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0d43c041-097e-4c0a-983c-c398626145d5 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.087854 Mar 05 20:51:29.528163 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 505/940] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:29 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:29.534315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e1bcc7c5-af69-44ed-a956-51b4d7a82001 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:29.549816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e1bcc7c5-af69-44ed-a956-51b4d7a82001 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:29.558703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1bcc7c5-af69-44ed-a956-51b4d7a82001 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:29.559155 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1bcc7c5-af69-44ed-a956-51b4d7a82001 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:29.560084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1bcc7c5-af69-44ed-a956-51b4d7a82001 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:29.560797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1bcc7c5-af69-44ed-a956-51b4d7a82001 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:29.765935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-db7c68f8-3d6f-4145-8e6c-d54e45a3dbbf tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:29.781823 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-db7c68f8-3d6f-4145-8e6c-d54e45a3dbbf tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.425162 Mar 05 20:51:29.794118 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 436/941] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:29 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:29.824571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-1630b508-fe00-49c7-9008-5801db0a4d63 req-aa0fd60f-78e7-41d5-85cf-f559bc5d56c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c1af88-614e-45b4-a82b-5e8b1eb60180", "name": "network-vif-deleted", "tag": "a3db8299-9220-413a-b709-391f3fa944d7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:29.838842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1630b508-fe00-49c7-9008-5801db0a4d63 req-aa0fd60f-78e7-41d5-85cf-f559bc5d56c4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:29.839534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1630b508-fe00-49c7-9008-5801db0a4d63 req-aa0fd60f-78e7-41d5-85cf-f559bc5d56c4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:29.872423 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-1630b508-fe00-49c7-9008-5801db0a4d63 req-aa0fd60f-78e7-41d5-85cf-f559bc5d56c4 service nova] Creating event network-vif-deleted:a3db8299-9220-413a-b709-391f3fa944d7 for instance 42c1af88-614e-45b4-a82b-5e8b1eb60180 on nch1-master-1 Mar 05 20:51:29.901611 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-1630b508-fe00-49c7-9008-5801db0a4d63 req-aa0fd60f-78e7-41d5-85cf-f559bc5d56c4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071981 Mar 05 20:51:29.917230 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 437/942] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:29.923392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0e0f2dfa-f1f5-43eb-99da-a2503f9be5f4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:29.945442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0e0f2dfa-f1f5-43eb-99da-a2503f9be5f4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:29.950315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e1bcc7c5-af69-44ed-a956-51b4d7a82001 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:29.959402 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e1bcc7c5-af69-44ed-a956-51b4d7a82001 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1508 microversion: 2.1 time: 0.429297 Mar 05 20:51:29.962857 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 506/943] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:29 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1508 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:29.964890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e0f2dfa-f1f5-43eb-99da-a2503f9be5f4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:29.969871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e0f2dfa-f1f5-43eb-99da-a2503f9be5f4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:29.975766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e0f2dfa-f1f5-43eb-99da-a2503f9be5f4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:29.979075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e0f2dfa-f1f5-43eb-99da-a2503f9be5f4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:30.057145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-94973c7a-1103-4ed3-935c-15ec0c02219d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:30.057781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-94973c7a-1103-4ed3-935c-15ec0c02219d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:30.071277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94973c7a-1103-4ed3-935c-15ec0c02219d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:30.071807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94973c7a-1103-4ed3-935c-15ec0c02219d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:30.073029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94973c7a-1103-4ed3-935c-15ec0c02219d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:30.073640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94973c7a-1103-4ed3-935c-15ec0c02219d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:30.364965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-94973c7a-1103-4ed3-935c-15ec0c02219d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839c64fcb5d249ffac671c90d252e1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2d8f510f49999fc3094858af40d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:30.379368 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-94973c7a-1103-4ed3-935c-15ec0c02219d tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 200 len: 1643 microversion: 2.1 time: 0.326064 Mar 05 20:51:30.384719 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 507/944] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:30 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 1643 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:30.395379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6de3434d-a05b-44e6-b23c-f15b7d4bbc8d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:30.405616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6de3434d-a05b-44e6-b23c-f15b7d4bbc8d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:30.429924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6de3434d-a05b-44e6-b23c-f15b7d4bbc8d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:30.430596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6de3434d-a05b-44e6-b23c-f15b7d4bbc8d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:30.431179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6de3434d-a05b-44e6-b23c-f15b7d4bbc8d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:30.446965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6de3434d-a05b-44e6-b23c-f15b7d4bbc8d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:30.504131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0e0f2dfa-f1f5-43eb-99da-a2503f9be5f4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:30.516238 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0e0f2dfa-f1f5-43eb-99da-a2503f9be5f4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.593587 Mar 05 20:51:30.532737 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 438/945] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:29 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:30.546447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fcb20aae-a1d2-4e73-96e9-8e7e7d8120c0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:30.552059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fcb20aae-a1d2-4e73-96e9-8e7e7d8120c0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:30.573381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fcb20aae-a1d2-4e73-96e9-8e7e7d8120c0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:30.574100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fcb20aae-a1d2-4e73-96e9-8e7e7d8120c0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:30.582969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fcb20aae-a1d2-4e73-96e9-8e7e7d8120c0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:30.583760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fcb20aae-a1d2-4e73-96e9-8e7e7d8120c0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:30.595916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6de3434d-a05b-44e6-b23c-f15b7d4bbc8d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:30.602829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6de3434d-a05b-44e6-b23c-f15b7d4bbc8d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:30.606341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-6de3434d-a05b-44e6-b23c-f15b7d4bbc8d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lazy-loading 'fault' on Instance uuid 42c1af88-614e-45b4-a82b-5e8b1eb60180 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:51:30.753435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6de3434d-a05b-44e6-b23c-f15b7d4bbc8d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:30.760205 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6de3434d-a05b-44e6-b23c-f15b7d4bbc8d tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 200 len: 1303 microversion: 2.1 time: 0.374020 Mar 05 20:51:30.764854 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 508/946] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:30 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 1303 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:30.784648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0d86097-2f4c-43f2-91e1-c80bb28b010b tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c770ee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:30.922072 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0d86097-2f4c-43f2-91e1-c80bb28b010b tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.149097 Mar 05 20:51:30.929569 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 509/947] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:30 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:30.938152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-762cbd94-17d7-4bdf-b11d-9a04db6beb50 req-11d6bcbf-5142-471a-a22e-7e80538ae280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "499e4dcb-b39f-43e3-9cfc-27d4661dfb97", "name": "network-vif-deleted", "tag": "a9d235c2-9ace-436f-8a2f-896e912f51bf"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:30.960109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-762cbd94-17d7-4bdf-b11d-9a04db6beb50 req-11d6bcbf-5142-471a-a22e-7e80538ae280 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:30.960836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-762cbd94-17d7-4bdf-b11d-9a04db6beb50 req-11d6bcbf-5142-471a-a22e-7e80538ae280 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:30.980380 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-762cbd94-17d7-4bdf-b11d-9a04db6beb50 req-11d6bcbf-5142-471a-a22e-7e80538ae280 service nova] Creating event network-vif-deleted:a9d235c2-9ace-436f-8a2f-896e912f51bf for instance 499e4dcb-b39f-43e3-9cfc-27d4661dfb97 on nch2-master-1 Mar 05 20:51:30.994947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fcb20aae-a1d2-4e73-96e9-8e7e7d8120c0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:31.002429 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-762cbd94-17d7-4bdf-b11d-9a04db6beb50 req-11d6bcbf-5142-471a-a22e-7e80538ae280 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071476 Mar 05 20:51:31.003532 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 510/948] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:31.009516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-81b003be-5496-488f-b07e-b18a27874ba8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:31.010823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-81b003be-5496-488f-b07e-b18a27874ba8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:31.020302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-81b003be-5496-488f-b07e-b18a27874ba8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.020994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-81b003be-5496-488f-b07e-b18a27874ba8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.021744 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fcb20aae-a1d2-4e73-96e9-8e7e7d8120c0 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1316 microversion: 2.1 time: 0.487809 Mar 05 20:51:31.022143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-81b003be-5496-488f-b07e-b18a27874ba8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.022722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-81b003be-5496-488f-b07e-b18a27874ba8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.035825 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 439/949] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:30 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:31.311115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-81b003be-5496-488f-b07e-b18a27874ba8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:31.326923 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-81b003be-5496-488f-b07e-b18a27874ba8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.320649 Mar 05 20:51:31.341174 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 511/950] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:31 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:31.402638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c80a9011-8770-4c92-9dd5-7a3e980b1c7e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:31.403325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c80a9011-8770-4c92-9dd5-7a3e980b1c7e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:31.415283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c80a9011-8770-4c92-9dd5-7a3e980b1c7e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.415770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c80a9011-8770-4c92-9dd5-7a3e980b1c7e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.416570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c80a9011-8770-4c92-9dd5-7a3e980b1c7e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.417067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c80a9011-8770-4c92-9dd5-7a3e980b1c7e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.448238 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-c80a9011-8770-4c92-9dd5-7a3e980b1c7e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] HTTP exception thrown: Instance 499e4dcb-b39f-43e3-9cfc-27d4661dfb97 could not be found. Mar 05 20:51:31.449159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c80a9011-8770-4c92-9dd5-7a3e980b1c7e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Returning 404 to user: Instance 499e4dcb-b39f-43e3-9cfc-27d4661dfb97 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:31.450309 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c80a9011-8770-4c92-9dd5-7a3e980b1c7e tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 404 len: 111 microversion: 2.1 time: 0.052034 Mar 05 20:51:31.451890 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 440/951] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:31 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:31.461232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-afea66f6-b871-4ea2-9275-09bdeecd3325 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:31.462783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-afea66f6-b871-4ea2-9275-09bdeecd3325 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:31.470213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afea66f6-b871-4ea2-9275-09bdeecd3325 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.471234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afea66f6-b871-4ea2-9275-09bdeecd3325 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.472678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afea66f6-b871-4ea2-9275-09bdeecd3325 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.473624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afea66f6-b871-4ea2-9275-09bdeecd3325 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.494199 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-afea66f6-b871-4ea2-9275-09bdeecd3325 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] HTTP exception thrown: Instance 80d89c14-aebf-4565-9719-229a9abd3ebd could not be found. Mar 05 20:51:31.495715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-afea66f6-b871-4ea2-9275-09bdeecd3325 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Returning 404 to user: Instance 80d89c14-aebf-4565-9719-229a9abd3ebd could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:31.497016 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-afea66f6-b871-4ea2-9275-09bdeecd3325 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "DELETE /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 404 len: 111 microversion: 2.1 time: 0.041236 Mar 05 20:51:31.498811 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 512/952] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:31 2022] DELETE /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:31.508163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-015ca292-db18-488a-bc57-5063e7cf4414 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:31.508780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-015ca292-db18-488a-bc57-5063e7cf4414 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:31.515517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-015ca292-db18-488a-bc57-5063e7cf4414 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.516190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-015ca292-db18-488a-bc57-5063e7cf4414 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.517132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-015ca292-db18-488a-bc57-5063e7cf4414 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.517728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-015ca292-db18-488a-bc57-5063e7cf4414 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.549772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-540a0205-bfc3-408c-8a42-2c8ee02810ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:31.552117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-540a0205-bfc3-408c-8a42-2c8ee02810ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:31.562450 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-540a0205-bfc3-408c-8a42-2c8ee02810ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.563886 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-015ca292-db18-488a-bc57-5063e7cf4414 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] HTTP exception thrown: Instance 80d89c14-aebf-4565-9719-229a9abd3ebd could not be found. Mar 05 20:51:31.566056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-540a0205-bfc3-408c-8a42-2c8ee02810ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.566368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-015ca292-db18-488a-bc57-5063e7cf4414 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Returning 404 to user: Instance 80d89c14-aebf-4565-9719-229a9abd3ebd could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:31.567529 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-015ca292-db18-488a-bc57-5063e7cf4414 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 404 len: 111 microversion: 2.1 time: 0.064768 Mar 05 20:51:31.568649 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 441/953] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:31 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:31.569595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-540a0205-bfc3-408c-8a42-2c8ee02810ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.570065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-540a0205-bfc3-408c-8a42-2c8ee02810ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.579232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4036d813-4af2-4522-bf2e-b5b3e263e532 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '.version_select at 0x7fed5d070820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:31.607079 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4036d813-4af2-4522-bf2e-b5b3e263e532 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-234183081" status: 202 len: 0 microversion: 2.1 time: 0.034120 Mar 05 20:51:31.610519 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 442/954] 10.222.0.15 () {58 vars in 1217 bytes} [Sat Mar 5 20:51:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-234183081 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 20:51:31.783076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b9c58492-5698-4121-9f50-072dd281dd91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:31.783945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b9c58492-5698-4121-9f50-072dd281dd91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: 42c1af88-614e-45b4-a82b-5e8b1eb60180] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:31.806701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b9c58492-5698-4121-9f50-072dd281dd91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.807163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b9c58492-5698-4121-9f50-072dd281dd91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.819064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b9c58492-5698-4121-9f50-072dd281dd91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.819816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b9c58492-5698-4121-9f50-072dd281dd91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.858361 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-b9c58492-5698-4121-9f50-072dd281dd91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] HTTP exception thrown: Instance 42c1af88-614e-45b4-a82b-5e8b1eb60180 could not be found. Mar 05 20:51:31.859214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b9c58492-5698-4121-9f50-072dd281dd91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Returning 404 to user: Instance 42c1af88-614e-45b4-a82b-5e8b1eb60180 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:31.860270 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b9c58492-5698-4121-9f50-072dd281dd91 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180" status: 404 len: 111 microversion: 2.1 time: 0.082803 Mar 05 20:51:31.861304 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 443/955] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:31 2022] GET /compute/v2.1/servers/42c1af88-614e-45b4-a82b-5e8b1eb60180 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:51:31.870300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c43509f0-5d36-47de-bdb8-0f24e475d445 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:31.871399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c43509f0-5d36-47de-bdb8-0f24e475d445 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:31.882335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c43509f0-5d36-47de-bdb8-0f24e475d445 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.885764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c43509f0-5d36-47de-bdb8-0f24e475d445 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.886888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c43509f0-5d36-47de-bdb8-0f24e475d445 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:31.890022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c43509f0-5d36-47de-bdb8-0f24e475d445 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:31.940609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c43509f0-5d36-47de-bdb8-0f24e475d445 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:51:32.074588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-540a0205-bfc3-408c-8a42-2c8ee02810ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:32.094949 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-540a0205-bfc3-408c-8a42-2c8ee02810ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.551727 Mar 05 20:51:32.095636 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 513/956] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:31 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:32.128606 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c43509f0-5d36-47de-bdb8-0f24e475d445 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 204 len: 0 microversion: 2.1 time: 0.263103 Mar 05 20:51:32.129183 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-17643bb6-ed8b-4316-83ff-3345cdaf3067 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c8f95e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:32.130223 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 444/957] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:31 2022] DELETE /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 20:51:32.135705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-425073fb-049e-44d4-a7cb-7166997d1294 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:32.136436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-425073fb-049e-44d4-a7cb-7166997d1294 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:32.149729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-425073fb-049e-44d4-a7cb-7166997d1294 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:32.150175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-425073fb-049e-44d4-a7cb-7166997d1294 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:32.150967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-425073fb-049e-44d4-a7cb-7166997d1294 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:32.151408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-425073fb-049e-44d4-a7cb-7166997d1294 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:32.215132 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-17643bb6-ed8b-4316-83ff-3345cdaf3067 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.113703 Mar 05 20:51:32.216110 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 514/958] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:32 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:32.224197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-98a1ed23-3904-44a1-a960-cc21b41f837e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c57b554-8684-4f09-a946-2caa95d79937"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:32.226058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-98a1ed23-3904-44a1-a960-cc21b41f837e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:32.234590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-98a1ed23-3904-44a1-a960-cc21b41f837e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:32.235591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-98a1ed23-3904-44a1-a960-cc21b41f837e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:32.236794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-98a1ed23-3904-44a1-a960-cc21b41f837e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:32.237491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-98a1ed23-3904-44a1-a960-cc21b41f837e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:32.674876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-425073fb-049e-44d4-a7cb-7166997d1294 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:32.688369 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-425073fb-049e-44d4-a7cb-7166997d1294 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1316 microversion: 2.1 time: 0.555722 Mar 05 20:51:32.689006 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 445/959] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:32 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:32.701562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b619eff6-8ba0-49e6-8f40-f9effcbf80a9 req-5c815c44-0d7b-4dd6-80f7-1f1c99b61ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c0be5b-cd1f-401d-b51b-9e5332d2365d", "name": "network-vif-plugged", "status": "completed", "tag": "e2723169-05a6-45c5-8077-430557c9a549"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:32.742797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b619eff6-8ba0-49e6-8f40-f9effcbf80a9 req-5c815c44-0d7b-4dd6-80f7-1f1c99b61ed6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:32.743257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b619eff6-8ba0-49e6-8f40-f9effcbf80a9 req-5c815c44-0d7b-4dd6-80f7-1f1c99b61ed6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:32.775293 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-b619eff6-8ba0-49e6-8f40-f9effcbf80a9 req-5c815c44-0d7b-4dd6-80f7-1f1c99b61ed6 service nova] Creating event network-vif-plugged:e2723169-05a6-45c5-8077-430557c9a549 for instance 22c0be5b-cd1f-401d-b51b-9e5332d2365d on nch2-master-1 Mar 05 20:51:32.783884 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b619eff6-8ba0-49e6-8f40-f9effcbf80a9 req-5c815c44-0d7b-4dd6-80f7-1f1c99b61ed6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092369 Mar 05 20:51:32.785198 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 446/960] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:32.793440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0da217fd-70cf-444c-93e7-4dbaa7d0ecf8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:32.806914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0da217fd-70cf-444c-93e7-4dbaa7d0ecf8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:32.816869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0da217fd-70cf-444c-93e7-4dbaa7d0ecf8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:32.819026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0da217fd-70cf-444c-93e7-4dbaa7d0ecf8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:32.820368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0da217fd-70cf-444c-93e7-4dbaa7d0ecf8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:32.821443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0da217fd-70cf-444c-93e7-4dbaa7d0ecf8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:32.844755 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-98a1ed23-3904-44a1-a960-cc21b41f837e tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "POST /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.624825 Mar 05 20:51:32.845564 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 515/961] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 20:51:32 2022] POST /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba/os-volume_attachments => generated 194 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:32.863599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e40487c9-96d0-4374-a759-0187e525b838 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:32.866512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e40487c9-96d0-4374-a759-0187e525b838 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:32.882233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e40487c9-96d0-4374-a759-0187e525b838 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:32.883885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e40487c9-96d0-4374-a759-0187e525b838 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:32.886104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e40487c9-96d0-4374-a759-0187e525b838 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:32.891118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e40487c9-96d0-4374-a759-0187e525b838 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:33.203650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e40487c9-96d0-4374-a759-0187e525b838 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:33.211709 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e40487c9-96d0-4374-a759-0187e525b838 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.362316 Mar 05 20:51:33.221119 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 516/962] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:32 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:33.228266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c156c4d5-fa61-4b48-b314-6c19a8b147ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:33.229294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c156c4d5-fa61-4b48-b314-6c19a8b147ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:33.236754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c156c4d5-fa61-4b48-b314-6c19a8b147ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:33.237353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c156c4d5-fa61-4b48-b314-6c19a8b147ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:33.238201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c156c4d5-fa61-4b48-b314-6c19a8b147ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:33.238645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c156c4d5-fa61-4b48-b314-6c19a8b147ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:33.296801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0da217fd-70cf-444c-93e7-4dbaa7d0ecf8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:33.306544 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0da217fd-70cf-444c-93e7-4dbaa7d0ecf8 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1469 microversion: 2.1 time: 0.519942 Mar 05 20:51:33.310505 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 447/963] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:32 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1469 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:33.316510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41e15f8d-724b-4064-9f7e-2cc2bc6b6ee4 tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:33.317832 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:51:33.317832 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:51:33.348194 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-41e15f8d-724b-4064-9f7e-2cc2bc6b6ee4 tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/17424052" status: 202 len: 0 microversion: 2.1 time: 0.035346 Mar 05 20:51:33.349435 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 448/964] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:51:33 2022] DELETE /compute/v2.1/flavors/17424052 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:51:33.356329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-568b9f63-bbe8-4e08-88be-424150fdd392 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c99df70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:33.426475 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-568b9f63-bbe8-4e08-88be-424150fdd392 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.075096 Mar 05 20:51:33.432633 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 449/965] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:33 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:33.443936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d29443c2-0105-4e89-8132-74eb10bfe4cf tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:33.490540 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d29443c2-0105-4e89-8132-74eb10bfe4cf tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.056844 Mar 05 20:51:33.500921 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 450/966] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:51:33 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:33.501106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c156c4d5-fa61-4b48-b314-6c19a8b147ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:33.502027 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c156c4d5-fa61-4b48-b314-6c19a8b147ca tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.278652 Mar 05 20:51:33.502945 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 517/967] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:33 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:33.508126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9619cafd-56b8-4c54-be04-4b1b005b7d73 tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:33.539041 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9619cafd-56b8-4c54-be04-4b1b005b7d73 tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/1413646340" status: 202 len: 0 microversion: 2.1 time: 0.036088 Mar 05 20:51:33.544778 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 451/968] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 20:51:33 2022] DELETE /compute/v2.1/flavors/1413646340 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:51:33.554117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8bce9be0-d7ff-4a31-b724-97f192536f1d tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:33.599734 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8bce9be0-d7ff-4a31-b724-97f192536f1d tempest-ServersWithSpecificFlavorTestJSON-1493484358 tempest-ServersWithSpecificFlavorTestJSON-1493484358-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051109 Mar 05 20:51:33.601314 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 518/969] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:51:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:33.630465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-70bc1a3f-bd3e-4cee-bdcd-28c3ed6ade56 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:33.631230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-70bc1a3f-bd3e-4cee-bdcd-28c3ed6ade56 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:33.643756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70bc1a3f-bd3e-4cee-bdcd-28c3ed6ade56 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:33.644498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70bc1a3f-bd3e-4cee-bdcd-28c3ed6ade56 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:33.646914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70bc1a3f-bd3e-4cee-bdcd-28c3ed6ade56 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:33.649893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70bc1a3f-bd3e-4cee-bdcd-28c3ed6ade56 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:33.668455 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-70bc1a3f-bd3e-4cee-bdcd-28c3ed6ade56 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] HTTP exception thrown: Instance 499e4dcb-b39f-43e3-9cfc-27d4661dfb97 could not be found. Mar 05 20:51:33.670663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-70bc1a3f-bd3e-4cee-bdcd-28c3ed6ade56 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Returning 404 to user: Instance 499e4dcb-b39f-43e3-9cfc-27d4661dfb97 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:33.671513 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-70bc1a3f-bd3e-4cee-bdcd-28c3ed6ade56 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "DELETE /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 404 len: 111 microversion: 2.1 time: 0.048801 Mar 05 20:51:33.676288 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 452/970] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:33 2022] DELETE /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:51:33.690276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dc53458b-f7b7-43e5-a28b-6252713a709a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:33.694371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dc53458b-f7b7-43e5-a28b-6252713a709a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 499e4dcb-b39f-43e3-9cfc-27d4661dfb97] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:33.707074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc53458b-f7b7-43e5-a28b-6252713a709a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:33.708659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc53458b-f7b7-43e5-a28b-6252713a709a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:33.709432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-71b72b44-7dee-43c6-bb26-c9d6e477d0e9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:33.709894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc53458b-f7b7-43e5-a28b-6252713a709a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:33.710050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-71b72b44-7dee-43c6-bb26-c9d6e477d0e9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:33.710631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc53458b-f7b7-43e5-a28b-6252713a709a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:33.727633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71b72b44-7dee-43c6-bb26-c9d6e477d0e9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:33.728690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71b72b44-7dee-43c6-bb26-c9d6e477d0e9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:33.729493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71b72b44-7dee-43c6-bb26-c9d6e477d0e9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:33.732741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71b72b44-7dee-43c6-bb26-c9d6e477d0e9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:33.755637 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-dc53458b-f7b7-43e5-a28b-6252713a709a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] HTTP exception thrown: Instance 499e4dcb-b39f-43e3-9cfc-27d4661dfb97 could not be found. Mar 05 20:51:33.757093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dc53458b-f7b7-43e5-a28b-6252713a709a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Returning 404 to user: Instance 499e4dcb-b39f-43e3-9cfc-27d4661dfb97 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:33.758221 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dc53458b-f7b7-43e5-a28b-6252713a709a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97" status: 404 len: 111 microversion: 2.1 time: 0.082018 Mar 05 20:51:33.759040 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 519/971] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:33 2022] GET /compute/v2.1/servers/499e4dcb-b39f-43e3-9cfc-27d4661dfb97 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:51:33.809343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d4207169-f0fb-42c0-bbeb-83976d0455f8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:33.812237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d4207169-f0fb-42c0-bbeb-83976d0455f8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:33.835850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4207169-f0fb-42c0-bbeb-83976d0455f8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:33.853995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4207169-f0fb-42c0-bbeb-83976d0455f8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:33.865301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4207169-f0fb-42c0-bbeb-83976d0455f8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:33.873087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4207169-f0fb-42c0-bbeb-83976d0455f8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:33.941017 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-d4207169-f0fb-42c0-bbeb-83976d0455f8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] HTTP exception thrown: Instance 80d89c14-aebf-4565-9719-229a9abd3ebd could not be found. Mar 05 20:51:33.948326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d4207169-f0fb-42c0-bbeb-83976d0455f8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Returning 404 to user: Instance 80d89c14-aebf-4565-9719-229a9abd3ebd could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:33.955510 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d4207169-f0fb-42c0-bbeb-83976d0455f8 tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "DELETE /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 404 len: 111 microversion: 2.1 time: 0.192189 Mar 05 20:51:33.960773 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 520/972] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:33 2022] DELETE /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:33.969711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9765081f-a8ad-4b4e-af58-3176541c5a8a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:33.970812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9765081f-a8ad-4b4e-af58-3176541c5a8a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] [instance: 80d89c14-aebf-4565-9719-229a9abd3ebd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:33.977144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9765081f-a8ad-4b4e-af58-3176541c5a8a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:33.977542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9765081f-a8ad-4b4e-af58-3176541c5a8a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:33.978332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9765081f-a8ad-4b4e-af58-3176541c5a8a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:33.979776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9765081f-a8ad-4b4e-af58-3176541c5a8a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:34.002784 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-9765081f-a8ad-4b4e-af58-3176541c5a8a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] HTTP exception thrown: Instance 80d89c14-aebf-4565-9719-229a9abd3ebd could not be found. Mar 05 20:51:34.003517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9765081f-a8ad-4b4e-af58-3176541c5a8a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] Returning 404 to user: Instance 80d89c14-aebf-4565-9719-229a9abd3ebd could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:34.006419 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9765081f-a8ad-4b4e-af58-3176541c5a8a tempest-ServersWithSpecificFlavorTestJSON-1160142816 tempest-ServersWithSpecificFlavorTestJSON-1160142816-project] 10.222.0.15 "GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd" status: 404 len: 111 microversion: 2.1 time: 0.041580 Mar 05 20:51:34.007371 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 521/973] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:33 2022] GET /compute/v2.1/servers/80d89c14-aebf-4565-9719-229a9abd3ebd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:51:34.230142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-38f2bc8b-b4da-4880-839f-03956182c3d8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:34.230765 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-38f2bc8b-b4da-4880-839f-03956182c3d8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:34.250334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-38f2bc8b-b4da-4880-839f-03956182c3d8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:34.253246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-38f2bc8b-b4da-4880-839f-03956182c3d8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:34.254275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-38f2bc8b-b4da-4880-839f-03956182c3d8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:34.256935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-38f2bc8b-b4da-4880-839f-03956182c3d8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:34.310668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-71b72b44-7dee-43c6-bb26-c9d6e477d0e9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:34.322564 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-71b72b44-7dee-43c6-bb26-c9d6e477d0e9 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1316 microversion: 2.1 time: 0.617277 Mar 05 20:51:34.323169 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 453/974] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:33 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1316 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:34.353744 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74480796-498a-49b5-8399-9933e6d9000b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:34.354481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-74480796-498a-49b5-8399-9933e6d9000b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:34.365433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74480796-498a-49b5-8399-9933e6d9000b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:34.365889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74480796-498a-49b5-8399-9933e6d9000b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:34.366687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74480796-498a-49b5-8399-9933e6d9000b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:34.367133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74480796-498a-49b5-8399-9933e6d9000b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:34.881362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-74480796-498a-49b5-8399-9933e6d9000b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:34.889987 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-74480796-498a-49b5-8399-9933e6d9000b tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1469 microversion: 2.1 time: 0.552277 Mar 05 20:51:34.894410 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 454/975] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:34 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1469 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:34.912744 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bbee0e7c-d782-4364-8ed2-17bdc4543408 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5cde24c0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:34.918576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-38f2bc8b-b4da-4880-839f-03956182c3d8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:34.931230 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-38f2bc8b-b4da-4880-839f-03956182c3d8 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.706730 Mar 05 20:51:34.935942 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 522/976] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:34 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1318 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:34.946431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f73462ce-9369-4957-a261-d3073f33ae61 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:34.949463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f73462ce-9369-4957-a261-d3073f33ae61 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:34.964902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f73462ce-9369-4957-a261-d3073f33ae61 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:34.968297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f73462ce-9369-4957-a261-d3073f33ae61 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:34.969901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f73462ce-9369-4957-a261-d3073f33ae61 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:34.971037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f73462ce-9369-4957-a261-d3073f33ae61 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:34.976425 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bbee0e7c-d782-4364-8ed2-17bdc4543408 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.080765 Mar 05 20:51:34.978867 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 455/977] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:34 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:34.993285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-1bf14df6-82ff-4e06-9614-54fa618e3816 req-05d695c4-44ca-4f25-bad3-f8c586febaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e8eaaa7-dba6-4929-a216-6d81195cd7ed", "name": "network-vif-plugged", "status": "completed", "tag": "1b198d0e-92a5-40ee-a02e-74c9206abe04"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:35.028000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1bf14df6-82ff-4e06-9614-54fa618e3816 req-05d695c4-44ca-4f25-bad3-f8c586febaa0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:35.029103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1bf14df6-82ff-4e06-9614-54fa618e3816 req-05d695c4-44ca-4f25-bad3-f8c586febaa0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:35.073236 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-1bf14df6-82ff-4e06-9614-54fa618e3816 req-05d695c4-44ca-4f25-bad3-f8c586febaa0 service nova] Creating event network-vif-plugged:1b198d0e-92a5-40ee-a02e-74c9206abe04 for instance 5e8eaaa7-dba6-4929-a216-6d81195cd7ed on nch1-master-1 Mar 05 20:51:35.079445 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-1bf14df6-82ff-4e06-9614-54fa618e3816 req-05d695c4-44ca-4f25-bad3-f8c586febaa0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099199 Mar 05 20:51:35.080341 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 456/978] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:35.340669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4d3763bc-ede8-4ca5-b4c8-fcfb68a4b585 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:35.341619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4d3763bc-ede8-4ca5-b4c8-fcfb68a4b585 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:35.357681 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d3763bc-ede8-4ca5-b4c8-fcfb68a4b585 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:35.358257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d3763bc-ede8-4ca5-b4c8-fcfb68a4b585 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:35.362021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d3763bc-ede8-4ca5-b4c8-fcfb68a4b585 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:35.372710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d3763bc-ede8-4ca5-b4c8-fcfb68a4b585 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:35.443052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f73462ce-9369-4957-a261-d3073f33ae61 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:35.456697 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f73462ce-9369-4957-a261-d3073f33ae61 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.519400 Mar 05 20:51:35.459657 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 523/979] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:34 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:35.474062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9286fbdb-e195-44d7-bb6d-c9189af58862 req-79932170-bd41-4ef4-ab0f-8163cff64a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d196df64-5f99-4c5a-b30b-92751e6f7702", "name": "network-vif-deleted", "tag": "cd12eb23-3086-4db9-babd-0ffb56ce7a27"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:35.502974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9286fbdb-e195-44d7-bb6d-c9189af58862 req-79932170-bd41-4ef4-ab0f-8163cff64a7f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:35.512473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9286fbdb-e195-44d7-bb6d-c9189af58862 req-79932170-bd41-4ef4-ab0f-8163cff64a7f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:35.554889 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9286fbdb-e195-44d7-bb6d-c9189af58862 req-79932170-bd41-4ef4-ab0f-8163cff64a7f service nova] Creating event network-vif-deleted:cd12eb23-3086-4db9-babd-0ffb56ce7a27 for instance d196df64-5f99-4c5a-b30b-92751e6f7702 on nch1-master-1 Mar 05 20:51:35.585526 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9286fbdb-e195-44d7-bb6d-c9189af58862 req-79932170-bd41-4ef4-ab0f-8163cff64a7f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123150 Mar 05 20:51:35.586147 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 524/980] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:35.750216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4d3763bc-ede8-4ca5-b4c8-fcfb68a4b585 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:35.760559 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4d3763bc-ede8-4ca5-b4c8-fcfb68a4b585 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1465 microversion: 2.1 time: 0.424156 Mar 05 20:51:35.762140 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 457/981] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:35 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1465 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:35.777826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ce86a61-0cee-4858-b68f-b5813b636006 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:35.778888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ce86a61-0cee-4858-b68f-b5813b636006 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:35.797856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ce86a61-0cee-4858-b68f-b5813b636006 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:35.798324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ce86a61-0cee-4858-b68f-b5813b636006 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:35.799137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ce86a61-0cee-4858-b68f-b5813b636006 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:35.799580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ce86a61-0cee-4858-b68f-b5813b636006 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:35.911055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-22527f77-18ae-427e-941e-d93ed1775ae7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:35.911712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-22527f77-18ae-427e-941e-d93ed1775ae7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:35.918516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22527f77-18ae-427e-941e-d93ed1775ae7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:35.919818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22527f77-18ae-427e-941e-d93ed1775ae7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:35.921119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22527f77-18ae-427e-941e-d93ed1775ae7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:35.921713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22527f77-18ae-427e-941e-d93ed1775ae7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:35.965251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22527f77-18ae-427e-941e-d93ed1775ae7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:35.966317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22527f77-18ae-427e-941e-d93ed1775ae7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:35.967416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-22527f77-18ae-427e-941e-d93ed1775ae7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lazy-loading 'fault' on Instance uuid d196df64-5f99-4c5a-b30b-92751e6f7702 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:51:36.026586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-22527f77-18ae-427e-941e-d93ed1775ae7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c78359372d4628b29d5c5456d61d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f138bfc479e24b3d9017a7cb9e73bdd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:36.037571 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-22527f77-18ae-427e-941e-d93ed1775ae7 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 200 len: 1303 microversion: 2.1 time: 0.130983 Mar 05 20:51:36.038898 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 458/982] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:35 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 1303 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:36.044198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-976113f6-d9f6-414b-806c-8ea4ea12a5de tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:36.045319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-976113f6-d9f6-414b-806c-8ea4ea12a5de tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:36.056472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-976113f6-d9f6-414b-806c-8ea4ea12a5de tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:36.057289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-976113f6-d9f6-414b-806c-8ea4ea12a5de tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:36.058442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-976113f6-d9f6-414b-806c-8ea4ea12a5de tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:36.059181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-976113f6-d9f6-414b-806c-8ea4ea12a5de tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:36.287645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-976113f6-d9f6-414b-806c-8ea4ea12a5de tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:36.309131 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-976113f6-d9f6-414b-806c-8ea4ea12a5de tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.268532 Mar 05 20:51:36.311817 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 459/983] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:36 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:36.320458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-703979f0-8234-41af-a928-d662946e7586 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c97b280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:36.328295 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4ce86a61-0cee-4858-b68f-b5813b636006 tempest-ServersOnMultiNodesTest-1525431424 tempest-ServersOnMultiNodesTest-1525431424-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1616 microversion: 2.1 time: 0.554823 Mar 05 20:51:36.336488 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 525/984] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:35 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1616 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:36.368523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e3069e84-d1cf-4cd4-a93d-63aa8f19b84b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:36.369233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e3069e84-d1cf-4cd4-a93d-63aa8f19b84b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:36.381761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3069e84-d1cf-4cd4-a93d-63aa8f19b84b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:36.382214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3069e84-d1cf-4cd4-a93d-63aa8f19b84b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:36.391299 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-703979f0-8234-41af-a928-d662946e7586 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.078046 Mar 05 20:51:36.392347 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 460/985] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:36 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:36.396197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3069e84-d1cf-4cd4-a93d-63aa8f19b84b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:36.396785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3069e84-d1cf-4cd4-a93d-63aa8f19b84b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:36.459034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e3069e84-d1cf-4cd4-a93d-63aa8f19b84b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:51:36.476616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7d037625-353d-4980-9704-f08bb462b345 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:36.477442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7d037625-353d-4980-9704-f08bb462b345 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:36.493390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d037625-353d-4980-9704-f08bb462b345 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:36.493951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d037625-353d-4980-9704-f08bb462b345 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:36.494787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d037625-353d-4980-9704-f08bb462b345 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:36.495227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d037625-353d-4980-9704-f08bb462b345 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:36.606026 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e3069e84-d1cf-4cd4-a93d-63aa8f19b84b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "DELETE /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 204 len: 0 microversion: 2.1 time: 0.241628 Mar 05 20:51:36.607796 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 526/986] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:36 2022] DELETE /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:51:36.616371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c24a0bb1-bea5-482c-9709-ace5bae3d7d5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:36.617222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c24a0bb1-bea5-482c-9709-ace5bae3d7d5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:36.630402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c24a0bb1-bea5-482c-9709-ace5bae3d7d5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:36.630908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c24a0bb1-bea5-482c-9709-ace5bae3d7d5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:36.631754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c24a0bb1-bea5-482c-9709-ace5bae3d7d5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:36.632197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c24a0bb1-bea5-482c-9709-ace5bae3d7d5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:36.742446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7d037625-353d-4980-9704-f08bb462b345 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:36.750790 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7d037625-353d-4980-9704-f08bb462b345 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.278027 Mar 05 20:51:36.760702 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 461/987] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:36 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:36.906709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c24a0bb1-bea5-482c-9709-ace5bae3d7d5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:36.915630 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c24a0bb1-bea5-482c-9709-ace5bae3d7d5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1471 microversion: 2.1 time: 0.303975 Mar 05 20:51:36.920596 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 527/988] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:36 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1471 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:37.062256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-187f7b32-0cdd-4936-892f-e94d740e8de1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:37.063240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-187f7b32-0cdd-4936-892f-e94d740e8de1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] [instance: d196df64-5f99-4c5a-b30b-92751e6f7702] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:37.079532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-187f7b32-0cdd-4936-892f-e94d740e8de1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:37.080379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-187f7b32-0cdd-4936-892f-e94d740e8de1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:37.082911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-187f7b32-0cdd-4936-892f-e94d740e8de1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:37.083527 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-187f7b32-0cdd-4936-892f-e94d740e8de1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:37.106187 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-187f7b32-0cdd-4936-892f-e94d740e8de1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] HTTP exception thrown: Instance d196df64-5f99-4c5a-b30b-92751e6f7702 could not be found. Mar 05 20:51:37.107383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-187f7b32-0cdd-4936-892f-e94d740e8de1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] Returning 404 to user: Instance d196df64-5f99-4c5a-b30b-92751e6f7702 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:37.109028 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-187f7b32-0cdd-4936-892f-e94d740e8de1 tempest-ServersAdminTestJSON-1751075180 tempest-ServersAdminTestJSON-1751075180-project] 10.222.0.15 "GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702" status: 404 len: 111 microversion: 2.1 time: 0.055041 Mar 05 20:51:37.113216 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 462/989] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:37 2022] GET /compute/v2.1/servers/d196df64-5f99-4c5a-b30b-92751e6f7702 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:37.330012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ca5fb383-d247-4b76-b50a-f2dd1ba6ae14 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:37.330639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ca5fb383-d247-4b76-b50a-f2dd1ba6ae14 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:37.349768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca5fb383-d247-4b76-b50a-f2dd1ba6ae14 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:37.350235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca5fb383-d247-4b76-b50a-f2dd1ba6ae14 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:37.351047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca5fb383-d247-4b76-b50a-f2dd1ba6ae14 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:37.351491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca5fb383-d247-4b76-b50a-f2dd1ba6ae14 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:37.415614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-32c6bed0-4dac-4184-b7f3-fa8b9965249c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c9a44c0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:37.514178 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-32c6bed0-4dac-4184-b7f3-fa8b9965249c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.113078 Mar 05 20:51:37.525335 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 463/990] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:37 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:37.769311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-25a1af32-1cea-43df-ab07-79c3a443ab76 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:37.770302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-25a1af32-1cea-43df-ab07-79c3a443ab76 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:37.776939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25a1af32-1cea-43df-ab07-79c3a443ab76 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:37.777789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25a1af32-1cea-43df-ab07-79c3a443ab76 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:37.779358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25a1af32-1cea-43df-ab07-79c3a443ab76 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:37.780054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25a1af32-1cea-43df-ab07-79c3a443ab76 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:37.855543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ca5fb383-d247-4b76-b50a-f2dd1ba6ae14 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:37.870761 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ca5fb383-d247-4b76-b50a-f2dd1ba6ae14 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1507 microversion: 2.1 time: 0.546644 Mar 05 20:51:37.897186 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 528/991] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:37 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:37.937042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-276ed1f4-cef7-48fb-91ad-6a78758ec14c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:37.938683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-276ed1f4-cef7-48fb-91ad-6a78758ec14c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:37.961845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-276ed1f4-cef7-48fb-91ad-6a78758ec14c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:37.962590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-276ed1f4-cef7-48fb-91ad-6a78758ec14c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:37.963575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-276ed1f4-cef7-48fb-91ad-6a78758ec14c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:37.965517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-276ed1f4-cef7-48fb-91ad-6a78758ec14c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:38.038283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-25a1af32-1cea-43df-ab07-79c3a443ab76 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:38.050561 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-25a1af32-1cea-43df-ab07-79c3a443ab76 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.285269 Mar 05 20:51:38.051261 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 464/992] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:37 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:38.260386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-276ed1f4-cef7-48fb-91ad-6a78758ec14c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:38.274803 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-276ed1f4-cef7-48fb-91ad-6a78758ec14c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1471 microversion: 2.1 time: 0.342046 Mar 05 20:51:38.275541 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 529/993] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:37 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1471 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:38.535733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bb1e6fe4-c9ac-43da-995f-97d840e70141 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c9a4dc0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:38.672427 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bb1e6fe4-c9ac-43da-995f-97d840e70141 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.143115 Mar 05 20:51:38.673011 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 465/994] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:38 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:39.069890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e11f1e91-e451-4a42-bb6c-ce51b4715d6a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:39.070499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e11f1e91-e451-4a42-bb6c-ce51b4715d6a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:39.083248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e11f1e91-e451-4a42-bb6c-ce51b4715d6a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:39.087773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e11f1e91-e451-4a42-bb6c-ce51b4715d6a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:39.088821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e11f1e91-e451-4a42-bb6c-ce51b4715d6a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:39.089810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e11f1e91-e451-4a42-bb6c-ce51b4715d6a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:39.302186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6c66aec5-01ca-4d25-9a44-26d729f9c547 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:39.303208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6c66aec5-01ca-4d25-9a44-26d729f9c547 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:39.318309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c66aec5-01ca-4d25-9a44-26d729f9c547 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:39.319332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c66aec5-01ca-4d25-9a44-26d729f9c547 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:39.320480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c66aec5-01ca-4d25-9a44-26d729f9c547 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:39.321136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c66aec5-01ca-4d25-9a44-26d729f9c547 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:39.723330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6c66aec5-01ca-4d25-9a44-26d729f9c547 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:39.738540 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6c66aec5-01ca-4d25-9a44-26d729f9c547 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1429 microversion: 2.1 time: 0.442990 Mar 05 20:51:39.740467 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 466/995] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:39 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1429 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:39.758578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c540fb9-1f8e-40e5-8890-c713ca9d39bc tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c897b80>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:39.867562 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4c540fb9-1f8e-40e5-8890-c713ca9d39bc tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.122036 Mar 05 20:51:39.868891 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 467/996] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:39 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:39.876828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9f53e604-58b8-4b70-8c88-d489d5ed83b0 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aca05eb4-9fe7-4bea-b42f-f6cab7112098"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:39.878515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9f53e604-58b8-4b70-8c88-d489d5ed83b0 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:39.894033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f53e604-58b8-4b70-8c88-d489d5ed83b0 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:39.895206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f53e604-58b8-4b70-8c88-d489d5ed83b0 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:39.896344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f53e604-58b8-4b70-8c88-d489d5ed83b0 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:39.897059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f53e604-58b8-4b70-8c88-d489d5ed83b0 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:40.053819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e11f1e91-e451-4a42-bb6c-ce51b4715d6a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:40.063718 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e11f1e91-e451-4a42-bb6c-ce51b4715d6a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.997663 Mar 05 20:51:40.064334 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 530/997] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:39 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:40.172053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-8e6395b1-211f-4dab-b034-f4d548a94855 req-54aeb6cf-e84d-4891-8580-49946eb6960f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c0be5b-cd1f-401d-b51b-9e5332d2365d", "name": "network-vif-deleted", "tag": "e2723169-05a6-45c5-8077-430557c9a549"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:40.201720 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8e6395b1-211f-4dab-b034-f4d548a94855 req-54aeb6cf-e84d-4891-8580-49946eb6960f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:40.202583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8e6395b1-211f-4dab-b034-f4d548a94855 req-54aeb6cf-e84d-4891-8580-49946eb6960f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:40.268661 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-8e6395b1-211f-4dab-b034-f4d548a94855 req-54aeb6cf-e84d-4891-8580-49946eb6960f service nova] Creating event network-vif-deleted:e2723169-05a6-45c5-8077-430557c9a549 for instance 22c0be5b-cd1f-401d-b51b-9e5332d2365d on nch2-master-1 Mar 05 20:51:40.283648 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-8e6395b1-211f-4dab-b034-f4d548a94855 req-54aeb6cf-e84d-4891-8580-49946eb6960f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116781 Mar 05 20:51:40.286584 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 531/998] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:51:40.312835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f9695676-242b-4a30-8238-ab5807b25eba tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:40.318971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f9695676-242b-4a30-8238-ab5807b25eba tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:40.340443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9695676-242b-4a30-8238-ab5807b25eba tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:40.343147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9695676-242b-4a30-8238-ab5807b25eba tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:40.344190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9695676-242b-4a30-8238-ab5807b25eba tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:40.344657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9695676-242b-4a30-8238-ab5807b25eba tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:40.487995 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f9695676-242b-4a30-8238-ab5807b25eba tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192233 Mar 05 20:51:40.498508 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 532/999] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 20:51:40 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:40.515000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fd9314d6-86af-40d1-a17f-a81d0e873b81 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:40.528394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fd9314d6-86af-40d1-a17f-a81d0e873b81 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:40.548414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd9314d6-86af-40d1-a17f-a81d0e873b81 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:40.549018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd9314d6-86af-40d1-a17f-a81d0e873b81 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:40.553585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd9314d6-86af-40d1-a17f-a81d0e873b81 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:40.554133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd9314d6-86af-40d1-a17f-a81d0e873b81 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:40.915567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-fd9314d6-86af-40d1-a17f-a81d0e873b81 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lazy-loading 'services' on Instance uuid 0c0c42a3-81a2-42db-9762-46bd15b2d0ba {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:51:40.932636 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9f53e604-58b8-4b70-8c88-d489d5ed83b0 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "POST /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.061634 Mar 05 20:51:40.939171 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 468/1000] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 20:51:39 2022] POST /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed/os-volume_attachments => generated 194 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:40.970823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-54b6022e-6759-4635-8df9-dd30a32ca235 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:40.974226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-54b6022e-6759-4635-8df9-dd30a32ca235 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:41.009330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54b6022e-6759-4635-8df9-dd30a32ca235 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:41.010164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54b6022e-6759-4635-8df9-dd30a32ca235 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:41.016380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54b6022e-6759-4635-8df9-dd30a32ca235 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:41.017210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54b6022e-6759-4635-8df9-dd30a32ca235 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:41.189182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54b6022e-6759-4635-8df9-dd30a32ca235 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:41.191164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54b6022e-6759-4635-8df9-dd30a32ca235 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:41.192779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-54b6022e-6759-4635-8df9-dd30a32ca235 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lazy-loading 'fault' on Instance uuid 22c0be5b-cd1f-401d-b51b-9e5332d2365d {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:51:41.272423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-54b6022e-6759-4635-8df9-dd30a32ca235 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:41.289292 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-54b6022e-6759-4635-8df9-dd30a32ca235 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 200 len: 1306 microversion: 2.1 time: 0.341781 Mar 05 20:51:41.292978 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 469/1001] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:40 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 1306 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:41.312610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-75ce2aeb-164c-4430-99c7-16a60a82b54d tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c7d4ca0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:41.380327 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fd9314d6-86af-40d1-a17f-a81d0e873b81 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba/os-volume_attachments/0c57b554-8684-4f09-a946-2caa95d79937" status: 202 len: 0 microversion: 2.1 time: 0.868023 Mar 05 20:51:41.387457 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 533/1002] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 20:51:40 2022] DELETE /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba/os-volume_attachments/0c57b554-8684-4f09-a946-2caa95d79937 => generated 0 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:51:41.418713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-78cee35e-839a-4911-9f56-3e0ad60bc6c9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:41.421718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-78cee35e-839a-4911-9f56-3e0ad60bc6c9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:41.425189 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-75ce2aeb-164c-4430-99c7-16a60a82b54d tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.128714 Mar 05 20:51:41.425798 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 470/1003] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:41 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:41.452136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78cee35e-839a-4911-9f56-3e0ad60bc6c9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:41.454929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78cee35e-839a-4911-9f56-3e0ad60bc6c9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:41.456607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78cee35e-839a-4911-9f56-3e0ad60bc6c9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:41.458981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78cee35e-839a-4911-9f56-3e0ad60bc6c9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:41.831388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-78cee35e-839a-4911-9f56-3e0ad60bc6c9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:41.838782 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-78cee35e-839a-4911-9f56-3e0ad60bc6c9 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.449407 Mar 05 20:51:41.839376 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 534/1004] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:41 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:42.311570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c80b0be5-72ef-4383-958a-5714381534e2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:42.312132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c80b0be5-72ef-4383-958a-5714381534e2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 22c0be5b-cd1f-401d-b51b-9e5332d2365d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:42.322130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c80b0be5-72ef-4383-958a-5714381534e2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:42.322707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c80b0be5-72ef-4383-958a-5714381534e2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:42.327489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c80b0be5-72ef-4383-958a-5714381534e2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:42.333936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c80b0be5-72ef-4383-958a-5714381534e2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:42.377565 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-c80b0be5-72ef-4383-958a-5714381534e2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] HTTP exception thrown: Instance 22c0be5b-cd1f-401d-b51b-9e5332d2365d could not be found. Mar 05 20:51:42.382747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c80b0be5-72ef-4383-958a-5714381534e2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Returning 404 to user: Instance 22c0be5b-cd1f-401d-b51b-9e5332d2365d could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:42.384214 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c80b0be5-72ef-4383-958a-5714381534e2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d" status: 404 len: 111 microversion: 2.1 time: 0.078001 Mar 05 20:51:42.391981 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 471/1005] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:42 2022] GET /compute/v2.1/servers/22c0be5b-cd1f-401d-b51b-9e5332d2365d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:42.399723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4adaeb25-8ea2-44db-a032-97bf695f1109 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:42.400246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4adaeb25-8ea2-44db-a032-97bf695f1109 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:42.408160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4adaeb25-8ea2-44db-a032-97bf695f1109 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:42.408615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4adaeb25-8ea2-44db-a032-97bf695f1109 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:42.415959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4adaeb25-8ea2-44db-a032-97bf695f1109 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:42.426219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4adaeb25-8ea2-44db-a032-97bf695f1109 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:42.443271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d08548f6-eb10-4be1-b33a-e260564c389b tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c9a4ee0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:42.474034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4adaeb25-8ea2-44db-a032-97bf695f1109 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:51:42.589101 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d08548f6-eb10-4be1-b33a-e260564c389b tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.154169 Mar 05 20:51:42.590519 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 472/1006] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:42 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:42.665396 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4adaeb25-8ea2-44db-a032-97bf695f1109 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "DELETE /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 204 len: 0 microversion: 2.1 time: 0.269211 Mar 05 20:51:42.673703 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 535/1007] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:42 2022] DELETE /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:51:42.683013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d34a0ab6-beea-465d-9a55-3d64ba3a73d2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:42.683639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d34a0ab6-beea-465d-9a55-3d64ba3a73d2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:42.710497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d34a0ab6-beea-465d-9a55-3d64ba3a73d2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:42.710955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d34a0ab6-beea-465d-9a55-3d64ba3a73d2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:42.725328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d34a0ab6-beea-465d-9a55-3d64ba3a73d2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:42.725915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d34a0ab6-beea-465d-9a55-3d64ba3a73d2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:42.859560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bb25001a-07fe-4d5b-94c6-76be1b01bc33 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:42.860955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bb25001a-07fe-4d5b-94c6-76be1b01bc33 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:42.877114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb25001a-07fe-4d5b-94c6-76be1b01bc33 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:42.887421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb25001a-07fe-4d5b-94c6-76be1b01bc33 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:42.889061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb25001a-07fe-4d5b-94c6-76be1b01bc33 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:42.898730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb25001a-07fe-4d5b-94c6-76be1b01bc33 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:43.305386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb25001a-07fe-4d5b-94c6-76be1b01bc33 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:43.316045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d34a0ab6-beea-465d-9a55-3d64ba3a73d2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:43.317502 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bb25001a-07fe-4d5b-94c6-76be1b01bc33 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.462916 Mar 05 20:51:43.320887 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 536/1008] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:42 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:43.324618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9038f384-dc56-432e-b19c-fb0686231434 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:43.329954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9038f384-dc56-432e-b19c-fb0686231434 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:43.330624 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d34a0ab6-beea-465d-9a55-3d64ba3a73d2 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1473 microversion: 2.1 time: 0.651281 Mar 05 20:51:43.339483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9038f384-dc56-432e-b19c-fb0686231434 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:43.339975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9038f384-dc56-432e-b19c-fb0686231434 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:43.341006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9038f384-dc56-432e-b19c-fb0686231434 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:43.351704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9038f384-dc56-432e-b19c-fb0686231434 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:43.354120 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 473/1009] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:42 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1473 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:43.400565 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9038f384-dc56-432e-b19c-fb0686231434 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080751 Mar 05 20:51:43.401150 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 537/1010] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 20:51:43 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:51:43.515162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f0d98c57-7778-4091-8e08-9b775b523463 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:43.516785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f0d98c57-7778-4091-8e08-9b775b523463 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:43.531770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0d98c57-7778-4091-8e08-9b775b523463 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:43.533507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0d98c57-7778-4091-8e08-9b775b523463 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:43.536907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0d98c57-7778-4091-8e08-9b775b523463 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:43.539077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0d98c57-7778-4091-8e08-9b775b523463 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:43.602193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3dba20f1-3d29-48f0-b960-9c26eba1b8df tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c4cc1f0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:43.655072 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f0d98c57-7778-4091-8e08-9b775b523463 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.145571 Mar 05 20:51:43.656302 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 474/1011] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 20:51:43 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:51:43.691440 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3dba20f1-3d29-48f0-b960-9c26eba1b8df tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.092926 Mar 05 20:51:43.697434 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 538/1012] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:43 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:43.784479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5bd08641-d05c-4f13-8c42-5713b8b5881c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:43.785320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5bd08641-d05c-4f13-8c42-5713b8b5881c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:43.799318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5bd08641-d05c-4f13-8c42-5713b8b5881c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:43.801652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5bd08641-d05c-4f13-8c42-5713b8b5881c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:43.802718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5bd08641-d05c-4f13-8c42-5713b8b5881c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:43.804182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5bd08641-d05c-4f13-8c42-5713b8b5881c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:43.864534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5bd08641-d05c-4f13-8c42-5713b8b5881c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:51:44.067129 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5bd08641-d05c-4f13-8c42-5713b8b5881c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 204 len: 0 microversion: 2.1 time: 0.288815 Mar 05 20:51:44.071554 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 475/1013] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:43 2022] DELETE /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:51:44.093137 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6d725d37-3a09-49bf-a061-2f40f929aba6 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:44.094791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6d725d37-3a09-49bf-a061-2f40f929aba6 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:44.103141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d725d37-3a09-49bf-a061-2f40f929aba6 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.103689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d725d37-3a09-49bf-a061-2f40f929aba6 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.104633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d725d37-3a09-49bf-a061-2f40f929aba6 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.105142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d725d37-3a09-49bf-a061-2f40f929aba6 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.164711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5dd74693-0468-4c17-a8d1-feb93fa3b15f tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Action: 'update', calling method: .version_select at 0x7fed5c57fc10>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:44.166128 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:51:44.166128 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:51:44.167329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dd74693-0468-4c17-a8d1-feb93fa3b15f tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.167810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dd74693-0468-4c17-a8d1-feb93fa3b15f tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.187553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dd74693-0468-4c17-a8d1-feb93fa3b15f tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.191175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dd74693-0468-4c17-a8d1-feb93fa3b15f tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.200556 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-5dd74693-0468-4c17-a8d1-feb93fa3b15f tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] HTTP exception thrown: Service 2120cba0-804d-4191-97dc-a478db86228a could not be found. Mar 05 20:51:44.201446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5dd74693-0468-4c17-a8d1-feb93fa3b15f tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Returning 404 to user: Service 2120cba0-804d-4191-97dc-a478db86228a could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:44.202451 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5dd74693-0468-4c17-a8d1-feb93fa3b15f tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-services/2120cba0-804d-4191-97dc-a478db86228a" status: 404 len: 110 microversion: 2.53 time: 0.344686 Mar 05 20:51:44.203200 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 539/1014] 10.222.0.15 () {62 vars in 1308 bytes} [Sat Mar 5 20:51:43 2022] PUT /compute/v2.1/os-services/2120cba0-804d-4191-97dc-a478db86228a => generated 110 bytes in 346 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:51:44.215380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7f301f79-2b01-44c3-95bf-be7c2d205f13 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Action: 'update', calling method: .version_select at 0x7fed5c79cd30>, body: {"status": "disabled"} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:44.218785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f301f79-2b01-44c3-95bf-be7c2d205f13 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.219596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f301f79-2b01-44c3-95bf-be7c2d205f13 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.226294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f301f79-2b01-44c3-95bf-be7c2d205f13 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.227208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f301f79-2b01-44c3-95bf-be7c2d205f13 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.234038 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-7f301f79-2b01-44c3-95bf-be7c2d205f13 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] HTTP exception thrown: Service 2120cba0-804d-4191-97dc-a478db86228a could not be found. Mar 05 20:51:44.235065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7f301f79-2b01-44c3-95bf-be7c2d205f13 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Returning 404 to user: Service 2120cba0-804d-4191-97dc-a478db86228a could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:44.236336 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7f301f79-2b01-44c3-95bf-be7c2d205f13 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-services/2120cba0-804d-4191-97dc-a478db86228a" status: 404 len: 110 microversion: 2.53 time: 0.025250 Mar 05 20:51:44.237456 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 540/1015] 10.222.0.15 () {62 vars in 1308 bytes} [Sat Mar 5 20:51:44 2022] PUT /compute/v2.1/os-services/2120cba0-804d-4191-97dc-a478db86228a => generated 110 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:51:44.253102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-18c63016-6bc8-4c68-9c82-3dbc226f1ba9 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Action: 'update', calling method: .version_select at 0x7fed5c6069d0>, body: {"status": "enabled"} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:44.256064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18c63016-6bc8-4c68-9c82-3dbc226f1ba9 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.256765 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18c63016-6bc8-4c68-9c82-3dbc226f1ba9 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.263728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18c63016-6bc8-4c68-9c82-3dbc226f1ba9 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.264453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18c63016-6bc8-4c68-9c82-3dbc226f1ba9 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.275910 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-18c63016-6bc8-4c68-9c82-3dbc226f1ba9 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] HTTP exception thrown: Service 2120cba0-804d-4191-97dc-a478db86228a could not be found. Mar 05 20:51:44.276905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-18c63016-6bc8-4c68-9c82-3dbc226f1ba9 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Returning 404 to user: Service 2120cba0-804d-4191-97dc-a478db86228a could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:44.277755 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-18c63016-6bc8-4c68-9c82-3dbc226f1ba9 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-services/2120cba0-804d-4191-97dc-a478db86228a" status: 404 len: 110 microversion: 2.53 time: 0.034924 Mar 05 20:51:44.278535 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 541/1016] 10.222.0.15 () {62 vars in 1308 bytes} [Sat Mar 5 20:51:44 2022] PUT /compute/v2.1/os-services/2120cba0-804d-4191-97dc-a478db86228a => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 05 20:51:44.289998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2ab462c0-7039-4fa3-b0c6-fab18c9935f0 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:44.295350 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:51:44.295350 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:51:44.296906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ab462c0-7039-4fa3-b0c6-fab18c9935f0 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.297375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ab462c0-7039-4fa3-b0c6-fab18c9935f0 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.298345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ab462c0-7039-4fa3-b0c6-fab18c9935f0 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.298779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ab462c0-7039-4fa3-b0c6-fab18c9935f0 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.328333 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2ab462c0-7039-4fa3-b0c6-fab18c9935f0 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.043408 Mar 05 20:51:44.332380 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 542/1017] 10.222.0.15 () {60 vars in 1177 bytes} [Sat Mar 5 20:51:44 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:51:44.349683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fc6c3f48-d407-44dd-911d-a5b992252eab tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:44.350307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fc6c3f48-d407-44dd-911d-a5b992252eab tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:44.357152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc6c3f48-d407-44dd-911d-a5b992252eab tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.357703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc6c3f48-d407-44dd-911d-a5b992252eab tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.358509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc6c3f48-d407-44dd-911d-a5b992252eab tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.358976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc6c3f48-d407-44dd-911d-a5b992252eab tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.784308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fc6c3f48-d407-44dd-911d-a5b992252eab tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:44.786478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6d725d37-3a09-49bf-a061-2f40f929aba6 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:44.797201 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6d725d37-3a09-49bf-a061-2f40f929aba6 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1514 microversion: 2.1 time: 0.724076 Mar 05 20:51:44.797797 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 476/1018] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:44 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1514 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:44.803410 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fc6c3f48-d407-44dd-911d-a5b992252eab tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1477 microversion: 2.1 time: 0.469786 Mar 05 20:51:44.804026 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 543/1019] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:44 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1477 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:44.816907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3ce3d869-9a85-4cbd-8b25-dd5cc183f956 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:44.818042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c3e8e147-9459-4312-8e43-79250eb732a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:44.818699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c3e8e147-9459-4312-8e43-79250eb732a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:44.819169 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:51:44.819169 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:51:44.820903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ce3d869-9a85-4cbd-8b25-dd5cc183f956 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.822041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ce3d869-9a85-4cbd-8b25-dd5cc183f956 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.823059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ce3d869-9a85-4cbd-8b25-dd5cc183f956 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.823662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ce3d869-9a85-4cbd-8b25-dd5cc183f956 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.830959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3e8e147-9459-4312-8e43-79250eb732a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.831415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3e8e147-9459-4312-8e43-79250eb732a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.832253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3e8e147-9459-4312-8e43-79250eb732a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.832696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3e8e147-9459-4312-8e43-79250eb732a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.868821 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3ce3d869-9a85-4cbd-8b25-dd5cc183f956 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.058101 Mar 05 20:51:44.868821 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 477/1020] 10.222.0.15 () {60 vars in 1210 bytes} [Sat Mar 5 20:51:44 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:51:44.868821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ff2eb0b9-3713-4d23-8cc1-32ff6a092444 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c8073a0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:44.909184 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ff2eb0b9-3713-4d23-8cc1-32ff6a092444 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1424 microversion: 2.1 time: 0.048940 Mar 05 20:51:44.910350 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 478/1021] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:44 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:44.915484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f2d907e8-a0a2-41e7-8421-b4c4f5af7690 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:44.916910 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:51:44.916910 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:51:44.918429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2d907e8-a0a2-41e7-8421-b4c4f5af7690 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.919823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2d907e8-a0a2-41e7-8421-b4c4f5af7690 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.920836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2d907e8-a0a2-41e7-8421-b4c4f5af7690 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.921501 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2d907e8-a0a2-41e7-8421-b4c4f5af7690 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.962845 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f2d907e8-a0a2-41e7-8421-b4c4f5af7690 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.051287 Mar 05 20:51:44.963454 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 479/1022] 10.222.0.15 () {60 vars in 1177 bytes} [Sat Mar 5 20:51:44 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:51:44.975472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7b93144c-6066-4b95-86a5-32a143f63fea tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:44.985490 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:51:44.985490 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:51:44.986880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b93144c-6066-4b95-86a5-32a143f63fea tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.987381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b93144c-6066-4b95-86a5-32a143f63fea tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:44.988202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b93144c-6066-4b95-86a5-32a143f63fea tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:44.988795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b93144c-6066-4b95-86a5-32a143f63fea tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:45.015533 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7b93144c-6066-4b95-86a5-32a143f63fea tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.043686 Mar 05 20:51:45.016724 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 480/1023] 10.222.0.15 () {60 vars in 1236 bytes} [Sat Mar 5 20:51:44 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:45.037150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3537521e-a7ff-4369-a4f1-2358558f70c5 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:45.039660 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:51:45.039660 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:51:45.041208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3537521e-a7ff-4369-a4f1-2358558f70c5 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:45.041666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3537521e-a7ff-4369-a4f1-2358558f70c5 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:45.042585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3537521e-a7ff-4369-a4f1-2358558f70c5 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:45.043503 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3537521e-a7ff-4369-a4f1-2358558f70c5 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:45.079577 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3537521e-a7ff-4369-a4f1-2358558f70c5 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.055722 Mar 05 20:51:45.080731 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 481/1024] 10.222.0.15 () {60 vars in 1177 bytes} [Sat Mar 5 20:51:45 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:51:45.098767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d23cf174-41cf-4c47-ac48-4b90b65c4d83 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:45.101605 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:51:45.101605 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:51:45.103520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d23cf174-41cf-4c47-ac48-4b90b65c4d83 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:45.104342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d23cf174-41cf-4c47-ac48-4b90b65c4d83 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:45.105397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d23cf174-41cf-4c47-ac48-4b90b65c4d83 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:45.106027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d23cf174-41cf-4c47-ac48-4b90b65c4d83 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:45.158302 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d23cf174-41cf-4c47-ac48-4b90b65c4d83 tempest-ServicesAdminNegativeV253TestJSON-1954795788 tempest-ServicesAdminNegativeV253TestJSON-1954795788-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.067926 Mar 05 20:51:45.158996 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 482/1025] 10.222.0.15 () {60 vars in 1238 bytes} [Sat Mar 5 20:51:45 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:45.262440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c3e8e147-9459-4312-8e43-79250eb732a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:45.281980 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c3e8e147-9459-4312-8e43-79250eb732a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1473 microversion: 2.1 time: 0.468532 Mar 05 20:51:45.283269 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 544/1026] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:44 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1473 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:45.517339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c1edb32a-1052-49b5-854a-61331ee3bf3d tempest-ServicesAdminNegativeV253TestJSON-401758969 tempest-ServicesAdminNegativeV253TestJSON-401758969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:45.527233 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:51:45.527233 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:51:45.536702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c1edb32a-1052-49b5-854a-61331ee3bf3d tempest-ServicesAdminNegativeV253TestJSON-401758969 tempest-ServicesAdminNegativeV253TestJSON-401758969-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e3b4d6c6526c4ab29606254a6760ff9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359d3b7865e8474d832272668855cdf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:45.542485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c1edb32a-1052-49b5-854a-61331ee3bf3d tempest-ServicesAdminNegativeV253TestJSON-401758969 tempest-ServicesAdminNegativeV253TestJSON-401758969-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:45.547321 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c1edb32a-1052-49b5-854a-61331ee3bf3d tempest-ServicesAdminNegativeV253TestJSON-401758969 tempest-ServicesAdminNegativeV253TestJSON-401758969-project] 10.222.0.15 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.377332 Mar 05 20:51:45.557459 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 483/1027] 10.222.0.15 () {60 vars in 1177 bytes} [Sat Mar 5 20:51:45 2022] GET /compute/v2.1/os-services => generated 112 bytes in 390 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:51:45.833630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ee792341-fc92-479f-b444-d89fcd975911 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:45.834488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ee792341-fc92-479f-b444-d89fcd975911 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:45.850703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-39ee9b66-129b-41ae-88fb-2c18d7a226a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:45.850703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-39ee9b66-129b-41ae-88fb-2c18d7a226a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:45.879990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee792341-fc92-479f-b444-d89fcd975911 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:45.880991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee792341-fc92-479f-b444-d89fcd975911 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:45.881937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee792341-fc92-479f-b444-d89fcd975911 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:45.882436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee792341-fc92-479f-b444-d89fcd975911 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:45.882621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39ee9b66-129b-41ae-88fb-2c18d7a226a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:45.883109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39ee9b66-129b-41ae-88fb-2c18d7a226a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:45.887530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39ee9b66-129b-41ae-88fb-2c18d7a226a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:45.888439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39ee9b66-129b-41ae-88fb-2c18d7a226a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:46.271435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-39ee9b66-129b-41ae-88fb-2c18d7a226a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:46.315365 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-39ee9b66-129b-41ae-88fb-2c18d7a226a1 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1514 microversion: 2.1 time: 0.498796 Mar 05 20:51:46.332736 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 545/1028] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:45 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1514 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:46.578781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ee792341-fc92-479f-b444-d89fcd975911 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:46.587544 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ee792341-fc92-479f-b444-d89fcd975911 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1476 microversion: 2.1 time: 0.765244 Mar 05 20:51:46.604188 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 484/1029] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:45 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1476 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:46.620217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7be7e4e5-609e-4f9c-8bc8-ac96f5826b67 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c7e5f70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:46.710692 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7be7e4e5-609e-4f9c-8bc8-ac96f5826b67 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1433 microversion: 2.1 time: 0.102508 Mar 05 20:51:46.712777 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 485/1030] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:46 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1433 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:46.723805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4e05eafa-6dd1-4a12-8a02-02960e1afe51 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:46.733842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4e05eafa-6dd1-4a12-8a02-02960e1afe51 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:46.750644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e05eafa-6dd1-4a12-8a02-02960e1afe51 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:46.756900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e05eafa-6dd1-4a12-8a02-02960e1afe51 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:46.759940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e05eafa-6dd1-4a12-8a02-02960e1afe51 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:46.764973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e05eafa-6dd1-4a12-8a02-02960e1afe51 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:46.857771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e8787f1d-96fe-4fcd-9b27-dc5513090c0b tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "03f139b7-e87f-4b8c-a36f-b8e203563100"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:46.858916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e8787f1d-96fe-4fcd-9b27-dc5513090c0b tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:46.892410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8787f1d-96fe-4fcd-9b27-dc5513090c0b tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:46.895204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8787f1d-96fe-4fcd-9b27-dc5513090c0b tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:46.896520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8787f1d-96fe-4fcd-9b27-dc5513090c0b tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:46.897202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8787f1d-96fe-4fcd-9b27-dc5513090c0b tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:47.273115 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-e8787f1d-96fe-4fcd-9b27-dc5513090c0b tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] HTTP exception thrown: Volume 03f139b7-e87f-4b8c-a36f-b8e203563100 could not be found. Mar 05 20:51:47.273710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e8787f1d-96fe-4fcd-9b27-dc5513090c0b tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] Returning 400 to user: Volume 03f139b7-e87f-4b8c-a36f-b8e203563100 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:47.275879 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e8787f1d-96fe-4fcd-9b27-dc5513090c0b tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] 10.222.0.15 "PUT /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed/os-volume_attachments/aca05eb4-9fe7-4bea-b42f-f6cab7112098" status: 400 len: 107 microversion: 2.1 time: 0.941861 Mar 05 20:51:47.276636 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 546/1031] 10.222.0.15 () {60 vars in 1432 bytes} [Sat Mar 5 20:51:46 2022] PUT /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed/os-volume_attachments/aca05eb4-9fe7-4bea-b42f-f6cab7112098 => generated 107 bytes in 943 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:51:47.296589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0f286b4c-1fb4-4cd6-b146-2558559a47e8 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c4cfe50>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:47.375343 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0f286b4c-1fb4-4cd6-b146-2558559a47e8 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 200 len: 1433 microversion: 2.1 time: 0.097080 Mar 05 20:51:47.384690 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 547/1032] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:47 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 1433 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:47.392797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ab889449-8992-4af2-860d-276ef3a85a8b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:47.393680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ab889449-8992-4af2-860d-276ef3a85a8b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:47.420660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab889449-8992-4af2-860d-276ef3a85a8b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:47.421539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab889449-8992-4af2-860d-276ef3a85a8b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:47.422541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab889449-8992-4af2-860d-276ef3a85a8b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:47.423172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab889449-8992-4af2-860d-276ef3a85a8b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:47.477001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4e05eafa-6dd1-4a12-8a02-02960e1afe51 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:47.491490 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4e05eafa-6dd1-4a12-8a02-02960e1afe51 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 200 len: 1431 microversion: 2.1 time: 0.777410 Mar 05 20:51:47.492639 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 486/1033] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:46 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 1431 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:47.500831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41292ba0-c9f1-4330-b1c9-40f8aebdd0d3 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:47.501658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-41292ba0-c9f1-4330-b1c9-40f8aebdd0d3 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:47.513379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41292ba0-c9f1-4330-b1c9-40f8aebdd0d3 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:47.515538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41292ba0-c9f1-4330-b1c9-40f8aebdd0d3 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:47.517375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41292ba0-c9f1-4330-b1c9-40f8aebdd0d3 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:47.518076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41292ba0-c9f1-4330-b1c9-40f8aebdd0d3 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:47.809145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-41292ba0-c9f1-4330-b1c9-40f8aebdd0d3 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lazy-loading 'services' on Instance uuid 5e8eaaa7-dba6-4929-a216-6d81195cd7ed {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:51:47.829282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ab889449-8992-4af2-860d-276ef3a85a8b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:47.841034 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ab889449-8992-4af2-860d-276ef3a85a8b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1514 microversion: 2.1 time: 0.454846 Mar 05 20:51:47.841913 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 548/1034] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:47 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1514 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:47.863693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-06026cc9-5116-4a11-a2fd-92093b84ae04 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:47.864542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-06026cc9-5116-4a11-a2fd-92093b84ae04 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:47.883928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06026cc9-5116-4a11-a2fd-92093b84ae04 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:47.886311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06026cc9-5116-4a11-a2fd-92093b84ae04 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:47.888664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06026cc9-5116-4a11-a2fd-92093b84ae04 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:47.889219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06026cc9-5116-4a11-a2fd-92093b84ae04 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:48.023176 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-41292ba0-c9f1-4330-b1c9-40f8aebdd0d3 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed/os-volume_attachments/aca05eb4-9fe7-4bea-b42f-f6cab7112098" status: 202 len: 0 microversion: 2.1 time: 0.528464 Mar 05 20:51:48.025450 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 487/1035] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 20:51:47 2022] DELETE /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed/os-volume_attachments/aca05eb4-9fe7-4bea-b42f-f6cab7112098 => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:51:48.033816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-4a7c5020-6164-4ee0-abab-030b1192e248 req-11774e2e-0736-449f-a9cf-2d0531b94965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d5b76d-41e6-4a10-8687-34fd9582a03e", "name": "network-vif-deleted", "tag": "4a95c28f-b4a8-4cd9-9a86-d99e68a231b9"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:48.046339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4a7c5020-6164-4ee0-abab-030b1192e248 req-11774e2e-0736-449f-a9cf-2d0531b94965 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:48.047879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4a7c5020-6164-4ee0-abab-030b1192e248 req-11774e2e-0736-449f-a9cf-2d0531b94965 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:48.131240 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-4a7c5020-6164-4ee0-abab-030b1192e248 req-11774e2e-0736-449f-a9cf-2d0531b94965 service nova] Creating event network-vif-deleted:4a95c28f-b4a8-4cd9-9a86-d99e68a231b9 for instance 37d5b76d-41e6-4a10-8687-34fd9582a03e on nch1-master-1 Mar 05 20:51:48.176333 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-4a7c5020-6164-4ee0-abab-030b1192e248 req-11774e2e-0736-449f-a9cf-2d0531b94965 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146114 Mar 05 20:51:48.179576 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 488/1036] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:48.195359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e658d68c-d947-4fbc-b7dc-1fdb2b46d9b3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:48.199804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e658d68c-d947-4fbc-b7dc-1fdb2b46d9b3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:48.219998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e658d68c-d947-4fbc-b7dc-1fdb2b46d9b3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:48.221336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e658d68c-d947-4fbc-b7dc-1fdb2b46d9b3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:48.222446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e658d68c-d947-4fbc-b7dc-1fdb2b46d9b3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:48.223425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e658d68c-d947-4fbc-b7dc-1fdb2b46d9b3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:48.320976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-06026cc9-5116-4a11-a2fd-92093b84ae04 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:48.335466 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-06026cc9-5116-4a11-a2fd-92093b84ae04 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1466 microversion: 2.1 time: 0.490500 Mar 05 20:51:48.336481 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 549/1037] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:47 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1466 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:48.342373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b262a6e1-4b55-4679-bf7d-878088dbd0fa tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:48.347271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b262a6e1-4b55-4679-bf7d-878088dbd0fa tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:48.359980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b262a6e1-4b55-4679-bf7d-878088dbd0fa tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:48.365178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b262a6e1-4b55-4679-bf7d-878088dbd0fa tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:48.366317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b262a6e1-4b55-4679-bf7d-878088dbd0fa tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:48.367056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b262a6e1-4b55-4679-bf7d-878088dbd0fa tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:48.435930 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b262a6e1-4b55-4679-bf7d-878088dbd0fa tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098122 Mar 05 20:51:48.436876 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 550/1038] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 20:51:48 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:48.441760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-77ffaa53-28ae-4f85-8358-67b5152a35c7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c4cf670>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:48.545603 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-77ffaa53-28ae-4f85-8358-67b5152a35c7 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80" status: 200 len: 784 microversion: 2.1 time: 0.107381 Mar 05 20:51:48.546202 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 551/1039] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:48 2022] GET /compute/v2.1/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80 => generated 784 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:48.563780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-76047726-de3c-4a87-874d-0cedd677fb00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:48.566189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-76047726-de3c-4a87-874d-0cedd677fb00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 37d5b76d-41e6-4a10-8687-34fd9582a03e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:48.601927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-76047726-de3c-4a87-874d-0cedd677fb00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:48.601927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-76047726-de3c-4a87-874d-0cedd677fb00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:48.601927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-76047726-de3c-4a87-874d-0cedd677fb00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:48.601927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-76047726-de3c-4a87-874d-0cedd677fb00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:48.638139 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-76047726-de3c-4a87-874d-0cedd677fb00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] HTTP exception thrown: Instance 37d5b76d-41e6-4a10-8687-34fd9582a03e could not be found. Mar 05 20:51:48.648399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-76047726-de3c-4a87-874d-0cedd677fb00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Returning 404 to user: Instance 37d5b76d-41e6-4a10-8687-34fd9582a03e could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:48.650565 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-76047726-de3c-4a87-874d-0cedd677fb00 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e" status: 404 len: 111 microversion: 2.1 time: 0.095960 Mar 05 20:51:48.651796 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 552/1040] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:48 2022] GET /compute/v2.1/servers/37d5b76d-41e6-4a10-8687-34fd9582a03e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:48.665666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c4e898c3-af58-4f31-8b6f-5bfb24a9394d tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:48.697176 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c4e898c3-af58-4f31-8b6f-5bfb24a9394d tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043548 Mar 05 20:51:48.698611 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 553/1041] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:51:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:48.708709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-22fe48ee-1855-4c4f-892d-1fef03344f79 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:48.721179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-22fe48ee-1855-4c4f-892d-1fef03344f79 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:48.744800 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22fe48ee-1855-4c4f-892d-1fef03344f79 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:48.745264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22fe48ee-1855-4c4f-892d-1fef03344f79 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:48.750029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22fe48ee-1855-4c4f-892d-1fef03344f79 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:48.753103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22fe48ee-1855-4c4f-892d-1fef03344f79 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:48.792965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-22fe48ee-1855-4c4f-892d-1fef03344f79 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:51:48.846060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e658d68c-d947-4fbc-b7dc-1fdb2b46d9b3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:48.867097 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e658d68c-d947-4fbc-b7dc-1fdb2b46d9b3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1474 microversion: 2.1 time: 0.683705 Mar 05 20:51:48.868547 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 489/1042] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:48 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1474 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:48.905428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8990c974-9cb3-4762-bc72-1020be4e03ce tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c835af0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:49.136101 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-22fe48ee-1855-4c4f-892d-1fef03344f79 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 204 len: 0 microversion: 2.1 time: 0.435923 Mar 05 20:51:49.138351 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 554/1043] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:48 2022] DELETE /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:51:49.157471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d90d0596-f70f-46ea-9732-739eb9a9a02b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:49.160801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d90d0596-f70f-46ea-9732-739eb9a9a02b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:49.188794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d90d0596-f70f-46ea-9732-739eb9a9a02b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:49.190860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d90d0596-f70f-46ea-9732-739eb9a9a02b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:49.193365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d90d0596-f70f-46ea-9732-739eb9a9a02b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:49.194149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d90d0596-f70f-46ea-9732-739eb9a9a02b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:49.362080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d90d0596-f70f-46ea-9732-739eb9a9a02b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:49.362592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d90d0596-f70f-46ea-9732-739eb9a9a02b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:49.363063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-d90d0596-f70f-46ea-9732-739eb9a9a02b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lazy-loading 'fault' on Instance uuid 0c0c42a3-81a2-42db-9762-46bd15b2d0ba {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:51:49.509540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d90d0596-f70f-46ea-9732-739eb9a9a02b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d38e7ad086f42abb908cdfd2e0ebd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde93d10dbea40429b16ffe4a6efce79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:49.522664 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d90d0596-f70f-46ea-9732-739eb9a9a02b tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 200 len: 1308 microversion: 2.1 time: 0.381170 Mar 05 20:51:49.538510 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 555/1044] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:49 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:49.548499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4001dbc6-d0de-4b14-9111-d81f501e3c7f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:49.549193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4001dbc6-d0de-4b14-9111-d81f501e3c7f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:49.564906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4001dbc6-d0de-4b14-9111-d81f501e3c7f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:49.565858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4001dbc6-d0de-4b14-9111-d81f501e3c7f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:49.566871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4001dbc6-d0de-4b14-9111-d81f501e3c7f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:49.567703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4001dbc6-d0de-4b14-9111-d81f501e3c7f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:49.796647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4001dbc6-d0de-4b14-9111-d81f501e3c7f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:49.807957 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4001dbc6-d0de-4b14-9111-d81f501e3c7f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1473 microversion: 2.1 time: 0.267911 Mar 05 20:51:49.809035 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 556/1045] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:49 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1473 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:49.818039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5533f3e2-3343-4d24-a579-ca9d67317e06 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:49.819029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5533f3e2-3343-4d24-a579-ca9d67317e06 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:49.828724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5533f3e2-3343-4d24-a579-ca9d67317e06 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:49.829380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5533f3e2-3343-4d24-a579-ca9d67317e06 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:49.830433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5533f3e2-3343-4d24-a579-ca9d67317e06 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:49.831031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5533f3e2-3343-4d24-a579-ca9d67317e06 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:49.933993 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5533f3e2-3343-4d24-a579-ca9d67317e06 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123633 Mar 05 20:51:49.940004 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 557/1046] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 20:51:49 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:51:49.955081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2d0b694d-34ec-4c91-91d8-2aab74de2324 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:49.956012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2d0b694d-34ec-4c91-91d8-2aab74de2324 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:49.972993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d0b694d-34ec-4c91-91d8-2aab74de2324 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:49.973455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d0b694d-34ec-4c91-91d8-2aab74de2324 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:49.975169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d0b694d-34ec-4c91-91d8-2aab74de2324 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:49.976957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d0b694d-34ec-4c91-91d8-2aab74de2324 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:50.476248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2d0b694d-34ec-4c91-91d8-2aab74de2324 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:50.490138 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2d0b694d-34ec-4c91-91d8-2aab74de2324 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1471 microversion: 2.1 time: 0.546841 Mar 05 20:51:50.491240 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 558/1047] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:49 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1471 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:50.503055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6f0d5fd1-57bd-4678-8af5-fe37a368913c req-00d888bd-4595-49b3-88f7-bc488c235282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0c42a3-81a2-42db-9762-46bd15b2d0ba", "name": "network-vif-deleted", "tag": "c27fa3bc-53d7-4955-9db1-64fb1ec24675"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:50.520307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6f0d5fd1-57bd-4678-8af5-fe37a368913c req-00d888bd-4595-49b3-88f7-bc488c235282 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:50.522059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6f0d5fd1-57bd-4678-8af5-fe37a368913c req-00d888bd-4595-49b3-88f7-bc488c235282 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:50.543816 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6f0d5fd1-57bd-4678-8af5-fe37a368913c req-00d888bd-4595-49b3-88f7-bc488c235282 service nova] Creating event network-vif-deleted:c27fa3bc-53d7-4955-9db1-64fb1ec24675 for instance 0c0c42a3-81a2-42db-9762-46bd15b2d0ba on nch1-master-1 Mar 05 20:51:50.554081 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6f0d5fd1-57bd-4678-8af5-fe37a368913c req-00d888bd-4595-49b3-88f7-bc488c235282 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059866 Mar 05 20:51:50.556621 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 559/1048] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:50.565793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-7f6eb6ab-963b-454b-90de-f7e7c4cb5c48 req-c3ed5bd4-f284-4405-9e43-0ad592aa11e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b0401ca-066c-40a5-b076-b4fd5b6ab3d2", "name": "network-vif-unplugged", "status": "completed", "tag": "5c0add0b-e16b-4f33-bad0-f6bb5dbab8ca"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:50.580193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7f6eb6ab-963b-454b-90de-f7e7c4cb5c48 req-c3ed5bd4-f284-4405-9e43-0ad592aa11e5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:50.580874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7f6eb6ab-963b-454b-90de-f7e7c4cb5c48 req-c3ed5bd4-f284-4405-9e43-0ad592aa11e5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:50.595858 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-7f6eb6ab-963b-454b-90de-f7e7c4cb5c48 req-c3ed5bd4-f284-4405-9e43-0ad592aa11e5 service nova] Creating event network-vif-unplugged:5c0add0b-e16b-4f33-bad0-f6bb5dbab8ca for instance 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 on nch2-master-1 Mar 05 20:51:50.602578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-7f6eb6ab-963b-454b-90de-f7e7c4cb5c48 req-c3ed5bd4-f284-4405-9e43-0ad592aa11e5 service nova] Instance 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:51:50.610304 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-7f6eb6ab-963b-454b-90de-f7e7c4cb5c48 req-c3ed5bd4-f284-4405-9e43-0ad592aa11e5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051193 Mar 05 20:51:50.611622 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 560/1049] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:50.617820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-63ea5e5b-0947-45cd-9596-0b48f348ed5c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:50.618943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-63ea5e5b-0947-45cd-9596-0b48f348ed5c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:50.636751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63ea5e5b-0947-45cd-9596-0b48f348ed5c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:50.641058 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8990c974-9cb3-4762-bc72-1020be4e03ce tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "DELETE /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 204 len: 0 microversion: 2.1 time: 1.763082 Mar 05 20:51:50.642012 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 490/1050] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:48 2022] DELETE /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 0 bytes in 1765 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:51:50.648528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82b50792-80eb-42a8-af79-34b16753dc78 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:50.649822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-82b50792-80eb-42a8-af79-34b16753dc78 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:50.650743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63ea5e5b-0947-45cd-9596-0b48f348ed5c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:50.654108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63ea5e5b-0947-45cd-9596-0b48f348ed5c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:50.655339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63ea5e5b-0947-45cd-9596-0b48f348ed5c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:50.667316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82b50792-80eb-42a8-af79-34b16753dc78 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:50.670052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82b50792-80eb-42a8-af79-34b16753dc78 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:50.688729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82b50792-80eb-42a8-af79-34b16753dc78 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:50.689209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82b50792-80eb-42a8-af79-34b16753dc78 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:50.704050 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-82b50792-80eb-42a8-af79-34b16753dc78 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] HTTP exception thrown: Instance 0c0c42a3-81a2-42db-9762-46bd15b2d0ba could not be found. Mar 05 20:51:50.704654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82b50792-80eb-42a8-af79-34b16753dc78 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Returning 404 to user: Instance 0c0c42a3-81a2-42db-9762-46bd15b2d0ba could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:50.705514 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-82b50792-80eb-42a8-af79-34b16753dc78 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 404 len: 111 microversion: 2.1 time: 0.062280 Mar 05 20:51:50.712389 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 491/1051] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:50 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:50.718606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-10ba52f0-8ab3-43d6-a529-df96066fa251 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c835ca0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:50.782379 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-10ba52f0-8ab3-43d6-a529-df96066fa251 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] HTTP exception thrown: Image not found. Mar 05 20:51:50.783083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-10ba52f0-8ab3-43d6-a529-df96066fa251 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Returning 404 to user: Image not found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:50.784004 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-10ba52f0-8ab3-43d6-a529-df96066fa251 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 404 len: 62 microversion: 2.1 time: 0.070525 Mar 05 20:51:50.784563 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 492/1052] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:50 2022] GET /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:51:50.796203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6121dff4-7acd-49e2-b011-801c906e1a5b tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-375406903"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:50.798092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6121dff4-7acd-49e2-b011-801c906e1a5b tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:50.802181 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-63ea5e5b-0947-45cd-9596-0b48f348ed5c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "POST /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2/action" status: 204 len: 0 microversion: 2.1 time: 0.187549 Mar 05 20:51:50.805600 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 561/1053] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:51:50 2022] POST /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2/action => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:51:50.821562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ffe25803-e678-4266-84e3-2a4974f1bdde tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:50.829887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ffe25803-e678-4266-84e3-2a4974f1bdde tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:50.837883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6121dff4-7acd-49e2-b011-801c906e1a5b tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:50.838370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6121dff4-7acd-49e2-b011-801c906e1a5b tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:50.839173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6121dff4-7acd-49e2-b011-801c906e1a5b tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:50.839646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6121dff4-7acd-49e2-b011-801c906e1a5b tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:50.847625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ffe25803-e678-4266-84e3-2a4974f1bdde tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:50.850658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ffe25803-e678-4266-84e3-2a4974f1bdde tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:50.851756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ffe25803-e678-4266-84e3-2a4974f1bdde tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:50.852993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ffe25803-e678-4266-84e3-2a4974f1bdde tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:51.503642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ffe25803-e678-4266-84e3-2a4974f1bdde tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:51.513775 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ffe25803-e678-4266-84e3-2a4974f1bdde tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1471 microversion: 2.1 time: 0.701782 Mar 05 20:51:51.536603 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 562/1054] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:50 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1471 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:51.543458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bb1a5958-4787-473d-85f1-03127412504b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:51.544388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bb1a5958-4787-473d-85f1-03127412504b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:51.585922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb1a5958-4787-473d-85f1-03127412504b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:51.587022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb1a5958-4787-473d-85f1-03127412504b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:51.589116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb1a5958-4787-473d-85f1-03127412504b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:51.591374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb1a5958-4787-473d-85f1-03127412504b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:51.646617 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6121dff4-7acd-49e2-b011-801c906e1a5b tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "POST /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214/action" status: 202 len: 0 microversion: 2.1 time: 0.854778 Mar 05 20:51:51.665217 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 493/1055] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:51:50 2022] POST /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214/action => generated 0 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 20:51:51.694865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8e2f73ee-5537-4779-ab9a-a72bf2085793 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5cfe2280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:51.767459 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8e2f73ee-5537-4779-ab9a-a72bf2085793 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.093249 Mar 05 20:51:51.768782 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 494/1056] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:51 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:51.967353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-89712dc3-5818-4336-b4e0-b3fc73704bb1 tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "98bf6158-49f4-41f1-9680-d8c0ce09efcc"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:51.968896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-89712dc3-5818-4336-b4e0-b3fc73704bb1 tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:51.980837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89712dc3-5818-4336-b4e0-b3fc73704bb1 tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:51.982174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89712dc3-5818-4336-b4e0-b3fc73704bb1 tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:51.983184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89712dc3-5818-4336-b4e0-b3fc73704bb1 tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:51.983867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89712dc3-5818-4336-b4e0-b3fc73704bb1 tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:52.091526 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-89712dc3-5818-4336-b4e0-b3fc73704bb1 tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] HTTP exception thrown: Volume 666e71d1-afc5-459d-8598-b9966776d935 could not be found. Mar 05 20:51:52.092394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-89712dc3-5818-4336-b4e0-b3fc73704bb1 tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] Returning 404 to user: Volume 666e71d1-afc5-459d-8598-b9966776d935 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:52.093233 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-89712dc3-5818-4336-b4e0-b3fc73704bb1 tempest-VolumesAdminNegativeTest-501728914 tempest-VolumesAdminNegativeTest-501728914-project-admin] 10.222.0.15 "PUT /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed/os-volume_attachments/666e71d1-afc5-459d-8598-b9966776d935" status: 404 len: 109 microversion: 2.1 time: 0.131903 Mar 05 20:51:52.094486 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 495/1057] 10.222.0.15 () {60 vars in 1432 bytes} [Sat Mar 5 20:51:51 2022] PUT /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed/os-volume_attachments/666e71d1-afc5-459d-8598-b9966776d935 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:51:52.387738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb1a5958-4787-473d-85f1-03127412504b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:52.452749 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bb1a5958-4787-473d-85f1-03127412504b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 200 len: 1431 microversion: 2.1 time: 0.909590 Mar 05 20:51:52.464889 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 563/1058] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:51 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 1431 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:52.543597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8878e609-7976-458d-8aa6-d64758741d0b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:52.544424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8878e609-7976-458d-8aa6-d64758741d0b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:52.557434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8878e609-7976-458d-8aa6-d64758741d0b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:52.563038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8878e609-7976-458d-8aa6-d64758741d0b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:52.565585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8878e609-7976-458d-8aa6-d64758741d0b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:52.566420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8878e609-7976-458d-8aa6-d64758741d0b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:52.583183 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9dc74b34-5fc2-4266-8171-9ffde0100f31 req-4c39747b-dd1b-4feb-9735-bd001bd2ed59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3378502b-221a-43a1-94fb-a38942c6ea8f", "name": "network-vif-deleted", "tag": "a08d1e53-56eb-4fc4-9b82-dc43fcf4a04b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:52.605024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9dc74b34-5fc2-4266-8171-9ffde0100f31 req-4c39747b-dd1b-4feb-9735-bd001bd2ed59 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:52.605700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9dc74b34-5fc2-4266-8171-9ffde0100f31 req-4c39747b-dd1b-4feb-9735-bd001bd2ed59 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:52.643165 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9dc74b34-5fc2-4266-8171-9ffde0100f31 req-4c39747b-dd1b-4feb-9735-bd001bd2ed59 service nova] Creating event network-vif-deleted:a08d1e53-56eb-4fc4-9b82-dc43fcf4a04b for instance 3378502b-221a-43a1-94fb-a38942c6ea8f on nch1-master-1 Mar 05 20:51:52.662738 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9dc74b34-5fc2-4266-8171-9ffde0100f31 req-4c39747b-dd1b-4feb-9735-bd001bd2ed59 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083268 Mar 05 20:51:52.663788 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 564/1059] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:51:52.669760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-a8c787ee-7ae1-461c-a201-271d5a86469b req-c9c5eb2e-f9f1-42ba-9525-7f5e50a8d9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54f039d-1623-4ad6-a4e3-308472493214", "name": "network-vif-unplugged", "status": "completed", "tag": "6c25b98e-729b-490d-bb31-a40e13f1d945"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:52.694115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a8c787ee-7ae1-461c-a201-271d5a86469b req-c9c5eb2e-f9f1-42ba-9525-7f5e50a8d9d3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:52.695207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a8c787ee-7ae1-461c-a201-271d5a86469b req-c9c5eb2e-f9f1-42ba-9525-7f5e50a8d9d3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:52.720884 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-a8c787ee-7ae1-461c-a201-271d5a86469b req-c9c5eb2e-f9f1-42ba-9525-7f5e50a8d9d3 service nova] Creating event network-vif-unplugged:6c25b98e-729b-490d-bb31-a40e13f1d945 for instance d54f039d-1623-4ad6-a4e3-308472493214 on nch2-master-1 Mar 05 20:51:52.727024 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-a8c787ee-7ae1-461c-a201-271d5a86469b req-c9c5eb2e-f9f1-42ba-9525-7f5e50a8d9d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061525 Mar 05 20:51:52.727639 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 565/1060] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:52.790114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a3c1ed67-ac0e-482c-b03e-2302b908bdc5 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c57f700>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:52.864617 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a3c1ed67-ac0e-482c-b03e-2302b908bdc5 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.085813 Mar 05 20:51:52.871158 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 566/1061] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:52 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:52.906353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8878e609-7976-458d-8aa6-d64758741d0b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:52.919451 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8878e609-7976-458d-8aa6-d64758741d0b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1471 microversion: 2.1 time: 0.379513 Mar 05 20:51:52.922239 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 496/1062] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:52 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1471 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:53.119365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f20dd28e-2f8b-4df4-a1d9-6079e8d21cdd tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Action: 'create', calling method: .version_select at 0x7fed5c4a4550>, body: {"keypair": {"name": "tempest-keypair-264667923"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:53.156960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-f20dd28e-2f8b-4df4-a1d9-6079e8d21cdd tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:53.165867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-f20dd28e-2f8b-4df4-a1d9-6079e8d21cdd tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for user 9a1ff3fe70d54bcfb83d5820a4b57ec7 and project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:53.470884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5e190807-e7ae-4b50-a3f0-914906f5061d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:53.471516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5e190807-e7ae-4b50-a3f0-914906f5061d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 3378502b-221a-43a1-94fb-a38942c6ea8f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:53.479760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-f20dd28e-2f8b-4df4-a1d9-6079e8d21cdd tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:53.481426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e190807-e7ae-4b50-a3f0-914906f5061d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:53.483609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e190807-e7ae-4b50-a3f0-914906f5061d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:53.484564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e190807-e7ae-4b50-a3f0-914906f5061d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:53.485279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e190807-e7ae-4b50-a3f0-914906f5061d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:53.487059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-f20dd28e-2f8b-4df4-a1d9-6079e8d21cdd tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for user 9a1ff3fe70d54bcfb83d5820a4b57ec7 and project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:53.510777 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-5e190807-e7ae-4b50-a3f0-914906f5061d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] HTTP exception thrown: Instance 3378502b-221a-43a1-94fb-a38942c6ea8f could not be found. Mar 05 20:51:53.511796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5e190807-e7ae-4b50-a3f0-914906f5061d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Returning 404 to user: Instance 3378502b-221a-43a1-94fb-a38942c6ea8f could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:53.513028 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5e190807-e7ae-4b50-a3f0-914906f5061d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f" status: 404 len: 111 microversion: 2.1 time: 0.046581 Mar 05 20:51:53.514449 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 497/1063] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:53 2022] GET /compute/v2.1/servers/3378502b-221a-43a1-94fb-a38942c6ea8f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:53.519508 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f20dd28e-2f8b-4df4-a1d9-6079e8d21cdd tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.568164 Mar 05 20:51:53.524672 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 567/1064] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:51:52 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:53.525338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7e719ec6-923d-4787-8850-74ac03cf7e28 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:53.525864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7e719ec6-923d-4787-8850-74ac03cf7e28 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 441213dc-2cba-4629-8bfc-3a01bbec6942] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:53.531385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-645fdad2-e468-40a2-b055-af610b109ef4 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Calling method '.version_select at 0x7fed5c4cc0d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:53.534939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e719ec6-923d-4787-8850-74ac03cf7e28 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:53.535395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e719ec6-923d-4787-8850-74ac03cf7e28 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:53.536438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e719ec6-923d-4787-8850-74ac03cf7e28 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:53.536841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e719ec6-923d-4787-8850-74ac03cf7e28 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:53.540196 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-645fdad2-e468-40a2-b055-af610b109ef4 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "GET /compute/v2.1/os-keypairs/tempest-keypair-264667923" status: 200 len: 690 microversion: 2.1 time: 0.013676 Mar 05 20:51:53.547030 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 568/1065] 10.222.0.15 () {58 vars in 1214 bytes} [Sat Mar 5 20:51:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-264667923 => generated 690 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:53.552890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0a0a8eae-9789-4d43-8396-c98d39c25432 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Calling method '.version_select at 0x7fed5c57fca0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:53.573492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7e719ec6-923d-4787-8850-74ac03cf7e28 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 441213dc-2cba-4629-8bfc-3a01bbec6942] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:51:53.575615 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0a0a8eae-9789-4d43-8396-c98d39c25432 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-264667923" status: 202 len: 0 microversion: 2.1 time: 0.026379 Mar 05 20:51:53.582711 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 569/1066] 10.222.0.15 () {58 vars in 1217 bytes} [Sat Mar 5 20:51:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-264667923 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:51:53.591558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fd7dd5e9-6d3a-493c-98e1-158e6300fedb tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Action: 'create', calling method: .version_select at 0x7fed5c4c4b80>, body: {"keypair": {"name": "tempest-keypair-189853130"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:53.613820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-fd7dd5e9-6d3a-493c-98e1-158e6300fedb tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:53.625501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-fd7dd5e9-6d3a-493c-98e1-158e6300fedb tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for user 9a1ff3fe70d54bcfb83d5820a4b57ec7 and project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:53.701838 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7e719ec6-923d-4787-8850-74ac03cf7e28 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "DELETE /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942" status: 204 len: 0 microversion: 2.1 time: 0.183044 Mar 05 20:51:53.703092 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 498/1067] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:53 2022] DELETE /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 20:51:53.716620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a894792f-c171-425e-bf2c-76240375d086 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:53.717286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a894792f-c171-425e-bf2c-76240375d086 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:53.723939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a894792f-c171-425e-bf2c-76240375d086 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:53.726460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a894792f-c171-425e-bf2c-76240375d086 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:53.727426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a894792f-c171-425e-bf2c-76240375d086 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:53.728059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a894792f-c171-425e-bf2c-76240375d086 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:53.773401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a894792f-c171-425e-bf2c-76240375d086 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:51:53.885721 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a894792f-c171-425e-bf2c-76240375d086 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 204 len: 0 microversion: 2.1 time: 0.174083 Mar 05 20:51:53.888018 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 499/1068] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:53 2022] DELETE /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:51:53.893768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-04a71e4a-0ea1-411b-9b18-cfd4d856f1b0 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c7b0820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:53.957426 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-04a71e4a-0ea1-411b-9b18-cfd4d856f1b0 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.067201 Mar 05 20:51:53.958838 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 500/1069] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:53 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:53.963418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6592812a-6539-45f9-a5f7-b4380e3676d8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:53.964535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6592812a-6539-45f9-a5f7-b4380e3676d8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 441213dc-2cba-4629-8bfc-3a01bbec6942] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:53.972270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6592812a-6539-45f9-a5f7-b4380e3676d8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:53.972541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6592812a-6539-45f9-a5f7-b4380e3676d8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:53.973371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6592812a-6539-45f9-a5f7-b4380e3676d8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:53.973810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6592812a-6539-45f9-a5f7-b4380e3676d8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:54.083883 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-fd7dd5e9-6d3a-493c-98e1-158e6300fedb tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:54.094043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-fd7dd5e9-6d3a-493c-98e1-158e6300fedb tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for user 9a1ff3fe70d54bcfb83d5820a4b57ec7 and project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:54.113535 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fd7dd5e9-6d3a-493c-98e1-158e6300fedb tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.527911 Mar 05 20:51:54.114644 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 570/1070] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:51:53 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:54.120624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3516201d-8eb5-4c71-8d16-19c57c2a4e1a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:54.123534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3516201d-8eb5-4c71-8d16-19c57c2a4e1a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:54.133059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3516201d-8eb5-4c71-8d16-19c57c2a4e1a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:54.134058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3516201d-8eb5-4c71-8d16-19c57c2a4e1a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:54.135123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3516201d-8eb5-4c71-8d16-19c57c2a4e1a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:54.135792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3516201d-8eb5-4c71-8d16-19c57c2a4e1a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:54.257922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6592812a-6539-45f9-a5f7-b4380e3676d8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:54.268794 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6592812a-6539-45f9-a5f7-b4380e3676d8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942" status: 200 len: 1474 microversion: 2.1 time: 0.308438 Mar 05 20:51:54.269964 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 501/1071] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:53 2022] GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942 => generated 1474 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:54.274873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a3fe3aa3-1874-497c-859f-a4c1b3d7aa8a tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Calling method '.version_select at 0x7fed5c6cde50>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:54.302424 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a3fe3aa3-1874-497c-859f-a4c1b3d7aa8a tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-189853130" status: 202 len: 0 microversion: 2.1 time: 0.031155 Mar 05 20:51:54.303083 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 502/1072] 10.222.0.15 () {58 vars in 1217 bytes} [Sat Mar 5 20:51:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-189853130 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:51:54.315967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bfc7839f-cc4d-4388-b3bc-abfeb683e377 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:54.316916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bfc7839f-cc4d-4388-b3bc-abfeb683e377 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:54.324273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfc7839f-cc4d-4388-b3bc-abfeb683e377 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:54.326355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfc7839f-cc4d-4388-b3bc-abfeb683e377 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:54.328254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfc7839f-cc4d-4388-b3bc-abfeb683e377 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:54.329081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfc7839f-cc4d-4388-b3bc-abfeb683e377 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:54.369262 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-bfc7839f-cc4d-4388-b3bc-abfeb683e377 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] HTTP exception thrown: Instance 0c0c42a3-81a2-42db-9762-46bd15b2d0ba could not be found. Mar 05 20:51:54.370798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bfc7839f-cc4d-4388-b3bc-abfeb683e377 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Returning 404 to user: Instance 0c0c42a3-81a2-42db-9762-46bd15b2d0ba could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:54.371544 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bfc7839f-cc4d-4388-b3bc-abfeb683e377 tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 404 len: 111 microversion: 2.1 time: 0.067207 Mar 05 20:51:54.377110 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 503/1073] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:54 2022] DELETE /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:54.382435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-362fef80-80b5-4136-a10a-90c34199a515 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Action: 'create', calling method: .version_select at 0x7fed5c7b0280>, body: {"keypair": {"name": "tempest-keypair-2003861414", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:54.405262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-362fef80-80b5-4136-a10a-90c34199a515 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:54.413920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-362fef80-80b5-4136-a10a-90c34199a515 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for user 9a1ff3fe70d54bcfb83d5820a4b57ec7 and project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:54.447312 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-362fef80-80b5-4136-a10a-90c34199a515 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.068959 Mar 05 20:51:54.450644 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 504/1074] 10.222.0.15 () {60 vars in 1158 bytes} [Sat Mar 5 20:51:54 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:54.471729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2a13c6d2-d305-439e-acb5-e0aa9553a09c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:54.473200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2a13c6d2-d305-439e-acb5-e0aa9553a09c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] [instance: 0c0c42a3-81a2-42db-9762-46bd15b2d0ba] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:54.483155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a13c6d2-d305-439e-acb5-e0aa9553a09c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:54.484057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a13c6d2-d305-439e-acb5-e0aa9553a09c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:54.485287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a13c6d2-d305-439e-acb5-e0aa9553a09c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:54.486928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a13c6d2-d305-439e-acb5-e0aa9553a09c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:54.516183 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-2a13c6d2-d305-439e-acb5-e0aa9553a09c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] HTTP exception thrown: Instance 0c0c42a3-81a2-42db-9762-46bd15b2d0ba could not be found. Mar 05 20:51:54.517085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2a13c6d2-d305-439e-acb5-e0aa9553a09c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] Returning 404 to user: Instance 0c0c42a3-81a2-42db-9762-46bd15b2d0ba could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:54.518007 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2a13c6d2-d305-439e-acb5-e0aa9553a09c tempest-AttachSCSIVolumeTestJSON-1365107399 tempest-AttachSCSIVolumeTestJSON-1365107399-project] 10.222.0.15 "GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba" status: 404 len: 111 microversion: 2.1 time: 0.063758 Mar 05 20:51:54.522584 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 505/1075] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:54 2022] GET /compute/v2.1/servers/0c0c42a3-81a2-42db-9762-46bd15b2d0ba => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:54.529296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e36075c5-b7a7-4129-91a3-80980f9bf48b tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Calling method '.version_select at 0x7fed5c737550>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:54.564365 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e36075c5-b7a7-4129-91a3-80980f9bf48b tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003861414" status: 202 len: 0 microversion: 2.1 time: 0.040646 Mar 05 20:51:54.565313 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 506/1076] 10.222.0.15 () {58 vars in 1220 bytes} [Sat Mar 5 20:51:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003861414 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:51:54.577484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cf8f8ca1-00a2-4f43-8de1-189d36bdec91 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Action: 'create', calling method: .version_select at 0x7fed5c7b00d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2014119273"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:54.599343 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-cf8f8ca1-00a2-4f43-8de1-189d36bdec91 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:54.606806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-cf8f8ca1-00a2-4f43-8de1-189d36bdec91 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for user 9a1ff3fe70d54bcfb83d5820a4b57ec7 and project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:54.655923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3516201d-8eb5-4c71-8d16-19c57c2a4e1a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:54.670477 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3516201d-8eb5-4c71-8d16-19c57c2a4e1a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1471 microversion: 2.1 time: 0.554287 Mar 05 20:51:54.672212 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 571/1077] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:54 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1471 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:54.905098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-cf8f8ca1-00a2-4f43-8de1-189d36bdec91 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:54.916924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-cf8f8ca1-00a2-4f43-8de1-189d36bdec91 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for user 9a1ff3fe70d54bcfb83d5820a4b57ec7 and project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:54.937045 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cf8f8ca1-00a2-4f43-8de1-189d36bdec91 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.367002 Mar 05 20:51:54.939279 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 507/1078] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:51:54 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:54.950758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-21984285-e3aa-4ef8-b720-a665e65b2913 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Action: 'create', calling method: .version_select at 0x7fed5c4cf3a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1122714080"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:54.971264 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-267218c4-4083-4193-aff5-ab952ea3dd9d tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c7b0820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:55.016679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-21984285-e3aa-4ef8-b720-a665e65b2913 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:55.025262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-21984285-e3aa-4ef8-b720-a665e65b2913 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for user 9a1ff3fe70d54bcfb83d5820a4b57ec7 and project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:55.035974 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-267218c4-4083-4193-aff5-ab952ea3dd9d tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.069234 Mar 05 20:51:55.037030 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 508/1079] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:54 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:55.289876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a6b81701-5d36-416b-8d0f-41f5fbd78358 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:55.290637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a6b81701-5d36-416b-8d0f-41f5fbd78358 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 441213dc-2cba-4629-8bfc-3a01bbec6942] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:55.302044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6b81701-5d36-416b-8d0f-41f5fbd78358 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:55.303089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6b81701-5d36-416b-8d0f-41f5fbd78358 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:55.304669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6b81701-5d36-416b-8d0f-41f5fbd78358 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:55.305116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6b81701-5d36-416b-8d0f-41f5fbd78358 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:55.379138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-21984285-e3aa-4ef8-b720-a665e65b2913 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:55.385127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-21984285-e3aa-4ef8-b720-a665e65b2913 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for user 9a1ff3fe70d54bcfb83d5820a4b57ec7 and project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:55.402319 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-21984285-e3aa-4ef8-b720-a665e65b2913 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.456454 Mar 05 20:51:55.404034 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 572/1080] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:51:54 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:55.414386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-727720fb-6a55-4729-9732-0d51377b2c82 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Action: 'create', calling method: .version_select at 0x7fed5c79cb80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1657019135"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:55.431730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-727720fb-6a55-4729-9732-0d51377b2c82 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:55.440142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-727720fb-6a55-4729-9732-0d51377b2c82 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for user 9a1ff3fe70d54bcfb83d5820a4b57ec7 and project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:55.707776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a6b81701-5d36-416b-8d0f-41f5fbd78358 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:55.718104 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a6b81701-5d36-416b-8d0f-41f5fbd78358 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942" status: 200 len: 1474 microversion: 2.1 time: 0.433021 Mar 05 20:51:55.718699 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 509/1081] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:55 2022] GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942 => generated 1474 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:55.740176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cbe6cad1-e65b-4fc8-9af7-c580000c0093 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:55.743834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cbe6cad1-e65b-4fc8-9af7-c580000c0093 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:55.753184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbe6cad1-e65b-4fc8-9af7-c580000c0093 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:55.760797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbe6cad1-e65b-4fc8-9af7-c580000c0093 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:55.772060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbe6cad1-e65b-4fc8-9af7-c580000c0093 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:55.773545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbe6cad1-e65b-4fc8-9af7-c580000c0093 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:55.808520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-727720fb-6a55-4729-9732-0d51377b2c82 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:55.822264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-727720fb-6a55-4729-9732-0d51377b2c82 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Getting quotas for user 9a1ff3fe70d54bcfb83d5820a4b57ec7 and project 0039978f151f4315902945b34e86ce7e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:55.862270 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-727720fb-6a55-4729-9732-0d51377b2c82 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.451637 Mar 05 20:51:55.863979 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 573/1082] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:51:55 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:51:55.869771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-288982081", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d8a74baa-3ebe-46d5-a0b5-c05bac959620"}], "security_groups": [{"name": "tempest-securitygroup--188089828"}], "key_name": "tempest-keypair-589748295", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "7fab029c-6104-4f67-a93d-5c93dbea922a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:56.141519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] validate_networks() for [('d8a74baa-3ebe-46d5-a0b5-c05bac959620', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:51:56.266219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cbe6cad1-e65b-4fc8-9af7-c580000c0093 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:56.274323 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cbe6cad1-e65b-4fc8-9af7-c580000c0093 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1463 microversion: 2.1 time: 0.547217 Mar 05 20:51:56.277894 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 510/1083] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:55 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1463 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:56.294485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-460e3f7d-f267-4cae-96ed-284ee761ec3f tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Calling method '.version_select at 0x7fed5c7cba60>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:56.297885 ncdv-master-1 devstack@n-api.service[141478]: WARNING oslo_db.sqlalchemy.utils [None req-460e3f7d-f267-4cae-96ed-284ee761ec3f tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 05 20:51:56.316454 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-460e3f7d-f267-4cae-96ed-284ee761ec3f tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "GET /compute/v2.1/os-keypairs" status: 200 len: 1676 microversion: 2.1 time: 0.036672 Mar 05 20:51:56.317740 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 511/1084] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:51:56 2022] GET /compute/v2.1/os-keypairs => generated 1676 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:56.327580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e251ce7d-84cf-4604-9190-be043d928480 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c710820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:56.395071 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e251ce7d-84cf-4604-9190-be043d928480 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.072706 Mar 05 20:51:56.397974 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 512/1085] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:56 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:56.409034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-96aec494-71cb-473e-aaa4-0d13a996f091 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:56.413656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-96aec494-71cb-473e-aaa4-0d13a996f091 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:56.423023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96aec494-71cb-473e-aaa4-0d13a996f091 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:56.424277 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96aec494-71cb-473e-aaa4-0d13a996f091 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:56.425414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96aec494-71cb-473e-aaa4-0d13a996f091 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:56.426437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96aec494-71cb-473e-aaa4-0d13a996f091 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:56.708679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-96aec494-71cb-473e-aaa4-0d13a996f091 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:56.741510 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-96aec494-71cb-473e-aaa4-0d13a996f091 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1463 microversion: 2.1 time: 0.332845 Mar 05 20:51:56.742187 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 513/1086] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:56 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1463 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:56.758109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-12906ad8-89ca-4b28-8dd5-13759f3e89fa tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Calling method '.version_select at 0x7fed5c6cdf70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:56.796245 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-12906ad8-89ca-4b28-8dd5-13759f3e89fa tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1657019135" status: 202 len: 0 microversion: 2.1 time: 0.052911 Mar 05 20:51:56.796882 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 514/1087] 10.222.0.15 () {58 vars in 1277 bytes} [Sat Mar 5 20:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1657019135 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:51:56.816131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-1d18539c-79e2-4052-bf31-652952530cc0 req-0261c98b-8022-433c-9d3c-79646e0a9f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b0401ca-066c-40a5-b076-b4fd5b6ab3d2", "name": "network-vif-plugged", "status": "completed", "tag": "5c0add0b-e16b-4f33-bad0-f6bb5dbab8ca"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:56.833140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1d18539c-79e2-4052-bf31-652952530cc0 req-0261c98b-8022-433c-9d3c-79646e0a9f5f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:56.833503 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1d18539c-79e2-4052-bf31-652952530cc0 req-0261c98b-8022-433c-9d3c-79646e0a9f5f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:56.855044 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-1d18539c-79e2-4052-bf31-652952530cc0 req-0261c98b-8022-433c-9d3c-79646e0a9f5f service nova] Creating event network-vif-plugged:5c0add0b-e16b-4f33-bad0-f6bb5dbab8ca for instance 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 on nch2-master-1 Mar 05 20:51:56.877510 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-1d18539c-79e2-4052-bf31-652952530cc0 req-0261c98b-8022-433c-9d3c-79646e0a9f5f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079360 Mar 05 20:51:56.878401 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 515/1088] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:56.886802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-abca95c6-adc7-47da-8901-fbfbb6059988 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:56.895255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-abca95c6-adc7-47da-8901-fbfbb6059988 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 441213dc-2cba-4629-8bfc-3a01bbec6942] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:56.913178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abca95c6-adc7-47da-8901-fbfbb6059988 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:56.915179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abca95c6-adc7-47da-8901-fbfbb6059988 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:56.919939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abca95c6-adc7-47da-8901-fbfbb6059988 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:56.920452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abca95c6-adc7-47da-8901-fbfbb6059988 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:57.239615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-abca95c6-adc7-47da-8901-fbfbb6059988 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:57.249419 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-abca95c6-adc7-47da-8901-fbfbb6059988 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942" status: 200 len: 1474 microversion: 2.1 time: 0.368832 Mar 05 20:51:57.253422 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 516/1089] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:56 2022] GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942 => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:57.258167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5abfb7d2-7b17-4328-a226-4cfe9c5fef41 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Calling method '.version_select at 0x7fed5c710f70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:57.262881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5abfb7d2-7b17-4328-a226-4cfe9c5fef41 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:57.269795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5abfb7d2-7b17-4328-a226-4cfe9c5fef41 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:57.297156 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5abfb7d2-7b17-4328-a226-4cfe9c5fef41 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "GET /compute/v2.1/os-migrations" status: 200 len: 802 microversion: 2.1 time: 0.042397 Mar 05 20:51:57.299058 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 517/1090] 10.222.0.15 () {58 vars in 1142 bytes} [Sat Mar 5 20:51:57 2022] GET /compute/v2.1/os-migrations => generated 802 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:57.322295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-151deeca-6005-4986-927e-1696fca45984 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:57.323305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-151deeca-6005-4986-927e-1696fca45984 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:57.351309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-151deeca-6005-4986-927e-1696fca45984 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:57.353541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-151deeca-6005-4986-927e-1696fca45984 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:57.354808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-151deeca-6005-4986-927e-1696fca45984 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:57.361763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-151deeca-6005-4986-927e-1696fca45984 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:57.495780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-151deeca-6005-4986-927e-1696fca45984 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:51:57.799193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Getting quotas for project 0ff75cc228d249d1b12cd184ad1c4cde. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:57.803222 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-151deeca-6005-4986-927e-1696fca45984 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 204 len: 0 microversion: 2.1 time: 0.500025 Mar 05 20:51:57.804261 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 518/1091] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:57 2022] DELETE /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:51:57.829579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Getting quotas for user e33c3ba3d26c4664a622711cad0381a9 and project 0ff75cc228d249d1b12cd184ad1c4cde. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:57.837862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c2f22a42-7f2c-4397-8313-09a245434676 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Calling method '.version_select at 0x7fed5c99d670>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:57.914919 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c2f22a42-7f2c-4397-8313-09a245434676 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1122714080" status: 202 len: 0 microversion: 2.1 time: 0.108998 Mar 05 20:51:57.915662 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 519/1092] 10.222.0.15 () {58 vars in 1277 bytes} [Sat Mar 5 20:51:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1122714080 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:51:57.929861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:51:57.931798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:51:57.935501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:51:57.936929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-c20005c0-ca2d-429c-aa0d-bd465ad33a01 req-5f930c05-b1a1-4ef6-90aa-d6d9ad1d189c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e95742-638c-44fa-b25e-327896dbc669", "name": "network-vif-deleted", "tag": "687346d5-cf6b-4895-b648-b214a9d0b985"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:57.940114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:51:57.940814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:51:58.021970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c20005c0-ca2d-429c-aa0d-bd465ad33a01 req-5f930c05-b1a1-4ef6-90aa-d6d9ad1d189c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:58.029756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:58.033257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c20005c0-ca2d-429c-aa0d-bd465ad33a01 req-5f930c05-b1a1-4ef6-90aa-d6d9ad1d189c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:58.034303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:58.037496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:58.038701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:58.095288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Getting quotas for project 0ff75cc228d249d1b12cd184ad1c4cde. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:51:58.109903 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-c20005c0-ca2d-429c-aa0d-bd465ad33a01 req-5f930c05-b1a1-4ef6-90aa-d6d9ad1d189c service nova] Creating event network-vif-deleted:687346d5-cf6b-4895-b648-b214a9d0b985 for instance c3e95742-638c-44fa-b25e-327896dbc669 on nch1-master-1 Mar 05 20:51:58.114746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Getting quotas for user e33c3ba3d26c4664a622711cad0381a9 and project 0ff75cc228d249d1b12cd184ad1c4cde. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:51:58.128315 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-c20005c0-ca2d-429c-aa0d-bd465ad33a01 req-5f930c05-b1a1-4ef6-90aa-d6d9ad1d189c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209029 Mar 05 20:51:58.133078 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 520/1093] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:58.150820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3a44b7f2-3ad3-4a82-95cb-02b9bd7a14b6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:58.175467 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3a44b7f2-3ad3-4a82-95cb-02b9bd7a14b6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040408 Mar 05 20:51:58.196417 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 521/1094] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:51:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:58.209517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-bc9fad70-c66a-40ac-a40a-a64c46d47b54 req-a51e06ed-61b9-4b14-83a9-26e0c4a3f817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "441213dc-2cba-4629-8bfc-3a01bbec6942", "name": "network-vif-deleted", "tag": "2ce9941d-9f5c-480d-b176-f639f34c5f2f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:58.230360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-bc9fad70-c66a-40ac-a40a-a64c46d47b54 req-a51e06ed-61b9-4b14-83a9-26e0c4a3f817 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:58.232430 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-bc9fad70-c66a-40ac-a40a-a64c46d47b54 req-a51e06ed-61b9-4b14-83a9-26e0c4a3f817 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:58.275253 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-bc9fad70-c66a-40ac-a40a-a64c46d47b54 req-a51e06ed-61b9-4b14-83a9-26e0c4a3f817 service nova] Creating event network-vif-deleted:2ce9941d-9f5c-480d-b176-f639f34c5f2f for instance 441213dc-2cba-4629-8bfc-3a01bbec6942 on nch2-master-1 Mar 05 20:51:58.284347 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-bc9fad70-c66a-40ac-a40a-a64c46d47b54 req-a51e06ed-61b9-4b14-83a9-26e0c4a3f817 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084636 Mar 05 20:51:58.285087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:51:58.287965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7fab029c-6104-4f67-a93d-5c93dbea922a',volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:51:58.289518 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 522/1095] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:58.303093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5cc5a2a5-44b4-4508-bf00-f69fccd80804 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c6cd0d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:58.384870 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5cc5a2a5-44b4-4508-bf00-f69fccd80804 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.093859 Mar 05 20:51:58.386176 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 523/1096] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:58 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:58.398597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d46e4cca-7b9d-4e1e-b2fb-3429c53c8928 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:58.399857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d46e4cca-7b9d-4e1e-b2fb-3429c53c8928 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:58.420226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d46e4cca-7b9d-4e1e-b2fb-3429c53c8928 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:58.421016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d46e4cca-7b9d-4e1e-b2fb-3429c53c8928 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:58.426439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d46e4cca-7b9d-4e1e-b2fb-3429c53c8928 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:58.428094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d46e4cca-7b9d-4e1e-b2fb-3429c53c8928 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:58.614823 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5e65a327-ee11-433a-8fcd-71baf57fc4bf tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.748218 Mar 05 20:51:58.616044 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 574/1097] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:51:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 2751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:51:58.628493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9be1cc65-35ef-40d6-b991-e60aa03d4a11 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] Calling method '.version_select at 0x7fed5c4aed30>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:58.699626 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9be1cc65-35ef-40d6-b991-e60aa03d4a11 tempest-KeyPairsV2TestJSON-2109580922 tempest-KeyPairsV2TestJSON-2109580922-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2014119273" status: 202 len: 0 microversion: 2.1 time: 0.078801 Mar 05 20:51:58.708868 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 575/1098] 10.222.0.15 () {58 vars in 1277 bytes} [Sat Mar 5 20:51:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2014119273 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:51:58.718519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-897b74ab-3bf8-462f-8a00-dd5cc0779643 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-619961753", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:58.720173 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:51:58.720173 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:51:58.760289 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-897b74ab-3bf8-462f-8a00-dd5cc0779643 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.055464 Mar 05 20:51:58.760667 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 576/1099] 10.222.0.15 () {60 vars in 1145 bytes} [Sat Mar 5 20:51:58 2022] POST /compute/v2.1/flavors => generated 498 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:58.772293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ab1584b4-22b6-4946-ade1-36ee3eb9747c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:58.779637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ab1584b4-22b6-4946-ade1-36ee3eb9747c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 441213dc-2cba-4629-8bfc-3a01bbec6942] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:58.792759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab1584b4-22b6-4946-ade1-36ee3eb9747c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:58.793282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab1584b4-22b6-4946-ade1-36ee3eb9747c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:58.797396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab1584b4-22b6-4946-ade1-36ee3eb9747c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:58.798259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab1584b4-22b6-4946-ade1-36ee3eb9747c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:58.840429 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-ab1584b4-22b6-4946-ade1-36ee3eb9747c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] HTTP exception thrown: Instance 441213dc-2cba-4629-8bfc-3a01bbec6942 could not be found. Mar 05 20:51:58.841292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ab1584b4-22b6-4946-ade1-36ee3eb9747c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Returning 404 to user: Instance 441213dc-2cba-4629-8bfc-3a01bbec6942 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:58.841888 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ab1584b4-22b6-4946-ade1-36ee3eb9747c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942" status: 404 len: 111 microversion: 2.1 time: 0.080309 Mar 05 20:51:58.849202 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 577/1100] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:58 2022] GET /compute/v2.1/servers/441213dc-2cba-4629-8bfc-3a01bbec6942 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:58.859254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-778e18df-5e5f-43ad-aa72-13dc2562477e tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:58.861856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-778e18df-5e5f-43ad-aa72-13dc2562477e tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:58.864058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d46e4cca-7b9d-4e1e-b2fb-3429c53c8928 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:58.876013 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d46e4cca-7b9d-4e1e-b2fb-3429c53c8928 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1513 microversion: 2.1 time: 0.488456 Mar 05 20:51:58.879091 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 524/1101] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:58 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1513 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:58.894489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3dfcc097-e971-4dc7-a70b-556b88edf922 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:58.914411 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3dfcc097-e971-4dc7-a70b-556b88edf922 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032874 Mar 05 20:51:58.918561 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 525/1102] 10.222.0.15 () {58 vars in 1181 bytes} [Sat Mar 5 20:51:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:51:58.929773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4d863ef0-6f7e-4de0-b1d5-ba91fff05617 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:58.930470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4d863ef0-6f7e-4de0-b1d5-ba91fff05617 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: c3e95742-638c-44fa-b25e-327896dbc669] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:58.946361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d863ef0-6f7e-4de0-b1d5-ba91fff05617 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:58.947164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d863ef0-6f7e-4de0-b1d5-ba91fff05617 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:58.948239 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d863ef0-6f7e-4de0-b1d5-ba91fff05617 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:58.948892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d863ef0-6f7e-4de0-b1d5-ba91fff05617 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:58.979385 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4d863ef0-6f7e-4de0-b1d5-ba91fff05617 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] HTTP exception thrown: Instance c3e95742-638c-44fa-b25e-327896dbc669 could not be found. Mar 05 20:51:58.982534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4d863ef0-6f7e-4de0-b1d5-ba91fff05617 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Returning 404 to user: Instance c3e95742-638c-44fa-b25e-327896dbc669 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:51:58.986608 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4d863ef0-6f7e-4de0-b1d5-ba91fff05617 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669" status: 404 len: 111 microversion: 2.1 time: 0.063625 Mar 05 20:51:58.989935 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 526/1103] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:58 2022] GET /compute/v2.1/servers/c3e95742-638c-44fa-b25e-327896dbc669 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:51:58.999422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fe218659-3a0b-464d-8de0-72d9b02fc5e6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:59.056732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-778e18df-5e5f-43ad-aa72-13dc2562477e tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:51:59.067190 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-778e18df-5e5f-43ad-aa72-13dc2562477e tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1120 microversion: 2.1 time: 0.216671 Mar 05 20:51:59.076663 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 578/1104] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:58 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1120 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:59.087094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9a59a482-ed27-4974-a628-1421debe4114 req-ac2166ab-d7e0-49a2-a314-16783f0553bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54f039d-1623-4ad6-a4e3-308472493214", "name": "network-vif-plugged", "status": "completed", "tag": "6c25b98e-729b-490d-bb31-a40e13f1d945"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:59.099871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9a59a482-ed27-4974-a628-1421debe4114 req-ac2166ab-d7e0-49a2-a314-16783f0553bf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:59.100328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9a59a482-ed27-4974-a628-1421debe4114 req-ac2166ab-d7e0-49a2-a314-16783f0553bf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:59.106978 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fe218659-3a0b-464d-8de0-72d9b02fc5e6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "DELETE /compute/v2.1/os-server-groups/ae192161-3ff8-408b-8a55-08a2736d1044" status: 204 len: 0 microversion: 2.1 time: 0.113894 Mar 05 20:51:59.112887 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 527/1105] 10.222.0.15 () {58 vars in 1265 bytes} [Sat Mar 5 20:51:58 2022] DELETE /compute/v2.1/os-server-groups/ae192161-3ff8-408b-8a55-08a2736d1044 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:51:59.113845 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9a59a482-ed27-4974-a628-1421debe4114 req-ac2166ab-d7e0-49a2-a314-16783f0553bf service nova] Creating event network-vif-plugged:6c25b98e-729b-490d-bb31-a40e13f1d945 for instance d54f039d-1623-4ad6-a4e3-308472493214 on nch2-master-1 Mar 05 20:51:59.120217 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9a59a482-ed27-4974-a628-1421debe4114 req-ac2166ab-d7e0-49a2-a314-16783f0553bf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046221 Mar 05 20:51:59.122230 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 579/1106] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:51:59.130434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-86ab69d4-d0c7-4c02-a04c-ab70ba1bf638 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:59.130941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-86ab69d4-d0c7-4c02-a04c-ab70ba1bf638 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: d13582ed-3ac6-46fe-9e71-a3af018d2402] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:59.142672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86ab69d4-d0c7-4c02-a04c-ab70ba1bf638 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:59.147191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86ab69d4-d0c7-4c02-a04c-ab70ba1bf638 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:59.148238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86ab69d4-d0c7-4c02-a04c-ab70ba1bf638 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:59.150000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86ab69d4-d0c7-4c02-a04c-ab70ba1bf638 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:59.208109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-86ab69d4-d0c7-4c02-a04c-ab70ba1bf638 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: d13582ed-3ac6-46fe-9e71-a3af018d2402] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:51:59.232303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-369117443", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "3af68e85-ae9d-4b46-b42f-e35de912f6f0"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:51:59.341995 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-86ab69d4-d0c7-4c02-a04c-ab70ba1bf638 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402" status: 204 len: 0 microversion: 2.1 time: 0.226028 Mar 05 20:51:59.347020 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 528/1107] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:59 2022] DELETE /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:51:59.364127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fdc444fe-6c62-4aad-bd4f-b5c3ae61f8d6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:59.365180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fdc444fe-6c62-4aad-bd4f-b5c3ae61f8d6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:59.372147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc444fe-6c62-4aad-bd4f-b5c3ae61f8d6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:59.372817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc444fe-6c62-4aad-bd4f-b5c3ae61f8d6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:59.374281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc444fe-6c62-4aad-bd4f-b5c3ae61f8d6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:59.374882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc444fe-6c62-4aad-bd4f-b5c3ae61f8d6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:59.383647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:51:59.425818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fdc444fe-6c62-4aad-bd4f-b5c3ae61f8d6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:51:59.616423 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fdc444fe-6c62-4aad-bd4f-b5c3ae61f8d6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "DELETE /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 204 len: 0 microversion: 2.1 time: 0.265752 Mar 05 20:51:59.620785 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 529/1108] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:51:59 2022] DELETE /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:51:59.635480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a7418696-9f31-4cb3-85db-a0c40b3a8650 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c710dc0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:59.733337 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a7418696-9f31-4cb3-85db-a0c40b3a8650 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.110023 Mar 05 20:51:59.734570 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 530/1109] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:51:59 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:51:59.747061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a7634b29-f6a6-4f0e-8b3b-a38d78a5950d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:51:59.750243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a7634b29-f6a6-4f0e-8b3b-a38d78a5950d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: d13582ed-3ac6-46fe-9e71-a3af018d2402] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:51:59.771981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7634b29-f6a6-4f0e-8b3b-a38d78a5950d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:59.772442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7634b29-f6a6-4f0e-8b3b-a38d78a5950d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:51:59.775613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7634b29-f6a6-4f0e-8b3b-a38d78a5950d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:51:59.776090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7634b29-f6a6-4f0e-8b3b-a38d78a5950d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:00.315842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a7634b29-f6a6-4f0e-8b3b-a38d78a5950d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:00.324224 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a7634b29-f6a6-4f0e-8b3b-a38d78a5950d tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402" status: 200 len: 1475 microversion: 2.1 time: 0.588640 Mar 05 20:52:00.332661 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 531/1110] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:51:59 2022] GET /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402 => generated 1475 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:00.338653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-075d7a91-7d20-4bd4-a14f-fde42e9aa4a7 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:00.339584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-075d7a91-7d20-4bd4-a14f-fde42e9aa4a7 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:00.354137 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-075d7a91-7d20-4bd4-a14f-fde42e9aa4a7 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:00.355428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-075d7a91-7d20-4bd4-a14f-fde42e9aa4a7 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:00.357119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-075d7a91-7d20-4bd4-a14f-fde42e9aa4a7 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:00.368388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-075d7a91-7d20-4bd4-a14f-fde42e9aa4a7 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:01.136215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-075d7a91-7d20-4bd4-a14f-fde42e9aa4a7 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:01.146066 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-075d7a91-7d20-4bd4-a14f-fde42e9aa4a7 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1513 microversion: 2.1 time: 0.811978 Mar 05 20:52:01.155212 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 532/1111] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:00 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1513 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:01.161933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6f959df-234c-485c-929b-50f0d915660a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:01.165975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:52:01.167525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:52:01.168061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6f959df-234c-485c-929b-50f0d915660a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:01.169144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:52:01.169830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:52:01.170468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:52:01.187276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6f959df-234c-485c-929b-50f0d915660a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:01.187870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6f959df-234c-485c-929b-50f0d915660a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:01.188732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6f959df-234c-485c-929b-50f0d915660a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:01.189523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6f959df-234c-485c-929b-50f0d915660a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:01.190592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:01.191265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:01.192329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:01.195165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:01.240459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Getting quotas for project 3501f5d56344468ebc4d50db1a5c5bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:01.250950 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Getting quotas for user 52cc30e265f94e3caa91b6adff365209 and project 3501f5d56344468ebc4d50db1a5c5bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:01.284789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:52:01.293978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:52:01.392456 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-19d29d2e-40db-4bb4-a1e6-d4831c0d6faf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.163796 Mar 05 20:52:01.393174 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 580/1112] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:51:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:52:01.402877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-951110d7-62ea-40bf-ad61-d05cca1da7d3 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c5f73a0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:01.517106 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-951110d7-62ea-40bf-ad61-d05cca1da7d3 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.122824 Mar 05 20:52:01.518025 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 581/1113] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:01 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:01.526691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f1d7f61e-d442-448a-b95a-04a69951eb1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:01.527319 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f1d7f61e-d442-448a-b95a-04a69951eb1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: d13582ed-3ac6-46fe-9e71-a3af018d2402] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:01.551260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1d7f61e-d442-448a-b95a-04a69951eb1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:01.551746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1d7f61e-d442-448a-b95a-04a69951eb1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:01.552550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1d7f61e-d442-448a-b95a-04a69951eb1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:01.552993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1d7f61e-d442-448a-b95a-04a69951eb1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:01.780039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6f959df-234c-485c-929b-50f0d915660a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:01.801248 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6f959df-234c-485c-929b-50f0d915660a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1236 microversion: 2.1 time: 0.642965 Mar 05 20:52:01.811418 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 533/1114] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:01 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1236 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:01.818018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8a0dcd3c-cff5-470c-bfb3-785deb598d91 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:01.818633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8a0dcd3c-cff5-470c-bfb3-785deb598d91 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:01.915306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8a0dcd3c-cff5-470c-bfb3-785deb598d91 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:01.922637 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8a0dcd3c-cff5-470c-bfb3-785deb598d91 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1278 microversion: 2.1 time: 0.109827 Mar 05 20:52:01.927559 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 534/1115] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:01 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1278 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:02.561383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3c1ed053-51e4-4e9f-a1b0-f3322f54653a tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Calling method '.version_select at 0x7fed5c7804c0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:02.563635 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:02.563635 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:52:02.565011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3c1ed053-51e4-4e9f-a1b0-f3322f54653a tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'cdfdd91731f5478d8c867d595b7c32ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bbe16e5f2e47229965ac6b3fd5cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:02.565786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3c1ed053-51e4-4e9f-a1b0-f3322f54653a tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:02.566630 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3c1ed053-51e4-4e9f-a1b0-f3322f54653a tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.638093 Mar 05 20:52:02.567159 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 535/1116] 10.222.0.15 () {58 vars in 1166 bytes} [Sat Mar 5 20:52:01 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 639 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:02.580662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1fa0063f-6508-4864-9240-9fe78b57d955 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:02.589915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1fa0063f-6508-4864-9240-9fe78b57d955 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:02.611533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1fa0063f-6508-4864-9240-9fe78b57d955 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:02.612558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1fa0063f-6508-4864-9240-9fe78b57d955 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:02.621832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1fa0063f-6508-4864-9240-9fe78b57d955 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:02.622592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1fa0063f-6508-4864-9240-9fe78b57d955 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:02.725762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f1d7f61e-d442-448a-b95a-04a69951eb1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:02.742358 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f1d7f61e-d442-448a-b95a-04a69951eb1c tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402" status: 200 len: 1475 microversion: 2.1 time: 1.222909 Mar 05 20:52:02.747373 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 582/1117] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:01 2022] GET /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402 => generated 1475 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:02.766614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-27660bc4-74a5-4aad-947d-cf145bc8f4ee tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c4a4a60>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:02.877452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1fa0063f-6508-4864-9240-9fe78b57d955 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77d65eda4a24df3bc38b9920f99f2dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef6fdcc64421f8fb6f1d147edea70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:02.899774 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1fa0063f-6508-4864-9240-9fe78b57d955 tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 200 len: 1471 microversion: 2.1 time: 0.323888 Mar 05 20:52:02.901080 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 536/1118] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:02 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 1471 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:02.927381 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-27660bc4-74a5-4aad-947d-cf145bc8f4ee tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.176127 Mar 05 20:52:02.927951 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 583/1119] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:02 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:02.928585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1654b713-509d-4017-9391-b76cf95d99e6 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Calling method '.version_select at 0x7fed5c903ee0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:02.932779 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:02.932779 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:52:02.938471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1654b713-509d-4017-9391-b76cf95d99e6 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'cdfdd91731f5478d8c867d595b7c32ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bbe16e5f2e47229965ac6b3fd5cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:02.939736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1654b713-509d-4017-9391-b76cf95d99e6 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:02.941979 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1654b713-509d-4017-9391-b76cf95d99e6 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] 10.222.0.15 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.039118 Mar 05 20:52:02.945951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 537/1120] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:52:02 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:02.946707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ecdfd2cf-6f88-484a-95ab-7d752babe985 req-5529bbf2-d0ce-4d66-894d-a6cc99888e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e8eaaa7-dba6-4929-a216-6d81195cd7ed", "name": "network-vif-deleted", "tag": "1b198d0e-92a5-40ee-a02e-74c9206abe04"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:02.967286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-47bd0a15-e824-4069-8ed3-0122cc8ae6ae tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:02.968071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-47bd0a15-e824-4069-8ed3-0122cc8ae6ae tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:02.979512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47bd0a15-e824-4069-8ed3-0122cc8ae6ae tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:02.981373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47bd0a15-e824-4069-8ed3-0122cc8ae6ae tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:02.983086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47bd0a15-e824-4069-8ed3-0122cc8ae6ae tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:02.983923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47bd0a15-e824-4069-8ed3-0122cc8ae6ae tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:03.004614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ecdfd2cf-6f88-484a-95ab-7d752babe985 req-5529bbf2-d0ce-4d66-894d-a6cc99888e8f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:03.014921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ecdfd2cf-6f88-484a-95ab-7d752babe985 req-5529bbf2-d0ce-4d66-894d-a6cc99888e8f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:03.072054 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ecdfd2cf-6f88-484a-95ab-7d752babe985 req-5529bbf2-d0ce-4d66-894d-a6cc99888e8f service nova] Creating event network-vif-deleted:1b198d0e-92a5-40ee-a02e-74c9206abe04 for instance 5e8eaaa7-dba6-4929-a216-6d81195cd7ed on nch1-master-1 Mar 05 20:52:03.098106 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ecdfd2cf-6f88-484a-95ab-7d752babe985 req-5529bbf2-d0ce-4d66-894d-a6cc99888e8f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168879 Mar 05 20:52:03.098729 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 584/1121] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:03.134479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-414db8db-4ace-4c7f-a19f-ada85385c47d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:03.135196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-414db8db-4ace-4c7f-a19f-ada85385c47d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:03.176960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-414db8db-4ace-4c7f-a19f-ada85385c47d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:03.177336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-414db8db-4ace-4c7f-a19f-ada85385c47d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:03.190237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-414db8db-4ace-4c7f-a19f-ada85385c47d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:03.190945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-414db8db-4ace-4c7f-a19f-ada85385c47d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:03.453923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-414db8db-4ace-4c7f-a19f-ada85385c47d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:03.476439 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-414db8db-4ace-4c7f-a19f-ada85385c47d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1330 microversion: 2.1 time: 0.376229 Mar 05 20:52:03.479566 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 585/1122] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:03 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1330 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:03.502045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-37a78279-4f1b-448e-a9f7-260a949dfec5 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Calling method '.version_select at 0x7fed5c4ae430>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:03.505009 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:03.505009 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:52:03.517921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-37a78279-4f1b-448e-a9f7-260a949dfec5 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'cdfdd91731f5478d8c867d595b7c32ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bbe16e5f2e47229965ac6b3fd5cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:03.544177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-37a78279-4f1b-448e-a9f7-260a949dfec5 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:03.545886 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-37a78279-4f1b-448e-a9f7-260a949dfec5 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.053515 Mar 05 20:52:03.558266 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 586/1123] 10.222.0.15 () {58 vars in 1178 bytes} [Sat Mar 5 20:52:03 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 66 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:03.800732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-47bd0a15-e824-4069-8ed3-0122cc8ae6ae tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:03.818524 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-47bd0a15-e824-4069-8ed3-0122cc8ae6ae tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1236 microversion: 2.1 time: 0.870867 Mar 05 20:52:03.821268 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 538/1124] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:02 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1236 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:03.840945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-798db595-5475-427a-9943-4ec5a01098a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:03.841975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-798db595-5475-427a-9943-4ec5a01098a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: d13582ed-3ac6-46fe-9e71-a3af018d2402] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:03.867711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798db595-5475-427a-9943-4ec5a01098a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:03.868242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798db595-5475-427a-9943-4ec5a01098a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:03.869109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798db595-5475-427a-9943-4ec5a01098a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:03.869599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798db595-5475-427a-9943-4ec5a01098a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:03.954820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b3d4d89d-7790-4ea2-b98d-874a79114295 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Calling method '.version_select at 0x7fed5c79cd30>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:03.955646 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:03.955646 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:52:03.956999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3d4d89d-7790-4ea2-b98d-874a79114295 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:03.957457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3d4d89d-7790-4ea2-b98d-874a79114295 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.000136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3d4d89d-7790-4ea2-b98d-874a79114295 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.002099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3d4d89d-7790-4ea2-b98d-874a79114295 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.037551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3d4d89d-7790-4ea2-b98d-874a79114295 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.039516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3d4d89d-7790-4ea2-b98d-874a79114295 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.087183 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b3d4d89d-7790-4ea2-b98d-874a79114295 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.523785 Mar 05 20:52:04.092532 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 587/1125] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:52:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:04.107481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-798db595-5475-427a-9943-4ec5a01098a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:04.123467 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-798db595-5475-427a-9943-4ec5a01098a8 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402" status: 200 len: 1433 microversion: 2.1 time: 0.299481 Mar 05 20:52:04.126486 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 539/1126] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:03 2022] GET /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402 => generated 1433 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:04.137963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4eb5ab8a-6861-4b24-a1a8-0c5d3b89bfef tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:04.144225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4eb5ab8a-6861-4b24-a1a8-0c5d3b89bfef tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] [instance: 5e8eaaa7-dba6-4929-a216-6d81195cd7ed] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:04.161711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4eb5ab8a-6861-4b24-a1a8-0c5d3b89bfef tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.162194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4eb5ab8a-6861-4b24-a1a8-0c5d3b89bfef tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.166186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4eb5ab8a-6861-4b24-a1a8-0c5d3b89bfef tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.166697 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4eb5ab8a-6861-4b24-a1a8-0c5d3b89bfef tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.212505 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4eb5ab8a-6861-4b24-a1a8-0c5d3b89bfef tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] HTTP exception thrown: Instance 5e8eaaa7-dba6-4929-a216-6d81195cd7ed could not be found. Mar 05 20:52:04.213207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4eb5ab8a-6861-4b24-a1a8-0c5d3b89bfef tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] Returning 404 to user: Instance 5e8eaaa7-dba6-4929-a216-6d81195cd7ed could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:04.214184 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4eb5ab8a-6861-4b24-a1a8-0c5d3b89bfef tempest-VolumesAdminNegativeTest-945551508 tempest-VolumesAdminNegativeTest-945551508-project] 10.222.0.15 "GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed" status: 404 len: 111 microversion: 2.1 time: 0.086567 Mar 05 20:52:04.214730 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 540/1127] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:04 2022] GET /compute/v2.1/servers/5e8eaaa7-dba6-4929-a216-6d81195cd7ed => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:04.228843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dd146ff5-9153-456e-9008-6e8d23ec3f3c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c7d4c10>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:04.291407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8c73c4cb-67e8-4337-a06f-c90ebd84a81d tempest-AbsoluteLimitsNegativeTestJSON-1147662124 tempest-AbsoluteLimitsNegativeTestJSON-1147662124-project] Calling method '.version_select at 0x7fed5c4c4f70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:04.319628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c73c4cb-67e8-4337-a06f-c90ebd84a81d tempest-AbsoluteLimitsNegativeTestJSON-1147662124 tempest-AbsoluteLimitsNegativeTestJSON-1147662124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.320109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c73c4cb-67e8-4337-a06f-c90ebd84a81d tempest-AbsoluteLimitsNegativeTestJSON-1147662124 tempest-AbsoluteLimitsNegativeTestJSON-1147662124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.323931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c73c4cb-67e8-4337-a06f-c90ebd84a81d tempest-AbsoluteLimitsNegativeTestJSON-1147662124 tempest-AbsoluteLimitsNegativeTestJSON-1147662124-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.325480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c73c4cb-67e8-4337-a06f-c90ebd84a81d tempest-AbsoluteLimitsNegativeTestJSON-1147662124 tempest-AbsoluteLimitsNegativeTestJSON-1147662124-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.328802 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dd146ff5-9153-456e-9008-6e8d23ec3f3c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.109714 Mar 05 20:52:04.329792 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 541/1128] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:04 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:04.343242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-24a19148-9638-448c-86f8-f082aeebfab8 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Calling method '.version_select at 0x7fed5c7e5160>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:04.344494 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:04.344494 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:52:04.349741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-24a19148-9638-448c-86f8-f082aeebfab8 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'cdfdd91731f5478d8c867d595b7c32ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bbe16e5f2e47229965ac6b3fd5cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:04.350464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-24a19148-9638-448c-86f8-f082aeebfab8 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:04.352614 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-24a19148-9638-448c-86f8-f082aeebfab8 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.019959 Mar 05 20:52:04.353163 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 542/1129] 10.222.0.15 () {58 vars in 1172 bytes} [Sat Mar 5 20:52:04 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:04.365656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2de38b61-debf-4dd0-9115-ae3ea897aeaf tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Calling method '.version_select at 0x7fed5c695ca0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:04.379567 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-2de38b61-debf-4dd0-9115-ae3ea897aeaf tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] HTTP exception thrown: Hypervisor with ID '5e96af77-2b62-4a1f-95b9-e0035fa586f1' could not be found. Mar 05 20:52:04.380239 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2de38b61-debf-4dd0-9115-ae3ea897aeaf tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Returning 404 to user: Hypervisor with ID '5e96af77-2b62-4a1f-95b9-e0035fa586f1' could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:04.382613 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2de38b61-debf-4dd0-9115-ae3ea897aeaf tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/5e96af77-2b62-4a1f-95b9-e0035fa586f1/uptime" status: 404 len: 123 microversion: 2.1 time: 0.021447 Mar 05 20:52:04.385962 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 543/1130] 10.222.0.15 () {58 vars in 1277 bytes} [Sat Mar 5 20:52:04 2022] GET /compute/v2.1/os-hypervisors/5e96af77-2b62-4a1f-95b9-e0035fa586f1/uptime => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:52:04.391286 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8c73c4cb-67e8-4337-a06f-c90ebd84a81d tempest-AbsoluteLimitsNegativeTestJSON-1147662124 tempest-AbsoluteLimitsNegativeTestJSON-1147662124-project] 10.222.0.15 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.297932 Mar 05 20:52:04.396701 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 588/1131] 10.222.0.15 () {58 vars in 1121 bytes} [Sat Mar 5 20:52:04 2022] GET /compute/v2.1/limits => generated 511 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:04.396883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-14dd733f-8903-4260-a55f-350f3264b962 req-60046574-62c7-4ed4-be2c-f0fa11deb293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13582ed-3ac6-46fe-9e71-a3af018d2402", "name": "network-vif-deleted", "tag": "18ba91e4-2032-4765-b352-295315061de5"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:04.424187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-14dd733f-8903-4260-a55f-350f3264b962 req-60046574-62c7-4ed4-be2c-f0fa11deb293 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.427068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-14dd733f-8903-4260-a55f-350f3264b962 req-60046574-62c7-4ed4-be2c-f0fa11deb293 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.450018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b46c168a-1f6a-4ccc-925a-1f880ff0b6d3 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Calling method '.version_select at 0x7fed5c4ae1f0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:04.451936 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-14dd733f-8903-4260-a55f-350f3264b962 req-60046574-62c7-4ed4-be2c-f0fa11deb293 service nova] Creating event network-vif-deleted:18ba91e4-2032-4765-b352-295315061de5 for instance d13582ed-3ac6-46fe-9e71-a3af018d2402 on nch2-master-1 Mar 05 20:52:04.453459 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:04.453459 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:52:04.454823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b46c168a-1f6a-4ccc-925a-1f880ff0b6d3 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.455287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b46c168a-1f6a-4ccc-925a-1f880ff0b6d3 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.475624 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-14dd733f-8903-4260-a55f-350f3264b962 req-60046574-62c7-4ed4-be2c-f0fa11deb293 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088093 Mar 05 20:52:04.477887 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 544/1132] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:04.500432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6f6fd39e-0a69-4f90-9b33-2c9512562c90 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:04.501689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6f6fd39e-0a69-4f90-9b33-2c9512562c90 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:04.517224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f6fd39e-0a69-4f90-9b33-2c9512562c90 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.521058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f6fd39e-0a69-4f90-9b33-2c9512562c90 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.526627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f6fd39e-0a69-4f90-9b33-2c9512562c90 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.526751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b46c168a-1f6a-4ccc-925a-1f880ff0b6d3 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.527322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f6fd39e-0a69-4f90-9b33-2c9512562c90 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.528106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b46c168a-1f6a-4ccc-925a-1f880ff0b6d3 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.573553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b46c168a-1f6a-4ccc-925a-1f880ff0b6d3 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.574031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b46c168a-1f6a-4ccc-925a-1f880ff0b6d3 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.591753 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b46c168a-1f6a-4ccc-925a-1f880ff0b6d3 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.192560 Mar 05 20:52:04.594667 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 589/1133] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:52:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:04.609220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-372c08ee-d8ef-48c9-8027-1328ddab2add tempest-AbsoluteLimitsNegativeTestJSON-1147662124 tempest-AbsoluteLimitsNegativeTestJSON-1147662124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2016484157", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:04.738948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-372c08ee-d8ef-48c9-8027-1328ddab2add tempest-AbsoluteLimitsNegativeTestJSON-1147662124 tempest-AbsoluteLimitsNegativeTestJSON-1147662124-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:52:04.880485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6f6fd39e-0a69-4f90-9b33-2c9512562c90 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:04.914243 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6f6fd39e-0a69-4f90-9b33-2c9512562c90 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1336 microversion: 2.1 time: 0.420808 Mar 05 20:52:04.915452 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 545/1134] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:04 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1336 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:52:04.922012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6b093b84-88f8-4a6e-b902-20aea68b0ba2 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Calling method '.version_select at 0x7fed5c7b0280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:04.925248 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:04.925248 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:52:04.926800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6b093b84-88f8-4a6e-b902-20aea68b0ba2 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'cdfdd91731f5478d8c867d595b7c32ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bbe16e5f2e47229965ac6b3fd5cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:04.940109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6b093b84-88f8-4a6e-b902-20aea68b0ba2 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:04.943572 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6b093b84-88f8-4a6e-b902-20aea68b0ba2 tempest-HypervisorAdminNegativeTestJSON-1403424107 tempest-HypervisorAdminNegativeTestJSON-1403424107-project] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.025291 Mar 05 20:52:04.948310 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 546/1135] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:52:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:04.957684 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-42c3e520-c6f3-4dad-9dac-d50fe1dabe8c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:04.960065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-42c3e520-c6f3-4dad-9dac-d50fe1dabe8c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:04.971295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-42c3e520-c6f3-4dad-9dac-d50fe1dabe8c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.971781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-42c3e520-c6f3-4dad-9dac-d50fe1dabe8c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:04.972831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-42c3e520-c6f3-4dad-9dac-d50fe1dabe8c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:04.973465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-42c3e520-c6f3-4dad-9dac-d50fe1dabe8c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:05.421487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-372c08ee-d8ef-48c9-8027-1328ddab2add tempest-AbsoluteLimitsNegativeTestJSON-1147662124 tempest-AbsoluteLimitsNegativeTestJSON-1147662124-project] Getting quotas for project 6e2bbe79f74a480abf9ccf2af996265e. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:05.432754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-372c08ee-d8ef-48c9-8027-1328ddab2add tempest-AbsoluteLimitsNegativeTestJSON-1147662124 tempest-AbsoluteLimitsNegativeTestJSON-1147662124-project] Getting quotas for user 0b442c50a5254bc5b50620ce0c7eb86e and project 6e2bbe79f74a480abf9ccf2af996265e. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:05.462977 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-372c08ee-d8ef-48c9-8027-1328ddab2add tempest-AbsoluteLimitsNegativeTestJSON-1147662124 tempest-AbsoluteLimitsNegativeTestJSON-1147662124-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Mar 05 20:52:05.463608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-372c08ee-d8ef-48c9-8027-1328ddab2add tempest-AbsoluteLimitsNegativeTestJSON-1147662124 tempest-AbsoluteLimitsNegativeTestJSON-1147662124-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:05.464510 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-372c08ee-d8ef-48c9-8027-1328ddab2add tempest-AbsoluteLimitsNegativeTestJSON-1147662124 tempest-AbsoluteLimitsNegativeTestJSON-1147662124-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.868440 Mar 05 20:52:05.466085 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 590/1136] 10.222.0.15 () {60 vars in 1147 bytes} [Sat Mar 5 20:52:04 2022] POST /compute/v2.1/servers => generated 87 bytes in 871 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:52:05.472039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3ddaab10-6cd7-4cf7-b1f4-fbea4854abf5 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Calling method '.version_select at 0x7fed5c4a4c10>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:05.473469 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:05.473469 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:52:05.475536 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-3ddaab10-6cd7-4cf7-b1f4-fbea4854abf5 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] HTTP exception thrown: Hypervisor with ID '014ec782-9073-4bb6-bf5b-0e10e26a812a' could not be found. Mar 05 20:52:05.476672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3ddaab10-6cd7-4cf7-b1f4-fbea4854abf5 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] Returning 404 to user: Hypervisor with ID '014ec782-9073-4bb6-bf5b-0e10e26a812a' could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:05.478008 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3ddaab10-6cd7-4cf7-b1f4-fbea4854abf5 tempest-HypervisorAdminNegativeTestJSON-62924202 tempest-HypervisorAdminNegativeTestJSON-62924202-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/014ec782-9073-4bb6-bf5b-0e10e26a812a" status: 404 len: 123 microversion: 2.1 time: 0.010736 Mar 05 20:52:05.478970 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 591/1137] 10.222.0.15 () {58 vars in 1256 bytes} [Sat Mar 5 20:52:05 2022] GET /compute/v2.1/os-hypervisors/014ec782-9073-4bb6-bf5b-0e10e26a812a => generated 123 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:05.486685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dd53b6fe-8f8f-457a-ba2f-93ee035149b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:05.488545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dd53b6fe-8f8f-457a-ba2f-93ee035149b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: d13582ed-3ac6-46fe-9e71-a3af018d2402] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:05.498014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd53b6fe-8f8f-457a-ba2f-93ee035149b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:05.498813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd53b6fe-8f8f-457a-ba2f-93ee035149b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:05.499921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd53b6fe-8f8f-457a-ba2f-93ee035149b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:05.500714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd53b6fe-8f8f-457a-ba2f-93ee035149b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:05.528492 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-dd53b6fe-8f8f-457a-ba2f-93ee035149b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] HTTP exception thrown: Instance d13582ed-3ac6-46fe-9e71-a3af018d2402 could not be found. Mar 05 20:52:05.529973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dd53b6fe-8f8f-457a-ba2f-93ee035149b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Returning 404 to user: Instance d13582ed-3ac6-46fe-9e71-a3af018d2402 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:05.531337 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dd53b6fe-8f8f-457a-ba2f-93ee035149b6 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402" status: 404 len: 111 microversion: 2.1 time: 0.050673 Mar 05 20:52:05.532523 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 592/1138] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:05 2022] GET /compute/v2.1/servers/d13582ed-3ac6-46fe-9e71-a3af018d2402 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:05.541056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d76b12eb-329d-4d21-b2f6-df15d3b1643d tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c4cc040>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:05.634496 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d76b12eb-329d-4d21-b2f6-df15d3b1643d tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.099461 Mar 05 20:52:05.636137 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 593/1139] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:05 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:05.646564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e079db01-8775-4d6d-9204-0d3e9c8557ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:05.649633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e079db01-8775-4d6d-9204-0d3e9c8557ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:05.709847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e079db01-8775-4d6d-9204-0d3e9c8557ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:05.716470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e079db01-8775-4d6d-9204-0d3e9c8557ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:05.717696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e079db01-8775-4d6d-9204-0d3e9c8557ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:05.718612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e079db01-8775-4d6d-9204-0d3e9c8557ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:05.985351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-42c3e520-c6f3-4dad-9dac-d50fe1dabe8c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:05.993317 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-42c3e520-c6f3-4dad-9dac-d50fe1dabe8c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1291 microversion: 2.1 time: 1.043315 Mar 05 20:52:05.996399 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 547/1140] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:04 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1291 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:06.010399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-90c6e875-a4c5-4be0-8f82-637378ce7993 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:06.015940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-90c6e875-a4c5-4be0-8f82-637378ce7993 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:06.022957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90c6e875-a4c5-4be0-8f82-637378ce7993 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:06.033433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90c6e875-a4c5-4be0-8f82-637378ce7993 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:06.034311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90c6e875-a4c5-4be0-8f82-637378ce7993 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:06.034731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90c6e875-a4c5-4be0-8f82-637378ce7993 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:06.053481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e079db01-8775-4d6d-9204-0d3e9c8557ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:06.063481 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e079db01-8775-4d6d-9204-0d3e9c8557ca tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 200 len: 1475 microversion: 2.1 time: 0.423048 Mar 05 20:52:06.074092 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 594/1141] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:05 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 1475 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:06.257149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-90c6e875-a4c5-4be0-8f82-637378ce7993 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:06.268667 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-90c6e875-a4c5-4be0-8f82-637378ce7993 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1336 microversion: 2.1 time: 0.270280 Mar 05 20:52:06.269263 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 548/1142] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:05 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1336 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:06.405589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-636a4124-9cbd-43c8-8462-31380738456c req-54719808-6d48-4729-ae8d-d7299223da0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa21d40-79bf-46fd-8cd9-0b00668e875c", "name": "network-vif-deleted", "tag": "7816a992-0d79-44b6-8e6b-38df5012bd45"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:06.432956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-636a4124-9cbd-43c8-8462-31380738456c req-54719808-6d48-4729-ae8d-d7299223da0a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:06.433698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-636a4124-9cbd-43c8-8462-31380738456c req-54719808-6d48-4729-ae8d-d7299223da0a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:06.464622 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-636a4124-9cbd-43c8-8462-31380738456c req-54719808-6d48-4729-ae8d-d7299223da0a service nova] Creating event network-vif-deleted:7816a992-0d79-44b6-8e6b-38df5012bd45 for instance caa21d40-79bf-46fd-8cd9-0b00668e875c on nch2-master-1 Mar 05 20:52:06.480424 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-636a4124-9cbd-43c8-8462-31380738456c req-54719808-6d48-4729-ae8d-d7299223da0a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081571 Mar 05 20:52:06.484360 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 595/1143] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:06.649867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c624ea06-ee88-4e04-b4f9-2df330cce98f tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c695a60>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:06.774028 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c624ea06-ee88-4e04-b4f9-2df330cce98f tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.126740 Mar 05 20:52:06.782347 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 549/1144] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:06 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:07.014338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7fbdafa3-5da9-4b15-b9ce-c65121a7947a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:07.015064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7fbdafa3-5da9-4b15-b9ce-c65121a7947a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:07.027221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fbdafa3-5da9-4b15-b9ce-c65121a7947a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:07.035428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fbdafa3-5da9-4b15-b9ce-c65121a7947a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:07.036564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fbdafa3-5da9-4b15-b9ce-c65121a7947a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:07.040433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fbdafa3-5da9-4b15-b9ce-c65121a7947a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:07.082848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a2189cd2-c893-4c51-a206-a91d239bb33e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:07.083473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a2189cd2-c893-4c51-a206-a91d239bb33e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: caa21d40-79bf-46fd-8cd9-0b00668e875c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:07.096474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a2189cd2-c893-4c51-a206-a91d239bb33e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:07.096926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a2189cd2-c893-4c51-a206-a91d239bb33e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:07.103518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a2189cd2-c893-4c51-a206-a91d239bb33e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:07.103966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a2189cd2-c893-4c51-a206-a91d239bb33e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:07.141447 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-a2189cd2-c893-4c51-a206-a91d239bb33e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] HTTP exception thrown: Instance caa21d40-79bf-46fd-8cd9-0b00668e875c could not be found. Mar 05 20:52:07.142248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a2189cd2-c893-4c51-a206-a91d239bb33e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Returning 404 to user: Instance caa21d40-79bf-46fd-8cd9-0b00668e875c could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:07.143250 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a2189cd2-c893-4c51-a206-a91d239bb33e tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c" status: 404 len: 111 microversion: 2.1 time: 0.065070 Mar 05 20:52:07.144176 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 550/1145] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:07 2022] GET /compute/v2.1/servers/caa21d40-79bf-46fd-8cd9-0b00668e875c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:07.151992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9c76b7e6-ed2c-4512-bb59-b2e0bfe56d12 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:07.204943 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9c76b7e6-ed2c-4512-bb59-b2e0bfe56d12 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "DELETE /compute/v2.1/os-server-groups/61eb2945-c0e1-4883-981b-181a2824a316" status: 204 len: 0 microversion: 2.1 time: 0.056876 Mar 05 20:52:07.205516 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 551/1146] 10.222.0.15 () {58 vars in 1265 bytes} [Sat Mar 5 20:52:07 2022] DELETE /compute/v2.1/os-server-groups/61eb2945-c0e1-4883-981b-181a2824a316 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:07.213311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f46bcc3b-50a6-428c-872d-1913608f8b5b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:07.214414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f46bcc3b-50a6-428c-872d-1913608f8b5b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:07.225680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f46bcc3b-50a6-428c-872d-1913608f8b5b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:07.226509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f46bcc3b-50a6-428c-872d-1913608f8b5b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:07.227510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f46bcc3b-50a6-428c-872d-1913608f8b5b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:07.228199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f46bcc3b-50a6-428c-872d-1913608f8b5b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:07.254996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f46bcc3b-50a6-428c-872d-1913608f8b5b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:52:07.380799 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f46bcc3b-50a6-428c-872d-1913608f8b5b tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 204 len: 0 microversion: 2.1 time: 0.170747 Mar 05 20:52:07.381327 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 552/1147] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:52:07 2022] DELETE /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 20:52:07.404664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-92d36885-34e6-4b01-aff0-8c1a2320bf8d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:07.406370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-92d36885-34e6-4b01-aff0-8c1a2320bf8d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:07.426735 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92d36885-34e6-4b01-aff0-8c1a2320bf8d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:07.427450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92d36885-34e6-4b01-aff0-8c1a2320bf8d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:07.428414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92d36885-34e6-4b01-aff0-8c1a2320bf8d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:07.429005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92d36885-34e6-4b01-aff0-8c1a2320bf8d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:07.801455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7fbdafa3-5da9-4b15-b9ce-c65121a7947a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:07.810638 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7fbdafa3-5da9-4b15-b9ce-c65121a7947a tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1291 microversion: 2.1 time: 0.801358 Mar 05 20:52:07.816137 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 596/1148] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:07 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1291 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:07.829185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-86cd1892-0439-4f48-a369-97a167def901 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:07.843780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-86cd1892-0439-4f48-a369-97a167def901 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:07.859553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86cd1892-0439-4f48-a369-97a167def901 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:07.860043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86cd1892-0439-4f48-a369-97a167def901 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:07.860858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86cd1892-0439-4f48-a369-97a167def901 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:07.861304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86cd1892-0439-4f48-a369-97a167def901 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:08.348098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-86cd1892-0439-4f48-a369-97a167def901 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:08.361164 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-86cd1892-0439-4f48-a369-97a167def901 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1471 microversion: 2.1 time: 0.539957 Mar 05 20:52:08.372113 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 597/1149] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:07 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1471 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:08.396682 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-423d7122-4c95-4502-aad8-3b4da8d38333 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c5f7430>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:08.509736 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-423d7122-4c95-4502-aad8-3b4da8d38333 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.136189 Mar 05 20:52:08.517883 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 598/1150] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:08 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:08.648505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-92d36885-34e6-4b01-aff0-8c1a2320bf8d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:08.672678 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-92d36885-34e6-4b01-aff0-8c1a2320bf8d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1378 microversion: 2.1 time: 1.288531 Mar 05 20:52:08.675396 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 553/1151] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:07 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1378 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:08.836003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-308ae6b8-e6fd-40f0-badb-a7fb547a18e8 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:08.837943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-308ae6b8-e6fd-40f0-badb-a7fb547a18e8 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:08.852777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-308ae6b8-e6fd-40f0-badb-a7fb547a18e8 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:08.854420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-308ae6b8-e6fd-40f0-badb-a7fb547a18e8 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:08.856708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-308ae6b8-e6fd-40f0-badb-a7fb547a18e8 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:08.860136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-308ae6b8-e6fd-40f0-badb-a7fb547a18e8 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:09.382181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-49d16412-b4d2-4cfa-98c5-a8a333881d5f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:09.383129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-49d16412-b4d2-4cfa-98c5-a8a333881d5f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:09.402917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49d16412-b4d2-4cfa-98c5-a8a333881d5f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:09.404913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49d16412-b4d2-4cfa-98c5-a8a333881d5f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:09.406017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49d16412-b4d2-4cfa-98c5-a8a333881d5f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:09.406645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49d16412-b4d2-4cfa-98c5-a8a333881d5f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:10.035020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-308ae6b8-e6fd-40f0-badb-a7fb547a18e8 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:10.081971 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-308ae6b8-e6fd-40f0-badb-a7fb547a18e8 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1291 microversion: 2.1 time: 1.245475 Mar 05 20:52:10.086951 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 599/1152] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:08 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1291 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:10.113991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67c1416b-105e-4cae-b01a-6ba571eb6c9b tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c606af0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:10.212403 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67c1416b-105e-4cae-b01a-6ba571eb6c9b tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.122208 Mar 05 20:52:10.213329 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 600/1153] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:10 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:10.240866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6e7cda7c-22d5-4b49-a5e4-49882b171742 req-6b0873b9-1e6d-41e7-b9d8-977c036520fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7325377-2828-4f76-82f5-84a025e75574", "tag": "987d4803-9ee7-4faf-842e-7a86e2732a1a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:10.289189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6e7cda7c-22d5-4b49-a5e4-49882b171742 req-6b0873b9-1e6d-41e7-b9d8-977c036520fc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:10.301371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6e7cda7c-22d5-4b49-a5e4-49882b171742 req-6b0873b9-1e6d-41e7-b9d8-977c036520fc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:10.327287 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6e7cda7c-22d5-4b49-a5e4-49882b171742 req-6b0873b9-1e6d-41e7-b9d8-977c036520fc service nova] Creating event network-changed:987d4803-9ee7-4faf-842e-7a86e2732a1a for instance e7325377-2828-4f76-82f5-84a025e75574 on nch1-master-1 Mar 05 20:52:10.338107 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6e7cda7c-22d5-4b49-a5e4-49882b171742 req-6b0873b9-1e6d-41e7-b9d8-977c036520fc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110418 Mar 05 20:52:10.350145 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 601/1154] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:10.354838 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-133915b4-a04e-4632-8bca-025f62162c37 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:10.356779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-133915b4-a04e-4632-8bca-025f62162c37 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:10.369689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-133915b4-a04e-4632-8bca-025f62162c37 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:10.374094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-133915b4-a04e-4632-8bca-025f62162c37 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:10.375928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-133915b4-a04e-4632-8bca-025f62162c37 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:10.377443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-133915b4-a04e-4632-8bca-025f62162c37 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:10.545874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-49d16412-b4d2-4cfa-98c5-a8a333881d5f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:10.556517 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-49d16412-b4d2-4cfa-98c5-a8a333881d5f tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1471 microversion: 2.1 time: 1.177295 Mar 05 20:52:10.560922 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 554/1155] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:09 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1471 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:52:11.104085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd1c71b7-7e1c-4b00-8584-a89703a3ec84 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:11.105150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd1c71b7-7e1c-4b00-8584-a89703a3ec84 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:11.120853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1c71b7-7e1c-4b00-8584-a89703a3ec84 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:11.125121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1c71b7-7e1c-4b00-8584-a89703a3ec84 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:11.128520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1c71b7-7e1c-4b00-8584-a89703a3ec84 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:11.129794 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1c71b7-7e1c-4b00-8584-a89703a3ec84 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:11.306104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-133915b4-a04e-4632-8bca-025f62162c37 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:11.316185 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-133915b4-a04e-4632-8bca-025f62162c37 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1378 microversion: 2.1 time: 0.971659 Mar 05 20:52:11.317463 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 602/1156] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:10 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1378 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:11.322603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c961f5f9-c4d1-43b3-bb77-7a2faffbd460 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c45bee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:11.390652 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c961f5f9-c4d1-43b3-bb77-7a2faffbd460 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.071891 Mar 05 20:52:11.391353 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 603/1157] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:11 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:11.579838 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-03ccfe26-eb02-4eb5-8ecb-3907c3d3ed85 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:11.580812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-03ccfe26-eb02-4eb5-8ecb-3907c3d3ed85 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:11.593601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03ccfe26-eb02-4eb5-8ecb-3907c3d3ed85 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:11.603907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03ccfe26-eb02-4eb5-8ecb-3907c3d3ed85 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:11.603907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03ccfe26-eb02-4eb5-8ecb-3907c3d3ed85 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:11.604337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03ccfe26-eb02-4eb5-8ecb-3907c3d3ed85 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:11.752002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-03ccfe26-eb02-4eb5-8ecb-3907c3d3ed85 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d9d88f4b414d5492bcf673e7105551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce49b47d2cef4fddbfdb7b5f00004b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:11.767253 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-03ccfe26-eb02-4eb5-8ecb-3907c3d3ed85 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 200 len: 1429 microversion: 2.1 time: 0.192746 Mar 05 20:52:11.767895 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 604/1158] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:11 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 1429 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:52:12.110256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd1c71b7-7e1c-4b00-8584-a89703a3ec84 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:12.126165 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd1c71b7-7e1c-4b00-8584-a89703a3ec84 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1291 microversion: 2.1 time: 1.024029 Mar 05 20:52:12.127006 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 555/1159] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:11 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1291 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:12.334661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fc410457-79f3-41c3-8973-e23c73bb57c4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:12.334661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fc410457-79f3-41c3-8973-e23c73bb57c4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:12.341790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc410457-79f3-41c3-8973-e23c73bb57c4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:12.342248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc410457-79f3-41c3-8973-e23c73bb57c4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:12.343048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc410457-79f3-41c3-8973-e23c73bb57c4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:12.343504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc410457-79f3-41c3-8973-e23c73bb57c4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:12.404906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fe411d53-19a0-430d-84cd-a88d257cc80a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c710e50>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:12.523739 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fe411d53-19a0-430d-84cd-a88d257cc80a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.121049 Mar 05 20:52:12.528297 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 556/1160] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:12 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:12.926930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fc410457-79f3-41c3-8973-e23c73bb57c4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:12.986137 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fc410457-79f3-41c3-8973-e23c73bb57c4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1378 microversion: 2.1 time: 0.655871 Mar 05 20:52:13.000220 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 605/1161] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:12 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1378 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:13.006156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-0f440594-45e1-4396-ae41-126d38b1127d req-2e4080bf-77f4-46b7-8021-86f32f392ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a4bc94-61de-4cb5-8c5a-4ba4dc781ada", "tag": "a62edc1f-925c-416d-82a9-ced25df2b5e2"}, {"server_uuid": "7f00577b-ab4a-4e3c-b42d-53f30d4a34bd", "name": "network-vif-deleted", "tag": "641ae876-922a-4e29-be45-f8fac1e96f2e"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:13.027107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0f440594-45e1-4396-ae41-126d38b1127d req-2e4080bf-77f4-46b7-8021-86f32f392ba6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:13.028894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0f440594-45e1-4396-ae41-126d38b1127d req-2e4080bf-77f4-46b7-8021-86f32f392ba6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:13.045321 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0f440594-45e1-4396-ae41-126d38b1127d req-2e4080bf-77f4-46b7-8021-86f32f392ba6 service nova] Creating event network-changed:a62edc1f-925c-416d-82a9-ced25df2b5e2 for instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada on nch1-master-1 Mar 05 20:52:13.046153 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0f440594-45e1-4396-ae41-126d38b1127d req-2e4080bf-77f4-46b7-8021-86f32f392ba6 service nova] Creating event network-vif-deleted:641ae876-922a-4e29-be45-f8fac1e96f2e for instance 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd on nch2-master-1 Mar 05 20:52:13.160706 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-0f440594-45e1-4396-ae41-126d38b1127d req-2e4080bf-77f4-46b7-8021-86f32f392ba6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.159071 Mar 05 20:52:13.161363 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 606/1162] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:13.167220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-de0e5a78-7cdd-4b92-a626-904103d7cfb5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:13.168572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-de0e5a78-7cdd-4b92-a626-904103d7cfb5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] [instance: 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:13.168964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b20ae20f-7ba1-4f93-8912-ce3ee9596caf tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Action: 'create', calling method: .version_select at 0x7fed5c7e5940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-28077918", "description": "tempest-description-1638635279"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:13.193276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de0e5a78-7cdd-4b92-a626-904103d7cfb5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:13.193745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de0e5a78-7cdd-4b92-a626-904103d7cfb5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:13.194554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de0e5a78-7cdd-4b92-a626-904103d7cfb5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:13.196268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de0e5a78-7cdd-4b92-a626-904103d7cfb5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:13.221492 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-de0e5a78-7cdd-4b92-a626-904103d7cfb5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] HTTP exception thrown: Instance 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd could not be found. Mar 05 20:52:13.222274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-de0e5a78-7cdd-4b92-a626-904103d7cfb5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] Returning 404 to user: Instance 7f00577b-ab4a-4e3c-b42d-53f30d4a34bd could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:13.223333 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-de0e5a78-7cdd-4b92-a626-904103d7cfb5 tempest-ServersOnMultiNodesTest-1481026260 tempest-ServersOnMultiNodesTest-1481026260-project] 10.222.0.15 "GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd" status: 404 len: 111 microversion: 2.1 time: 0.060756 Mar 05 20:52:13.224064 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 607/1163] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:13 2022] GET /compute/v2.1/servers/7f00577b-ab4a-4e3c-b42d-53f30d4a34bd => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:13.234242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c4ac771-4593-4a16-890b-0701cc12bfb9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:13.234866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9c4ac771-4593-4a16-890b-0701cc12bfb9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:13.253493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c4ac771-4593-4a16-890b-0701cc12bfb9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:13.253959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c4ac771-4593-4a16-890b-0701cc12bfb9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:13.254759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c4ac771-4593-4a16-890b-0701cc12bfb9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:13.255206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c4ac771-4593-4a16-890b-0701cc12bfb9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:13.739522 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b20ae20f-7ba1-4f93-8912-ce3ee9596caf tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.209587 Mar 05 20:52:13.740230 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 557/1164] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:52:12 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:13.751416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a21fcab5-597b-4248-a0c0-99efa71ed0a3 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c737940>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:13.834208 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a21fcab5-597b-4248-a0c0-99efa71ed0a3 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.092683 Mar 05 20:52:13.834998 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 558/1165] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:13 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:13.840123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1724f9de-8ed9-413e-a2f0-75a19af2f745 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Action: 'create', calling method: .version_select at 0x7fed5c7d4ca0>, body: {"security_group_rule": {"parent_group_id": "313e7985-2478-4ea8-af00-f70a47614de0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:13.908598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9c4ac771-4593-4a16-890b-0701cc12bfb9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:13.917226 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c4ac771-4593-4a16-890b-0701cc12bfb9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1291 microversion: 2.1 time: 0.692028 Mar 05 20:52:13.932797 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 608/1166] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:13 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1291 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:14.003988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cadfa94d-8b1f-49c1-a5b9-8826054b19dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:14.004618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cadfa94d-8b1f-49c1-a5b9-8826054b19dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:14.016023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cadfa94d-8b1f-49c1-a5b9-8826054b19dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:14.033052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cadfa94d-8b1f-49c1-a5b9-8826054b19dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:14.035769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cadfa94d-8b1f-49c1-a5b9-8826054b19dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:14.036407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cadfa94d-8b1f-49c1-a5b9-8826054b19dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:14.514496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cadfa94d-8b1f-49c1-a5b9-8826054b19dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:14.525671 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cadfa94d-8b1f-49c1-a5b9-8826054b19dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1378 microversion: 2.1 time: 0.526589 Mar 05 20:52:14.539226 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 609/1167] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:13 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1378 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:52:14.882718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8d7d2eea-b868-4aac-a957-d6643c773e7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Calling method '.version_select at 0x7fed5c4a4670>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:14.885050 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:14.885050 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:52:14.886699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d7d2eea-b868-4aac-a957-d6643c773e7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:14.887362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d7d2eea-b868-4aac-a957-d6643c773e7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:14.914904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d7d2eea-b868-4aac-a957-d6643c773e7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:14.916185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d7d2eea-b868-4aac-a957-d6643c773e7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:14.929884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d7d2eea-b868-4aac-a957-d6643c773e7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:14.930540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d7d2eea-b868-4aac-a957-d6643c773e7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:14.942553 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8d7d2eea-b868-4aac-a957-d6643c773e7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.401851 Mar 05 20:52:14.952055 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 610/1168] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:52:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:14.977478 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1724f9de-8ed9-413e-a2f0-75a19af2f745 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.141131 Mar 05 20:52:14.979299 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 559/1169] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 20:52:13 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:14.985687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f677b2ec-6047-4173-88de-ea3192268556 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c780310>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:15.063414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6b561bc4-d1e3-4f2e-9575-de6f2434c7c3 tempest-AbsoluteLimitsTestJSON-2037693013 tempest-AbsoluteLimitsTestJSON-2037693013-project] Calling method '.version_select at 0x7fed5c4a4280>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:15.063631 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f677b2ec-6047-4173-88de-ea3192268556 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.082943 Mar 05 20:52:15.065350 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 560/1170] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:14 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:15.077091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b95c5f10-08ba-4c5e-af84-83065b390701 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:15.078094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b95c5f10-08ba-4c5e-af84-83065b390701 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:15.078484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b561bc4-d1e3-4f2e-9575-de6f2434c7c3 tempest-AbsoluteLimitsTestJSON-2037693013 tempest-AbsoluteLimitsTestJSON-2037693013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:15.079118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b561bc4-d1e3-4f2e-9575-de6f2434c7c3 tempest-AbsoluteLimitsTestJSON-2037693013 tempest-AbsoluteLimitsTestJSON-2037693013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:15.080643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b561bc4-d1e3-4f2e-9575-de6f2434c7c3 tempest-AbsoluteLimitsTestJSON-2037693013 tempest-AbsoluteLimitsTestJSON-2037693013-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:15.082240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b561bc4-d1e3-4f2e-9575-de6f2434c7c3 tempest-AbsoluteLimitsTestJSON-2037693013 tempest-AbsoluteLimitsTestJSON-2037693013-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:15.093776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b95c5f10-08ba-4c5e-af84-83065b390701 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:15.095853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b95c5f10-08ba-4c5e-af84-83065b390701 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:15.098051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b95c5f10-08ba-4c5e-af84-83065b390701 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:15.098751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b95c5f10-08ba-4c5e-af84-83065b390701 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:15.125500 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6b561bc4-d1e3-4f2e-9575-de6f2434c7c3 tempest-AbsoluteLimitsTestJSON-2037693013 tempest-AbsoluteLimitsTestJSON-2037693013-project] 10.222.0.15 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.171920 Mar 05 20:52:15.127215 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 611/1171] 10.222.0.15 () {58 vars in 1121 bytes} [Sat Mar 5 20:52:14 2022] GET /compute/v2.1/limits => generated 511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:15.434034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0d54a5e-b256-41ca-986d-b2dbe5a77f3b tempest-HypervisorAdminNegativeUnderV252Test-1024346039 tempest-HypervisorAdminNegativeUnderV252Test-1024346039-project] Calling method '.version_select at 0x7fed5c4ccf70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:15.434963 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:15.434963 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:52:15.438643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a0d54a5e-b256-41ca-986d-b2dbe5a77f3b tempest-HypervisorAdminNegativeUnderV252Test-1024346039 tempest-HypervisorAdminNegativeUnderV252Test-1024346039-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '120deb81da244cb7ba326f393d896e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fab54036dea43e481829531ed2511ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:15.440740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0d54a5e-b256-41ca-986d-b2dbe5a77f3b tempest-HypervisorAdminNegativeUnderV252Test-1024346039 tempest-HypervisorAdminNegativeUnderV252Test-1024346039-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:15.453102 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0d54a5e-b256-41ca-986d-b2dbe5a77f3b tempest-HypervisorAdminNegativeUnderV252Test-1024346039 tempest-HypervisorAdminNegativeUnderV252Test-1024346039-project] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.323932 Mar 05 20:52:15.461430 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 612/1172] 10.222.0.15 () {58 vars in 1208 bytes} [Sat Mar 5 20:52:15 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 333 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:15.467944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b9040fe8-efa4-43b7-af04-16b67c5b396f tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Action: 'create', calling method: .version_select at 0x7fed5c45b8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2135394515", "description": "tempest-description-1610345610"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:15.562467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b95c5f10-08ba-4c5e-af84-83065b390701 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:15.576620 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b95c5f10-08ba-4c5e-af84-83065b390701 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1291 microversion: 2.1 time: 0.509935 Mar 05 20:52:15.587336 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 561/1173] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:15 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1291 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:15.594140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74f9363d-be2e-47a8-a787-62a55188889a tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Calling method '.version_select at 0x7fed5c8359d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:15.595355 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:15.595355 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:52:15.597327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74f9363d-be2e-47a8-a787-62a55188889a tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:15.597958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74f9363d-be2e-47a8-a787-62a55188889a tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:15.604570 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-74f9363d-be2e-47a8-a787-62a55188889a tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Mar 05 20:52:15.605424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74f9363d-be2e-47a8-a787-62a55188889a tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:15.606492 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-74f9363d-be2e-47a8-a787-62a55188889a tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.017754 Mar 05 20:52:15.607601 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 562/1174] 10.222.0.15 () {58 vars in 1250 bytes} [Sat Mar 5 20:52:15 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:15.633521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-52a5f727-9d6c-4aa9-84cd-a26a63c9899d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:15.639317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-52a5f727-9d6c-4aa9-84cd-a26a63c9899d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:15.660923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a5f727-9d6c-4aa9-84cd-a26a63c9899d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:15.662355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a5f727-9d6c-4aa9-84cd-a26a63c9899d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:15.663729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a5f727-9d6c-4aa9-84cd-a26a63c9899d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:15.665643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a5f727-9d6c-4aa9-84cd-a26a63c9899d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:16.076205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-52a5f727-9d6c-4aa9-84cd-a26a63c9899d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:16.086111 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-52a5f727-9d6c-4aa9-84cd-a26a63c9899d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1378 microversion: 2.1 time: 0.477209 Mar 05 20:52:16.088533 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 563/1175] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:15 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1378 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:16.104871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-086b3ca8-b36c-4b4b-a4c6-d695aa628a38 tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Calling method '.version_select at 0x7fed5c7804c0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:16.108849 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:16.108849 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:52:16.112526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-086b3ca8-b36c-4b4b-a4c6-d695aa628a38 tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:16.113881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-086b3ca8-b36c-4b4b-a4c6-d695aa628a38 tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:16.156036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-086b3ca8-b36c-4b4b-a4c6-d695aa628a38 tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:16.156816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-086b3ca8-b36c-4b4b-a4c6-d695aa628a38 tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:16.186069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-086b3ca8-b36c-4b4b-a4c6-d695aa628a38 tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:16.189057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-086b3ca8-b36c-4b4b-a4c6-d695aa628a38 tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:16.202414 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-086b3ca8-b36c-4b4b-a4c6-d695aa628a38 tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.109751 Mar 05 20:52:16.208795 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 564/1176] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:52:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:16.214384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-334fcc21-913f-4b70-adfc-c35f5bf3163c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c7e58b0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:16.267342 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-334fcc21-913f-4b70-adfc-c35f5bf3163c tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.056993 Mar 05 20:52:16.268620 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 565/1177] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:16 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:16.273471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5d1c2a9c-417a-48cd-a031-90359a2c315b tempest-HypervisorAdminNegativeUnderV252Test-1024346039 tempest-HypervisorAdminNegativeUnderV252Test-1024346039-project] Calling method '.version_select at 0x7fed5c69f0d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:16.275291 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:16.275291 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:52:16.276911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5d1c2a9c-417a-48cd-a031-90359a2c315b tempest-HypervisorAdminNegativeUnderV252Test-1024346039 tempest-HypervisorAdminNegativeUnderV252Test-1024346039-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '120deb81da244cb7ba326f393d896e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fab54036dea43e481829531ed2511ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:16.277872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5d1c2a9c-417a-48cd-a031-90359a2c315b tempest-HypervisorAdminNegativeUnderV252Test-1024346039 tempest-HypervisorAdminNegativeUnderV252Test-1024346039-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:16.279177 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5d1c2a9c-417a-48cd-a031-90359a2c315b tempest-HypervisorAdminNegativeUnderV252Test-1024346039 tempest-HypervisorAdminNegativeUnderV252Test-1024346039-project] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009330 Mar 05 20:52:16.285572 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 566/1178] 10.222.0.15 () {58 vars in 1175 bytes} [Sat Mar 5 20:52:16 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:16.291511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a5203c2a-9f04-4c17-b3a5-51e6bd6c5d7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Calling method '.version_select at 0x7fed5c6c0700>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:16.294536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5203c2a-9f04-4c17-b3a5-51e6bd6c5d7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:16.295595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5203c2a-9f04-4c17-b3a5-51e6bd6c5d7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:16.302940 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-a5203c2a-9f04-4c17-b3a5-51e6bd6c5d7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] HTTP exception thrown: No hypervisor matching '3d1f327f-fed1-49de-8b52-a2a5cddcd0f8' could be found. Mar 05 20:52:16.303905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a5203c2a-9f04-4c17-b3a5-51e6bd6c5d7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] Returning 404 to user: No hypervisor matching '3d1f327f-fed1-49de-8b52-a2a5cddcd0f8' could be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:16.304967 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a5203c2a-9f04-4c17-b3a5-51e6bd6c5d7d tempest-HypervisorAdminNegativeUnderV252Test-325540523 tempest-HypervisorAdminNegativeUnderV252Test-325540523-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors/3d1f327f-fed1-49de-8b52-a2a5cddcd0f8/servers" status: 404 len: 123 microversion: 2.1 time: 0.018098 Mar 05 20:52:16.306115 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 567/1179] 10.222.0.15 () {58 vars in 1280 bytes} [Sat Mar 5 20:52:16 2022] GET /compute/v2.1/os-hypervisors/3d1f327f-fed1-49de-8b52-a2a5cddcd0f8/servers => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:16.434703 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b9040fe8-efa4-43b7-af04-16b67c5b396f tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.971666 Mar 05 20:52:16.436034 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 613/1180] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:52:15 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:16.452285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dd7252d4-4337-4d4f-8183-0731614f8812 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Action: 'create', calling method: .version_select at 0x7fed5c69f550>, body: {"security_group_rule": {"parent_group_id": "c88f6635-0138-496a-a65b-e35a10788593", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:16.593695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fad1d89d-4f61-48e8-a753-6e82304e5dd9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:16.594526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fad1d89d-4f61-48e8-a753-6e82304e5dd9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:16.618407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fad1d89d-4f61-48e8-a753-6e82304e5dd9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:16.622213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fad1d89d-4f61-48e8-a753-6e82304e5dd9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:16.627306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fad1d89d-4f61-48e8-a753-6e82304e5dd9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:16.627839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fad1d89d-4f61-48e8-a753-6e82304e5dd9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:16.937263 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dd7252d4-4337-4d4f-8183-0731614f8812 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.492125 Mar 05 20:52:16.937919 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 568/1181] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 20:52:16 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:16.949650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ea70e89f-471c-4648-aab1-f01d7d48c688 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Action: 'create', calling method: .version_select at 0x7fed5c835430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1791722804", "description": "tempest-description-786587169"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:17.287263 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ea70e89f-471c-4648-aab1-f01d7d48c688 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.342153 Mar 05 20:52:17.289067 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 569/1182] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:52:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:17.294489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-216a86e4-0093-4727-8a66-b17bff0e66d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:17.295804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-216a86e4-0093-4727-8a66-b17bff0e66d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:17.317616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-216a86e4-0093-4727-8a66-b17bff0e66d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:17.334345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-216a86e4-0093-4727-8a66-b17bff0e66d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:17.335901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-216a86e4-0093-4727-8a66-b17bff0e66d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:17.336677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-216a86e4-0093-4727-8a66-b17bff0e66d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:17.401636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fad1d89d-4f61-48e8-a753-6e82304e5dd9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:17.413023 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fad1d89d-4f61-48e8-a753-6e82304e5dd9 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1291 microversion: 2.1 time: 0.823781 Mar 05 20:52:17.420850 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 614/1183] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:16 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1291 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:17.437188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6c1eb29d-3140-40e9-9ae9-a2bf0cfe6b05 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c4705e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:17.548375 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6c1eb29d-3140-40e9-9ae9-a2bf0cfe6b05 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.126001 Mar 05 20:52:17.549279 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 615/1184] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:17 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:17.562137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b75f4b87-146f-493d-8980-5bbe772a9bf0 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Action: 'create', calling method: .version_select at 0x7fed5c470d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1289583563", "description": "tempest-description-343675222"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:17.633099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-216a86e4-0093-4727-8a66-b17bff0e66d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:17.645931 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-216a86e4-0093-4727-8a66-b17bff0e66d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1378 microversion: 2.1 time: 0.355532 Mar 05 20:52:17.657170 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 570/1185] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:17 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1378 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:18.048848 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b75f4b87-146f-493d-8980-5bbe772a9bf0 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.494594 Mar 05 20:52:18.049512 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 616/1186] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:52:17 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:18.065083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-385c6278-f17e-4f2f-a612-650849472edd tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Action: 'create', calling method: .version_select at 0x7fed5c7e5d30>, body: {"security_group_rule": {"parent_group_id": "5e4680df-6dd7-46c4-af18-330afe1ae861", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c664c237-0cc4-47fa-a016-a9ab888a4870"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:18.437707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c89a7fc-5d3a-4584-87c4-09e1fb67cc73 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:18.438399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3c89a7fc-5d3a-4584-87c4-09e1fb67cc73 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:18.453161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c89a7fc-5d3a-4584-87c4-09e1fb67cc73 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:18.458813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c89a7fc-5d3a-4584-87c4-09e1fb67cc73 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:18.462802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c89a7fc-5d3a-4584-87c4-09e1fb67cc73 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:18.466256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c89a7fc-5d3a-4584-87c4-09e1fb67cc73 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:18.857597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3c89a7fc-5d3a-4584-87c4-09e1fb67cc73 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:18.876688 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3c89a7fc-5d3a-4584-87c4-09e1fb67cc73 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1291 microversion: 2.1 time: 0.438879 Mar 05 20:52:18.881796 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 617/1187] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:18 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1291 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:18.900746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d9891593-d248-45ae-83c7-d52da18dfd27 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c45bca0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:18.918740 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-385c6278-f17e-4f2f-a612-650849472edd tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.860651 Mar 05 20:52:18.919949 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 571/1188] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 20:52:18 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:18.931944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-92b87720-5a93-4719-b968-65e427c4dda6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:18.932764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-92b87720-5a93-4719-b968-65e427c4dda6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:18.945702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92b87720-5a93-4719-b968-65e427c4dda6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:18.950637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92b87720-5a93-4719-b968-65e427c4dda6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:18.951756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92b87720-5a93-4719-b968-65e427c4dda6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:18.952605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92b87720-5a93-4719-b968-65e427c4dda6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:19.030871 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d9891593-d248-45ae-83c7-d52da18dfd27 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.145384 Mar 05 20:52:19.032702 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 618/1189] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:18 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:19.062188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d5f3b3d1-c9cd-49d0-85e5-40e027544aa2 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Action: 'create', calling method: .version_select at 0x7fed5c57f790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1955007671", "description": "tempest-description-992693832"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:19.319170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-92b87720-5a93-4719-b968-65e427c4dda6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:19.342039 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-92b87720-5a93-4719-b968-65e427c4dda6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1378 microversion: 2.1 time: 0.408020 Mar 05 20:52:19.347063 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 572/1190] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:18 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1378 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:19.508261 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d5f3b3d1-c9cd-49d0-85e5-40e027544aa2 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.471462 Mar 05 20:52:19.510512 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 619/1191] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:52:19 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:19.523215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-064c3f6a-febb-422d-bc0b-79aea77eea12 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Action: 'create', calling method: .version_select at 0x7fed5c780280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-69739881", "description": "tempest-description-1760693785"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:19.902259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-be00e41e-d5ea-4597-b47f-123c31148445 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:19.916162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-be00e41e-d5ea-4597-b47f-123c31148445 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:19.965262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be00e41e-d5ea-4597-b47f-123c31148445 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:19.970540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be00e41e-d5ea-4597-b47f-123c31148445 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:19.972668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be00e41e-d5ea-4597-b47f-123c31148445 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:19.981566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be00e41e-d5ea-4597-b47f-123c31148445 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:20.085556 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-064c3f6a-febb-422d-bc0b-79aea77eea12 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.566856 Mar 05 20:52:20.086773 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 573/1192] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:52:19 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:20.093064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-187a0fa0-4b1d-46a0-a01a-8bba7717d443 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c6c0550>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:20.195711 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-187a0fa0-4b1d-46a0-a01a-8bba7717d443 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.107542 Mar 05 20:52:20.196324 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 574/1193] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:20 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:20.518271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-be00e41e-d5ea-4597-b47f-123c31148445 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:20.543218 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-be00e41e-d5ea-4597-b47f-123c31148445 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1291 microversion: 2.1 time: 0.647320 Mar 05 20:52:20.543923 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 620/1194] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:19 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1291 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:52:20.576490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ca0dbeea-59e6-4926-8e25-52c07bd1a59c tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Action: 'create', calling method: .version_select at 0x7fed5c46f3a0>, body: {"security_group_rule": {"parent_group_id": "64e6770f-ec8f-401c-ae80-6ae7e5a8bcc0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "2c9ad845-9855-4cb3-b152-cea047f463f3"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:20.922008 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b6701c7d-0798-4ce0-a06f-1429be79472a tempest-TenantUsagesNegativeTestJSON-1147901867 tempest-TenantUsagesNegativeTestJSON-1147901867-project-admin] 10.222.0.15 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-03-04T20%3A52%3A20.083638&end=2022-03-06T20%3A52%3A20.083638" status: 404 len: 112 microversion: - time: 0.720278 Mar 05 20:52:20.923951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 575/1195] 10.222.0.15 () {58 vars in 1315 bytes} [Sat Mar 5 20:52:20 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-03-04T20%3A52%3A20.083638&end=2022-03-06T20%3A52%3A20.083638 => generated 112 bytes in 724 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 05 20:52:20.934121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-47099b62-4f02-4342-8110-193ec0d6bc8e req-37f93175-cb9f-4dcb-84b7-5d392f8e225e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4bc94-61de-4cb5-8c5a-4ba4dc781ada", "name": "network-vif-plugged", "status": "completed", "tag": "a62edc1f-925c-416d-82a9-ced25df2b5e2"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:20.947629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-47099b62-4f02-4342-8110-193ec0d6bc8e req-37f93175-cb9f-4dcb-84b7-5d392f8e225e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:20.948382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-47099b62-4f02-4342-8110-193ec0d6bc8e req-37f93175-cb9f-4dcb-84b7-5d392f8e225e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:20.975653 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-47099b62-4f02-4342-8110-193ec0d6bc8e req-37f93175-cb9f-4dcb-84b7-5d392f8e225e service nova] Creating event network-vif-plugged:a62edc1f-925c-416d-82a9-ced25df2b5e2 for instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada on nch1-master-1 Mar 05 20:52:20.981822 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-47099b62-4f02-4342-8110-193ec0d6bc8e req-37f93175-cb9f-4dcb-84b7-5d392f8e225e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056210 Mar 05 20:52:20.982706 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 576/1196] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:20.988849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-462ac1e5-2519-4bdf-bf32-269802e6a18c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:20.989833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-462ac1e5-2519-4bdf-bf32-269802e6a18c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:21.028282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-462ac1e5-2519-4bdf-bf32-269802e6a18c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:21.028994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-462ac1e5-2519-4bdf-bf32-269802e6a18c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:21.029798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-462ac1e5-2519-4bdf-bf32-269802e6a18c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:21.030246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-462ac1e5-2519-4bdf-bf32-269802e6a18c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:21.435567 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ca0dbeea-59e6-4926-8e25-52c07bd1a59c tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.884495 Mar 05 20:52:21.436760 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 621/1197] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 20:52:20 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:21.442427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-73f5022e-8e67-4938-b0c7-dd3dae2d347b tempest-TenantUsagesNegativeTestJSON-1147901867 tempest-TenantUsagesNegativeTestJSON-1147901867-project-admin] Calling method '.version_select at 0x7fed5c470550>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:21.453749 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-73f5022e-8e67-4938-b0c7-dd3dae2d347b tempest-TenantUsagesNegativeTestJSON-1147901867 tempest-TenantUsagesNegativeTestJSON-1147901867-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Mar 05 20:52:21.454556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-73f5022e-8e67-4938-b0c7-dd3dae2d347b tempest-TenantUsagesNegativeTestJSON-1147901867 tempest-TenantUsagesNegativeTestJSON-1147901867-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:21.455571 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-73f5022e-8e67-4938-b0c7-dd3dae2d347b tempest-TenantUsagesNegativeTestJSON-1147901867 tempest-TenantUsagesNegativeTestJSON-1147901867-project-admin] 10.222.0.15 "GET /compute/v2.1/os-simple-tenant-usage/657db505127d48f89dff1401fc649913?start=2022-03-06T20%3A52%3A20.083638&end=2022-03-04T20%3A52%3A20.083638" status: 400 len: 111 microversion: 2.1 time: 0.017560 Mar 05 20:52:21.457877 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 622/1198] 10.222.0.15 () {58 vars in 1411 bytes} [Sat Mar 5 20:52:21 2022] GET /compute/v2.1/os-simple-tenant-usage/657db505127d48f89dff1401fc649913?start=2022-03-06T20%3A52%3A20.083638&end=2022-03-04T20%3A52%3A20.083638 => generated 111 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:52:21.468300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f7eef7f2-3ed5-42e3-9a61-8bcfe75d5ded tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c4a4e50>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:21.549221 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f7eef7f2-3ed5-42e3-9a61-8bcfe75d5ded tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.088098 Mar 05 20:52:21.556038 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 623/1199] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:21 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:21.564425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-29d629ab-a078-40f8-aa26-dcf98a530d9a tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Calling method '.version_select at 0x7fed5c5f7430>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:21.573241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-462ac1e5-2519-4bdf-bf32-269802e6a18c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:21.593900 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-462ac1e5-2519-4bdf-bf32-269802e6a18c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1378 microversion: 2.1 time: 0.608118 Mar 05 20:52:21.597359 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 577/1200] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:20 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1378 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:22.264240 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-29d629ab-a078-40f8-aa26-dcf98a530d9a tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/2c9ad845-9855-4cb3-b152-cea047f463f3" status: 202 len: 0 microversion: 2.1 time: 0.706937 Mar 05 20:52:22.265189 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 624/1201] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:52:21 2022] DELETE /compute/v2.1/os-security-groups/2c9ad845-9855-4cb3-b152-cea047f463f3 => generated 0 bytes in 708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:52:22.270143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cff83698-a6ba-4dd0-899b-8b1300f6e7f2 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:22.270959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cff83698-a6ba-4dd0-899b-8b1300f6e7f2 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:22.285142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cff83698-a6ba-4dd0-899b-8b1300f6e7f2 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:22.289392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cff83698-a6ba-4dd0-899b-8b1300f6e7f2 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:22.290430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cff83698-a6ba-4dd0-899b-8b1300f6e7f2 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:22.291469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cff83698-a6ba-4dd0-899b-8b1300f6e7f2 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:22.390935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f73e677-3ee8-4c8e-bac0-766610780b9b tempest-TenantUsagesNegativeTestJSON-440297712 tempest-TenantUsagesNegativeTestJSON-440297712-project] Calling method '.version_select at 0x7fed5c710af0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:22.394596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5f73e677-3ee8-4c8e-bac0-766610780b9b tempest-TenantUsagesNegativeTestJSON-440297712 tempest-TenantUsagesNegativeTestJSON-440297712-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'befdc5b97ff845378674984e4a5be450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657db505127d48f89dff1401fc649913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:22.396997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f73e677-3ee8-4c8e-bac0-766610780b9b tempest-TenantUsagesNegativeTestJSON-440297712 tempest-TenantUsagesNegativeTestJSON-440297712-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:22.398485 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5f73e677-3ee8-4c8e-bac0-766610780b9b tempest-TenantUsagesNegativeTestJSON-440297712 tempest-TenantUsagesNegativeTestJSON-440297712-project] 10.222.0.15 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-04T20%3A52%3A20.083638&end=2022-03-06T20%3A52%3A20.083638&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.799681 Mar 05 20:52:22.399392 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 578/1202] 10.222.0.15 () {58 vars in 1334 bytes} [Sat Mar 5 20:52:21 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-04T20%3A52%3A20.083638&end=2022-03-06T20%3A52%3A20.083638&detailed=1 => generated 123 bytes in 801 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:22.408888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-657990dc-d5b8-4baa-b939-20632771ab2c tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Calling method '.version_select at 0x7fed5c780af0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:22.476094 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-657990dc-d5b8-4baa-b939-20632771ab2c tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "GET /compute/v2.1/os-security-groups/64e6770f-ec8f-401c-ae80-6ae7e5a8bcc0" status: 200 len: 247 microversion: 2.1 time: 0.075190 Mar 05 20:52:22.477305 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 579/1203] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 20:52:22 2022] GET /compute/v2.1/os-security-groups/64e6770f-ec8f-401c-ae80-6ae7e5a8bcc0 => generated 247 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:22.496174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85da2e13-d639-4f58-b8d3-dbf165f16090 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Action: 'create', calling method: .version_select at 0x7fed5c78c8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1791859117", "description": "tempest-description-345321312"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:22.800484 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-85da2e13-d639-4f58-b8d3-dbf165f16090 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.310954 Mar 05 20:52:22.802661 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 580/1204] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:52:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:22.811456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6c6f46e1-fda9-4042-ba58-12c418898d36 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c69fc10>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:22.928713 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6c6f46e1-fda9-4042-ba58-12c418898d36 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1428 microversion: 2.1 time: 0.124706 Mar 05 20:52:22.929196 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 581/1205] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:22 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1428 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:22.936699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cff83698-a6ba-4dd0-899b-8b1300f6e7f2 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:22.943324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2540ef41-2e02-46b0-8f08-ddc3d4072092 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:22.950068 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cff83698-a6ba-4dd0-899b-8b1300f6e7f2 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1291 microversion: 2.1 time: 0.683743 Mar 05 20:52:22.950982 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 625/1206] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:22 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1291 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:22.953996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2540ef41-2e02-46b0-8f08-ddc3d4072092 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:22.969915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ab3aa3a6-a474-4cc8-af2a-535966b86b40 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Action: 'create', calling method: .version_select at 0x7fed5c46f280>, body: {"security_group_rule": {"parent_group_id": "569eefce-55bd-4e6d-8a1f-3605938dd46c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:22.997311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2540ef41-2e02-46b0-8f08-ddc3d4072092 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:22.997963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2540ef41-2e02-46b0-8f08-ddc3d4072092 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:23.009181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2540ef41-2e02-46b0-8f08-ddc3d4072092 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:23.010800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2540ef41-2e02-46b0-8f08-ddc3d4072092 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:23.394346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2540ef41-2e02-46b0-8f08-ddc3d4072092 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:23.409855 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2540ef41-2e02-46b0-8f08-ddc3d4072092 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1528 microversion: 2.1 time: 0.477641 Mar 05 20:52:23.410909 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 582/1207] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:22 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1528 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:23.428054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e259e651-874d-499d-b50d-107b5e18e8b5 req-8b06ad65-3707-4640-b640-45e447bf9709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7325377-2828-4f76-82f5-84a025e75574", "name": "network-vif-plugged", "status": "completed", "tag": "987d4803-9ee7-4faf-842e-7a86e2732a1a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:23.440578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e259e651-874d-499d-b50d-107b5e18e8b5 req-8b06ad65-3707-4640-b640-45e447bf9709 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:23.441320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e259e651-874d-499d-b50d-107b5e18e8b5 req-8b06ad65-3707-4640-b640-45e447bf9709 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:23.457319 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e259e651-874d-499d-b50d-107b5e18e8b5 req-8b06ad65-3707-4640-b640-45e447bf9709 service nova] Creating event network-vif-plugged:987d4803-9ee7-4faf-842e-7a86e2732a1a for instance e7325377-2828-4f76-82f5-84a025e75574 on nch1-master-1 Mar 05 20:52:23.470282 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e259e651-874d-499d-b50d-107b5e18e8b5 req-8b06ad65-3707-4640-b640-45e447bf9709 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056421 Mar 05 20:52:23.471423 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 583/1208] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:23.477741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-21be88c5-464f-4d71-a991-8503517979fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:23.478757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-21be88c5-464f-4d71-a991-8503517979fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:23.488091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21be88c5-464f-4d71-a991-8503517979fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:23.488804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21be88c5-464f-4d71-a991-8503517979fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:23.492353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21be88c5-464f-4d71-a991-8503517979fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:23.492824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21be88c5-464f-4d71-a991-8503517979fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:23.798453 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ab3aa3a6-a474-4cc8-af2a-535966b86b40 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.846045 Mar 05 20:52:23.804940 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 626/1209] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 20:52:22 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:23.812670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-33cb8574-71cc-4baf-a47e-e472380b3ff7 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Action: 'create', calling method: .version_select at 0x7fed5c5f71f0>, body: {"security_group_rule": {"parent_group_id": "569eefce-55bd-4e6d-8a1f-3605938dd46c", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:24.041385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-21be88c5-464f-4d71-a991-8503517979fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:24.052466 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-21be88c5-464f-4d71-a991-8503517979fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1528 microversion: 2.1 time: 0.579582 Mar 05 20:52:24.054441 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 584/1210] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:23 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1528 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:24.061784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2e701712-ba79-4b66-9bf3-9776a1f2059a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c69f310>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:24.173623 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2e701712-ba79-4b66-9bf3-9776a1f2059a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1437 microversion: 2.1 time: 0.117496 Mar 05 20:52:24.180428 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 585/1211] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:24 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1437 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:24.180428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6b7b1c66-20f3-43cd-9022-9c0510164c0d tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:24.180620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6b7b1c66-20f3-43cd-9022-9c0510164c0d tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:24.189364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b7b1c66-20f3-43cd-9022-9c0510164c0d tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:24.190104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b7b1c66-20f3-43cd-9022-9c0510164c0d tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:24.190917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b7b1c66-20f3-43cd-9022-9c0510164c0d tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:24.191729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b7b1c66-20f3-43cd-9022-9c0510164c0d tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:24.390084 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-33cb8574-71cc-4baf-a47e-e472380b3ff7 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.582076 Mar 05 20:52:24.391278 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 627/1212] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 20:52:23 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:24.396345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-74ab6fab-cbef-488c-b47b-5fe9def59cae tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:24.397403 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:24.397403 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:52:24.423949 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-74ab6fab-cbef-488c-b47b-5fe9def59cae tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/3af68e85-ae9d-4b46-b42f-e35de912f6f0" status: 202 len: 0 microversion: 2.1 time: 0.030870 Mar 05 20:52:24.425316 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 628/1213] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:52:24 2022] DELETE /compute/v2.1/flavors/3af68e85-ae9d-4b46-b42f-e35de912f6f0 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:52:24.431445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-36938148-4c33-46b1-af79-e1b671f32033 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c77c5e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:24.497285 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-36938148-4c33-46b1-af79-e1b671f32033 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 200 len: 1437 microversion: 2.1 time: 0.070517 Mar 05 20:52:24.506360 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 629/1214] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:24 2022] GET /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 1437 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:24.513573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-64f79d91-7f1e-4e68-bf81-f8ada617bc89 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Calling method '.version_select at 0x7fed5c5f71f0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:24.582934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6b7b1c66-20f3-43cd-9022-9c0510164c0d tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:24.595397 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6b7b1c66-20f3-43cd-9022-9c0510164c0d tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1291 microversion: 2.1 time: 0.419299 Mar 05 20:52:24.597223 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 586/1215] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:24 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1291 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:24.610097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2a3bb730-80c2-4c1d-ad5d-bac2cbf26562 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:24.681543 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2a3bb730-80c2-4c1d-ad5d-bac2cbf26562 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078457 Mar 05 20:52:24.683987 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 587/1216] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:52:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:24.697766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-776e8798-718b-4fcc-bfef-2ed5dc7ca913 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:24.698393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-776e8798-718b-4fcc-bfef-2ed5dc7ca913 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:24.721888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-776e8798-718b-4fcc-bfef-2ed5dc7ca913 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:24.722357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-776e8798-718b-4fcc-bfef-2ed5dc7ca913 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:24.736512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-776e8798-718b-4fcc-bfef-2ed5dc7ca913 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:24.739626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-776e8798-718b-4fcc-bfef-2ed5dc7ca913 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:25.071845 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-64f79d91-7f1e-4e68-bf81-f8ada617bc89 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "GET /compute/v2.1/os-security-groups/569eefce-55bd-4e6d-8a1f-3605938dd46c" status: 200 len: 664 microversion: 2.1 time: 0.563456 Mar 05 20:52:25.077949 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 630/1217] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 20:52:24 2022] GET /compute/v2.1/os-security-groups/569eefce-55bd-4e6d-8a1f-3605938dd46c => generated 664 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:25.083498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:25.084770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:25.099081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:25.100744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:25.101637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:25.102347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:25.227798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-776e8798-718b-4fcc-bfef-2ed5dc7ca913 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:25.238086 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-776e8798-718b-4fcc-bfef-2ed5dc7ca913 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1466 microversion: 2.1 time: 0.550817 Mar 05 20:52:25.258065 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 588/1218] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:24 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1466 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:25.270158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c721a420-919d-4ece-9a6b-cd7ccd3de95a tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Calling method '.version_select at 0x7fed5c710820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:25.419318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:25.427657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Old instance type tempest-test_resize_flavor_-619961753, new instance type m1.heat {{(pid=141479) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 20:52:25.447952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:52:25.448383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:52:25.449504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:52:25.449989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:52:25.450497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:52:25.633336 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-78b67c92-8f6c-4b7c-afd8-972b5a109ea7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "POST /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada/action" status: 202 len: 0 microversion: 2.1 time: 0.553974 Mar 05 20:52:25.647057 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 631/1219] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:52:25 2022] POST /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:52:25.660785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bb954dae-5f3b-4c64-8375-00f9c7c66db5 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c57f940>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:25.894796 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c721a420-919d-4ece-9a6b-cd7ccd3de95a tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-group-rules/ed960ba8-7b60-4287-92ff-150a8984411f" status: 202 len: 0 microversion: 2.1 time: 0.634812 Mar 05 20:52:25.896460 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 589/1220] 10.222.0.15 () {58 vars in 1286 bytes} [Sat Mar 5 20:52:25 2022] DELETE /compute/v2.1/os-security-group-rules/ed960ba8-7b60-4287-92ff-150a8984411f => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:52:25.901662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6423a1f6-02f7-45a1-8258-c46fabe536ce tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:25.902860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6423a1f6-02f7-45a1-8258-c46fabe536ce tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:25.912255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6423a1f6-02f7-45a1-8258-c46fabe536ce tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:25.912951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6423a1f6-02f7-45a1-8258-c46fabe536ce tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:25.914087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6423a1f6-02f7-45a1-8258-c46fabe536ce tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:25.914748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6423a1f6-02f7-45a1-8258-c46fabe536ce tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:26.235458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6423a1f6-02f7-45a1-8258-c46fabe536ce tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:26.244195 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6423a1f6-02f7-45a1-8258-c46fabe536ce tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1482 microversion: 2.1 time: 0.346453 Mar 05 20:52:26.247474 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 590/1221] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:25 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1482 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:26.272265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-864f6953-2d70-4b20-a194-8dc7e4e2d8ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:26.273941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-864f6953-2d70-4b20-a194-8dc7e4e2d8ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:26.286047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-864f6953-2d70-4b20-a194-8dc7e4e2d8ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:26.286751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-864f6953-2d70-4b20-a194-8dc7e4e2d8ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:26.289557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-864f6953-2d70-4b20-a194-8dc7e4e2d8ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:26.290179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-864f6953-2d70-4b20-a194-8dc7e4e2d8ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:26.517158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-864f6953-2d70-4b20-a194-8dc7e4e2d8ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:26.526554 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-864f6953-2d70-4b20-a194-8dc7e4e2d8ce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1537 microversion: 2.1 time: 0.277696 Mar 05 20:52:26.527430 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 591/1222] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:26 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1537 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:26.539174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2dfd0936-773e-4407-ba35-dac1ff47f8ff tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Calling method '.version_select at 0x7fed5c780ca0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:26.964686 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bb954dae-5f3b-4c64-8375-00f9c7c66db5 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "DELETE /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864" status: 204 len: 0 microversion: 2.1 time: 1.316185 Mar 05 20:52:26.965396 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 632/1223] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:25 2022] DELETE /compute/v2.1/images/3c2adcec-7bc0-41d4-913c-2bacc21ad864 => generated 0 bytes in 1318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:26.973479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-89e87917-f240-4eb8-83c1-222bd276ee1c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:26.973990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-89e87917-f240-4eb8-83c1-222bd276ee1c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:27.001826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89e87917-f240-4eb8-83c1-222bd276ee1c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:27.005586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89e87917-f240-4eb8-83c1-222bd276ee1c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:27.008025 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89e87917-f240-4eb8-83c1-222bd276ee1c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:27.009704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89e87917-f240-4eb8-83c1-222bd276ee1c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:27.139630 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2dfd0936-773e-4407-ba35-dac1ff47f8ff tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/569eefce-55bd-4e6d-8a1f-3605938dd46c" status: 202 len: 0 microversion: 2.1 time: 0.608764 Mar 05 20:52:27.140281 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 592/1224] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:52:26 2022] DELETE /compute/v2.1/os-security-groups/569eefce-55bd-4e6d-8a1f-3605938dd46c => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:52:27.150399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-755db458-744c-4cfb-98d3-25070a9f591a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '.version_select at 0x7fed5c780430>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:27.244746 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-755db458-744c-4cfb-98d3-25070a9f591a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] HTTP exception thrown: Image not found. Mar 05 20:52:27.248116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-755db458-744c-4cfb-98d3-25070a9f591a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Returning 404 to user: Image not found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:27.250890 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-755db458-744c-4cfb-98d3-25070a9f591a tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "DELETE /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7" status: 404 len: 62 microversion: 2.1 time: 0.107578 Mar 05 20:52:27.253597 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 593/1225] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:27 2022] DELETE /compute/v2.1/images/72f04d8d-188a-4418-bb6d-db04f3c126f7 => generated 62 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:52:27.280205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b35d493-690f-4409-96d8-2d6b754856b7 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Calling method '.version_select at 0x7fed5c780d30>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:27.291989 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-89e87917-f240-4eb8-83c1-222bd276ee1c tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.321759 Mar 05 20:52:27.292726 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 633/1226] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 20:52:26 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574/os-interface => generated 285 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:27.302624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cdd79ba1-bbb4-412a-9dad-79100b4d3a9e tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:27.303211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cdd79ba1-bbb4-412a-9dad-79100b4d3a9e tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:27.316044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdd79ba1-bbb4-412a-9dad-79100b4d3a9e tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:27.320370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdd79ba1-bbb4-412a-9dad-79100b4d3a9e tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:27.321468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdd79ba1-bbb4-412a-9dad-79100b4d3a9e tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:27.322193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdd79ba1-bbb4-412a-9dad-79100b4d3a9e tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:27.377973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cdd79ba1-bbb4-412a-9dad-79100b4d3a9e tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:52:27.442426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-4b35d493-690f-4409-96d8-2d6b754856b7 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2c9ad845-9855-4cb3-b152-cea047f463f3 does not exist", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:52:27.443407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.security_group_api [None req-4b35d493-690f-4409-96d8-2d6b754856b7 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Neutron security group 2c9ad845-9855-4cb3-b152-cea047f463f3 not found {{(pid=141478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:52:27.444215 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4b35d493-690f-4409-96d8-2d6b754856b7 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] HTTP exception thrown: Security group 2c9ad845-9855-4cb3-b152-cea047f463f3 does not exist Mar 05 20:52:27.444215 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-aea6ef11-df84-47f8-b160-4fe861b3df3d'] Mar 05 20:52:27.445086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b35d493-690f-4409-96d8-2d6b754856b7 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Returning 404 to user: Security group 2c9ad845-9855-4cb3-b152-cea047f463f3 does not exist Mar 05 20:52:27.445086 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-aea6ef11-df84-47f8-b160-4fe861b3df3d'] {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:27.446261 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4b35d493-690f-4409-96d8-2d6b754856b7 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/2c9ad845-9855-4cb3-b152-cea047f463f3" status: 404 len: 194 microversion: 2.1 time: 0.191236 Mar 05 20:52:27.447017 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 594/1227] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:52:27 2022] DELETE /compute/v2.1/os-security-groups/2c9ad845-9855-4cb3-b152-cea047f463f3 => generated 194 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:27.459447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85eaade3-8d8b-4ea7-a0fe-beb54dcae3ad tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Calling method '.version_select at 0x7fed5c78c8b0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:27.541869 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cdd79ba1-bbb4-412a-9dad-79100b4d3a9e tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 204 len: 0 microversion: 2.1 time: 0.242228 Mar 05 20:52:27.543125 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 634/1228] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:52:27 2022] DELETE /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:27.551574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e08cd3c3-8c19-42da-9dd5-13404ed21463 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:27.552666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e08cd3c3-8c19-42da-9dd5-13404ed21463 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:27.567236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e08cd3c3-8c19-42da-9dd5-13404ed21463 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:27.567834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e08cd3c3-8c19-42da-9dd5-13404ed21463 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:27.569264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e08cd3c3-8c19-42da-9dd5-13404ed21463 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:27.572290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e08cd3c3-8c19-42da-9dd5-13404ed21463 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:28.550590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e08cd3c3-8c19-42da-9dd5-13404ed21463 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:28.562697 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e08cd3c3-8c19-42da-9dd5-13404ed21463 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1537 microversion: 2.1 time: 1.015272 Mar 05 20:52:28.563746 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 635/1229] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:27 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1537 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:52:28.569003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dc9f8b3d-4f80-4a20-9fdf-fbc06cf28b99 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:28.569923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dc9f8b3d-4f80-4a20-9fdf-fbc06cf28b99 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:28.582766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc9f8b3d-4f80-4a20-9fdf-fbc06cf28b99 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:28.583602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc9f8b3d-4f80-4a20-9fdf-fbc06cf28b99 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:28.586864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc9f8b3d-4f80-4a20-9fdf-fbc06cf28b99 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:28.587923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc9f8b3d-4f80-4a20-9fdf-fbc06cf28b99 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:29.194278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dc9f8b3d-4f80-4a20-9fdf-fbc06cf28b99 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:29.208066 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dc9f8b3d-4f80-4a20-9fdf-fbc06cf28b99 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1472 microversion: 2.1 time: 0.642862 Mar 05 20:52:29.208674 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 636/1230] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:28 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1472 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:29.225099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-69a7e9fa-2414-4c3f-96cc-196c75164cc0 req-25115a29-f9ea-4f10-8b47-5b39842a3470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54f039d-1623-4ad6-a4e3-308472493214", "name": "network-vif-unplugged", "status": "completed", "tag": "6c25b98e-729b-490d-bb31-a40e13f1d945"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:29.236031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-69a7e9fa-2414-4c3f-96cc-196c75164cc0 req-25115a29-f9ea-4f10-8b47-5b39842a3470 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:29.237168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-69a7e9fa-2414-4c3f-96cc-196c75164cc0 req-25115a29-f9ea-4f10-8b47-5b39842a3470 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:29.255140 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-69a7e9fa-2414-4c3f-96cc-196c75164cc0 req-25115a29-f9ea-4f10-8b47-5b39842a3470 service nova] Creating event network-vif-unplugged:6c25b98e-729b-490d-bb31-a40e13f1d945 for instance d54f039d-1623-4ad6-a4e3-308472493214 on nch2-master-1 Mar 05 20:52:29.260652 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-69a7e9fa-2414-4c3f-96cc-196c75164cc0 req-25115a29-f9ea-4f10-8b47-5b39842a3470 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050780 Mar 05 20:52:29.264897 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 637/1231] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:29.583049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a3d914a1-e46a-46db-8ead-1954b2d6bbce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:29.583806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a3d914a1-e46a-46db-8ead-1954b2d6bbce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:29.595287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3d914a1-e46a-46db-8ead-1954b2d6bbce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:29.595763 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3d914a1-e46a-46db-8ead-1954b2d6bbce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:29.596738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3d914a1-e46a-46db-8ead-1954b2d6bbce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:29.601471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3d914a1-e46a-46db-8ead-1954b2d6bbce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:29.980429 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-85eaade3-8d8b-4ea7-a0fe-beb54dcae3ad tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/64e6770f-ec8f-401c-ae80-6ae7e5a8bcc0" status: 202 len: 0 microversion: 2.1 time: 2.525189 Mar 05 20:52:29.981610 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 595/1232] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:52:27 2022] DELETE /compute/v2.1/os-security-groups/64e6770f-ec8f-401c-ae80-6ae7e5a8bcc0 => generated 0 bytes in 2529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 20:52:29.989642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e2a022e9-d7d6-41de-a23f-bd145cc6a486 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Calling method '.version_select at 0x7fed5c7e5d30>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:30.631663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a3d914a1-e46a-46db-8ead-1954b2d6bbce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:30.681440 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a3d914a1-e46a-46db-8ead-1954b2d6bbce tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1537 microversion: 2.1 time: 1.105175 Mar 05 20:52:30.682965 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 638/1233] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:29 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1537 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:52:30.692416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e8dabc68-ec8d-4112-8918-1d170cc87dfb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:30.693743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e8dabc68-ec8d-4112-8918-1d170cc87dfb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:30.703822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8dabc68-ec8d-4112-8918-1d170cc87dfb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:30.704942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8dabc68-ec8d-4112-8918-1d170cc87dfb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:30.708676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8dabc68-ec8d-4112-8918-1d170cc87dfb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:30.709711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8dabc68-ec8d-4112-8918-1d170cc87dfb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:31.233183 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e8dabc68-ec8d-4112-8918-1d170cc87dfb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275c5f63f0e84b32bf036e57586bf59c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa214a1fdce408095cfce5d20496af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:31.247801 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e8dabc68-ec8d-4112-8918-1d170cc87dfb tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 200 len: 1472 microversion: 2.1 time: 0.562744 Mar 05 20:52:31.248400 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 639/1234] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:30 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 1472 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:31.305401 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e2a022e9-d7d6-41de-a23f-bd145cc6a486 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/c664c237-0cc4-47fa-a016-a9ab888a4870" status: 202 len: 0 microversion: 2.1 time: 1.320050 Mar 05 20:52:31.310265 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 596/1235] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:52:29 2022] DELETE /compute/v2.1/os-security-groups/c664c237-0cc4-47fa-a016-a9ab888a4870 => generated 0 bytes in 1321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:52:31.320026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-18c8aaca-c3ab-4442-9440-ba7a7c5150a6 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Calling method '.version_select at 0x7fed5c35be50>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:31.987656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-742179354", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "d83df0c3-2a5b-4fbb-9f93-42653588000e"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:32.074359 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-18c8aaca-c3ab-4442-9440-ba7a7c5150a6 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/5e4680df-6dd7-46c4-af18-330afe1ae861" status: 202 len: 0 microversion: 2.1 time: 0.762006 Mar 05 20:52:32.075405 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 640/1236] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:52:31 2022] DELETE /compute/v2.1/os-security-groups/5e4680df-6dd7-46c4-af18-330afe1ae861 => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:52:32.081855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7755adbf-d819-4837-ad43-24c242fd58cf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:32.082661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7755adbf-d819-4837-ad43-24c242fd58cf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:32.106440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7755adbf-d819-4837-ad43-24c242fd58cf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:32.107079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7755adbf-d819-4837-ad43-24c242fd58cf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:32.108063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7755adbf-d819-4837-ad43-24c242fd58cf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:32.116694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] validate_networks() for [('d83df0c3-2a5b-4fbb-9f93-42653588000e', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:52:32.133150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7755adbf-d819-4837-ad43-24c242fd58cf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:32.822543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7755adbf-d819-4837-ad43-24c242fd58cf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:32.838359 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7755adbf-d819-4837-ad43-24c242fd58cf tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1537 microversion: 2.1 time: 0.761791 Mar 05 20:52:32.851192 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 641/1237] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:32 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1537 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:32.858469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ca69948d-0a31-4c33-9d16-ad52c3a273a1 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Calling method '.version_select at 0x7fed5c45b940>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:33.402623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:52:33.404645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:52:33.405269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:52:33.405786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:52:33.406297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:52:33.432706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:33.438671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:33.445997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:33.463407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:33.572403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Getting quotas for project aa37ca4c9ac445f4ab3ab68f30b46d44. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:33.597365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Getting quotas for user 33c2e3f240e04849be211c91e18234dd and project aa37ca4c9ac445f4ab3ab68f30b46d44. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:33.633312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:52:33.641190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:52:33.800588 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b80dbb97-08c3-4ed8-a0a2-9e34cc7a93b7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.377737 Mar 05 20:52:33.805121 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 597/1238] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 20:52:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2389 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 05 20:52:33.820950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2fed6fb6-79b5-4206-8a8e-ac3d7e610146 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:33.821584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2fed6fb6-79b5-4206-8a8e-ac3d7e610146 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] [instance: d54f039d-1623-4ad6-a4e3-308472493214] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:33.834648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2fed6fb6-79b5-4206-8a8e-ac3d7e610146 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:33.835110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2fed6fb6-79b5-4206-8a8e-ac3d7e610146 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:33.836830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2fed6fb6-79b5-4206-8a8e-ac3d7e610146 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:33.837445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2fed6fb6-79b5-4206-8a8e-ac3d7e610146 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:33.875949 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-2fed6fb6-79b5-4206-8a8e-ac3d7e610146 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] HTTP exception thrown: Instance d54f039d-1623-4ad6-a4e3-308472493214 could not be found. Mar 05 20:52:33.878598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2fed6fb6-79b5-4206-8a8e-ac3d7e610146 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] Returning 404 to user: Instance d54f039d-1623-4ad6-a4e3-308472493214 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:52:33.879662 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2fed6fb6-79b5-4206-8a8e-ac3d7e610146 tempest-ImagesOneServerTestJSON-1617694947 tempest-ImagesOneServerTestJSON-1617694947-project] 10.222.0.15 "GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214" status: 404 len: 111 microversion: 2.1 time: 0.073065 Mar 05 20:52:33.880259 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 598/1239] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:33 2022] GET /compute/v2.1/servers/d54f039d-1623-4ad6-a4e3-308472493214 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:52:33.914393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-72cf3665-a786-4e5d-95c7-a9686e2df86f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:33.915031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-72cf3665-a786-4e5d-95c7-a9686e2df86f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:33.940308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72cf3665-a786-4e5d-95c7-a9686e2df86f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:33.941339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72cf3665-a786-4e5d-95c7-a9686e2df86f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:33.944284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72cf3665-a786-4e5d-95c7-a9686e2df86f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:33.944731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72cf3665-a786-4e5d-95c7-a9686e2df86f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:34.010764 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ca69948d-0a31-4c33-9d16-ad52c3a273a1 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/c88f6635-0138-496a-a65b-e35a10788593" status: 202 len: 0 microversion: 2.1 time: 1.157296 Mar 05 20:52:34.012400 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 642/1240] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:52:32 2022] DELETE /compute/v2.1/os-security-groups/c88f6635-0138-496a-a65b-e35a10788593 => generated 0 bytes in 1160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:52:34.019585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-55c485f4-1fb2-4392-9f54-67a0141731da req-5de950b6-07d3-4e3b-8634-f466b7f1e636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7325377-2828-4f76-82f5-84a025e75574", "tag": "987d4803-9ee7-4faf-842e-7a86e2732a1a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:34.058569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-55c485f4-1fb2-4392-9f54-67a0141731da req-5de950b6-07d3-4e3b-8634-f466b7f1e636 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:34.059112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-55c485f4-1fb2-4392-9f54-67a0141731da req-5de950b6-07d3-4e3b-8634-f466b7f1e636 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:34.112270 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-55c485f4-1fb2-4392-9f54-67a0141731da req-5de950b6-07d3-4e3b-8634-f466b7f1e636 service nova] Creating event network-changed:987d4803-9ee7-4faf-842e-7a86e2732a1a for instance e7325377-2828-4f76-82f5-84a025e75574 on nch1-master-1 Mar 05 20:52:34.130586 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-55c485f4-1fb2-4392-9f54-67a0141731da req-5de950b6-07d3-4e3b-8634-f466b7f1e636 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116635 Mar 05 20:52:34.137369 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 643/1241] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:34.578505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-521647636", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "92c1bc99-8218-45a1-b95c-a4c228475460"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:34.758334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] validate_networks() for [('92c1bc99-8218-45a1-b95c-a4c228475460', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:52:35.045833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-72cf3665-a786-4e5d-95c7-a9686e2df86f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:35.057783 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-72cf3665-a786-4e5d-95c7-a9686e2df86f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1482 microversion: 2.1 time: 1.175096 Mar 05 20:52:35.065212 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 599/1242] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:33 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1482 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:35.071045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-75e7cf22-4bda-402d-ac69-85a0a440a44b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:35.071687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-75e7cf22-4bda-402d-ac69-85a0a440a44b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:35.088353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75e7cf22-4bda-402d-ac69-85a0a440a44b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:35.088815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75e7cf22-4bda-402d-ac69-85a0a440a44b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:35.092871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75e7cf22-4bda-402d-ac69-85a0a440a44b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:35.093527 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75e7cf22-4bda-402d-ac69-85a0a440a44b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:35.274882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-75e7cf22-4bda-402d-ac69-85a0a440a44b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:35.289979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-75e7cf22-4bda-402d-ac69-85a0a440a44b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:35.296557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-75e7cf22-4bda-402d-ac69-85a0a440a44b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:35.300266 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-75e7cf22-4bda-402d-ac69-85a0a440a44b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1265 microversion: 2.25 time: 0.233683 Mar 05 20:52:35.303091 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 600/1243] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:35 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:35.317755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4e9f003a-6119-4299-a65f-7d84e9fe1d8f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:35.319646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4e9f003a-6119-4299-a65f-7d84e9fe1d8f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:35.339987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e9f003a-6119-4299-a65f-7d84e9fe1d8f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:35.341756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e9f003a-6119-4299-a65f-7d84e9fe1d8f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:35.342710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e9f003a-6119-4299-a65f-7d84e9fe1d8f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:35.343179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e9f003a-6119-4299-a65f-7d84e9fe1d8f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:36.039353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:52:36.040252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:52:36.040883 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:52:36.041383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:52:36.041872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:52:36.064011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:36.064559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:36.065775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:36.068326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:36.117310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Getting quotas for project 1e9d41fd2f8d48d894ddb8ae0aa2799d. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:36.124074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Getting quotas for user 8bcf50b3de674240bb695a0d5614ffd9 and project 1e9d41fd2f8d48d894ddb8ae0aa2799d. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:36.167256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:52:36.173052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:52:36.297856 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9185be8c-507a-4782-ae59-68175656f8bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.159114 Mar 05 20:52:36.298732 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 644/1244] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:52:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:52:36.307406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-779ff43f-0913-46e6-b07d-49a8c1c79fd5 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] Calling method '.version_select at 0x7fed5c660ee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:36.342589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4e9f003a-6119-4299-a65f-7d84e9fe1d8f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:36.368521 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4e9f003a-6119-4299-a65f-7d84e9fe1d8f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1542 microversion: 2.1 time: 1.057271 Mar 05 20:52:36.370101 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 601/1245] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:35 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1542 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:36.380273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f502b2bc-509e-4e73-96a2-3fa3c8b86009 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:36.382898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f502b2bc-509e-4e73-96a2-3fa3c8b86009 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:36.657611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f502b2bc-509e-4e73-96a2-3fa3c8b86009 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:36.668334 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f502b2bc-509e-4e73-96a2-3fa3c8b86009 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 200 len: 1207 microversion: 2.1 time: 0.295588 Mar 05 20:52:36.673044 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 602/1246] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:36 2022] GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 1207 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:36.686840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-dfec2f3e-4593-4635-b761-f34e36eab0ed req-73c0cbfb-0858-45e1-855e-9765e84000bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54f039d-1623-4ad6-a4e3-308472493214", "name": "network-vif-deleted", "tag": "6c25b98e-729b-490d-bb31-a40e13f1d945"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:36.734922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-dfec2f3e-4593-4635-b761-f34e36eab0ed req-73c0cbfb-0858-45e1-855e-9765e84000bf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:36.735389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-dfec2f3e-4593-4635-b761-f34e36eab0ed req-73c0cbfb-0858-45e1-855e-9765e84000bf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:36.742008 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-779ff43f-0913-46e6-b07d-49a8c1c79fd5 tempest-SecurityGroupRulesTestJSON-627720296 tempest-SecurityGroupRulesTestJSON-627720296-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/313e7985-2478-4ea8-af00-f70a47614de0" status: 202 len: 0 microversion: 2.1 time: 0.441973 Mar 05 20:52:36.747267 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 645/1247] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:52:36 2022] DELETE /compute/v2.1/os-security-groups/313e7985-2478-4ea8-af00-f70a47614de0 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:52:36.767283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d8e70831-a05f-48f9-8bbb-39f5be914a77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:36.769405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d8e70831-a05f-48f9-8bbb-39f5be914a77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:36.788817 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-dfec2f3e-4593-4635-b761-f34e36eab0ed req-73c0cbfb-0858-45e1-855e-9765e84000bf service nova] Creating event network-vif-deleted:6c25b98e-729b-490d-bb31-a40e13f1d945 for instance d54f039d-1623-4ad6-a4e3-308472493214 on nch2-master-1 Mar 05 20:52:36.799787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8e70831-a05f-48f9-8bbb-39f5be914a77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:36.805609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8e70831-a05f-48f9-8bbb-39f5be914a77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:36.807638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8e70831-a05f-48f9-8bbb-39f5be914a77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:36.809126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8e70831-a05f-48f9-8bbb-39f5be914a77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:36.815620 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-dfec2f3e-4593-4635-b761-f34e36eab0ed req-73c0cbfb-0858-45e1-855e-9765e84000bf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140255 Mar 05 20:52:36.816264 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 603/1248] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:36.946420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d8e70831-a05f-48f9-8bbb-39f5be914a77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:36.959021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d8e70831-a05f-48f9-8bbb-39f5be914a77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:36.960632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d8e70831-a05f-48f9-8bbb-39f5be914a77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:36.967290 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d8e70831-a05f-48f9-8bbb-39f5be914a77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1319 microversion: 2.25 time: 0.218461 Mar 05 20:52:36.968048 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 646/1249] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:36 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:37.228996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-62883e74-d677-46fb-b539-db8620e03349 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] Action: 'create', calling method: .version_select at 0x7fed5c7d4ca0>, body: {"pool": null} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:37.388818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b94e3760-2361-41cd-9ea6-a1c4c824470f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:37.389624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b94e3760-2361-41cd-9ea6-a1c4c824470f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:37.415286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b94e3760-2361-41cd-9ea6-a1c4c824470f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:37.416449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b94e3760-2361-41cd-9ea6-a1c4c824470f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:37.420186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b94e3760-2361-41cd-9ea6-a1c4c824470f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:37.423717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b94e3760-2361-41cd-9ea6-a1c4c824470f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:37.717738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b94e3760-2361-41cd-9ea6-a1c4c824470f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:37.733491 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b94e3760-2361-41cd-9ea6-a1c4c824470f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1542 microversion: 2.1 time: 0.350178 Mar 05 20:52:37.742998 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 647/1250] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:37 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1542 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:52:37.742998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0d251ca0-fa41-4ec4-9fb8-b696b1958eb8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:37.743959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0d251ca0-fa41-4ec4-9fb8-b696b1958eb8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:37.766321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d251ca0-fa41-4ec4-9fb8-b696b1958eb8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:37.766774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d251ca0-fa41-4ec4-9fb8-b696b1958eb8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:37.770554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d251ca0-fa41-4ec4-9fb8-b696b1958eb8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:37.771069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d251ca0-fa41-4ec4-9fb8-b696b1958eb8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:37.859308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0d251ca0-fa41-4ec4-9fb8-b696b1958eb8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:37.867981 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0d251ca0-fa41-4ec4-9fb8-b696b1958eb8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 200 len: 1259 microversion: 2.1 time: 0.131407 Mar 05 20:52:37.869693 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 648/1251] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:37 2022] GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 1259 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:38.170236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5fe9d29f-0dcd-42db-921d-86cf245eb755 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Action: 'create', calling method: .version_select at 0x7fed5c50a430>, body: {"keypair": {"name": "tempest-keypair-603612973"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:38.208202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5fe9d29f-0dcd-42db-921d-86cf245eb755 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:38.229987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5fe9d29f-0dcd-42db-921d-86cf245eb755 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:38.624201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5fe9d29f-0dcd-42db-921d-86cf245eb755 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:38.645370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5fe9d29f-0dcd-42db-921d-86cf245eb755 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:38.702609 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5fe9d29f-0dcd-42db-921d-86cf245eb755 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.831088 Mar 05 20:52:38.711576 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 649/1252] 10.222.0.15 () {62 vars in 1197 bytes} [Sat Mar 5 20:52:37 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 841 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:38.727827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-be4d4ae9-81ef-4c96-bfa8-7fc5a4f8cd42 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:38.731993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-be4d4ae9-81ef-4c96-bfa8-7fc5a4f8cd42 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:38.739824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be4d4ae9-81ef-4c96-bfa8-7fc5a4f8cd42 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:38.741507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be4d4ae9-81ef-4c96-bfa8-7fc5a4f8cd42 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:38.743466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be4d4ae9-81ef-4c96-bfa8-7fc5a4f8cd42 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:38.744371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be4d4ae9-81ef-4c96-bfa8-7fc5a4f8cd42 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:38.908769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-be4d4ae9-81ef-4c96-bfa8-7fc5a4f8cd42 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:38.931914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-be4d4ae9-81ef-4c96-bfa8-7fc5a4f8cd42 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:38.935922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-be4d4ae9-81ef-4c96-bfa8-7fc5a4f8cd42 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:38.938182 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-be4d4ae9-81ef-4c96-bfa8-7fc5a4f8cd42 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1319 microversion: 2.25 time: 0.225175 Mar 05 20:52:38.942250 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 650/1253] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:38 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:38.953845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5b2fc0b9-7c22-4850-a776-893b521c8f3b tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5c50aa60>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:38.974639 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5b2fc0b9-7c22-4850-a776-893b521c8f3b tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "GET /compute/v2.1/os-keypairs/tempest-keypair-603612973" status: 200 len: 706 microversion: 2.2 time: 0.031098 Mar 05 20:52:38.977538 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 651/1254] 10.222.0.15 () {60 vars in 1254 bytes} [Sat Mar 5 20:52:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-603612973 => generated 706 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:38.990271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d4df0666-4cb1-4bd7-8e3e-374019fbfd0f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:38.990813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d4df0666-4cb1-4bd7-8e3e-374019fbfd0f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:39.024284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4df0666-4cb1-4bd7-8e3e-374019fbfd0f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:39.026457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4df0666-4cb1-4bd7-8e3e-374019fbfd0f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:39.030817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4df0666-4cb1-4bd7-8e3e-374019fbfd0f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:39.031547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4df0666-4cb1-4bd7-8e3e-374019fbfd0f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:39.438428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d4df0666-4cb1-4bd7-8e3e-374019fbfd0f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:39.449798 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d4df0666-4cb1-4bd7-8e3e-374019fbfd0f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1542 microversion: 2.1 time: 0.459735 Mar 05 20:52:39.451017 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 652/1255] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:38 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1542 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:39.462912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f7258408-1cb6-4637-96f0-c7c5a6aba0ca tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:39.463545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f7258408-1cb6-4637-96f0-c7c5a6aba0ca tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:39.479563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7258408-1cb6-4637-96f0-c7c5a6aba0ca tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:39.483898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7258408-1cb6-4637-96f0-c7c5a6aba0ca tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:39.486475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7258408-1cb6-4637-96f0-c7c5a6aba0ca tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:39.487942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7258408-1cb6-4637-96f0-c7c5a6aba0ca tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:39.638540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f7258408-1cb6-4637-96f0-c7c5a6aba0ca tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:39.649928 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f7258408-1cb6-4637-96f0-c7c5a6aba0ca tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 200 len: 1265 microversion: 2.1 time: 0.194396 Mar 05 20:52:39.653220 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 653/1256] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:39 2022] GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:39.668613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6aa3bc4d-062a-4dec-863e-fcf5970ba052 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5c45b5e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:39.704196 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6aa3bc4d-062a-4dec-863e-fcf5970ba052 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-603612973" status: 204 len: 0 microversion: 2.2 time: 0.048260 Mar 05 20:52:39.710006 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 654/1257] 10.222.0.15 () {60 vars in 1257 bytes} [Sat Mar 5 20:52:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-603612973 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:39.719751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-949febed-7ce8-410b-82f4-59ce63c2c268 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Action: 'create', calling method: .version_select at 0x7fed5c5f7280>, body: {"keypair": {"name": "tempest-keypair-1354599309"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:39.778663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-949febed-7ce8-410b-82f4-59ce63c2c268 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:39.796954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-949febed-7ce8-410b-82f4-59ce63c2c268 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:40.177586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-949febed-7ce8-410b-82f4-59ce63c2c268 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:40.192978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-949febed-7ce8-410b-82f4-59ce63c2c268 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:40.218194 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-949febed-7ce8-410b-82f4-59ce63c2c268 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 0.506878 Mar 05 20:52:40.220313 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 655/1258] 10.222.0.15 () {62 vars in 1197 bytes} [Sat Mar 5 20:52:39 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 510 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:40.231168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f9cd7c47-3716-4565-a2c7-3ed5a9978930 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:40.232467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f9cd7c47-3716-4565-a2c7-3ed5a9978930 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:40.252286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9cd7c47-3716-4565-a2c7-3ed5a9978930 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:40.253000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9cd7c47-3716-4565-a2c7-3ed5a9978930 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:40.254357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9cd7c47-3716-4565-a2c7-3ed5a9978930 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:40.255174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9cd7c47-3716-4565-a2c7-3ed5a9978930 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:41.080980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f9cd7c47-3716-4565-a2c7-3ed5a9978930 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:41.092415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f9cd7c47-3716-4565-a2c7-3ed5a9978930 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:41.094683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f9cd7c47-3716-4565-a2c7-3ed5a9978930 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:41.096163 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f9cd7c47-3716-4565-a2c7-3ed5a9978930 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1361 microversion: 2.25 time: 0.874180 Mar 05 20:52:41.109457 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 656/1259] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:40 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1361 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:41.117981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f22d71b3-e449-42d3-931a-e72ce4320311 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5c4cfaf0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:41.147587 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f22d71b3-e449-42d3-931a-e72ce4320311 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354599309" status: 204 len: 0 microversion: 2.2 time: 0.034340 Mar 05 20:52:41.149098 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 657/1260] 10.222.0.15 () {60 vars in 1260 bytes} [Sat Mar 5 20:52:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354599309 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:41.164390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5ba153d9-22fa-4e92-ac1d-d9827eab19d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:41.166894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5ba153d9-22fa-4e92-ac1d-d9827eab19d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:41.181702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ba153d9-22fa-4e92-ac1d-d9827eab19d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:41.182711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ba153d9-22fa-4e92-ac1d-d9827eab19d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:41.184616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ba153d9-22fa-4e92-ac1d-d9827eab19d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:41.186120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ba153d9-22fa-4e92-ac1d-d9827eab19d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:41.561846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5ba153d9-22fa-4e92-ac1d-d9827eab19d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:41.582758 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5ba153d9-22fa-4e92-ac1d-d9827eab19d0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1542 microversion: 2.1 time: 0.431674 Mar 05 20:52:41.584792 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 658/1261] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:41 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1542 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:41.592663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91132a51-4c81-4295-af0e-55df150fcb9c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:41.601572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91132a51-4c81-4295-af0e-55df150fcb9c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:41.614253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91132a51-4c81-4295-af0e-55df150fcb9c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:41.616354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91132a51-4c81-4295-af0e-55df150fcb9c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:41.618465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91132a51-4c81-4295-af0e-55df150fcb9c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:41.622284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91132a51-4c81-4295-af0e-55df150fcb9c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:42.397078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-91132a51-4c81-4295-af0e-55df150fcb9c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:42.407614 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91132a51-4c81-4295-af0e-55df150fcb9c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 200 len: 1307 microversion: 2.1 time: 0.820187 Mar 05 20:52:42.408957 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 659/1262] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:41 2022] GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 1307 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:42.422179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2220056c-da9c-4be7-9ff2-4f941c888a55 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Action: 'create', calling method: .version_select at 0x7fed5c50a0d0>, body: {"keypair": {"name": "tempest-keypair-2054951951", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:42.443311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-2220056c-da9c-4be7-9ff2-4f941c888a55 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:42.449834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-2220056c-da9c-4be7-9ff2-4f941c888a55 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:42.485906 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2220056c-da9c-4be7-9ff2-4f941c888a55 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.075583 Mar 05 20:52:42.486633 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 660/1263] 10.222.0.15 () {62 vars in 1198 bytes} [Sat Mar 5 20:52:42 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Mar 05 20:52:42.492064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-923e6d0a-339c-4e95-ba5a-61aed96bce6b req-221d7708-4c50-49b6-b1c4-c7b9bc4a1460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78b93bf-150c-4b48-b376-5c2ba3a624b9", "tag": "62f18a02-3cec-4f72-9fe9-641e4f0d18e9"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:42.503262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-923e6d0a-339c-4e95-ba5a-61aed96bce6b req-221d7708-4c50-49b6-b1c4-c7b9bc4a1460 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:42.505132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-923e6d0a-339c-4e95-ba5a-61aed96bce6b req-221d7708-4c50-49b6-b1c4-c7b9bc4a1460 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:42.519223 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-923e6d0a-339c-4e95-ba5a-61aed96bce6b req-221d7708-4c50-49b6-b1c4-c7b9bc4a1460 service nova] Creating event network-changed:62f18a02-3cec-4f72-9fe9-641e4f0d18e9 for instance a78b93bf-150c-4b48-b376-5c2ba3a624b9 on nch2-master-1 Mar 05 20:52:42.525958 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-923e6d0a-339c-4e95-ba5a-61aed96bce6b req-221d7708-4c50-49b6-b1c4-c7b9bc4a1460 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037899 Mar 05 20:52:42.527593 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 661/1264] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:42.535058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bf2c22d6-729e-4893-b139-a242f1102f07 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:42.536148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bf2c22d6-729e-4893-b139-a242f1102f07 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:42.543501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf2c22d6-729e-4893-b139-a242f1102f07 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:42.544607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf2c22d6-729e-4893-b139-a242f1102f07 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:42.545668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf2c22d6-729e-4893-b139-a242f1102f07 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:42.546352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf2c22d6-729e-4893-b139-a242f1102f07 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:42.803284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bf2c22d6-729e-4893-b139-a242f1102f07 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:42.817814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bf2c22d6-729e-4893-b139-a242f1102f07 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:42.819706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bf2c22d6-729e-4893-b139-a242f1102f07 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:42.820878 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bf2c22d6-729e-4893-b139-a242f1102f07 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1361 microversion: 2.25 time: 0.291638 Mar 05 20:52:42.835456 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 662/1265] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:42 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:42.841339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-02bd2366-b9aa-40a1-b334-c46432135e06 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5c5f7160>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:42.859961 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-02bd2366-b9aa-40a1-b334-c46432135e06 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054951951" status: 204 len: 0 microversion: 2.2 time: 0.023149 Mar 05 20:52:42.861260 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 663/1266] 10.222.0.15 () {60 vars in 1260 bytes} [Sat Mar 5 20:52:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054951951 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:42.867928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6e828dca-d8e9-431e-bb0a-96ad35796c1d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:42.868795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6e828dca-d8e9-431e-bb0a-96ad35796c1d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:42.876656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e828dca-d8e9-431e-bb0a-96ad35796c1d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:42.877111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e828dca-d8e9-431e-bb0a-96ad35796c1d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:42.878078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e828dca-d8e9-431e-bb0a-96ad35796c1d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:42.878523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e828dca-d8e9-431e-bb0a-96ad35796c1d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:43.132814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6e828dca-d8e9-431e-bb0a-96ad35796c1d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:43.141414 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6e828dca-d8e9-431e-bb0a-96ad35796c1d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1542 microversion: 2.1 time: 0.278866 Mar 05 20:52:43.142027 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 664/1267] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:42 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1542 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:43.146799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fda937bd-275d-4c56-a6a7-cf9185ceaa36 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Action: 'create', calling method: .version_select at 0x7fed5c42cee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1352152609"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:43.167242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-fda937bd-275d-4c56-a6a7-cf9185ceaa36 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:43.175072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-fda937bd-275d-4c56-a6a7-cf9185ceaa36 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:43.395609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-fda937bd-275d-4c56-a6a7-cf9185ceaa36 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:43.402121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-fda937bd-275d-4c56-a6a7-cf9185ceaa36 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:43.420161 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fda937bd-275d-4c56-a6a7-cf9185ceaa36 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.2 time: 0.277046 Mar 05 20:52:43.423717 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 665/1268] 10.222.0.15 () {62 vars in 1197 bytes} [Sat Mar 5 20:52:43 2022] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 278 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:43.425610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-00103a7d-2a7f-41f0-bb99-2f816ec8b334 req-d570855b-f597-4198-abd5-d7a0aa24d4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31db5aa9-c804-4757-af1b-3354d442b6d8", "tag": "c0110646-dc95-417d-ac53-0985cc88a5b8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:43.435153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-00103a7d-2a7f-41f0-bb99-2f816ec8b334 req-d570855b-f597-4198-abd5-d7a0aa24d4ec service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:43.435796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-00103a7d-2a7f-41f0-bb99-2f816ec8b334 req-d570855b-f597-4198-abd5-d7a0aa24d4ec service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:43.651435 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-00103a7d-2a7f-41f0-bb99-2f816ec8b334 req-d570855b-f597-4198-abd5-d7a0aa24d4ec service nova] Creating event network-changed:c0110646-dc95-417d-ac53-0985cc88a5b8 for instance 31db5aa9-c804-4757-af1b-3354d442b6d8 on nch2-master-1 Mar 05 20:52:43.658154 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-00103a7d-2a7f-41f0-bb99-2f816ec8b334 req-d570855b-f597-4198-abd5-d7a0aa24d4ec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235892 Mar 05 20:52:43.659184 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 666/1269] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:43.665326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cd4a0a52-4862-4548-8080-ac554fb7c9cc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:43.666015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cd4a0a52-4862-4548-8080-ac554fb7c9cc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:43.672472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd4a0a52-4862-4548-8080-ac554fb7c9cc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:43.672935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd4a0a52-4862-4548-8080-ac554fb7c9cc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:43.673715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd4a0a52-4862-4548-8080-ac554fb7c9cc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:43.674153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd4a0a52-4862-4548-8080-ac554fb7c9cc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:43.894182 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-62883e74-d677-46fb-b539-db8620e03349 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] 10.222.0.15 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.072196 Mar 05 20:52:43.895468 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 604/1270] 10.222.0.15 () {60 vars in 1169 bytes} [Sat Mar 5 20:52:36 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:43.905163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8af50f3c-4f97-4fe0-a495-f706dda47ded tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Action: 'create', calling method: .version_select at 0x7fed5c6c0f70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1007495731"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:43.921071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cd4a0a52-4862-4548-8080-ac554fb7c9cc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:43.930708 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cd4a0a52-4862-4548-8080-ac554fb7c9cc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 200 len: 1307 microversion: 2.1 time: 0.268700 Mar 05 20:52:43.934805 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 667/1271] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:43 2022] GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 1307 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:43.938476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8af50f3c-4f97-4fe0-a495-f706dda47ded tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:43.943879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8af50f3c-4f97-4fe0-a495-f706dda47ded tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:43.944771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-14d89211-b268-40b6-95b2-ab26bb0c8139 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:43.946251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-14d89211-b268-40b6-95b2-ab26bb0c8139 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:43.953835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14d89211-b268-40b6-95b2-ab26bb0c8139 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:43.954431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14d89211-b268-40b6-95b2-ab26bb0c8139 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:43.955943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14d89211-b268-40b6-95b2-ab26bb0c8139 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:43.956515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14d89211-b268-40b6-95b2-ab26bb0c8139 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:44.063422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8af50f3c-4f97-4fe0-a495-f706dda47ded tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:44.069749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8af50f3c-4f97-4fe0-a495-f706dda47ded tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:44.087380 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8af50f3c-4f97-4fe0-a495-f706dda47ded tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.2 time: 0.188053 Mar 05 20:52:44.089090 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 605/1272] 10.222.0.15 () {62 vars in 1197 bytes} [Sat Mar 5 20:52:43 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 190 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:44.094603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c69ae9f-2901-4d53-8219-da2d4d1cf267 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] Action: 'create', calling method: .version_select at 0x7fed5c6c3550>, body: {"pool": null} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:44.234162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-14d89211-b268-40b6-95b2-ab26bb0c8139 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:44.243598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-14d89211-b268-40b6-95b2-ab26bb0c8139 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:44.247105 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-14d89211-b268-40b6-95b2-ab26bb0c8139 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:44.248285 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-14d89211-b268-40b6-95b2-ab26bb0c8139 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1361 microversion: 2.25 time: 0.310792 Mar 05 20:52:44.258929 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 668/1273] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:43 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1361 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:44.258929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b91242a1-4657-4531-a77f-406dede11628 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Action: 'create', calling method: .version_select at 0x7fed5c45bf70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-836242169"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:44.276789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b91242a1-4657-4531-a77f-406dede11628 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:44.283621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b91242a1-4657-4531-a77f-406dede11628 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:44.734833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b91242a1-4657-4531-a77f-406dede11628 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:44.740730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b91242a1-4657-4531-a77f-406dede11628 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:44.768519 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b91242a1-4657-4531-a77f-406dede11628 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.2 time: 0.517847 Mar 05 20:52:44.774511 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 669/1274] 10.222.0.15 () {62 vars in 1197 bytes} [Sat Mar 5 20:52:44 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 525 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:44.782471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-222cc036-04fa-457e-88c3-9e130dde4564 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:44.784230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-222cc036-04fa-457e-88c3-9e130dde4564 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:44.791642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-222cc036-04fa-457e-88c3-9e130dde4564 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:44.793227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-222cc036-04fa-457e-88c3-9e130dde4564 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:44.794042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-222cc036-04fa-457e-88c3-9e130dde4564 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:44.795123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-222cc036-04fa-457e-88c3-9e130dde4564 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:45.079348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-222cc036-04fa-457e-88c3-9e130dde4564 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:45.086704 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-222cc036-04fa-457e-88c3-9e130dde4564 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1542 microversion: 2.1 time: 0.310920 Mar 05 20:52:45.087288 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 670/1275] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:44 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1542 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:45.291365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1447077413", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "0d067b91-4a07-4b62-a220-cba2f62187af"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:45.354451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] validate_networks() for [('0d067b91-4a07-4b62-a220-cba2f62187af', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:52:45.981836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:52:45.984094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:52:45.984094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:52:45.984094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:52:45.984094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:52:46.004358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:46.005318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:46.006639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:46.007176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:46.029914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Getting quotas for project 2800feb70d3947938e03fbcaa7ee8d13. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:46.041513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Getting quotas for user da16ae41d4f547cebc7ccb11e87dfc8e and project 2800feb70d3947938e03fbcaa7ee8d13. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:46.108843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Going to run 2 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:52:46.111599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: d52eacda-01a8-4166-b9a1-0ec730e2b5dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:52:46.158821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=d52eacda-01a8-4166-b9a1-0ec730e2b5dc,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:52:46.252642 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0a10f109-436d-49fe-9f3f-9658a9fa5523 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.154623 Mar 05 20:52:46.255520 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 671/1276] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:52:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:52:46.266468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ff6e02cb-0207-489f-9d3c-d5007e0440c5 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5c42c9d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:46.271391 ncdv-master-1 devstack@n-api.service[141479]: WARNING oslo_db.sqlalchemy.utils [None req-ff6e02cb-0207-489f-9d3c-d5007e0440c5 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 05 20:52:46.277927 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ff6e02cb-0207-489f-9d3c-d5007e0440c5 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "GET /compute/v2.1/os-keypairs" status: 200 len: 1723 microversion: 2.2 time: 0.016815 Mar 05 20:52:46.278961 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 672/1277] 10.222.0.15 () {60 vars in 1176 bytes} [Sat Mar 5 20:52:46 2022] GET /compute/v2.1/os-keypairs => generated 1723 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:46.290851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cde2f9bc-ce5a-43ba-a3e0-0b021ae30207 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:46.291541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cde2f9bc-ce5a-43ba-a3e0-0b021ae30207 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:46.300199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cde2f9bc-ce5a-43ba-a3e0-0b021ae30207 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:46.300375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cde2f9bc-ce5a-43ba-a3e0-0b021ae30207 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:46.301434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cde2f9bc-ce5a-43ba-a3e0-0b021ae30207 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:46.302050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cde2f9bc-ce5a-43ba-a3e0-0b021ae30207 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:46.433688 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4c69ae9f-2901-4d53-8219-da2d4d1cf267 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] 10.222.0.15 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.342741 Mar 05 20:52:46.443163 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 606/1278] 10.222.0.15 () {60 vars in 1169 bytes} [Sat Mar 5 20:52:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:46.449689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ff366a24-ed2a-4877-9985-47fa14cc0b6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:46.451079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ff366a24-ed2a-4877-9985-47fa14cc0b6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:46.459046 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff366a24-ed2a-4877-9985-47fa14cc0b6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:46.459894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff366a24-ed2a-4877-9985-47fa14cc0b6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:46.460973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff366a24-ed2a-4877-9985-47fa14cc0b6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:46.461611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff366a24-ed2a-4877-9985-47fa14cc0b6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:46.731615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ff366a24-ed2a-4877-9985-47fa14cc0b6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:46.739900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cde2f9bc-ce5a-43ba-a3e0-0b021ae30207 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:46.740277 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ff366a24-ed2a-4877-9985-47fa14cc0b6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:46.741902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ff366a24-ed2a-4877-9985-47fa14cc0b6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:46.743263 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ff366a24-ed2a-4877-9985-47fa14cc0b6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1361 microversion: 2.25 time: 0.298570 Mar 05 20:52:46.744026 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 607/1279] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:46 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1361 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:46.750709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-03328906-c3c0-4446-92d2-dc12c5530a2f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:46.751330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-03328906-c3c0-4446-92d2-dc12c5530a2f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:46.758143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-03328906-c3c0-4446-92d2-dc12c5530a2f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:46.758599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-03328906-c3c0-4446-92d2-dc12c5530a2f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:46.759381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-03328906-c3c0-4446-92d2-dc12c5530a2f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:46.759898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-03328906-c3c0-4446-92d2-dc12c5530a2f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:46.769961 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cde2f9bc-ce5a-43ba-a3e0-0b021ae30207 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 200 len: 1307 microversion: 2.1 time: 0.482816 Mar 05 20:52:46.770844 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 673/1280] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:46 2022] GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 1307 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:46.779141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-65f02d00-e59c-447e-bafe-2946af3bdc48 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:46.783153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-65f02d00-e59c-447e-bafe-2946af3bdc48 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:46.784645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-65f02d00-e59c-447e-bafe-2946af3bdc48 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Searching by: {'deleted': False, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:52:46.819274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65f02d00-e59c-447e-bafe-2946af3bdc48 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:46.819763 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65f02d00-e59c-447e-bafe-2946af3bdc48 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:46.821225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65f02d00-e59c-447e-bafe-2946af3bdc48 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:46.821672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65f02d00-e59c-447e-bafe-2946af3bdc48 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:46.874856 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-65f02d00-e59c-447e-bafe-2946af3bdc48 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.101189 Mar 05 20:52:46.876289 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 674/1281] 10.222.0.15 () {58 vars in 1124 bytes} [Sat Mar 5 20:52:46 2022] GET /compute/v2.1/servers => generated 677 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:46.894764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ac965a12-6682-4e4f-86a8-41c648a4ab91 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5c4a4a60>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:46.933402 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ac965a12-6682-4e4f-86a8-41c648a4ab91 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-836242169" status: 204 len: 0 microversion: 2.2 time: 0.050794 Mar 05 20:52:46.935157 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 675/1282] 10.222.0.15 () {60 vars in 1317 bytes} [Sat Mar 5 20:52:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-836242169 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:46.947925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-681dacb4-2274-4aef-9917-d69937a6184a tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] Action: 'create', calling method: .version_select at 0x7fed5c64a0d0>, body: {"pool": null} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:47.044049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-03328906-c3c0-4446-92d2-dc12c5530a2f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:47.063857 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-03328906-c3c0-4446-92d2-dc12c5530a2f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1542 microversion: 2.1 time: 0.318198 Mar 05 20:52:47.064802 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 608/1283] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:46 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1542 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:47.079174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9e5af375-2704-417a-8c1a-a6fad870e5e2 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:47.080111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9e5af375-2704-417a-8c1a-a6fad870e5e2 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:47.181724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9e5af375-2704-417a-8c1a-a6fad870e5e2 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:47.191154 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9e5af375-2704-417a-8c1a-a6fad870e5e2 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b" status: 200 len: 1220 microversion: 2.1 time: 0.125235 Mar 05 20:52:47.192148 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 609/1284] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:47 2022] GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b => generated 1220 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:47.197294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-da9d92cc-7cbc-45ba-a019-2712ec2cbc43 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5c78c790>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:47.256304 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-da9d92cc-7cbc-45ba-a019-2712ec2cbc43 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1007495731" status: 204 len: 0 microversion: 2.2 time: 0.062432 Mar 05 20:52:47.258678 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 610/1285] 10.222.0.15 () {60 vars in 1320 bytes} [Sat Mar 5 20:52:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1007495731 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:47.269642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b943afe8-f647-4a58-b571-820a7c89d765 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5c6953a0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:47.312914 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b943afe8-f647-4a58-b571-820a7c89d765 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1352152609" status: 204 len: 0 microversion: 2.2 time: 0.045335 Mar 05 20:52:47.313762 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 611/1286] 10.222.0.15 () {60 vars in 1320 bytes} [Sat Mar 5 20:52:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1352152609 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 20:52:47.336382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-43513b22-e328-42cc-9c8b-3cace581ab06 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Action: 'create', calling method: .version_select at 0x7fed5c78c9d0>, body: {"keypair": {"name": "tempest-keypair-1939465249"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:47.366432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-43513b22-e328-42cc-9c8b-3cace581ab06 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:47.373032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-43513b22-e328-42cc-9c8b-3cace581ab06 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:48.536325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-43513b22-e328-42cc-9c8b-3cace581ab06 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:48.544652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-43513b22-e328-42cc-9c8b-3cace581ab06 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:48.588761 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-43513b22-e328-42cc-9c8b-3cace581ab06 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 1.267560 Mar 05 20:52:48.589006 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 612/1287] 10.222.0.15 () {62 vars in 1197 bytes} [Sat Mar 5 20:52:47 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1269 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:48.610970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-19a6e79a-de4d-477e-82e2-aff452f35cee tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:48.612344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-19a6e79a-de4d-477e-82e2-aff452f35cee tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:48.622767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19a6e79a-de4d-477e-82e2-aff452f35cee tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:48.623231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19a6e79a-de4d-477e-82e2-aff452f35cee tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:48.624119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19a6e79a-de4d-477e-82e2-aff452f35cee tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:48.624566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19a6e79a-de4d-477e-82e2-aff452f35cee tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:49.090498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-19a6e79a-de4d-477e-82e2-aff452f35cee tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:49.098803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-19a6e79a-de4d-477e-82e2-aff452f35cee tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:49.104631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-19a6e79a-de4d-477e-82e2-aff452f35cee tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:49.109555 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-19a6e79a-de4d-477e-82e2-aff452f35cee tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1361 microversion: 2.25 time: 0.514419 Mar 05 20:52:49.110451 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 613/1288] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:48 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1361 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:49.137703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-231ef75c-e4df-4325-b0b9-8541e8fa932d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:49.138239 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-231ef75c-e4df-4325-b0b9-8541e8fa932d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:49.146822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-231ef75c-e4df-4325-b0b9-8541e8fa932d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:49.146822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-231ef75c-e4df-4325-b0b9-8541e8fa932d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:49.146822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-231ef75c-e4df-4325-b0b9-8541e8fa932d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:49.146822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-231ef75c-e4df-4325-b0b9-8541e8fa932d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:49.491162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-231ef75c-e4df-4325-b0b9-8541e8fa932d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:49.505142 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-231ef75c-e4df-4325-b0b9-8541e8fa932d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 200 len: 1307 microversion: 2.1 time: 0.370249 Mar 05 20:52:49.507470 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 614/1289] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:49 2022] GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 1307 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:49.549399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-787c9577-5013-464e-a348-51743a06bcc4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:49.552482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-787c9577-5013-464e-a348-51743a06bcc4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:49.567927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-787c9577-5013-464e-a348-51743a06bcc4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:49.568979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-787c9577-5013-464e-a348-51743a06bcc4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:49.569950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-787c9577-5013-464e-a348-51743a06bcc4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:49.570554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-787c9577-5013-464e-a348-51743a06bcc4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:50.131937 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-681dacb4-2274-4aef-9917-d69937a6184a tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] 10.222.0.15 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.194742 Mar 05 20:52:50.136525 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 676/1290] 10.222.0.15 () {60 vars in 1169 bytes} [Sat Mar 5 20:52:46 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:50.150986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4443c23c-9724-40f9-b938-ef916e857dd7 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:50.152349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4443c23c-9724-40f9-b938-ef916e857dd7 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:50.158926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4443c23c-9724-40f9-b938-ef916e857dd7 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:50.159513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4443c23c-9724-40f9-b938-ef916e857dd7 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:50.160969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4443c23c-9724-40f9-b938-ef916e857dd7 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:50.161878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4443c23c-9724-40f9-b938-ef916e857dd7 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:50.188469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-787c9577-5013-464e-a348-51743a06bcc4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:50.199573 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-787c9577-5013-464e-a348-51743a06bcc4 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1542 microversion: 2.1 time: 0.682297 Mar 05 20:52:50.201003 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 615/1291] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:49 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1542 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:50.207335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eba929b7-b7be-4796-a08b-71c0b6c938fd tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5c695790>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:50.218396 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eba929b7-b7be-4796-a08b-71c0b6c938fd tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "GET /compute/v2.1/os-keypairs/tempest-keypair-1939465249" status: 200 len: 707 microversion: 2.2 time: 0.015704 Mar 05 20:52:50.225906 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 616/1292] 10.222.0.15 () {60 vars in 1257 bytes} [Sat Mar 5 20:52:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1939465249 => generated 707 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:50.236931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-64cac6d5-d776-4aae-8b6f-ae431f16d7e2 req-df358601-bd09-49e9-ad8d-24123e7e9720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78b93bf-150c-4b48-b376-5c2ba3a624b9", "name": "network-vif-plugged", "status": "completed", "tag": "62f18a02-3cec-4f72-9fe9-641e4f0d18e9"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:50.254472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-64cac6d5-d776-4aae-8b6f-ae431f16d7e2 req-df358601-bd09-49e9-ad8d-24123e7e9720 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:50.255339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-64cac6d5-d776-4aae-8b6f-ae431f16d7e2 req-df358601-bd09-49e9-ad8d-24123e7e9720 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:50.258829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4443c23c-9724-40f9-b938-ef916e857dd7 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:50.269691 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4443c23c-9724-40f9-b938-ef916e857dd7 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b" status: 200 len: 1278 microversion: 2.1 time: 0.131801 Mar 05 20:52:50.271041 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 677/1293] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:50 2022] GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b => generated 1278 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:50.284741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c201b8d3-6a22-458f-9e7e-66862266e6ac tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:50.285360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c201b8d3-6a22-458f-9e7e-66862266e6ac tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:50.286650 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-64cac6d5-d776-4aae-8b6f-ae431f16d7e2 req-df358601-bd09-49e9-ad8d-24123e7e9720 service nova] Creating event network-vif-plugged:62f18a02-3cec-4f72-9fe9-641e4f0d18e9 for instance a78b93bf-150c-4b48-b376-5c2ba3a624b9 on nch2-master-1 Mar 05 20:52:50.293702 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-64cac6d5-d776-4aae-8b6f-ae431f16d7e2 req-df358601-bd09-49e9-ad8d-24123e7e9720 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066059 Mar 05 20:52:50.294718 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 617/1294] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:50.304270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c201b8d3-6a22-458f-9e7e-66862266e6ac tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:50.305014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c201b8d3-6a22-458f-9e7e-66862266e6ac tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:50.314627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c201b8d3-6a22-458f-9e7e-66862266e6ac tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:50.315431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c201b8d3-6a22-458f-9e7e-66862266e6ac tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:50.333736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dc722ce6-cf11-44a2-b691-5542ee619b08 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] Action: 'create', calling method: .version_select at 0x7fed5c6cadc0>, body: {"pool": null} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:50.563845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c201b8d3-6a22-458f-9e7e-66862266e6ac tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:50.583804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c201b8d3-6a22-458f-9e7e-66862266e6ac tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:50.592702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c201b8d3-6a22-458f-9e7e-66862266e6ac tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:50.594675 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c201b8d3-6a22-458f-9e7e-66862266e6ac tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1361 microversion: 2.25 time: 0.321495 Mar 05 20:52:50.595485 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 678/1295] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:50 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1361 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:50.605504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-66d2625e-76e9-447e-9b23-26ba158273d3 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5c45b280>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:50.614635 ncdv-master-1 devstack@n-api.service[141479]: WARNING oslo_db.sqlalchemy.utils [None req-66d2625e-76e9-447e-9b23-26ba158273d3 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 05 20:52:50.629596 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-66d2625e-76e9-447e-9b23-26ba158273d3 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "GET /compute/v2.1/os-keypairs" status: 200 len: 564 microversion: 2.2 time: 0.032780 Mar 05 20:52:50.635383 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 679/1296] 10.222.0.15 () {60 vars in 1176 bytes} [Sat Mar 5 20:52:50 2022] GET /compute/v2.1/os-keypairs => generated 564 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:50.640043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-97e6f321-828a-4253-bdc3-b325f804cdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:50.641867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-97e6f321-828a-4253-bdc3-b325f804cdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:50.666560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97e6f321-828a-4253-bdc3-b325f804cdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:50.667352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97e6f321-828a-4253-bdc3-b325f804cdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:50.671727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97e6f321-828a-4253-bdc3-b325f804cdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:50.671727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97e6f321-828a-4253-bdc3-b325f804cdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:50.925642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-97e6f321-828a-4253-bdc3-b325f804cdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:50.935017 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-97e6f321-828a-4253-bdc3-b325f804cdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 200 len: 1307 microversion: 2.1 time: 0.303264 Mar 05 20:52:50.936656 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 680/1297] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:50 2022] GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 1307 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:50.941704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b9591ab4-9f3a-410f-aec1-9d5ebbc871de tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5c4cc940>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:50.976367 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b9591ab4-9f3a-410f-aec1-9d5ebbc871de tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939465249" status: 204 len: 0 microversion: 2.2 time: 0.038552 Mar 05 20:52:50.985190 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 681/1298] 10.222.0.15 () {60 vars in 1260 bytes} [Sat Mar 5 20:52:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939465249 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:50.992074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bc51fce6-7017-4a69-bbe2-d1675f298456 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Action: 'create', calling method: .version_select at 0x7fed5c45bf70>, body: {"keypair": {"name": "tempest-keypair-115022996", "type": "x509"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:51.035854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bc51fce6-7017-4a69-bbe2-d1675f298456 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:51.046009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bc51fce6-7017-4a69-bbe2-d1675f298456 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:51.082050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.processutils [None req-bc51fce6-7017-4a69-bbe2-d1675f298456 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpi9ohlykd/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpi9ohlykd/temp.key -subj /CN=33206aa8e4f048a2ae30135ef15fa3f5 -extensions v3_req_client {{(pid=141479) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:52:51.354617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.processutils [None req-bc51fce6-7017-4a69-bbe2-d1675f298456 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpi9ohlykd/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpi9ohlykd/temp.key -subj /CN=33206aa8e4f048a2ae30135ef15fa3f5 -extensions v3_req_client" returned: 0 in 0.270s {{(pid=141479) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:52:51.359038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.processutils [None req-bc51fce6-7017-4a69-bbe2-d1675f298456 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpi9ohlykd/temp.key -password pass: {{(pid=141479) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 05 20:52:51.419628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.processutils [None req-bc51fce6-7017-4a69-bbe2-d1675f298456 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpi9ohlykd/temp.key -password pass:" returned: 0 in 0.059s {{(pid=141479) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 05 20:52:51.519371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bc51fce6-7017-4a69-bbe2-d1675f298456 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:52:51.531898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bc51fce6-7017-4a69-bbe2-d1675f298456 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Getting quotas for user 33206aa8e4f048a2ae30135ef15fa3f5 and project 71774e5537064828bf8ab6e239d4f630. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:52:51.578530 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bc51fce6-7017-4a69-bbe2-d1675f298456 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.590910 Mar 05 20:52:51.580110 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 682/1299] 10.222.0.15 () {62 vars in 1197 bytes} [Sat Mar 5 20:52:50 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 594 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:51.588161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a9f9c8b8-c619-4849-a66e-3e7a9b0f171f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:51.590177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a9f9c8b8-c619-4849-a66e-3e7a9b0f171f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:51.601254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9f9c8b8-c619-4849-a66e-3e7a9b0f171f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:51.602550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9f9c8b8-c619-4849-a66e-3e7a9b0f171f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:51.603731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9f9c8b8-c619-4849-a66e-3e7a9b0f171f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:51.635055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9f9c8b8-c619-4849-a66e-3e7a9b0f171f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:51.997159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a9f9c8b8-c619-4849-a66e-3e7a9b0f171f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:52.009767 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a9f9c8b8-c619-4849-a66e-3e7a9b0f171f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1542 microversion: 2.1 time: 0.428060 Mar 05 20:52:52.010797 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 683/1300] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:51 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1542 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:52.040053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a752a574-ed85-4d53-84bc-5c6baf96d303 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:52.041003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a752a574-ed85-4d53-84bc-5c6baf96d303 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:52.056232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a752a574-ed85-4d53-84bc-5c6baf96d303 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:52.057028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a752a574-ed85-4d53-84bc-5c6baf96d303 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:52.059528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a752a574-ed85-4d53-84bc-5c6baf96d303 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:52.060185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a752a574-ed85-4d53-84bc-5c6baf96d303 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:52.322215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a752a574-ed85-4d53-84bc-5c6baf96d303 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:52.340324 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a752a574-ed85-4d53-84bc-5c6baf96d303 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b" status: 200 len: 1320 microversion: 2.1 time: 0.309321 Mar 05 20:52:52.341154 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 684/1301] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:52 2022] GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b => generated 1320 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:52.358824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1ee9651b-be89-4cab-ade3-9ac189b4300d tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5c57f1f0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:52.379187 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1ee9651b-be89-4cab-ade3-9ac189b4300d tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "GET /compute/v2.1/os-keypairs/tempest-keypair-115022996" status: 200 len: 1533 microversion: 2.2 time: 0.027731 Mar 05 20:52:52.379885 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 685/1302] 10.222.0.15 () {60 vars in 1254 bytes} [Sat Mar 5 20:52:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-115022996 => generated 1533 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:52.384745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a729d568-dce5-4c76-be37-8f065e73f1b6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:52.387632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a729d568-dce5-4c76-be37-8f065e73f1b6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:52.400417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a729d568-dce5-4c76-be37-8f065e73f1b6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:52.402086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a729d568-dce5-4c76-be37-8f065e73f1b6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:52.406876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a729d568-dce5-4c76-be37-8f065e73f1b6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:52.407615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a729d568-dce5-4c76-be37-8f065e73f1b6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:52.641238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a729d568-dce5-4c76-be37-8f065e73f1b6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:52.649553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a729d568-dce5-4c76-be37-8f065e73f1b6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:52.651193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a729d568-dce5-4c76-be37-8f065e73f1b6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:52.652909 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a729d568-dce5-4c76-be37-8f065e73f1b6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1361 microversion: 2.25 time: 0.271865 Mar 05 20:52:52.654076 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 686/1303] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:52 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:52.659290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-182d19e3-1556-42a8-b4fe-46fefa39b441 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:52.660170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-182d19e3-1556-42a8-b4fe-46fefa39b441 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:52.668551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-182d19e3-1556-42a8-b4fe-46fefa39b441 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:52.669004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-182d19e3-1556-42a8-b4fe-46fefa39b441 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:52.670080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-182d19e3-1556-42a8-b4fe-46fefa39b441 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:52.670430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-182d19e3-1556-42a8-b4fe-46fefa39b441 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:52.906996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-182d19e3-1556-42a8-b4fe-46fefa39b441 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:52.917056 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-182d19e3-1556-42a8-b4fe-46fefa39b441 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 200 len: 1487 microversion: 2.1 time: 0.261576 Mar 05 20:52:52.918114 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 687/1304] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:52 2022] GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 1487 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:52.924592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-50a03953-e3d6-4e77-aeb8-0937c5f57332 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5c470d30>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:52.927775 ncdv-master-1 devstack@n-api.service[141479]: WARNING oslo_db.sqlalchemy.utils [None req-50a03953-e3d6-4e77-aeb8-0937c5f57332 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 05 20:52:52.937444 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-50a03953-e3d6-4e77-aeb8-0937c5f57332 tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.017665 Mar 05 20:52:52.938149 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 688/1305] 10.222.0.15 () {60 vars in 1176 bytes} [Sat Mar 5 20:52:52 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:52.944196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c4c78b83-19e1-45f3-a629-b7ff1c7a4a59 req-9bbe2f6a-b6b0-46c2-a2e6-cb0a1a7df2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31db5aa9-c804-4757-af1b-3354d442b6d8", "name": "network-vif-plugged", "status": "completed", "tag": "c0110646-dc95-417d-ac53-0985cc88a5b8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:52.954596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c4c78b83-19e1-45f3-a629-b7ff1c7a4a59 req-9bbe2f6a-b6b0-46c2-a2e6-cb0a1a7df2e4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:52.955129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c4c78b83-19e1-45f3-a629-b7ff1c7a4a59 req-9bbe2f6a-b6b0-46c2-a2e6-cb0a1a7df2e4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:52.972381 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c4c78b83-19e1-45f3-a629-b7ff1c7a4a59 req-9bbe2f6a-b6b0-46c2-a2e6-cb0a1a7df2e4 service nova] Creating event network-vif-plugged:c0110646-dc95-417d-ac53-0985cc88a5b8 for instance 31db5aa9-c804-4757-af1b-3354d442b6d8 on nch2-master-1 Mar 05 20:52:52.980777 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c4c78b83-19e1-45f3-a629-b7ff1c7a4a59 req-9bbe2f6a-b6b0-46c2-a2e6-cb0a1a7df2e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039823 Mar 05 20:52:52.981813 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 689/1306] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:52.992648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e1d4b0e7-5df6-4aa7-b3a9-7a1620d48cda req-58b3ce36-22d4-4581-9816-c5bb6f9fcf06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d52eacda-01a8-4166-b9a1-0ec730e2b5dc", "tag": "878b946f-c090-4c0f-8268-6cafc20b229c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:53.010044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e1d4b0e7-5df6-4aa7-b3a9-7a1620d48cda req-58b3ce36-22d4-4581-9816-c5bb6f9fcf06 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:53.011391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e1d4b0e7-5df6-4aa7-b3a9-7a1620d48cda req-58b3ce36-22d4-4581-9816-c5bb6f9fcf06 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:53.035224 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e1d4b0e7-5df6-4aa7-b3a9-7a1620d48cda req-58b3ce36-22d4-4581-9816-c5bb6f9fcf06 service nova] Creating event network-changed:878b946f-c090-4c0f-8268-6cafc20b229c for instance d52eacda-01a8-4166-b9a1-0ec730e2b5dc on nch1-master-1 Mar 05 20:52:53.040483 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e1d4b0e7-5df6-4aa7-b3a9-7a1620d48cda req-58b3ce36-22d4-4581-9816-c5bb6f9fcf06 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057061 Mar 05 20:52:53.041458 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 690/1307] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:53.049702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-36e77ccd-9959-4ffa-98a6-b8d800dd66d3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:53.050363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-36e77ccd-9959-4ffa-98a6-b8d800dd66d3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:53.058560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36e77ccd-9959-4ffa-98a6-b8d800dd66d3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:53.059145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36e77ccd-9959-4ffa-98a6-b8d800dd66d3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:53.060030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36e77ccd-9959-4ffa-98a6-b8d800dd66d3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:53.060522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36e77ccd-9959-4ffa-98a6-b8d800dd66d3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:53.148312 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-36e77ccd-9959-4ffa-98a6-b8d800dd66d3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "POST /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9/action" status: 202 len: 0 microversion: 2.1 time: 0.103991 Mar 05 20:52:53.152716 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 691/1308] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:52:53 2022] POST /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:52:53.157592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-38704b28-a2b0-4c36-92f2-7e7abf99cb6c tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] Calling method '.version_select at 0x7fed5ce1e280>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:53.185922 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-38704b28-a2b0-4c36-92f2-7e7abf99cb6c tempest-KeyPairsV22TestJSON-390669040 tempest-KeyPairsV22TestJSON-390669040-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-115022996" status: 204 len: 0 microversion: 2.2 time: 0.034918 Mar 05 20:52:53.188571 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 692/1309] 10.222.0.15 () {60 vars in 1257 bytes} [Sat Mar 5 20:52:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-115022996 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:52:53.196124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1abfb5f9-4b7a-4e1d-b7ab-3dbfabf5054c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:53.197118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1abfb5f9-4b7a-4e1d-b7ab-3dbfabf5054c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:53.204911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1abfb5f9-4b7a-4e1d-b7ab-3dbfabf5054c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:53.205433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1abfb5f9-4b7a-4e1d-b7ab-3dbfabf5054c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:53.206252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1abfb5f9-4b7a-4e1d-b7ab-3dbfabf5054c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:53.206698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1abfb5f9-4b7a-4e1d-b7ab-3dbfabf5054c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:53.452449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1abfb5f9-4b7a-4e1d-b7ab-3dbfabf5054c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:53.463368 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1abfb5f9-4b7a-4e1d-b7ab-3dbfabf5054c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1542 microversion: 2.1 time: 0.273931 Mar 05 20:52:53.464820 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 693/1310] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:53 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1542 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:53.470865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1dd53936-a980-4e77-9e22-ce910cd93e09 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:53.471493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1dd53936-a980-4e77-9e22-ce910cd93e09 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:53.479804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1dd53936-a980-4e77-9e22-ce910cd93e09 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:53.480584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1dd53936-a980-4e77-9e22-ce910cd93e09 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:53.481455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1dd53936-a980-4e77-9e22-ce910cd93e09 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:53.481912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1dd53936-a980-4e77-9e22-ce910cd93e09 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:53.862899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1dd53936-a980-4e77-9e22-ce910cd93e09 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:53.885919 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1dd53936-a980-4e77-9e22-ce910cd93e09 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 200 len: 1492 microversion: 2.1 time: 0.419387 Mar 05 20:52:53.890407 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 694/1311] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:53 2022] GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 1492 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:53.898244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b11ebfa2-e443-4d37-b7e1-88f677080b15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:53.899814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b11ebfa2-e443-4d37-b7e1-88f677080b15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:53.914684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b11ebfa2-e443-4d37-b7e1-88f677080b15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:53.915503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b11ebfa2-e443-4d37-b7e1-88f677080b15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:53.918645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b11ebfa2-e443-4d37-b7e1-88f677080b15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:53.919555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b11ebfa2-e443-4d37-b7e1-88f677080b15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:54.201686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b11ebfa2-e443-4d37-b7e1-88f677080b15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:54.211720 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b11ebfa2-e443-4d37-b7e1-88f677080b15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b" status: 200 len: 1320 microversion: 2.1 time: 0.320053 Mar 05 20:52:54.224307 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 695/1312] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:53 2022] GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b => generated 1320 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:54.231372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fe67f418-c89b-4d28-bac7-45d52e9764cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:54.232326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fe67f418-c89b-4d28-bac7-45d52e9764cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:54.257105 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe67f418-c89b-4d28-bac7-45d52e9764cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:54.258861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe67f418-c89b-4d28-bac7-45d52e9764cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:54.265295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe67f418-c89b-4d28-bac7-45d52e9764cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:54.266227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe67f418-c89b-4d28-bac7-45d52e9764cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:54.618638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fe67f418-c89b-4d28-bac7-45d52e9764cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:54.631719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fe67f418-c89b-4d28-bac7-45d52e9764cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:54.634551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fe67f418-c89b-4d28-bac7-45d52e9764cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:54.636778 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fe67f418-c89b-4d28-bac7-45d52e9764cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1361 microversion: 2.25 time: 0.410289 Mar 05 20:52:54.638216 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 696/1313] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:54 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1361 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:54.659059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3a1c0963-e35d-4788-bf00-22ee88d1ea9b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:54.659830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3a1c0963-e35d-4788-bf00-22ee88d1ea9b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:54.683592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a1c0963-e35d-4788-bf00-22ee88d1ea9b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:54.684151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a1c0963-e35d-4788-bf00-22ee88d1ea9b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:54.685407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a1c0963-e35d-4788-bf00-22ee88d1ea9b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:54.685945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a1c0963-e35d-4788-bf00-22ee88d1ea9b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:54.877260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3a1c0963-e35d-4788-bf00-22ee88d1ea9b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:54.898440 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3a1c0963-e35d-4788-bf00-22ee88d1ea9b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1542 microversion: 2.1 time: 0.258628 Mar 05 20:52:54.900195 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 697/1314] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:54 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1542 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:54.920100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-379e90f1-b384-4cb4-8546-db7b53909254 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:54.920901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-379e90f1-b384-4cb4-8546-db7b53909254 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:54.944725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-379e90f1-b384-4cb4-8546-db7b53909254 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:54.945421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-379e90f1-b384-4cb4-8546-db7b53909254 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:54.947059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-379e90f1-b384-4cb4-8546-db7b53909254 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:54.947749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-379e90f1-b384-4cb4-8546-db7b53909254 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:54.984026 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dc722ce6-cf11-44a2-b691-5542ee619b08 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] 10.222.0.15 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.686432 Mar 05 20:52:54.992767 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 618/1315] 10.222.0.15 () {60 vars in 1169 bytes} [Sat Mar 5 20:52:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:54.999595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6401459d-71b1-40df-8ab9-fc8978e4035a tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] Calling method '.version_select at 0x7fed5c7b0280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:55.118434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-379e90f1-b384-4cb4-8546-db7b53909254 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:55.130720 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-379e90f1-b384-4cb4-8546-db7b53909254 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 200 len: 1472 microversion: 2.1 time: 0.224149 Mar 05 20:52:55.135862 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 698/1316] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:54 2022] GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 1472 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:55.138704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c837c837-4da9-4818-80c1-84593e20af55 req-b65e4ef5-8e3e-4ec7-8e9d-b6888429afc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c11f51-93de-462e-a077-8def070aa65b", "tag": "6ea2476e-b80c-4e12-8bde-c724d5fa1f64"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:55.148057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c837c837-4da9-4818-80c1-84593e20af55 req-b65e4ef5-8e3e-4ec7-8e9d-b6888429afc6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:55.148539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c837c837-4da9-4818-80c1-84593e20af55 req-b65e4ef5-8e3e-4ec7-8e9d-b6888429afc6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:55.166048 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c837c837-4da9-4818-80c1-84593e20af55 req-b65e4ef5-8e3e-4ec7-8e9d-b6888429afc6 service nova] Creating event network-changed:6ea2476e-b80c-4e12-8bde-c724d5fa1f64 for instance b0c11f51-93de-462e-a077-8def070aa65b on nch2-master-1 Mar 05 20:52:55.172139 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c837c837-4da9-4818-80c1-84593e20af55 req-b65e4ef5-8e3e-4ec7-8e9d-b6888429afc6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037742 Mar 05 20:52:55.172912 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 699/1317] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:55.178449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b56d8a02-5879-4b9d-901d-ae5d75b3360d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1703193698"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:55.179909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b56d8a02-5879-4b9d-901d-ae5d75b3360d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:55.188097 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b56d8a02-5879-4b9d-901d-ae5d75b3360d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:55.188601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b56d8a02-5879-4b9d-901d-ae5d75b3360d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:55.189446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b56d8a02-5879-4b9d-901d-ae5d75b3360d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:55.190088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b56d8a02-5879-4b9d-901d-ae5d75b3360d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:55.507695 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b56d8a02-5879-4b9d-901d-ae5d75b3360d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "POST /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9/action" status: 202 len: 0 microversion: 2.1 time: 0.333467 Mar 05 20:52:55.508315 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 700/1318] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:52:55 2022] POST /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 20:52:55.514995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3abc1d28-1e21-488f-820d-ff44fdd1700a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:55.515963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3abc1d28-1e21-488f-820d-ff44fdd1700a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:55.523200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3abc1d28-1e21-488f-820d-ff44fdd1700a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:55.523917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3abc1d28-1e21-488f-820d-ff44fdd1700a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:55.525658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3abc1d28-1e21-488f-820d-ff44fdd1700a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:55.526336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3abc1d28-1e21-488f-820d-ff44fdd1700a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:55.702077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3abc1d28-1e21-488f-820d-ff44fdd1700a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:55.711096 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3abc1d28-1e21-488f-820d-ff44fdd1700a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b" status: 200 len: 1320 microversion: 2.1 time: 0.200951 Mar 05 20:52:55.711852 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 701/1319] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:55 2022] GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b => generated 1320 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:55.720727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3340e673-9b5f-4284-b626-a5566dbf566c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c470550>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:55.762992 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6401459d-71b1-40df-8ab9-fc8978e4035a tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] 10.222.0.15 "GET /compute/v2.1/os-floating-ips/6ecea3a4-4584-4ee9-a00d-a0025251f289" status: 200 len: 142 microversion: 2.1 time: 0.768961 Mar 05 20:52:55.764187 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 619/1320] 10.222.0.15 () {58 vars in 1259 bytes} [Sat Mar 5 20:52:54 2022] GET /compute/v2.1/os-floating-ips/6ecea3a4-4584-4ee9-a00d-a0025251f289 => generated 142 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:55.775380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-00028f83-f0c0-4371-9be1-49be0cf0b964 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:55.776963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-00028f83-f0c0-4371-9be1-49be0cf0b964 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:55.783204 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3340e673-9b5f-4284-b626-a5566dbf566c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 200 len: 1412 microversion: 2.1 time: 0.070001 Mar 05 20:52:55.789264 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 702/1321] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:55 2022] GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:55.789453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00028f83-f0c0-4371-9be1-49be0cf0b964 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:55.789453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00028f83-f0c0-4371-9be1-49be0cf0b964 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:55.789453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00028f83-f0c0-4371-9be1-49be0cf0b964 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:55.789453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00028f83-f0c0-4371-9be1-49be0cf0b964 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:55.797058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c0285746-af29-4a87-bd4b-6c6f27641286 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] Calling method '.version_select at 0x7fed5c4a4ee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:56.324804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-00028f83-f0c0-4371-9be1-49be0cf0b964 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:56.336637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-00028f83-f0c0-4371-9be1-49be0cf0b964 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:56.339912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-00028f83-f0c0-4371-9be1-49be0cf0b964 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:56.342849 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-00028f83-f0c0-4371-9be1-49be0cf0b964 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1558 microversion: 2.25 time: 0.572876 Mar 05 20:52:56.344564 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 620/1322] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:55 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1558 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:56.351619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-653c222d-4b62-402d-8645-03c0dcad1c68 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:56.352620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-653c222d-4b62-402d-8645-03c0dcad1c68 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:56.361287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-653c222d-4b62-402d-8645-03c0dcad1c68 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:56.361831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-653c222d-4b62-402d-8645-03c0dcad1c68 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:56.362940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-653c222d-4b62-402d-8645-03c0dcad1c68 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:56.363611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-653c222d-4b62-402d-8645-03c0dcad1c68 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:56.679714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-653c222d-4b62-402d-8645-03c0dcad1c68 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:56.689802 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-653c222d-4b62-402d-8645-03c0dcad1c68 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1541 microversion: 2.1 time: 0.343555 Mar 05 20:52:56.691616 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 621/1323] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:56 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1541 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:57.013847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-494d49f9-b632-4b93-8679-0d1c441b9ba1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:57.014837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-494d49f9-b632-4b93-8679-0d1c441b9ba1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:57.022449 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-494d49f9-b632-4b93-8679-0d1c441b9ba1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:57.023172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-494d49f9-b632-4b93-8679-0d1c441b9ba1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:57.024425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-494d49f9-b632-4b93-8679-0d1c441b9ba1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:57.025090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-494d49f9-b632-4b93-8679-0d1c441b9ba1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:57.426840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-494d49f9-b632-4b93-8679-0d1c441b9ba1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid 31db5aa9-c804-4757-af1b-3354d442b6d8 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:52:57.488275 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-494d49f9-b632-4b93-8679-0d1c441b9ba1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 2050 microversion: 2.25 time: 0.795152 Mar 05 20:52:57.489106 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 622/1324] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:56 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 2050 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:57.494002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ec9e1d7f-909a-43f2-ae9e-c8aae7a44fc6 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:57.494681 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ec9e1d7f-909a-43f2-ae9e-c8aae7a44fc6 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:57.501468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec9e1d7f-909a-43f2-ae9e-c8aae7a44fc6 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:57.502011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec9e1d7f-909a-43f2-ae9e-c8aae7a44fc6 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:57.502863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec9e1d7f-909a-43f2-ae9e-c8aae7a44fc6 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:57.503525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec9e1d7f-909a-43f2-ae9e-c8aae7a44fc6 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:57.752376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ec9e1d7f-909a-43f2-ae9e-c8aae7a44fc6 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:57.779263 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ec9e1d7f-909a-43f2-ae9e-c8aae7a44fc6 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b" status: 200 len: 1320 microversion: 2.1 time: 0.283022 Mar 05 20:52:57.782357 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 623/1325] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:57 2022] GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:57.787471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f025bcb8-7160-4748-b02a-4a3090707438 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c710b80>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:57.854008 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f025bcb8-7160-4748-b02a-4a3090707438 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 200 len: 1412 microversion: 2.1 time: 0.070142 Mar 05 20:52:57.862180 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 624/1326] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:57 2022] GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:57.867331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9b181c7e-c983-48da-bec5-8c33b41dda4f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:57.868373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9b181c7e-c983-48da-bec5-8c33b41dda4f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:57.876194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b181c7e-c983-48da-bec5-8c33b41dda4f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:57.876997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b181c7e-c983-48da-bec5-8c33b41dda4f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:57.878163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b181c7e-c983-48da-bec5-8c33b41dda4f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:57.878822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b181c7e-c983-48da-bec5-8c33b41dda4f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:58.043707 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c0285746-af29-4a87-bd4b-6c6f27641286 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] 10.222.0.15 "DELETE /compute/v2.1/os-floating-ips/6ecea3a4-4584-4ee9-a00d-a0025251f289" status: 202 len: 0 microversion: 2.1 time: 2.257977 Mar 05 20:52:58.048779 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 703/1327] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:52:55 2022] DELETE /compute/v2.1/os-floating-ips/6ecea3a4-4584-4ee9-a00d-a0025251f289 => generated 0 bytes in 2261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:52:58.053577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6faebc63-a1bc-4f65-b8c8-509ce41162eb req-a7bcc9a5-0146-4b1f-a511-c18386e8a74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4bc94-61de-4cb5-8c5a-4ba4dc781ada", "name": "network-vif-unplugged", "status": "completed", "tag": "a62edc1f-925c-416d-82a9-ced25df2b5e2"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:58.090667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6faebc63-a1bc-4f65-b8c8-509ce41162eb req-a7bcc9a5-0146-4b1f-a511-c18386e8a74e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:58.091614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6faebc63-a1bc-4f65-b8c8-509ce41162eb req-a7bcc9a5-0146-4b1f-a511-c18386e8a74e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:58.111794 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6faebc63-a1bc-4f65-b8c8-509ce41162eb req-a7bcc9a5-0146-4b1f-a511-c18386e8a74e service nova] Creating event network-vif-unplugged:a62edc1f-925c-416d-82a9-ced25df2b5e2 for instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada on nch2-master-1 Mar 05 20:52:58.118138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-9b181c7e-c983-48da-bec5-8c33b41dda4f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid 31db5aa9-c804-4757-af1b-3354d442b6d8 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:52:58.120669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-6faebc63-a1bc-4f65-b8c8-509ce41162eb req-a7bcc9a5-0146-4b1f-a511-c18386e8a74e service nova] Instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:52:58.138546 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6faebc63-a1bc-4f65-b8c8-509ce41162eb req-a7bcc9a5-0146-4b1f-a511-c18386e8a74e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090251 Mar 05 20:52:58.139420 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 704/1328] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:58.146070 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9b181c7e-c983-48da-bec5-8c33b41dda4f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 2050 microversion: 2.25 time: 0.282346 Mar 05 20:52:58.147650 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 625/1329] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:52:57 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 2050 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:52:58.148069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-746a4253-0b0f-4a86-ba1f-17d2a8da4ea5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:58.148894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-746a4253-0b0f-4a86-ba1f-17d2a8da4ea5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:58.170082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-746a4253-0b0f-4a86-ba1f-17d2a8da4ea5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:58.171024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-746a4253-0b0f-4a86-ba1f-17d2a8da4ea5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:58.172952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-746a4253-0b0f-4a86-ba1f-17d2a8da4ea5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:58.173660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-746a4253-0b0f-4a86-ba1f-17d2a8da4ea5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:58.242694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-09d857a1-12d0-4598-8708-f90ea1530493 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'create', calling method: .version_select at 0x7fed5c7cb160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1622593503", "description": "tempest-description-656568137"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:58.441391 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-09d857a1-12d0-4598-8708-f90ea1530493 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.291434 Mar 05 20:52:58.449017 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 626/1330] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:52:58 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:58.450160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-29fa1b08-ed57-4378-b272-e078367a8437 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] Calling method '.version_select at 0x7fed5c69f9d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:58.846861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-746a4253-0b0f-4a86-ba1f-17d2a8da4ea5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:58.862005 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-746a4253-0b0f-4a86-ba1f-17d2a8da4ea5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1541 microversion: 2.1 time: 0.720632 Mar 05 20:52:58.863021 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 705/1331] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:58 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1541 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:58.871609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-43c3522a-3a1e-4e93-8fcd-65bf01959a5b tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:58.889442 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:52:58.889442 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:52:58.911848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43c3522a-3a1e-4e93-8fcd-65bf01959a5b tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:58.920187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43c3522a-3a1e-4e93-8fcd-65bf01959a5b tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:58.921850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43c3522a-3a1e-4e93-8fcd-65bf01959a5b tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:58.922531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43c3522a-3a1e-4e93-8fcd-65bf01959a5b tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:58.953374 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-43c3522a-3a1e-4e93-8fcd-65bf01959a5b tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.086728 Mar 05 20:52:58.961565 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 706/1332] 10.222.0.15 () {60 vars in 1216 bytes} [Sat Mar 5 20:52:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:52:58.968570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b9abfaf4-48ef-4174-b9a6-83171c2cd7a9 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'create', calling method: .version_select at 0x7fed5c4a4a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-166776991", "description": "tempest-description-1501055061"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:59.280199 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-29fa1b08-ed57-4378-b272-e078367a8437 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] 10.222.0.15 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.835169 Mar 05 20:52:59.280850 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 627/1333] 10.222.0.15 () {58 vars in 1163 bytes} [Sat Mar 5 20:52:58 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:52:59.289611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4de6a66f-5ea1-4d8d-9078-7d6266e0f49c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:59.290155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4de6a66f-5ea1-4d8d-9078-7d6266e0f49c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:59.299030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4de6a66f-5ea1-4d8d-9078-7d6266e0f49c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:59.304149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4de6a66f-5ea1-4d8d-9078-7d6266e0f49c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:59.305083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4de6a66f-5ea1-4d8d-9078-7d6266e0f49c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:59.305547 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4de6a66f-5ea1-4d8d-9078-7d6266e0f49c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:59.641471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4de6a66f-5ea1-4d8d-9078-7d6266e0f49c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:52:59.649729 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4de6a66f-5ea1-4d8d-9078-7d6266e0f49c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b" status: 200 len: 1320 microversion: 2.1 time: 0.367743 Mar 05 20:52:59.660538 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 628/1334] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:52:59 2022] GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b => generated 1320 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:59.666029 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ba68e70d-6a58-45d1-a0f1-18f388bd9a02 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c67cca0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:59.725556 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ba68e70d-6a58-45d1-a0f1-18f388bd9a02 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 200 len: 1412 microversion: 2.1 time: 0.061961 Mar 05 20:52:59.727562 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 629/1335] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:52:59 2022] GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:52:59.735600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bd017dd4-a1c2-4f31-a212-c1ffd11d4207 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:52:59.737578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bd017dd4-a1c2-4f31-a212-c1ffd11d4207 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:52:59.744662 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b9abfaf4-48ef-4174-b9a6-83171c2cd7a9 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.781413 Mar 05 20:52:59.758001 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 707/1336] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:52:58 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:52:59.760800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd017dd4-a1c2-4f31-a212-c1ffd11d4207 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:59.761533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd017dd4-a1c2-4f31-a212-c1ffd11d4207 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:59.762548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd017dd4-a1c2-4f31-a212-c1ffd11d4207 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:52:59.763167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd017dd4-a1c2-4f31-a212-c1ffd11d4207 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:52:59.764925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f18b77b6-a85f-4897-8d12-71a80722b172 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] Calling method '.version_select at 0x7fed5c57f040>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:52:59.817223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-bd017dd4-a1c2-4f31-a212-c1ffd11d4207 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'flavor' on Instance uuid 31db5aa9-c804-4757-af1b-3354d442b6d8 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:52:59.852627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bd017dd4-a1c2-4f31-a212-c1ffd11d4207 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Going to try to live migrate instance to nch1-master-1 {{(pid=141478) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 05 20:53:00.216144 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f18b77b6-a85f-4897-8d12-71a80722b172 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] 10.222.0.15 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.456541 Mar 05 20:53:00.216789 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 708/1337] 10.222.0.15 () {58 vars in 1148 bytes} [Sat Mar 5 20:52:59 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:00.228196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-867491052", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "62082c5f-85c3-4d11-9ba0-883ff09b0721"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:00.327732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] validate_networks() for [('62082c5f-85c3-4d11-9ba0-883ff09b0721', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:53:01.491055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:53:01.496190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:53:01.496774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:53:01.498344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:53:01.498344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:53:01.520293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:01.521040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:01.522036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:01.523001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:01.583614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Getting quotas for project 8f07583be1724ade87d2945c000e3e33. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:53:01.593831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Getting quotas for user 31812fbb5c6142a8ab6068b1464ae2a3 and project 8f07583be1724ade87d2945c000e3e33. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:53:01.638392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:53:01.648179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:53:01.783484 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b19b980a-79e7-4572-838c-07b3378feaf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565329 Mar 05 20:53:01.784541 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 709/1338] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:53:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:53:01.796044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5d465ad2-a4b8-4477-8574-f00d1f1f96fd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:01.796769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5d465ad2-a4b8-4477-8574-f00d1f1f96fd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:01.805607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d465ad2-a4b8-4477-8574-f00d1f1f96fd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:01.806323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d465ad2-a4b8-4477-8574-f00d1f1f96fd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:01.807324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d465ad2-a4b8-4477-8574-f00d1f1f96fd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:01.808786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d465ad2-a4b8-4477-8574-f00d1f1f96fd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:02.648570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5d465ad2-a4b8-4477-8574-f00d1f1f96fd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:02.675352 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5d465ad2-a4b8-4477-8574-f00d1f1f96fd tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1473 microversion: 2.1 time: 0.883740 Mar 05 20:53:02.676068 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 710/1339] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:01 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1473 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:02.728868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5372d7d2-df4d-4db3-8755-acdb50cafd50 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] Calling method '.version_select at 0x7fed5c42c940>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:03.319039 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bd017dd4-a1c2-4f31-a212-c1ffd11d4207 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8/action" status: 202 len: 0 microversion: 2.25 time: 3.589542 Mar 05 20:53:03.324320 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 630/1340] 10.222.0.15 () {62 vars in 1318 bytes} [Sat Mar 5 20:52:59 2022] POST /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8/action => generated 0 bytes in 3594 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:53:03.330361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-69aa1fdd-e597-4531-839c-3abc47a4b982 req-a7e2d0e5-5beb-4e90-86bb-78d04afd4b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a4bc94-61de-4cb5-8c5a-4ba4dc781ada", "tag": "a62edc1f-925c-416d-82a9-ced25df2b5e2"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:03.370943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-69aa1fdd-e597-4531-839c-3abc47a4b982 req-a7e2d0e5-5beb-4e90-86bb-78d04afd4b89 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:03.373852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-69aa1fdd-e597-4531-839c-3abc47a4b982 req-a7e2d0e5-5beb-4e90-86bb-78d04afd4b89 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:03.414834 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-69aa1fdd-e597-4531-839c-3abc47a4b982 req-a7e2d0e5-5beb-4e90-86bb-78d04afd4b89 service nova] Creating event network-changed:a62edc1f-925c-416d-82a9-ced25df2b5e2 for instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada on nch2-master-1 Mar 05 20:53:03.441854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-69aa1fdd-e597-4531-839c-3abc47a4b982 req-a7e2d0e5-5beb-4e90-86bb-78d04afd4b89 service nova] Instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:53:03.486356 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-69aa1fdd-e597-4531-839c-3abc47a4b982 req-a7e2d0e5-5beb-4e90-86bb-78d04afd4b89 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160204 Mar 05 20:53:03.492318 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 631/1341] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:03.524720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-582c1859-07e3-457a-819f-a8e774b492d5 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:03.530026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-582c1859-07e3-457a-819f-a8e774b492d5 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:03.544135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-582c1859-07e3-457a-819f-a8e774b492d5 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:03.547043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-582c1859-07e3-457a-819f-a8e774b492d5 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:03.562417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-582c1859-07e3-457a-819f-a8e774b492d5 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:03.564856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-582c1859-07e3-457a-819f-a8e774b492d5 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:04.697166 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-582c1859-07e3-457a-819f-a8e774b492d5 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:04.711545 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-582c1859-07e3-457a-819f-a8e774b492d5 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b" status: 200 len: 1320 microversion: 2.1 time: 1.215143 Mar 05 20:53:04.715383 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 632/1342] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:03 2022] GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b => generated 1320 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:04.726855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-01588f3b-f1b0-4bf7-9990-311c6cebc7f8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c62dca0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:04.797760 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-01588f3b-f1b0-4bf7-9990-311c6cebc7f8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 200 len: 1412 microversion: 2.1 time: 0.079369 Mar 05 20:53:04.799980 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 633/1343] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:53:04 2022] GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:04.817978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-71c23657-68c5-403d-91ea-a3e747d349fc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:04.820047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-71c23657-68c5-403d-91ea-a3e747d349fc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:04.838066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71c23657-68c5-403d-91ea-a3e747d349fc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:04.842003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71c23657-68c5-403d-91ea-a3e747d349fc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:04.844493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71c23657-68c5-403d-91ea-a3e747d349fc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:04.845121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71c23657-68c5-403d-91ea-a3e747d349fc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:05.050025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-71c23657-68c5-403d-91ea-a3e747d349fc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:05.061949 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-71c23657-68c5-403d-91ea-a3e747d349fc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c" status: 200 len: 1273 microversion: 2.1 time: 0.259657 Mar 05 20:53:05.066256 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 634/1344] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:04 2022] GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:05.066256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-3f97a216-86ca-4b28-8eb9-771874551ba6 req-4baabdd9-8e4b-404f-89b9-52c77a2aff7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d52eacda-01a8-4166-b9a1-0ec730e2b5dc", "name": "network-vif-plugged", "status": "completed", "tag": "878b946f-c090-4c0f-8268-6cafc20b229c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:05.089654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3f97a216-86ca-4b28-8eb9-771874551ba6 req-4baabdd9-8e4b-404f-89b9-52c77a2aff7e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:05.090539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3f97a216-86ca-4b28-8eb9-771874551ba6 req-4baabdd9-8e4b-404f-89b9-52c77a2aff7e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:05.106890 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-3f97a216-86ca-4b28-8eb9-771874551ba6 req-4baabdd9-8e4b-404f-89b9-52c77a2aff7e service nova] Creating event network-vif-plugged:878b946f-c090-4c0f-8268-6cafc20b229c for instance d52eacda-01a8-4166-b9a1-0ec730e2b5dc on nch1-master-1 Mar 05 20:53:05.114781 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-3f97a216-86ca-4b28-8eb9-771874551ba6 req-4baabdd9-8e4b-404f-89b9-52c77a2aff7e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046853 Mar 05 20:53:05.115655 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 635/1345] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:05.124638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1148329a-a749-4e27-b6dc-6defb4e60b77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:05.125610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1148329a-a749-4e27-b6dc-6defb4e60b77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:05.162668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1148329a-a749-4e27-b6dc-6defb4e60b77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:05.163452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1148329a-a749-4e27-b6dc-6defb4e60b77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:05.167702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1148329a-a749-4e27-b6dc-6defb4e60b77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:05.168488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1148329a-a749-4e27-b6dc-6defb4e60b77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:05.986713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1148329a-a749-4e27-b6dc-6defb4e60b77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:05.996411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1148329a-a749-4e27-b6dc-6defb4e60b77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:06.001483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1148329a-a749-4e27-b6dc-6defb4e60b77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:06.002680 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1148329a-a749-4e27-b6dc-6defb4e60b77 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1568 microversion: 2.25 time: 0.885696 Mar 05 20:53:06.003243 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 636/1346] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:05 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1568 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:06.033611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-664f592a-c90f-4c0e-ab9c-13dd2823eae3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:06.034235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-664f592a-c90f-4c0e-ab9c-13dd2823eae3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:06.049354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-664f592a-c90f-4c0e-ab9c-13dd2823eae3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:06.049869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-664f592a-c90f-4c0e-ab9c-13dd2823eae3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:06.050762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-664f592a-c90f-4c0e-ab9c-13dd2823eae3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:06.051287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-664f592a-c90f-4c0e-ab9c-13dd2823eae3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:06.258311 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5372d7d2-df4d-4db3-8755-acdb50cafd50 tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] 10.222.0.15 "DELETE /compute/v2.1/os-floating-ips/344636a1-4c75-4fe3-90b7-a56c7fae5154" status: 202 len: 0 microversion: 2.1 time: 3.581218 Mar 05 20:53:06.261373 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 711/1347] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:53:02 2022] DELETE /compute/v2.1/os-floating-ips/344636a1-4c75-4fe3-90b7-a56c7fae5154 => generated 0 bytes in 3582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:53:06.266282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-58c16803-ed94-4d90-9a67-0995587e12db tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:06.267045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-58c16803-ed94-4d90-9a67-0995587e12db tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:06.289252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-58c16803-ed94-4d90-9a67-0995587e12db tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:06.291226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-58c16803-ed94-4d90-9a67-0995587e12db tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:06.294132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-58c16803-ed94-4d90-9a67-0995587e12db tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:06.294620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-58c16803-ed94-4d90-9a67-0995587e12db tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:06.421436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-664f592a-c90f-4c0e-ab9c-13dd2823eae3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:06.431733 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-664f592a-c90f-4c0e-ab9c-13dd2823eae3 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1470 microversion: 2.1 time: 0.413423 Mar 05 20:53:06.442665 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 637/1348] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:06 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1470 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:06.442665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e82b6bd8-a0cf-4648-ae99-fbea9deb479d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c67ca60>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:06.525046 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e82b6bd8-a0cf-4648-ae99-fbea9deb479d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 200 len: 1412 microversion: 2.1 time: 0.090728 Mar 05 20:53:06.526290 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 638/1349] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:53:06 2022] GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:06.535911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-30ec9b63-73f9-4208-a99f-f5585a1d475b tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:06.539164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-30ec9b63-73f9-4208-a99f-f5585a1d475b tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:06.558324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30ec9b63-73f9-4208-a99f-f5585a1d475b tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:06.560517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30ec9b63-73f9-4208-a99f-f5585a1d475b tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:06.562914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30ec9b63-73f9-4208-a99f-f5585a1d475b tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:06.565091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30ec9b63-73f9-4208-a99f-f5585a1d475b tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:06.689055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-30ec9b63-73f9-4208-a99f-f5585a1d475b tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:06.703895 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-30ec9b63-73f9-4208-a99f-f5585a1d475b tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c" status: 200 len: 1273 microversion: 2.1 time: 0.176325 Mar 05 20:53:06.704872 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 639/1350] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:06 2022] GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c => generated 1273 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:06.709676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-59932931-24d1-491a-b15d-f7ac26d1c73b tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] Calling method '.version_select at 0x7fed5c780940>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:07.195528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-58c16803-ed94-4d90-9a67-0995587e12db tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:07.207290 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-58c16803-ed94-4d90-9a67-0995587e12db tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b" status: 200 len: 1320 microversion: 2.1 time: 0.946299 Mar 05 20:53:07.208039 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 712/1351] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:06 2022] GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b => generated 1320 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:07.233174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8bcb9924-f076-4d20-ab48-23dc06ef63df tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:07.238631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8bcb9924-f076-4d20-ab48-23dc06ef63df tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:07.252383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bcb9924-f076-4d20-ab48-23dc06ef63df tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:07.252860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bcb9924-f076-4d20-ab48-23dc06ef63df tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:07.253713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bcb9924-f076-4d20-ab48-23dc06ef63df tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:07.254080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bcb9924-f076-4d20-ab48-23dc06ef63df tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:07.381216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bcb9924-f076-4d20-ab48-23dc06ef63df tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:07.382464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bcb9924-f076-4d20-ab48-23dc06ef63df tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:07.383565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bcb9924-f076-4d20-ab48-23dc06ef63df tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:07.384273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bcb9924-f076-4d20-ab48-23dc06ef63df tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:07.446926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-8bcb9924-f076-4d20-ab48-23dc06ef63df tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Getting quotas for project 3501f5d56344468ebc4d50db1a5c5bb7. Resources: {'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:53:07.456693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-8bcb9924-f076-4d20-ab48-23dc06ef63df tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Getting quotas for user 52cc30e265f94e3caa91b6adff365209 and project 3501f5d56344468ebc4d50db1a5c5bb7. Resources: {'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:53:07.727274 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8bcb9924-f076-4d20-ab48-23dc06ef63df tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "POST /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada/action" status: 202 len: 0 microversion: 2.1 time: 0.506031 Mar 05 20:53:07.728215 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 713/1352] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:53:07 2022] POST /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:53:07.750176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3f5724b6-f049-407f-9fb2-299faf8ce229 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:07.751157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3f5724b6-f049-407f-9fb2-299faf8ce229 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:07.762515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f5724b6-f049-407f-9fb2-299faf8ce229 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:07.763367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f5724b6-f049-407f-9fb2-299faf8ce229 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:07.766643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f5724b6-f049-407f-9fb2-299faf8ce229 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:07.767545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f5724b6-f049-407f-9fb2-299faf8ce229 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:08.229478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3f5724b6-f049-407f-9fb2-299faf8ce229 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:08.245902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3f5724b6-f049-407f-9fb2-299faf8ce229 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:08.250442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3f5724b6-f049-407f-9fb2-299faf8ce229 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:08.253285 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3f5724b6-f049-407f-9fb2-299faf8ce229 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1568 microversion: 2.25 time: 0.522002 Mar 05 20:53:08.255254 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 714/1353] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:07 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1568 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:08.263635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ba06efbc-fd13-4f58-84da-e65042398b1a req-95b14815-80f9-4e22-9e37-d1aee97e2c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78b93bf-150c-4b48-b376-5c2ba3a624b9", "name": "network-vif-plugged", "status": "completed", "tag": "62f18a02-3cec-4f72-9fe9-641e4f0d18e9"}, {"server_uuid": "b0c11f51-93de-462e-a077-8def070aa65b", "name": "network-vif-plugged", "status": "completed", "tag": "6ea2476e-b80c-4e12-8bde-c724d5fa1f64"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:08.298686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ba06efbc-fd13-4f58-84da-e65042398b1a req-95b14815-80f9-4e22-9e37-d1aee97e2c7e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:08.304032 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ba06efbc-fd13-4f58-84da-e65042398b1a req-95b14815-80f9-4e22-9e37-d1aee97e2c7e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:08.342363 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ba06efbc-fd13-4f58-84da-e65042398b1a req-95b14815-80f9-4e22-9e37-d1aee97e2c7e service nova] Creating event network-vif-plugged:62f18a02-3cec-4f72-9fe9-641e4f0d18e9 for instance a78b93bf-150c-4b48-b376-5c2ba3a624b9 on nch2-master-1 Mar 05 20:53:08.343316 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ba06efbc-fd13-4f58-84da-e65042398b1a req-95b14815-80f9-4e22-9e37-d1aee97e2c7e service nova] Creating event network-vif-plugged:6ea2476e-b80c-4e12-8bde-c724d5fa1f64 for instance b0c11f51-93de-462e-a077-8def070aa65b on nch2-master-1 Mar 05 20:53:08.358384 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ba06efbc-fd13-4f58-84da-e65042398b1a req-95b14815-80f9-4e22-9e37-d1aee97e2c7e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.101286 Mar 05 20:53:08.359419 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 715/1354] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:08.370878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a9b966fd-34b5-409f-acbe-013e830d9afb tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Action: 'create', calling method: .version_select at 0x7fed5c57f040>, body: {"keypair": {"name": "tempest-keypair-1100974734"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:08.451541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-a9b966fd-34b5-409f-acbe-013e830d9afb tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Getting quotas for project f15a5d639338454c90a7ce959e996284. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:53:08.477994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-a9b966fd-34b5-409f-acbe-013e830d9afb tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Getting quotas for user 4028a85798ff4ea88a0aa32b944010a8 and project f15a5d639338454c90a7ce959e996284. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:53:08.678959 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-59932931-24d1-491a-b15d-f7ac26d1c73b tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] 10.222.0.15 "DELETE /compute/v2.1/os-floating-ips/37e26aad-89a1-4fd7-8c6a-acee01fe115f" status: 202 len: 0 microversion: 2.1 time: 1.972736 Mar 05 20:53:08.683428 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 640/1355] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:53:06 2022] DELETE /compute/v2.1/os-floating-ips/37e26aad-89a1-4fd7-8c6a-acee01fe115f => generated 0 bytes in 1974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:53:08.692600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-07eb21a7-0581-40f6-ad26-34fe8a3c0530 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c61df70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:08.781906 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-07eb21a7-0581-40f6-ad26-34fe8a3c0530 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 200 len: 1412 microversion: 2.1 time: 0.100646 Mar 05 20:53:08.782496 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 641/1356] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:53:08 2022] GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:08.809208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-91a704d1-95fd-4abf-b862-27b6ee889db2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:08.810200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-91a704d1-95fd-4abf-b862-27b6ee889db2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:08.825473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91a704d1-95fd-4abf-b862-27b6ee889db2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:08.827502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91a704d1-95fd-4abf-b862-27b6ee889db2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:08.831622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91a704d1-95fd-4abf-b862-27b6ee889db2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:08.832324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91a704d1-95fd-4abf-b862-27b6ee889db2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:08.931361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-a9b966fd-34b5-409f-acbe-013e830d9afb tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Getting quotas for project f15a5d639338454c90a7ce959e996284. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:53:08.953264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-a9b966fd-34b5-409f-acbe-013e830d9afb tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Getting quotas for user 4028a85798ff4ea88a0aa32b944010a8 and project f15a5d639338454c90a7ce959e996284. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:53:09.007896 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a9b966fd-34b5-409f-acbe-013e830d9afb tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.32 time: 0.646843 Mar 05 20:53:09.010231 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 716/1357] 10.222.0.15 () {62 vars in 1198 bytes} [Sat Mar 5 20:53:08 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 650 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:53:09.030997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-89adbf2e-55ab-4324-875d-c0a17dffe321 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:09.035747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-89adbf2e-55ab-4324-875d-c0a17dffe321 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:09.051583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89adbf2e-55ab-4324-875d-c0a17dffe321 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:09.053788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89adbf2e-55ab-4324-875d-c0a17dffe321 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:09.055062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89adbf2e-55ab-4324-875d-c0a17dffe321 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:09.061158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89adbf2e-55ab-4324-875d-c0a17dffe321 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:09.529223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-91a704d1-95fd-4abf-b862-27b6ee889db2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:09.537338 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-91a704d1-95fd-4abf-b862-27b6ee889db2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c" status: 200 len: 1315 microversion: 2.1 time: 0.752215 Mar 05 20:53:09.537931 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 642/1358] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:08 2022] GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:09.546898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-21258187-f5f8-4a2c-8ee5-62ddec4005f1 req-a9d36f80-2db1-4339-bf1c-a678c60c5dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31db5aa9-c804-4757-af1b-3354d442b6d8", "name": "network-vif-unplugged", "status": "completed", "tag": "c0110646-dc95-417d-ac53-0985cc88a5b8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:09.569077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-21258187-f5f8-4a2c-8ee5-62ddec4005f1 req-a9d36f80-2db1-4339-bf1c-a678c60c5dc4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:09.569936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-21258187-f5f8-4a2c-8ee5-62ddec4005f1 req-a9d36f80-2db1-4339-bf1c-a678c60c5dc4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:09.583043 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-21258187-f5f8-4a2c-8ee5-62ddec4005f1 req-a9d36f80-2db1-4339-bf1c-a678c60c5dc4 service nova] Creating event network-vif-unplugged:c0110646-dc95-417d-ac53-0985cc88a5b8 for instance 31db5aa9-c804-4757-af1b-3354d442b6d8 on nch2-master-1 Mar 05 20:53:09.590317 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-21258187-f5f8-4a2c-8ee5-62ddec4005f1 req-a9d36f80-2db1-4339-bf1c-a678c60c5dc4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046800 Mar 05 20:53:09.591776 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 643/1359] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:09.600340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-353d70b8-8315-4f8e-a308-cc514decd990 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:09.601377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-353d70b8-8315-4f8e-a308-cc514decd990 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:09.610340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-353d70b8-8315-4f8e-a308-cc514decd990 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:09.611454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-353d70b8-8315-4f8e-a308-cc514decd990 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:09.612636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-353d70b8-8315-4f8e-a308-cc514decd990 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:09.613574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-353d70b8-8315-4f8e-a308-cc514decd990 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:09.896103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-353d70b8-8315-4f8e-a308-cc514decd990 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:09.910382 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-353d70b8-8315-4f8e-a308-cc514decd990 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b" status: 200 len: 1320 microversion: 2.1 time: 0.316926 Mar 05 20:53:09.920721 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 644/1360] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:09 2022] GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:09.928318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c2a20eb7-91d3-4ce8-93cb-1ac4ced3e0cf tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] Calling method '.version_select at 0x7fed5c67cca0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:10.092710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-89adbf2e-55ab-4324-875d-c0a17dffe321 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:10.106947 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-89adbf2e-55ab-4324-875d-c0a17dffe321 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1469 microversion: 2.1 time: 1.094716 Mar 05 20:53:10.109924 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 717/1361] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:09 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1469 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:10.118810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-325db54b-3cad-44ea-912d-0116eb6e8810 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:10.120881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-325db54b-3cad-44ea-912d-0116eb6e8810 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:10.129635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-325db54b-3cad-44ea-912d-0116eb6e8810 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:10.130145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-325db54b-3cad-44ea-912d-0116eb6e8810 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:10.131410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-325db54b-3cad-44ea-912d-0116eb6e8810 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:10.132022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-325db54b-3cad-44ea-912d-0116eb6e8810 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:10.636689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-325db54b-3cad-44ea-912d-0116eb6e8810 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:10.649375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-325db54b-3cad-44ea-912d-0116eb6e8810 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:10.651554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-325db54b-3cad-44ea-912d-0116eb6e8810 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:10.657006 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-325db54b-3cad-44ea-912d-0116eb6e8810 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1568 microversion: 2.25 time: 0.545995 Mar 05 20:53:10.668457 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 718/1362] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:10 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1568 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:10.682988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5c58202e-c5a3-4905-adde-514dbd01abee tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c42c3a0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:10.788772 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5c58202e-c5a3-4905-adde-514dbd01abee tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 200 len: 1412 microversion: 2.1 time: 0.115786 Mar 05 20:53:10.789709 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 719/1363] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:53:10 2022] GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:10.803444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-3e102b35-f01c-42b2-9e6b-024e57349448 req-35352640-4316-45fc-844e-3d679656564e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4bc94-61de-4cb5-8c5a-4ba4dc781ada", "name": "network-vif-plugged", "status": "completed", "tag": "a62edc1f-925c-416d-82a9-ced25df2b5e2"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:10.812371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3e102b35-f01c-42b2-9e6b-024e57349448 req-35352640-4316-45fc-844e-3d679656564e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:10.813193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3e102b35-f01c-42b2-9e6b-024e57349448 req-35352640-4316-45fc-844e-3d679656564e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:10.829412 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-3e102b35-f01c-42b2-9e6b-024e57349448 req-35352640-4316-45fc-844e-3d679656564e service nova] Creating event network-vif-plugged:a62edc1f-925c-416d-82a9-ced25df2b5e2 for instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada on nch2-master-1 Mar 05 20:53:10.836439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-3e102b35-f01c-42b2-9e6b-024e57349448 req-35352640-4316-45fc-844e-3d679656564e service nova] Instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:53:10.851015 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-3e102b35-f01c-42b2-9e6b-024e57349448 req-35352640-4316-45fc-844e-3d679656564e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059750 Mar 05 20:53:10.851791 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 720/1364] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:10.859514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b6346860-65e8-48f2-afca-662498452219 req-0214f045-bb32-4b6e-b161-87438d4ddf07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e87f17b-0999-4fff-ae66-5f37ccc3628c", "tag": "4843f79d-ea4a-4732-bdaa-157ee20d5051"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:10.868418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b6346860-65e8-48f2-afca-662498452219 req-0214f045-bb32-4b6e-b161-87438d4ddf07 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:10.869151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b6346860-65e8-48f2-afca-662498452219 req-0214f045-bb32-4b6e-b161-87438d4ddf07 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:10.883412 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b6346860-65e8-48f2-afca-662498452219 req-0214f045-bb32-4b6e-b161-87438d4ddf07 service nova] Creating event network-changed:4843f79d-ea4a-4732-bdaa-157ee20d5051 for instance 1e87f17b-0999-4fff-ae66-5f37ccc3628c on nch1-master-1 Mar 05 20:53:10.890312 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b6346860-65e8-48f2-afca-662498452219 req-0214f045-bb32-4b6e-b161-87438d4ddf07 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036882 Mar 05 20:53:10.891528 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 721/1365] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:10.898177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-70acb054-f34e-4c9d-9f16-6b552879afe3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:10.899374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-70acb054-f34e-4c9d-9f16-6b552879afe3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:10.909870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70acb054-f34e-4c9d-9f16-6b552879afe3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:10.910614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70acb054-f34e-4c9d-9f16-6b552879afe3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:10.912224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70acb054-f34e-4c9d-9f16-6b552879afe3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:10.912932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70acb054-f34e-4c9d-9f16-6b552879afe3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:11.348858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-70acb054-f34e-4c9d-9f16-6b552879afe3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:11.360883 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-70acb054-f34e-4c9d-9f16-6b552879afe3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c" status: 200 len: 1315 microversion: 2.1 time: 0.467635 Mar 05 20:53:11.366177 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 722/1366] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:10 2022] GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:11.373557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7430813e-3bde-48ae-ae1c-1a737480803a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:11.375743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7430813e-3bde-48ae-ae1c-1a737480803a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:11.395396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7430813e-3bde-48ae-ae1c-1a737480803a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:11.395923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7430813e-3bde-48ae-ae1c-1a737480803a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:11.399079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7430813e-3bde-48ae-ae1c-1a737480803a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:11.399613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7430813e-3bde-48ae-ae1c-1a737480803a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:11.481086 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c2a20eb7-91d3-4ce8-93cb-1ac4ced3e0cf tempest-FloatingIPDetailsTestJSON-1305426736 tempest-FloatingIPDetailsTestJSON-1305426736-project] 10.222.0.15 "DELETE /compute/v2.1/os-floating-ips/52fc6658-f898-40db-9ed3-f9e677d4c30f" status: 202 len: 0 microversion: 2.1 time: 1.567808 Mar 05 20:53:11.485280 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 645/1367] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:53:09 2022] DELETE /compute/v2.1/os-floating-ips/52fc6658-f898-40db-9ed3-f9e677d4c30f => generated 0 bytes in 1573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:53:11.490110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-07c49764-0b1f-401e-849f-c4e78abbebd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:11.490735 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-07c49764-0b1f-401e-849f-c4e78abbebd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:11.501788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-07c49764-0b1f-401e-849f-c4e78abbebd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:11.502628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-07c49764-0b1f-401e-849f-c4e78abbebd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:11.503767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-07c49764-0b1f-401e-849f-c4e78abbebd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:11.504425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-07c49764-0b1f-401e-849f-c4e78abbebd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:11.860524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7430813e-3bde-48ae-ae1c-1a737480803a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:11.871224 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7430813e-3bde-48ae-ae1c-1a737480803a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b" status: 200 len: 1508 microversion: 2.1 time: 0.503731 Mar 05 20:53:11.874675 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 723/1368] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:11 2022] GET /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b => generated 1508 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:11.893267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-d57765ed-1d74-4934-8bf0-5dc60978ea54 req-ebd1fe84-b628-4327-8523-0167dabd4a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31db5aa9-c804-4757-af1b-3354d442b6d8", "tag": "c0110646-dc95-417d-ac53-0985cc88a5b8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:11.927971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d57765ed-1d74-4934-8bf0-5dc60978ea54 req-ebd1fe84-b628-4327-8523-0167dabd4a56 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:11.936199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-07c49764-0b1f-401e-849f-c4e78abbebd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:11.945426 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-07c49764-0b1f-401e-849f-c4e78abbebd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1469 microversion: 2.1 time: 0.459028 Mar 05 20:53:11.951230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d57765ed-1d74-4934-8bf0-5dc60978ea54 req-ebd1fe84-b628-4327-8523-0167dabd4a56 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:11.957816 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 646/1369] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:11 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1469 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:11.981840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-763bb4f2-6cae-4d58-b9fd-f16dab2669b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:11.982670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-763bb4f2-6cae-4d58-b9fd-f16dab2669b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:12.002480 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-d57765ed-1d74-4934-8bf0-5dc60978ea54 req-ebd1fe84-b628-4327-8523-0167dabd4a56 service nova] Creating event network-changed:c0110646-dc95-417d-ac53-0985cc88a5b8 for instance 31db5aa9-c804-4757-af1b-3354d442b6d8 on nch2-master-1 Mar 05 20:53:12.012293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-763bb4f2-6cae-4d58-b9fd-f16dab2669b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:12.013180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-763bb4f2-6cae-4d58-b9fd-f16dab2669b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:12.016697 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-763bb4f2-6cae-4d58-b9fd-f16dab2669b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:12.018648 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-d57765ed-1d74-4934-8bf0-5dc60978ea54 req-ebd1fe84-b628-4327-8523-0167dabd4a56 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129530 Mar 05 20:53:12.019356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-763bb4f2-6cae-4d58-b9fd-f16dab2669b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:12.036497 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 724/1370] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:12.043241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-33fed905-fd03-4f2a-85d8-7cb3d1576de7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c4a4a60>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:12.156886 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-33fed905-fd03-4f2a-85d8-7cb3d1576de7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 200 len: 1412 microversion: 2.1 time: 0.118762 Mar 05 20:53:12.165160 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 725/1371] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:53:12 2022] GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:12.177196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67d5b2b5-9384-4b30-8099-177682979f15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:12.178397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-67d5b2b5-9384-4b30-8099-177682979f15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: d52eacda-01a8-4166-b9a1-0ec730e2b5dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:12.190120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67d5b2b5-9384-4b30-8099-177682979f15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:12.190924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67d5b2b5-9384-4b30-8099-177682979f15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:12.191767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67d5b2b5-9384-4b30-8099-177682979f15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:12.192231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67d5b2b5-9384-4b30-8099-177682979f15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:12.507901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-763bb4f2-6cae-4d58-b9fd-f16dab2669b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:12.531648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-763bb4f2-6cae-4d58-b9fd-f16dab2669b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:12.545898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-763bb4f2-6cae-4d58-b9fd-f16dab2669b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:12.549976 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-763bb4f2-6cae-4d58-b9fd-f16dab2669b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1568 microversion: 2.25 time: 0.591056 Mar 05 20:53:12.555384 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 647/1372] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:11 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1568 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:12.561295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-21fd6e25-6102-4795-915c-a3c5debb48fa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:12.562223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-21fd6e25-6102-4795-915c-a3c5debb48fa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:12.588124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21fd6e25-6102-4795-915c-a3c5debb48fa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:12.591392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21fd6e25-6102-4795-915c-a3c5debb48fa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:12.592516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21fd6e25-6102-4795-915c-a3c5debb48fa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:12.594363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21fd6e25-6102-4795-915c-a3c5debb48fa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:12.814739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-67d5b2b5-9384-4b30-8099-177682979f15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:12.827163 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67d5b2b5-9384-4b30-8099-177682979f15 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/d52eacda-01a8-4166-b9a1-0ec730e2b5dc" status: 200 len: 1509 microversion: 2.1 time: 0.660556 Mar 05 20:53:12.830131 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 726/1373] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:12 2022] GET /compute/v2.1/servers/d52eacda-01a8-4166-b9a1-0ec730e2b5dc => generated 1509 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:12.846775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c997011-cae4-4eab-acd0-efc114c3e677 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:12.847302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3c997011-cae4-4eab-acd0-efc114c3e677 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: d52eacda-01a8-4166-b9a1-0ec730e2b5dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:12.858692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c997011-cae4-4eab-acd0-efc114c3e677 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:12.859523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c997011-cae4-4eab-acd0-efc114c3e677 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:12.861159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c997011-cae4-4eab-acd0-efc114c3e677 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:12.862265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c997011-cae4-4eab-acd0-efc114c3e677 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:12.903149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3c997011-cae4-4eab-acd0-efc114c3e677 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: d52eacda-01a8-4166-b9a1-0ec730e2b5dc] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:53:13.059998 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3c997011-cae4-4eab-acd0-efc114c3e677 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d52eacda-01a8-4166-b9a1-0ec730e2b5dc" status: 204 len: 0 microversion: 2.1 time: 0.213911 Mar 05 20:53:13.066748 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 727/1374] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:53:12 2022] DELETE /compute/v2.1/servers/d52eacda-01a8-4166-b9a1-0ec730e2b5dc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 20:53:13.084282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-74e13a67-c820-4411-aead-bf43c2ac1ee6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:13.086140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-74e13a67-c820-4411-aead-bf43c2ac1ee6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:13.100570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74e13a67-c820-4411-aead-bf43c2ac1ee6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:13.101196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74e13a67-c820-4411-aead-bf43c2ac1ee6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:13.102054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74e13a67-c820-4411-aead-bf43c2ac1ee6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:13.102621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74e13a67-c820-4411-aead-bf43c2ac1ee6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:13.124142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-21fd6e25-6102-4795-915c-a3c5debb48fa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:13.138187 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-21fd6e25-6102-4795-915c-a3c5debb48fa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c" status: 200 len: 1315 microversion: 2.1 time: 0.581214 Mar 05 20:53:13.141755 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 648/1375] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:12 2022] GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:13.156071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b6539f3c-d87f-4c88-a124-bc9234ed503f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:13.158486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b6539f3c-d87f-4c88-a124-bc9234ed503f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:13.177222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6539f3c-d87f-4c88-a124-bc9234ed503f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:13.179569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6539f3c-d87f-4c88-a124-bc9234ed503f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:13.180461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6539f3c-d87f-4c88-a124-bc9234ed503f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:13.180904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6539f3c-d87f-4c88-a124-bc9234ed503f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:13.228445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b6539f3c-d87f-4c88-a124-bc9234ed503f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: b0c11f51-93de-462e-a077-8def070aa65b] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:53:13.420908 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b6539f3c-d87f-4c88-a124-bc9234ed503f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b" status: 204 len: 0 microversion: 2.1 time: 0.277856 Mar 05 20:53:13.431466 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 649/1376] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:53:13 2022] DELETE /compute/v2.1/servers/b0c11f51-93de-462e-a077-8def070aa65b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:53:13.439038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-da36c059-2bfb-4440-bd62-7bfafeb74187 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c7e50d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:13.493966 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-da36c059-2bfb-4440-bd62-7bfafeb74187 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 200 len: 1412 microversion: 2.1 time: 0.059984 Mar 05 20:53:13.501051 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 650/1377] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:53:13 2022] GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:13.573850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b929e86a-e353-4314-a363-59bc18a577fb tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:13.575797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b929e86a-e353-4314-a363-59bc18a577fb tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:13.599443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b929e86a-e353-4314-a363-59bc18a577fb tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:13.600454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b929e86a-e353-4314-a363-59bc18a577fb tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:13.610108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b929e86a-e353-4314-a363-59bc18a577fb tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:13.610927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b929e86a-e353-4314-a363-59bc18a577fb tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:14.054450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b929e86a-e353-4314-a363-59bc18a577fb tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:14.093733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b929e86a-e353-4314-a363-59bc18a577fb tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:14.097130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b929e86a-e353-4314-a363-59bc18a577fb tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:14.105933 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b929e86a-e353-4314-a363-59bc18a577fb tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1568 microversion: 2.25 time: 0.538774 Mar 05 20:53:14.127705 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 651/1378] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:13 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1568 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:53:14.163919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1506565925", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "0d067b91-4a07-4b62-a220-cba2f62187af"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:14.281952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-74e13a67-c820-4411-aead-bf43c2ac1ee6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:14.306454 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-74e13a67-c820-4411-aead-bf43c2ac1ee6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1535 microversion: 2.1 time: 1.235847 Mar 05 20:53:14.312012 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 728/1379] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:13 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1535 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:14.337385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-bbb225d6-bf8a-4236-9295-797907a9772c req-2b44f7d5-0380-4ade-b5c0-6eea11eaa451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4bc94-61de-4cb5-8c5a-4ba4dc781ada", "name": "network-vif-unplugged", "status": "completed", "tag": "a62edc1f-925c-416d-82a9-ced25df2b5e2"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:14.381341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-bbb225d6-bf8a-4236-9295-797907a9772c req-2b44f7d5-0380-4ade-b5c0-6eea11eaa451 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:14.383690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-bbb225d6-bf8a-4236-9295-797907a9772c req-2b44f7d5-0380-4ade-b5c0-6eea11eaa451 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:14.383903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] validate_networks() for [('0d067b91-4a07-4b62-a220-cba2f62187af', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:53:14.477167 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-bbb225d6-bf8a-4236-9295-797907a9772c req-2b44f7d5-0380-4ade-b5c0-6eea11eaa451 service nova] Creating event network-vif-unplugged:a62edc1f-925c-416d-82a9-ced25df2b5e2 for instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada on nch1-master-1 Mar 05 20:53:14.503792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-bbb225d6-bf8a-4236-9295-797907a9772c req-2b44f7d5-0380-4ade-b5c0-6eea11eaa451 service nova] Instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:53:14.553170 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-bbb225d6-bf8a-4236-9295-797907a9772c req-2b44f7d5-0380-4ade-b5c0-6eea11eaa451 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.233167 Mar 05 20:53:14.558285 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 729/1380] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:14.580348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e6815316-9048-45ba-98f9-235cb6e5e704 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:14.583558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e6815316-9048-45ba-98f9-235cb6e5e704 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:14.607543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6815316-9048-45ba-98f9-235cb6e5e704 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:14.608411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6815316-9048-45ba-98f9-235cb6e5e704 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:14.609887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6815316-9048-45ba-98f9-235cb6e5e704 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:14.614788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6815316-9048-45ba-98f9-235cb6e5e704 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:15.322876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e6815316-9048-45ba-98f9-235cb6e5e704 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:15.331830 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e6815316-9048-45ba-98f9-235cb6e5e704 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c" status: 200 len: 1315 microversion: 2.1 time: 0.771284 Mar 05 20:53:15.338391 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 730/1381] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:14 2022] GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c => generated 1315 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:15.359347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-beb50c1b-d9b1-41ef-8d4f-af476b1159ce tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c5f7ee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:15.437619 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-beb50c1b-d9b1-41ef-8d4f-af476b1159ce tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 200 len: 1412 microversion: 2.1 time: 0.087460 Mar 05 20:53:15.444656 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 731/1382] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:53:15 2022] GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:15.450789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-290be08f-dc81-4008-bff4-d964e1498467 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:15.452307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-290be08f-dc81-4008-bff4-d964e1498467 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:15.460482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-290be08f-dc81-4008-bff4-d964e1498467 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:15.461204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-290be08f-dc81-4008-bff4-d964e1498467 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:15.462250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-290be08f-dc81-4008-bff4-d964e1498467 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:15.462922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-290be08f-dc81-4008-bff4-d964e1498467 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:15.996040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-290be08f-dc81-4008-bff4-d964e1498467 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:16.019091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-290be08f-dc81-4008-bff4-d964e1498467 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:16.020672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-290be08f-dc81-4008-bff4-d964e1498467 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:16.022175 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-290be08f-dc81-4008-bff4-d964e1498467 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1568 microversion: 2.25 time: 0.576386 Mar 05 20:53:16.022756 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 732/1383] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:15 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1568 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:16.037269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-514429121", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "67213d25-3583-48ce-be19-a10d0059fcac"}, {"port": "ef356e17-c442-448a-8679-da5ba1910c00", "tag": "port-1"}, {"port": "8e97203d-117b-4a26-8c1e-33c77fbdf3ce", "tag": "port-2"}, {"uuid": "2b3d5cc6-cf52-466e-844d-ad651934c95a", "tag": "net-1"}, {"uuid": "2b3d5cc6-cf52-466e-844d-ad651934c95a"}, {"uuid": "da3ff7ac-2d9c-4f49-a4eb-d748dd0fcd89", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "da3ff7ac-2d9c-4f49-a4eb-d748dd0fcd89", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "218d7dc8-d08f-48dd-8791-4cb639216b6b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "8501e6cd-ef92-486c-9fd7-73be61906481", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--926824121"}], "key_name": "tempest-keypair-1100974734", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:16.358493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] validate_networks() for [('67213d25-3583-48ce-be19-a10d0059fcac', None, None, None, None, None), (None, None, 'ef356e17-c442-448a-8679-da5ba1910c00', None, None, None), (None, None, '8e97203d-117b-4a26-8c1e-33c77fbdf3ce', None, None, None), ('2b3d5cc6-cf52-466e-844d-ad651934c95a', None, None, None, None, None), ('2b3d5cc6-cf52-466e-844d-ad651934c95a', None, None, None, None, None), ('da3ff7ac-2d9c-4f49-a4eb-d748dd0fcd89', '10.2.2.100', None, None, None, None), ('da3ff7ac-2d9c-4f49-a4eb-d748dd0fcd89', '10.2.2.200', None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:53:16.846938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:53:16.848130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:53:16.849106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:53:16.849737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:53:16.852820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:53:16.896844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:16.899880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:16.916045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:16.917257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:16.983507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Getting quotas for project 2800feb70d3947938e03fbcaa7ee8d13. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:53:17.008002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Getting quotas for user da16ae41d4f547cebc7ccb11e87dfc8e and project 2800feb70d3947938e03fbcaa7ee8d13. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:53:17.030624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Going to run 2 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:53:17.035941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 730ddde5-fc74-4dfd-b3f8-879a2d86114d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:53:17.111727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 5f3a1743-f646-4148-a573-fe033e15c940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=730ddde5-fc74-4dfd-b3f8-879a2d86114d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:53:17.258980 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0020173f-ae88-47c2-8926-409b9d8bae1a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.116003 Mar 05 20:53:17.259660 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 652/1384] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:53:14 2022] POST /compute/v2.1/servers => generated 32 bytes in 3118 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Mar 05 20:53:17.284841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d5a007b3-ce88-4127-8e24-475cbfb6a730 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:17.287024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d5a007b3-ce88-4127-8e24-475cbfb6a730 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:17.320772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d5a007b3-ce88-4127-8e24-475cbfb6a730 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:17.321389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d5a007b3-ce88-4127-8e24-475cbfb6a730 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:17.322366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d5a007b3-ce88-4127-8e24-475cbfb6a730 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:17.326654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d5a007b3-ce88-4127-8e24-475cbfb6a730 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:18.298183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d5a007b3-ce88-4127-8e24-475cbfb6a730 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:18.314046 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d5a007b3-ce88-4127-8e24-475cbfb6a730 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1535 microversion: 2.1 time: 1.041199 Mar 05 20:53:18.315869 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 653/1385] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:17 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1535 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:18.343539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1bbc7c13-c3c0-4b93-8d50-879aa1ed9b34 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:18.346459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1bbc7c13-c3c0-4b93-8d50-879aa1ed9b34 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:18.379645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bbc7c13-c3c0-4b93-8d50-879aa1ed9b34 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:18.384691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bbc7c13-c3c0-4b93-8d50-879aa1ed9b34 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:18.387996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bbc7c13-c3c0-4b93-8d50-879aa1ed9b34 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:18.389150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bbc7c13-c3c0-4b93-8d50-879aa1ed9b34 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:19.648995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1bbc7c13-c3c0-4b93-8d50-879aa1ed9b34 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:19.689370 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1bbc7c13-c3c0-4b93-8d50-879aa1ed9b34 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c" status: 200 len: 1315 microversion: 2.1 time: 1.368403 Mar 05 20:53:19.690985 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 654/1386] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:18 2022] GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c => generated 1315 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:19.696193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cb1edb10-b497-482e-aafc-2d20ce5a82eb tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c62c940>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:19.766476 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cb1edb10-b497-482e-aafc-2d20ce5a82eb tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 200 len: 1412 microversion: 2.1 time: 0.073654 Mar 05 20:53:19.769466 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 655/1387] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:53:19 2022] GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:19.775839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-82de7559-eb7c-4a0c-9f79-116b0649345b req-6f7d4471-13f7-4ef9-9359-d5d7c27bbe8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e87f17b-0999-4fff-ae66-5f37ccc3628c", "name": "network-vif-plugged", "status": "completed", "tag": "4843f79d-ea4a-4732-bdaa-157ee20d5051"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:19.804187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-82de7559-eb7c-4a0c-9f79-116b0649345b req-6f7d4471-13f7-4ef9-9359-d5d7c27bbe8f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:19.805345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-82de7559-eb7c-4a0c-9f79-116b0649345b req-6f7d4471-13f7-4ef9-9359-d5d7c27bbe8f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:19.839065 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-82de7559-eb7c-4a0c-9f79-116b0649345b req-6f7d4471-13f7-4ef9-9359-d5d7c27bbe8f service nova] Creating event network-vif-plugged:4843f79d-ea4a-4732-bdaa-157ee20d5051 for instance 1e87f17b-0999-4fff-ae66-5f37ccc3628c on nch1-master-1 Mar 05 20:53:19.856765 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-82de7559-eb7c-4a0c-9f79-116b0649345b req-6f7d4471-13f7-4ef9-9359-d5d7c27bbe8f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082016 Mar 05 20:53:19.859538 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 656/1388] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:19.878787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-22a6dfaa-d83f-43ea-a3d7-fca456eda537 req-e6f62285-a6e4-4e5b-a2bc-687a946821ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c11f51-93de-462e-a077-8def070aa65b", "name": "network-vif-deleted", "tag": "6ea2476e-b80c-4e12-8bde-c724d5fa1f64"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:19.925582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-22a6dfaa-d83f-43ea-a3d7-fca456eda537 req-e6f62285-a6e4-4e5b-a2bc-687a946821ef service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:19.926208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-22a6dfaa-d83f-43ea-a3d7-fca456eda537 req-e6f62285-a6e4-4e5b-a2bc-687a946821ef service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:19.954951 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-22a6dfaa-d83f-43ea-a3d7-fca456eda537 req-e6f62285-a6e4-4e5b-a2bc-687a946821ef service nova] Creating event network-vif-deleted:6ea2476e-b80c-4e12-8bde-c724d5fa1f64 for instance b0c11f51-93de-462e-a077-8def070aa65b on nch2-master-1 Mar 05 20:53:19.965197 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-22a6dfaa-d83f-43ea-a3d7-fca456eda537 req-e6f62285-a6e4-4e5b-a2bc-687a946821ef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099766 Mar 05 20:53:19.966291 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 657/1389] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:19.973317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0448d083-f3da-45e4-971c-7cd16bbb2968 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:19.974248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0448d083-f3da-45e4-971c-7cd16bbb2968 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:19.989884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0448d083-f3da-45e4-971c-7cd16bbb2968 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:19.990700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0448d083-f3da-45e4-971c-7cd16bbb2968 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:19.991642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0448d083-f3da-45e4-971c-7cd16bbb2968 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:19.992365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0448d083-f3da-45e4-971c-7cd16bbb2968 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:20.698951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0448d083-f3da-45e4-971c-7cd16bbb2968 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:20.709227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0448d083-f3da-45e4-971c-7cd16bbb2968 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:20.717588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0448d083-f3da-45e4-971c-7cd16bbb2968 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:20.719130 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0448d083-f3da-45e4-971c-7cd16bbb2968 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1568 microversion: 2.25 time: 0.751657 Mar 05 20:53:20.721353 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 658/1390] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:19 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1568 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:20.726693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b8d0222a-67df-4a1e-8026-babe329b372f req-77ed05b4-f9e9-41d3-9930-c4e420966826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a4bc94-61de-4cb5-8c5a-4ba4dc781ada", "tag": "a62edc1f-925c-416d-82a9-ced25df2b5e2"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:20.738606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b8d0222a-67df-4a1e-8026-babe329b372f req-77ed05b4-f9e9-41d3-9930-c4e420966826 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:20.742600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b8d0222a-67df-4a1e-8026-babe329b372f req-77ed05b4-f9e9-41d3-9930-c4e420966826 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:20.762215 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-b8d0222a-67df-4a1e-8026-babe329b372f req-77ed05b4-f9e9-41d3-9930-c4e420966826 service nova] Creating event network-changed:a62edc1f-925c-416d-82a9-ced25df2b5e2 for instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada on nch1-master-1 Mar 05 20:53:20.770665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-b8d0222a-67df-4a1e-8026-babe329b372f req-77ed05b4-f9e9-41d3-9930-c4e420966826 service nova] Instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:53:20.795143 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b8d0222a-67df-4a1e-8026-babe329b372f req-77ed05b4-f9e9-41d3-9930-c4e420966826 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071740 Mar 05 20:53:20.795925 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 659/1391] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:20.804725 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-51c14eae-15d6-443b-b4c9-ba4f01e5eacf tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:20.809387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-51c14eae-15d6-443b-b4c9-ba4f01e5eacf tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:20.810585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-51c14eae-15d6-443b-b4c9-ba4f01e5eacf tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Searching by: {'deleted': False, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:53:20.817987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-51c14eae-15d6-443b-b4c9-ba4f01e5eacf tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:20.819066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-51c14eae-15d6-443b-b4c9-ba4f01e5eacf tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:20.819915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-51c14eae-15d6-443b-b4c9-ba4f01e5eacf tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:20.820363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-51c14eae-15d6-443b-b4c9-ba4f01e5eacf tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:20.847377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-51c14eae-15d6-443b-b4c9-ba4f01e5eacf tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:53:20.876389 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-51c14eae-15d6-443b-b4c9-ba4f01e5eacf tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.078820 Mar 05 20:53:20.877190 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 660/1392] 10.222.0.15 () {58 vars in 1124 bytes} [Sat Mar 5 20:53:20 2022] GET /compute/v2.1/servers => generated 673 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:20.881635 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a39e2255-5e06-43cd-9a9f-8fdd4a10246b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:20.882355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a39e2255-5e06-43cd-9a9f-8fdd4a10246b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:20.888591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a39e2255-5e06-43cd-9a9f-8fdd4a10246b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:20.889014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a39e2255-5e06-43cd-9a9f-8fdd4a10246b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:20.889886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a39e2255-5e06-43cd-9a9f-8fdd4a10246b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:20.890338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a39e2255-5e06-43cd-9a9f-8fdd4a10246b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:21.393275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a39e2255-5e06-43cd-9a9f-8fdd4a10246b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:21.401891 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a39e2255-5e06-43cd-9a9f-8fdd4a10246b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1535 microversion: 2.1 time: 0.523222 Mar 05 20:53:21.412333 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 661/1393] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:20 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1535 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:21.418071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3141e93a-f7aa-441f-91e3-b5ad60a63ba8 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:21.418667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3141e93a-f7aa-441f-91e3-b5ad60a63ba8 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:21.424691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3141e93a-f7aa-441f-91e3-b5ad60a63ba8 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:21.425144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3141e93a-f7aa-441f-91e3-b5ad60a63ba8 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:21.425918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3141e93a-f7aa-441f-91e3-b5ad60a63ba8 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:21.426358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3141e93a-f7aa-441f-91e3-b5ad60a63ba8 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:22.010110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3141e93a-f7aa-441f-91e3-b5ad60a63ba8 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:22.027201 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3141e93a-f7aa-441f-91e3-b5ad60a63ba8 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c" status: 200 len: 1315 microversion: 2.1 time: 0.612875 Mar 05 20:53:22.028854 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 662/1394] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:21 2022] GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:22.034219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e26f8bbe-fee7-4faf-897b-6bb955160d06 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c5dc310>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:22.099388 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e26f8bbe-fee7-4faf-897b-6bb955160d06 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 200 len: 1421 microversion: 2.1 time: 0.068101 Mar 05 20:53:22.101882 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 663/1395] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:53:22 2022] GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 1421 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:22.118734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-17555262-9a19-4a0b-833b-4bc0c5280449 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:22.120658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-17555262-9a19-4a0b-833b-4bc0c5280449 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 5f3a1743-f646-4148-a573-fe033e15c940] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:22.135008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-17555262-9a19-4a0b-833b-4bc0c5280449 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:22.137479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-17555262-9a19-4a0b-833b-4bc0c5280449 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:22.138559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-17555262-9a19-4a0b-833b-4bc0c5280449 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:22.139839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-17555262-9a19-4a0b-833b-4bc0c5280449 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:22.637221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-17555262-9a19-4a0b-833b-4bc0c5280449 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:22.645741 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-17555262-9a19-4a0b-833b-4bc0c5280449 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940" status: 200 len: 1276 microversion: 2.1 time: 0.542682 Mar 05 20:53:22.646331 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 664/1396] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:22 2022] GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940 => generated 1276 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:22.651912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c4d24367-19c3-4c7d-9bfd-7d4316daf1fd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:22.653795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c4d24367-19c3-4c7d-9bfd-7d4316daf1fd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:22.660234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4d24367-19c3-4c7d-9bfd-7d4316daf1fd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:22.660927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4d24367-19c3-4c7d-9bfd-7d4316daf1fd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:22.662073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4d24367-19c3-4c7d-9bfd-7d4316daf1fd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:22.662675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4d24367-19c3-4c7d-9bfd-7d4316daf1fd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:22.694875 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:53:22.695795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:53:22.696910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:53:22.697713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:53:22.700083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:53:22.713171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:22.714996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:22.715973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:22.716654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:22.739248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Getting quotas for project f15a5d639338454c90a7ce959e996284. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:53:22.745113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Getting quotas for user 4028a85798ff4ea88a0aa32b944010a8 and project f15a5d639338454c90a7ce959e996284. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:53:22.913617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:53:22.917118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f1cfdf9f-0ebf-4aed-9dc6-cfd6de6b108e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='218d7dc8-d08f-48dd-8791-4cb639216b6b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8501e6cd-ef92-486c-9fd7-73be61906481',volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:53:23.193361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c4d24367-19c3-4c7d-9bfd-7d4316daf1fd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:23.205773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c4d24367-19c3-4c7d-9bfd-7d4316daf1fd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:23.207818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c4d24367-19c3-4c7d-9bfd-7d4316daf1fd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:23.209896 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c4d24367-19c3-4c7d-9bfd-7d4316daf1fd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1558 microversion: 2.25 time: 0.561852 Mar 05 20:53:23.223168 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 665/1397] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:22 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1558 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:23.233085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3d089dd1-c1b0-4855-8ba7-063b8f6d17c2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c5de9d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:23.314117 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3d089dd1-c1b0-4855-8ba7-063b8f6d17c2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 200 len: 1421 microversion: 2.1 time: 0.094215 Mar 05 20:53:23.315533 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 666/1398] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:53:23 2022] GET /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:23.321104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4092049a-35d9-4d78-8aa0-0f52641c5610 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:23.322193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4092049a-35d9-4d78-8aa0-0f52641c5610 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:23.329846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4092049a-35d9-4d78-8aa0-0f52641c5610 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:23.331307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4092049a-35d9-4d78-8aa0-0f52641c5610 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:23.332393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4092049a-35d9-4d78-8aa0-0f52641c5610 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:23.333592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4092049a-35d9-4d78-8aa0-0f52641c5610 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:23.387840 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-74c09ff0-9d63-4ac4-8e91-b99b8b15c72d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.360202 Mar 05 20:53:23.392831 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 733/1399] 10.222.0.15 () {62 vars in 1188 bytes} [Sat Mar 5 20:53:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 7366 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 05 20:53:23.404550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-da5bf8f6-8427-412c-8dc8-a19059117e33 req-435ac8d1-7976-459f-9909-4acb235642b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d52eacda-01a8-4166-b9a1-0ec730e2b5dc", "name": "network-vif-deleted", "tag": "878b946f-c090-4c0f-8268-6cafc20b229c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:23.430454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-da5bf8f6-8427-412c-8dc8-a19059117e33 req-435ac8d1-7976-459f-9909-4acb235642b7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:23.436422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-da5bf8f6-8427-412c-8dc8-a19059117e33 req-435ac8d1-7976-459f-9909-4acb235642b7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:23.456512 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-da5bf8f6-8427-412c-8dc8-a19059117e33 req-435ac8d1-7976-459f-9909-4acb235642b7 service nova] Creating event network-vif-deleted:878b946f-c090-4c0f-8268-6cafc20b229c for instance d52eacda-01a8-4166-b9a1-0ec730e2b5dc on nch1-master-1 Mar 05 20:53:23.462086 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-da5bf8f6-8427-412c-8dc8-a19059117e33 req-435ac8d1-7976-459f-9909-4acb235642b7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067242 Mar 05 20:53:23.463822 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 734/1400] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:23.474929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f1ffa546-4d43-4cae-9730-db8aa10f5cd5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:23.475978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f1ffa546-4d43-4cae-9730-db8aa10f5cd5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:23.484988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1ffa546-4d43-4cae-9730-db8aa10f5cd5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:23.485868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1ffa546-4d43-4cae-9730-db8aa10f5cd5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:23.486862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1ffa546-4d43-4cae-9730-db8aa10f5cd5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:23.487738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1ffa546-4d43-4cae-9730-db8aa10f5cd5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:23.746250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f1ffa546-4d43-4cae-9730-db8aa10f5cd5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:23.763407 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f1ffa546-4d43-4cae-9730-db8aa10f5cd5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c" status: 200 len: 1503 microversion: 2.1 time: 0.295623 Mar 05 20:53:23.765171 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 735/1401] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:23 2022] GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c => generated 1503 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:23.777464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d17ba796-3c87-47ee-977d-5ee8dd4b161f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '.version_select at 0x7fed5c4cc3a0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:23.781632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d17ba796-3c87-47ee-977d-5ee8dd4b161f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:23.782310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d17ba796-3c87-47ee-977d-5ee8dd4b161f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:23.801963 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d17ba796-3c87-47ee-977d-5ee8dd4b161f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/os-migrations" status: 200 len: 1701 microversion: 2.25 time: 0.033527 Mar 05 20:53:23.812073 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 736/1402] 10.222.0.15 () {60 vars in 1183 bytes} [Sat Mar 5 20:53:23 2022] GET /compute/v2.1/os-migrations => generated 1701 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:23.825170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ebe27b20-3f9e-4d0e-bec0-2f3c1bc2cf32 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c4cc820>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:24.051522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4092049a-35d9-4d78-8aa0-0f52641c5610 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:24.059654 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4092049a-35d9-4d78-8aa0-0f52641c5610 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1528 microversion: 2.1 time: 0.742639 Mar 05 20:53:24.060272 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 667/1403] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:23 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1528 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:24.082296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-14405734-d58d-487a-83c8-0fcdc305027d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:24.083134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-14405734-d58d-487a-83c8-0fcdc305027d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:24.301024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-14405734-d58d-487a-83c8-0fcdc305027d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:24.311815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-14405734-d58d-487a-83c8-0fcdc305027d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:24.316741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-14405734-d58d-487a-83c8-0fcdc305027d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:24.319959 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-14405734-d58d-487a-83c8-0fcdc305027d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1285 microversion: 2.32 time: 0.254574 Mar 05 20:53:24.323938 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 668/1404] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:24 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1285 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:24.335195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-95459392-9895-4684-931f-316013e3c136 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:24.336642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-95459392-9895-4684-931f-316013e3c136 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 5f3a1743-f646-4148-a573-fe033e15c940] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:24.353250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95459392-9895-4684-931f-316013e3c136 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:24.357238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95459392-9895-4684-931f-316013e3c136 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:24.360046 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95459392-9895-4684-931f-316013e3c136 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:24.361644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95459392-9895-4684-931f-316013e3c136 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:24.503043 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ebe27b20-3f9e-4d0e-bec0-2f3c1bc2cf32 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 204 len: 0 microversion: 2.1 time: 0.689528 Mar 05 20:53:24.506763 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 737/1405] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:23 2022] DELETE /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:53:24.515225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a7d34a98-43e8-470d-b94b-3bb26f582568 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1622593503"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:24.516344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a7d34a98-43e8-470d-b94b-3bb26f582568 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:24.522646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7d34a98-43e8-470d-b94b-3bb26f582568 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:24.523103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7d34a98-43e8-470d-b94b-3bb26f582568 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:24.524847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7d34a98-43e8-470d-b94b-3bb26f582568 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:24.525297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7d34a98-43e8-470d-b94b-3bb26f582568 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:24.689902 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.network.security_group_api [None req-a7d34a98-43e8-470d-b94b-3bb26f582568 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Adding security group 5dc7330a-c9d0-4b79-8a67-24901a59b404 to port 4843f79d-ea4a-4732-bdaa-157ee20d5051 Mar 05 20:53:24.932102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-95459392-9895-4684-931f-316013e3c136 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:24.941388 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-95459392-9895-4684-931f-316013e3c136 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940" status: 200 len: 1318 microversion: 2.1 time: 0.615916 Mar 05 20:53:24.942633 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 669/1406] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:24 2022] GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940 => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:24.948321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-df2819b2-cf16-4b76-af1c-2c04989eca4c tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:24.949132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-df2819b2-cf16-4b76-af1c-2c04989eca4c tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:24.957253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df2819b2-cf16-4b76-af1c-2c04989eca4c tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:24.957865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df2819b2-cf16-4b76-af1c-2c04989eca4c tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:24.958765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df2819b2-cf16-4b76-af1c-2c04989eca4c tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:24.959519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df2819b2-cf16-4b76-af1c-2c04989eca4c tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:25.303621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-df2819b2-cf16-4b76-af1c-2c04989eca4c tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid 31db5aa9-c804-4757-af1b-3354d442b6d8 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:53:25.318987 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-df2819b2-cf16-4b76-af1c-2c04989eca4c tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 2050 microversion: 2.25 time: 0.373500 Mar 05 20:53:25.320190 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 670/1407] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:24 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 2050 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:25.327883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e84d46e6-847f-45fb-bfdc-6c656dc1a632 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:25.329056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e84d46e6-847f-45fb-bfdc-6c656dc1a632 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:25.336588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e84d46e6-847f-45fb-bfdc-6c656dc1a632 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:25.337660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e84d46e6-847f-45fb-bfdc-6c656dc1a632 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:25.340235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e84d46e6-847f-45fb-bfdc-6c656dc1a632 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:25.341072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e84d46e6-847f-45fb-bfdc-6c656dc1a632 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:25.608508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e84d46e6-847f-45fb-bfdc-6c656dc1a632 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:25.616724 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e84d46e6-847f-45fb-bfdc-6c656dc1a632 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1528 microversion: 2.1 time: 0.295184 Mar 05 20:53:25.620472 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 671/1408] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:25 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1528 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:25.644761 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a7d34a98-43e8-470d-b94b-3bb26f582568 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c/action" status: 202 len: 0 microversion: 2.1 time: 1.135743 Mar 05 20:53:25.645388 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 738/1409] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:53:24 2022] POST /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c/action => generated 0 bytes in 1138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:53:25.654019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3091134c-47e7-49fe-a336-73f27a9abf20 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:25.654474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c0a658df-0fa7-42ec-af22-a2b0c03da8d2 req-3b55118b-11da-4926-b246-951755b96247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78b93bf-150c-4b48-b376-5c2ba3a624b9", "name": "network-vif-unplugged", "status": "completed", "tag": "62f18a02-3cec-4f72-9fe9-641e4f0d18e9"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:25.654619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3091134c-47e7-49fe-a336-73f27a9abf20 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:25.667986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3091134c-47e7-49fe-a336-73f27a9abf20 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:25.668973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3091134c-47e7-49fe-a336-73f27a9abf20 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:25.670145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3091134c-47e7-49fe-a336-73f27a9abf20 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:25.672158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3091134c-47e7-49fe-a336-73f27a9abf20 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:25.683640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c0a658df-0fa7-42ec-af22-a2b0c03da8d2 req-3b55118b-11da-4926-b246-951755b96247 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:25.687137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c0a658df-0fa7-42ec-af22-a2b0c03da8d2 req-3b55118b-11da-4926-b246-951755b96247 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:25.722218 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c0a658df-0fa7-42ec-af22-a2b0c03da8d2 req-3b55118b-11da-4926-b246-951755b96247 service nova] Creating event network-vif-unplugged:62f18a02-3cec-4f72-9fe9-641e4f0d18e9 for instance a78b93bf-150c-4b48-b376-5c2ba3a624b9 on nch2-master-1 Mar 05 20:53:25.733589 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c0a658df-0fa7-42ec-af22-a2b0c03da8d2 req-3b55118b-11da-4926-b246-951755b96247 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084197 Mar 05 20:53:25.734574 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 739/1410] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:25.749329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3091134c-47e7-49fe-a336-73f27a9abf20 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:53:25.758181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-d0a4d30d-5636-4cbd-a6b8-94b6bde13d50 req-d9af0f58-4768-441f-a2f1-866cb0ef2d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3a1743-f646-4148-a573-fe033e15c940", "tag": "a12b1cef-8918-43e9-9644-e6d9f0cccf28"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:25.780217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d0a4d30d-5636-4cbd-a6b8-94b6bde13d50 req-d9af0f58-4768-441f-a2f1-866cb0ef2d5c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:25.780678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d0a4d30d-5636-4cbd-a6b8-94b6bde13d50 req-d9af0f58-4768-441f-a2f1-866cb0ef2d5c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:25.803310 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-d0a4d30d-5636-4cbd-a6b8-94b6bde13d50 req-d9af0f58-4768-441f-a2f1-866cb0ef2d5c service nova] Creating event network-changed:a12b1cef-8918-43e9-9644-e6d9f0cccf28 for instance 5f3a1743-f646-4148-a573-fe033e15c940 on nch2-master-1 Mar 05 20:53:25.817392 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-d0a4d30d-5636-4cbd-a6b8-94b6bde13d50 req-d9af0f58-4768-441f-a2f1-866cb0ef2d5c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072909 Mar 05 20:53:25.818687 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 740/1411] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:25.825344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6d9db11d-abd5-4fc6-83e7-67ed4224c84a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:25.827281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6d9db11d-abd5-4fc6-83e7-67ed4224c84a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:25.846891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d9db11d-abd5-4fc6-83e7-67ed4224c84a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:25.848377 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d9db11d-abd5-4fc6-83e7-67ed4224c84a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:25.849361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d9db11d-abd5-4fc6-83e7-67ed4224c84a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:25.851312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d9db11d-abd5-4fc6-83e7-67ed4224c84a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:25.905616 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3091134c-47e7-49fe-a336-73f27a9abf20 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 204 len: 0 microversion: 2.1 time: 0.269919 Mar 05 20:53:25.907238 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 672/1412] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:53:25 2022] DELETE /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:53:25.913611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-251876326", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "d83df0c3-2a5b-4fbb-9f93-42653588000e"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:26.018330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] validate_networks() for [('d83df0c3-2a5b-4fbb-9f93-42653588000e', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:53:26.125805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6d9db11d-abd5-4fc6-83e7-67ed4224c84a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:26.129510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6d9db11d-abd5-4fc6-83e7-67ed4224c84a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:26.132984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6d9db11d-abd5-4fc6-83e7-67ed4224c84a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:26.134185 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6d9db11d-abd5-4fc6-83e7-67ed4224c84a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1593 microversion: 2.32 time: 0.314192 Mar 05 20:53:26.134757 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 741/1413] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:25 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1593 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:26.141702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9dc9ad0d-3cf1-4001-94db-77592200fa64 req-02423911-f698-4731-b9da-d234b77a2480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730ddde5-fc74-4dfd-b3f8-879a2d86114d", "tag": "160c53f5-6eb4-4d29-ab34-699f46d3c7e4"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:26.169930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9dc9ad0d-3cf1-4001-94db-77592200fa64 req-02423911-f698-4731-b9da-d234b77a2480 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:26.170637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9dc9ad0d-3cf1-4001-94db-77592200fa64 req-02423911-f698-4731-b9da-d234b77a2480 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:26.189972 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9dc9ad0d-3cf1-4001-94db-77592200fa64 req-02423911-f698-4731-b9da-d234b77a2480 service nova] Creating event network-changed:160c53f5-6eb4-4d29-ab34-699f46d3c7e4 for instance 730ddde5-fc74-4dfd-b3f8-879a2d86114d on nch2-master-1 Mar 05 20:53:26.212736 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9dc9ad0d-3cf1-4001-94db-77592200fa64 req-02423911-f698-4731-b9da-d234b77a2480 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072369 Mar 05 20:53:26.228606 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 742/1414] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:26.251522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b5b8a3a7-0251-45c8-9b35-d77084524ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:26.254800 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:53:26.254800 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:53:26.263226 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-b5b8a3a7-0251-45c8-9b35-d77084524ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] HTTP exception thrown: Flavor 3af68e85-ae9d-4b46-b42f-e35de912f6f0 could not be found. Mar 05 20:53:26.264371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b5b8a3a7-0251-45c8-9b35-d77084524ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Returning 404 to user: Flavor 3af68e85-ae9d-4b46-b42f-e35de912f6f0 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:53:26.265672 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b5b8a3a7-0251-45c8-9b35-d77084524ab6 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/3af68e85-ae9d-4b46-b42f-e35de912f6f0" status: 404 len: 109 microversion: 2.1 time: 0.033267 Mar 05 20:53:26.266542 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 743/1415] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:53:26 2022] DELETE /compute/v2.1/flavors/3af68e85-ae9d-4b46-b42f-e35de912f6f0 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:53:26.272207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8b2de452-4e29-41d5-88ef-a7fc4cbf057d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-166776991"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:26.273813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8b2de452-4e29-41d5-88ef-a7fc4cbf057d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:26.283751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b2de452-4e29-41d5-88ef-a7fc4cbf057d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:26.284527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b2de452-4e29-41d5-88ef-a7fc4cbf057d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:26.285743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b2de452-4e29-41d5-88ef-a7fc4cbf057d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:26.286524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b2de452-4e29-41d5-88ef-a7fc4cbf057d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:26.715938 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.network.security_group_api [None req-8b2de452-4e29-41d5-88ef-a7fc4cbf057d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Adding security group ef9a7897-8e28-4656-b460-90e46bcbd2f3 to port 4843f79d-ea4a-4732-bdaa-157ee20d5051 Mar 05 20:53:27.621892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:53:27.622429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:53:27.622895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:53:27.623314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:53:27.623749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:53:27.650080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:27.651487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:27.652974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:27.653878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:27.703055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Getting quotas for project aa37ca4c9ac445f4ab3ab68f30b46d44. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:53:27.709410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Getting quotas for user 33c2e3f240e04849be211c91e18234dd and project aa37ca4c9ac445f4ab3ab68f30b46d44. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:53:27.730244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:53:27.735483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:53:27.817971 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8b2de452-4e29-41d5-88ef-a7fc4cbf057d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c/action" status: 202 len: 0 microversion: 2.1 time: 1.548774 Mar 05 20:53:27.822079 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 744/1416] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:53:26 2022] POST /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c/action => generated 0 bytes in 1555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:53:27.830069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2c5e7ed6-5f11-485a-92ab-d2fb208c67c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:27.830802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2c5e7ed6-5f11-485a-92ab-d2fb208c67c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 5f3a1743-f646-4148-a573-fe033e15c940] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:27.859164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c5e7ed6-5f11-485a-92ab-d2fb208c67c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:27.862518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c5e7ed6-5f11-485a-92ab-d2fb208c67c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:27.863439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c5e7ed6-5f11-485a-92ab-d2fb208c67c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:27.863978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c5e7ed6-5f11-485a-92ab-d2fb208c67c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:27.898812 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-779f08ac-8a89-433e-af35-e11d3caa84e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.989952 Mar 05 20:53:27.900019 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 673/1417] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 20:53:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1992 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 05 20:53:27.914518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1911180747", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "92c1bc99-8218-45a1-b95c-a4c228475460"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:27.996994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] validate_networks() for [('92c1bc99-8218-45a1-b95c-a4c228475460', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:53:28.344524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2c5e7ed6-5f11-485a-92ab-d2fb208c67c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:28.365188 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2c5e7ed6-5f11-485a-92ab-d2fb208c67c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940" status: 200 len: 1318 microversion: 2.1 time: 0.539440 Mar 05 20:53:28.368585 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 745/1418] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:27 2022] GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:28.386009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1555417863", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:28.493935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:53:29.009411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:53:29.011538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:53:29.012293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:53:29.012935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:53:29.013571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:53:29.031464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:29.032576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:29.035043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:29.035880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:29.076336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Getting quotas for project 3501f5d56344468ebc4d50db1a5c5bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:53:29.093307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Getting quotas for user 52cc30e265f94e3caa91b6adff365209 and project 3501f5d56344468ebc4d50db1a5c5bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:53:29.133805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:53:29.137959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:53:29.237822 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-86d6b90b-3577-4083-8ce9-e16d8b26e5d8 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865230 Mar 05 20:53:29.239087 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 746/1419] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:53:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:53:29.250378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5c66fc53-bbf6-455f-b226-f8e505c2f032 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:29.251121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5c66fc53-bbf6-455f-b226-f8e505c2f032 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:29.259099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c66fc53-bbf6-455f-b226-f8e505c2f032 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:29.260813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c66fc53-bbf6-455f-b226-f8e505c2f032 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:29.261839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c66fc53-bbf6-455f-b226-f8e505c2f032 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:29.262581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c66fc53-bbf6-455f-b226-f8e505c2f032 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:29.523740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:53:29.524936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:53:29.526748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:53:29.527860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:53:29.528654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:53:29.553662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:29.555966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:29.561307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:29.562454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:29.674890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Getting quotas for project 1e9d41fd2f8d48d894ddb8ae0aa2799d. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:53:29.685275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Getting quotas for user 8bcf50b3de674240bb695a0d5614ffd9 and project 1e9d41fd2f8d48d894ddb8ae0aa2799d. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:53:29.737148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:53:29.741458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:53:29.897198 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-962f1909-6158-4719-8f0a-48233c08abda tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.992704 Mar 05 20:53:29.900986 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 674/1420] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:53:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:53:29.924272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-9e7428fb-2da5-45ee-828d-675a60fca2be req-0d16357b-56b4-4351-9fb1-d08d3dea48df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4bc94-61de-4cb5-8c5a-4ba4dc781ada", "name": "network-vif-plugged", "status": "completed", "tag": "a62edc1f-925c-416d-82a9-ced25df2b5e2"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:29.957665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9e7428fb-2da5-45ee-828d-675a60fca2be req-0d16357b-56b4-4351-9fb1-d08d3dea48df service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:29.960480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9e7428fb-2da5-45ee-828d-675a60fca2be req-0d16357b-56b4-4351-9fb1-d08d3dea48df service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:30.000998 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-9e7428fb-2da5-45ee-828d-675a60fca2be req-0d16357b-56b4-4351-9fb1-d08d3dea48df service nova] Creating event network-vif-plugged:a62edc1f-925c-416d-82a9-ced25df2b5e2 for instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada on nch1-master-1 Mar 05 20:53:30.016180 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-9e7428fb-2da5-45ee-828d-675a60fca2be req-0d16357b-56b4-4351-9fb1-d08d3dea48df service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112452 Mar 05 20:53:30.021111 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 675/1421] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:30.050676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-090a4217-4d52-4589-9dcc-76761b27047d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:30.053362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-090a4217-4d52-4589-9dcc-76761b27047d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:30.070714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-090a4217-4d52-4589-9dcc-76761b27047d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:30.076017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-090a4217-4d52-4589-9dcc-76761b27047d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:30.076968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-090a4217-4d52-4589-9dcc-76761b27047d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:30.077431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-090a4217-4d52-4589-9dcc-76761b27047d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:30.328541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5c66fc53-bbf6-455f-b226-f8e505c2f032 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:30.349543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5c66fc53-bbf6-455f-b226-f8e505c2f032 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:30.358064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5c66fc53-bbf6-455f-b226-f8e505c2f032 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:30.363060 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5c66fc53-bbf6-455f-b226-f8e505c2f032 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1660 microversion: 2.32 time: 1.121026 Mar 05 20:53:30.364269 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 747/1422] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:29 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1660 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:30.388935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cbf7d1ca-fa81-4ddd-b512-cdb53e83283b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:30.392726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cbf7d1ca-fa81-4ddd-b512-cdb53e83283b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:30.418426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cbf7d1ca-fa81-4ddd-b512-cdb53e83283b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:30.419087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cbf7d1ca-fa81-4ddd-b512-cdb53e83283b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:30.422195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cbf7d1ca-fa81-4ddd-b512-cdb53e83283b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:30.423513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cbf7d1ca-fa81-4ddd-b512-cdb53e83283b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:30.480129 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-090a4217-4d52-4589-9dcc-76761b27047d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.453533 Mar 05 20:53:30.481186 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 676/1423] 10.222.0.15 () {58 vars in 1292 bytes} [Sat Mar 5 20:53:30 2022] GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c/os-security-groups => generated 1157 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:30.494509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-3ca3980d-fb58-46b3-bfe0-8a24481c836a req-4f6c6e1d-8831-4029-a33f-e00f2eb2cb0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e87f17b-0999-4fff-ae66-5f37ccc3628c", "tag": "4843f79d-ea4a-4732-bdaa-157ee20d5051"}, {"name": "network-changed", "server_uuid": "1e87f17b-0999-4fff-ae66-5f37ccc3628c", "tag": "4843f79d-ea4a-4732-bdaa-157ee20d5051"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:30.513395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3ca3980d-fb58-46b3-bfe0-8a24481c836a req-4f6c6e1d-8831-4029-a33f-e00f2eb2cb0d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:30.514371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3ca3980d-fb58-46b3-bfe0-8a24481c836a req-4f6c6e1d-8831-4029-a33f-e00f2eb2cb0d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:30.536181 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-3ca3980d-fb58-46b3-bfe0-8a24481c836a req-4f6c6e1d-8831-4029-a33f-e00f2eb2cb0d service nova] Creating event network-changed:4843f79d-ea4a-4732-bdaa-157ee20d5051 for instance 1e87f17b-0999-4fff-ae66-5f37ccc3628c on nch1-master-1 Mar 05 20:53:30.537485 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-3ca3980d-fb58-46b3-bfe0-8a24481c836a req-4f6c6e1d-8831-4029-a33f-e00f2eb2cb0d service nova] Creating event network-changed:4843f79d-ea4a-4732-bdaa-157ee20d5051 for instance 1e87f17b-0999-4fff-ae66-5f37ccc3628c on nch1-master-1 Mar 05 20:53:30.545140 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-3ca3980d-fb58-46b3-bfe0-8a24481c836a req-4f6c6e1d-8831-4029-a33f-e00f2eb2cb0d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061908 Mar 05 20:53:30.546425 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 677/1424] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:30.553878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-345ad26d-f250-4464-b039-caa729b9c5fa tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:30.560961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-345ad26d-f250-4464-b039-caa729b9c5fa tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:30.579771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-345ad26d-f250-4464-b039-caa729b9c5fa tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:30.580346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-345ad26d-f250-4464-b039-caa729b9c5fa tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:30.581713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-345ad26d-f250-4464-b039-caa729b9c5fa tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:30.584641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-345ad26d-f250-4464-b039-caa729b9c5fa tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:30.716268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-345ad26d-f250-4464-b039-caa729b9c5fa tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:30.728648 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-345ad26d-f250-4464-b039-caa729b9c5fa tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1265 microversion: 2.1 time: 0.178820 Mar 05 20:53:30.731561 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 678/1425] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:30 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:30.738299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6f2b6d3c-e064-4514-886a-d26f72bdb31f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:30.738909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6f2b6d3c-e064-4514-886a-d26f72bdb31f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 5f3a1743-f646-4148-a573-fe033e15c940] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:30.758698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2b6d3c-e064-4514-886a-d26f72bdb31f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:30.760490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2b6d3c-e064-4514-886a-d26f72bdb31f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:30.762631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2b6d3c-e064-4514-886a-d26f72bdb31f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:30.764495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2b6d3c-e064-4514-886a-d26f72bdb31f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:31.070420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cbf7d1ca-fa81-4ddd-b512-cdb53e83283b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:31.090805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cbf7d1ca-fa81-4ddd-b512-cdb53e83283b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:31.092659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cbf7d1ca-fa81-4ddd-b512-cdb53e83283b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:31.105023 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cbf7d1ca-fa81-4ddd-b512-cdb53e83283b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1319 microversion: 2.25 time: 0.738118 Mar 05 20:53:31.107552 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 748/1426] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:30 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1319 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:31.114904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e83bb4cf-6d81-4422-aa91-bd4979cbc007 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:31.116255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e83bb4cf-6d81-4422-aa91-bd4979cbc007 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:31.159158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e83bb4cf-6d81-4422-aa91-bd4979cbc007 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:31.166442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e83bb4cf-6d81-4422-aa91-bd4979cbc007 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:31.172459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e83bb4cf-6d81-4422-aa91-bd4979cbc007 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:31.177658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e83bb4cf-6d81-4422-aa91-bd4979cbc007 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:31.202340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6f2b6d3c-e064-4514-886a-d26f72bdb31f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:31.229511 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6f2b6d3c-e064-4514-886a-d26f72bdb31f tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940" status: 200 len: 1318 microversion: 2.1 time: 0.489457 Mar 05 20:53:31.233867 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 679/1427] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:30 2022] GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:31.259272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-21007f64-34b1-4c95-9bd8-5cc9cf900bcc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'create', calling method: .version_select at 0x7fed5c6c3040>, body: {"security_group": {"name": " tempest-securitygroup -1387880918 ", "description": "tempest-description-2050968895"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:31.476210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e83bb4cf-6d81-4422-aa91-bd4979cbc007 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:31.496324 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e83bb4cf-6d81-4422-aa91-bd4979cbc007 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1260 microversion: 2.1 time: 0.387318 Mar 05 20:53:31.499115 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 749/1428] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:31 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1260 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:31.512035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1337cdbc-1ce8-4bae-8112-62ecc897a780 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:31.514175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1337cdbc-1ce8-4bae-8112-62ecc897a780 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:31.535252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1337cdbc-1ce8-4bae-8112-62ecc897a780 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:31.536623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1337cdbc-1ce8-4bae-8112-62ecc897a780 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:31.539509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1337cdbc-1ce8-4bae-8112-62ecc897a780 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:31.540160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1337cdbc-1ce8-4bae-8112-62ecc897a780 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:31.871619 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-21007f64-34b1-4c95-9bd8-5cc9cf900bcc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.628468 Mar 05 20:53:31.880022 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 680/1429] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:53:31 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:32.130801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1406401937", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "2946acdb-a2ef-4ca1-ac26-ee00745cfd9f"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:32.220537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] validate_networks() for [('2946acdb-a2ef-4ca1-ac26-ee00745cfd9f', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:53:32.330000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1337cdbc-1ce8-4bae-8112-62ecc897a780 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:32.341991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1337cdbc-1ce8-4bae-8112-62ecc897a780 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:32.344234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1337cdbc-1ce8-4bae-8112-62ecc897a780 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:32.345928 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1337cdbc-1ce8-4bae-8112-62ecc897a780 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1706 microversion: 2.32 time: 0.845736 Mar 05 20:53:32.347100 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 750/1430] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:31 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1706 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:32.359524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9383f46e-256c-4314-8f3f-72569bf470fe tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:32.360732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9383f46e-256c-4314-8f3f-72569bf470fe tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:32.374258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9383f46e-256c-4314-8f3f-72569bf470fe tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:32.375114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9383f46e-256c-4314-8f3f-72569bf470fe tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:32.376215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9383f46e-256c-4314-8f3f-72569bf470fe tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:32.377204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9383f46e-256c-4314-8f3f-72569bf470fe tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:32.546558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9383f46e-256c-4314-8f3f-72569bf470fe tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:32.566456 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9383f46e-256c-4314-8f3f-72569bf470fe tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1271 microversion: 2.1 time: 0.217147 Mar 05 20:53:32.567644 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 751/1431] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:32 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:32.575616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-10f3e4fd-8902-45bf-8546-d0e690be2c34 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c77c550>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:32.772408 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-10f3e4fd-8902-45bf-8546-d0e690be2c34 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/os-security-groups/3604fb65-d255-47cb-a6fb-19bee0381487" status: 200 len: 224 microversion: 2.1 time: 0.203232 Mar 05 20:53:32.773335 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 752/1432] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 20:53:32 2022] GET /compute/v2.1/os-security-groups/3604fb65-d255-47cb-a6fb-19bee0381487 => generated 224 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:32.788119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-43f714da-3502-4b6b-b64c-a3164d53884c tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:32.789000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-43f714da-3502-4b6b-b64c-a3164d53884c tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:32.796239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43f714da-3502-4b6b-b64c-a3164d53884c tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:32.796904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43f714da-3502-4b6b-b64c-a3164d53884c tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:32.797723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43f714da-3502-4b6b-b64c-a3164d53884c tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:32.798334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43f714da-3502-4b6b-b64c-a3164d53884c tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:33.515381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:53:33.517886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:53:33.518812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:53:33.522307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:53:33.523021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:53:33.539603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:33.542658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:33.544195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:33.545076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:33.590114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Getting quotas for project f177f4eebae0479d86a35a7531da201f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:53:33.598174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Getting quotas for user ced50a298a4242d8a1856fe9b2cc454e and project f177f4eebae0479d86a35a7531da201f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:53:33.622394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:53:33.637456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:53:33.708275 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6059e591-fc32-45fe-9e8c-379754d6e83d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.826115 Mar 05 20:53:33.709828 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 681/1433] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:53:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:53:33.719741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-25e94b86-6a06-4bb4-89eb-1d4069b8c825 req-4c4602e5-7e9d-45aa-a24c-1ab2e386aed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730ddde5-fc74-4dfd-b3f8-879a2d86114d", "name": "network-vif-plugged", "status": "completed", "tag": "160c53f5-6eb4-4d29-ab34-699f46d3c7e4"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:33.737455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-25e94b86-6a06-4bb4-89eb-1d4069b8c825 req-4c4602e5-7e9d-45aa-a24c-1ab2e386aed1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:33.737688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-43f714da-3502-4b6b-b64c-a3164d53884c tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:33.738990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-25e94b86-6a06-4bb4-89eb-1d4069b8c825 req-4c4602e5-7e9d-45aa-a24c-1ab2e386aed1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:33.757198 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-25e94b86-6a06-4bb4-89eb-1d4069b8c825 req-4c4602e5-7e9d-45aa-a24c-1ab2e386aed1 service nova] Creating event network-vif-plugged:160c53f5-6eb4-4d29-ab34-699f46d3c7e4 for instance 730ddde5-fc74-4dfd-b3f8-879a2d86114d on nch2-master-1 Mar 05 20:53:33.764027 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-43f714da-3502-4b6b-b64c-a3164d53884c tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:33.764742 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-25e94b86-6a06-4bb4-89eb-1d4069b8c825 req-4c4602e5-7e9d-45aa-a24c-1ab2e386aed1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051154 Mar 05 20:53:33.766272 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 682/1434] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:33.772313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-43f714da-3502-4b6b-b64c-a3164d53884c tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:33.779441 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-43f714da-3502-4b6b-b64c-a3164d53884c tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1361 microversion: 2.25 time: 1.004765 Mar 05 20:53:33.790190 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 753/1435] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:32 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1361 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:33.790703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a604d848-9b9c-4b97-b160-4c1410f7f558 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:33.790703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a604d848-9b9c-4b97-b160-4c1410f7f558 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 5f3a1743-f646-4148-a573-fe033e15c940] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:33.794422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ddc66a95-9765-4b75-9630-bb0463365bf7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:33.797619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ddc66a95-9765-4b75-9630-bb0463365bf7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:33.805085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a604d848-9b9c-4b97-b160-4c1410f7f558 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:33.806010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a604d848-9b9c-4b97-b160-4c1410f7f558 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:33.807702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a604d848-9b9c-4b97-b160-4c1410f7f558 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:33.808694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a604d848-9b9c-4b97-b160-4c1410f7f558 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:33.853594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ddc66a95-9765-4b75-9630-bb0463365bf7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:33.856873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ddc66a95-9765-4b75-9630-bb0463365bf7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:33.864202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ddc66a95-9765-4b75-9630-bb0463365bf7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:33.865106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ddc66a95-9765-4b75-9630-bb0463365bf7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:34.312893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a604d848-9b9c-4b97-b160-4c1410f7f558 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:34.324921 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a604d848-9b9c-4b97-b160-4c1410f7f558 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940" status: 200 len: 1318 microversion: 2.1 time: 0.553079 Mar 05 20:53:34.325836 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 683/1436] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:33 2022] GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940 => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:34.350115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-3b1b6308-1ed5-41e7-9e25-58a10e918e7e req-e70bbcbc-16c7-401f-ac82-72ebc023334c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78b93bf-150c-4b48-b376-5c2ba3a624b9", "name": "network-vif-deleted", "tag": "62f18a02-3cec-4f72-9fe9-641e4f0d18e9"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:34.364838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3b1b6308-1ed5-41e7-9e25-58a10e918e7e req-e70bbcbc-16c7-401f-ac82-72ebc023334c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:34.365339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3b1b6308-1ed5-41e7-9e25-58a10e918e7e req-e70bbcbc-16c7-401f-ac82-72ebc023334c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:34.384038 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-3b1b6308-1ed5-41e7-9e25-58a10e918e7e req-e70bbcbc-16c7-401f-ac82-72ebc023334c service nova] Creating event network-vif-deleted:62f18a02-3cec-4f72-9fe9-641e4f0d18e9 for instance a78b93bf-150c-4b48-b376-5c2ba3a624b9 on nch2-master-1 Mar 05 20:53:34.391735 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-3b1b6308-1ed5-41e7-9e25-58a10e918e7e req-e70bbcbc-16c7-401f-ac82-72ebc023334c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056160 Mar 05 20:53:34.393396 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 684/1437] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:34.398692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4a869869-b402-4f6a-8ec5-0b1f6e2cfbc5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c5de8b0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:34.774000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ddc66a95-9765-4b75-9630-bb0463365bf7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:34.797841 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ddc66a95-9765-4b75-9630-bb0463365bf7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1308 microversion: 2.1 time: 1.010332 Mar 05 20:53:34.801783 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 754/1438] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:33 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1308 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:34.832646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9dc39d4e-e8d7-42be-89bd-e6d5f97be396 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:34.834263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9dc39d4e-e8d7-42be-89bd-e6d5f97be396 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:34.863454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9dc39d4e-e8d7-42be-89bd-e6d5f97be396 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:34.865053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9dc39d4e-e8d7-42be-89bd-e6d5f97be396 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:34.866197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9dc39d4e-e8d7-42be-89bd-e6d5f97be396 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:34.872770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9dc39d4e-e8d7-42be-89bd-e6d5f97be396 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:35.343384 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4a869869-b402-4f6a-8ec5-0b1f6e2cfbc5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/3604fb65-d255-47cb-a6fb-19bee0381487" status: 202 len: 0 microversion: 2.1 time: 0.948407 Mar 05 20:53:35.345452 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 685/1439] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:53:34 2022] DELETE /compute/v2.1/os-security-groups/3604fb65-d255-47cb-a6fb-19bee0381487 => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:53:35.351554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a47b5a9c-dad9-47de-8020-9c355d61e98d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:35.352621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a47b5a9c-dad9-47de-8020-9c355d61e98d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:35.365926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a47b5a9c-dad9-47de-8020-9c355d61e98d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:35.366779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a47b5a9c-dad9-47de-8020-9c355d61e98d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:35.368342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a47b5a9c-dad9-47de-8020-9c355d61e98d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:35.369162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a47b5a9c-dad9-47de-8020-9c355d61e98d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:35.759376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9dc39d4e-e8d7-42be-89bd-e6d5f97be396 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:35.779663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9dc39d4e-e8d7-42be-89bd-e6d5f97be396 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:35.782382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9dc39d4e-e8d7-42be-89bd-e6d5f97be396 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:35.783765 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9dc39d4e-e8d7-42be-89bd-e6d5f97be396 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1740 microversion: 2.32 time: 0.980735 Mar 05 20:53:35.784421 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 755/1440] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:34 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1740 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:35.789888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-643d8049-8dd8-4848-8f81-96e4e5acd796 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:35.790657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-643d8049-8dd8-4848-8f81-96e4e5acd796 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:35.798441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-643d8049-8dd8-4848-8f81-96e4e5acd796 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:35.799154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-643d8049-8dd8-4848-8f81-96e4e5acd796 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:35.800520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-643d8049-8dd8-4848-8f81-96e4e5acd796 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:35.801261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-643d8049-8dd8-4848-8f81-96e4e5acd796 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:35.937210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-643d8049-8dd8-4848-8f81-96e4e5acd796 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:35.948019 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-643d8049-8dd8-4848-8f81-96e4e5acd796 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1283 microversion: 2.1 time: 0.162068 Mar 05 20:53:35.949536 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 756/1441] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:35 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1283 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:35.956247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-86bf4ce7-6ea4-4fdb-be9a-6e920edefd00 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:35.957235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-86bf4ce7-6ea4-4fdb-be9a-6e920edefd00 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:35.970477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86bf4ce7-6ea4-4fdb-be9a-6e920edefd00 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:35.971258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86bf4ce7-6ea4-4fdb-be9a-6e920edefd00 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:35.972745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86bf4ce7-6ea4-4fdb-be9a-6e920edefd00 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:35.974509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86bf4ce7-6ea4-4fdb-be9a-6e920edefd00 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:36.102069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a47b5a9c-dad9-47de-8020-9c355d61e98d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:36.111751 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a47b5a9c-dad9-47de-8020-9c355d61e98d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1313 microversion: 2.1 time: 0.764683 Mar 05 20:53:36.112599 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 686/1442] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:35 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1313 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:36.118196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7191c789-17db-47b1-95e8-83b83d91b423 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:36.119052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7191c789-17db-47b1-95e8-83b83d91b423 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 5f3a1743-f646-4148-a573-fe033e15c940] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:36.128840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7191c789-17db-47b1-95e8-83b83d91b423 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:36.129513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7191c789-17db-47b1-95e8-83b83d91b423 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:36.130328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7191c789-17db-47b1-95e8-83b83d91b423 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:36.131195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7191c789-17db-47b1-95e8-83b83d91b423 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:36.497918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-86bf4ce7-6ea4-4fdb-be9a-6e920edefd00 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:36.515121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-86bf4ce7-6ea4-4fdb-be9a-6e920edefd00 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:36.520669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-86bf4ce7-6ea4-4fdb-be9a-6e920edefd00 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:36.522716 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-86bf4ce7-6ea4-4fdb-be9a-6e920edefd00 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1361 microversion: 2.25 time: 0.571876 Mar 05 20:53:36.535863 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 757/1443] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:35 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1361 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:36.543119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2717a5b8-6d01-444a-8f42-9235ac12fbfa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c6b0820>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:36.578396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG neutronclient.v2_0.client [None req-2717a5b8-6d01-444a-8f42-9235ac12fbfa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3604fb65-d255-47cb-a6fb-19bee0381487 does not exist", "detail": ""}} {{(pid=141479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:53:36.579033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.security_group_api [None req-2717a5b8-6d01-444a-8f42-9235ac12fbfa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Neutron security group 3604fb65-d255-47cb-a6fb-19bee0381487 not found {{(pid=141479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:53:36.580126 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-2717a5b8-6d01-444a-8f42-9235ac12fbfa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Security group 3604fb65-d255-47cb-a6fb-19bee0381487 does not exist Mar 05 20:53:36.580126 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-477ec748-84b0-429b-9cbd-ff1214b74f4f'] Mar 05 20:53:36.581020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2717a5b8-6d01-444a-8f42-9235ac12fbfa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Security group 3604fb65-d255-47cb-a6fb-19bee0381487 does not exist Mar 05 20:53:36.581020 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-477ec748-84b0-429b-9cbd-ff1214b74f4f'] {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:53:36.582287 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2717a5b8-6d01-444a-8f42-9235ac12fbfa tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/os-security-groups/3604fb65-d255-47cb-a6fb-19bee0381487" status: 404 len: 194 microversion: 2.1 time: 0.045100 Mar 05 20:53:36.583154 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 758/1444] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 20:53:36 2022] GET /compute/v2.1/os-security-groups/3604fb65-d255-47cb-a6fb-19bee0381487 => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:53:36.593493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-5d6a3d8d-db82-4169-8994-866fd35a81f0 req-3473e59c-815a-447c-94f9-4b20f3b85ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3a1743-f646-4148-a573-fe033e15c940", "name": "network-vif-plugged", "status": "completed", "tag": "a12b1cef-8918-43e9-9644-e6d9f0cccf28"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:36.604417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5d6a3d8d-db82-4169-8994-866fd35a81f0 req-3473e59c-815a-447c-94f9-4b20f3b85ebd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:36.604909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5d6a3d8d-db82-4169-8994-866fd35a81f0 req-3473e59c-815a-447c-94f9-4b20f3b85ebd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:36.618276 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-5d6a3d8d-db82-4169-8994-866fd35a81f0 req-3473e59c-815a-447c-94f9-4b20f3b85ebd service nova] Creating event network-vif-plugged:a12b1cef-8918-43e9-9644-e6d9f0cccf28 for instance 5f3a1743-f646-4148-a573-fe033e15c940 on nch2-master-1 Mar 05 20:53:36.624461 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-5d6a3d8d-db82-4169-8994-866fd35a81f0 req-3473e59c-815a-447c-94f9-4b20f3b85ebd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038920 Mar 05 20:53:36.625357 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 759/1445] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:36.632265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-23a5205d-2e02-4ccf-b977-899deda47373 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:36.633185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-23a5205d-2e02-4ccf-b977-899deda47373 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:36.660413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-23a5205d-2e02-4ccf-b977-899deda47373 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:36.660983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-23a5205d-2e02-4ccf-b977-899deda47373 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:36.661980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-23a5205d-2e02-4ccf-b977-899deda47373 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:36.662537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-23a5205d-2e02-4ccf-b977-899deda47373 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:36.812467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7191c789-17db-47b1-95e8-83b83d91b423 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:36.823784 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7191c789-17db-47b1-95e8-83b83d91b423 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940" status: 200 len: 1318 microversion: 2.1 time: 0.709788 Mar 05 20:53:36.834430 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 687/1446] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:36 2022] GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940 => generated 1318 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:36.840623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6b17c0bc-e90b-4e04-8dc8-5dd332bee605 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:36.844304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6b17c0bc-e90b-4e04-8dc8-5dd332bee605 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:36.845805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6b17c0bc-e90b-4e04-8dc8-5dd332bee605 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Searching by: {'deleted': False, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:53:36.851866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b17c0bc-e90b-4e04-8dc8-5dd332bee605 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:36.852546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b17c0bc-e90b-4e04-8dc8-5dd332bee605 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:36.853506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b17c0bc-e90b-4e04-8dc8-5dd332bee605 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:36.855108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b17c0bc-e90b-4e04-8dc8-5dd332bee605 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:36.918197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-6b17c0bc-e90b-4e04-8dc8-5dd332bee605 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:53:36.966140 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6b17c0bc-e90b-4e04-8dc8-5dd332bee605 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.130006 Mar 05 20:53:36.967311 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 688/1447] 10.222.0.15 () {58 vars in 1124 bytes} [Sat Mar 5 20:53:36 2022] GET /compute/v2.1/servers => generated 343 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:36.972177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-468ddc8a-ba3b-4eb2-bb67-b73f213c194e req-623d3493-68f2-4c74-b67b-5758291050b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "facc63d8-2f5b-4b1f-858c-65e0ba787498", "tag": "727e5026-bc21-477c-93fd-d0897928ef02"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:36.982547 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-468ddc8a-ba3b-4eb2-bb67-b73f213c194e req-623d3493-68f2-4c74-b67b-5758291050b3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:36.983410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-468ddc8a-ba3b-4eb2-bb67-b73f213c194e req-623d3493-68f2-4c74-b67b-5758291050b3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:36.997265 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-468ddc8a-ba3b-4eb2-bb67-b73f213c194e req-623d3493-68f2-4c74-b67b-5758291050b3 service nova] Creating event network-changed:727e5026-bc21-477c-93fd-d0897928ef02 for instance facc63d8-2f5b-4b1f-858c-65e0ba787498 on nch1-master-1 Mar 05 20:53:37.004902 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-468ddc8a-ba3b-4eb2-bb67-b73f213c194e req-623d3493-68f2-4c74-b67b-5758291050b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036227 Mar 05 20:53:37.006222 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 689/1448] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:37.013104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d62678b2-2ed8-48e3-bb9a-4a1eede70a8c req-2a3da2c9-fea0-447d-8c9e-b9d1681569a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd", "tag": "675294b3-97d2-451e-9c82-33eef5c81bf5"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:37.026140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d62678b2-2ed8-48e3-bb9a-4a1eede70a8c req-2a3da2c9-fea0-447d-8c9e-b9d1681569a4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:37.027558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d62678b2-2ed8-48e3-bb9a-4a1eede70a8c req-2a3da2c9-fea0-447d-8c9e-b9d1681569a4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:37.048123 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d62678b2-2ed8-48e3-bb9a-4a1eede70a8c req-2a3da2c9-fea0-447d-8c9e-b9d1681569a4 service nova] Creating event network-changed:675294b3-97d2-451e-9c82-33eef5c81bf5 for instance fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd on nch2-master-1 Mar 05 20:53:37.054246 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d62678b2-2ed8-48e3-bb9a-4a1eede70a8c req-2a3da2c9-fea0-447d-8c9e-b9d1681569a4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046125 Mar 05 20:53:37.055424 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 690/1449] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:37.071351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b0b0e6ee-27c4-48d7-b0b2-be128381c352 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'create', calling method: .version_select at 0x7fed5c605550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1096862429", "description": "tempest-description-785847130"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:37.121012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-23a5205d-2e02-4ccf-b977-899deda47373 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:37.131110 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-23a5205d-2e02-4ccf-b977-899deda47373 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1308 microversion: 2.1 time: 0.504362 Mar 05 20:53:37.131726 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 760/1450] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:36 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1308 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:37.144100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2660966f-5486-4735-ad97-487304bfc466 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:37.144871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2660966f-5486-4735-ad97-487304bfc466 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:37.151778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2660966f-5486-4735-ad97-487304bfc466 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:37.152485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2660966f-5486-4735-ad97-487304bfc466 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:37.153706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2660966f-5486-4735-ad97-487304bfc466 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:37.154147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2660966f-5486-4735-ad97-487304bfc466 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:37.409301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2660966f-5486-4735-ad97-487304bfc466 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:37.419394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2660966f-5486-4735-ad97-487304bfc466 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:37.421261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2660966f-5486-4735-ad97-487304bfc466 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:37.422705 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2660966f-5486-4735-ad97-487304bfc466 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1786 microversion: 2.32 time: 0.284122 Mar 05 20:53:37.423274 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 761/1451] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:37 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1786 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:37.440212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cc2545de-3685-4b29-a689-056ced7bcdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:37.440857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cc2545de-3685-4b29-a689-056ced7bcdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:37.448501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc2545de-3685-4b29-a689-056ced7bcdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:37.448927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc2545de-3685-4b29-a689-056ced7bcdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:37.449731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc2545de-3685-4b29-a689-056ced7bcdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:37.450166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc2545de-3685-4b29-a689-056ced7bcdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:37.522257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cc2545de-3685-4b29-a689-056ced7bcdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:37.531338 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cc2545de-3685-4b29-a689-056ced7bcdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1283 microversion: 2.1 time: 0.106784 Mar 05 20:53:37.531977 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 762/1452] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:37 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1283 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:37.536604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-782a9f31-389e-4d1b-877b-71ff7c64ecb7 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:37.540261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-782a9f31-389e-4d1b-877b-71ff7c64ecb7 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:37.541192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-782a9f31-389e-4d1b-877b-71ff7c64ecb7 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Searching by: {'deleted': False, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:53:37.547099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-782a9f31-389e-4d1b-877b-71ff7c64ecb7 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:37.547557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-782a9f31-389e-4d1b-877b-71ff7c64ecb7 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:37.548417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-782a9f31-389e-4d1b-877b-71ff7c64ecb7 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:37.549068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-782a9f31-389e-4d1b-877b-71ff7c64ecb7 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:37.577824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-782a9f31-389e-4d1b-877b-71ff7c64ecb7 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:53:37.646751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-782a9f31-389e-4d1b-877b-71ff7c64ecb7 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:37.653603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-782a9f31-389e-4d1b-877b-71ff7c64ecb7 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:37.654066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-782a9f31-389e-4d1b-877b-71ff7c64ecb7 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:37.773587 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-782a9f31-389e-4d1b-877b-71ff7c64ecb7 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.240371 Mar 05 20:53:37.787397 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 763/1453] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:53:37 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:37.787397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-56aaae45-699a-4c2d-9261-2c9b7496901d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:37.787397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-56aaae45-699a-4c2d-9261-2c9b7496901d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:37.788551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56aaae45-699a-4c2d-9261-2c9b7496901d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:37.789067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56aaae45-699a-4c2d-9261-2c9b7496901d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:37.789893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56aaae45-699a-4c2d-9261-2c9b7496901d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:37.790416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56aaae45-699a-4c2d-9261-2c9b7496901d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:37.941257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-56aaae45-699a-4c2d-9261-2c9b7496901d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:37.949189 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-56aaae45-699a-4c2d-9261-2c9b7496901d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1313 microversion: 2.1 time: 0.173445 Mar 05 20:53:37.949774 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 764/1454] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:37 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:37.955063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-05a09ef6-30d2-44ef-801b-ac63b2171c70 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:37.955908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-05a09ef6-30d2-44ef-801b-ac63b2171c70 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:37.964876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05a09ef6-30d2-44ef-801b-ac63b2171c70 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:37.965326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05a09ef6-30d2-44ef-801b-ac63b2171c70 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:37.966215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05a09ef6-30d2-44ef-801b-ac63b2171c70 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:37.966820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05a09ef6-30d2-44ef-801b-ac63b2171c70 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:38.110483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-05a09ef6-30d2-44ef-801b-ac63b2171c70 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:38.121786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-05a09ef6-30d2-44ef-801b-ac63b2171c70 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:38.123523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-05a09ef6-30d2-44ef-801b-ac63b2171c70 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:38.124697 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-05a09ef6-30d2-44ef-801b-ac63b2171c70 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1361 microversion: 2.25 time: 0.174009 Mar 05 20:53:38.126353 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 765/1455] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:37 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:38.130932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-da87c67a-ea11-4040-aa55-ee2e6470e38f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:38.139683 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-da87c67a-ea11-4040-aa55-ee2e6470e38f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012263 Mar 05 20:53:38.140287 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 766/1456] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:53:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:38.154632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d490204d-71ac-4ee6-a196-0c48f5a0c6c0 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:38.155526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d490204d-71ac-4ee6-a196-0c48f5a0c6c0 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 5f3a1743-f646-4148-a573-fe033e15c940] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:38.163496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d490204d-71ac-4ee6-a196-0c48f5a0c6c0 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:38.164291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d490204d-71ac-4ee6-a196-0c48f5a0c6c0 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:38.165090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d490204d-71ac-4ee6-a196-0c48f5a0c6c0 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:38.165573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d490204d-71ac-4ee6-a196-0c48f5a0c6c0 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:38.202672 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b0b0e6ee-27c4-48d7-b0b2-be128381c352 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.145734 Mar 05 20:53:38.203970 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 691/1457] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:53:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:38.209242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-be6a4630-ef2c-42cf-b28e-7586284bbaec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:38.210121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-be6a4630-ef2c-42cf-b28e-7586284bbaec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:38.217776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be6a4630-ef2c-42cf-b28e-7586284bbaec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:38.218506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be6a4630-ef2c-42cf-b28e-7586284bbaec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:38.219306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be6a4630-ef2c-42cf-b28e-7586284bbaec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:38.219771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be6a4630-ef2c-42cf-b28e-7586284bbaec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:38.364666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d490204d-71ac-4ee6-a196-0c48f5a0c6c0 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:38.373225 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d490204d-71ac-4ee6-a196-0c48f5a0c6c0 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940" status: 200 len: 1318 microversion: 2.1 time: 0.231953 Mar 05 20:53:38.373815 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 767/1458] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:38 2022] GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:38.378537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aecc6c16-34ac-42ca-b20e-5c0e3402430f tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'create', calling method: .version_select at 0x7fed5c5f7940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-452613156", "description": "tempest-description-1844770872"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:38.518378 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aecc6c16-34ac-42ca-b20e-5c0e3402430f tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.142954 Mar 05 20:53:38.524893 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 768/1459] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:53:38 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:38.526334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c416407a-dbf1-48ae-ac84-d2e64ad9134c tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:38.527107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c416407a-dbf1-48ae-ac84-d2e64ad9134c tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:38.534300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c416407a-dbf1-48ae-ac84-d2e64ad9134c tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:38.534837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c416407a-dbf1-48ae-ac84-d2e64ad9134c tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:38.535716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c416407a-dbf1-48ae-ac84-d2e64ad9134c tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:38.536404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c416407a-dbf1-48ae-ac84-d2e64ad9134c tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:38.697328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c416407a-dbf1-48ae-ac84-d2e64ad9134c tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:38.707043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c416407a-dbf1-48ae-ac84-d2e64ad9134c tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:38.708677 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c416407a-dbf1-48ae-ac84-d2e64ad9134c tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:38.709880 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c416407a-dbf1-48ae-ac84-d2e64ad9134c tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1786 microversion: 2.32 time: 0.188842 Mar 05 20:53:38.710425 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 769/1460] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:38 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1786 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:38.714953 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3411a9f8-91bf-4526-9e03-6426de9f1093 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'create', calling method: .version_select at 0x7fed5c42c310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-849284141", "description": "tempest-description-1318420848"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:38.860718 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3411a9f8-91bf-4526-9e03-6426de9f1093 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.149187 Mar 05 20:53:38.872980 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 770/1461] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:53:38 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:38.873520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-be6a4630-ef2c-42cf-b28e-7586284bbaec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:38.877692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dc8ba619-447c-490c-bc5d-b3199d46c9d4 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:38.878567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dc8ba619-447c-490c-bc5d-b3199d46c9d4 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:38.893946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc8ba619-447c-490c-bc5d-b3199d46c9d4 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:38.894399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc8ba619-447c-490c-bc5d-b3199d46c9d4 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:38.895234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc8ba619-447c-490c-bc5d-b3199d46c9d4 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:38.895738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc8ba619-447c-490c-bc5d-b3199d46c9d4 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:38.897441 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-be6a4630-ef2c-42cf-b28e-7586284bbaec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1308 microversion: 2.1 time: 0.692206 Mar 05 20:53:38.909152 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 692/1462] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:38 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1308 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:38.923763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:38.924671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:38.942050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:38.942788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:38.943784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:38.944392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:39.000407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:53:39.100884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dc8ba619-447c-490c-bc5d-b3199d46c9d4 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:39.111017 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dc8ba619-447c-490c-bc5d-b3199d46c9d4 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1325 microversion: 2.1 time: 0.242963 Mar 05 20:53:39.112053 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 771/1463] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:38 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1325 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:39.120460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e468db02-6078-4bde-884e-82b68fb8571f tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c64a280>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:39.152402 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b4a8b057-8a16-4b40-bee3-b38c95ad0247 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 204 len: 0 microversion: 2.1 time: 0.241276 Mar 05 20:53:39.154340 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 693/1464] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:53:38 2022] DELETE /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:53:39.162683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dc2915ea-ca4c-42d3-9293-ea18ab9b7cb7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:39.164525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dc2915ea-ca4c-42d3-9293-ea18ab9b7cb7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:39.171911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc2915ea-ca4c-42d3-9293-ea18ab9b7cb7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:39.172468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc2915ea-ca4c-42d3-9293-ea18ab9b7cb7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:39.173267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc2915ea-ca4c-42d3-9293-ea18ab9b7cb7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:39.173887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc2915ea-ca4c-42d3-9293-ea18ab9b7cb7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:39.363073 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e468db02-6078-4bde-884e-82b68fb8571f tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.249853 Mar 05 20:53:39.363781 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 772/1465] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 20:53:39 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:39.369158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b25b78db-e8a1-4e53-affa-ef7f782cdbb7 req-71cddcbe-e02f-4607-a9af-13a039401e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e83e1e1-a9df-4257-a596-e67ee39ac474", "tag": "16cf4bd3-62b6-4ec8-863b-656e8ed0397b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:39.377858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b25b78db-e8a1-4e53-affa-ef7f782cdbb7 req-71cddcbe-e02f-4607-a9af-13a039401e65 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:39.378389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b25b78db-e8a1-4e53-affa-ef7f782cdbb7 req-71cddcbe-e02f-4607-a9af-13a039401e65 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:39.389587 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b25b78db-e8a1-4e53-affa-ef7f782cdbb7 req-71cddcbe-e02f-4607-a9af-13a039401e65 service nova] Creating event network-changed:16cf4bd3-62b6-4ec8-863b-656e8ed0397b for instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 on nch1-master-1 Mar 05 20:53:39.394556 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b25b78db-e8a1-4e53-affa-ef7f782cdbb7 req-71cddcbe-e02f-4607-a9af-13a039401e65 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029206 Mar 05 20:53:39.395254 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 773/1466] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:39.401198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ecc9bcb9-1ebe-4831-a49e-90a1cac245b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:39.402190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ecc9bcb9-1ebe-4831-a49e-90a1cac245b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:39.409333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ecc9bcb9-1ebe-4831-a49e-90a1cac245b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:39.409796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ecc9bcb9-1ebe-4831-a49e-90a1cac245b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:39.410743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ecc9bcb9-1ebe-4831-a49e-90a1cac245b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:39.411190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ecc9bcb9-1ebe-4831-a49e-90a1cac245b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:39.632179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ecc9bcb9-1ebe-4831-a49e-90a1cac245b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:39.642245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ecc9bcb9-1ebe-4831-a49e-90a1cac245b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:39.644083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ecc9bcb9-1ebe-4831-a49e-90a1cac245b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:39.645220 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ecc9bcb9-1ebe-4831-a49e-90a1cac245b0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1361 microversion: 2.25 time: 0.248785 Mar 05 20:53:39.646597 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 774/1467] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:39 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1361 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:39.651372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b9d3b92a-7765-48d4-b2bb-2eea9fc17e48 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:39.651865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b9d3b92a-7765-48d4-b2bb-2eea9fc17e48 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:39.658332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9d3b92a-7765-48d4-b2bb-2eea9fc17e48 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:39.658842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9d3b92a-7765-48d4-b2bb-2eea9fc17e48 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:39.659593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9d3b92a-7765-48d4-b2bb-2eea9fc17e48 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:39.660139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9d3b92a-7765-48d4-b2bb-2eea9fc17e48 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:39.742658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dc2915ea-ca4c-42d3-9293-ea18ab9b7cb7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:39.751690 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dc2915ea-ca4c-42d3-9293-ea18ab9b7cb7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1313 microversion: 2.1 time: 0.596176 Mar 05 20:53:39.752395 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 694/1468] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:39 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:39.767252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bfebeed7-f071-45cc-872b-2ce1a6bc2cda tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c78c9d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:39.882641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b9d3b92a-7765-48d4-b2bb-2eea9fc17e48 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:39.891018 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b9d3b92a-7765-48d4-b2bb-2eea9fc17e48 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1606 microversion: 2.1 time: 0.243829 Mar 05 20:53:39.900996 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 775/1469] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:39 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1606 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:39.908016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0d1cfc24-0d37-4652-80de-dcd8ac833bb2 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:39.909960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0d1cfc24-0d37-4652-80de-dcd8ac833bb2 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 5f3a1743-f646-4148-a573-fe033e15c940] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:39.918118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1cfc24-0d37-4652-80de-dcd8ac833bb2 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:39.918760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1cfc24-0d37-4652-80de-dcd8ac833bb2 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:39.920716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1cfc24-0d37-4652-80de-dcd8ac833bb2 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:39.921355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1cfc24-0d37-4652-80de-dcd8ac833bb2 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:40.466489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0d1cfc24-0d37-4652-80de-dcd8ac833bb2 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:40.474476 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0d1cfc24-0d37-4652-80de-dcd8ac833bb2 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940" status: 200 len: 1507 microversion: 2.1 time: 0.571563 Mar 05 20:53:40.475116 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 776/1470] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:39 2022] GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940 => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:40.480653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fa99a7d4-74ed-4df3-ab88-eee1f828a863 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:40.481273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fa99a7d4-74ed-4df3-ab88-eee1f828a863 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:40.489418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa99a7d4-74ed-4df3-ab88-eee1f828a863 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:40.489881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa99a7d4-74ed-4df3-ab88-eee1f828a863 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:40.490683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa99a7d4-74ed-4df3-ab88-eee1f828a863 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:40.491123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa99a7d4-74ed-4df3-ab88-eee1f828a863 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:40.718486 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bfebeed7-f071-45cc-872b-2ce1a6bc2cda tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/0659106f-d0f9-4a0b-a9e2-00bec915f465" status: 202 len: 0 microversion: 2.1 time: 0.955569 Mar 05 20:53:40.718947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fa99a7d4-74ed-4df3-ab88-eee1f828a863 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:40.719305 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 695/1471] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:53:39 2022] DELETE /compute/v2.1/os-security-groups/0659106f-d0f9-4a0b-a9e2-00bec915f465 => generated 0 bytes in 957 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:53:40.724388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c5edede4-748f-4567-b953-66645ef1a66d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:40.725236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c5edede4-748f-4567-b953-66645ef1a66d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:40.737564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fa99a7d4-74ed-4df3-ab88-eee1f828a863 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:40.741217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fa99a7d4-74ed-4df3-ab88-eee1f828a863 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:40.743306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5edede4-748f-4567-b953-66645ef1a66d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:40.743854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5edede4-748f-4567-b953-66645ef1a66d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:40.744386 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fa99a7d4-74ed-4df3-ab88-eee1f828a863 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1832 microversion: 2.32 time: 0.267181 Mar 05 20:53:40.744631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5edede4-748f-4567-b953-66645ef1a66d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:40.745090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5edede4-748f-4567-b953-66645ef1a66d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:40.746354 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 777/1472] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:40 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1832 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:40.754088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f3eedffa-686d-4c8a-bccb-1beebd0e83ef tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:40.755170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f3eedffa-686d-4c8a-bccb-1beebd0e83ef tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:40.763434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3eedffa-686d-4c8a-bccb-1beebd0e83ef tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:40.764183 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3eedffa-686d-4c8a-bccb-1beebd0e83ef tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:40.776219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3eedffa-686d-4c8a-bccb-1beebd0e83ef tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:40.777443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3eedffa-686d-4c8a-bccb-1beebd0e83ef tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:40.968109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f3eedffa-686d-4c8a-bccb-1beebd0e83ef tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:40.976192 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f3eedffa-686d-4c8a-bccb-1beebd0e83ef tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1325 microversion: 2.1 time: 0.227665 Mar 05 20:53:40.977172 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 778/1473] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:40 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1325 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:40.982598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2aaa2a8e-7f14-4e5f-8c92-fc8b3fe9da9a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:40.984205 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2aaa2a8e-7f14-4e5f-8c92-fc8b3fe9da9a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 730ddde5-fc74-4dfd-b3f8-879a2d86114d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:40.990575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2aaa2a8e-7f14-4e5f-8c92-fc8b3fe9da9a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:40.991305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2aaa2a8e-7f14-4e5f-8c92-fc8b3fe9da9a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:40.992411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2aaa2a8e-7f14-4e5f-8c92-fc8b3fe9da9a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:40.993232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2aaa2a8e-7f14-4e5f-8c92-fc8b3fe9da9a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:41.194931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c5edede4-748f-4567-b953-66645ef1a66d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:41.208142 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c5edede4-748f-4567-b953-66645ef1a66d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1308 microversion: 2.1 time: 0.487069 Mar 05 20:53:41.209611 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 696/1474] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:40 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1308 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:41.219446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a27dbe0f-04a8-4397-b26c-2e3a6a9bd7ec tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:41.220002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a27dbe0f-04a8-4397-b26c-2e3a6a9bd7ec tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:41.235796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a27dbe0f-04a8-4397-b26c-2e3a6a9bd7ec tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:41.236710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a27dbe0f-04a8-4397-b26c-2e3a6a9bd7ec tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:41.238212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a27dbe0f-04a8-4397-b26c-2e3a6a9bd7ec tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:41.239102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a27dbe0f-04a8-4397-b26c-2e3a6a9bd7ec tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:41.267996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2aaa2a8e-7f14-4e5f-8c92-fc8b3fe9da9a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:41.277567 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2aaa2a8e-7f14-4e5f-8c92-fc8b3fe9da9a tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/730ddde5-fc74-4dfd-b3f8-879a2d86114d" status: 200 len: 1506 microversion: 2.1 time: 0.298748 Mar 05 20:53:41.279126 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 779/1475] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:40 2022] GET /compute/v2.1/servers/730ddde5-fc74-4dfd-b3f8-879a2d86114d => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:41.285666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7cba20bb-7681-4450-b7da-57618e4b16ee tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c607670>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:41.396197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG neutronclient.v2_0.client [None req-7cba20bb-7681-4450-b7da-57618e4b16ee tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0659106f-d0f9-4a0b-a9e2-00bec915f465 does not exist", "detail": ""}} {{(pid=141479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:53:41.400360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.security_group_api [None req-7cba20bb-7681-4450-b7da-57618e4b16ee tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Neutron security group 0659106f-d0f9-4a0b-a9e2-00bec915f465 not found {{(pid=141479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:53:41.401999 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-7cba20bb-7681-4450-b7da-57618e4b16ee tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Security group 0659106f-d0f9-4a0b-a9e2-00bec915f465 does not exist Mar 05 20:53:41.401999 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-b03146e4-eb2f-4ecb-beba-e2b028b339d5'] Mar 05 20:53:41.403459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7cba20bb-7681-4450-b7da-57618e4b16ee tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Security group 0659106f-d0f9-4a0b-a9e2-00bec915f465 does not exist Mar 05 20:53:41.403459 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-b03146e4-eb2f-4ecb-beba-e2b028b339d5'] {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:53:41.404697 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7cba20bb-7681-4450-b7da-57618e4b16ee tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/os-security-groups/0659106f-d0f9-4a0b-a9e2-00bec915f465" status: 404 len: 194 microversion: 2.1 time: 0.124395 Mar 05 20:53:41.405539 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 780/1476] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 20:53:41 2022] GET /compute/v2.1/os-security-groups/0659106f-d0f9-4a0b-a9e2-00bec915f465 => generated 194 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:53:41.410405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-19f6d9be-7799-4b93-be76-484e8fe37388 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:41.411337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-19f6d9be-7799-4b93-be76-484e8fe37388 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:41.426409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19f6d9be-7799-4b93-be76-484e8fe37388 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:41.427020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19f6d9be-7799-4b93-be76-484e8fe37388 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:41.428192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19f6d9be-7799-4b93-be76-484e8fe37388 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:41.432353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19f6d9be-7799-4b93-be76-484e8fe37388 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:41.646341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a27dbe0f-04a8-4397-b26c-2e3a6a9bd7ec tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:41.665609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a27dbe0f-04a8-4397-b26c-2e3a6a9bd7ec tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:41.667753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a27dbe0f-04a8-4397-b26c-2e3a6a9bd7ec tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:41.669987 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a27dbe0f-04a8-4397-b26c-2e3a6a9bd7ec tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1361 microversion: 2.25 time: 0.457537 Mar 05 20:53:41.670456 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 697/1477] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:41 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1361 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:41.677010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cf033dc6-aaf9-4e14-a570-c3a6b61b546f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:41.677790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cf033dc6-aaf9-4e14-a570-c3a6b61b546f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:41.690700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf033dc6-aaf9-4e14-a570-c3a6b61b546f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:41.692737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf033dc6-aaf9-4e14-a570-c3a6b61b546f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:41.693574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf033dc6-aaf9-4e14-a570-c3a6b61b546f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:41.695004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf033dc6-aaf9-4e14-a570-c3a6b61b546f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:41.729305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-19f6d9be-7799-4b93-be76-484e8fe37388 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:41.739737 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-19f6d9be-7799-4b93-be76-484e8fe37388 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1313 microversion: 2.1 time: 0.332942 Mar 05 20:53:41.740578 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 781/1478] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:41 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:41.754415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-250e82de-867a-4000-9113-57f3b94749b1 req-12f8be7d-0e64-4811-9147-da4b60166fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566b4bf7-27e3-48e9-aa39-9d0f512a146f", "tag": "849d5225-97e8-496b-a8f3-1b7a3df6f4d7"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:41.764841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-250e82de-867a-4000-9113-57f3b94749b1 req-12f8be7d-0e64-4811-9147-da4b60166fdb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:41.765780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-250e82de-867a-4000-9113-57f3b94749b1 req-12f8be7d-0e64-4811-9147-da4b60166fdb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:41.783784 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-250e82de-867a-4000-9113-57f3b94749b1 req-12f8be7d-0e64-4811-9147-da4b60166fdb service nova] Creating event network-changed:849d5225-97e8-496b-a8f3-1b7a3df6f4d7 for instance 566b4bf7-27e3-48e9-aa39-9d0f512a146f on nch2-master-1 Mar 05 20:53:41.788718 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-250e82de-867a-4000-9113-57f3b94749b1 req-12f8be7d-0e64-4811-9147-da4b60166fdb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038131 Mar 05 20:53:41.790092 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 782/1479] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:41.795164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7cdd3e0c-a470-4045-a75d-e0f42092ac5e tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:41.795924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7cdd3e0c-a470-4045-a75d-e0f42092ac5e tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 730ddde5-fc74-4dfd-b3f8-879a2d86114d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:41.802566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7cdd3e0c-a470-4045-a75d-e0f42092ac5e tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:41.803108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7cdd3e0c-a470-4045-a75d-e0f42092ac5e tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:41.803935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7cdd3e0c-a470-4045-a75d-e0f42092ac5e tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:41.804399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7cdd3e0c-a470-4045-a75d-e0f42092ac5e tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:41.833262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7cdd3e0c-a470-4045-a75d-e0f42092ac5e tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 730ddde5-fc74-4dfd-b3f8-879a2d86114d] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:53:41.959053 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7cdd3e0c-a470-4045-a75d-e0f42092ac5e tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/730ddde5-fc74-4dfd-b3f8-879a2d86114d" status: 204 len: 0 microversion: 2.1 time: 0.167929 Mar 05 20:53:41.960173 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 783/1480] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:53:41 2022] DELETE /compute/v2.1/servers/730ddde5-fc74-4dfd-b3f8-879a2d86114d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:53:41.968021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cc9887f6-5a04-4c51-9fda-fcb7895a6923 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c611ee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:42.123067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cf033dc6-aaf9-4e14-a570-c3a6b61b546f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33c3ba3d26c4664a622711cad0381a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff75cc228d249d1b12cd184ad1c4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:42.133946 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cf033dc6-aaf9-4e14-a570-c3a6b61b546f tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 200 len: 1606 microversion: 2.1 time: 0.461544 Mar 05 20:53:42.141399 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 698/1481] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:41 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 1606 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:42.148059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7e147f09-5ad7-4a9d-9604-7cb8e7b51223 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:42.149352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7e147f09-5ad7-4a9d-9604-7cb8e7b51223 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:42.162618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e147f09-5ad7-4a9d-9604-7cb8e7b51223 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:42.163496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e147f09-5ad7-4a9d-9604-7cb8e7b51223 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:42.164428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e147f09-5ad7-4a9d-9604-7cb8e7b51223 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:42.165067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e147f09-5ad7-4a9d-9604-7cb8e7b51223 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:42.496417 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cc9887f6-5a04-4c51-9fda-fcb7895a6923 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/f25b682a-b85a-4260-83ce-f021216c56f5" status: 202 len: 0 microversion: 2.1 time: 0.534378 Mar 05 20:53:42.497386 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 784/1482] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:53:41 2022] DELETE /compute/v2.1/os-security-groups/f25b682a-b85a-4260-83ce-f021216c56f5 => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:53:42.503934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e8f9ffe2-b143-4000-8e0d-c86a81553f6c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:42.505074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e8f9ffe2-b143-4000-8e0d-c86a81553f6c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 5f3a1743-f646-4148-a573-fe033e15c940] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:42.526452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8f9ffe2-b143-4000-8e0d-c86a81553f6c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:42.527809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8f9ffe2-b143-4000-8e0d-c86a81553f6c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:42.530580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8f9ffe2-b143-4000-8e0d-c86a81553f6c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:42.532642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8f9ffe2-b143-4000-8e0d-c86a81553f6c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:42.570126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e8f9ffe2-b143-4000-8e0d-c86a81553f6c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 5f3a1743-f646-4148-a573-fe033e15c940] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:53:42.737032 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e8f9ffe2-b143-4000-8e0d-c86a81553f6c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940" status: 204 len: 0 microversion: 2.1 time: 0.237892 Mar 05 20:53:42.741041 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 785/1483] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:53:42 2022] DELETE /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:53:42.754301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f8a3e43f-2fc4-4f43-acaf-9df0279df3cb tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:42.755204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f8a3e43f-2fc4-4f43-acaf-9df0279df3cb tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:42.763246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8a3e43f-2fc4-4f43-acaf-9df0279df3cb tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:42.763856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8a3e43f-2fc4-4f43-acaf-9df0279df3cb tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:42.764822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8a3e43f-2fc4-4f43-acaf-9df0279df3cb tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:42.765363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8a3e43f-2fc4-4f43-acaf-9df0279df3cb tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:43.020798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f8a3e43f-2fc4-4f43-acaf-9df0279df3cb tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:43.035235 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f8a3e43f-2fc4-4f43-acaf-9df0279df3cb tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1325 microversion: 2.1 time: 0.291103 Mar 05 20:53:43.036453 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 786/1484] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:42 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1325 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:43.045828 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0f9e30e6-90ff-4319-993e-2056824cc2ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:43.046848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0f9e30e6-90ff-4319-993e-2056824cc2ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:43.054882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f9e30e6-90ff-4319-993e-2056824cc2ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:43.055850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f9e30e6-90ff-4319-993e-2056824cc2ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:43.057041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f9e30e6-90ff-4319-993e-2056824cc2ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:43.057852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f9e30e6-90ff-4319-993e-2056824cc2ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:43.120881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7e147f09-5ad7-4a9d-9604-7cb8e7b51223 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:43.135055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7e147f09-5ad7-4a9d-9604-7cb8e7b51223 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:43.141942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7e147f09-5ad7-4a9d-9604-7cb8e7b51223 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:43.146757 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7e147f09-5ad7-4a9d-9604-7cb8e7b51223 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1853 microversion: 2.32 time: 1.003651 Mar 05 20:53:43.162188 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 699/1485] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:42 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1853 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:43.194476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-6e1094e8-c17b-4ab6-9472-2b6c5a0af005 req-03c8aab4-6648-4894-b814-a2dce99df498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7325377-2828-4f76-82f5-84a025e75574", "name": "network-vif-deleted", "tag": "987d4803-9ee7-4faf-842e-7a86e2732a1a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:43.219929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6e1094e8-c17b-4ab6-9472-2b6c5a0af005 req-03c8aab4-6648-4894-b814-a2dce99df498 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:43.223464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6e1094e8-c17b-4ab6-9472-2b6c5a0af005 req-03c8aab4-6648-4894-b814-a2dce99df498 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:43.257001 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-6e1094e8-c17b-4ab6-9472-2b6c5a0af005 req-03c8aab4-6648-4894-b814-a2dce99df498 service nova] Creating event network-vif-deleted:987d4803-9ee7-4faf-842e-7a86e2732a1a for instance e7325377-2828-4f76-82f5-84a025e75574 on nch1-master-1 Mar 05 20:53:43.270154 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-6e1094e8-c17b-4ab6-9472-2b6c5a0af005 req-03c8aab4-6648-4894-b814-a2dce99df498 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100982 Mar 05 20:53:43.272848 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 700/1486] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:43.286802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7a000564-2264-4d3f-b06e-a93cb497287a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c5dcc10>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:43.409388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-7a000564-2264-4d3f-b06e-a93cb497287a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f25b682a-b85a-4260-83ce-f021216c56f5 does not exist", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:53:43.410100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.security_group_api [None req-7a000564-2264-4d3f-b06e-a93cb497287a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Neutron security group f25b682a-b85a-4260-83ce-f021216c56f5 not found {{(pid=141478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:53:43.410634 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-7a000564-2264-4d3f-b06e-a93cb497287a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Security group f25b682a-b85a-4260-83ce-f021216c56f5 does not exist Mar 05 20:53:43.410634 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-175ed14b-3ec7-45c9-a79b-51b93d514287'] Mar 05 20:53:43.411876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7a000564-2264-4d3f-b06e-a93cb497287a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Security group f25b682a-b85a-4260-83ce-f021216c56f5 does not exist Mar 05 20:53:43.411876 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-175ed14b-3ec7-45c9-a79b-51b93d514287'] {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:53:43.412736 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7a000564-2264-4d3f-b06e-a93cb497287a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/os-security-groups/f25b682a-b85a-4260-83ce-f021216c56f5" status: 404 len: 194 microversion: 2.1 time: 0.138674 Mar 05 20:53:43.413308 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 701/1487] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 20:53:43 2022] GET /compute/v2.1/os-security-groups/f25b682a-b85a-4260-83ce-f021216c56f5 => generated 194 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:53:43.425199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a6c92486-e03e-419c-beb6-7b77fe900b0c req-b4f1e941-b8bb-4865-a5e6-eb56aa44a2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e83e1e1-a9df-4257-a596-e67ee39ac474", "name": "network-vif-plugged", "status": "completed", "tag": "16cf4bd3-62b6-4ec8-863b-656e8ed0397b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:43.450977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0f9e30e6-90ff-4319-993e-2056824cc2ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:43.459777 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0f9e30e6-90ff-4319-993e-2056824cc2ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1308 microversion: 2.1 time: 0.421580 Mar 05 20:53:43.460395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a6c92486-e03e-419c-beb6-7b77fe900b0c req-b4f1e941-b8bb-4865-a5e6-eb56aa44a2eb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:43.461898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a6c92486-e03e-419c-beb6-7b77fe900b0c req-b4f1e941-b8bb-4865-a5e6-eb56aa44a2eb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:43.466156 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 787/1488] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:43 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:43.482751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-60a3261b-0fab-4c5e-81f2-354e2048ef6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:43.483981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-60a3261b-0fab-4c5e-81f2-354e2048ef6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:43.491576 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a6c92486-e03e-419c-beb6-7b77fe900b0c req-b4f1e941-b8bb-4865-a5e6-eb56aa44a2eb service nova] Creating event network-vif-plugged:16cf4bd3-62b6-4ec8-863b-656e8ed0397b for instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 on nch1-master-1 Mar 05 20:53:43.502040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-60a3261b-0fab-4c5e-81f2-354e2048ef6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:43.503107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-60a3261b-0fab-4c5e-81f2-354e2048ef6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:43.504595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-60a3261b-0fab-4c5e-81f2-354e2048ef6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:43.505337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-60a3261b-0fab-4c5e-81f2-354e2048ef6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:43.530198 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a6c92486-e03e-419c-beb6-7b77fe900b0c req-b4f1e941-b8bb-4865-a5e6-eb56aa44a2eb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107971 Mar 05 20:53:43.531334 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 702/1489] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:43.583662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dd35c017-c8fe-44aa-a108-3da78ed45011 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:43.584448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dd35c017-c8fe-44aa-a108-3da78ed45011 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 730ddde5-fc74-4dfd-b3f8-879a2d86114d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:43.594356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd35c017-c8fe-44aa-a108-3da78ed45011 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:43.594964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd35c017-c8fe-44aa-a108-3da78ed45011 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:43.595781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd35c017-c8fe-44aa-a108-3da78ed45011 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:43.596586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd35c017-c8fe-44aa-a108-3da78ed45011 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:43.797425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-60a3261b-0fab-4c5e-81f2-354e2048ef6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:43.807803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-60a3261b-0fab-4c5e-81f2-354e2048ef6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:43.808794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-60a3261b-0fab-4c5e-81f2-354e2048ef6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:43.814339 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-60a3261b-0fab-4c5e-81f2-354e2048ef6d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1361 microversion: 2.25 time: 0.343676 Mar 05 20:53:43.817267 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 788/1490] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:43 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1361 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:43.825993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a94eb782-daab-472c-a6ae-bb3241f5f94e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:43.826769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a94eb782-daab-472c-a6ae-bb3241f5f94e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:43.835630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a94eb782-daab-472c-a6ae-bb3241f5f94e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:43.836125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a94eb782-daab-472c-a6ae-bb3241f5f94e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:43.837531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a94eb782-daab-472c-a6ae-bb3241f5f94e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:43.838539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a94eb782-daab-472c-a6ae-bb3241f5f94e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:43.989941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a94eb782-daab-472c-a6ae-bb3241f5f94e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:43.999223 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a94eb782-daab-472c-a6ae-bb3241f5f94e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1313 microversion: 2.1 time: 0.179811 Mar 05 20:53:44.007876 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 789/1491] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:43 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:44.013108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cf493e19-30c2-40be-bd92-6182c35dfd41 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:44.013940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cf493e19-30c2-40be-bd92-6182c35dfd41 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] [instance: e7325377-2828-4f76-82f5-84a025e75574] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:44.021221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf493e19-30c2-40be-bd92-6182c35dfd41 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:44.021583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf493e19-30c2-40be-bd92-6182c35dfd41 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:44.022388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf493e19-30c2-40be-bd92-6182c35dfd41 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:44.022834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf493e19-30c2-40be-bd92-6182c35dfd41 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:44.036717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dd35c017-c8fe-44aa-a108-3da78ed45011 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:44.043731 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-cf493e19-30c2-40be-bd92-6182c35dfd41 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] HTTP exception thrown: Instance e7325377-2828-4f76-82f5-84a025e75574 could not be found. Mar 05 20:53:44.044911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cf493e19-30c2-40be-bd92-6182c35dfd41 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Returning 404 to user: Instance e7325377-2828-4f76-82f5-84a025e75574 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:53:44.045764 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cf493e19-30c2-40be-bd92-6182c35dfd41 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574" status: 404 len: 111 microversion: 2.1 time: 0.044461 Mar 05 20:53:44.047515 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dd35c017-c8fe-44aa-a108-3da78ed45011 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/730ddde5-fc74-4dfd-b3f8-879a2d86114d" status: 200 len: 1512 microversion: 2.1 time: 0.513344 Mar 05 20:53:44.051459 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 790/1492] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:44 2022] GET /compute/v2.1/servers/e7325377-2828-4f76-82f5-84a025e75574 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:53:44.052935 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 703/1493] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:43 2022] GET /compute/v2.1/servers/730ddde5-fc74-4dfd-b3f8-879a2d86114d => generated 1512 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:44.054898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0880e4e-95b9-4fbe-924b-446e1a3f390f tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c35bb80>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:44.060378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-844f03f5-0245-4137-acff-0adb7bd53b90 req-99f7d329-bf6f-451d-bcdc-036127243f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "tag": "5866fc79-fac2-4bd2-978f-c689c32b9c03"}, {"name": "network-changed", "server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "tag": "ef356e17-c442-448a-8679-da5ba1910c00"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:44.069587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-844f03f5-0245-4137-acff-0adb7bd53b90 req-99f7d329-bf6f-451d-bcdc-036127243f5c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:44.070257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-844f03f5-0245-4137-acff-0adb7bd53b90 req-99f7d329-bf6f-451d-bcdc-036127243f5c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:44.086640 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-844f03f5-0245-4137-acff-0adb7bd53b90 req-99f7d329-bf6f-451d-bcdc-036127243f5c service nova] Creating event network-changed:5866fc79-fac2-4bd2-978f-c689c32b9c03 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:53:44.087575 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-844f03f5-0245-4137-acff-0adb7bd53b90 req-99f7d329-bf6f-451d-bcdc-036127243f5c service nova] Creating event network-changed:ef356e17-c442-448a-8679-da5ba1910c00 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:53:44.095321 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-844f03f5-0245-4137-acff-0adb7bd53b90 req-99f7d329-bf6f-451d-bcdc-036127243f5c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040814 Mar 05 20:53:44.096956 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 704/1494] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:44.106905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5e08c9ae-f4be-42d4-8c61-05d0d277e815 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:44.108407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5e08c9ae-f4be-42d4-8c61-05d0d277e815 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:44.116589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e08c9ae-f4be-42d4-8c61-05d0d277e815 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:44.117674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e08c9ae-f4be-42d4-8c61-05d0d277e815 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:44.118738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e08c9ae-f4be-42d4-8c61-05d0d277e815 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:44.119453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e08c9ae-f4be-42d4-8c61-05d0d277e815 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:44.450343 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0880e4e-95b9-4fbe-924b-446e1a3f390f tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/c824e870-7a76-4d8e-a945-34bebbe65d56" status: 202 len: 0 microversion: 2.1 time: 0.399835 Mar 05 20:53:44.450925 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 791/1495] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:53:44 2022] DELETE /compute/v2.1/os-security-groups/c824e870-7a76-4d8e-a945-34bebbe65d56 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:53:44.457667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-81803856-1725-4139-9969-83c6454241c2 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] Calling method '.version_select at 0x7fed5c724af0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:44.484632 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-81803856-1725-4139-9969-83c6454241c2 tempest-ServersTestBootFromVolume-72971512 tempest-ServersTestBootFromVolume-72971512-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-589748295" status: 202 len: 0 microversion: 2.1 time: 0.032614 Mar 05 20:53:44.486194 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 792/1496] 10.222.0.15 () {58 vars in 1217 bytes} [Sat Mar 5 20:53:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-589748295 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:53:44.492249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-744f9e1b-27b6-4aa3-9483-270f409651f8 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:44.493278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-744f9e1b-27b6-4aa3-9483-270f409651f8 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:44.505472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-744f9e1b-27b6-4aa3-9483-270f409651f8 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:44.506318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-744f9e1b-27b6-4aa3-9483-270f409651f8 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:44.507502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-744f9e1b-27b6-4aa3-9483-270f409651f8 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:44.508242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-744f9e1b-27b6-4aa3-9483-270f409651f8 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:44.870944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5e08c9ae-f4be-42d4-8c61-05d0d277e815 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:44.880599 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5e08c9ae-f4be-42d4-8c61-05d0d277e815 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1325 microversion: 2.1 time: 0.781648 Mar 05 20:53:44.881205 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 705/1497] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:44 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1325 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:44.889094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-02c6d5ea-7abd-4f7d-b1e3-609b102458e5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c5e7790>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:45.005462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-02c6d5ea-7abd-4f7d-b1e3-609b102458e5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c824e870-7a76-4d8e-a945-34bebbe65d56 does not exist", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:53:45.006939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.security_group_api [None req-02c6d5ea-7abd-4f7d-b1e3-609b102458e5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Neutron security group c824e870-7a76-4d8e-a945-34bebbe65d56 not found {{(pid=141478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:53:45.013973 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-02c6d5ea-7abd-4f7d-b1e3-609b102458e5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Security group c824e870-7a76-4d8e-a945-34bebbe65d56 does not exist Mar 05 20:53:45.013973 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-6f518752-29d7-4d0d-b242-e848386358be'] Mar 05 20:53:45.019705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-02c6d5ea-7abd-4f7d-b1e3-609b102458e5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Security group c824e870-7a76-4d8e-a945-34bebbe65d56 does not exist Mar 05 20:53:45.019705 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-6f518752-29d7-4d0d-b242-e848386358be'] {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:53:45.026365 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-02c6d5ea-7abd-4f7d-b1e3-609b102458e5 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/os-security-groups/c824e870-7a76-4d8e-a945-34bebbe65d56" status: 404 len: 194 microversion: 2.1 time: 0.137519 Mar 05 20:53:45.037116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-744f9e1b-27b6-4aa3-9483-270f409651f8 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:45.050011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-744f9e1b-27b6-4aa3-9483-270f409651f8 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:45.054903 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 706/1498] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 20:53:44 2022] GET /compute/v2.1/os-security-groups/c824e870-7a76-4d8e-a945-34bebbe65d56 => generated 194 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:53:45.065041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-744f9e1b-27b6-4aa3-9483-270f409651f8 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:45.066318 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-744f9e1b-27b6-4aa3-9483-270f409651f8 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.578922 Mar 05 20:53:45.066932 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 793/1499] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:44 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:45.071159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a1419769-4198-415e-a3f6-da28dea3f70b tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:45.071989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a1419769-4198-415e-a3f6-da28dea3f70b tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:45.082356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-faf9cafa-626c-42e1-ba38-114244be5079 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:45.083432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-faf9cafa-626c-42e1-ba38-114244be5079 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:45.094992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1419769-4198-415e-a3f6-da28dea3f70b tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:45.095588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1419769-4198-415e-a3f6-da28dea3f70b tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:45.096270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1419769-4198-415e-a3f6-da28dea3f70b tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:45.096709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1419769-4198-415e-a3f6-da28dea3f70b tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:45.097151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-faf9cafa-626c-42e1-ba38-114244be5079 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:45.097847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-faf9cafa-626c-42e1-ba38-114244be5079 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:45.098873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-faf9cafa-626c-42e1-ba38-114244be5079 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:45.100340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-faf9cafa-626c-42e1-ba38-114244be5079 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:45.428961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-faf9cafa-626c-42e1-ba38-114244be5079 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:45.443011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-faf9cafa-626c-42e1-ba38-114244be5079 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:45.445598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-faf9cafa-626c-42e1-ba38-114244be5079 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:45.451162 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-faf9cafa-626c-42e1-ba38-114244be5079 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1361 microversion: 2.25 time: 0.382868 Mar 05 20:53:45.451877 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 794/1500] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:45 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1361 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:45.458805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cfc8cd24-53ac-4408-9c03-f3229b8cd59f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:45.462369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cfc8cd24-53ac-4408-9c03-f3229b8cd59f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:45.472861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfc8cd24-53ac-4408-9c03-f3229b8cd59f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:45.475507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfc8cd24-53ac-4408-9c03-f3229b8cd59f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:45.476469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfc8cd24-53ac-4408-9c03-f3229b8cd59f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:45.477163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfc8cd24-53ac-4408-9c03-f3229b8cd59f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:45.727628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cfc8cd24-53ac-4408-9c03-f3229b8cd59f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:45.745239 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cfc8cd24-53ac-4408-9c03-f3229b8cd59f tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1463 microversion: 2.1 time: 0.290907 Mar 05 20:53:45.749835 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 795/1501] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:45 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1463 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:45.756082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-68eb0620-5f3f-45f3-89d2-2033d9670f43 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c77c430>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:45.759294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a1419769-4198-415e-a3f6-da28dea3f70b tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:45.768971 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a1419769-4198-415e-a3f6-da28dea3f70b tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1308 microversion: 2.1 time: 0.709998 Mar 05 20:53:45.770747 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 707/1502] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:45 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1308 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:45.782426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7a00dc93-9ac5-4c4c-8d9e-bf1fb94253f8 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:45.783309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7a00dc93-9ac5-4c4c-8d9e-bf1fb94253f8 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 730ddde5-fc74-4dfd-b3f8-879a2d86114d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:45.790840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a00dc93-9ac5-4c4c-8d9e-bf1fb94253f8 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:45.793011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a00dc93-9ac5-4c4c-8d9e-bf1fb94253f8 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:45.794198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a00dc93-9ac5-4c4c-8d9e-bf1fb94253f8 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:45.794814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a00dc93-9ac5-4c4c-8d9e-bf1fb94253f8 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:45.812848 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-7a00dc93-9ac5-4c4c-8d9e-bf1fb94253f8 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] HTTP exception thrown: Instance 730ddde5-fc74-4dfd-b3f8-879a2d86114d could not be found. Mar 05 20:53:45.813712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7a00dc93-9ac5-4c4c-8d9e-bf1fb94253f8 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Returning 404 to user: Instance 730ddde5-fc74-4dfd-b3f8-879a2d86114d could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:53:45.814858 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7a00dc93-9ac5-4c4c-8d9e-bf1fb94253f8 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/730ddde5-fc74-4dfd-b3f8-879a2d86114d" status: 404 len: 111 microversion: 2.1 time: 0.042244 Mar 05 20:53:45.815927 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 708/1503] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:45 2022] GET /compute/v2.1/servers/730ddde5-fc74-4dfd-b3f8-879a2d86114d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:53:45.820972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a790b2d8-fecb-4201-a227-350c4c406d7c req-a4ee60cc-d9ce-41f1-8ad9-65a200780c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd", "name": "network-vif-plugged", "status": "completed", "tag": "675294b3-97d2-451e-9c82-33eef5c81bf5"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:45.830076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a790b2d8-fecb-4201-a227-350c4c406d7c req-a4ee60cc-d9ce-41f1-8ad9-65a200780c4e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:45.830829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a790b2d8-fecb-4201-a227-350c4c406d7c req-a4ee60cc-d9ce-41f1-8ad9-65a200780c4e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:45.844937 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a790b2d8-fecb-4201-a227-350c4c406d7c req-a4ee60cc-d9ce-41f1-8ad9-65a200780c4e service nova] Creating event network-vif-plugged:675294b3-97d2-451e-9c82-33eef5c81bf5 for instance fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd on nch2-master-1 Mar 05 20:53:45.850643 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a790b2d8-fecb-4201-a227-350c4c406d7c req-a4ee60cc-d9ce-41f1-8ad9-65a200780c4e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033353 Mar 05 20:53:45.851904 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 709/1504] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:45.859420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6402d9e-f17f-481e-8f75-8ee6c9e08227 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:45.860417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c6402d9e-f17f-481e-8f75-8ee6c9e08227 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:45.867457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6402d9e-f17f-481e-8f75-8ee6c9e08227 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:45.868311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6402d9e-f17f-481e-8f75-8ee6c9e08227 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:45.869393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6402d9e-f17f-481e-8f75-8ee6c9e08227 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:45.870353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6402d9e-f17f-481e-8f75-8ee6c9e08227 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:45.976158 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-68eb0620-5f3f-45f3-89d2-2033d9670f43 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.224700 Mar 05 20:53:45.976755 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 796/1505] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 20:53:45 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:45.981773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-371033b2-1a74-45bd-ac13-7618218133c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:45.982389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-371033b2-1a74-45bd-ac13-7618218133c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 5f3a1743-f646-4148-a573-fe033e15c940] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:45.989346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-371033b2-1a74-45bd-ac13-7618218133c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:45.989797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-371033b2-1a74-45bd-ac13-7618218133c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:45.990756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-371033b2-1a74-45bd-ac13-7618218133c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:45.991197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-371033b2-1a74-45bd-ac13-7618218133c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:46.140160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-371033b2-1a74-45bd-ac13-7618218133c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da16ae41d4f547cebc7ccb11e87dfc8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2800feb70d3947938e03fbcaa7ee8d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:46.148838 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-371033b2-1a74-45bd-ac13-7618218133c9 tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940" status: 200 len: 1513 microversion: 2.1 time: 0.170742 Mar 05 20:53:46.149824 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 797/1506] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:45 2022] GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:46.155890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0af5b03a-3f15-4876-a82e-34d1540f5cd5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:46.156504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0af5b03a-3f15-4876-a82e-34d1540f5cd5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:46.163211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0af5b03a-3f15-4876-a82e-34d1540f5cd5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:46.163920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0af5b03a-3f15-4876-a82e-34d1540f5cd5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:46.164707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0af5b03a-3f15-4876-a82e-34d1540f5cd5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:46.165360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0af5b03a-3f15-4876-a82e-34d1540f5cd5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:46.320709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0af5b03a-3f15-4876-a82e-34d1540f5cd5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:46.329413 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0af5b03a-3f15-4876-a82e-34d1540f5cd5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1325 microversion: 2.1 time: 0.177674 Mar 05 20:53:46.330158 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 798/1507] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:46 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1325 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:46.334937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bb63a72b-4de3-43fe-b142-75ccf9dc6f7a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'create', calling method: .version_select at 0x7fed5c50a0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-100849016", "description": "tempest-description-1336751239"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:46.481212 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c6402d9e-f17f-481e-8f75-8ee6c9e08227 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1614 microversion: 2.1 time: 0.627044 Mar 05 20:53:46.482557 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 710/1508] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:45 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1614 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:46.488400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a3065487-683e-46c7-8010-9fa1d8a9626e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:46.489292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a3065487-683e-46c7-8010-9fa1d8a9626e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:46.504562 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bb63a72b-4de3-43fe-b142-75ccf9dc6f7a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.173060 Mar 05 20:53:46.505941 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 799/1509] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:53:46 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:46.513749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-51468887-a980-4edb-a472-fbbe16e2458f req-fe776ce0-a826-4184-973a-da65a9d91d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730ddde5-fc74-4dfd-b3f8-879a2d86114d", "name": "network-vif-deleted", "tag": "160c53f5-6eb4-4d29-ab34-699f46d3c7e4"}, {"name": "network-changed", "server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "tag": "8e97203d-117b-4a26-8c1e-33c77fbdf3ce"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:46.516319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3065487-683e-46c7-8010-9fa1d8a9626e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:46.521234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3065487-683e-46c7-8010-9fa1d8a9626e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:46.522873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3065487-683e-46c7-8010-9fa1d8a9626e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:46.523396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3065487-683e-46c7-8010-9fa1d8a9626e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:46.535021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-51468887-a980-4edb-a472-fbbe16e2458f req-fe776ce0-a826-4184-973a-da65a9d91d03 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:46.535630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-51468887-a980-4edb-a472-fbbe16e2458f req-fe776ce0-a826-4184-973a-da65a9d91d03 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:46.550783 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-51468887-a980-4edb-a472-fbbe16e2458f req-fe776ce0-a826-4184-973a-da65a9d91d03 service nova] Creating event network-vif-deleted:160c53f5-6eb4-4d29-ab34-699f46d3c7e4 for instance 730ddde5-fc74-4dfd-b3f8-879a2d86114d on nch2-master-1 Mar 05 20:53:46.551656 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-51468887-a980-4edb-a472-fbbe16e2458f req-fe776ce0-a826-4184-973a-da65a9d91d03 service nova] Creating event network-changed:8e97203d-117b-4a26-8c1e-33c77fbdf3ce for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:53:46.562625 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-51468887-a980-4edb-a472-fbbe16e2458f req-fe776ce0-a826-4184-973a-da65a9d91d03 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.055136 Mar 05 20:53:46.563456 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 800/1510] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:46.569235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-26ef01fa-1d1b-4a93-8d2b-a1c4009fd1db tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:46.570003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-26ef01fa-1d1b-4a93-8d2b-a1c4009fd1db tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:46.578132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26ef01fa-1d1b-4a93-8d2b-a1c4009fd1db tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:46.578620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26ef01fa-1d1b-4a93-8d2b-a1c4009fd1db tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:46.579545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26ef01fa-1d1b-4a93-8d2b-a1c4009fd1db tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:46.580086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26ef01fa-1d1b-4a93-8d2b-a1c4009fd1db tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:46.846358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-26ef01fa-1d1b-4a93-8d2b-a1c4009fd1db tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:46.859413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-26ef01fa-1d1b-4a93-8d2b-a1c4009fd1db tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:46.861226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-26ef01fa-1d1b-4a93-8d2b-a1c4009fd1db tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:46.863313 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-26ef01fa-1d1b-4a93-8d2b-a1c4009fd1db tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1361 microversion: 2.25 time: 0.298622 Mar 05 20:53:46.864448 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 801/1511] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:46 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1361 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:46.870142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b5b2f2e2-836a-44e3-b3d3-3dfd10c1237a tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:46.870929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b5b2f2e2-836a-44e3-b3d3-3dfd10c1237a tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:46.887290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5b2f2e2-836a-44e3-b3d3-3dfd10c1237a tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:46.891250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5b2f2e2-836a-44e3-b3d3-3dfd10c1237a tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:46.893636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5b2f2e2-836a-44e3-b3d3-3dfd10c1237a tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:46.894329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5b2f2e2-836a-44e3-b3d3-3dfd10c1237a tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:46.933226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b5b2f2e2-836a-44e3-b3d3-3dfd10c1237a tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f1f722649c2248979f72bded84130ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95ff6b8169b4a6e91d0a2a28c1220cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:46.934619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b5b2f2e2-836a-44e3-b3d3-3dfd10c1237a tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] flavor_id is None. Assuming migration. {{(pid=141479) resize /opt/stack/nova/nova/compute/api.py:4140}} Mar 05 20:53:46.935528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b5b2f2e2-836a-44e3-b3d3-3dfd10c1237a tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141479) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 20:53:47.031643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a3065487-683e-46c7-8010-9fa1d8a9626e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:47.042417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a3065487-683e-46c7-8010-9fa1d8a9626e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:47.055897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a3065487-683e-46c7-8010-9fa1d8a9626e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:47.062588 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a3065487-683e-46c7-8010-9fa1d8a9626e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.578056 Mar 05 20:53:47.063207 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 711/1512] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:46 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:47.083073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2ae91d03-250e-4441-9a25-2e87abe88674 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'create', calling method: .version_select at 0x7fed5c58f700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1614650423", "description": "tempest-description-38494575"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:47.174371 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b5b2f2e2-836a-44e3-b3d3-3dfd10c1237a tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474/action" status: 202 len: 0 microversion: 2.1 time: 0.308473 Mar 05 20:53:47.175450 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 802/1513] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:53:46 2022] POST /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:53:47.181851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-60f97c5e-9868-49b9-b037-bf5cdc29d0d7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:47.183043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-60f97c5e-9868-49b9-b037-bf5cdc29d0d7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:47.192902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-60f97c5e-9868-49b9-b037-bf5cdc29d0d7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:47.193655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-60f97c5e-9868-49b9-b037-bf5cdc29d0d7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:47.194182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-60f97c5e-9868-49b9-b037-bf5cdc29d0d7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:47.194637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-60f97c5e-9868-49b9-b037-bf5cdc29d0d7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:47.508099 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2ae91d03-250e-4441-9a25-2e87abe88674 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.437854 Mar 05 20:53:47.521434 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 712/1514] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:53:47 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:47.532002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-00efa33c-d612-4507-85d5-31208ced5f2c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:47.532940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-00efa33c-d612-4507-85d5-31208ced5f2c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] [instance: 5f3a1743-f646-4148-a573-fe033e15c940] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:47.543050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00efa33c-d612-4507-85d5-31208ced5f2c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:47.543911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00efa33c-d612-4507-85d5-31208ced5f2c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:47.544903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00efa33c-d612-4507-85d5-31208ced5f2c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:47.545531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00efa33c-d612-4507-85d5-31208ced5f2c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:47.592264 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-00efa33c-d612-4507-85d5-31208ced5f2c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] HTTP exception thrown: Instance 5f3a1743-f646-4148-a573-fe033e15c940 could not be found. Mar 05 20:53:47.596148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-00efa33c-d612-4507-85d5-31208ced5f2c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] Returning 404 to user: Instance 5f3a1743-f646-4148-a573-fe033e15c940 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:53:47.597305 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-00efa33c-d612-4507-85d5-31208ced5f2c tempest-MultipleCreateTestJSON-874645773 tempest-MultipleCreateTestJSON-874645773-project] 10.222.0.15 "GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940" status: 404 len: 111 microversion: 2.1 time: 0.072943 Mar 05 20:53:47.600245 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 713/1515] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:47 2022] GET /compute/v2.1/servers/5f3a1743-f646-4148-a573-fe033e15c940 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:53:47.611620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c831ad08-328a-4188-9f0b-f320adb36e2d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:47.616560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c831ad08-328a-4188-9f0b-f320adb36e2d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:47.649341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c831ad08-328a-4188-9f0b-f320adb36e2d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:47.649959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c831ad08-328a-4188-9f0b-f320adb36e2d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:47.651348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c831ad08-328a-4188-9f0b-f320adb36e2d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:47.652018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c831ad08-328a-4188-9f0b-f320adb36e2d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:47.911605 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-60f97c5e-9868-49b9-b037-bf5cdc29d0d7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:47.921131 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-60f97c5e-9868-49b9-b037-bf5cdc29d0d7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1308 microversion: 2.1 time: 0.744251 Mar 05 20:53:47.922559 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 803/1516] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:47 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1308 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:47.928040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fb6b1b94-ac56-4b29-b7d3-9d33f6a0bdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:47.928945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fb6b1b94-ac56-4b29-b7d3-9d33f6a0bdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:47.935880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb6b1b94-ac56-4b29-b7d3-9d33f6a0bdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:47.936349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb6b1b94-ac56-4b29-b7d3-9d33f6a0bdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:47.937157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb6b1b94-ac56-4b29-b7d3-9d33f6a0bdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:47.937606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb6b1b94-ac56-4b29-b7d3-9d33f6a0bdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:48.153504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fb6b1b94-ac56-4b29-b7d3-9d33f6a0bdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:48.164530 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fb6b1b94-ac56-4b29-b7d3-9d33f6a0bdce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1325 microversion: 2.1 time: 0.240124 Mar 05 20:53:48.165829 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 804/1517] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:47 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:48.172127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-460156953", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "62082c5f-85c3-4d11-9ba0-883ff09b0721"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:48.247165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] validate_networks() for [('62082c5f-85c3-4d11-9ba0-883ff09b0721', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:53:48.412255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c831ad08-328a-4188-9f0b-f320adb36e2d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:48.434907 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c831ad08-328a-4188-9f0b-f320adb36e2d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1472 microversion: 2.1 time: 0.826407 Mar 05 20:53:48.445688 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 714/1518] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:47 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1472 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:48.453461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-37755b4d-9473-4469-8c37-6d3e09923c9c req-bd3354a2-5bbc-4fbc-8b86-f73f30486d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facc63d8-2f5b-4b1f-858c-65e0ba787498", "name": "network-vif-plugged", "status": "completed", "tag": "727e5026-bc21-477c-93fd-d0897928ef02"}, {"server_uuid": "566b4bf7-27e3-48e9-aa39-9d0f512a146f", "name": "network-vif-plugged", "status": "completed", "tag": "849d5225-97e8-496b-a8f3-1b7a3df6f4d7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:48.469696 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-37755b4d-9473-4469-8c37-6d3e09923c9c req-bd3354a2-5bbc-4fbc-8b86-f73f30486d8c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:48.470298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-37755b4d-9473-4469-8c37-6d3e09923c9c req-bd3354a2-5bbc-4fbc-8b86-f73f30486d8c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:48.488798 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-37755b4d-9473-4469-8c37-6d3e09923c9c req-bd3354a2-5bbc-4fbc-8b86-f73f30486d8c service nova] Creating event network-vif-plugged:727e5026-bc21-477c-93fd-d0897928ef02 for instance facc63d8-2f5b-4b1f-858c-65e0ba787498 on nch1-master-1 Mar 05 20:53:48.489524 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-37755b4d-9473-4469-8c37-6d3e09923c9c req-bd3354a2-5bbc-4fbc-8b86-f73f30486d8c service nova] Creating event network-vif-plugged:849d5225-97e8-496b-a8f3-1b7a3df6f4d7 for instance 566b4bf7-27e3-48e9-aa39-9d0f512a146f on nch2-master-1 Mar 05 20:53:48.502391 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-37755b4d-9473-4469-8c37-6d3e09923c9c req-bd3354a2-5bbc-4fbc-8b86-f73f30486d8c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055052 Mar 05 20:53:48.504265 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 715/1519] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:48.532545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-893c091c-bf32-4424-aae1-cb609b2fb354 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:48.535476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-893c091c-bf32-4424-aae1-cb609b2fb354 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:48.550992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-893c091c-bf32-4424-aae1-cb609b2fb354 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:48.552814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-893c091c-bf32-4424-aae1-cb609b2fb354 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:48.553765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-893c091c-bf32-4424-aae1-cb609b2fb354 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:48.554440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-893c091c-bf32-4424-aae1-cb609b2fb354 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:48.975826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:53:48.976262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:53:48.976756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:53:48.977171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:53:48.977814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:53:48.986713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:48.987172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:48.988027 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:48.988648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:49.006627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Getting quotas for project 8f07583be1724ade87d2945c000e3e33. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:53:49.013094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Getting quotas for user 31812fbb5c6142a8ab6068b1464ae2a3 and project 8f07583be1724ade87d2945c000e3e33. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:53:49.025944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:53:49.028586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:53:49.081319 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4ac1b4cf-d9a6-4b8b-b1cc-f8c6eed56fb3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913497 Mar 05 20:53:49.082697 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 805/1520] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:53:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:53:49.089063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b6ce5418-fb15-4855-a929-e44907019453 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:49.089934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b6ce5418-fb15-4855-a929-e44907019453 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:49.097227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6ce5418-fb15-4855-a929-e44907019453 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:49.097717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6ce5418-fb15-4855-a929-e44907019453 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:49.098514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6ce5418-fb15-4855-a929-e44907019453 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:49.099014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6ce5418-fb15-4855-a929-e44907019453 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:49.155867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-893c091c-bf32-4424-aae1-cb609b2fb354 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:49.168392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-893c091c-bf32-4424-aae1-cb609b2fb354 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:49.169890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-893c091c-bf32-4424-aae1-cb609b2fb354 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:49.171050 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-893c091c-bf32-4424-aae1-cb609b2fb354 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1558 microversion: 2.25 time: 0.664289 Mar 05 20:53:49.171615 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 716/1521] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:48 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1558 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:49.268633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-adece6df-e0a7-4c9c-a8ea-44928b726754 req-9a0de403-d93c-40be-a787-e625bd6c452c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3a1743-f646-4148-a573-fe033e15c940", "name": "network-vif-deleted", "tag": "a12b1cef-8918-43e9-9644-e6d9f0cccf28"}, {"name": "network-changed", "server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "tag": "2c1807e8-ead9-44e9-ab65-390e42b1ded8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:49.285182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-adece6df-e0a7-4c9c-a8ea-44928b726754 req-9a0de403-d93c-40be-a787-e625bd6c452c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:49.285701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-adece6df-e0a7-4c9c-a8ea-44928b726754 req-9a0de403-d93c-40be-a787-e625bd6c452c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:49.343981 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-adece6df-e0a7-4c9c-a8ea-44928b726754 req-9a0de403-d93c-40be-a787-e625bd6c452c service nova] Creating event network-vif-deleted:a12b1cef-8918-43e9-9644-e6d9f0cccf28 for instance 5f3a1743-f646-4148-a573-fe033e15c940 on nch2-master-1 Mar 05 20:53:49.345051 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-adece6df-e0a7-4c9c-a8ea-44928b726754 req-9a0de403-d93c-40be-a787-e625bd6c452c service nova] Creating event network-changed:2c1807e8-ead9-44e9-ab65-390e42b1ded8 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:53:49.357353 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-adece6df-e0a7-4c9c-a8ea-44928b726754 req-9a0de403-d93c-40be-a787-e625bd6c452c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.178507 Mar 05 20:53:49.358619 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 717/1522] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:49.365229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a06e8046-50da-4401-b292-90c2c7e5dcf4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:49.368376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a06e8046-50da-4401-b292-90c2c7e5dcf4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:49.379580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a06e8046-50da-4401-b292-90c2c7e5dcf4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:49.380302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a06e8046-50da-4401-b292-90c2c7e5dcf4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:49.381590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a06e8046-50da-4401-b292-90c2c7e5dcf4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:49.382140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a06e8046-50da-4401-b292-90c2c7e5dcf4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:49.735108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b6ce5418-fb15-4855-a929-e44907019453 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:49.748733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b6ce5418-fb15-4855-a929-e44907019453 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:49.752873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b6ce5418-fb15-4855-a929-e44907019453 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:49.755365 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b6ce5418-fb15-4855-a929-e44907019453 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.671443 Mar 05 20:53:49.774953 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 806/1523] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:49 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:49.781821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0996d98-d304-4fd7-b6a6-642321b76999 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:49.783179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e0996d98-d304-4fd7-b6a6-642321b76999 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:49.793305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0996d98-d304-4fd7-b6a6-642321b76999 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:49.794104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0996d98-d304-4fd7-b6a6-642321b76999 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:49.795096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0996d98-d304-4fd7-b6a6-642321b76999 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:49.795746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0996d98-d304-4fd7-b6a6-642321b76999 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:49.986049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e0996d98-d304-4fd7-b6a6-642321b76999 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:49.996344 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0996d98-d304-4fd7-b6a6-642321b76999 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1219 microversion: 2.1 time: 0.219460 Mar 05 20:53:50.008702 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 807/1524] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:49 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1219 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:50.015464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0c9f46bd-9d3a-48d9-8db5-48c1780c942d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:50.017206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0c9f46bd-9d3a-48d9-8db5-48c1780c942d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:50.031849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c9f46bd-9d3a-48d9-8db5-48c1780c942d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:50.033298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c9f46bd-9d3a-48d9-8db5-48c1780c942d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:50.035408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c9f46bd-9d3a-48d9-8db5-48c1780c942d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:50.037051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c9f46bd-9d3a-48d9-8db5-48c1780c942d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:50.223431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a06e8046-50da-4401-b292-90c2c7e5dcf4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:50.232183 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a06e8046-50da-4401-b292-90c2c7e5dcf4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1308 microversion: 2.1 time: 0.871958 Mar 05 20:53:50.233628 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 718/1525] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:49 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1308 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:50.239061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-257841e3-6e38-4ba1-bf83-e59b3beb71f1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:50.239982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-257841e3-6e38-4ba1-bf83-e59b3beb71f1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:50.248190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-257841e3-6e38-4ba1-bf83-e59b3beb71f1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:50.249033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-257841e3-6e38-4ba1-bf83-e59b3beb71f1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:50.250130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-257841e3-6e38-4ba1-bf83-e59b3beb71f1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:50.250839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-257841e3-6e38-4ba1-bf83-e59b3beb71f1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:50.500416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0c9f46bd-9d3a-48d9-8db5-48c1780c942d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:50.515879 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0c9f46bd-9d3a-48d9-8db5-48c1780c942d tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1325 microversion: 2.1 time: 0.504778 Mar 05 20:53:50.518328 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 808/1526] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:50 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1325 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:50.528547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-34a944ba-3085-4edc-9f2f-596903141e53 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:50.529185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-34a944ba-3085-4edc-9f2f-596903141e53 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:50.540633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34a944ba-3085-4edc-9f2f-596903141e53 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:50.542611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34a944ba-3085-4edc-9f2f-596903141e53 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:50.544534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34a944ba-3085-4edc-9f2f-596903141e53 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:50.545252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34a944ba-3085-4edc-9f2f-596903141e53 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:50.904649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-257841e3-6e38-4ba1-bf83-e59b3beb71f1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:53:50.920749 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-257841e3-6e38-4ba1-bf83-e59b3beb71f1 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 2050 microversion: 2.25 time: 0.685520 Mar 05 20:53:50.921925 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 719/1527] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:50 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 2050 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:50.931332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-47c31e6b-e2a5-4619-bb14-7f172041b74f tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:50.933603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-47c31e6b-e2a5-4619-bb14-7f172041b74f tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:50.941997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47c31e6b-e2a5-4619-bb14-7f172041b74f tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:50.942465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47c31e6b-e2a5-4619-bb14-7f172041b74f tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:50.943269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47c31e6b-e2a5-4619-bb14-7f172041b74f tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:50.943741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47c31e6b-e2a5-4619-bb14-7f172041b74f tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:50.966827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-34a944ba-3085-4edc-9f2f-596903141e53 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:50.980067 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-34a944ba-3085-4edc-9f2f-596903141e53 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1472 microversion: 2.1 time: 0.457004 Mar 05 20:53:50.993165 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 809/1528] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:50 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1472 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:50.999521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cde6b7d6-b320-41f2-83c5-0e92873a2f2d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:51.000533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cde6b7d6-b320-41f2-83c5-0e92873a2f2d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:51.012724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cde6b7d6-b320-41f2-83c5-0e92873a2f2d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:51.013288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cde6b7d6-b320-41f2-83c5-0e92873a2f2d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:51.014344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cde6b7d6-b320-41f2-83c5-0e92873a2f2d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:51.025079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cde6b7d6-b320-41f2-83c5-0e92873a2f2d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:51.635935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-47c31e6b-e2a5-4619-bb14-7f172041b74f tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:51.644761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-cde6b7d6-b320-41f2-83c5-0e92873a2f2d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:53:51.656592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-47c31e6b-e2a5-4619-bb14-7f172041b74f tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:51.658450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-47c31e6b-e2a5-4619-bb14-7f172041b74f tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:51.662771 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-47c31e6b-e2a5-4619-bb14-7f172041b74f tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.736684 Mar 05 20:53:51.663841 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 720/1529] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:50 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:51.673367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-22c62f5a-b34c-4f1d-8006-cc4ea3489549 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:51.675607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-22c62f5a-b34c-4f1d-8006-cc4ea3489549 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:51.689083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22c62f5a-b34c-4f1d-8006-cc4ea3489549 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:51.689566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22c62f5a-b34c-4f1d-8006-cc4ea3489549 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:51.690436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22c62f5a-b34c-4f1d-8006-cc4ea3489549 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:51.690881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22c62f5a-b34c-4f1d-8006-cc4ea3489549 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:51.767785 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cde6b7d6-b320-41f2-83c5-0e92873a2f2d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 2050 microversion: 2.25 time: 0.772933 Mar 05 20:53:51.780739 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 810/1530] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:50 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 2050 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:51.780739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-48a818f0-1e85-4e66-a7d5-c187ade1d494 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:51.780739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-48a818f0-1e85-4e66-a7d5-c187ade1d494 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:51.794768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48a818f0-1e85-4e66-a7d5-c187ade1d494 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:51.795229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48a818f0-1e85-4e66-a7d5-c187ade1d494 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:51.796054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48a818f0-1e85-4e66-a7d5-c187ade1d494 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:51.796791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48a818f0-1e85-4e66-a7d5-c187ade1d494 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:52.115914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-48a818f0-1e85-4e66-a7d5-c187ade1d494 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:52.140119 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-48a818f0-1e85-4e66-a7d5-c187ade1d494 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1487 microversion: 2.1 time: 0.368095 Mar 05 20:53:52.140733 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 811/1531] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:51 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1487 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:52.146831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-316bcad4-9f22-4e8e-9607-d6601cd4b9a6 req-2129cfb1-2b1b-4ed2-b098-4aae05ba870e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "tag": "b782a7da-f012-4816-a7bc-b15194cb2996"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:52.159927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-316bcad4-9f22-4e8e-9607-d6601cd4b9a6 req-2129cfb1-2b1b-4ed2-b098-4aae05ba870e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:52.160796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-316bcad4-9f22-4e8e-9607-d6601cd4b9a6 req-2129cfb1-2b1b-4ed2-b098-4aae05ba870e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:52.173369 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-316bcad4-9f22-4e8e-9607-d6601cd4b9a6 req-2129cfb1-2b1b-4ed2-b098-4aae05ba870e service nova] Creating event network-changed:b782a7da-f012-4816-a7bc-b15194cb2996 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:53:52.179897 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-316bcad4-9f22-4e8e-9607-d6601cd4b9a6 req-2129cfb1-2b1b-4ed2-b098-4aae05ba870e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037794 Mar 05 20:53:52.180894 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 812/1532] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:52.187197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91702058-83a8-4f1d-9f57-816c4874687a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:52.188235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91702058-83a8-4f1d-9f57-816c4874687a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:52.195646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91702058-83a8-4f1d-9f57-816c4874687a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:52.196458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91702058-83a8-4f1d-9f57-816c4874687a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:52.198017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91702058-83a8-4f1d-9f57-816c4874687a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:52.198676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91702058-83a8-4f1d-9f57-816c4874687a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:52.214506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-22c62f5a-b34c-4f1d-8006-cc4ea3489549 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:52.224388 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-22c62f5a-b34c-4f1d-8006-cc4ea3489549 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1273 microversion: 2.1 time: 0.559001 Mar 05 20:53:52.225468 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 721/1533] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:51 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1273 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:52.234276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-740cb00b-45d7-478c-bcbb-4d42d62c212f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:52.236678 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:53:52.236678 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:53:52.238298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-740cb00b-45d7-478c-bcbb-4d42d62c212f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:52.239608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-740cb00b-45d7-478c-bcbb-4d42d62c212f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:52.243552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-740cb00b-45d7-478c-bcbb-4d42d62c212f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:52.245090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-740cb00b-45d7-478c-bcbb-4d42d62c212f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:52.281733 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-740cb00b-45d7-478c-bcbb-4d42d62c212f tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.051043 Mar 05 20:53:52.282660 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 722/1534] 10.222.0.15 () {60 vars in 1216 bytes} [Sat Mar 5 20:53:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:53:52.295990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-860cdd9f-22df-4848-a27f-ebbecf89a3dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:52.296768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-860cdd9f-22df-4848-a27f-ebbecf89a3dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:52.304314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-860cdd9f-22df-4848-a27f-ebbecf89a3dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:52.305105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-860cdd9f-22df-4848-a27f-ebbecf89a3dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:52.306328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-860cdd9f-22df-4848-a27f-ebbecf89a3dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:52.308275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-860cdd9f-22df-4848-a27f-ebbecf89a3dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:52.644058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-91702058-83a8-4f1d-9f57-816c4874687a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:52.664814 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91702058-83a8-4f1d-9f57-816c4874687a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1521 microversion: 2.1 time: 0.481805 Mar 05 20:53:52.677865 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 813/1535] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:52 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:52.684232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a1ad9de0-d2f9-40c0-82c0-f0f974ca2088 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:52.692498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a1ad9de0-d2f9-40c0-82c0-f0f974ca2088 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:52.694737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a1ad9de0-d2f9-40c0-82c0-f0f974ca2088 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:52.775712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a1ad9de0-d2f9-40c0-82c0-f0f974ca2088 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Going to try to stop instance {{(pid=141479) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 05 20:53:52.823607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-860cdd9f-22df-4848-a27f-ebbecf89a3dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:52.840032 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a1ad9de0-d2f9-40c0-82c0-f0f974ca2088 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "POST /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498/action" status: 202 len: 0 microversion: 2.1 time: 0.160531 Mar 05 20:53:52.841998 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 814/1536] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:53:52 2022] POST /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:53:52.848297 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-860cdd9f-22df-4848-a27f-ebbecf89a3dc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.563842 Mar 05 20:53:52.850156 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 723/1537] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:52 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:52.862313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ef8e3c62-4598-4757-b3ec-9eee9c2c3305 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:52.865968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ef8e3c62-4598-4757-b3ec-9eee9c2c3305 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:52.877041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bac08ae8-b760-47fd-a165-2467c6d194d9 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:52.877899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bac08ae8-b760-47fd-a165-2467c6d194d9 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:52.884968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef8e3c62-4598-4757-b3ec-9eee9c2c3305 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:52.886042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef8e3c62-4598-4757-b3ec-9eee9c2c3305 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:52.887652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef8e3c62-4598-4757-b3ec-9eee9c2c3305 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:52.888367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef8e3c62-4598-4757-b3ec-9eee9c2c3305 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:52.889007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bac08ae8-b760-47fd-a165-2467c6d194d9 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:52.889517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bac08ae8-b760-47fd-a165-2467c6d194d9 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:52.890494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bac08ae8-b760-47fd-a165-2467c6d194d9 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:52.890959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bac08ae8-b760-47fd-a165-2467c6d194d9 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:53.004642 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bac08ae8-b760-47fd-a165-2467c6d194d9 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd/action" status: 202 len: 0 microversion: 2.25 time: 0.160192 Mar 05 20:53:53.009184 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 815/1538] 10.222.0.15 () {62 vars in 1318 bytes} [Sat Mar 5 20:53:52 2022] POST /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:53:53.013798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-84808acb-d9ee-47cd-9181-0c07fa5518c6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:53.015133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-84808acb-d9ee-47cd-9181-0c07fa5518c6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:53.022292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84808acb-d9ee-47cd-9181-0c07fa5518c6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:53.022755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84808acb-d9ee-47cd-9181-0c07fa5518c6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:53.023833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84808acb-d9ee-47cd-9181-0c07fa5518c6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:53.031527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84808acb-d9ee-47cd-9181-0c07fa5518c6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:53.357750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-84808acb-d9ee-47cd-9181-0c07fa5518c6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:53.367039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-84808acb-d9ee-47cd-9181-0c07fa5518c6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:53.377664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-84808acb-d9ee-47cd-9181-0c07fa5518c6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:53.378917 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-84808acb-d9ee-47cd-9181-0c07fa5518c6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.371013 Mar 05 20:53:53.394596 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 816/1539] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:53 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:53.413529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0cada02c-a3b5-43d8-983d-253e5a25d255 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:53.422668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0cada02c-a3b5-43d8-983d-253e5a25d255 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:53.430632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cada02c-a3b5-43d8-983d-253e5a25d255 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:53.432662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cada02c-a3b5-43d8-983d-253e5a25d255 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:53.434413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cada02c-a3b5-43d8-983d-253e5a25d255 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:53.436362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cada02c-a3b5-43d8-983d-253e5a25d255 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:53.592787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ef8e3c62-4598-4757-b3ec-9eee9c2c3305 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:53.600613 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ef8e3c62-4598-4757-b3ec-9eee9c2c3305 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1521 microversion: 2.1 time: 0.748804 Mar 05 20:53:53.612445 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 724/1540] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:52 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1521 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:53.618003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1f2a997b-462d-429c-82b8-b8bbb358fe1d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:53.618814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1f2a997b-462d-429c-82b8-b8bbb358fe1d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:53.626200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f2a997b-462d-429c-82b8-b8bbb358fe1d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:53.626667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f2a997b-462d-429c-82b8-b8bbb358fe1d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:53.627468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f2a997b-462d-429c-82b8-b8bbb358fe1d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:53.627947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f2a997b-462d-429c-82b8-b8bbb358fe1d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:53.779550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0cada02c-a3b5-43d8-983d-253e5a25d255 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:53.791588 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0cada02c-a3b5-43d8-983d-253e5a25d255 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.394926 Mar 05 20:53:53.793726 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 817/1541] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:53 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:53.799812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ab5b1fd2-479e-45f7-a630-61b7e88d8af2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:53.800892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ab5b1fd2-479e-45f7-a630-61b7e88d8af2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:53.813595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab5b1fd2-479e-45f7-a630-61b7e88d8af2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:53.814295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab5b1fd2-479e-45f7-a630-61b7e88d8af2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:53.815227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab5b1fd2-479e-45f7-a630-61b7e88d8af2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:53.815789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab5b1fd2-479e-45f7-a630-61b7e88d8af2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:54.116478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ab5b1fd2-479e-45f7-a630-61b7e88d8af2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:54.129268 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ab5b1fd2-479e-45f7-a630-61b7e88d8af2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1315 microversion: 2.1 time: 0.334353 Mar 05 20:53:54.137299 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 818/1542] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:53 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:54.153905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-70e36cfa-acc4-40ca-bfd4-4e3c62162edf tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-811126618", "metadata": {"": ""}}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:54.155649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-70e36cfa-acc4-40ca-bfd4-4e3c62162edf tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:53:54.156695 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-70e36cfa-acc4-40ca-bfd4-4e3c62162edf tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "POST /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f/action" status: 400 len: 170 microversion: 2.1 time: 0.017839 Mar 05 20:53:54.160979 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 819/1543] 10.222.0.15 () {60 vars in 1278 bytes} [Sat Mar 5 20:53:54 2022] POST /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f/action => generated 170 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:53:54.168212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c627b1b3-2d64-4f2e-b6d2-5fc0afe21235 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:54.169690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c627b1b3-2d64-4f2e-b6d2-5fc0afe21235 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:54.189088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c627b1b3-2d64-4f2e-b6d2-5fc0afe21235 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:54.193240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c627b1b3-2d64-4f2e-b6d2-5fc0afe21235 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:54.194337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c627b1b3-2d64-4f2e-b6d2-5fc0afe21235 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:54.195028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c627b1b3-2d64-4f2e-b6d2-5fc0afe21235 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:54.332990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-1f2a997b-462d-429c-82b8-b8bbb358fe1d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:53:54.494015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c627b1b3-2d64-4f2e-b6d2-5fc0afe21235 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:54.510335 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c627b1b3-2d64-4f2e-b6d2-5fc0afe21235 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.346285 Mar 05 20:53:54.512354 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 820/1544] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:54 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:54.519512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-337125c9-52ff-4437-a1bc-733a4cf5ea3f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:54.520752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-337125c9-52ff-4437-a1bc-733a4cf5ea3f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:54.531650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-337125c9-52ff-4437-a1bc-733a4cf5ea3f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:54.532352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-337125c9-52ff-4437-a1bc-733a4cf5ea3f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:54.533412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-337125c9-52ff-4437-a1bc-733a4cf5ea3f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:54.534375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-337125c9-52ff-4437-a1bc-733a4cf5ea3f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:54.609973 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1f2a997b-462d-429c-82b8-b8bbb358fe1d tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 2035 microversion: 2.25 time: 0.996130 Mar 05 20:53:54.610978 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 725/1545] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:53 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 2035 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:54.615753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-44d891e7-8281-461c-86e1-1b789144f120 req-b9d1a06c-1d61-4950-ae64-129a93539ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "tag": "3cb0d38e-d7d1-417d-8eb1-bc1f3f7cf239"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:54.624793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-44d891e7-8281-461c-86e1-1b789144f120 req-b9d1a06c-1d61-4950-ae64-129a93539ddd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:54.625235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-44d891e7-8281-461c-86e1-1b789144f120 req-b9d1a06c-1d61-4950-ae64-129a93539ddd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:54.637375 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-44d891e7-8281-461c-86e1-1b789144f120 req-b9d1a06c-1d61-4950-ae64-129a93539ddd service nova] Creating event network-changed:3cb0d38e-d7d1-417d-8eb1-bc1f3f7cf239 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:53:54.642958 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-44d891e7-8281-461c-86e1-1b789144f120 req-b9d1a06c-1d61-4950-ae64-129a93539ddd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030726 Mar 05 20:53:54.643570 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 726/1546] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:54.648860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aa7aa8f3-5900-4248-85cf-2f2d48dfbd10 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:54.649896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aa7aa8f3-5900-4248-85cf-2f2d48dfbd10 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:54.658256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa7aa8f3-5900-4248-85cf-2f2d48dfbd10 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:54.658881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa7aa8f3-5900-4248-85cf-2f2d48dfbd10 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:54.659928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa7aa8f3-5900-4248-85cf-2f2d48dfbd10 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:54.660645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa7aa8f3-5900-4248-85cf-2f2d48dfbd10 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:54.802687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-337125c9-52ff-4437-a1bc-733a4cf5ea3f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:54.816329 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-337125c9-52ff-4437-a1bc-733a4cf5ea3f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1521 microversion: 2.1 time: 0.302372 Mar 05 20:53:54.828687 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 821/1547] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:54 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:54.828687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7ad47d6a-20cd-417c-9165-557592f4879a tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:54.828687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7ad47d6a-20cd-417c-9165-557592f4879a tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:54.831922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ad47d6a-20cd-417c-9165-557592f4879a tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:54.832551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ad47d6a-20cd-417c-9165-557592f4879a tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:54.834367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ad47d6a-20cd-417c-9165-557592f4879a tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:54.835138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ad47d6a-20cd-417c-9165-557592f4879a tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:54.877352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-7ad47d6a-20cd-417c-9165-557592f4879a tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'flavor' on Instance uuid fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:53:54.901059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7ad47d6a-20cd-417c-9165-557592f4879a tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Going to try to live migrate instance to nch1-master-1 {{(pid=141479) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 05 20:53:55.301809 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aa7aa8f3-5900-4248-85cf-2f2d48dfbd10 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:55.317895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aa7aa8f3-5900-4248-85cf-2f2d48dfbd10 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:55.319757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aa7aa8f3-5900-4248-85cf-2f2d48dfbd10 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:55.321005 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aa7aa8f3-5900-4248-85cf-2f2d48dfbd10 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.676209 Mar 05 20:53:55.321721 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 727/1548] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:54 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:55.340588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-957c9aad-926c-4442-952a-aa1fee8d5439 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:55.342134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-957c9aad-926c-4442-952a-aa1fee8d5439 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:55.349516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-957c9aad-926c-4442-952a-aa1fee8d5439 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:55.350256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-957c9aad-926c-4442-952a-aa1fee8d5439 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:55.351361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-957c9aad-926c-4442-952a-aa1fee8d5439 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:55.352118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-957c9aad-926c-4442-952a-aa1fee8d5439 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:55.670313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-957c9aad-926c-4442-952a-aa1fee8d5439 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:55.689025 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-957c9aad-926c-4442-952a-aa1fee8d5439 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.345503 Mar 05 20:53:55.701306 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 728/1549] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:55 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:55.707751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-64689082-1321-4adc-a5ec-b41a82163ca2 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:55.708751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-64689082-1321-4adc-a5ec-b41a82163ca2 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:55.717403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64689082-1321-4adc-a5ec-b41a82163ca2 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:55.718377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64689082-1321-4adc-a5ec-b41a82163ca2 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:55.719717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64689082-1321-4adc-a5ec-b41a82163ca2 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:55.724523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64689082-1321-4adc-a5ec-b41a82163ca2 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:56.145760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-64689082-1321-4adc-a5ec-b41a82163ca2 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:56.159469 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-64689082-1321-4adc-a5ec-b41a82163ca2 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1521 microversion: 2.1 time: 0.456294 Mar 05 20:53:56.161365 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 729/1550] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:55 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:56.373289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1070317164", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "b6447283-e533-4bc2-9b52-88f180bac4d0"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:56.428810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] validate_networks() for [('b6447283-e533-4bc2-9b52-88f180bac4d0', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:53:57.313579 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7ad47d6a-20cd-417c-9165-557592f4879a tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd/action" status: 202 len: 0 microversion: 2.25 time: 2.494882 Mar 05 20:53:57.318268 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 822/1551] 10.222.0.15 () {62 vars in 1318 bytes} [Sat Mar 5 20:53:54 2022] POST /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd/action => generated 0 bytes in 2500 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:53:57.324538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-22343f0e-15a1-4582-89cf-3af536c03569 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:57.325161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-22343f0e-15a1-4582-89cf-3af536c03569 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:57.331472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22343f0e-15a1-4582-89cf-3af536c03569 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:57.331973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22343f0e-15a1-4582-89cf-3af536c03569 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:57.332770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22343f0e-15a1-4582-89cf-3af536c03569 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:57.339867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22343f0e-15a1-4582-89cf-3af536c03569 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:57.347287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:53:57.347750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:53:57.348286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:53:57.348962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:53:57.349484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:53:57.375910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:57.378655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:57.381100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:57.381975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:57.404932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Getting quotas for project e6badaeb06194bf7a79309e9bad2e8b5. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:53:57.411389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Getting quotas for user 4de3173446b54d288bc94c8e49bb4120 and project e6badaeb06194bf7a79309e9bad2e8b5. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:53:57.430391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:53:57.436904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:53:57.502195 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-96977d1e-5296-4edd-85f7-95feabb710be tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.339371 Mar 05 20:53:57.503446 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 730/1552] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:53:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:53:57.510125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e82ce91d-5314-4876-839b-726dae3e6009 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:57.510881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e82ce91d-5314-4876-839b-726dae3e6009 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:57.519795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e82ce91d-5314-4876-839b-726dae3e6009 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:57.520547 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e82ce91d-5314-4876-839b-726dae3e6009 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:57.521989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e82ce91d-5314-4876-839b-726dae3e6009 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:57.523010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e82ce91d-5314-4876-839b-726dae3e6009 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:57.525555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-22343f0e-15a1-4582-89cf-3af536c03569 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:57.534789 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-22343f0e-15a1-4582-89cf-3af536c03569 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1315 microversion: 2.1 time: 0.215198 Mar 05 20:53:57.550316 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 823/1553] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:57 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:57.555815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-11068323-204f-42c9-b10c-98471f4480ce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-164859710", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:57.558437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-11068323-204f-42c9-b10c-98471f4480ce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:53:57.559625 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-11068323-204f-42c9-b10c-98471f4480ce tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "POST /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f/action" status: 400 len: 938 microversion: 2.1 time: 0.007884 Mar 05 20:53:57.561468 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 824/1554] 10.222.0.15 () {60 vars in 1278 bytes} [Sat Mar 5 20:53:57 2022] POST /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f/action => generated 938 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:53:57.566540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-65f6fe2c-824e-4d4a-a5e9-09a9e9a8e1ca tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:57.568077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-65f6fe2c-824e-4d4a-a5e9-09a9e9a8e1ca tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:57.576542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65f6fe2c-824e-4d4a-a5e9-09a9e9a8e1ca tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:57.577260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65f6fe2c-824e-4d4a-a5e9-09a9e9a8e1ca tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:57.578659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65f6fe2c-824e-4d4a-a5e9-09a9e9a8e1ca tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:57.579270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65f6fe2c-824e-4d4a-a5e9-09a9e9a8e1ca tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:57.783455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-65f6fe2c-824e-4d4a-a5e9-09a9e9a8e1ca tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:57.798572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-65f6fe2c-824e-4d4a-a5e9-09a9e9a8e1ca tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:57.803896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-65f6fe2c-824e-4d4a-a5e9-09a9e9a8e1ca tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:57.805233 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-65f6fe2c-824e-4d4a-a5e9-09a9e9a8e1ca tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.242582 Mar 05 20:53:57.805748 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 825/1555] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:57 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:57.828364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-57a3bcfc-38ea-4169-8769-f91c60c9cc16 req-b19c4cf4-8ed9-4020-a4d0-ad7d7f189e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "tag": "b9701cfb-119e-4040-a711-f90621bd7b80"}, {"name": "network-changed", "server_uuid": "1c9bb643-2491-47d8-9758-76f13e927450", "tag": "39103012-a3fb-406c-a3d5-628b64bf136f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:57.838788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-57a3bcfc-38ea-4169-8769-f91c60c9cc16 req-b19c4cf4-8ed9-4020-a4d0-ad7d7f189e57 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:57.839583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-57a3bcfc-38ea-4169-8769-f91c60c9cc16 req-b19c4cf4-8ed9-4020-a4d0-ad7d7f189e57 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:57.854888 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-57a3bcfc-38ea-4169-8769-f91c60c9cc16 req-b19c4cf4-8ed9-4020-a4d0-ad7d7f189e57 service nova] Creating event network-changed:b9701cfb-119e-4040-a711-f90621bd7b80 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:53:57.855921 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-57a3bcfc-38ea-4169-8769-f91c60c9cc16 req-b19c4cf4-8ed9-4020-a4d0-ad7d7f189e57 service nova] Creating event network-changed:39103012-a3fb-406c-a3d5-628b64bf136f for instance 1c9bb643-2491-47d8-9758-76f13e927450 on nch2-master-1 Mar 05 20:53:57.866859 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-57a3bcfc-38ea-4169-8769-f91c60c9cc16 req-b19c4cf4-8ed9-4020-a4d0-ad7d7f189e57 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.059886 Mar 05 20:53:57.867725 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 826/1556] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:53:57.873772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c1bd47fc-f322-482c-a10e-f9ba4c36d2bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:57.874949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c1bd47fc-f322-482c-a10e-f9ba4c36d2bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:57.883345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1bd47fc-f322-482c-a10e-f9ba4c36d2bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:57.884204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1bd47fc-f322-482c-a10e-f9ba4c36d2bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:57.885245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1bd47fc-f322-482c-a10e-f9ba4c36d2bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:57.885889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1bd47fc-f322-482c-a10e-f9ba4c36d2bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:57.988039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e82ce91d-5314-4876-839b-726dae3e6009 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:58.006584 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e82ce91d-5314-4876-839b-726dae3e6009 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.501039 Mar 05 20:53:58.007647 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 731/1557] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:57 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:58.078985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1588133072", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "fb0078aa-02a6-4f87-b415-c08c0da0522d"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:58.086207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c1bd47fc-f322-482c-a10e-f9ba4c36d2bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:58.095290 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c1bd47fc-f322-482c-a10e-f9ba4c36d2bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.225988 Mar 05 20:53:58.096463 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 827/1558] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:57 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:58.104476 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1e881fac-6bdb-43a9-bd21-53267f2c7cce tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:58.106562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1e881fac-6bdb-43a9-bd21-53267f2c7cce tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:58.115447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e881fac-6bdb-43a9-bd21-53267f2c7cce tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:58.116201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e881fac-6bdb-43a9-bd21-53267f2c7cce tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:58.117388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e881fac-6bdb-43a9-bd21-53267f2c7cce tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:58.118230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e881fac-6bdb-43a9-bd21-53267f2c7cce tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:58.152147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] validate_networks() for [('fb0078aa-02a6-4f87-b415-c08c0da0522d', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:53:58.286303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1e881fac-6bdb-43a9-bd21-53267f2c7cce tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:58.296597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1e881fac-6bdb-43a9-bd21-53267f2c7cce tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:58.298431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1e881fac-6bdb-43a9-bd21-53267f2c7cce tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:58.299597 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1e881fac-6bdb-43a9-bd21-53267f2c7cce tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1568 microversion: 2.25 time: 0.201794 Mar 05 20:53:58.300223 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 828/1559] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:58 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:58.304964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-45a2befe-71d6-48af-bfdb-12a543a14e0c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:58.305573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-45a2befe-71d6-48af-bfdb-12a543a14e0c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:58.312982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45a2befe-71d6-48af-bfdb-12a543a14e0c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:58.313580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45a2befe-71d6-48af-bfdb-12a543a14e0c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:58.314367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45a2befe-71d6-48af-bfdb-12a543a14e0c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:58.314906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45a2befe-71d6-48af-bfdb-12a543a14e0c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:58.377194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-45a2befe-71d6-48af-bfdb-12a543a14e0c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:58.385291 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-45a2befe-71d6-48af-bfdb-12a543a14e0c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1269 microversion: 2.1 time: 0.083879 Mar 05 20:53:58.385876 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 829/1560] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:58 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:58.390393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6b6fedde-b557-4d04-aa40-9c38f00a4e97 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:58.391127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6b6fedde-b557-4d04-aa40-9c38f00a4e97 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:58.397358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b6fedde-b557-4d04-aa40-9c38f00a4e97 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:58.397831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b6fedde-b557-4d04-aa40-9c38f00a4e97 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:58.398607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b6fedde-b557-4d04-aa40-9c38f00a4e97 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:58.399042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b6fedde-b557-4d04-aa40-9c38f00a4e97 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:58.536410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6b6fedde-b557-4d04-aa40-9c38f00a4e97 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:58.545009 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6b6fedde-b557-4d04-aa40-9c38f00a4e97 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1521 microversion: 2.1 time: 0.157985 Mar 05 20:53:58.557026 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 830/1561] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:58 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:58.562418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-49c4763a-99da-46a6-97d1-9e40ab6f92de tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:58.563438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-49c4763a-99da-46a6-97d1-9e40ab6f92de tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:58.572252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-49c4763a-99da-46a6-97d1-9e40ab6f92de tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:58.572974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-49c4763a-99da-46a6-97d1-9e40ab6f92de tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:58.573784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-49c4763a-99da-46a6-97d1-9e40ab6f92de tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:58.574237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-49c4763a-99da-46a6-97d1-9e40ab6f92de tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:58.726073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-49c4763a-99da-46a6-97d1-9e40ab6f92de tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:58.733866 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-49c4763a-99da-46a6-97d1-9e40ab6f92de tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1315 microversion: 2.1 time: 0.177793 Mar 05 20:53:58.734385 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 831/1562] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:58 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:58.739642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8814cc3c-828f-4b4c-8cb7-3d7f1de8b50a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:58.740301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8814cc3c-828f-4b4c-8cb7-3d7f1de8b50a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:58.747366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8814cc3c-828f-4b4c-8cb7-3d7f1de8b50a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:58.747920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8814cc3c-828f-4b4c-8cb7-3d7f1de8b50a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:58.749190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8814cc3c-828f-4b4c-8cb7-3d7f1de8b50a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:58.749325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8814cc3c-828f-4b4c-8cb7-3d7f1de8b50a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:58.892462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8814cc3c-828f-4b4c-8cb7-3d7f1de8b50a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:58.900026 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8814cc3c-828f-4b4c-8cb7-3d7f1de8b50a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1521 microversion: 2.1 time: 0.164547 Mar 05 20:53:58.901333 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 832/1563] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:58 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:58.908612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6cfe632c-50eb-483c-8154-ceb9ac1845f5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:58.908612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6cfe632c-50eb-483c-8154-ceb9ac1845f5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:58.913981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6cfe632c-50eb-483c-8154-ceb9ac1845f5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:58.914532 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6cfe632c-50eb-483c-8154-ceb9ac1845f5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:58.915362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6cfe632c-50eb-483c-8154-ceb9ac1845f5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:58.916103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6cfe632c-50eb-483c-8154-ceb9ac1845f5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.119091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6cfe632c-50eb-483c-8154-ceb9ac1845f5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:59.129050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6cfe632c-50eb-483c-8154-ceb9ac1845f5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:59.130568 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6cfe632c-50eb-483c-8154-ceb9ac1845f5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:59.131774 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6cfe632c-50eb-483c-8154-ceb9ac1845f5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.229597 Mar 05 20:53:59.132358 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 833/1564] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:58 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:59.138727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0238e771-8f74-44af-b3be-daab87b0a516 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:53:59.140027 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0238e771-8f74-44af-b3be-daab87b0a516 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:53:59.140858 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0238e771-8f74-44af-b3be-daab87b0a516 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "POST /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f/action" status: 400 len: 619 microversion: 2.1 time: 0.007360 Mar 05 20:53:59.142705 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 834/1565] 10.222.0.15 () {60 vars in 1278 bytes} [Sat Mar 5 20:53:59 2022] POST /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f/action => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:53:59.146523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-01e92525-526d-462d-892e-78c52ece08a1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:59.147091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-01e92525-526d-462d-892e-78c52ece08a1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:59.155740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01e92525-526d-462d-892e-78c52ece08a1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.156203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01e92525-526d-462d-892e-78c52ece08a1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.156998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01e92525-526d-462d-892e-78c52ece08a1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.157441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01e92525-526d-462d-892e-78c52ece08a1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.298531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-01e92525-526d-462d-892e-78c52ece08a1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:59.307812 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-01e92525-526d-462d-892e-78c52ece08a1 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.165065 Mar 05 20:53:59.308213 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 835/1566] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:59 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:59.314385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5d839758-803f-478d-808c-1aa0388870e0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:59.315073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5d839758-803f-478d-808c-1aa0388870e0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:59.321210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d839758-803f-478d-808c-1aa0388870e0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.321674 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d839758-803f-478d-808c-1aa0388870e0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.323115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d839758-803f-478d-808c-1aa0388870e0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.323560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d839758-803f-478d-808c-1aa0388870e0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.471706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5d839758-803f-478d-808c-1aa0388870e0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:59.480231 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5d839758-803f-478d-808c-1aa0388870e0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.170996 Mar 05 20:53:59.480812 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 836/1567] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:59 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:59.485478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ba163c9-4f90-402a-b0b3-593df5e55f2c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:59.486117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ba163c9-4f90-402a-b0b3-593df5e55f2c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:59.492155 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ba163c9-4f90-402a-b0b3-593df5e55f2c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.492609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ba163c9-4f90-402a-b0b3-593df5e55f2c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.493386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ba163c9-4f90-402a-b0b3-593df5e55f2c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.493823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ba163c9-4f90-402a-b0b3-593df5e55f2c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.632269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9ba163c9-4f90-402a-b0b3-593df5e55f2c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:59.640378 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ba163c9-4f90-402a-b0b3-593df5e55f2c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1521 microversion: 2.1 time: 0.158427 Mar 05 20:53:59.651772 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 837/1568] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:59 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:59.651772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-41a850cb-3d36-4b1e-83aa-4ec4ff3f6b22 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:59.651772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-41a850cb-3d36-4b1e-83aa-4ec4ff3f6b22 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:59.657775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41a850cb-3d36-4b1e-83aa-4ec4ff3f6b22 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.658233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41a850cb-3d36-4b1e-83aa-4ec4ff3f6b22 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.659026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41a850cb-3d36-4b1e-83aa-4ec4ff3f6b22 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.659468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41a850cb-3d36-4b1e-83aa-4ec4ff3f6b22 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.804997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-41a850cb-3d36-4b1e-83aa-4ec4ff3f6b22 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:59.813902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-41a850cb-3d36-4b1e-83aa-4ec4ff3f6b22 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:59.815519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-41a850cb-3d36-4b1e-83aa-4ec4ff3f6b22 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:59.816789 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-41a850cb-3d36-4b1e-83aa-4ec4ff3f6b22 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1568 microversion: 2.25 time: 0.174897 Mar 05 20:53:59.817436 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 838/1569] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:53:59 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:53:59.822759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-be779606-4ef6-491c-bcac-be3984ec5f4a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:59.822994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-be779606-4ef6-491c-bcac-be3984ec5f4a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:59.829866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be779606-4ef6-491c-bcac-be3984ec5f4a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.830335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be779606-4ef6-491c-bcac-be3984ec5f4a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.831120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be779606-4ef6-491c-bcac-be3984ec5f4a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.831563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be779606-4ef6-491c-bcac-be3984ec5f4a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.836582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:53:59.837053 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:53:59.838319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:53:59.838865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:53:59.839490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:53:59.848645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.849237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.850169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.850726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.872610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Getting quotas for project c9b274ea570549a3a2624e701a7774d5. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:53:59.881924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Getting quotas for user 95900ebca5b941a58ab71c68d69be24a and project c9b274ea570549a3a2624e701a7774d5. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:53:59.899642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-be779606-4ef6-491c-bcac-be3984ec5f4a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:53:59.909205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:53:59.911513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:53:59.913532 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-be779606-4ef6-491c-bcac-be3984ec5f4a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1275 microversion: 2.1 time: 0.095062 Mar 05 20:53:59.914340 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 839/1570] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:59 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:53:59.920182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a27db88b-9dda-4ce8-8059-59fb1df0d5a5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:59.920960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a27db88b-9dda-4ce8-8059-59fb1df0d5a5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:59.933157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a27db88b-9dda-4ce8-8059-59fb1df0d5a5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.933710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a27db88b-9dda-4ce8-8059-59fb1df0d5a5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.934631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a27db88b-9dda-4ce8-8059-59fb1df0d5a5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.935142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a27db88b-9dda-4ce8-8059-59fb1df0d5a5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.966873 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bfef05a6-4e2d-4922-bdfc-137f92715186 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.956983 Mar 05 20:53:59.968297 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 732/1571] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 20:53:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1960 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 05 20:53:59.974937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd60037c-ed31-4863-9056-3181f7380993 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:53:59.975854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd60037c-ed31-4863-9056-3181f7380993 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:53:59.983437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd60037c-ed31-4863-9056-3181f7380993 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.984498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd60037c-ed31-4863-9056-3181f7380993 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:53:59.987975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd60037c-ed31-4863-9056-3181f7380993 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:53:59.988479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd60037c-ed31-4863-9056-3181f7380993 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:00.102748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a27db88b-9dda-4ce8-8059-59fb1df0d5a5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:00.111521 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a27db88b-9dda-4ce8-8059-59fb1df0d5a5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1521 microversion: 2.1 time: 0.196338 Mar 05 20:54:00.112548 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 840/1572] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:59 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:00.117384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3f4dd395-a085-44a9-bd56-4fe1c30957cc tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:00.117852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3f4dd395-a085-44a9-bd56-4fe1c30957cc tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:00.183031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3f4dd395-a085-44a9-bd56-4fe1c30957cc tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:00.191096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3f4dd395-a085-44a9-bd56-4fe1c30957cc tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:00.192651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3f4dd395-a085-44a9-bd56-4fe1c30957cc tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:00.193777 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3f4dd395-a085-44a9-bd56-4fe1c30957cc tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 200 len: 1259 microversion: 2.21 time: 0.080414 Mar 05 20:54:00.194731 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 841/1573] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:00 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:00.200159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-44c8ab65-43f1-4d25-9310-900b5fe1ee73 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2025511509"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:00.201265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-44c8ab65-43f1-4d25-9310-900b5fe1ee73 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:00.207390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44c8ab65-43f1-4d25-9310-900b5fe1ee73 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:00.207898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44c8ab65-43f1-4d25-9310-900b5fe1ee73 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:00.208692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44c8ab65-43f1-4d25-9310-900b5fe1ee73 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:00.209140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44c8ab65-43f1-4d25-9310-900b5fe1ee73 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:00.516002 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-44c8ab65-43f1-4d25-9310-900b5fe1ee73 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "POST /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f/action" status: 202 len: 0 microversion: 2.1 time: 0.320196 Mar 05 20:54:00.516985 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 842/1574] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:54:00 2022] POST /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 20:54:00.523179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8e7ed1a8-234c-4266-9383-67173c6751cc tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:00.524085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8e7ed1a8-234c-4266-9383-67173c6751cc tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:00.537796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e7ed1a8-234c-4266-9383-67173c6751cc tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:00.538414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e7ed1a8-234c-4266-9383-67173c6751cc tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:00.539348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e7ed1a8-234c-4266-9383-67173c6751cc tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:00.539934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e7ed1a8-234c-4266-9383-67173c6751cc tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:00.551022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd60037c-ed31-4863-9056-3181f7380993 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:00.564627 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd60037c-ed31-4863-9056-3181f7380993 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1315 microversion: 2.1 time: 0.594545 Mar 05 20:54:00.578314 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 733/1575] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:53:59 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:00.589660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a34648c1-25b7-4627-b210-1a87edd6eacc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:00.590617 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a34648c1-25b7-4627-b210-1a87edd6eacc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:00.605956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a34648c1-25b7-4627-b210-1a87edd6eacc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:00.613377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a34648c1-25b7-4627-b210-1a87edd6eacc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:00.615028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a34648c1-25b7-4627-b210-1a87edd6eacc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:00.615872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a34648c1-25b7-4627-b210-1a87edd6eacc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:00.834271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8e7ed1a8-234c-4266-9383-67173c6751cc tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:00.845288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8e7ed1a8-234c-4266-9383-67173c6751cc tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:00.848011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8e7ed1a8-234c-4266-9383-67173c6751cc tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:00.849691 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8e7ed1a8-234c-4266-9383-67173c6751cc tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.331291 Mar 05 20:54:00.850647 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 843/1576] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:00 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:00.856096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3113bb58-0c69-4488-a144-2a8bed21c1bb tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:00.856667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3113bb58-0c69-4488-a144-2a8bed21c1bb tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:00.862834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3113bb58-0c69-4488-a144-2a8bed21c1bb tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:00.863661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3113bb58-0c69-4488-a144-2a8bed21c1bb tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:00.864713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3113bb58-0c69-4488-a144-2a8bed21c1bb tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:00.865011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3113bb58-0c69-4488-a144-2a8bed21c1bb tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:01.040837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3113bb58-0c69-4488-a144-2a8bed21c1bb tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:01.050338 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3113bb58-0c69-4488-a144-2a8bed21c1bb tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.198983 Mar 05 20:54:01.051381 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 844/1577] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:00 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:01.058695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1b62edee-68ee-4ee6-aed9-f98cf0de14c3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1461371149"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:01.060231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1b62edee-68ee-4ee6-aed9-f98cf0de14c3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:01.067635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1b62edee-68ee-4ee6-aed9-f98cf0de14c3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:01.068382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1b62edee-68ee-4ee6-aed9-f98cf0de14c3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:01.069177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1b62edee-68ee-4ee6-aed9-f98cf0de14c3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:01.069726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1b62edee-68ee-4ee6-aed9-f98cf0de14c3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:01.099221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a34648c1-25b7-4627-b210-1a87edd6eacc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:01.101923 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-1b62edee-68ee-4ee6-aed9-f98cf0de14c3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] HTTP exception thrown: Cannot 'createImage' instance 566b4bf7-27e3-48e9-aa39-9d0f512a146f while it is in task_state image_snapshot Mar 05 20:54:01.102588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1b62edee-68ee-4ee6-aed9-f98cf0de14c3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 409 to user: Cannot 'createImage' instance 566b4bf7-27e3-48e9-aa39-9d0f512a146f while it is in task_state image_snapshot {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:01.104569 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1b62edee-68ee-4ee6-aed9-f98cf0de14c3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "POST /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f/action" status: 409 len: 159 microversion: 2.1 time: 0.051945 Mar 05 20:54:01.105989 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 845/1578] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:54:01 2022] POST /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f/action => generated 159 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:54:01.110507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-a52358d0-f94f-4c42-ad22-ead5a84ab7d9 req-dfa35d46-c281-4d31-a2b2-736022e210e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd", "name": "network-vif-unplugged", "status": "completed", "tag": "675294b3-97d2-451e-9c82-33eef5c81bf5"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:01.113307 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a34648c1-25b7-4627-b210-1a87edd6eacc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.533525 Mar 05 20:54:01.122062 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 734/1579] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:00 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:01.122062 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-097a43e7-ada0-4bac-b039-c0ec5894328d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:01.122349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a52358d0-f94f-4c42-ad22-ead5a84ab7d9 req-dfa35d46-c281-4d31-a2b2-736022e210e9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:01.122349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a52358d0-f94f-4c42-ad22-ead5a84ab7d9 req-dfa35d46-c281-4d31-a2b2-736022e210e9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:01.122505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-097a43e7-ada0-4bac-b039-c0ec5894328d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:01.128452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-097a43e7-ada0-4bac-b039-c0ec5894328d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:01.129228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-097a43e7-ada0-4bac-b039-c0ec5894328d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:01.129982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-097a43e7-ada0-4bac-b039-c0ec5894328d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:01.130463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-097a43e7-ada0-4bac-b039-c0ec5894328d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:01.132642 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-a52358d0-f94f-4c42-ad22-ead5a84ab7d9 req-dfa35d46-c281-4d31-a2b2-736022e210e9 service nova] Creating event network-vif-unplugged:675294b3-97d2-451e-9c82-33eef5c81bf5 for instance fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd on nch2-master-1 Mar 05 20:54:01.139112 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-a52358d0-f94f-4c42-ad22-ead5a84ab7d9 req-dfa35d46-c281-4d31-a2b2-736022e210e9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032336 Mar 05 20:54:01.140323 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 846/1580] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:01.145933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-58a750b3-84d1-4087-b46d-fb459041c46e tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:01.146722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-58a750b3-84d1-4087-b46d-fb459041c46e tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:01.155104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-58a750b3-84d1-4087-b46d-fb459041c46e tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:01.155701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-58a750b3-84d1-4087-b46d-fb459041c46e tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:01.156588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-58a750b3-84d1-4087-b46d-fb459041c46e tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:01.157099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-58a750b3-84d1-4087-b46d-fb459041c46e tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:01.413491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-58a750b3-84d1-4087-b46d-fb459041c46e tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:01.442025 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-58a750b3-84d1-4087-b46d-fb459041c46e tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1317 microversion: 2.1 time: 0.300369 Mar 05 20:54:01.444535 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 847/1581] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:01 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:01.457563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2360d74f-7993-4ea0-9aee-17e24e39fbbb tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '.version_select at 0x7fed5d12baf0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:01.570412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-097a43e7-ada0-4bac-b039-c0ec5894328d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:01.586782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-097a43e7-ada0-4bac-b039-c0ec5894328d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:01.592196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-097a43e7-ada0-4bac-b039-c0ec5894328d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:01.598084 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-097a43e7-ada0-4bac-b039-c0ec5894328d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1568 microversion: 2.25 time: 0.480210 Mar 05 20:54:01.610223 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 735/1582] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:01 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1568 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:01.615400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b4a10324-9657-4610-9764-2add10fdb1c5 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:01.616395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b4a10324-9657-4610-9764-2add10fdb1c5 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:01.623799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4a10324-9657-4610-9764-2add10fdb1c5 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:01.624484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4a10324-9657-4610-9764-2add10fdb1c5 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:01.625439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4a10324-9657-4610-9764-2add10fdb1c5 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:01.627176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4a10324-9657-4610-9764-2add10fdb1c5 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:01.709503 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2360d74f-7993-4ea0-9aee-17e24e39fbbb tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "DELETE /compute/v2.1/images/6bebdab8-7355-4d92-9ba0-37a0c733b311" status: 204 len: 0 microversion: 2.1 time: 0.263639 Mar 05 20:54:01.710664 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 848/1583] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:01 2022] DELETE /compute/v2.1/images/6bebdab8-7355-4d92-9ba0-37a0c733b311 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:54:01.716988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6c4a4ef9-816c-4574-aaaf-460d775ddd8d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:01.717888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6c4a4ef9-816c-4574-aaaf-460d775ddd8d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:01.727006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c4a4ef9-816c-4574-aaaf-460d775ddd8d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:01.728266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c4a4ef9-816c-4574-aaaf-460d775ddd8d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:01.730983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c4a4ef9-816c-4574-aaaf-460d775ddd8d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:01.731773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c4a4ef9-816c-4574-aaaf-460d775ddd8d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:01.787413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b4a10324-9657-4610-9764-2add10fdb1c5 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:01.796351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b4a10324-9657-4610-9764-2add10fdb1c5 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:01.797860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b4a10324-9657-4610-9764-2add10fdb1c5 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:01.798980 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b4a10324-9657-4610-9764-2add10fdb1c5 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 200 len: 1317 microversion: 2.21 time: 0.187490 Mar 05 20:54:01.799549 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 736/1584] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:01 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:01.805683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ce2cb254-425a-46ee-97b3-7e6691183248 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:01.807710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ce2cb254-425a-46ee-97b3-7e6691183248 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:01.814311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce2cb254-425a-46ee-97b3-7e6691183248 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:01.815023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce2cb254-425a-46ee-97b3-7e6691183248 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:01.816024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce2cb254-425a-46ee-97b3-7e6691183248 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:01.816632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce2cb254-425a-46ee-97b3-7e6691183248 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:02.017546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6c4a4ef9-816c-4574-aaaf-460d775ddd8d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:02.025619 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6c4a4ef9-816c-4574-aaaf-460d775ddd8d tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1315 microversion: 2.1 time: 0.313563 Mar 05 20:54:02.026660 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 849/1585] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:01 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:02.031611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b6715b05-f8ce-4eb6-88c6-7ed8356f389e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:02.032357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b6715b05-f8ce-4eb6-88c6-7ed8356f389e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:02.038653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6715b05-f8ce-4eb6-88c6-7ed8356f389e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:02.039118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6715b05-f8ce-4eb6-88c6-7ed8356f389e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:02.041241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6715b05-f8ce-4eb6-88c6-7ed8356f389e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:02.041241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6715b05-f8ce-4eb6-88c6-7ed8356f389e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:02.339835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b6715b05-f8ce-4eb6-88c6-7ed8356f389e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:02.350126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b6715b05-f8ce-4eb6-88c6-7ed8356f389e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:02.351660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b6715b05-f8ce-4eb6-88c6-7ed8356f389e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:02.353151 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b6715b05-f8ce-4eb6-88c6-7ed8356f389e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.325631 Mar 05 20:54:02.354100 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 850/1586] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:02 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:02.358968 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-869616c2-c01f-4eee-806f-749d96541250 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:02.359591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-869616c2-c01f-4eee-806f-749d96541250 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:02.366099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-869616c2-c01f-4eee-806f-749d96541250 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:02.366556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-869616c2-c01f-4eee-806f-749d96541250 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:02.367350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-869616c2-c01f-4eee-806f-749d96541250 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:02.367831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-869616c2-c01f-4eee-806f-749d96541250 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:02.488595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ce2cb254-425a-46ee-97b3-7e6691183248 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:02.496971 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ce2cb254-425a-46ee-97b3-7e6691183248 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1539 microversion: 2.1 time: 0.695961 Mar 05 20:54:02.497959 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 737/1587] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:01 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1539 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:02.504099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f1cb13d4-372c-4e2b-a039-fe19d205dfd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:02.505133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f1cb13d4-372c-4e2b-a039-fe19d205dfd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:02.515126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1cb13d4-372c-4e2b-a039-fe19d205dfd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:02.515807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1cb13d4-372c-4e2b-a039-fe19d205dfd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:02.516841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1cb13d4-372c-4e2b-a039-fe19d205dfd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:02.517573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1cb13d4-372c-4e2b-a039-fe19d205dfd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:02.596793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-869616c2-c01f-4eee-806f-749d96541250 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:02.605209 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-869616c2-c01f-4eee-806f-749d96541250 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.250215 Mar 05 20:54:02.605907 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 851/1588] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:02 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:02.611522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8cb957ff-8e3b-47b6-9803-0798d242e83c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:02.612586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8cb957ff-8e3b-47b6-9803-0798d242e83c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:02.620349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cb957ff-8e3b-47b6-9803-0798d242e83c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:02.620926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cb957ff-8e3b-47b6-9803-0798d242e83c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:02.621777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cb957ff-8e3b-47b6-9803-0798d242e83c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:02.622334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cb957ff-8e3b-47b6-9803-0798d242e83c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:02.869975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8cb957ff-8e3b-47b6-9803-0798d242e83c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:02.881721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f1cb13d4-372c-4e2b-a039-fe19d205dfd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:02.899571 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8cb957ff-8e3b-47b6-9803-0798d242e83c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1317 microversion: 2.1 time: 0.290667 Mar 05 20:54:02.900096 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f1cb13d4-372c-4e2b-a039-fe19d205dfd7 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.399831 Mar 05 20:54:02.902179 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 852/1589] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:02 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:02.902751 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 738/1590] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:02 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:02.934066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ea80175e-ea13-44f5-b73f-0267f27ff4c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:02.934701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ec4e54d3-9ea3-42e9-984f-7818953fa8d9 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:02.935579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ec4e54d3-9ea3-42e9-984f-7818953fa8d9 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:02.936241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ea80175e-ea13-44f5-b73f-0267f27ff4c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:02.947498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ea80175e-ea13-44f5-b73f-0267f27ff4c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:02.947753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec4e54d3-9ea3-42e9-984f-7818953fa8d9 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:02.948076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec4e54d3-9ea3-42e9-984f-7818953fa8d9 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:02.948882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec4e54d3-9ea3-42e9-984f-7818953fa8d9 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:02.949324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec4e54d3-9ea3-42e9-984f-7818953fa8d9 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:02.949816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ea80175e-ea13-44f5-b73f-0267f27ff4c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:02.951131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ea80175e-ea13-44f5-b73f-0267f27ff4c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:02.951832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ea80175e-ea13-44f5-b73f-0267f27ff4c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:03.266230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ec4e54d3-9ea3-42e9-984f-7818953fa8d9 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:03.278858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ec4e54d3-9ea3-42e9-984f-7818953fa8d9 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:03.281351 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ec4e54d3-9ea3-42e9-984f-7818953fa8d9 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:03.283205 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ec4e54d3-9ea3-42e9-984f-7818953fa8d9 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 200 len: 1359 microversion: 2.21 time: 0.373178 Mar 05 20:54:03.294398 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 853/1591] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:02 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 1359 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:03.294398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1099034f-d942-4b4f-9436-e1b36441b724 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:03.294398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1099034f-d942-4b4f-9436-e1b36441b724 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:03.299186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1099034f-d942-4b4f-9436-e1b36441b724 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:03.299792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1099034f-d942-4b4f-9436-e1b36441b724 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:03.301074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1099034f-d942-4b4f-9436-e1b36441b724 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:03.301978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1099034f-d942-4b4f-9436-e1b36441b724 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:03.359068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ea80175e-ea13-44f5-b73f-0267f27ff4c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:03.373065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ea80175e-ea13-44f5-b73f-0267f27ff4c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:03.375073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ea80175e-ea13-44f5-b73f-0267f27ff4c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:03.376812 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ea80175e-ea13-44f5-b73f-0267f27ff4c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1568 microversion: 2.25 time: 0.469108 Mar 05 20:54:03.389250 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 739/1592] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:02 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1568 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:03.394718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d7617b8a-55a4-4d7c-8ba9-3fc78a741a83 req-0caae0e9-608f-4234-bb5a-7c0bae78ed43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd", "tag": "675294b3-97d2-451e-9c82-33eef5c81bf5"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:03.407811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d7617b8a-55a4-4d7c-8ba9-3fc78a741a83 req-0caae0e9-608f-4234-bb5a-7c0bae78ed43 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:03.408294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d7617b8a-55a4-4d7c-8ba9-3fc78a741a83 req-0caae0e9-608f-4234-bb5a-7c0bae78ed43 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:03.433121 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d7617b8a-55a4-4d7c-8ba9-3fc78a741a83 req-0caae0e9-608f-4234-bb5a-7c0bae78ed43 service nova] Creating event network-changed:675294b3-97d2-451e-9c82-33eef5c81bf5 for instance fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd on nch2-master-1 Mar 05 20:54:03.438533 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d7617b8a-55a4-4d7c-8ba9-3fc78a741a83 req-0caae0e9-608f-4234-bb5a-7c0bae78ed43 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047752 Mar 05 20:54:03.439446 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 740/1593] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:03.519994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-be2dc118-4c17-49d7-81b1-0cefb6d5ef84 req-9a45e64e-c408-428c-82c3-2695644c841f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c9bb643-2491-47d8-9758-76f13e927450", "name": "network-vif-plugged", "status": "completed", "tag": "39103012-a3fb-406c-a3d5-628b64bf136f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:03.531205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-be2dc118-4c17-49d7-81b1-0cefb6d5ef84 req-9a45e64e-c408-428c-82c3-2695644c841f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:03.531914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-be2dc118-4c17-49d7-81b1-0cefb6d5ef84 req-9a45e64e-c408-428c-82c3-2695644c841f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:03.546374 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-be2dc118-4c17-49d7-81b1-0cefb6d5ef84 req-9a45e64e-c408-428c-82c3-2695644c841f service nova] Creating event network-vif-plugged:39103012-a3fb-406c-a3d5-628b64bf136f for instance 1c9bb643-2491-47d8-9758-76f13e927450 on nch2-master-1 Mar 05 20:54:03.560821 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-be2dc118-4c17-49d7-81b1-0cefb6d5ef84 req-9a45e64e-c408-428c-82c3-2695644c841f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119780 Mar 05 20:54:03.569772 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 741/1594] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:03.582242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c894e029-1bf3-44a8-8194-245cc0b5b064 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:03.584394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c894e029-1bf3-44a8-8194-245cc0b5b064 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:03.599122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c894e029-1bf3-44a8-8194-245cc0b5b064 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:03.600142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c894e029-1bf3-44a8-8194-245cc0b5b064 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:03.601622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c894e029-1bf3-44a8-8194-245cc0b5b064 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:03.602346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c894e029-1bf3-44a8-8194-245cc0b5b064 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:03.984279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1099034f-d942-4b4f-9436-e1b36441b724 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:03.999722 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1099034f-d942-4b4f-9436-e1b36441b724 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1315 microversion: 2.1 time: 0.713912 Mar 05 20:54:04.000855 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 854/1595] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:03 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:04.008749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1ef99616-59e1-4a2e-bfa6-0e2c71bb8866 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:04.009891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1ef99616-59e1-4a2e-bfa6-0e2c71bb8866 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:04.020147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ef99616-59e1-4a2e-bfa6-0e2c71bb8866 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.020793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ef99616-59e1-4a2e-bfa6-0e2c71bb8866 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.022063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ef99616-59e1-4a2e-bfa6-0e2c71bb8866 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.023076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ef99616-59e1-4a2e-bfa6-0e2c71bb8866 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.090270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c894e029-1bf3-44a8-8194-245cc0b5b064 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:04.099404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c894e029-1bf3-44a8-8194-245cc0b5b064 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:04.100943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c894e029-1bf3-44a8-8194-245cc0b5b064 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:04.103093 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c894e029-1bf3-44a8-8194-245cc0b5b064 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.530149 Mar 05 20:54:04.104387 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 742/1596] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:03 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:04.109612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5a717fda-70c0-4289-868d-3b3378abd423 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:04.110510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5a717fda-70c0-4289-868d-3b3378abd423 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:04.118241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a717fda-70c0-4289-868d-3b3378abd423 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.118979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a717fda-70c0-4289-868d-3b3378abd423 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.120288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a717fda-70c0-4289-868d-3b3378abd423 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.120888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a717fda-70c0-4289-868d-3b3378abd423 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.195818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1ef99616-59e1-4a2e-bfa6-0e2c71bb8866 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:04.205385 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1ef99616-59e1-4a2e-bfa6-0e2c71bb8866 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1521 microversion: 2.1 time: 0.202773 Mar 05 20:54:04.206039 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 855/1597] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:04 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:04.212117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0501523c-7025-409a-813c-ca9ae674e222 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:04.213650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0501523c-7025-409a-813c-ca9ae674e222 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:04.222130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0501523c-7025-409a-813c-ca9ae674e222 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.222740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0501523c-7025-409a-813c-ca9ae674e222 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.223972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0501523c-7025-409a-813c-ca9ae674e222 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.224755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0501523c-7025-409a-813c-ca9ae674e222 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.282258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5a717fda-70c0-4289-868d-3b3378abd423 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:04.289903 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5a717fda-70c0-4289-868d-3b3378abd423 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.183815 Mar 05 20:54:04.290742 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 743/1598] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:04 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:04.296873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd7712bc-6803-43d7-bdc5-d8e8c465e5a3 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:04.297338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd7712bc-6803-43d7-bdc5-d8e8c465e5a3 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:04.305098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd7712bc-6803-43d7-bdc5-d8e8c465e5a3 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.305702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd7712bc-6803-43d7-bdc5-d8e8c465e5a3 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.306722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd7712bc-6803-43d7-bdc5-d8e8c465e5a3 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.307213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd7712bc-6803-43d7-bdc5-d8e8c465e5a3 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.387173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0501523c-7025-409a-813c-ca9ae674e222 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:04.396811 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0501523c-7025-409a-813c-ca9ae674e222 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.189503 Mar 05 20:54:04.397587 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 856/1599] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:04 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:04.466894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-a98a5b7d-6c5e-4ffb-8788-cdbce64e96d3 req-ed705da7-5599-4192-ad8e-9440f5f7234f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fed7313-ee78-4aa8-8df2-4ff9a776115f", "tag": "2e2be274-47ed-4b4e-a0f7-f1971d3394d2"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:04.475892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a98a5b7d-6c5e-4ffb-8788-cdbce64e96d3 req-ed705da7-5599-4192-ad8e-9440f5f7234f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.476354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a98a5b7d-6c5e-4ffb-8788-cdbce64e96d3 req-ed705da7-5599-4192-ad8e-9440f5f7234f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.488428 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-a98a5b7d-6c5e-4ffb-8788-cdbce64e96d3 req-ed705da7-5599-4192-ad8e-9440f5f7234f service nova] Creating event network-changed:2e2be274-47ed-4b4e-a0f7-f1971d3394d2 for instance 8fed7313-ee78-4aa8-8df2-4ff9a776115f on nch1-master-1 Mar 05 20:54:04.493328 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-a98a5b7d-6c5e-4ffb-8788-cdbce64e96d3 req-ed705da7-5599-4192-ad8e-9440f5f7234f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094599 Mar 05 20:54:04.494051 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 857/1600] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:04.499614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5f1999c1-3732-408c-8e7c-28e919f06dfe tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:04.500662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5f1999c1-3732-408c-8e7c-28e919f06dfe tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:04.506951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f1999c1-3732-408c-8e7c-28e919f06dfe tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.507416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f1999c1-3732-408c-8e7c-28e919f06dfe tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.508261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f1999c1-3732-408c-8e7c-28e919f06dfe tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.508713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f1999c1-3732-408c-8e7c-28e919f06dfe tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.539919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5f1999c1-3732-408c-8e7c-28e919f06dfe tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:54:04.647023 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5f1999c1-3732-408c-8e7c-28e919f06dfe tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "DELETE /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 204 len: 0 microversion: 2.1 time: 0.151466 Mar 05 20:54:04.648631 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 858/1601] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:54:04 2022] DELETE /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:54:04.654984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a85692e0-e225-417d-98c2-a440f47f114f tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:04.656129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a85692e0-e225-417d-98c2-a440f47f114f tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:04.662969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a85692e0-e225-417d-98c2-a440f47f114f tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.663481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a85692e0-e225-417d-98c2-a440f47f114f tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.664480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a85692e0-e225-417d-98c2-a440f47f114f tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.665005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a85692e0-e225-417d-98c2-a440f47f114f tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.747367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd7712bc-6803-43d7-bdc5-d8e8c465e5a3 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:04.765379 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd7712bc-6803-43d7-bdc5-d8e8c465e5a3 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1317 microversion: 2.1 time: 0.473712 Mar 05 20:54:04.766195 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 744/1602] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:04 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:04.770883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9cb0b6af-943a-41dd-ab9d-0f0575dad1c7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:04.771740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9cb0b6af-943a-41dd-ab9d-0f0575dad1c7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:04.778532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9cb0b6af-943a-41dd-ab9d-0f0575dad1c7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.780371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9cb0b6af-943a-41dd-ab9d-0f0575dad1c7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.782596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9cb0b6af-943a-41dd-ab9d-0f0575dad1c7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.785848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9cb0b6af-943a-41dd-ab9d-0f0575dad1c7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.823264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a85692e0-e225-417d-98c2-a440f47f114f tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:04.833298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a85692e0-e225-417d-98c2-a440f47f114f tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:04.834864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a85692e0-e225-417d-98c2-a440f47f114f tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:04.836263 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a85692e0-e225-417d-98c2-a440f47f114f tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 200 len: 1359 microversion: 2.21 time: 0.186051 Mar 05 20:54:04.837008 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 859/1603] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:04 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:04.842650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-61f8f54f-ba29-468b-9e4f-f0eaccffa4ca tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:04.843744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-61f8f54f-ba29-468b-9e4f-f0eaccffa4ca tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:04.853221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61f8f54f-ba29-468b-9e4f-f0eaccffa4ca tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.853691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61f8f54f-ba29-468b-9e4f-f0eaccffa4ca tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:04.854493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61f8f54f-ba29-468b-9e4f-f0eaccffa4ca tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:04.854939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61f8f54f-ba29-468b-9e4f-f0eaccffa4ca tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.100761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9cb0b6af-943a-41dd-ab9d-0f0575dad1c7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:05.111871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9cb0b6af-943a-41dd-ab9d-0f0575dad1c7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:05.113774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9cb0b6af-943a-41dd-ab9d-0f0575dad1c7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:05.115077 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9cb0b6af-943a-41dd-ab9d-0f0575dad1c7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1568 microversion: 2.25 time: 0.347955 Mar 05 20:54:05.126100 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 745/1604] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:04 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1568 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:05.126100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b4be05e5-177c-4d47-82bb-9cb876206ef9 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:05.126100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b4be05e5-177c-4d47-82bb-9cb876206ef9 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:05.128296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4be05e5-177c-4d47-82bb-9cb876206ef9 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.128752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4be05e5-177c-4d47-82bb-9cb876206ef9 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.129534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4be05e5-177c-4d47-82bb-9cb876206ef9 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.129972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4be05e5-177c-4d47-82bb-9cb876206ef9 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.177187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-61f8f54f-ba29-468b-9e4f-f0eaccffa4ca tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:05.185811 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-61f8f54f-ba29-468b-9e4f-f0eaccffa4ca tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1527 microversion: 2.1 time: 0.346757 Mar 05 20:54:05.186403 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 860/1605] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:04 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1527 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:05.191564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-51d7d949-4c71-4c2a-b2d4-4b6e05cf5122 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:05.192216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-51d7d949-4c71-4c2a-b2d4-4b6e05cf5122 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:05.200462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51d7d949-4c71-4c2a-b2d4-4b6e05cf5122 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.201063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51d7d949-4c71-4c2a-b2d4-4b6e05cf5122 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.201852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51d7d949-4c71-4c2a-b2d4-4b6e05cf5122 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.202291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51d7d949-4c71-4c2a-b2d4-4b6e05cf5122 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.355208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b4be05e5-177c-4d47-82bb-9cb876206ef9 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:05.363625 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b4be05e5-177c-4d47-82bb-9cb876206ef9 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1315 microversion: 2.1 time: 0.246482 Mar 05 20:54:05.364337 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 746/1606] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:05 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:05.376505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-14c5eeef-5058-4c4b-82c4-ddc698be11f0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:05.377298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-14c5eeef-5058-4c4b-82c4-ddc698be11f0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:05.385592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14c5eeef-5058-4c4b-82c4-ddc698be11f0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.386141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14c5eeef-5058-4c4b-82c4-ddc698be11f0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.387265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14c5eeef-5058-4c4b-82c4-ddc698be11f0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.387991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14c5eeef-5058-4c4b-82c4-ddc698be11f0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.473770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-51d7d949-4c71-4c2a-b2d4-4b6e05cf5122 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:05.484017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-51d7d949-4c71-4c2a-b2d4-4b6e05cf5122 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:05.485639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-51d7d949-4c71-4c2a-b2d4-4b6e05cf5122 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:05.486876 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-51d7d949-4c71-4c2a-b2d4-4b6e05cf5122 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.299556 Mar 05 20:54:05.487734 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 861/1607] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:05 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:05.492041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-56dea287-6b08-4287-a823-2b043c865486 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:05.492726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-56dea287-6b08-4287-a823-2b043c865486 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:05.499425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56dea287-6b08-4287-a823-2b043c865486 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.499922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56dea287-6b08-4287-a823-2b043c865486 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.500701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56dea287-6b08-4287-a823-2b043c865486 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.501138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56dea287-6b08-4287-a823-2b043c865486 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.545771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-14c5eeef-5058-4c4b-82c4-ddc698be11f0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:05.553251 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-14c5eeef-5058-4c4b-82c4-ddc698be11f0 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.188065 Mar 05 20:54:05.553830 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 747/1608] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:05 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:05.559730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-086016c5-52ed-40b9-92c2-258a103d03c3 req-8c42a218-2dd9-4b3b-824d-0836ae4cf6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba11c91-fc0e-41d6-8efd-fddeb4132869", "tag": "6ab2be74-857e-4e38-ad99-97dbaa1f820d"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:05.567523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-086016c5-52ed-40b9-92c2-258a103d03c3 req-8c42a218-2dd9-4b3b-824d-0836ae4cf6b3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.568003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-086016c5-52ed-40b9-92c2-258a103d03c3 req-8c42a218-2dd9-4b3b-824d-0836ae4cf6b3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.580139 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-086016c5-52ed-40b9-92c2-258a103d03c3 req-8c42a218-2dd9-4b3b-824d-0836ae4cf6b3 service nova] Creating event network-changed:6ab2be74-857e-4e38-ad99-97dbaa1f820d for instance aba11c91-fc0e-41d6-8efd-fddeb4132869 on nch2-master-1 Mar 05 20:54:05.585878 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-086016c5-52ed-40b9-92c2-258a103d03c3 req-8c42a218-2dd9-4b3b-824d-0836ae4cf6b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030891 Mar 05 20:54:05.586581 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 748/1609] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:05.596616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-4aad71d6-715e-45c1-9526-3f01f790129f req-eee65bf5-05ff-4451-8a18-f8809402c441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566b4bf7-27e3-48e9-aa39-9d0f512a146f", "name": "network-vif-plugged", "status": "completed", "tag": "849d5225-97e8-496b-a8f3-1b7a3df6f4d7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:05.606163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4aad71d6-715e-45c1-9526-3f01f790129f req-eee65bf5-05ff-4451-8a18-f8809402c441 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.606603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4aad71d6-715e-45c1-9526-3f01f790129f req-eee65bf5-05ff-4451-8a18-f8809402c441 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.618940 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-4aad71d6-715e-45c1-9526-3f01f790129f req-eee65bf5-05ff-4451-8a18-f8809402c441 service nova] Creating event network-vif-plugged:849d5225-97e8-496b-a8f3-1b7a3df6f4d7 for instance 566b4bf7-27e3-48e9-aa39-9d0f512a146f on nch2-master-1 Mar 05 20:54:05.624192 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-4aad71d6-715e-45c1-9526-3f01f790129f req-eee65bf5-05ff-4451-8a18-f8809402c441 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031509 Mar 05 20:54:05.627775 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 749/1610] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:54:05.759858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-56dea287-6b08-4287-a823-2b043c865486 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:05.767353 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-56dea287-6b08-4287-a823-2b043c865486 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.278756 Mar 05 20:54:05.768204 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 862/1611] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:05 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:05.783686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-76155373-1cd3-4bdd-be8d-20c475144d40 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:05.784495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-76155373-1cd3-4bdd-be8d-20c475144d40 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:05.791776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76155373-1cd3-4bdd-be8d-20c475144d40 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.792332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76155373-1cd3-4bdd-be8d-20c475144d40 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.793197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76155373-1cd3-4bdd-be8d-20c475144d40 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.793861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76155373-1cd3-4bdd-be8d-20c475144d40 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.858807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b78bba9b-3a47-42b2-a756-15d385f18335 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:05.859431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b78bba9b-3a47-42b2-a756-15d385f18335 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:05.866053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b78bba9b-3a47-42b2-a756-15d385f18335 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.866542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b78bba9b-3a47-42b2-a756-15d385f18335 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:05.867325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b78bba9b-3a47-42b2-a756-15d385f18335 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:05.867923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b78bba9b-3a47-42b2-a756-15d385f18335 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.011864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b78bba9b-3a47-42b2-a756-15d385f18335 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:06.019801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b78bba9b-3a47-42b2-a756-15d385f18335 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:06.021320 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b78bba9b-3a47-42b2-a756-15d385f18335 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:06.022446 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b78bba9b-3a47-42b2-a756-15d385f18335 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 200 len: 1359 microversion: 2.21 time: 0.167880 Mar 05 20:54:06.023019 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 863/1612] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:05 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:54:06.042688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-76155373-1cd3-4bdd-be8d-20c475144d40 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:06.050104 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-76155373-1cd3-4bdd-be8d-20c475144d40 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1317 microversion: 2.1 time: 0.271096 Mar 05 20:54:06.050672 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 750/1613] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:05 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:06.133090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-69e0ca2c-aa58-4240-ad7a-4c6abfe0e674 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:06.133733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-69e0ca2c-aa58-4240-ad7a-4c6abfe0e674 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:06.141032 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69e0ca2c-aa58-4240-ad7a-4c6abfe0e674 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.141484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69e0ca2c-aa58-4240-ad7a-4c6abfe0e674 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.142256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69e0ca2c-aa58-4240-ad7a-4c6abfe0e674 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.142693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69e0ca2c-aa58-4240-ad7a-4c6abfe0e674 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.203278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-87cd068b-f15c-4895-930c-0514ad015834 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:06.204394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-87cd068b-f15c-4895-930c-0514ad015834 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:06.210604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-87cd068b-f15c-4895-930c-0514ad015834 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.211034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-87cd068b-f15c-4895-930c-0514ad015834 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.212013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-87cd068b-f15c-4895-930c-0514ad015834 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.212482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-87cd068b-f15c-4895-930c-0514ad015834 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.285614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-69e0ca2c-aa58-4240-ad7a-4c6abfe0e674 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:06.294279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-69e0ca2c-aa58-4240-ad7a-4c6abfe0e674 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:06.295817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-69e0ca2c-aa58-4240-ad7a-4c6abfe0e674 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:06.297027 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-69e0ca2c-aa58-4240-ad7a-4c6abfe0e674 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1568 microversion: 2.25 time: 0.167947 Mar 05 20:54:06.297597 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 864/1614] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:06 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:06.352579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-87cd068b-f15c-4895-930c-0514ad015834 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:06.360230 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-87cd068b-f15c-4895-930c-0514ad015834 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1527 microversion: 2.1 time: 0.160876 Mar 05 20:54:06.360804 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 751/1615] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:06 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1527 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:54:06.380780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d3fb7f03-1976-4416-a903-383e68bbd41e tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:06.381389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d3fb7f03-1976-4416-a903-383e68bbd41e tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:06.387838 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3fb7f03-1976-4416-a903-383e68bbd41e tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.388294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3fb7f03-1976-4416-a903-383e68bbd41e tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.389061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3fb7f03-1976-4416-a903-383e68bbd41e tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.389534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3fb7f03-1976-4416-a903-383e68bbd41e tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.506043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ef07bce9-f14a-4dab-a2ac-c341a4382d70 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:06.506654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ef07bce9-f14a-4dab-a2ac-c341a4382d70 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:06.512922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef07bce9-f14a-4dab-a2ac-c341a4382d70 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.513437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef07bce9-f14a-4dab-a2ac-c341a4382d70 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.514589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef07bce9-f14a-4dab-a2ac-c341a4382d70 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.514716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef07bce9-f14a-4dab-a2ac-c341a4382d70 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.523119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d3fb7f03-1976-4416-a903-383e68bbd41e tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:06.530843 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d3fb7f03-1976-4416-a903-383e68bbd41e tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1504 microversion: 2.1 time: 0.153836 Mar 05 20:54:06.531421 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 865/1616] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:06 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:54:06.547324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af6f4e36-6f1c-4023-a8dc-c57cdb5fcf85 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-100849016"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:06.547831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-af6f4e36-6f1c-4023-a8dc-c57cdb5fcf85 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:06.553684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af6f4e36-6f1c-4023-a8dc-c57cdb5fcf85 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.554139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af6f4e36-6f1c-4023-a8dc-c57cdb5fcf85 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.554909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af6f4e36-6f1c-4023-a8dc-c57cdb5fcf85 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.555353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af6f4e36-6f1c-4023-a8dc-c57cdb5fcf85 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.695185 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.network.security_group_api [None req-af6f4e36-6f1c-4023-a8dc-c57cdb5fcf85 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Adding security group ce519741-0808-43df-9dc7-121b57f65881 to port 39103012-a3fb-406c-a3d5-628b64bf136f Mar 05 20:54:06.703856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ef07bce9-f14a-4dab-a2ac-c341a4382d70 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:06.714382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ef07bce9-f14a-4dab-a2ac-c341a4382d70 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:06.716063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ef07bce9-f14a-4dab-a2ac-c341a4382d70 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:06.717342 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ef07bce9-f14a-4dab-a2ac-c341a4382d70 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.215150 Mar 05 20:54:06.718105 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 752/1617] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:06 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:54:06.722519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b6dfdb40-fca8-4bc1-8831-84513090d546 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:06.723135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b6dfdb40-fca8-4bc1-8831-84513090d546 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:06.729708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6dfdb40-fca8-4bc1-8831-84513090d546 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.730166 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6dfdb40-fca8-4bc1-8831-84513090d546 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.730954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6dfdb40-fca8-4bc1-8831-84513090d546 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.731399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6dfdb40-fca8-4bc1-8831-84513090d546 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.896551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b6dfdb40-fca8-4bc1-8831-84513090d546 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:06.906061 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b6dfdb40-fca8-4bc1-8831-84513090d546 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.187021 Mar 05 20:54:06.906662 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 753/1618] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:06 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:06.916423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-11f8bc47-77c4-4a52-b1d2-77c5aecd9f70 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:06.917042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-11f8bc47-77c4-4a52-b1d2-77c5aecd9f70 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:06.923468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11f8bc47-77c4-4a52-b1d2-77c5aecd9f70 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.923958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11f8bc47-77c4-4a52-b1d2-77c5aecd9f70 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:06.924763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11f8bc47-77c4-4a52-b1d2-77c5aecd9f70 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:06.925201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11f8bc47-77c4-4a52-b1d2-77c5aecd9f70 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:07.085429 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-af6f4e36-6f1c-4023-a8dc-c57cdb5fcf85 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450/action" status: 202 len: 0 microversion: 2.1 time: 0.541552 Mar 05 20:54:07.087173 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 866/1619] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:54:06 2022] POST /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 20:54:07.094831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4f7c5d77-5966-4882-96ed-fc7dd87b9286 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:07.096348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4f7c5d77-5966-4882-96ed-fc7dd87b9286 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:07.104586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f7c5d77-5966-4882-96ed-fc7dd87b9286 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:07.106467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f7c5d77-5966-4882-96ed-fc7dd87b9286 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:07.107859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f7c5d77-5966-4882-96ed-fc7dd87b9286 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:07.109100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f7c5d77-5966-4882-96ed-fc7dd87b9286 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:07.269217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4f7c5d77-5966-4882-96ed-fc7dd87b9286 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:07.281176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4f7c5d77-5966-4882-96ed-fc7dd87b9286 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:07.282943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4f7c5d77-5966-4882-96ed-fc7dd87b9286 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:07.284620 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4f7c5d77-5966-4882-96ed-fc7dd87b9286 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 200 len: 1359 microversion: 2.21 time: 0.195330 Mar 05 20:54:07.293970 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 867/1620] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:07 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:07.293970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a864d706-aff1-43c5-aac4-f108ff61b84d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:07.293970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a864d706-aff1-43c5-aac4-f108ff61b84d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:07.299143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a864d706-aff1-43c5-aac4-f108ff61b84d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:07.299610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a864d706-aff1-43c5-aac4-f108ff61b84d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:07.300467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a864d706-aff1-43c5-aac4-f108ff61b84d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:07.300917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a864d706-aff1-43c5-aac4-f108ff61b84d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:07.455633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a864d706-aff1-43c5-aac4-f108ff61b84d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:07.463920 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a864d706-aff1-43c5-aac4-f108ff61b84d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1317 microversion: 2.1 time: 0.177254 Mar 05 20:54:07.464814 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 868/1621] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:07 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:07.480253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6c8775bf-3462-49ee-b714-79b11fccc18c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c6cf0d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:07.545650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-11f8bc47-77c4-4a52-b1d2-77c5aecd9f70 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:07.555958 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-11f8bc47-77c4-4a52-b1d2-77c5aecd9f70 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.643901 Mar 05 20:54:07.570519 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 754/1622] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:06 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:07.578333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-4b0dcf79-c4d9-49a0-823c-4091b36e611f req-7984def6-ef5f-4a97-8029-fa158815b56d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c9bb643-2491-47d8-9758-76f13e927450", "tag": "39103012-a3fb-406c-a3d5-628b64bf136f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:07.594793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4b0dcf79-c4d9-49a0-823c-4091b36e611f req-7984def6-ef5f-4a97-8029-fa158815b56d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:07.595794 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4b0dcf79-c4d9-49a0-823c-4091b36e611f req-7984def6-ef5f-4a97-8029-fa158815b56d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:07.603899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG neutronclient.v2_0.client [None req-6c8775bf-3462-49ee-b714-79b11fccc18c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ce519741-0808-43df-9dc7-121b57f65881 in use.", "detail": ""}} {{(pid=141479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:54:07.603899 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-6c8775bf-3462-49ee-b714-79b11fccc18c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Security Group ce519741-0808-43df-9dc7-121b57f65881 in use. Mar 05 20:54:07.603899 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-315f406e-b962-4481-bb32-f9bfae249c68'] Mar 05 20:54:07.603899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6c8775bf-3462-49ee-b714-79b11fccc18c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 400 to user: Security Group ce519741-0808-43df-9dc7-121b57f65881 in use. Mar 05 20:54:07.603899 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-315f406e-b962-4481-bb32-f9bfae249c68'] {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:07.605661 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6c8775bf-3462-49ee-b714-79b11fccc18c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/ce519741-0808-43df-9dc7-121b57f65881" status: 400 len: 185 microversion: 2.1 time: 0.137154 Mar 05 20:54:07.606612 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 869/1623] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:54:07 2022] DELETE /compute/v2.1/os-security-groups/ce519741-0808-43df-9dc7-121b57f65881 => generated 185 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:54:07.615924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2bff48a6-057a-460e-963d-0d7da84c9c24 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:07.616220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2bff48a6-057a-460e-963d-0d7da84c9c24 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:07.625998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2bff48a6-057a-460e-963d-0d7da84c9c24 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:07.626468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2bff48a6-057a-460e-963d-0d7da84c9c24 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:07.627271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2bff48a6-057a-460e-963d-0d7da84c9c24 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:07.627777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2bff48a6-057a-460e-963d-0d7da84c9c24 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:07.632927 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-4b0dcf79-c4d9-49a0-823c-4091b36e611f req-7984def6-ef5f-4a97-8029-fa158815b56d service nova] Creating event network-changed:39103012-a3fb-406c-a3d5-628b64bf136f for instance 1c9bb643-2491-47d8-9758-76f13e927450 on nch2-master-1 Mar 05 20:54:07.641730 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-4b0dcf79-c4d9-49a0-823c-4091b36e611f req-7984def6-ef5f-4a97-8029-fa158815b56d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069317 Mar 05 20:54:07.643764 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 755/1624] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:07.650589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f595b593-0d02-480a-b870-58b78c45bd3c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:07.651597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f595b593-0d02-480a-b870-58b78c45bd3c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:07.658822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f595b593-0d02-480a-b870-58b78c45bd3c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:07.659290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f595b593-0d02-480a-b870-58b78c45bd3c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:07.660544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f595b593-0d02-480a-b870-58b78c45bd3c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:07.661231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f595b593-0d02-480a-b870-58b78c45bd3c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:07.877487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2bff48a6-057a-460e-963d-0d7da84c9c24 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:07.886249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2bff48a6-057a-460e-963d-0d7da84c9c24 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:07.887824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2bff48a6-057a-460e-963d-0d7da84c9c24 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:07.889035 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2bff48a6-057a-460e-963d-0d7da84c9c24 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1568 microversion: 2.25 time: 0.281506 Mar 05 20:54:07.889699 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 870/1625] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:07 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1568 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:07.896106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0da87cce-df3b-43aa-b81c-e795673fdd1c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:07.897347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0da87cce-df3b-43aa-b81c-e795673fdd1c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:07.904730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0da87cce-df3b-43aa-b81c-e795673fdd1c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:07.905199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0da87cce-df3b-43aa-b81c-e795673fdd1c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:07.905995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0da87cce-df3b-43aa-b81c-e795673fdd1c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:07.906447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0da87cce-df3b-43aa-b81c-e795673fdd1c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.003597 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0da87cce-df3b-43aa-b81c-e795673fdd1c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450/action" status: 202 len: 0 microversion: 2.1 time: 0.112322 Mar 05 20:54:08.007180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f595b593-0d02-480a-b870-58b78c45bd3c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:08.012143 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 871/1626] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:54:07 2022] POST /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:54:08.021445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-261cfa16-bb3c-44c7-8146-720045ddea1e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:08.024482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-261cfa16-bb3c-44c7-8146-720045ddea1e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:08.038764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-261cfa16-bb3c-44c7-8146-720045ddea1e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.039795 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f595b593-0d02-480a-b870-58b78c45bd3c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 200 len: 1527 microversion: 2.1 time: 0.392581 Mar 05 20:54:08.051536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-261cfa16-bb3c-44c7-8146-720045ddea1e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.055764 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 756/1627] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:07 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 1527 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:08.057296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-261cfa16-bb3c-44c7-8146-720045ddea1e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.057615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-261cfa16-bb3c-44c7-8146-720045ddea1e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.063618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7833926f-7601-4095-96f0-19dd051843ed tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:08.063618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7833926f-7601-4095-96f0-19dd051843ed tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:08.070825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7833926f-7601-4095-96f0-19dd051843ed tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.071395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7833926f-7601-4095-96f0-19dd051843ed tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.074705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7833926f-7601-4095-96f0-19dd051843ed tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.075586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7833926f-7601-4095-96f0-19dd051843ed tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.404871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-261cfa16-bb3c-44c7-8146-720045ddea1e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:08.411812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7833926f-7601-4095-96f0-19dd051843ed tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:08.417460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-261cfa16-bb3c-44c7-8146-720045ddea1e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:08.418992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-261cfa16-bb3c-44c7-8146-720045ddea1e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:08.420179 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-261cfa16-bb3c-44c7-8146-720045ddea1e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.410790 Mar 05 20:54:08.421070 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 872/1628] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:08 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:08.434924 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7833926f-7601-4095-96f0-19dd051843ed tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.377401 Mar 05 20:54:08.444595 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 757/1629] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:08 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:08.444811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-de9bacee-9aab-4e14-be1a-a54213a7b464 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:08.444811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-de9bacee-9aab-4e14-be1a-a54213a7b464 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:08.445773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7e4b8cba-4c99-44c2-b9b1-73a5083183a2 req-0fd03801-65f1-429d-880e-a065420e4340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566b4bf7-27e3-48e9-aa39-9d0f512a146f", "name": "network-vif-deleted", "tag": "849d5225-97e8-496b-a8f3-1b7a3df6f4d7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:08.448772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de9bacee-9aab-4e14-be1a-a54213a7b464 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.449226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de9bacee-9aab-4e14-be1a-a54213a7b464 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.450049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de9bacee-9aab-4e14-be1a-a54213a7b464 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.450675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de9bacee-9aab-4e14-be1a-a54213a7b464 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.460241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7e4b8cba-4c99-44c2-b9b1-73a5083183a2 req-0fd03801-65f1-429d-880e-a065420e4340 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.460693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7e4b8cba-4c99-44c2-b9b1-73a5083183a2 req-0fd03801-65f1-429d-880e-a065420e4340 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.473793 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7e4b8cba-4c99-44c2-b9b1-73a5083183a2 req-0fd03801-65f1-429d-880e-a065420e4340 service nova] Creating event network-vif-deleted:849d5225-97e8-496b-a8f3-1b7a3df6f4d7 for instance 566b4bf7-27e3-48e9-aa39-9d0f512a146f on nch2-master-1 Mar 05 20:54:08.481856 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7e4b8cba-4c99-44c2-b9b1-73a5083183a2 req-0fd03801-65f1-429d-880e-a065420e4340 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040915 Mar 05 20:54:08.482807 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 758/1630] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:08.488646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-350d7e8b-8647-462c-8b36-7258df723d9c tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:08.489361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-350d7e8b-8647-462c-8b36-7258df723d9c tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:08.495928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-350d7e8b-8647-462c-8b36-7258df723d9c tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.496803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-350d7e8b-8647-462c-8b36-7258df723d9c tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.507317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-350d7e8b-8647-462c-8b36-7258df723d9c tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.507834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-350d7e8b-8647-462c-8b36-7258df723d9c tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.665659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-350d7e8b-8647-462c-8b36-7258df723d9c tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:08.675167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-350d7e8b-8647-462c-8b36-7258df723d9c tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:08.676700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-350d7e8b-8647-462c-8b36-7258df723d9c tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:08.677810 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-350d7e8b-8647-462c-8b36-7258df723d9c tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 200 len: 1359 microversion: 2.21 time: 0.193921 Mar 05 20:54:08.678560 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 759/1631] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:08 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:08.682967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f4cac137-4b40-4deb-af89-7a47f33280a7 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:08.683574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f4cac137-4b40-4deb-af89-7a47f33280a7 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:08.689386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4cac137-4b40-4deb-af89-7a47f33280a7 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.689827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4cac137-4b40-4deb-af89-7a47f33280a7 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.690602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4cac137-4b40-4deb-af89-7a47f33280a7 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.691041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4cac137-4b40-4deb-af89-7a47f33280a7 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.808676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-de9bacee-9aab-4e14-be1a-a54213a7b464 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:08.816770 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-de9bacee-9aab-4e14-be1a-a54213a7b464 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1574 microversion: 2.1 time: 0.394058 Mar 05 20:54:08.828034 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 873/1632] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:08 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1574 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:08.833200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-00d55e3d-735d-4e6e-a872-8cf9d2689c39 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:08.834154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-00d55e3d-735d-4e6e-a872-8cf9d2689c39 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:08.841475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00d55e3d-735d-4e6e-a872-8cf9d2689c39 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.842273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00d55e3d-735d-4e6e-a872-8cf9d2689c39 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.843307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00d55e3d-735d-4e6e-a872-8cf9d2689c39 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.843992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00d55e3d-735d-4e6e-a872-8cf9d2689c39 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.867344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f4cac137-4b40-4deb-af89-7a47f33280a7 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:08.877830 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f4cac137-4b40-4deb-af89-7a47f33280a7 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1317 microversion: 2.1 time: 0.198223 Mar 05 20:54:08.887817 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 760/1633] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:08 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:08.908038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a9849d21-abec-46c0-aad0-cca51be99c8e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:08.908670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a9849d21-abec-46c0-aad0-cca51be99c8e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:08.918780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9849d21-abec-46c0-aad0-cca51be99c8e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.919247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9849d21-abec-46c0-aad0-cca51be99c8e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:08.920111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9849d21-abec-46c0-aad0-cca51be99c8e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:08.920559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9849d21-abec-46c0-aad0-cca51be99c8e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:09.075706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a9849d21-abec-46c0-aad0-cca51be99c8e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:09.086363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a9849d21-abec-46c0-aad0-cca51be99c8e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:09.088072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a9849d21-abec-46c0-aad0-cca51be99c8e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:09.089435 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a9849d21-abec-46c0-aad0-cca51be99c8e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1568 microversion: 2.25 time: 0.185576 Mar 05 20:54:09.099799 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 761/1634] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:08 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:09.099799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85d46c05-d41f-46b3-9c78-47fcee66c19a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:09.099799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-85d46c05-d41f-46b3-9c78-47fcee66c19a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:09.102684 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85d46c05-d41f-46b3-9c78-47fcee66c19a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:09.103972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85d46c05-d41f-46b3-9c78-47fcee66c19a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:09.104805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85d46c05-d41f-46b3-9c78-47fcee66c19a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:09.105245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85d46c05-d41f-46b3-9c78-47fcee66c19a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:09.123930 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-85d46c05-d41f-46b3-9c78-47fcee66c19a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] HTTP exception thrown: Instance 566b4bf7-27e3-48e9-aa39-9d0f512a146f could not be found. Mar 05 20:54:09.124539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85d46c05-d41f-46b3-9c78-47fcee66c19a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 404 to user: Instance 566b4bf7-27e3-48e9-aa39-9d0f512a146f could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:09.125387 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-85d46c05-d41f-46b3-9c78-47fcee66c19a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 404 len: 111 microversion: 2.1 time: 0.034478 Mar 05 20:54:09.129874 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 762/1635] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:09 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:54:09.138590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e3604e3a-9610-4504-aeba-8c5b87f3de64 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Action: 'create', calling method: .version_select at 0x7fed5c62c4c0>, body: {"keypair": {"name": "tempest-keypair-386407703"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:09.153039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-e3604e3a-9610-4504-aeba-8c5b87f3de64 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Getting quotas for project f177f4eebae0479d86a35a7531da201f. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:54:09.158701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-e3604e3a-9610-4504-aeba-8c5b87f3de64 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Getting quotas for user ced50a298a4242d8a1856fe9b2cc454e and project f177f4eebae0479d86a35a7531da201f. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:54:09.240119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-00d55e3d-735d-4e6e-a872-8cf9d2689c39 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:09.248423 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-00d55e3d-735d-4e6e-a872-8cf9d2689c39 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.419015 Mar 05 20:54:09.249221 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 874/1636] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:08 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:09.337269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-e3604e3a-9610-4504-aeba-8c5b87f3de64 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Getting quotas for project f177f4eebae0479d86a35a7531da201f. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:54:09.343956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-e3604e3a-9610-4504-aeba-8c5b87f3de64 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Getting quotas for user ced50a298a4242d8a1856fe9b2cc454e and project f177f4eebae0479d86a35a7531da201f. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:54:09.358971 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e3604e3a-9610-4504-aeba-8c5b87f3de64 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.224824 Mar 05 20:54:09.359815 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 763/1637] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:54:09 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:09.440424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cdc94c51-6e1a-4930-8f2d-932743f91e77 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:09.441183 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cdc94c51-6e1a-4930-8f2d-932743f91e77 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:09.453950 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdc94c51-6e1a-4930-8f2d-932743f91e77 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:09.454604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b68a20dc-58b9-45a6-9a50-c506f17fbce8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:09.456019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b68a20dc-58b9-45a6-9a50-c506f17fbce8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:09.456311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdc94c51-6e1a-4930-8f2d-932743f91e77 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:09.457035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdc94c51-6e1a-4930-8f2d-932743f91e77 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:09.457490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdc94c51-6e1a-4930-8f2d-932743f91e77 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:09.470338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b68a20dc-58b9-45a6-9a50-c506f17fbce8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:09.471426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b68a20dc-58b9-45a6-9a50-c506f17fbce8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:09.472493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b68a20dc-58b9-45a6-9a50-c506f17fbce8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:09.473258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b68a20dc-58b9-45a6-9a50-c506f17fbce8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:09.729306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b68a20dc-58b9-45a6-9a50-c506f17fbce8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:09.738742 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b68a20dc-58b9-45a6-9a50-c506f17fbce8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.289681 Mar 05 20:54:09.739966 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 764/1638] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:09 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:09.746379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6611f132-e8da-4023-b8bd-82e23fc67fb4 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:09.747162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6611f132-e8da-4023-b8bd-82e23fc67fb4 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:09.754645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6611f132-e8da-4023-b8bd-82e23fc67fb4 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:09.755227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6611f132-e8da-4023-b8bd-82e23fc67fb4 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:09.756757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6611f132-e8da-4023-b8bd-82e23fc67fb4 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:09.756951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6611f132-e8da-4023-b8bd-82e23fc67fb4 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:09.785302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cdc94c51-6e1a-4930-8f2d-932743f91e77 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:09.804360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cdc94c51-6e1a-4930-8f2d-932743f91e77 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:09.806503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cdc94c51-6e1a-4930-8f2d-932743f91e77 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:09.808078 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cdc94c51-6e1a-4930-8f2d-932743f91e77 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.372105 Mar 05 20:54:09.808733 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 875/1639] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:09 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:09.835896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bedc5e05-185c-4dd6-9246-70cdd8131646 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:09.836545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bedc5e05-185c-4dd6-9246-70cdd8131646 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:09.843773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bedc5e05-185c-4dd6-9246-70cdd8131646 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:09.844314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bedc5e05-185c-4dd6-9246-70cdd8131646 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:09.845170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bedc5e05-185c-4dd6-9246-70cdd8131646 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:09.845681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bedc5e05-185c-4dd6-9246-70cdd8131646 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:09.995823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6611f132-e8da-4023-b8bd-82e23fc67fb4 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:10.003893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6611f132-e8da-4023-b8bd-82e23fc67fb4 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:10.005421 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6611f132-e8da-4023-b8bd-82e23fc67fb4 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:10.006559 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6611f132-e8da-4023-b8bd-82e23fc67fb4 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 200 len: 1359 microversion: 2.21 time: 0.264904 Mar 05 20:54:10.017965 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 765/1640] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:09 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:10.022936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ba950763-b717-47f9-ac11-f6c6a4d8ceec tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:10.023570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ba950763-b717-47f9-ac11-f6c6a4d8ceec tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:10.031149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ba950763-b717-47f9-ac11-f6c6a4d8ceec tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.031607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ba950763-b717-47f9-ac11-f6c6a4d8ceec tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:10.032443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ba950763-b717-47f9-ac11-f6c6a4d8ceec tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.033241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ba950763-b717-47f9-ac11-f6c6a4d8ceec tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:10.080595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bedc5e05-185c-4dd6-9246-70cdd8131646 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:10.089688 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bedc5e05-185c-4dd6-9246-70cdd8131646 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1579 microversion: 2.1 time: 0.257965 Mar 05 20:54:10.090244 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 876/1641] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:09 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1579 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:10.108768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6f3252a0-346f-40b3-b81a-80d54af2a582 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:10.109482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6f3252a0-346f-40b3-b81a-80d54af2a582 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:10.118001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f3252a0-346f-40b3-b81a-80d54af2a582 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.120736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f3252a0-346f-40b3-b81a-80d54af2a582 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:10.123358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f3252a0-346f-40b3-b81a-80d54af2a582 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.124443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f3252a0-346f-40b3-b81a-80d54af2a582 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:10.250095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ba950763-b717-47f9-ac11-f6c6a4d8ceec tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:10.261623 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ba950763-b717-47f9-ac11-f6c6a4d8ceec tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1317 microversion: 2.1 time: 0.242051 Mar 05 20:54:10.275523 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 766/1642] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:10 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:10.281690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-78fd2a1e-4626-4328-b7cc-82924bbb7dc5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:10.282349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-78fd2a1e-4626-4328-b7cc-82924bbb7dc5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:10.292921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78fd2a1e-4626-4328-b7cc-82924bbb7dc5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.293627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78fd2a1e-4626-4328-b7cc-82924bbb7dc5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:10.296378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78fd2a1e-4626-4328-b7cc-82924bbb7dc5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.296378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78fd2a1e-4626-4328-b7cc-82924bbb7dc5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:10.361797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6f3252a0-346f-40b3-b81a-80d54af2a582 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:10.371691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6f3252a0-346f-40b3-b81a-80d54af2a582 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:10.373804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6f3252a0-346f-40b3-b81a-80d54af2a582 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:10.375101 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6f3252a0-346f-40b3-b81a-80d54af2a582 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1543 microversion: 2.25 time: 0.270714 Mar 05 20:54:10.376340 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 877/1643] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:10 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1543 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:54:10.392715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af07c3a9-d83d-416b-8d01-2bd6b46eebae tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '.version_select at 0x7fed5d2a0f70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:10.395196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af07c3a9-d83d-416b-8d01-2bd6b46eebae tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.395656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af07c3a9-d83d-416b-8d01-2bd6b46eebae tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:10.408692 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-af07c3a9-d83d-416b-8d01-2bd6b46eebae tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/os-migrations" status: 200 len: 2789 microversion: 2.25 time: 0.019627 Mar 05 20:54:10.409328 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 878/1644] 10.222.0.15 () {60 vars in 1183 bytes} [Sat Mar 5 20:54:10 2022] GET /compute/v2.1/os-migrations => generated 2789 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:54:10.423532 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ad700cdc-d747-40ca-ab0f-5622fabd55e7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:10.424219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ad700cdc-d747-40ca-ab0f-5622fabd55e7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:10.430733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad700cdc-d747-40ca-ab0f-5622fabd55e7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.433029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad700cdc-d747-40ca-ab0f-5622fabd55e7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:10.434289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad700cdc-d747-40ca-ab0f-5622fabd55e7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.434971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad700cdc-d747-40ca-ab0f-5622fabd55e7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:10.608884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-78fd2a1e-4626-4328-b7cc-82924bbb7dc5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:10.618211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-ad700cdc-d747-40ca-ab0f-5622fabd55e7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:54:10.645065 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-78fd2a1e-4626-4328-b7cc-82924bbb7dc5 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.367644 Mar 05 20:54:10.648184 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 767/1645] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:10 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:10.659804 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ad700cdc-d747-40ca-ab0f-5622fabd55e7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 2035 microversion: 2.25 time: 0.240442 Mar 05 20:54:10.660987 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 879/1646] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:10 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 2035 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:54:10.672227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a9e6733b-b3f6-4ffe-aa8f-4b444d6757b0 req-beb412ef-7b3b-4a05-acec-e28fd9413ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fed7313-ee78-4aa8-8df2-4ff9a776115f", "name": "network-vif-plugged", "status": "completed", "tag": "2e2be274-47ed-4b4e-a0f7-f1971d3394d2"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:10.696233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a9e6733b-b3f6-4ffe-aa8f-4b444d6757b0 req-beb412ef-7b3b-4a05-acec-e28fd9413ee6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.696686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a9e6733b-b3f6-4ffe-aa8f-4b444d6757b0 req-beb412ef-7b3b-4a05-acec-e28fd9413ee6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:10.711702 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a9e6733b-b3f6-4ffe-aa8f-4b444d6757b0 req-beb412ef-7b3b-4a05-acec-e28fd9413ee6 service nova] Creating event network-vif-plugged:2e2be274-47ed-4b4e-a0f7-f1971d3394d2 for instance 8fed7313-ee78-4aa8-8df2-4ff9a776115f on nch1-master-1 Mar 05 20:54:10.718368 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a9e6733b-b3f6-4ffe-aa8f-4b444d6757b0 req-beb412ef-7b3b-4a05-acec-e28fd9413ee6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067373 Mar 05 20:54:10.720736 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 768/1647] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:10.757696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b369b4cb-d100-43ea-8a70-06c51be04b22 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:10.758422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b369b4cb-d100-43ea-8a70-06c51be04b22 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:10.766054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b369b4cb-d100-43ea-8a70-06c51be04b22 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.766644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b369b4cb-d100-43ea-8a70-06c51be04b22 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:10.769672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b369b4cb-d100-43ea-8a70-06c51be04b22 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.770445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b369b4cb-d100-43ea-8a70-06c51be04b22 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:10.828373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9d07a281-7572-48c2-9ee5-84d6092b91de tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:10.829087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9d07a281-7572-48c2-9ee5-84d6092b91de tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:10.840056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d07a281-7572-48c2-9ee5-84d6092b91de tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.840788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d07a281-7572-48c2-9ee5-84d6092b91de tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:10.842157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d07a281-7572-48c2-9ee5-84d6092b91de tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:10.843004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d07a281-7572-48c2-9ee5-84d6092b91de tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:11.068785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b369b4cb-d100-43ea-8a70-06c51be04b22 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:11.078744 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b369b4cb-d100-43ea-8a70-06c51be04b22 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.325715 Mar 05 20:54:11.079329 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 880/1648] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:10 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:11.084189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2048486846", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "d83df0c3-2a5b-4fbb-9f93-42653588000e"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:11.141483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] validate_networks() for [('d83df0c3-2a5b-4fbb-9f93-42653588000e', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:54:11.248352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9d07a281-7572-48c2-9ee5-84d6092b91de tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:11.265465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9d07a281-7572-48c2-9ee5-84d6092b91de tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:11.269803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9d07a281-7572-48c2-9ee5-84d6092b91de tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:11.271908 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9d07a281-7572-48c2-9ee5-84d6092b91de tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.447679 Mar 05 20:54:11.279257 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 769/1649] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:10 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:54:11.298907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b479e7d8-4dbd-4b65-a5b4-d6dba05d014a tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:11.302675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b479e7d8-4dbd-4b65-a5b4-d6dba05d014a tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:11.321585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b479e7d8-4dbd-4b65-a5b4-d6dba05d014a tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:11.322369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b479e7d8-4dbd-4b65-a5b4-d6dba05d014a tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:11.323331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b479e7d8-4dbd-4b65-a5b4-d6dba05d014a tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:11.323955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b479e7d8-4dbd-4b65-a5b4-d6dba05d014a tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:11.587041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b479e7d8-4dbd-4b65-a5b4-d6dba05d014a tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:11.596734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b479e7d8-4dbd-4b65-a5b4-d6dba05d014a tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:11.598658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b479e7d8-4dbd-4b65-a5b4-d6dba05d014a tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:11.600025 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b479e7d8-4dbd-4b65-a5b4-d6dba05d014a tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 200 len: 1359 microversion: 2.21 time: 0.309612 Mar 05 20:54:11.600774 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 770/1650] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:11 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 1359 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:11.616182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23a83791-bc0a-4149-a9cb-e89800a331a7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:11.617022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-23a83791-bc0a-4149-a9cb-e89800a331a7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:11.621477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:54:11.621995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:54:11.622383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:54:11.622802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:54:11.623225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:54:11.633519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23a83791-bc0a-4149-a9cb-e89800a331a7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:11.634370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23a83791-bc0a-4149-a9cb-e89800a331a7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:11.635395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23a83791-bc0a-4149-a9cb-e89800a331a7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:11.636052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23a83791-bc0a-4149-a9cb-e89800a331a7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:11.637404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:11.637880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:11.638702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:11.639209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:11.682378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Getting quotas for project aa37ca4c9ac445f4ab3ab68f30b46d44. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:54:11.693789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Getting quotas for user 33c2e3f240e04849be211c91e18234dd and project aa37ca4c9ac445f4ab3ab68f30b46d44. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:54:11.707980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:54:11.711341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:54:11.764307 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e6e0d635-0365-43cb-b37b-998a702c2fb3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.683238 Mar 05 20:54:11.766838 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 881/1651] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 20:54:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 05 20:54:11.774014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-def9420c-d765-45f4-b61d-e17ead5e6dfe tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:11.775039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-def9420c-d765-45f4-b61d-e17ead5e6dfe tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:11.785079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-def9420c-d765-45f4-b61d-e17ead5e6dfe tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:11.785542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-def9420c-d765-45f4-b61d-e17ead5e6dfe tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:11.786737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-def9420c-d765-45f4-b61d-e17ead5e6dfe tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:11.786830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-def9420c-d765-45f4-b61d-e17ead5e6dfe tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:11.812100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-23a83791-bc0a-4149-a9cb-e89800a331a7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:11.819598 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-23a83791-bc0a-4149-a9cb-e89800a331a7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1572 microversion: 2.1 time: 0.207221 Mar 05 20:54:11.820208 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 771/1652] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:11 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1572 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:11.833277 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3fbd276d-0757-4cc0-98cb-72703adfbb6d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:11.833907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3fbd276d-0757-4cc0-98cb-72703adfbb6d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:11.841670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3fbd276d-0757-4cc0-98cb-72703adfbb6d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:11.842085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3fbd276d-0757-4cc0-98cb-72703adfbb6d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:11.843071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3fbd276d-0757-4cc0-98cb-72703adfbb6d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:11.843705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3fbd276d-0757-4cc0-98cb-72703adfbb6d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:11.977848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-def9420c-d765-45f4-b61d-e17ead5e6dfe tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:11.991458 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-def9420c-d765-45f4-b61d-e17ead5e6dfe tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1317 microversion: 2.1 time: 0.222963 Mar 05 20:54:12.003133 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 882/1653] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:11 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:12.014016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1923656444", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:12.081391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3fbd276d-0757-4cc0-98cb-72703adfbb6d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:12.093247 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3fbd276d-0757-4cc0-98cb-72703adfbb6d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.269097 Mar 05 20:54:12.095724 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 772/1654] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:11 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:12.096659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] validate_networks() for [('2946acdb-a2ef-4ca1-ac26-ee00745cfd9f', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:54:12.101198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2d2016f4-24f9-4aed-a899-5850a4349291 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:12.102611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2d2016f4-24f9-4aed-a899-5850a4349291 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:12.167950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d2016f4-24f9-4aed-a899-5850a4349291 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:12.176496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d2016f4-24f9-4aed-a899-5850a4349291 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:12.179446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d2016f4-24f9-4aed-a899-5850a4349291 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:12.181817 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2d2016f4-24f9-4aed-a899-5850a4349291 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1262 microversion: 2.25 time: 0.084299 Mar 05 20:54:12.183085 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 773/1655] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:12 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:12.188583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3bf7abe2-eac6-4b19-9ce1-d7409451e653 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1614650423"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:12.189523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3bf7abe2-eac6-4b19-9ce1-d7409451e653 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:12.195615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bf7abe2-eac6-4b19-9ce1-d7409451e653 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:12.196405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bf7abe2-eac6-4b19-9ce1-d7409451e653 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:12.199494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bf7abe2-eac6-4b19-9ce1-d7409451e653 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:12.200193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bf7abe2-eac6-4b19-9ce1-d7409451e653 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:12.396020 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.network.security_group_api [None req-3bf7abe2-eac6-4b19-9ce1-d7409451e653 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Adding security group c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8 to port 39103012-a3fb-406c-a3d5-628b64bf136f Mar 05 20:54:12.599253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:54:12.599819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:54:12.600490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:54:12.601076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:54:12.601680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:54:12.612053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:12.612627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:12.613775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:12.614428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:12.633281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Getting quotas for project f177f4eebae0479d86a35a7531da201f. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:54:12.639226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Getting quotas for user ced50a298a4242d8a1856fe9b2cc454e and project f177f4eebae0479d86a35a7531da201f. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:54:12.660039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:54:12.662149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:54:12.716509 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bf74ee6e-b47a-4d15-8bab-1be375a8fa5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.711425 Mar 05 20:54:12.718027 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 883/1656] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:54:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:54:12.723017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3a0098d0-7d0b-446a-b769-5b980058fe27 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:12.724139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3a0098d0-7d0b-446a-b769-5b980058fe27 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:12.731557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a0098d0-7d0b-446a-b769-5b980058fe27 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:12.732161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a0098d0-7d0b-446a-b769-5b980058fe27 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:12.733191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a0098d0-7d0b-446a-b769-5b980058fe27 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:12.733987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a0098d0-7d0b-446a-b769-5b980058fe27 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:12.871460 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3bf7abe2-eac6-4b19-9ce1-d7409451e653 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450/action" status: 202 len: 0 microversion: 2.1 time: 0.686997 Mar 05 20:54:12.872126 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 774/1657] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:54:12 2022] POST /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:54:12.880135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-11c49fcc-cc9e-4625-8d03-ddd0319e8165 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:12.880772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-11c49fcc-cc9e-4625-8d03-ddd0319e8165 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:12.897542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11c49fcc-cc9e-4625-8d03-ddd0319e8165 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:12.898026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11c49fcc-cc9e-4625-8d03-ddd0319e8165 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:12.898846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11c49fcc-cc9e-4625-8d03-ddd0319e8165 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:12.899298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11c49fcc-cc9e-4625-8d03-ddd0319e8165 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:12.954552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3a0098d0-7d0b-446a-b769-5b980058fe27 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:12.980840 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3a0098d0-7d0b-446a-b769-5b980058fe27 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.261365 Mar 05 20:54:12.981405 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 884/1658] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:12 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:12.997854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d8d2ada5-5eec-4188-a8d9-59cf3347dc27 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:12.998831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d8d2ada5-5eec-4188-a8d9-59cf3347dc27 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:13.006383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8d2ada5-5eec-4188-a8d9-59cf3347dc27 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:13.007571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8d2ada5-5eec-4188-a8d9-59cf3347dc27 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:13.008876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8d2ada5-5eec-4188-a8d9-59cf3347dc27 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:13.009542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8d2ada5-5eec-4188-a8d9-59cf3347dc27 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:13.278925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-11c49fcc-cc9e-4625-8d03-ddd0319e8165 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:13.291377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-11c49fcc-cc9e-4625-8d03-ddd0319e8165 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:13.292877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-11c49fcc-cc9e-4625-8d03-ddd0319e8165 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:13.295264 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-11c49fcc-cc9e-4625-8d03-ddd0319e8165 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.418824 Mar 05 20:54:13.295769 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 775/1659] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:12 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:13.317458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a820d229-f1a0-4b97-978d-f72baf36c262 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:13.320520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a820d229-f1a0-4b97-978d-f72baf36c262 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:13.387200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a820d229-f1a0-4b97-978d-f72baf36c262 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:13.395073 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a820d229-f1a0-4b97-978d-f72baf36c262 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1225 microversion: 2.1 time: 0.084050 Mar 05 20:54:13.396100 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 776/1660] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:13 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:13.402423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-92ed1bb2-5193-4d2b-ba0d-cc1a56159dda req-98861510-26e5-46fc-99b8-51e6ed45b2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba11c91-fc0e-41d6-8efd-fddeb4132869", "name": "network-vif-plugged", "status": "completed", "tag": "6ab2be74-857e-4e38-ad99-97dbaa1f820d"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:13.411518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-92ed1bb2-5193-4d2b-ba0d-cc1a56159dda req-98861510-26e5-46fc-99b8-51e6ed45b2bb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:13.412628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-92ed1bb2-5193-4d2b-ba0d-cc1a56159dda req-98861510-26e5-46fc-99b8-51e6ed45b2bb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:13.427740 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-92ed1bb2-5193-4d2b-ba0d-cc1a56159dda req-98861510-26e5-46fc-99b8-51e6ed45b2bb service nova] Creating event network-vif-plugged:6ab2be74-857e-4e38-ad99-97dbaa1f820d for instance aba11c91-fc0e-41d6-8efd-fddeb4132869 on nch2-master-1 Mar 05 20:54:13.434259 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-92ed1bb2-5193-4d2b-ba0d-cc1a56159dda req-98861510-26e5-46fc-99b8-51e6ed45b2bb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036163 Mar 05 20:54:13.435591 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 777/1661] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:13.441896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-af0c7a8f-ad82-4c0c-b2d0-f393696992bc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c737f70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:13.662434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-af0c7a8f-ad82-4c0c-b2d0-f393696992bc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8 in use.", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:54:13.663137 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-af0c7a8f-ad82-4c0c-b2d0-f393696992bc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Security Group c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8 in use. Mar 05 20:54:13.663137 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-679217fb-c59f-4e3d-80c1-fa336e6ad121'] Mar 05 20:54:13.663771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-af0c7a8f-ad82-4c0c-b2d0-f393696992bc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 400 to user: Security Group c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8 in use. Mar 05 20:54:13.663771 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-679217fb-c59f-4e3d-80c1-fa336e6ad121'] {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:13.664691 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-af0c7a8f-ad82-4c0c-b2d0-f393696992bc tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8" status: 400 len: 185 microversion: 2.1 time: 0.227692 Mar 05 20:54:13.666463 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 778/1662] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:54:13 2022] DELETE /compute/v2.1/os-security-groups/c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8 => generated 185 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:54:13.673410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e449b0d5-12a2-4919-aba5-4e3e77162647 req-a4695adb-33a5-4dc2-92c7-7aa048c466e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c9bb643-2491-47d8-9758-76f13e927450", "tag": "39103012-a3fb-406c-a3d5-628b64bf136f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:13.696634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e449b0d5-12a2-4919-aba5-4e3e77162647 req-a4695adb-33a5-4dc2-92c7-7aa048c466e3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:13.698647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e449b0d5-12a2-4919-aba5-4e3e77162647 req-a4695adb-33a5-4dc2-92c7-7aa048c466e3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:13.723920 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e449b0d5-12a2-4919-aba5-4e3e77162647 req-a4695adb-33a5-4dc2-92c7-7aa048c466e3 service nova] Creating event network-changed:39103012-a3fb-406c-a3d5-628b64bf136f for instance 1c9bb643-2491-47d8-9758-76f13e927450 on nch2-master-1 Mar 05 20:54:13.731561 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e449b0d5-12a2-4919-aba5-4e3e77162647 req-a4695adb-33a5-4dc2-92c7-7aa048c466e3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063441 Mar 05 20:54:13.732859 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 779/1663] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:13.758475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-59ff8cae-ea0c-4191-99c5-9f8476ed8817 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:13.759923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-59ff8cae-ea0c-4191-99c5-9f8476ed8817 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:13.769785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-59ff8cae-ea0c-4191-99c5-9f8476ed8817 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:13.772006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-59ff8cae-ea0c-4191-99c5-9f8476ed8817 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:13.773218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-59ff8cae-ea0c-4191-99c5-9f8476ed8817 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:13.774305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-59ff8cae-ea0c-4191-99c5-9f8476ed8817 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:13.871624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d8d2ada5-5eec-4188-a8d9-59cf3347dc27 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:13.882030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d8d2ada5-5eec-4188-a8d9-59cf3347dc27 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:13.885844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d8d2ada5-5eec-4188-a8d9-59cf3347dc27 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:13.887574 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d8d2ada5-5eec-4188-a8d9-59cf3347dc27 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 200 len: 1552 microversion: 2.21 time: 0.895935 Mar 05 20:54:13.905187 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 885/1664] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:12 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 1552 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:13.911161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-053a5a3a-9ef5-49d8-94f3-1f9ff7759963 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:13.912345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-053a5a3a-9ef5-49d8-94f3-1f9ff7759963 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:13.926109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-053a5a3a-9ef5-49d8-94f3-1f9ff7759963 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:13.926566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-053a5a3a-9ef5-49d8-94f3-1f9ff7759963 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:13.927363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-053a5a3a-9ef5-49d8-94f3-1f9ff7759963 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:13.927976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-053a5a3a-9ef5-49d8-94f3-1f9ff7759963 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:13.969080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-59ff8cae-ea0c-4191-99c5-9f8476ed8817 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:13.977402 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-59ff8cae-ea0c-4191-99c5-9f8476ed8817 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1317 microversion: 2.1 time: 0.241886 Mar 05 20:54:13.979559 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 780/1665] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:13 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:13.984954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c20f598d-d8be-4781-bc97-dc2aeb86a599 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:13.985755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c20f598d-d8be-4781-bc97-dc2aeb86a599 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:13.992207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c20f598d-d8be-4781-bc97-dc2aeb86a599 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:13.992949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c20f598d-d8be-4781-bc97-dc2aeb86a599 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:13.995381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c20f598d-d8be-4781-bc97-dc2aeb86a599 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:13.996108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c20f598d-d8be-4781-bc97-dc2aeb86a599 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:14.113737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c20f598d-d8be-4781-bc97-dc2aeb86a599 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:14.129463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c20f598d-d8be-4781-bc97-dc2aeb86a599 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:14.132067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c20f598d-d8be-4781-bc97-dc2aeb86a599 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:14.133284 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c20f598d-d8be-4781-bc97-dc2aeb86a599 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1320 microversion: 2.25 time: 0.152383 Mar 05 20:54:14.141248 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 781/1666] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:13 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:14.146195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-331ba76b-769a-4ac4-8777-03f0390d0cf6 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:14.162251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-331ba76b-769a-4ac4-8777-03f0390d0cf6 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:14.171064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-331ba76b-769a-4ac4-8777-03f0390d0cf6 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:14.171579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-331ba76b-769a-4ac4-8777-03f0390d0cf6 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:14.172415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-331ba76b-769a-4ac4-8777-03f0390d0cf6 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:14.173425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-331ba76b-769a-4ac4-8777-03f0390d0cf6 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:14.231807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-331ba76b-769a-4ac4-8777-03f0390d0cf6 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:54:14.263775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-053a5a3a-9ef5-49d8-94f3-1f9ff7759963 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:14.274437 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-053a5a3a-9ef5-49d8-94f3-1f9ff7759963 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.367712 Mar 05 20:54:14.277517 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 886/1667] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:13 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:14.289459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3f127c10-4886-49b3-9242-6c9d1be87d87 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:14.290383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3f127c10-4886-49b3-9242-6c9d1be87d87 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:14.303252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f127c10-4886-49b3-9242-6c9d1be87d87 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:14.305030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f127c10-4886-49b3-9242-6c9d1be87d87 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:14.309336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f127c10-4886-49b3-9242-6c9d1be87d87 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:14.310073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f127c10-4886-49b3-9242-6c9d1be87d87 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:14.372176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3f127c10-4886-49b3-9242-6c9d1be87d87 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:54:14.420383 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-331ba76b-769a-4ac4-8777-03f0390d0cf6 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 204 len: 0 microversion: 2.1 time: 0.283931 Mar 05 20:54:14.421395 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 782/1668] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:54:14 2022] DELETE /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:54:14.426977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e2ccdc8a-5109-44c6-b24e-9508c19517fa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:14.427845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e2ccdc8a-5109-44c6-b24e-9508c19517fa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:14.446518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e2ccdc8a-5109-44c6-b24e-9508c19517fa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:14.447778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e2ccdc8a-5109-44c6-b24e-9508c19517fa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:14.448672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e2ccdc8a-5109-44c6-b24e-9508c19517fa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:14.449194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e2ccdc8a-5109-44c6-b24e-9508c19517fa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:14.521847 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3f127c10-4886-49b3-9242-6c9d1be87d87 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 204 len: 0 microversion: 2.21 time: 0.239548 Mar 05 20:54:14.522584 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 887/1669] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 20:54:14 2022] DELETE /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:54:14.542761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-59e2d320-ddc3-4bf2-ab5a-67f5ee11e20a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:14.543780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-59e2d320-ddc3-4bf2-ab5a-67f5ee11e20a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:14.552302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59e2d320-ddc3-4bf2-ab5a-67f5ee11e20a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:14.553055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59e2d320-ddc3-4bf2-ab5a-67f5ee11e20a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:14.554019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59e2d320-ddc3-4bf2-ab5a-67f5ee11e20a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:14.554647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59e2d320-ddc3-4bf2-ab5a-67f5ee11e20a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:14.845566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e2ccdc8a-5109-44c6-b24e-9508c19517fa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:14.862742 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e2ccdc8a-5109-44c6-b24e-9508c19517fa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.438977 Mar 05 20:54:14.864248 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 783/1670] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:14 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:14.871060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41076434-608d-4b13-a15f-ac5ff61e2479 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:14.874609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-41076434-608d-4b13-a15f-ac5ff61e2479 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:14.898936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41076434-608d-4b13-a15f-ac5ff61e2479 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:14.899403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41076434-608d-4b13-a15f-ac5ff61e2479 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:14.902187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41076434-608d-4b13-a15f-ac5ff61e2479 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:14.902834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41076434-608d-4b13-a15f-ac5ff61e2479 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:14.937389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-59e2d320-ddc3-4bf2-ab5a-67f5ee11e20a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:14.952310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-59e2d320-ddc3-4bf2-ab5a-67f5ee11e20a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:14.954350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-59e2d320-ddc3-4bf2-ab5a-67f5ee11e20a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:14.956885 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-59e2d320-ddc3-4bf2-ab5a-67f5ee11e20a tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.431567 Mar 05 20:54:14.958002 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 888/1671] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:14 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:14.966921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9d769433-14da-4c87-8d63-9cfb38e72006 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:14.969335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9d769433-14da-4c87-8d63-9cfb38e72006 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:14.977600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d769433-14da-4c87-8d63-9cfb38e72006 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:14.980410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d769433-14da-4c87-8d63-9cfb38e72006 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:14.981602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d769433-14da-4c87-8d63-9cfb38e72006 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:14.982170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d769433-14da-4c87-8d63-9cfb38e72006 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.036988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-41076434-608d-4b13-a15f-ac5ff61e2479 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:15.046758 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-41076434-608d-4b13-a15f-ac5ff61e2479 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1283 microversion: 2.1 time: 0.181222 Mar 05 20:54:15.047724 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 784/1672] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:14 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1283 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:15.056903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8326add0-d5ad-4d5f-8462-5b0e2afbc492 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:15.072113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8326add0-d5ad-4d5f-8462-5b0e2afbc492 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:15.079512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8326add0-d5ad-4d5f-8462-5b0e2afbc492 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.080094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8326add0-d5ad-4d5f-8462-5b0e2afbc492 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.080982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8326add0-d5ad-4d5f-8462-5b0e2afbc492 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.081530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8326add0-d5ad-4d5f-8462-5b0e2afbc492 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.281670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9d769433-14da-4c87-8d63-9cfb38e72006 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:15.289759 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9d769433-14da-4c87-8d63-9cfb38e72006 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1647 microversion: 2.1 time: 0.330555 Mar 05 20:54:15.290352 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 889/1673] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:14 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1647 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:15.295104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fc327a10-783b-4d44-9a55-e6c859acc81c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:15.295744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fc327a10-783b-4d44-9a55-e6c859acc81c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:15.302045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc327a10-783b-4d44-9a55-e6c859acc81c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.302498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc327a10-783b-4d44-9a55-e6c859acc81c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.303414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc327a10-783b-4d44-9a55-e6c859acc81c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.304046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc327a10-783b-4d44-9a55-e6c859acc81c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.307249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8326add0-d5ad-4d5f-8462-5b0e2afbc492 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:15.318279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8326add0-d5ad-4d5f-8462-5b0e2afbc492 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:15.323791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8326add0-d5ad-4d5f-8462-5b0e2afbc492 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:15.325042 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8326add0-d5ad-4d5f-8462-5b0e2afbc492 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 200 len: 1558 microversion: 2.21 time: 0.276592 Mar 05 20:54:15.325638 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 785/1674] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:15 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 1558 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:15.340570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ac13c644-57a1-41fa-b627-d148984fcf45 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:15.341435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ac13c644-57a1-41fa-b627-d148984fcf45 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:15.347581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac13c644-57a1-41fa-b627-d148984fcf45 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.348300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac13c644-57a1-41fa-b627-d148984fcf45 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.349318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac13c644-57a1-41fa-b627-d148984fcf45 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.349925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac13c644-57a1-41fa-b627-d148984fcf45 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.575832 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fc327a10-783b-4d44-9a55-e6c859acc81c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:15.581024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ac13c644-57a1-41fa-b627-d148984fcf45 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:15.594502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ac13c644-57a1-41fa-b627-d148984fcf45 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:15.595211 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fc327a10-783b-4d44-9a55-e6c859acc81c tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1505 microversion: 2.1 time: 0.303740 Mar 05 20:54:15.596105 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 890/1675] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:15 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:15.604340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bf7e2197-4e86-4994-a0ae-006d2a14a620 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:15.605181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bf7e2197-4e86-4994-a0ae-006d2a14a620 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:15.609534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ac13c644-57a1-41fa-b627-d148984fcf45 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:15.610790 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ac13c644-57a1-41fa-b627-d148984fcf45 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1362 microversion: 2.25 time: 0.274153 Mar 05 20:54:15.612224 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 786/1676] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:15 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:15.626177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf7e2197-4e86-4994-a0ae-006d2a14a620 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.626177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf7e2197-4e86-4994-a0ae-006d2a14a620 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.626428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c82ea48a-30f8-4ede-82fc-1cb11e0aae8f tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:15.626869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c82ea48a-30f8-4ede-82fc-1cb11e0aae8f tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:15.627585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf7e2197-4e86-4994-a0ae-006d2a14a620 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.627585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf7e2197-4e86-4994-a0ae-006d2a14a620 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.634469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c82ea48a-30f8-4ede-82fc-1cb11e0aae8f tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.635050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c82ea48a-30f8-4ede-82fc-1cb11e0aae8f tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.635994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c82ea48a-30f8-4ede-82fc-1cb11e0aae8f tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.636694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c82ea48a-30f8-4ede-82fc-1cb11e0aae8f tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.665237 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c82ea48a-30f8-4ede-82fc-1cb11e0aae8f tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869/ips" status: 200 len: 108 microversion: 2.1 time: 0.051226 Mar 05 20:54:15.666654 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 787/1677] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 20:54:15 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869/ips => generated 108 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:15.688917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-367a4f36-ddff-4c73-a415-138f252e06ea tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:15.689928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-367a4f36-ddff-4c73-a415-138f252e06ea tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:15.698443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-367a4f36-ddff-4c73-a415-138f252e06ea tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.699083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-367a4f36-ddff-4c73-a415-138f252e06ea tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.700079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-367a4f36-ddff-4c73-a415-138f252e06ea tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.700678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-367a4f36-ddff-4c73-a415-138f252e06ea tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.728960 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-367a4f36-ddff-4c73-a415-138f252e06ea tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869/ips" status: 200 len: 108 microversion: 2.1 time: 0.051504 Mar 05 20:54:15.730004 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 788/1678] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 20:54:15 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869/ips => generated 108 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:15.742047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-919de842-5a72-4b99-8245-00f40e943514 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:15.745556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-919de842-5a72-4b99-8245-00f40e943514 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:15.752114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-919de842-5a72-4b99-8245-00f40e943514 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.752577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-919de842-5a72-4b99-8245-00f40e943514 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.754025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-919de842-5a72-4b99-8245-00f40e943514 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.754498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-919de842-5a72-4b99-8245-00f40e943514 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.785977 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-919de842-5a72-4b99-8245-00f40e943514 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869/ips/tempest-ServerAddressesTestJSON-592226249-network" status: 200 len: 93 microversion: 2.1 time: 0.048005 Mar 05 20:54:15.786781 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 789/1679] 10.222.0.15 () {58 vars in 1397 bytes} [Sat Mar 5 20:54:15 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869/ips/tempest-ServerAddressesTestJSON-592226249-network => generated 93 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:54:15.813928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-296e637e-20df-4f38-a8ae-0d292f5db1a2 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:15.816412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-296e637e-20df-4f38-a8ae-0d292f5db1a2 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:15.826259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-296e637e-20df-4f38-a8ae-0d292f5db1a2 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.826952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-296e637e-20df-4f38-a8ae-0d292f5db1a2 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.827953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-296e637e-20df-4f38-a8ae-0d292f5db1a2 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.828579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-296e637e-20df-4f38-a8ae-0d292f5db1a2 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.856873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-296e637e-20df-4f38-a8ae-0d292f5db1a2 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:54:15.917113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bf7e2197-4e86-4994-a0ae-006d2a14a620 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:15.926536 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bf7e2197-4e86-4994-a0ae-006d2a14a620 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.327666 Mar 05 20:54:15.927223 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 891/1680] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:15 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:15.932965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-106bbacc-2a1b-4679-a855-9b3e66b0019a req-f791faf6-d86f-4a9c-91ff-f9f6e6f5e0ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "019a8023-9015-41ae-974a-eb725177770d", "tag": "38ee5a79-ec27-42bc-985c-95ae7544d810"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:15.941482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-106bbacc-2a1b-4679-a855-9b3e66b0019a req-f791faf6-d86f-4a9c-91ff-f9f6e6f5e0ac service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.942983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-106bbacc-2a1b-4679-a855-9b3e66b0019a req-f791faf6-d86f-4a9c-91ff-f9f6e6f5e0ac service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.958091 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-106bbacc-2a1b-4679-a855-9b3e66b0019a req-f791faf6-d86f-4a9c-91ff-f9f6e6f5e0ac service nova] Creating event network-changed:38ee5a79-ec27-42bc-985c-95ae7544d810 for instance 019a8023-9015-41ae-974a-eb725177770d on nch2-master-1 Mar 05 20:54:15.965632 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-106bbacc-2a1b-4679-a855-9b3e66b0019a req-f791faf6-d86f-4a9c-91ff-f9f6e6f5e0ac service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036919 Mar 05 20:54:15.966904 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 892/1681] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:15.974139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d35c4d14-d5d0-48f4-8e5d-f65fe63c870f tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:15.975368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d35c4d14-d5d0-48f4-8e5d-f65fe63c870f tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:15.987650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d35c4d14-d5d0-48f4-8e5d-f65fe63c870f tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.988251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d35c4d14-d5d0-48f4-8e5d-f65fe63c870f tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:15.989179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d35c4d14-d5d0-48f4-8e5d-f65fe63c870f tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:15.989749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d35c4d14-d5d0-48f4-8e5d-f65fe63c870f tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:16.003506 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-296e637e-20df-4f38-a8ae-0d292f5db1a2 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 204 len: 0 microversion: 2.1 time: 0.202465 Mar 05 20:54:16.004347 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 790/1682] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:54:15 2022] DELETE /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:54:16.012921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a7abc556-9faf-4322-a781-aa42add67b8d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:16.013642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a7abc556-9faf-4322-a781-aa42add67b8d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:16.020653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7abc556-9faf-4322-a781-aa42add67b8d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:16.021136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7abc556-9faf-4322-a781-aa42add67b8d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:16.022695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7abc556-9faf-4322-a781-aa42add67b8d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:16.023146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7abc556-9faf-4322-a781-aa42add67b8d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:16.424880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d35c4d14-d5d0-48f4-8e5d-f65fe63c870f tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:16.436333 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d35c4d14-d5d0-48f4-8e5d-f65fe63c870f tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.467949 Mar 05 20:54:16.444537 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 893/1683] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:15 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:16.450207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-51465f35-b3c0-467e-b338-8ec573c8f556 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:16.453652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-51465f35-b3c0-467e-b338-8ec573c8f556 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:16.467405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51465f35-b3c0-467e-b338-8ec573c8f556 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:16.468160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51465f35-b3c0-467e-b338-8ec573c8f556 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:16.469137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51465f35-b3c0-467e-b338-8ec573c8f556 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:16.469736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51465f35-b3c0-467e-b338-8ec573c8f556 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:16.740331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a7abc556-9faf-4322-a781-aa42add67b8d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:16.755004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a7abc556-9faf-4322-a781-aa42add67b8d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:16.757597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a7abc556-9faf-4322-a781-aa42add67b8d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:16.760060 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a7abc556-9faf-4322-a781-aa42add67b8d tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.754034 Mar 05 20:54:16.760978 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 791/1684] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:16 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:16.766014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0216c2e4-c11d-4acb-8459-bff3e531c674 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:16.766737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0216c2e4-c11d-4acb-8459-bff3e531c674 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:16.773076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0216c2e4-c11d-4acb-8459-bff3e531c674 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:16.773643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0216c2e4-c11d-4acb-8459-bff3e531c674 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:16.774719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0216c2e4-c11d-4acb-8459-bff3e531c674 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:16.775572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0216c2e4-c11d-4acb-8459-bff3e531c674 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:16.980239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-51465f35-b3c0-467e-b338-8ec573c8f556 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:16.988430 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-51465f35-b3c0-467e-b338-8ec573c8f556 tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1511 microversion: 2.1 time: 0.542488 Mar 05 20:54:17.000594 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 894/1685] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:16 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1511 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:17.000594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6ec42ecf-e54f-4d3c-9626-03f0977b4c46 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:17.000594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6ec42ecf-e54f-4d3c-9626-03f0977b4c46 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:17.010733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ec42ecf-e54f-4d3c-9626-03f0977b4c46 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:17.011518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ec42ecf-e54f-4d3c-9626-03f0977b4c46 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:17.012852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ec42ecf-e54f-4d3c-9626-03f0977b4c46 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:17.013358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ec42ecf-e54f-4d3c-9626-03f0977b4c46 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:17.124459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0216c2e4-c11d-4acb-8459-bff3e531c674 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:17.134892 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0216c2e4-c11d-4acb-8459-bff3e531c674 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1325 microversion: 2.1 time: 0.372212 Mar 05 20:54:17.146296 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 792/1686] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:16 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1325 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:17.151941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-15b6df7b-8e43-4da8-9414-420a2145b524 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:17.152674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-15b6df7b-8e43-4da8-9414-420a2145b524 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:17.159856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15b6df7b-8e43-4da8-9414-420a2145b524 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:17.160594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15b6df7b-8e43-4da8-9414-420a2145b524 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:17.161958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15b6df7b-8e43-4da8-9414-420a2145b524 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:17.162603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15b6df7b-8e43-4da8-9414-420a2145b524 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:17.595014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6ec42ecf-e54f-4d3c-9626-03f0977b4c46 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:17.621835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-15b6df7b-8e43-4da8-9414-420a2145b524 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:17.637929 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6ec42ecf-e54f-4d3c-9626-03f0977b4c46 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 200 len: 1647 microversion: 2.1 time: 0.647817 Mar 05 20:54:17.644528 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 895/1687] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:16 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 1647 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:17.646276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-15b6df7b-8e43-4da8-9414-420a2145b524 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:17.651485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-15b6df7b-8e43-4da8-9414-420a2145b524 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95900ebca5b941a58ab71c68d69be24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b274ea570549a3a2624e701a7774d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:17.655552 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-15b6df7b-8e43-4da8-9414-420a2145b524 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 200 len: 1558 microversion: 2.21 time: 0.507790 Mar 05 20:54:17.681417 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 793/1688] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:17 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 1558 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:17.692646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bec9962b-3099-424d-b6a9-3addf8c2ae6a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:17.693572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bec9962b-3099-424d-b6a9-3addf8c2ae6a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:17.720909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a85fd466-6df8-4685-84d6-ab7f30636880 req-0a0ccde2-5d30-4852-ba3b-42946d850037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-plugged", "status": "completed", "tag": "b782a7da-f012-4816-a7bc-b15194cb2996"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:17.750238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a85fd466-6df8-4685-84d6-ab7f30636880 req-0a0ccde2-5d30-4852-ba3b-42946d850037 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:17.750960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a85fd466-6df8-4685-84d6-ab7f30636880 req-0a0ccde2-5d30-4852-ba3b-42946d850037 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:17.762289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bec9962b-3099-424d-b6a9-3addf8c2ae6a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:17.766046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bec9962b-3099-424d-b6a9-3addf8c2ae6a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:17.766988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bec9962b-3099-424d-b6a9-3addf8c2ae6a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:17.769787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bec9962b-3099-424d-b6a9-3addf8c2ae6a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:17.776757 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a85fd466-6df8-4685-84d6-ab7f30636880 req-0a0ccde2-5d30-4852-ba3b-42946d850037 service nova] Creating event network-vif-plugged:b782a7da-f012-4816-a7bc-b15194cb2996 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:54:17.797440 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a85fd466-6df8-4685-84d6-ab7f30636880 req-0a0ccde2-5d30-4852-ba3b-42946d850037 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113872 Mar 05 20:54:17.798794 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 794/1689] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:17.806173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-94e89070-3af5-4767-a9bd-2d251b299b32 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:17.807419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-94e89070-3af5-4767-a9bd-2d251b299b32 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:17.815171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94e89070-3af5-4767-a9bd-2d251b299b32 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:17.816078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94e89070-3af5-4767-a9bd-2d251b299b32 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:17.817251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94e89070-3af5-4767-a9bd-2d251b299b32 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:17.817853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94e89070-3af5-4767-a9bd-2d251b299b32 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:18.105329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-94e89070-3af5-4767-a9bd-2d251b299b32 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:18.114241 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-94e89070-3af5-4767-a9bd-2d251b299b32 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.313524 Mar 05 20:54:18.125346 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 795/1690] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:17 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:18.132526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-712fd41d-7951-4aa7-89ec-78f63c3e36de tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:18.132791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-712fd41d-7951-4aa7-89ec-78f63c3e36de tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:18.141140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-712fd41d-7951-4aa7-89ec-78f63c3e36de tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:18.141907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-712fd41d-7951-4aa7-89ec-78f63c3e36de tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:18.143202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-712fd41d-7951-4aa7-89ec-78f63c3e36de tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:18.143952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-712fd41d-7951-4aa7-89ec-78f63c3e36de tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:18.344952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-712fd41d-7951-4aa7-89ec-78f63c3e36de tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:18.356976 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-712fd41d-7951-4aa7-89ec-78f63c3e36de tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.228400 Mar 05 20:54:18.366470 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 796/1691] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:18 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:18.366470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-2789a885-2935-4c8f-9498-460e58395e47 req-52a882a0-1339-4353-9d4b-9d0a52c1b837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b", "tag": "20167121-7ae4-4eaf-b943-f8a27843c51a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:18.374459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-2789a885-2935-4c8f-9498-460e58395e47 req-52a882a0-1339-4353-9d4b-9d0a52c1b837 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:18.374899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-2789a885-2935-4c8f-9498-460e58395e47 req-52a882a0-1339-4353-9d4b-9d0a52c1b837 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:18.388266 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-2789a885-2935-4c8f-9498-460e58395e47 req-52a882a0-1339-4353-9d4b-9d0a52c1b837 service nova] Creating event network-changed:20167121-7ae4-4eaf-b943-f8a27843c51a for instance 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b on nch2-master-1 Mar 05 20:54:18.393536 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-2789a885-2935-4c8f-9498-460e58395e47 req-52a882a0-1339-4353-9d4b-9d0a52c1b837 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033516 Mar 05 20:54:18.394558 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 797/1692] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:18.400361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c1ac7301-6a53-4c86-8220-d7c08666050b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:18.401216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c1ac7301-6a53-4c86-8220-d7c08666050b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:18.407979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c1ac7301-6a53-4c86-8220-d7c08666050b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:18.408436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c1ac7301-6a53-4c86-8220-d7c08666050b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:18.409217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c1ac7301-6a53-4c86-8220-d7c08666050b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:18.409833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c1ac7301-6a53-4c86-8220-d7c08666050b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:18.492084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bec9962b-3099-424d-b6a9-3addf8c2ae6a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:18.507281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bec9962b-3099-424d-b6a9-3addf8c2ae6a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:18.518439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bec9962b-3099-424d-b6a9-3addf8c2ae6a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:18.520368 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bec9962b-3099-424d-b6a9-3addf8c2ae6a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1362 microversion: 2.25 time: 0.874390 Mar 05 20:54:18.530501 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 896/1693] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:17 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1362 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:18.539580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5334ae07-e7b2-4ffc-8ddd-3b451babcc9a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:18.542860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5334ae07-e7b2-4ffc-8ddd-3b451babcc9a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:18.551457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5334ae07-e7b2-4ffc-8ddd-3b451babcc9a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:18.552872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5334ae07-e7b2-4ffc-8ddd-3b451babcc9a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:18.554344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5334ae07-e7b2-4ffc-8ddd-3b451babcc9a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:18.554961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5334ae07-e7b2-4ffc-8ddd-3b451babcc9a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:18.816218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5334ae07-e7b2-4ffc-8ddd-3b451babcc9a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de3173446b54d288bc94c8e49bb4120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6badaeb06194bf7a79309e9bad2e8b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:18.830473 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5334ae07-e7b2-4ffc-8ddd-3b451babcc9a tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 200 len: 1511 microversion: 2.1 time: 0.297799 Mar 05 20:54:18.831814 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 897/1694] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:18 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:18.839443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-d0e55ba4-3d84-4fd0-b0fd-f87de4d24367 req-229f0067-f78b-4bce-8d3f-f3ff87fee5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c9bb643-2491-47d8-9758-76f13e927450", "name": "network-vif-deleted", "tag": "39103012-a3fb-406c-a3d5-628b64bf136f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:18.852055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d0e55ba4-3d84-4fd0-b0fd-f87de4d24367 req-229f0067-f78b-4bce-8d3f-f3ff87fee5e8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:18.854381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d0e55ba4-3d84-4fd0-b0fd-f87de4d24367 req-229f0067-f78b-4bce-8d3f-f3ff87fee5e8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:18.873201 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-d0e55ba4-3d84-4fd0-b0fd-f87de4d24367 req-229f0067-f78b-4bce-8d3f-f3ff87fee5e8 service nova] Creating event network-vif-deleted:39103012-a3fb-406c-a3d5-628b64bf136f for instance 1c9bb643-2491-47d8-9758-76f13e927450 on nch2-master-1 Mar 05 20:54:18.882126 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-d0e55ba4-3d84-4fd0-b0fd-f87de4d24367 req-229f0067-f78b-4bce-8d3f-f3ff87fee5e8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047248 Mar 05 20:54:18.883041 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 898/1695] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:18.897031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3edf79fe-6b0a-421a-9431-11cded9e8de3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:18.898416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3edf79fe-6b0a-421a-9431-11cded9e8de3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:18.908211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3edf79fe-6b0a-421a-9431-11cded9e8de3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:18.908712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3edf79fe-6b0a-421a-9431-11cded9e8de3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:18.909631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3edf79fe-6b0a-421a-9431-11cded9e8de3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:18.909990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3edf79fe-6b0a-421a-9431-11cded9e8de3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:18.954183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c1ac7301-6a53-4c86-8220-d7c08666050b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:18.968755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c1ac7301-6a53-4c86-8220-d7c08666050b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:18.974442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c1ac7301-6a53-4c86-8220-d7c08666050b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:18.975953 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c1ac7301-6a53-4c86-8220-d7c08666050b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.580278 Mar 05 20:54:18.987179 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 798/1696] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:18 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:18.998314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-654eb6ac-6f4a-44c3-ad68-2b3bbb4b0106 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:19.003447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-654eb6ac-6f4a-44c3-ad68-2b3bbb4b0106 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:19.029973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-654eb6ac-6f4a-44c3-ad68-2b3bbb4b0106 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.032259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-654eb6ac-6f4a-44c3-ad68-2b3bbb4b0106 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.033187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-654eb6ac-6f4a-44c3-ad68-2b3bbb4b0106 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.036473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-654eb6ac-6f4a-44c3-ad68-2b3bbb4b0106 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.062047 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-654eb6ac-6f4a-44c3-ad68-2b3bbb4b0106 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Instance 1c9bb643-2491-47d8-9758-76f13e927450 could not be found. Mar 05 20:54:19.066010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-654eb6ac-6f4a-44c3-ad68-2b3bbb4b0106 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Instance 1c9bb643-2491-47d8-9758-76f13e927450 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:19.067726 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-654eb6ac-6f4a-44c3-ad68-2b3bbb4b0106 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 404 len: 111 microversion: 2.1 time: 0.079061 Mar 05 20:54:19.071844 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 799/1697] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:18 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:54:19.075052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cf482c7d-8c52-45d7-aeda-ca63f8097c32 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:19.075909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cf482c7d-8c52-45d7-aeda-ca63f8097c32 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:19.083590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf482c7d-8c52-45d7-aeda-ca63f8097c32 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.084291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf482c7d-8c52-45d7-aeda-ca63f8097c32 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.085313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf482c7d-8c52-45d7-aeda-ca63f8097c32 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.085865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf482c7d-8c52-45d7-aeda-ca63f8097c32 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.111483 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-cf482c7d-8c52-45d7-aeda-ca63f8097c32 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] HTTP exception thrown: Instance 8fed7313-ee78-4aa8-8df2-4ff9a776115f could not be found. Mar 05 20:54:19.112137 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cf482c7d-8c52-45d7-aeda-ca63f8097c32 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Returning 404 to user: Instance 8fed7313-ee78-4aa8-8df2-4ff9a776115f could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:19.114007 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cf482c7d-8c52-45d7-aeda-ca63f8097c32 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 404 len: 111 microversion: 2.21 time: 0.043773 Mar 05 20:54:19.119991 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 800/1698] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:19 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:54:19.127220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-490ae92d-bcbd-493b-80dc-1235ce552db6 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5d1a8b80>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:19.172890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3edf79fe-6b0a-421a-9431-11cded9e8de3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:19.180664 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3edf79fe-6b0a-421a-9431-11cded9e8de3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1325 microversion: 2.1 time: 0.295259 Mar 05 20:54:19.191510 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 899/1699] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:18 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1325 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:19.198315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ce38b4d4-9e0e-41a8-9114-cca64c8d07ad tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '.version_select at 0x7fed61b8bd30>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:19.199258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ce38b4d4-9e0e-41a8-9114-cca64c8d07ad tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:19.205362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce38b4d4-9e0e-41a8-9114-cca64c8d07ad tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.205908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce38b4d4-9e0e-41a8-9114-cca64c8d07ad tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.206998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce38b4d4-9e0e-41a8-9114-cca64c8d07ad tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.207317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce38b4d4-9e0e-41a8-9114-cca64c8d07ad tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.281867 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ce38b4d4-9e0e-41a8-9114-cca64c8d07ad tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.088372 Mar 05 20:54:19.282876 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 900/1700] 10.222.0.15 () {60 vars in 1336 bytes} [Sat Mar 5 20:54:19 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f/os-instance-actions => generated 611 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:54:19.288218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-56cbfec1-ab39-4275-b532-98e49e387f9e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:19.289141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-56cbfec1-ab39-4275-b532-98e49e387f9e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:19.297626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56cbfec1-ab39-4275-b532-98e49e387f9e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.297889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56cbfec1-ab39-4275-b532-98e49e387f9e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.298595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56cbfec1-ab39-4275-b532-98e49e387f9e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.299033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56cbfec1-ab39-4275-b532-98e49e387f9e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.458436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-56cbfec1-ab39-4275-b532-98e49e387f9e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:19.468235 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-56cbfec1-ab39-4275-b532-98e49e387f9e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.184151 Mar 05 20:54:19.470214 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 901/1701] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:19 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:19.475567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-88f049ce-0b44-4ba0-938d-9749cd089034 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:19.476612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-88f049ce-0b44-4ba0-938d-9749cd089034 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:19.481625 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-490ae92d-bcbd-493b-80dc-1235ce552db6 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/ce519741-0808-43df-9dc7-121b57f65881" status: 202 len: 0 microversion: 2.1 time: 0.359238 Mar 05 20:54:19.482213 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 801/1702] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:54:19 2022] DELETE /compute/v2.1/os-security-groups/ce519741-0808-43df-9dc7-121b57f65881 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:54:19.484855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88f049ce-0b44-4ba0-938d-9749cd089034 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.485509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88f049ce-0b44-4ba0-938d-9749cd089034 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.486677 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88f049ce-0b44-4ba0-938d-9749cd089034 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.487302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88f049ce-0b44-4ba0-938d-9749cd089034 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.488978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ee91e7e2-2621-49d3-95e7-de5076c73803 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:19.490319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ee91e7e2-2621-49d3-95e7-de5076c73803 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:19.507453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee91e7e2-2621-49d3-95e7-de5076c73803 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.507983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee91e7e2-2621-49d3-95e7-de5076c73803 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.508793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee91e7e2-2621-49d3-95e7-de5076c73803 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.510844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee91e7e2-2621-49d3-95e7-de5076c73803 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.520161 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-88f049ce-0b44-4ba0-938d-9749cd089034 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] HTTP exception thrown: Instance 8fed7313-ee78-4aa8-8df2-4ff9a776115f could not be found. Mar 05 20:54:19.521613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-88f049ce-0b44-4ba0-938d-9749cd089034 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Returning 404 to user: Instance 8fed7313-ee78-4aa8-8df2-4ff9a776115f could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:19.522627 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-88f049ce-0b44-4ba0-938d-9749cd089034 tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 404 len: 111 microversion: 2.21 time: 0.051166 Mar 05 20:54:19.523363 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 902/1703] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 20:54:19 2022] DELETE /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:54:19.534438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-17260f61-af30-40ec-aaaa-9616944b4d0a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed61b77e50>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:19.706977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ee91e7e2-2621-49d3-95e7-de5076c73803 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:19.716331 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ee91e7e2-2621-49d3-95e7-de5076c73803 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.232780 Mar 05 20:54:19.717803 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 802/1704] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:19 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:19.724104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6e614c56-682b-4055-9664-5c0444a6d37d tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:19.725010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6e614c56-682b-4055-9664-5c0444a6d37d tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] [instance: 8fed7313-ee78-4aa8-8df2-4ff9a776115f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:19.734731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e614c56-682b-4055-9664-5c0444a6d37d tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.735617 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e614c56-682b-4055-9664-5c0444a6d37d tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.736703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e614c56-682b-4055-9664-5c0444a6d37d tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.737390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e614c56-682b-4055-9664-5c0444a6d37d tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.760838 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-6e614c56-682b-4055-9664-5c0444a6d37d tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] HTTP exception thrown: Instance 8fed7313-ee78-4aa8-8df2-4ff9a776115f could not be found. Mar 05 20:54:19.761476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6e614c56-682b-4055-9664-5c0444a6d37d tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] Returning 404 to user: Instance 8fed7313-ee78-4aa8-8df2-4ff9a776115f could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:19.762556 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6e614c56-682b-4055-9664-5c0444a6d37d tempest-InstanceActionsV221TestJSON-181571016 tempest-InstanceActionsV221TestJSON-181571016-project] 10.222.0.15 "GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f" status: 404 len: 111 microversion: 2.21 time: 0.043520 Mar 05 20:54:19.763850 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-17260f61-af30-40ec-aaaa-9616944b4d0a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8" status: 202 len: 0 microversion: 2.1 time: 0.235029 Mar 05 20:54:19.764192 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 803/1705] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:19 2022] GET /compute/v2.1/servers/8fed7313-ee78-4aa8-8df2-4ff9a776115f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:54:19.764456 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 903/1706] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:54:19 2022] DELETE /compute/v2.1/os-security-groups/c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:54:19.769625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c9bfc777-a4d0-4324-80cb-23e81e2393d7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:19.770425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c9bfc777-a4d0-4324-80cb-23e81e2393d7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:19.780331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5d14a4fa-1596-40f8-975d-fa43d2f718cb tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'create', calling method: .version_select at 0x7fed5ce76e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1499976688", "description": "tempest-description-710868906"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:19.788374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c9bfc777-a4d0-4324-80cb-23e81e2393d7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.792093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c9bfc777-a4d0-4324-80cb-23e81e2393d7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.794405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c9bfc777-a4d0-4324-80cb-23e81e2393d7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.794984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c9bfc777-a4d0-4324-80cb-23e81e2393d7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:19.982493 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5d14a4fa-1596-40f8-975d-fa43d2f718cb tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.206464 Mar 05 20:54:19.983165 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 904/1707] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:54:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:19.988810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-2fcd4cb3-cfa2-4488-af28-cb1ab536dba9 req-c95df9a3-3693-4727-b462-0ab6c0320bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-plugged", "status": "completed", "tag": "5866fc79-fac2-4bd2-978f-c689c32b9c03"}, {"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-plugged", "status": "completed", "tag": "ef356e17-c442-448a-8679-da5ba1910c00"}, {"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-plugged", "status": "completed", "tag": "3cb0d38e-d7d1-417d-8eb1-bc1f3f7cf239"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:19.998822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2fcd4cb3-cfa2-4488-af28-cb1ab536dba9 req-c95df9a3-3693-4727-b462-0ab6c0320bc1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:19.999640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2fcd4cb3-cfa2-4488-af28-cb1ab536dba9 req-c95df9a3-3693-4727-b462-0ab6c0320bc1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:20.012081 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-2fcd4cb3-cfa2-4488-af28-cb1ab536dba9 req-c95df9a3-3693-4727-b462-0ab6c0320bc1 service nova] Creating event network-vif-plugged:5866fc79-fac2-4bd2-978f-c689c32b9c03 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:54:20.013392 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-2fcd4cb3-cfa2-4488-af28-cb1ab536dba9 req-c95df9a3-3693-4727-b462-0ab6c0320bc1 service nova] Creating event network-vif-plugged:ef356e17-c442-448a-8679-da5ba1910c00 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:54:20.014394 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-2fcd4cb3-cfa2-4488-af28-cb1ab536dba9 req-c95df9a3-3693-4727-b462-0ab6c0320bc1 service nova] Creating event network-vif-plugged:3cb0d38e-d7d1-417d-8eb1-bc1f3f7cf239 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:54:20.022726 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-2fcd4cb3-cfa2-4488-af28-cb1ab536dba9 req-c95df9a3-3693-4727-b462-0ab6c0320bc1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037732 Mar 05 20:54:20.024639 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 905/1708] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:20.030771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b3497ee4-2ba3-4ec9-850d-5105f863688d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:20.031474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b3497ee4-2ba3-4ec9-850d-5105f863688d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] [instance: aba11c91-fc0e-41d6-8efd-fddeb4132869] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:20.038122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3497ee4-2ba3-4ec9-850d-5105f863688d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:20.038575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3497ee4-2ba3-4ec9-850d-5105f863688d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:20.039352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3497ee4-2ba3-4ec9-850d-5105f863688d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:20.039824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3497ee4-2ba3-4ec9-850d-5105f863688d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:20.061119 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-b3497ee4-2ba3-4ec9-850d-5105f863688d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] HTTP exception thrown: Instance aba11c91-fc0e-41d6-8efd-fddeb4132869 could not be found. Mar 05 20:54:20.061731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b3497ee4-2ba3-4ec9-850d-5105f863688d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] Returning 404 to user: Instance aba11c91-fc0e-41d6-8efd-fddeb4132869 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:20.063872 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b3497ee4-2ba3-4ec9-850d-5105f863688d tempest-ServerAddressesTestJSON-1543404289 tempest-ServerAddressesTestJSON-1543404289-project] 10.222.0.15 "GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869" status: 404 len: 111 microversion: 2.1 time: 0.036017 Mar 05 20:54:20.064218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c9bfc777-a4d0-4324-80cb-23e81e2393d7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:20.066775 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 906/1709] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:20 2022] GET /compute/v2.1/servers/aba11c91-fc0e-41d6-8efd-fddeb4132869 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:54:20.073515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2f300aa8-833b-4e28-adcf-6f6420610dfd tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Action: 'update', calling method: .version_select at 0x7fed5c4c49d0>, body: {"security_group": {"name": "tempest-sg-hth-1107629796", "description": "tempest-description-hth-1014121377"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:20.077384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c9bfc777-a4d0-4324-80cb-23e81e2393d7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:20.079247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c9bfc777-a4d0-4324-80cb-23e81e2393d7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:20.080621 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c9bfc777-a4d0-4324-80cb-23e81e2393d7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1362 microversion: 2.25 time: 0.314856 Mar 05 20:54:20.093499 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 804/1710] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:19 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:20.098944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e0b637db-d691-4ee5-ac58-0bd2287480dd tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:20.099580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e0b637db-d691-4ee5-ac58-0bd2287480dd tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:20.108390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e0b637db-d691-4ee5-ac58-0bd2287480dd tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:20.108861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e0b637db-d691-4ee5-ac58-0bd2287480dd tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:20.109654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e0b637db-d691-4ee5-ac58-0bd2287480dd tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:20.110371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e0b637db-d691-4ee5-ac58-0bd2287480dd tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:20.387021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e0b637db-d691-4ee5-ac58-0bd2287480dd tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:20.397395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e0b637db-d691-4ee5-ac58-0bd2287480dd tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:20.399201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e0b637db-d691-4ee5-ac58-0bd2287480dd tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:20.401852 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e0b637db-d691-4ee5-ac58-0bd2287480dd tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.306984 Mar 05 20:54:20.402901 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 805/1711] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:20 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:20.409012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-53233181-4d39-4f3d-95da-a7e13bc8095b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:20.410629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-53233181-4d39-4f3d-95da-a7e13bc8095b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:20.419639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53233181-4d39-4f3d-95da-a7e13bc8095b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:20.420507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53233181-4d39-4f3d-95da-a7e13bc8095b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:20.421623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53233181-4d39-4f3d-95da-a7e13bc8095b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:20.422462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53233181-4d39-4f3d-95da-a7e13bc8095b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:20.480057 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2f300aa8-833b-4e28-adcf-6f6420610dfd tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "PUT /compute/v2.1/os-security-groups/c6841116-2b4f-45a6-919f-9d2c56c07a78" status: 200 len: 218 microversion: 2.1 time: 0.410825 Mar 05 20:54:20.488491 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 907/1712] 10.222.0.15 () {60 vars in 1289 bytes} [Sat Mar 5 20:54:20 2022] PUT /compute/v2.1/os-security-groups/c6841116-2b4f-45a6-919f-9d2c56c07a78 => generated 218 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:20.500003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7a2b627b-43cf-4f89-a606-445ce84f7e75 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:20.503180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7a2b627b-43cf-4f89-a606-445ce84f7e75 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:20.517042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a2b627b-43cf-4f89-a606-445ce84f7e75 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:20.518245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a2b627b-43cf-4f89-a606-445ce84f7e75 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:20.520168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a2b627b-43cf-4f89-a606-445ce84f7e75 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:20.520803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a2b627b-43cf-4f89-a606-445ce84f7e75 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:20.666460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-53233181-4d39-4f3d-95da-a7e13bc8095b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:20.674443 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-53233181-4d39-4f3d-95da-a7e13bc8095b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1325 microversion: 2.1 time: 0.269636 Mar 05 20:54:20.675742 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 806/1713] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:20 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1325 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:20.680875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-759097aa-a1c0-48d4-a3e7-7d42cb566e16 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5cfe2dc0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:20.740998 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-759097aa-a1c0-48d4-a3e7-7d42cb566e16 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/os-security-groups/c6841116-2b4f-45a6-919f-9d2c56c07a78" status: 200 len: 218 microversion: 2.1 time: 0.063865 Mar 05 20:54:20.741829 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 807/1714] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 20:54:20 2022] GET /compute/v2.1/os-security-groups/c6841116-2b4f-45a6-919f-9d2c56c07a78 => generated 218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:20.747754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5cb14277-e7a1-462e-982c-9f34cd281a2e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:20.748455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5cb14277-e7a1-462e-982c-9f34cd281a2e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:20.760273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cb14277-e7a1-462e-982c-9f34cd281a2e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:20.760781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cb14277-e7a1-462e-982c-9f34cd281a2e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:20.761610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cb14277-e7a1-462e-982c-9f34cd281a2e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:20.762066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cb14277-e7a1-462e-982c-9f34cd281a2e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:20.914072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7a2b627b-43cf-4f89-a606-445ce84f7e75 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:20.921835 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7a2b627b-43cf-4f89-a606-445ce84f7e75 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.430877 Mar 05 20:54:20.922427 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 908/1715] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:20 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:20.930146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6dc90149-79c9-4c4f-8fd9-10c0b6d904a8 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed61b77940>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:20.993919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5cb14277-e7a1-462e-982c-9f34cd281a2e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:21.003298 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5cb14277-e7a1-462e-982c-9f34cd281a2e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.260287 Mar 05 20:54:21.004464 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 808/1716] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:20 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:21.011302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-572f85d2-b9fa-42ad-84d9-c253fc693784 req-af4d65ce-e0a1-479b-ba5e-832c5e3a6b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fed7313-ee78-4aa8-8df2-4ff9a776115f", "name": "network-vif-deleted", "tag": "2e2be274-47ed-4b4e-a0f7-f1971d3394d2"}, {"server_uuid": "aba11c91-fc0e-41d6-8efd-fddeb4132869", "name": "network-vif-deleted", "tag": "6ab2be74-857e-4e38-ad99-97dbaa1f820d"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:21.022661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-572f85d2-b9fa-42ad-84d9-c253fc693784 req-af4d65ce-e0a1-479b-ba5e-832c5e3a6b2d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.022862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-572f85d2-b9fa-42ad-84d9-c253fc693784 req-af4d65ce-e0a1-479b-ba5e-832c5e3a6b2d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.038265 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-572f85d2-b9fa-42ad-84d9-c253fc693784 req-af4d65ce-e0a1-479b-ba5e-832c5e3a6b2d service nova] Creating event network-vif-deleted:2e2be274-47ed-4b4e-a0f7-f1971d3394d2 for instance 8fed7313-ee78-4aa8-8df2-4ff9a776115f on nch1-master-1 Mar 05 20:54:21.038612 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-572f85d2-b9fa-42ad-84d9-c253fc693784 req-af4d65ce-e0a1-479b-ba5e-832c5e3a6b2d service nova] Creating event network-vif-deleted:6ab2be74-857e-4e38-ad99-97dbaa1f820d for instance aba11c91-fc0e-41d6-8efd-fddeb4132869 on nch2-master-1 Mar 05 20:54:21.048330 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-572f85d2-b9fa-42ad-84d9-c253fc693784 req-af4d65ce-e0a1-479b-ba5e-832c5e3a6b2d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042090 Mar 05 20:54:21.049307 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 809/1717] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:21.111179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b5310d30-b784-41f7-a742-499c4bfb2ca3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.112948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b5310d30-b784-41f7-a742-499c4bfb2ca3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:21.124044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5310d30-b784-41f7-a742-499c4bfb2ca3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.125182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5310d30-b784-41f7-a742-499c4bfb2ca3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.133016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5310d30-b784-41f7-a742-499c4bfb2ca3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.133891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5310d30-b784-41f7-a742-499c4bfb2ca3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.279364 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6dc90149-79c9-4c4f-8fd9-10c0b6d904a8 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/c6841116-2b4f-45a6-919f-9d2c56c07a78" status: 202 len: 0 microversion: 2.1 time: 0.355100 Mar 05 20:54:21.280341 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 909/1718] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:54:20 2022] DELETE /compute/v2.1/os-security-groups/c6841116-2b4f-45a6-919f-9d2c56c07a78 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:54:21.289100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1d6e7275-1b47-41c0-8dc4-bab5f56df7d0 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.290077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1d6e7275-1b47-41c0-8dc4-bab5f56df7d0 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:21.302275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d6e7275-1b47-41c0-8dc4-bab5f56df7d0 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.302755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d6e7275-1b47-41c0-8dc4-bab5f56df7d0 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.307785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d6e7275-1b47-41c0-8dc4-bab5f56df7d0 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.308175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d6e7275-1b47-41c0-8dc4-bab5f56df7d0 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.327587 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-1d6e7275-1b47-41c0-8dc4-bab5f56df7d0 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Instance 1c9bb643-2491-47d8-9758-76f13e927450 could not be found. Mar 05 20:54:21.328451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1d6e7275-1b47-41c0-8dc4-bab5f56df7d0 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Instance 1c9bb643-2491-47d8-9758-76f13e927450 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:21.329485 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1d6e7275-1b47-41c0-8dc4-bab5f56df7d0 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 404 len: 111 microversion: 2.1 time: 0.045157 Mar 05 20:54:21.330536 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 910/1719] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:54:21 2022] DELETE /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:54:21.340198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-775616e7-1fc7-4225-9ea9-dcdc42f18d62 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.341218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-775616e7-1fc7-4225-9ea9-dcdc42f18d62 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1c9bb643-2491-47d8-9758-76f13e927450] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:21.347597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-775616e7-1fc7-4225-9ea9-dcdc42f18d62 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.348431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-775616e7-1fc7-4225-9ea9-dcdc42f18d62 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.349955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-775616e7-1fc7-4225-9ea9-dcdc42f18d62 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.350568 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-775616e7-1fc7-4225-9ea9-dcdc42f18d62 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.366742 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-775616e7-1fc7-4225-9ea9-dcdc42f18d62 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Instance 1c9bb643-2491-47d8-9758-76f13e927450 could not be found. Mar 05 20:54:21.367650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-775616e7-1fc7-4225-9ea9-dcdc42f18d62 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Instance 1c9bb643-2491-47d8-9758-76f13e927450 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:21.369098 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-775616e7-1fc7-4225-9ea9-dcdc42f18d62 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450" status: 404 len: 111 microversion: 2.1 time: 0.034258 Mar 05 20:54:21.370205 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 911/1720] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:21 2022] GET /compute/v2.1/servers/1c9bb643-2491-47d8-9758-76f13e927450 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:54:21.382024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-388e7cd1-f095-4f1f-ad89-768981dc9bf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c42ce50>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.415154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG neutronclient.v2_0.client [None req-388e7cd1-f095-4f1f-ad89-768981dc9bf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8 does not exist", "detail": ""}} {{(pid=141479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:54:21.416852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.security_group_api [None req-388e7cd1-f095-4f1f-ad89-768981dc9bf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Neutron security group c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8 not found {{(pid=141479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:54:21.417376 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-388e7cd1-f095-4f1f-ad89-768981dc9bf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Security group c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8 does not exist Mar 05 20:54:21.417376 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-1de317a8-0a1d-4d61-b057-36912fed7b2e'] Mar 05 20:54:21.418091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-388e7cd1-f095-4f1f-ad89-768981dc9bf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Security group c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8 does not exist Mar 05 20:54:21.418091 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-1de317a8-0a1d-4d61-b057-36912fed7b2e'] {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:21.418996 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-388e7cd1-f095-4f1f-ad89-768981dc9bf7 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8" status: 404 len: 194 microversion: 2.1 time: 0.041734 Mar 05 20:54:21.421661 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 912/1721] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:54:21 2022] DELETE /compute/v2.1/os-security-groups/c43c0fc9-b4e0-439a-8fcb-9a3afd2551f8 => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:54:21.427535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b5310d30-b784-41f7-a742-499c4bfb2ca3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:21.427838 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7afa6314-d2b6-430b-a330-9765b9b7bdce tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.428376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7afa6314-d2b6-430b-a330-9765b9b7bdce tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:21.437614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b5310d30-b784-41f7-a742-499c4bfb2ca3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:21.439553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b5310d30-b784-41f7-a742-499c4bfb2ca3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:21.441106 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b5310d30-b784-41f7-a742-499c4bfb2ca3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1362 microversion: 2.25 time: 0.343843 Mar 05 20:54:21.441676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7afa6314-d2b6-430b-a330-9765b9b7bdce tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.441833 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 810/1722] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:21 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:21.442523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7afa6314-d2b6-430b-a330-9765b9b7bdce tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.443527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7afa6314-d2b6-430b-a330-9765b9b7bdce tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.444395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7afa6314-d2b6-430b-a330-9765b9b7bdce tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.447190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6bf3797-fc35-45bb-8304-62543041bdb2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c510280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.499379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-c6bf3797-fc35-45bb-8304-62543041bdb2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ce519741-0808-43df-9dc7-121b57f65881 does not exist", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:54:21.500289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.security_group_api [None req-c6bf3797-fc35-45bb-8304-62543041bdb2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Neutron security group ce519741-0808-43df-9dc7-121b57f65881 not found {{(pid=141478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:54:21.501452 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-c6bf3797-fc35-45bb-8304-62543041bdb2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Security group ce519741-0808-43df-9dc7-121b57f65881 does not exist Mar 05 20:54:21.501452 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-c799c0d8-2ea2-4b2d-9ba2-91ad5c9cceba'] Mar 05 20:54:21.502336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6bf3797-fc35-45bb-8304-62543041bdb2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Security group ce519741-0808-43df-9dc7-121b57f65881 does not exist Mar 05 20:54:21.502336 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-c799c0d8-2ea2-4b2d-9ba2-91ad5c9cceba'] {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:21.503556 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c6bf3797-fc35-45bb-8304-62543041bdb2 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/ce519741-0808-43df-9dc7-121b57f65881" status: 404 len: 194 microversion: 2.1 time: 0.060827 Mar 05 20:54:21.504707 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 811/1723] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:54:21 2022] DELETE /compute/v2.1/os-security-groups/ce519741-0808-43df-9dc7-121b57f65881 => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:54:21.513103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2acb2217-cc97-4708-8879-e7d4c4406774 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5d2ca9d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.551327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-2acb2217-cc97-4708-8879-e7d4c4406774 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c824e870-7a76-4d8e-a945-34bebbe65d56 does not exist", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:54:21.552013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.security_group_api [None req-2acb2217-cc97-4708-8879-e7d4c4406774 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Neutron security group c824e870-7a76-4d8e-a945-34bebbe65d56 not found {{(pid=141478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:54:21.552536 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-2acb2217-cc97-4708-8879-e7d4c4406774 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Security group c824e870-7a76-4d8e-a945-34bebbe65d56 does not exist Mar 05 20:54:21.552536 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-96110d11-1ae0-45f7-8b55-d24d9b5a3a65'] Mar 05 20:54:21.554313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2acb2217-cc97-4708-8879-e7d4c4406774 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Security group c824e870-7a76-4d8e-a945-34bebbe65d56 does not exist Mar 05 20:54:21.554313 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-96110d11-1ae0-45f7-8b55-d24d9b5a3a65'] {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:21.555444 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2acb2217-cc97-4708-8879-e7d4c4406774 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/c824e870-7a76-4d8e-a945-34bebbe65d56" status: 404 len: 194 microversion: 2.1 time: 0.047017 Mar 05 20:54:21.557509 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 812/1724] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:54:21 2022] DELETE /compute/v2.1/os-security-groups/c824e870-7a76-4d8e-a945-34bebbe65d56 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:54:21.570243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f62c9b9f-7664-4aaf-8bee-3cbc1f029ef1 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c7d4790>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.611428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-f62c9b9f-7664-4aaf-8bee-3cbc1f029ef1 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f25b682a-b85a-4260-83ce-f021216c56f5 does not exist", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:54:21.612218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.security_group_api [None req-f62c9b9f-7664-4aaf-8bee-3cbc1f029ef1 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Neutron security group f25b682a-b85a-4260-83ce-f021216c56f5 not found {{(pid=141478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:54:21.613300 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-f62c9b9f-7664-4aaf-8bee-3cbc1f029ef1 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Security group f25b682a-b85a-4260-83ce-f021216c56f5 does not exist Mar 05 20:54:21.613300 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-61da08a9-c2ad-4b1c-bf81-3bba75f100d2'] Mar 05 20:54:21.613989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f62c9b9f-7664-4aaf-8bee-3cbc1f029ef1 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Security group f25b682a-b85a-4260-83ce-f021216c56f5 does not exist Mar 05 20:54:21.613989 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-61da08a9-c2ad-4b1c-bf81-3bba75f100d2'] {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:21.614924 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f62c9b9f-7664-4aaf-8bee-3cbc1f029ef1 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/f25b682a-b85a-4260-83ce-f021216c56f5" status: 404 len: 194 microversion: 2.1 time: 0.053057 Mar 05 20:54:21.615839 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 813/1725] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:54:21 2022] DELETE /compute/v2.1/os-security-groups/f25b682a-b85a-4260-83ce-f021216c56f5 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:54:21.623986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-023166d2-bfb4-4f29-8de9-620cae9e77c3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c78c790>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.672672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-023166d2-bfb4-4f29-8de9-620cae9e77c3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0659106f-d0f9-4a0b-a9e2-00bec915f465 does not exist", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:54:21.673475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.security_group_api [None req-023166d2-bfb4-4f29-8de9-620cae9e77c3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Neutron security group 0659106f-d0f9-4a0b-a9e2-00bec915f465 not found {{(pid=141478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:54:21.674199 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-023166d2-bfb4-4f29-8de9-620cae9e77c3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Security group 0659106f-d0f9-4a0b-a9e2-00bec915f465 does not exist Mar 05 20:54:21.674199 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-65c4869f-0beb-4aa2-8ab4-dc9c1fd6a86b'] Mar 05 20:54:21.675051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-023166d2-bfb4-4f29-8de9-620cae9e77c3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Security group 0659106f-d0f9-4a0b-a9e2-00bec915f465 does not exist Mar 05 20:54:21.675051 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-65c4869f-0beb-4aa2-8ab4-dc9c1fd6a86b'] {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:21.676180 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-023166d2-bfb4-4f29-8de9-620cae9e77c3 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/0659106f-d0f9-4a0b-a9e2-00bec915f465" status: 404 len: 194 microversion: 2.1 time: 0.056164 Mar 05 20:54:21.680141 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 814/1726] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:54:21 2022] DELETE /compute/v2.1/os-security-groups/0659106f-d0f9-4a0b-a9e2-00bec915f465 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:54:21.689680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-78e65168-023d-4936-8df7-20ea76f57f64 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c589550>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.722793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-78e65168-023d-4936-8df7-20ea76f57f64 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3604fb65-d255-47cb-a6fb-19bee0381487 does not exist", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:54:21.723588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.security_group_api [None req-78e65168-023d-4936-8df7-20ea76f57f64 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Neutron security group 3604fb65-d255-47cb-a6fb-19bee0381487 not found {{(pid=141478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 20:54:21.724317 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-78e65168-023d-4936-8df7-20ea76f57f64 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Security group 3604fb65-d255-47cb-a6fb-19bee0381487 does not exist Mar 05 20:54:21.724317 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-76113dd2-e641-49cc-9c3c-0c1be7217b5b'] Mar 05 20:54:21.725163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-78e65168-023d-4936-8df7-20ea76f57f64 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Security group 3604fb65-d255-47cb-a6fb-19bee0381487 does not exist Mar 05 20:54:21.725163 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-76113dd2-e641-49cc-9c3c-0c1be7217b5b'] {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:21.726231 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-78e65168-023d-4936-8df7-20ea76f57f64 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/3604fb65-d255-47cb-a6fb-19bee0381487" status: 404 len: 194 microversion: 2.1 time: 0.042966 Mar 05 20:54:21.734714 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 815/1727] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:54:21 2022] DELETE /compute/v2.1/os-security-groups/3604fb65-d255-47cb-a6fb-19bee0381487 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:54:21.736781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41f554d2-8ed9-4adb-b073-bb2a6dfcea2b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.737404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-41f554d2-8ed9-4adb-b073-bb2a6dfcea2b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:21.746214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41f554d2-8ed9-4adb-b073-bb2a6dfcea2b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.746714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41f554d2-8ed9-4adb-b073-bb2a6dfcea2b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.747609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41f554d2-8ed9-4adb-b073-bb2a6dfcea2b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.748107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41f554d2-8ed9-4adb-b073-bb2a6dfcea2b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.771332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7afa6314-d2b6-430b-a330-9765b9b7bdce tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:21.786998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7afa6314-d2b6-430b-a330-9765b9b7bdce tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:21.791424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7afa6314-d2b6-430b-a330-9765b9b7bdce tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:21.793455 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7afa6314-d2b6-430b-a330-9765b9b7bdce tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.370574 Mar 05 20:54:21.794140 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 913/1728] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:21 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:21.800724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-06b2d8ee-6c6a-46f0-b948-9d2453fcea93 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.801550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-06b2d8ee-6c6a-46f0-b948-9d2453fcea93 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:21.809492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06b2d8ee-6c6a-46f0-b948-9d2453fcea93 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.810035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06b2d8ee-6c6a-46f0-b948-9d2453fcea93 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.811866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06b2d8ee-6c6a-46f0-b948-9d2453fcea93 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.813005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06b2d8ee-6c6a-46f0-b948-9d2453fcea93 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.845677 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-06b2d8ee-6c6a-46f0-b948-9d2453fcea93 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:54:21.937855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-41f554d2-8ed9-4adb-b073-bb2a6dfcea2b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:21.952900 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-41f554d2-8ed9-4adb-b073-bb2a6dfcea2b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1325 microversion: 2.1 time: 0.219905 Mar 05 20:54:21.953888 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 816/1729] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:21 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1325 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:21.958524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8ece2e5f-c69f-4d81-970b-06d9d4a8477b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.959524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8ece2e5f-c69f-4d81-970b-06d9d4a8477b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:21.967826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8ece2e5f-c69f-4d81-970b-06d9d4a8477b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.968518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8ece2e5f-c69f-4d81-970b-06d9d4a8477b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.971260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8ece2e5f-c69f-4d81-970b-06d9d4a8477b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:21.971658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8ece2e5f-c69f-4d81-970b-06d9d4a8477b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:21.987004 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-06b2d8ee-6c6a-46f0-b948-9d2453fcea93 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c" status: 204 len: 0 microversion: 2.1 time: 0.190529 Mar 05 20:54:21.991467 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 914/1730] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:54:21 2022] DELETE /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:54:21.998862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e4c1aebc-9bc2-4008-b670-7b148127d042 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:21.999632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e4c1aebc-9bc2-4008-b670-7b148127d042 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:22.006819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4c1aebc-9bc2-4008-b670-7b148127d042 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:22.007280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4c1aebc-9bc2-4008-b670-7b148127d042 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:22.008143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4c1aebc-9bc2-4008-b670-7b148127d042 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:22.008616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4c1aebc-9bc2-4008-b670-7b148127d042 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:22.151023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8ece2e5f-c69f-4d81-970b-06d9d4a8477b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:22.159434 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8ece2e5f-c69f-4d81-970b-06d9d4a8477b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1477 microversion: 2.1 time: 0.204524 Mar 05 20:54:22.160535 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 817/1731] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:21 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1477 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:22.165138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-712b8763-2265-469d-9b0c-2c59afc55e06 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:22.166097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-712b8763-2265-469d-9b0c-2c59afc55e06 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:22.172045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-712b8763-2265-469d-9b0c-2c59afc55e06 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:22.172771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-712b8763-2265-469d-9b0c-2c59afc55e06 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:22.174119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-712b8763-2265-469d-9b0c-2c59afc55e06 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:22.175373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-712b8763-2265-469d-9b0c-2c59afc55e06 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:22.202354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e4c1aebc-9bc2-4008-b670-7b148127d042 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:22.211802 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e4c1aebc-9bc2-4008-b670-7b148127d042 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c" status: 200 len: 1646 microversion: 2.1 time: 0.218560 Mar 05 20:54:22.212772 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 915/1732] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:21 2022] GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c => generated 1646 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:22.228588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-05168562-2ebe-4092-99d0-9fbfb70eca8a req-87a390e4-aa6b-4135-9360-bcf21431f50b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-plugged", "status": "completed", "tag": "b9701cfb-119e-4040-a711-f90621bd7b80"}, {"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-plugged", "status": "completed", "tag": "2c1807e8-ead9-44e9-ab65-390e42b1ded8"}, {"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-plugged", "status": "completed", "tag": "8e97203d-117b-4a26-8c1e-33c77fbdf3ce"}, {"server_uuid": "019a8023-9015-41ae-974a-eb725177770d", "name": "network-vif-plugged", "status": "completed", "tag": "38ee5a79-ec27-42bc-985c-95ae7544d810"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:22.239121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-05168562-2ebe-4092-99d0-9fbfb70eca8a req-87a390e4-aa6b-4135-9360-bcf21431f50b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:22.239867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-05168562-2ebe-4092-99d0-9fbfb70eca8a req-87a390e4-aa6b-4135-9360-bcf21431f50b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:22.258227 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-05168562-2ebe-4092-99d0-9fbfb70eca8a req-87a390e4-aa6b-4135-9360-bcf21431f50b service nova] Creating event network-vif-plugged:b9701cfb-119e-4040-a711-f90621bd7b80 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:54:22.259075 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-05168562-2ebe-4092-99d0-9fbfb70eca8a req-87a390e4-aa6b-4135-9360-bcf21431f50b service nova] Creating event network-vif-plugged:2c1807e8-ead9-44e9-ab65-390e42b1ded8 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:54:22.259963 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-05168562-2ebe-4092-99d0-9fbfb70eca8a req-87a390e4-aa6b-4135-9360-bcf21431f50b service nova] Creating event network-vif-plugged:8e97203d-117b-4a26-8c1e-33c77fbdf3ce for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:54:22.260780 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-05168562-2ebe-4092-99d0-9fbfb70eca8a req-87a390e4-aa6b-4135-9360-bcf21431f50b service nova] Creating event network-vif-plugged:38ee5a79-ec27-42bc-985c-95ae7544d810 for instance 019a8023-9015-41ae-974a-eb725177770d on nch2-master-1 Mar 05 20:54:22.271543 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-05168562-2ebe-4092-99d0-9fbfb70eca8a req-87a390e4-aa6b-4135-9360-bcf21431f50b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.047807 Mar 05 20:54:22.273092 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 916/1733] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:22.346780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-712b8763-2265-469d-9b0c-2c59afc55e06 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:22.357395 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-712b8763-2265-469d-9b0c-2c59afc55e06 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1497 microversion: 2.1 time: 0.195311 Mar 05 20:54:22.372421 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 818/1734] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:22 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:22.462955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8f374613-ca08-442f-a95c-ca25dc92d481 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:22.463887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8f374613-ca08-442f-a95c-ca25dc92d481 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:22.471525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f374613-ca08-442f-a95c-ca25dc92d481 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:22.472346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f374613-ca08-442f-a95c-ca25dc92d481 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:22.473347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f374613-ca08-442f-a95c-ca25dc92d481 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:22.473994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f374613-ca08-442f-a95c-ca25dc92d481 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:22.626303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8f374613-ca08-442f-a95c-ca25dc92d481 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:22.635074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8f374613-ca08-442f-a95c-ca25dc92d481 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:22.636609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8f374613-ca08-442f-a95c-ca25dc92d481 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:22.638082 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8f374613-ca08-442f-a95c-ca25dc92d481 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1362 microversion: 2.25 time: 0.182066 Mar 05 20:54:22.638654 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 917/1735] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:22 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:22.813177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8422f8e4-a2bd-4302-985a-8b0de9f0b4b6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:22.813800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8422f8e4-a2bd-4302-985a-8b0de9f0b4b6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:22.836519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8422f8e4-a2bd-4302-985a-8b0de9f0b4b6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:22.838641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8422f8e4-a2bd-4302-985a-8b0de9f0b4b6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:22.839730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8422f8e4-a2bd-4302-985a-8b0de9f0b4b6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:22.840743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8422f8e4-a2bd-4302-985a-8b0de9f0b4b6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:22.973351 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-54a4f8c2-0091-48af-8cd4-4792e69ab9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:22.974058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-54a4f8c2-0091-48af-8cd4-4792e69ab9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:22.988378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-54a4f8c2-0091-48af-8cd4-4792e69ab9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:22.988850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-54a4f8c2-0091-48af-8cd4-4792e69ab9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:22.990530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-54a4f8c2-0091-48af-8cd4-4792e69ab9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:22.991425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-54a4f8c2-0091-48af-8cd4-4792e69ab9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:23.231363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8422f8e4-a2bd-4302-985a-8b0de9f0b4b6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:23.240846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8422f8e4-a2bd-4302-985a-8b0de9f0b4b6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:23.242376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8422f8e4-a2bd-4302-985a-8b0de9f0b4b6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:23.243815 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8422f8e4-a2bd-4302-985a-8b0de9f0b4b6 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1874 microversion: 2.32 time: 0.434736 Mar 05 20:54:23.245086 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 819/1736] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:22 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1874 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:23.249997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eee7373d-d224-4f66-ba66-507c5a83786e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:23.250814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eee7373d-d224-4f66-ba66-507c5a83786e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:23.257606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eee7373d-d224-4f66-ba66-507c5a83786e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:23.258055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eee7373d-d224-4f66-ba66-507c5a83786e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:23.259610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eee7373d-d224-4f66-ba66-507c5a83786e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:23.260232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eee7373d-d224-4f66-ba66-507c5a83786e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:23.320582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-54a4f8c2-0091-48af-8cd4-4792e69ab9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:23.334982 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-54a4f8c2-0091-48af-8cd4-4792e69ab9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1325 microversion: 2.1 time: 0.367214 Mar 05 20:54:23.335813 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 918/1737] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:22 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1325 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:23.343192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e44867d8-9d1c-4071-8089-f1dea97c8d7a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:23.344120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e44867d8-9d1c-4071-8089-f1dea97c8d7a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:23.350846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e44867d8-9d1c-4071-8089-f1dea97c8d7a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:23.351297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e44867d8-9d1c-4071-8089-f1dea97c8d7a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:23.352309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e44867d8-9d1c-4071-8089-f1dea97c8d7a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:23.352945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e44867d8-9d1c-4071-8089-f1dea97c8d7a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:23.652918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e44867d8-9d1c-4071-8089-f1dea97c8d7a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31812fbb5c6142a8ab6068b1464ae2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f07583be1724ade87d2945c000e3e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:23.663242 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e44867d8-9d1c-4071-8089-f1dea97c8d7a tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c" status: 200 len: 1646 microversion: 2.1 time: 0.325726 Mar 05 20:54:23.664069 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 919/1738] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:23 2022] GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c => generated 1646 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:23.669702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c344067-26a1-49ee-a319-0389251c18dc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:23.686586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9c344067-26a1-49ee-a319-0389251c18dc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:23.711615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c344067-26a1-49ee-a319-0389251c18dc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:23.712845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c344067-26a1-49ee-a319-0389251c18dc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:23.713655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c344067-26a1-49ee-a319-0389251c18dc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:23.713957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c344067-26a1-49ee-a319-0389251c18dc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:23.726500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eee7373d-d224-4f66-ba66-507c5a83786e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:23.736104 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eee7373d-d224-4f66-ba66-507c5a83786e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1476 microversion: 2.1 time: 0.489688 Mar 05 20:54:23.750225 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 820/1739] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:23 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1476 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:23.767161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dcd735e4-fa6a-4d8a-a776-0337a08a5b5f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:23.771596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dcd735e4-fa6a-4d8a-a776-0337a08a5b5f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:23.783097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dcd735e4-fa6a-4d8a-a776-0337a08a5b5f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:23.785191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dcd735e4-fa6a-4d8a-a776-0337a08a5b5f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:23.786478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dcd735e4-fa6a-4d8a-a776-0337a08a5b5f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:23.787206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dcd735e4-fa6a-4d8a-a776-0337a08a5b5f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:24.140651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dcd735e4-fa6a-4d8a-a776-0337a08a5b5f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:24.148625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dcd735e4-fa6a-4d8a-a776-0337a08a5b5f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:24.150561 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dcd735e4-fa6a-4d8a-a776-0337a08a5b5f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:24.155083 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dcd735e4-fa6a-4d8a-a776-0337a08a5b5f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1558 microversion: 2.25 time: 0.403261 Mar 05 20:54:24.168968 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 821/1740] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:23 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1558 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:24.212736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9c344067-26a1-49ee-a319-0389251c18dc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:24.225794 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c344067-26a1-49ee-a319-0389251c18dc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 200 len: 1474 microversion: 2.1 time: 0.560313 Mar 05 20:54:24.227193 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 920/1741] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:23 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 1474 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:24.247661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-760f7e7c-1684-4949-bebc-3d6489623740 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:24.251518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-760f7e7c-1684-4949-bebc-3d6489623740 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:24.265355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-760f7e7c-1684-4949-bebc-3d6489623740 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:24.266681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-760f7e7c-1684-4949-bebc-3d6489623740 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:24.268364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-760f7e7c-1684-4949-bebc-3d6489623740 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:24.268813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-760f7e7c-1684-4949-bebc-3d6489623740 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:24.336900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-396293390", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "cb9f1358-14b7-43a8-a87f-8cb8dfb356bd"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:24.417103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] validate_networks() for [('cb9f1358-14b7-43a8-a87f-8cb8dfb356bd', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:54:24.563510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-760f7e7c-1684-4949-bebc-3d6489623740 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid 019a8023-9015-41ae-974a-eb725177770d {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:54:24.588363 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-760f7e7c-1684-4949-bebc-3d6489623740 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 2051 microversion: 2.25 time: 0.353312 Mar 05 20:54:24.594715 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 921/1742] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:24 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 2051 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:24.666655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b3b4add4-5e55-48d2-9038-111f6770cbf4 tempest-ComputeTenantNetworksTest-1380830994 tempest-ComputeTenantNetworksTest-1380830994-project] Calling method '.version_select at 0x7fed5c42c4c0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:25.026140 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b3b4add4-5e55-48d2-9038-111f6770cbf4 tempest-ComputeTenantNetworksTest-1380830994 tempest-ComputeTenantNetworksTest-1380830994-project] 10.222.0.15 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.429908 Mar 05 20:54:25.026760 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 922/1743] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 20:54:24 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:25.032463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-0eef8439-1159-453f-bb88-187e06af4187 req-267cd21c-5031-437a-9aa1-77d0db6814b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e83e1e1-a9df-4257-a596-e67ee39ac474", "name": "network-vif-unplugged", "status": "completed", "tag": "16cf4bd3-62b6-4ec8-863b-656e8ed0397b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:25.044055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0eef8439-1159-453f-bb88-187e06af4187 req-267cd21c-5031-437a-9aa1-77d0db6814b2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.044817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0eef8439-1159-453f-bb88-187e06af4187 req-267cd21c-5031-437a-9aa1-77d0db6814b2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:25.059505 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0eef8439-1159-453f-bb88-187e06af4187 req-267cd21c-5031-437a-9aa1-77d0db6814b2 service nova] Creating event network-vif-unplugged:16cf4bd3-62b6-4ec8-863b-656e8ed0397b for instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 on nch2-master-1 Mar 05 20:54:25.068391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-0eef8439-1159-453f-bb88-187e06af4187 req-267cd21c-5031-437a-9aa1-77d0db6814b2 service nova] Instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:54:25.086899 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-0eef8439-1159-453f-bb88-187e06af4187 req-267cd21c-5031-437a-9aa1-77d0db6814b2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058290 Mar 05 20:54:25.090048 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 923/1744] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:25.110626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5d4e18c0-3c8c-4b39-93f9-abf1fdf5fdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-59204621"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:25.114057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5d4e18c0-3c8c-4b39-93f9-abf1fdf5fdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:25.122918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d4e18c0-3c8c-4b39-93f9-abf1fdf5fdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.123783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d4e18c0-3c8c-4b39-93f9-abf1fdf5fdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:25.124854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d4e18c0-3c8c-4b39-93f9-abf1fdf5fdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.125504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d4e18c0-3c8c-4b39-93f9-abf1fdf5fdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:25.505171 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5d4e18c0-3c8c-4b39-93f9-abf1fdf5fdd9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "POST /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498/action" status: 202 len: 0 microversion: 2.1 time: 0.412338 Mar 05 20:54:25.505952 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 924/1745] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:54:25 2022] POST /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 20:54:25.516688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f747a548-621f-47bf-9369-f3d540f74f03 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:25.521750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f747a548-621f-47bf-9369-f3d540f74f03 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:25.534632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f747a548-621f-47bf-9369-f3d540f74f03 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.537440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f747a548-621f-47bf-9369-f3d540f74f03 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:25.539500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f747a548-621f-47bf-9369-f3d540f74f03 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.541863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f747a548-621f-47bf-9369-f3d540f74f03 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:25.653603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:54:25.654150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:54:25.654484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:54:25.654892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:54:25.655299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:54:25.675366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.678751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:25.679797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.681634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:25.718855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Getting quotas for project 7f868fae33d848129fabf0f797c73be4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:54:25.729513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Getting quotas for user 3a21adbe60d34fdf81d780364a0c4367 and project 7f868fae33d848129fabf0f797c73be4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:54:25.748963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:54:25.753222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:54:25.767314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f747a548-621f-47bf-9369-f3d540f74f03 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:25.784536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f747a548-621f-47bf-9369-f3d540f74f03 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:25.787540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f747a548-621f-47bf-9369-f3d540f74f03 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:25.789712 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f747a548-621f-47bf-9369-f3d540f74f03 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 2825 microversion: 2.32 time: 0.282407 Mar 05 20:54:25.791398 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 925/1746] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:25 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 2825 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:25.802035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-471bd144-6820-4fe0-81f9-d14f2ffae86c req-47e7c403-d5c3-4fd4-9e2b-96477ab0067e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b", "name": "network-vif-plugged", "status": "completed", "tag": "20167121-7ae4-4eaf-b943-f8a27843c51a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:25.810769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-471bd144-6820-4fe0-81f9-d14f2ffae86c req-47e7c403-d5c3-4fd4-9e2b-96477ab0067e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.811213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-471bd144-6820-4fe0-81f9-d14f2ffae86c req-47e7c403-d5c3-4fd4-9e2b-96477ab0067e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:25.827338 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5db3b619-a07d-412d-a58a-46f221bb2777 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.654323 Mar 05 20:54:25.828728 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-471bd144-6820-4fe0-81f9-d14f2ffae86c req-47e7c403-d5c3-4fd4-9e2b-96477ab0067e service nova] Creating event network-vif-plugged:20167121-7ae4-4eaf-b943-f8a27843c51a for instance 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b on nch2-master-1 Mar 05 20:54:25.828857 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 822/1747] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:54:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:54:25.833902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-43edb21f-50d1-41ed-adc9-8f41a46b7862 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:25.835111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-43edb21f-50d1-41ed-adc9-8f41a46b7862 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:25.844739 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-471bd144-6820-4fe0-81f9-d14f2ffae86c req-47e7c403-d5c3-4fd4-9e2b-96477ab0067e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048500 Mar 05 20:54:25.846045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43edb21f-50d1-41ed-adc9-8f41a46b7862 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.846765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43edb21f-50d1-41ed-adc9-8f41a46b7862 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:25.848933 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 926/1748] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:25.860758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43edb21f-50d1-41ed-adc9-8f41a46b7862 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.861484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d7619cd1-66b2-4ef1-9704-8b3953160569 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:25.862355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43edb21f-50d1-41ed-adc9-8f41a46b7862 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:25.876666 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:54:25.876666 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:54:25.885073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7619cd1-66b2-4ef1-9704-8b3953160569 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.885860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7619cd1-66b2-4ef1-9704-8b3953160569 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:25.886906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7619cd1-66b2-4ef1-9704-8b3953160569 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.887643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7619cd1-66b2-4ef1-9704-8b3953160569 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:25.941977 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d7619cd1-66b2-4ef1-9704-8b3953160569 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.091576 Mar 05 20:54:25.952340 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 927/1749] 10.222.0.15 () {60 vars in 1216 bytes} [Sat Mar 5 20:54:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:54:25.952340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-52a23a4d-620b-4c5c-b137-314eb7dc0b54 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:25.956814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-52a23a4d-620b-4c5c-b137-314eb7dc0b54 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] [instance: 1e87f17b-0999-4fff-ae66-5f37ccc3628c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:25.968926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52a23a4d-620b-4c5c-b137-314eb7dc0b54 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.971142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52a23a4d-620b-4c5c-b137-314eb7dc0b54 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:25.973033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52a23a4d-620b-4c5c-b137-314eb7dc0b54 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:25.976654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52a23a4d-620b-4c5c-b137-314eb7dc0b54 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:26.008409 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-52a23a4d-620b-4c5c-b137-314eb7dc0b54 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] HTTP exception thrown: Instance 1e87f17b-0999-4fff-ae66-5f37ccc3628c could not be found. Mar 05 20:54:26.012945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-52a23a4d-620b-4c5c-b137-314eb7dc0b54 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Returning 404 to user: Instance 1e87f17b-0999-4fff-ae66-5f37ccc3628c could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:26.014019 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-52a23a4d-620b-4c5c-b137-314eb7dc0b54 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c" status: 404 len: 111 microversion: 2.1 time: 0.069995 Mar 05 20:54:26.021132 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 928/1750] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:25 2022] GET /compute/v2.1/servers/1e87f17b-0999-4fff-ae66-5f37ccc3628c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:54:26.028676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-32721ed0-e7d3-46e7-ae15-208665bc7335 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:26.029291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-32721ed0-e7d3-46e7-ae15-208665bc7335 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:26.044555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32721ed0-e7d3-46e7-ae15-208665bc7335 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:26.045015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32721ed0-e7d3-46e7-ae15-208665bc7335 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:26.049249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32721ed0-e7d3-46e7-ae15-208665bc7335 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:26.049592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32721ed0-e7d3-46e7-ae15-208665bc7335 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:26.263953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-43edb21f-50d1-41ed-adc9-8f41a46b7862 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:26.273513 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-43edb21f-50d1-41ed-adc9-8f41a46b7862 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1325 microversion: 2.1 time: 0.443187 Mar 05 20:54:26.274384 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 823/1751] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:25 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:26.293660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-101543aa-d3b4-4307-8650-fa33a709e93b req-b25a116e-f2ca-470b-bf93-fa364597b7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e87f17b-0999-4fff-ae66-5f37ccc3628c", "name": "network-vif-deleted", "tag": "4843f79d-ea4a-4732-bdaa-157ee20d5051"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:26.307498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-101543aa-d3b4-4307-8650-fa33a709e93b req-b25a116e-f2ca-470b-bf93-fa364597b7f8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:26.308752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-101543aa-d3b4-4307-8650-fa33a709e93b req-b25a116e-f2ca-470b-bf93-fa364597b7f8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:26.346173 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-101543aa-d3b4-4307-8650-fa33a709e93b req-b25a116e-f2ca-470b-bf93-fa364597b7f8 service nova] Creating event network-vif-deleted:4843f79d-ea4a-4732-bdaa-157ee20d5051 for instance 1e87f17b-0999-4fff-ae66-5f37ccc3628c on nch1-master-1 Mar 05 20:54:26.349091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-32721ed0-e7d3-46e7-ae15-208665bc7335 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:26.355260 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-101543aa-d3b4-4307-8650-fa33a709e93b req-b25a116e-f2ca-470b-bf93-fa364597b7f8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078231 Mar 05 20:54:26.356031 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 824/1752] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:26.364673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bfc2faa5-4d47-4df5-bcbd-16669b54c5b7 tempest-ComputeTenantNetworksTest-1380830994 tempest-ComputeTenantNetworksTest-1380830994-project] Calling method '.version_select at 0x7fed5c6c09d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:26.383388 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-32721ed0-e7d3-46e7-ae15-208665bc7335 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1476 microversion: 2.1 time: 0.360786 Mar 05 20:54:26.385127 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 929/1753] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:26 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1476 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:26.391367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5f6021a0-fd71-4158-aa23-786486b5faf1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed61aff820>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:26.461039 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5f6021a0-fd71-4158-aa23-786486b5faf1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.073077 Mar 05 20:54:26.462530 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 930/1754] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:26 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:26.469503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-90dfe692-adca-47e7-850f-3261b0b7dc64 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:26.470397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-90dfe692-adca-47e7-850f-3261b0b7dc64 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:26.480291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90dfe692-adca-47e7-850f-3261b0b7dc64 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:26.480753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90dfe692-adca-47e7-850f-3261b0b7dc64 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:26.483193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90dfe692-adca-47e7-850f-3261b0b7dc64 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:26.483705 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90dfe692-adca-47e7-850f-3261b0b7dc64 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:26.514375 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bfc2faa5-4d47-4df5-bcbd-16669b54c5b7 tempest-ComputeTenantNetworksTest-1380830994 tempest-ComputeTenantNetworksTest-1380830994-project] 10.222.0.15 "GET /compute/v2.1/os-tenant-networks/8e218ac5-59ae-4eb0-8d60-20240df93437" status: 200 len: 140 microversion: 2.1 time: 0.156993 Mar 05 20:54:26.515619 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 825/1755] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 20:54:26 2022] GET /compute/v2.1/os-tenant-networks/8e218ac5-59ae-4eb0-8d60-20240df93437 => generated 140 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:26.527452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-126772999", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "cb9f1358-14b7-43a8-a87f-8cb8dfb356bd"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:26.601632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] validate_networks() for [('cb9f1358-14b7-43a8-a87f-8cb8dfb356bd', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:54:26.910530 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-90dfe692-adca-47e7-850f-3261b0b7dc64 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.445960 Mar 05 20:54:26.919233 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 931/1756] 10.222.0.15 () {60 vars in 1315 bytes} [Sat Mar 5 20:54:26 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77/os-interface => generated 1830 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:26.924208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91bb1327-2ff2-46f0-9840-49eed16d8b72 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed61b4c550>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:27.271138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:54:27.271600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:54:27.272052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:54:27.272461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:54:27.272872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:54:27.288792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:27.289309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:27.290269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:27.290940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:27.314811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Getting quotas for project 7f868fae33d848129fabf0f797c73be4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:54:27.321507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Getting quotas for user 3a21adbe60d34fdf81d780364a0c4367 and project 7f868fae33d848129fabf0f797c73be4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:54:27.338295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:54:27.341327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: f4c65952-c3d5-4826-9fe6-48c5f0ec86a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:54:27.404324 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fbbb00ca-afa6-4b66-bcd8-109d17bb4483 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.887367 Mar 05 20:54:27.404990 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 826/1757] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:54:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:54:27.409619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-ce167a1c-7c2a-4a34-ad71-0d2f972d8c88 req-6166fb42-e694-4d0f-9c2d-6aea351e9dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e83e1e1-a9df-4257-a596-e67ee39ac474", "tag": "16cf4bd3-62b6-4ec8-863b-656e8ed0397b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:27.446959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ce167a1c-7c2a-4a34-ad71-0d2f972d8c88 req-6166fb42-e694-4d0f-9c2d-6aea351e9dcc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:27.447420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ce167a1c-7c2a-4a34-ad71-0d2f972d8c88 req-6166fb42-e694-4d0f-9c2d-6aea351e9dcc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:27.461659 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ce167a1c-7c2a-4a34-ad71-0d2f972d8c88 req-6166fb42-e694-4d0f-9c2d-6aea351e9dcc service nova] Creating event network-changed:16cf4bd3-62b6-4ec8-863b-656e8ed0397b for instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 on nch2-master-1 Mar 05 20:54:27.479930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-ce167a1c-7c2a-4a34-ad71-0d2f972d8c88 req-6166fb42-e694-4d0f-9c2d-6aea351e9dcc service nova] Instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:54:27.502053 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-ce167a1c-7c2a-4a34-ad71-0d2f972d8c88 req-6166fb42-e694-4d0f-9c2d-6aea351e9dcc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095666 Mar 05 20:54:27.512073 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 827/1758] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:27.519578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-90a0b3a1-624e-40bf-b42f-5698ec7a9fcd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:27.520721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-90a0b3a1-624e-40bf-b42f-5698ec7a9fcd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:27.538099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90a0b3a1-624e-40bf-b42f-5698ec7a9fcd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:27.541116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90a0b3a1-624e-40bf-b42f-5698ec7a9fcd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:27.542554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90a0b3a1-624e-40bf-b42f-5698ec7a9fcd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:27.543446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90a0b3a1-624e-40bf-b42f-5698ec7a9fcd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:28.067133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-90a0b3a1-624e-40bf-b42f-5698ec7a9fcd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:28.080770 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-90a0b3a1-624e-40bf-b42f-5698ec7a9fcd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1522 microversion: 2.1 time: 0.563819 Mar 05 20:54:28.081457 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 828/1759] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:27 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1522 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:28.096631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b0f038dd-6db1-4744-98b1-a2abde848499 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:28.099972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b0f038dd-6db1-4744-98b1-a2abde848499 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:28.113972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0f038dd-6db1-4744-98b1-a2abde848499 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:28.124363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0f038dd-6db1-4744-98b1-a2abde848499 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:28.125500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0f038dd-6db1-4744-98b1-a2abde848499 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:28.126103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0f038dd-6db1-4744-98b1-a2abde848499 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:28.439518 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91bb1327-2ff2-46f0-9840-49eed16d8b72 tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/ef9a7897-8e28-4656-b460-90e46bcbd2f3" status: 202 len: 0 microversion: 2.1 time: 1.526593 Mar 05 20:54:28.442003 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 932/1760] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:54:26 2022] DELETE /compute/v2.1/os-security-groups/ef9a7897-8e28-4656-b460-90e46bcbd2f3 => generated 0 bytes in 1530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:54:28.450465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1065260147", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "451", "networks": [{"uuid": "cb9f1358-14b7-43a8-a87f-8cb8dfb356bd"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:28.530792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b0f038dd-6db1-4744-98b1-a2abde848499 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:28.544076 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b0f038dd-6db1-4744-98b1-a2abde848499 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1471 microversion: 2.1 time: 0.461141 Mar 05 20:54:28.550833 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 829/1761] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:28 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1471 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:28.557407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3931c7a6-65ed-4612-aabc-8a368c85532d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c780700>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:28.563462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] validate_networks() for [('cb9f1358-14b7-43a8-a87f-8cb8dfb356bd', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:54:28.628506 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3931c7a6-65ed-4612-aabc-8a368c85532d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.076169 Mar 05 20:54:28.629714 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 830/1762] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:28 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:28.643112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d7c7e935-81a0-4efd-8dcf-344e47fe6c47 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26c79aaa-d9c1-41fc-9e06-a62b6b10fcec", "device": "/dev/xvdb"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:28.647660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d7c7e935-81a0-4efd-8dcf-344e47fe6c47 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:28.662879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7c7e935-81a0-4efd-8dcf-344e47fe6c47 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:28.663786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7c7e935-81a0-4efd-8dcf-344e47fe6c47 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:28.666171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7c7e935-81a0-4efd-8dcf-344e47fe6c47 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:28.669266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7c7e935-81a0-4efd-8dcf-344e47fe6c47 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:29.040631 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d7c7e935-81a0-4efd-8dcf-344e47fe6c47 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "POST /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.407226 Mar 05 20:54:29.043474 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 831/1763] 10.222.0.15 () {62 vars in 1363 bytes} [Sat Mar 5 20:54:28 2022] POST /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:54:29.064789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3234f05e-8fce-42b7-919d-60511e6cfbe8 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:29.066917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3234f05e-8fce-42b7-919d-60511e6cfbe8 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:29.086810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3234f05e-8fce-42b7-919d-60511e6cfbe8 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:29.088608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3234f05e-8fce-42b7-919d-60511e6cfbe8 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:29.089876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3234f05e-8fce-42b7-919d-60511e6cfbe8 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:29.092112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3234f05e-8fce-42b7-919d-60511e6cfbe8 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:30.021217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3234f05e-8fce-42b7-919d-60511e6cfbe8 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:30.036257 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3234f05e-8fce-42b7-919d-60511e6cfbe8 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1522 microversion: 2.1 time: 0.984452 Mar 05 20:54:30.039545 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 832/1764] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:29 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1522 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:30.053402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0ebf4f29-7c45-4088-84e6-a565bdac920c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] Calling method '.version_select at 0x7fed5c780a60>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:30.884603 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0ebf4f29-7c45-4088-84e6-a565bdac920c tempest-SecurityGroupsTestJSON-1181301969 tempest-SecurityGroupsTestJSON-1181301969-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/5dc7330a-c9d0-4b79-8a67-24901a59b404" status: 202 len: 0 microversion: 2.1 time: 0.843609 Mar 05 20:54:30.888222 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 833/1765] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:54:30 2022] DELETE /compute/v2.1/os-security-groups/5dc7330a-c9d0-4b79-8a67-24901a59b404 => generated 0 bytes in 845 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:54:30.897329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2676e855-2ce2-4317-bc3b-b2d771a453d6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:30.897872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2676e855-2ce2-4317-bc3b-b2d771a453d6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:30.912758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2676e855-2ce2-4317-bc3b-b2d771a453d6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:30.916907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2676e855-2ce2-4317-bc3b-b2d771a453d6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:30.917952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2676e855-2ce2-4317-bc3b-b2d771a453d6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:30.924449 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2676e855-2ce2-4317-bc3b-b2d771a453d6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:31.380327 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2676e855-2ce2-4317-bc3b-b2d771a453d6 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "POST /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474/action" status: 202 len: 0 microversion: 2.1 time: 0.492829 Mar 05 20:54:31.380976 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 834/1766] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:54:30 2022] POST /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:54:31.388611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3f58afa3-6ca1-42f9-8124-268df4dba300 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c780550>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:31.487620 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3f58afa3-6ca1-42f9-8124-268df4dba300 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.104851 Mar 05 20:54:31.493088 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 835/1767] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:31 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:31.510640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b5750acc-66b9-4fdc-9b09-16b00f5efafd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2141629196"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:31.516520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b5750acc-66b9-4fdc-9b09-16b00f5efafd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:31.529190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5750acc-66b9-4fdc-9b09-16b00f5efafd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:31.529910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5750acc-66b9-4fdc-9b09-16b00f5efafd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:31.534577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5750acc-66b9-4fdc-9b09-16b00f5efafd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:31.535129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5750acc-66b9-4fdc-9b09-16b00f5efafd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:31.670892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:54:31.671403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:54:31.671820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:54:31.672413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:54:31.673000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:54:31.699064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:31.700142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:31.701407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:31.702701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:31.738607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Getting quotas for project 7f868fae33d848129fabf0f797c73be4. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:54:31.746574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Getting quotas for user 3a21adbe60d34fdf81d780364a0c4367 and project 7f868fae33d848129fabf0f797c73be4. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:54:31.766580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:54:31.769845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:54:31.849669 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ce27023-9e70-44f6-bfba-e5bbfed36c56 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.405299 Mar 05 20:54:31.850845 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 933/1768] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:54:31.871611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-11a9e122-31f4-4742-8e54-82fe3263e505 req-d047376e-fb4b-4533-a30c-20b43c8b9c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facc63d8-2f5b-4b1f-858c-65e0ba787498", "name": "network-vif-plugged", "status": "completed", "tag": "727e5026-bc21-477c-93fd-d0897928ef02"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:31.905567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-11a9e122-31f4-4742-8e54-82fe3263e505 req-d047376e-fb4b-4533-a30c-20b43c8b9c62 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:31.906227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-11a9e122-31f4-4742-8e54-82fe3263e505 req-d047376e-fb4b-4533-a30c-20b43c8b9c62 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:31.966955 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-11a9e122-31f4-4742-8e54-82fe3263e505 req-d047376e-fb4b-4533-a30c-20b43c8b9c62 service nova] Creating event network-vif-plugged:727e5026-bc21-477c-93fd-d0897928ef02 for instance facc63d8-2f5b-4b1f-858c-65e0ba787498 on nch1-master-1 Mar 05 20:54:31.989519 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-11a9e122-31f4-4742-8e54-82fe3263e505 req-d047376e-fb4b-4533-a30c-20b43c8b9c62 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133209 Mar 05 20:54:31.990165 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 934/1769] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:32.173153 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b5750acc-66b9-4fdc-9b09-16b00f5efafd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "POST /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b/action" status: 202 len: 0 microversion: 2.1 time: 0.683119 Mar 05 20:54:32.180389 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 836/1770] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:54:31 2022] POST /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b/action => generated 0 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 20:54:32.191111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7000e359-2d19-4c12-9deb-580c6e77ee28 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:32.191871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7000e359-2d19-4c12-9deb-580c6e77ee28 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:32.358803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7000e359-2d19-4c12-9deb-580c6e77ee28 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:32.365823 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7000e359-2d19-4c12-9deb-580c6e77ee28 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1221 microversion: 2.1 time: 0.183109 Mar 05 20:54:32.379323 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 837/1771] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:32 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1221 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:32.393819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fe85aa41-795c-4ea9-9bad-1e5e6629627a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '.version_select at 0x7fed5c780a60>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:32.550372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-be35487f-b2c6-409a-90f9-9d69eeb82a06 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:32.551160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-be35487f-b2c6-409a-90f9-9d69eeb82a06 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:32.563957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be35487f-b2c6-409a-90f9-9d69eeb82a06 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:32.564497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be35487f-b2c6-409a-90f9-9d69eeb82a06 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:32.565318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be35487f-b2c6-409a-90f9-9d69eeb82a06 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:32.569315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be35487f-b2c6-409a-90f9-9d69eeb82a06 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:32.705589 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fe85aa41-795c-4ea9-9bad-1e5e6629627a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "DELETE /compute/v2.1/images/194bfac8-2175-45b7-8d3f-24671b826280" status: 204 len: 0 microversion: 2.1 time: 0.333472 Mar 05 20:54:32.706586 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 838/1772] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:32 2022] DELETE /compute/v2.1/images/194bfac8-2175-45b7-8d3f-24671b826280 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:54:32.715235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c13c67f0-d52f-4153-93a2-673ea358194f tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] Calling method '.version_select at 0x7fed5c589550>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:32.792747 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c13c67f0-d52f-4153-93a2-673ea358194f tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/d519473a-ef8a-409d-875f-13ff7f5365dd" status: 200 len: 344 microversion: 2.1 time: 0.084806 Mar 05 20:54:32.801655 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 839/1773] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:54:32 2022] GET /compute/v2.1/os-volumes/d519473a-ef8a-409d-875f-13ff7f5365dd => generated 344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:32.809633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-49d7d838-8354-49c3-9379-648a38ed6be2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c5dc820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:32.944830 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-49d7d838-8354-49c3-9379-648a38ed6be2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.139096 Mar 05 20:54:32.945670 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 840/1774] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:32 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:32.969164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2b95c578-b543-4f16-bc2a-925697f38433 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '.version_select at 0x7fed5c5e7430>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:33.033019 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-2b95c578-b543-4f16-bc2a-925697f38433 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] HTTP exception thrown: Image not found. Mar 05 20:54:33.033708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2b95c578-b543-4f16-bc2a-925697f38433 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 404 to user: Image not found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:33.034675 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2b95c578-b543-4f16-bc2a-925697f38433 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/images/194bfac8-2175-45b7-8d3f-24671b826280" status: 404 len: 62 microversion: 2.1 time: 0.088305 Mar 05 20:54:33.035573 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 841/1775] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:32 2022] GET /compute/v2.1/images/194bfac8-2175-45b7-8d3f-24671b826280 => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:54:33.045221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d9a7cfa4-32f3-4333-b99f-1aa9ed32ee5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:33.045848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d9a7cfa4-32f3-4333-b99f-1aa9ed32ee5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:33.062964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d9a7cfa4-32f3-4333-b99f-1aa9ed32ee5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:33.063627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d9a7cfa4-32f3-4333-b99f-1aa9ed32ee5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:33.064619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d9a7cfa4-32f3-4333-b99f-1aa9ed32ee5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:33.067515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d9a7cfa4-32f3-4333-b99f-1aa9ed32ee5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:33.412129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-be35487f-b2c6-409a-90f9-9d69eeb82a06 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:33.422348 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-be35487f-b2c6-409a-90f9-9d69eeb82a06 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1470 microversion: 2.1 time: 1.430943 Mar 05 20:54:33.422952 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 935/1776] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:31 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1470 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:33.437636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ff3b5b9c-5e64-4b25-9c9e-a0753b970d52 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:33.448470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ff3b5b9c-5e64-4b25-9c9e-a0753b970d52 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:33.464409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff3b5b9c-5e64-4b25-9c9e-a0753b970d52 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:33.484444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff3b5b9c-5e64-4b25-9c9e-a0753b970d52 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:33.485493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff3b5b9c-5e64-4b25-9c9e-a0753b970d52 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:33.486088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff3b5b9c-5e64-4b25-9c9e-a0753b970d52 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:33.757484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ff3b5b9c-5e64-4b25-9c9e-a0753b970d52 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:33.772877 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ff3b5b9c-5e64-4b25-9c9e-a0753b970d52 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1273 microversion: 2.1 time: 0.348797 Mar 05 20:54:33.785064 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 936/1777] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:33 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1273 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:33.794019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-63fd3b86-4cee-4e17-98b7-75a7040af810 req-94ac758c-0ff6-49e6-b0aa-448e01df05f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "tag": "5866fc79-fac2-4bd2-978f-c689c32b9c03"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:33.830881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-63fd3b86-4cee-4e17-98b7-75a7040af810 req-94ac758c-0ff6-49e6-b0aa-448e01df05f8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:33.831622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-63fd3b86-4cee-4e17-98b7-75a7040af810 req-94ac758c-0ff6-49e6-b0aa-448e01df05f8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:33.876237 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-63fd3b86-4cee-4e17-98b7-75a7040af810 req-94ac758c-0ff6-49e6-b0aa-448e01df05f8 service nova] Creating event network-changed:5866fc79-fac2-4bd2-978f-c689c32b9c03 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:54:33.892730 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-63fd3b86-4cee-4e17-98b7-75a7040af810 req-94ac758c-0ff6-49e6-b0aa-448e01df05f8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105081 Mar 05 20:54:33.921434 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 937/1778] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:33.960462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d830bac4-c51d-4864-9aa0-3cef8cfd76bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed61b4c790>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:34.169774 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d830bac4-c51d-4864-9aa0-3cef8cfd76bc tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.214802 Mar 05 20:54:34.186900 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 938/1779] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:33 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:34.201284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-312f8b93-d1f9-4f49-b91a-7cb7c1e981ed req-c89a38c2-6928-495c-8e75-d27fb7c1cb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e83e1e1-a9df-4257-a596-e67ee39ac474", "name": "network-vif-plugged", "status": "completed", "tag": "16cf4bd3-62b6-4ec8-863b-656e8ed0397b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:34.216006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-312f8b93-d1f9-4f49-b91a-7cb7c1e981ed req-c89a38c2-6928-495c-8e75-d27fb7c1cb86 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:34.216634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-312f8b93-d1f9-4f49-b91a-7cb7c1e981ed req-c89a38c2-6928-495c-8e75-d27fb7c1cb86 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:34.240129 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-312f8b93-d1f9-4f49-b91a-7cb7c1e981ed req-c89a38c2-6928-495c-8e75-d27fb7c1cb86 service nova] Creating event network-vif-plugged:16cf4bd3-62b6-4ec8-863b-656e8ed0397b for instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 on nch2-master-1 Mar 05 20:54:34.248540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-312f8b93-d1f9-4f49-b91a-7cb7c1e981ed req-c89a38c2-6928-495c-8e75-d27fb7c1cb86 service nova] Instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:54:34.263537 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-312f8b93-d1f9-4f49-b91a-7cb7c1e981ed req-c89a38c2-6928-495c-8e75-d27fb7c1cb86 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074571 Mar 05 20:54:34.264437 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 939/1780] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:34.330463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d9a7cfa4-32f3-4333-b99f-1aa9ed32ee5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:34.344783 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d9a7cfa4-32f3-4333-b99f-1aa9ed32ee5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1534 microversion: 2.1 time: 1.304897 Mar 05 20:54:34.346674 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 842/1781] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:33 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1534 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:34.444278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5735eaa1-90cf-48e6-bdf9-5501276f68c0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:34.445682 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5735eaa1-90cf-48e6-bdf9-5501276f68c0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:34.456309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5735eaa1-90cf-48e6-bdf9-5501276f68c0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:34.456866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5735eaa1-90cf-48e6-bdf9-5501276f68c0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:34.465325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5735eaa1-90cf-48e6-bdf9-5501276f68c0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:34.466723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5735eaa1-90cf-48e6-bdf9-5501276f68c0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:34.580857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ed92ea75-e4c2-4304-aaa5-077c9d26aba1 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] Calling method '.version_select at 0x7fed5cf30e50>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:34.692829 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ed92ea75-e4c2-4304-aaa5-077c9d26aba1 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/0c82cb15-d91f-4a2f-9541-5d18e0a29a66" status: 200 len: 343 microversion: 2.1 time: 0.127459 Mar 05 20:54:34.695746 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 843/1782] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:54:34 2022] GET /compute/v2.1/os-volumes/0c82cb15-d91f-4a2f-9541-5d18e0a29a66 => generated 343 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:34.791814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7cb8dfb8-8b99-4b31-949f-55baf2066fd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:34.793123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7cb8dfb8-8b99-4b31-949f-55baf2066fd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:34.805408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cb8dfb8-8b99-4b31-949f-55baf2066fd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:34.811038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cb8dfb8-8b99-4b31-949f-55baf2066fd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:34.812383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cb8dfb8-8b99-4b31-949f-55baf2066fd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:34.813058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cb8dfb8-8b99-4b31-949f-55baf2066fd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:35.966780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7cb8dfb8-8b99-4b31-949f-55baf2066fd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:35.976957 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7cb8dfb8-8b99-4b31-949f-55baf2066fd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1279 microversion: 2.1 time: 1.189728 Mar 05 20:54:35.978052 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 844/1783] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:34 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1279 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:35.993945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2846817e-1094-4dc0-829d-46947cadd98b tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c7b0af0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:36.169514 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2846817e-1094-4dc0-829d-46947cadd98b tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.186227 Mar 05 20:54:36.176700 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 845/1784] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:35 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:36.182579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bca2841d-5f20-4e1b-9784-bdecfaf2490b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:36.195983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bca2841d-5f20-4e1b-9784-bdecfaf2490b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:36.209460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bca2841d-5f20-4e1b-9784-bdecfaf2490b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:36.211909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bca2841d-5f20-4e1b-9784-bdecfaf2490b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:36.213953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bca2841d-5f20-4e1b-9784-bdecfaf2490b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:36.215626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bca2841d-5f20-4e1b-9784-bdecfaf2490b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:36.438684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5735eaa1-90cf-48e6-bdf9-5501276f68c0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:36.452661 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5735eaa1-90cf-48e6-bdf9-5501276f68c0 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1470 microversion: 2.1 time: 2.010035 Mar 05 20:54:36.457420 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 940/1785] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:34 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1470 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:36.476703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-8b434b50-fbcc-4170-96d4-69338a67a01c req-7c002301-8efb-485f-a458-b6ffb0df8f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fbb1c17-d366-4ba5-9665-68a62f95f341", "tag": "de431d40-486f-404d-9b88-d63c337d45e9"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:36.495191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8b434b50-fbcc-4170-96d4-69338a67a01c req-7c002301-8efb-485f-a458-b6ffb0df8f04 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:36.495979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8b434b50-fbcc-4170-96d4-69338a67a01c req-7c002301-8efb-485f-a458-b6ffb0df8f04 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:36.532046 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-8b434b50-fbcc-4170-96d4-69338a67a01c req-7c002301-8efb-485f-a458-b6ffb0df8f04 service nova] Creating event network-changed:de431d40-486f-404d-9b88-d63c337d45e9 for instance 6fbb1c17-d366-4ba5-9665-68a62f95f341 on nch2-master-1 Mar 05 20:54:36.543227 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-8b434b50-fbcc-4170-96d4-69338a67a01c req-7c002301-8efb-485f-a458-b6ffb0df8f04 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084034 Mar 05 20:54:36.547833 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 941/1786] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:36.557930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d299a6b2-160c-4f02-9f05-334c1ca4becd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:36.560594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d299a6b2-160c-4f02-9f05-334c1ca4becd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:36.585153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d299a6b2-160c-4f02-9f05-334c1ca4becd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:36.585749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d299a6b2-160c-4f02-9f05-334c1ca4becd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:36.586588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d299a6b2-160c-4f02-9f05-334c1ca4becd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:36.602358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d299a6b2-160c-4f02-9f05-334c1ca4becd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:37.189124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bca2841d-5f20-4e1b-9784-bdecfaf2490b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:37.213511 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bca2841d-5f20-4e1b-9784-bdecfaf2490b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1522 microversion: 2.1 time: 1.026966 Mar 05 20:54:37.214426 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 846/1787] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:36 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1522 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:37.225169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-de24089b-77db-40f4-8b43-98f388371fb3 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] Calling method '.version_select at 0x7fed5c69f430>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:37.361990 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-de24089b-77db-40f4-8b43-98f388371fb3 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/5e6dcd4a-ad36-42e7-b580-9b60cc270591" status: 200 len: 344 microversion: 2.1 time: 0.144877 Mar 05 20:54:37.369769 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 847/1788] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:54:37 2022] GET /compute/v2.1/os-volumes/5e6dcd4a-ad36-42e7-b580-9b60cc270591 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:37.374858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-36800e9a-33d5-4964-a745-e5885f4ee790 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:37.379653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-36800e9a-33d5-4964-a745-e5885f4ee790 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:37.402333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36800e9a-33d5-4964-a745-e5885f4ee790 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:37.402816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36800e9a-33d5-4964-a745-e5885f4ee790 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:37.403964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36800e9a-33d5-4964-a745-e5885f4ee790 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:37.404419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36800e9a-33d5-4964-a745-e5885f4ee790 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:37.448566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-d299a6b2-160c-4f02-9f05-334c1ca4becd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid 019a8023-9015-41ae-974a-eb725177770d {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:54:37.489780 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d299a6b2-160c-4f02-9f05-334c1ca4becd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 2129 microversion: 2.25 time: 0.939098 Mar 05 20:54:37.503703 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 942/1789] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:36 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 2129 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:37.506497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2ebd12a8-bc20-4726-aeab-11d53eedd96e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed61a9d040>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:37.579626 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2ebd12a8-bc20-4726-aeab-11d53eedd96e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.083701 Mar 05 20:54:37.592252 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 943/1790] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:37 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:37.600446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5cb0d566-9579-4dc1-a169-d53b907d3d0b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:37.601963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5cb0d566-9579-4dc1-a169-d53b907d3d0b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:37.620482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cb0d566-9579-4dc1-a169-d53b907d3d0b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:37.621115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cb0d566-9579-4dc1-a169-d53b907d3d0b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:37.622107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cb0d566-9579-4dc1-a169-d53b907d3d0b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:37.622721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cb0d566-9579-4dc1-a169-d53b907d3d0b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:37.679277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5cb0d566-9579-4dc1-a169-d53b907d3d0b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:54:37.833801 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5cb0d566-9579-4dc1-a169-d53b907d3d0b tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 204 len: 0 microversion: 2.1 time: 0.239416 Mar 05 20:54:37.834681 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 944/1791] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:54:37 2022] DELETE /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:54:37.841749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b8ccaee1-68cf-404b-8c65-60f5cd9da319 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] Calling method '.version_select at 0x7fed61b15160>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:38.108194 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b8ccaee1-68cf-404b-8c65-60f5cd9da319 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.271945 Mar 05 20:54:38.116726 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 945/1792] 10.222.0.15 () {58 vars in 1133 bytes} [Sat Mar 5 20:54:37 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:38.122326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-002cd90b-428e-4a9c-b5fa-186a374d4cad tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:38.123434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-002cd90b-428e-4a9c-b5fa-186a374d4cad tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:38.151711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-002cd90b-428e-4a9c-b5fa-186a374d4cad tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:38.155450 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-002cd90b-428e-4a9c-b5fa-186a374d4cad tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:38.158932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-002cd90b-428e-4a9c-b5fa-186a374d4cad tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:38.162619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-002cd90b-428e-4a9c-b5fa-186a374d4cad tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:38.343536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-36800e9a-33d5-4964-a745-e5885f4ee790 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:38.373822 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-36800e9a-33d5-4964-a745-e5885f4ee790 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1321 microversion: 2.1 time: 1.002806 Mar 05 20:54:38.377564 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 848/1793] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:37 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1321 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:38.394316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:38.396418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:38.404081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:38.404537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:38.405325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:38.405755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:38.440544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'flavor' on Instance uuid 019a8023-9015-41ae-974a-eb725177770d {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:54:38.457381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: 019a8023-9015-41ae-974a-eb725177770d] Going to try to live migrate instance to nch1-master-1 {{(pid=141478) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 05 20:54:38.848442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-002cd90b-428e-4a9c-b5fa-186a374d4cad tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:38.856995 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-002cd90b-428e-4a9c-b5fa-186a374d4cad tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1470 microversion: 2.1 time: 0.738611 Mar 05 20:54:38.858049 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 946/1794] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:38 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1470 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:38.862732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-322a137e-6fe3-4d33-bd79-ea3c21ab7b6d req-4927c7dd-4d3f-4163-ae58-a69eb14e8c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b", "name": "network-vif-plugged", "status": "completed", "tag": "20167121-7ae4-4eaf-b943-f8a27843c51a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:38.873126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-322a137e-6fe3-4d33-bd79-ea3c21ab7b6d req-4927c7dd-4d3f-4163-ae58-a69eb14e8c1e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:38.876007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-322a137e-6fe3-4d33-bd79-ea3c21ab7b6d req-4927c7dd-4d3f-4163-ae58-a69eb14e8c1e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:38.895408 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-322a137e-6fe3-4d33-bd79-ea3c21ab7b6d req-4927c7dd-4d3f-4163-ae58-a69eb14e8c1e service nova] Creating event network-vif-plugged:20167121-7ae4-4eaf-b943-f8a27843c51a for instance 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b on nch2-master-1 Mar 05 20:54:38.907258 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-322a137e-6fe3-4d33-bd79-ea3c21ab7b6d req-4927c7dd-4d3f-4163-ae58-a69eb14e8c1e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047737 Mar 05 20:54:38.917181 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 947/1795] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:38.923272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-985625ab-a34d-49ac-9c87-962665874d5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:38.928682 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-985625ab-a34d-49ac-9c87-962665874d5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:38.939011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-985625ab-a34d-49ac-9c87-962665874d5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:38.939729 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-985625ab-a34d-49ac-9c87-962665874d5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:38.940758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-985625ab-a34d-49ac-9c87-962665874d5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:38.941412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-985625ab-a34d-49ac-9c87-962665874d5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:39.458630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-985625ab-a34d-49ac-9c87-962665874d5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:39.476156 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-985625ab-a34d-49ac-9c87-962665874d5a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1528 microversion: 2.1 time: 0.556880 Mar 05 20:54:39.487606 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 948/1796] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:38 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1528 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:39.498191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d0a0d9f3-5805-4a21-b615-3643b797e0d9 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] Calling method '.version_select at 0x7fed5c79cf70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:39.831555 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d0a0d9f3-5805-4a21-b615-3643b797e0d9 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.342303 Mar 05 20:54:39.832397 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 949/1797] 10.222.0.15 () {58 vars in 1148 bytes} [Sat Mar 5 20:54:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:39.842318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-521f2e9a-6356-4230-a82b-5447d3f95162 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed61b6aaf0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:39.916610 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-521f2e9a-6356-4230-a82b-5447d3f95162 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.082988 Mar 05 20:54:39.917290 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 950/1798] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:39 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:39.927563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-2ed7c92b-7174-40d1-8272-3ed3dc41b13d req-a00a5789-4748-4dba-95ed-78c4c3c3e484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c65952-c3d5-4826-9fe6-48c5f0ec86a7", "tag": "727f750d-d4cf-46e8-b684-69803f8825eb"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:39.947121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2ed7c92b-7174-40d1-8272-3ed3dc41b13d req-a00a5789-4748-4dba-95ed-78c4c3c3e484 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:39.948006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2ed7c92b-7174-40d1-8272-3ed3dc41b13d req-a00a5789-4748-4dba-95ed-78c4c3c3e484 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:39.961000 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-2ed7c92b-7174-40d1-8272-3ed3dc41b13d req-a00a5789-4748-4dba-95ed-78c4c3c3e484 service nova] Creating event network-changed:727f750d-d4cf-46e8-b684-69803f8825eb for instance f4c65952-c3d5-4826-9fe6-48c5f0ec86a7 on nch1-master-1 Mar 05 20:54:39.968455 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-2ed7c92b-7174-40d1-8272-3ed3dc41b13d req-a00a5789-4748-4dba-95ed-78c4c3c3e484 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049404 Mar 05 20:54:39.969828 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 951/1799] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:39.990083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-feaaa651-8a55-4a38-bc2b-778d7b676669 req-179eddd0-b10c-4f82-84ea-0353286a05fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e83e1e1-a9df-4257-a596-e67ee39ac474", "name": "network-vif-unplugged", "status": "completed", "tag": "16cf4bd3-62b6-4ec8-863b-656e8ed0397b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:40.001342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-feaaa651-8a55-4a38-bc2b-778d7b676669 req-179eddd0-b10c-4f82-84ea-0353286a05fa service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:40.002106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-feaaa651-8a55-4a38-bc2b-778d7b676669 req-179eddd0-b10c-4f82-84ea-0353286a05fa service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:40.017047 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-feaaa651-8a55-4a38-bc2b-778d7b676669 req-179eddd0-b10c-4f82-84ea-0353286a05fa service nova] Creating event network-vif-unplugged:16cf4bd3-62b6-4ec8-863b-656e8ed0397b for instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 on nch1-master-1 Mar 05 20:54:40.025578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-feaaa651-8a55-4a38-bc2b-778d7b676669 req-179eddd0-b10c-4f82-84ea-0353286a05fa service nova] Instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:54:40.038988 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-feaaa651-8a55-4a38-bc2b-778d7b676669 req-179eddd0-b10c-4f82-84ea-0353286a05fa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067503 Mar 05 20:54:40.040094 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 952/1800] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:40.046339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d5bc323e-bb1b-4f10-be56-2688d4dcc8bd tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:40.047405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d5bc323e-bb1b-4f10-be56-2688d4dcc8bd tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:40.060052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5bc323e-bb1b-4f10-be56-2688d4dcc8bd tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:40.060779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5bc323e-bb1b-4f10-be56-2688d4dcc8bd tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:40.062268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5bc323e-bb1b-4f10-be56-2688d4dcc8bd tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:40.063130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5bc323e-bb1b-4f10-be56-2688d4dcc8bd tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:40.715351 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d5bc323e-bb1b-4f10-be56-2688d4dcc8bd tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:40.724555 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d5bc323e-bb1b-4f10-be56-2688d4dcc8bd tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1321 microversion: 2.1 time: 0.682994 Mar 05 20:54:40.730647 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 953/1801] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:40 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1321 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:40.736444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5e200b79-7f55-4fbe-8128-26f984b759ac tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] Calling method '.version_select at 0x7fed61b15c10>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:40.934642 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5e200b79-7f55-4fbe-8128-26f984b759ac tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.201373 Mar 05 20:54:40.935791 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 954/1802] 10.222.0.15 () {58 vars in 1133 bytes} [Sat Mar 5 20:54:40 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:40.961762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f9ede8b0-a974-48c3-aa22-ba20829f3c6c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:40.965147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f9ede8b0-a974-48c3-aa22-ba20829f3c6c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:40.972206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9ede8b0-a974-48c3-aa22-ba20829f3c6c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:40.973363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9ede8b0-a974-48c3-aa22-ba20829f3c6c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:40.981267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9ede8b0-a974-48c3-aa22-ba20829f3c6c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:40.982147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9ede8b0-a974-48c3-aa22-ba20829f3c6c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:41.160490 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e8bf1e33-7fa6-4a1a-86d1-95715d949fc7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d/action" status: 202 len: 0 microversion: 2.25 time: 2.776628 Mar 05 20:54:41.166455 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 849/1803] 10.222.0.15 () {62 vars in 1318 bytes} [Sat Mar 5 20:54:38 2022] POST /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d/action => generated 0 bytes in 2785 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:54:41.171745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-766ddcde-76d1-467e-9a7f-a0a1448cf51c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:41.175330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-766ddcde-76d1-467e-9a7f-a0a1448cf51c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:41.209488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-766ddcde-76d1-467e-9a7f-a0a1448cf51c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:41.213926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-766ddcde-76d1-467e-9a7f-a0a1448cf51c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:41.217958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-766ddcde-76d1-467e-9a7f-a0a1448cf51c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:41.222766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-766ddcde-76d1-467e-9a7f-a0a1448cf51c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:41.749085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-766ddcde-76d1-467e-9a7f-a0a1448cf51c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:41.772340 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-766ddcde-76d1-467e-9a7f-a0a1448cf51c tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1528 microversion: 2.1 time: 0.601304 Mar 05 20:54:41.773001 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 850/1804] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:41 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1528 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:41.796426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-781fd841-3346-48cb-87f4-1ea09cc71fa4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c6c0280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:41.903174 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-781fd841-3346-48cb-87f4-1ea09cc71fa4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.128665 Mar 05 20:54:41.910305 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 851/1805] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:41 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:41.925440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-25fd6765-16ac-4485-82cc-e2134eaa5e05 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] Calling method '.version_select at 0x7fed5c5dc5e0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:42.073986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f9ede8b0-a974-48c3-aa22-ba20829f3c6c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:42.082502 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f9ede8b0-a974-48c3-aa22-ba20829f3c6c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1470 microversion: 2.1 time: 1.125271 Mar 05 20:54:42.094701 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 955/1806] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:40 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1470 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:42.101432 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-25fd6765-16ac-4485-82cc-e2134eaa5e05 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.187379 Mar 05 20:54:42.102286 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 852/1807] 10.222.0.15 () {58 vars in 1166 bytes} [Sat Mar 5 20:54:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:42.106747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-9c49a319-2b08-4d3d-8dc5-5251a2179e36 req-69a16183-0f02-43b1-9567-e0bfbf71d024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b", "name": "network-vif-unplugged", "status": "completed", "tag": "20167121-7ae4-4eaf-b943-f8a27843c51a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:42.110783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1d761eb7-f7bf-4957-b683-c7b13031f8e3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:42.111395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1d761eb7-f7bf-4957-b683-c7b13031f8e3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:42.118840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d761eb7-f7bf-4957-b683-c7b13031f8e3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:42.119548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d761eb7-f7bf-4957-b683-c7b13031f8e3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:42.120557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d761eb7-f7bf-4957-b683-c7b13031f8e3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:42.121158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d761eb7-f7bf-4957-b683-c7b13031f8e3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:42.129093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9c49a319-2b08-4d3d-8dc5-5251a2179e36 req-69a16183-0f02-43b1-9567-e0bfbf71d024 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:42.129554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9c49a319-2b08-4d3d-8dc5-5251a2179e36 req-69a16183-0f02-43b1-9567-e0bfbf71d024 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:42.155955 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-9c49a319-2b08-4d3d-8dc5-5251a2179e36 req-69a16183-0f02-43b1-9567-e0bfbf71d024 service nova] Creating event network-vif-unplugged:20167121-7ae4-4eaf-b943-f8a27843c51a for instance 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b on nch2-master-1 Mar 05 20:54:42.165818 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-9c49a319-2b08-4d3d-8dc5-5251a2179e36 req-69a16183-0f02-43b1-9567-e0bfbf71d024 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061715 Mar 05 20:54:42.167123 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 853/1808] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:42.185706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-421cc3dd-84f9-4a43-8594-b3de0ca0924a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:42.186742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-421cc3dd-84f9-4a43-8594-b3de0ca0924a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:42.198060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-421cc3dd-84f9-4a43-8594-b3de0ca0924a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:42.200901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-421cc3dd-84f9-4a43-8594-b3de0ca0924a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:42.201911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-421cc3dd-84f9-4a43-8594-b3de0ca0924a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:42.203564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-421cc3dd-84f9-4a43-8594-b3de0ca0924a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:42.509342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-421cc3dd-84f9-4a43-8594-b3de0ca0924a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:42.518115 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-421cc3dd-84f9-4a43-8594-b3de0ca0924a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1321 microversion: 2.1 time: 0.349380 Mar 05 20:54:42.519547 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 854/1809] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:42 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:42.525769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-57f6bd03-908b-402d-a89c-412573c372aa tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] Calling method '.version_select at 0x7fed5c9031f0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:42.634971 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-57f6bd03-908b-402d-a89c-412573c372aa tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.109832 Mar 05 20:54:42.636910 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 855/1810] 10.222.0.15 () {58 vars in 1169 bytes} [Sat Mar 5 20:54:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:42.643250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-68e43368-7b41-40a2-aaa9-c7620164f72e req-40326753-6209-4b38-87d1-fcba4d914069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e83e1e1-a9df-4257-a596-e67ee39ac474", "tag": "16cf4bd3-62b6-4ec8-863b-656e8ed0397b"}, {"name": "network-changed", "server_uuid": "c204e8d4-97d5-4836-b7b5-3700e219dea6", "tag": "ec3287d8-2694-4693-885a-dc693fd9360a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:42.657271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-68e43368-7b41-40a2-aaa9-c7620164f72e req-40326753-6209-4b38-87d1-fcba4d914069 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:42.658701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-68e43368-7b41-40a2-aaa9-c7620164f72e req-40326753-6209-4b38-87d1-fcba4d914069 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:42.677017 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-68e43368-7b41-40a2-aaa9-c7620164f72e req-40326753-6209-4b38-87d1-fcba4d914069 service nova] Creating event network-changed:16cf4bd3-62b6-4ec8-863b-656e8ed0397b for instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 on nch1-master-1 Mar 05 20:54:42.678981 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-68e43368-7b41-40a2-aaa9-c7620164f72e req-40326753-6209-4b38-87d1-fcba4d914069 service nova] Creating event network-changed:ec3287d8-2694-4693-885a-dc693fd9360a for instance c204e8d4-97d5-4836-b7b5-3700e219dea6 on nch2-master-1 Mar 05 20:54:42.688119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-68e43368-7b41-40a2-aaa9-c7620164f72e req-40326753-6209-4b38-87d1-fcba4d914069 service nova] Instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 20:54:42.711388 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-68e43368-7b41-40a2-aaa9-c7620164f72e req-40326753-6209-4b38-87d1-fcba4d914069 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072918 Mar 05 20:54:42.712848 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 856/1811] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:42.724057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-677c7a78-8bad-4b30-a73d-7763095b1132 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] Calling method '.version_select at 0x7fed5c69fca0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:42.810435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1d761eb7-f7bf-4957-b683-c7b13031f8e3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:42.831476 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1d761eb7-f7bf-4957-b683-c7b13031f8e3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:42.841303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1d761eb7-f7bf-4957-b683-c7b13031f8e3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:42.842834 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1d761eb7-f7bf-4957-b683-c7b13031f8e3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1646 microversion: 2.25 time: 0.746933 Mar 05 20:54:42.854617 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 956/1812] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:42 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1646 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:42.859504 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-677c7a78-8bad-4b30-a73d-7763095b1132 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.145046 Mar 05 20:54:42.860702 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 857/1813] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:54:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:42.872505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1d96f2e9-e874-464c-9fc7-e25ae69042e8 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] Calling method '.version_select at 0x7fed5c6c0b80>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:42.875946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3007480c-d88e-4ccd-9e66-dce9acaef5a0 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:42.876813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3007480c-d88e-4ccd-9e66-dce9acaef5a0 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:42.911938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3007480c-d88e-4ccd-9e66-dce9acaef5a0 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:42.914171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3007480c-d88e-4ccd-9e66-dce9acaef5a0 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:42.918064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3007480c-d88e-4ccd-9e66-dce9acaef5a0 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:42.923753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3007480c-d88e-4ccd-9e66-dce9acaef5a0 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:43.006589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3007480c-d88e-4ccd-9e66-dce9acaef5a0 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:43.007440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3007480c-d88e-4ccd-9e66-dce9acaef5a0 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:43.008228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-3007480c-d88e-4ccd-9e66-dce9acaef5a0 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lazy-loading 'fault' on Instance uuid 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:54:43.106951 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1d96f2e9-e874-464c-9fc7-e25ae69042e8 tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.238474 Mar 05 20:54:43.108197 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 858/1814] 10.222.0.15 () {58 vars in 1187 bytes} [Sat Mar 5 20:54:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:43.224492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3007480c-d88e-4ccd-9e66-dce9acaef5a0 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:43.245015 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3007480c-d88e-4ccd-9e66-dce9acaef5a0 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 200 len: 1315 microversion: 2.1 time: 0.389010 Mar 05 20:54:43.252166 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 957/1815] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:42 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:43.270931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-53356091-aef3-4b4c-8486-2c8f9f54e870 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed61b77d30>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:43.327040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1153815009", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "c91c4b92-5eca-4314-95af-3ab75681740f"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:43.441596 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-53356091-aef3-4b4c-8486-2c8f9f54e870 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.188081 Mar 05 20:54:43.442190 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 958/1816] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:43 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:43.453631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9e2e07e7-5dea-48e0-a099-6e212cb6eaac tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:43.454393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9e2e07e7-5dea-48e0-a099-6e212cb6eaac tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:43.478117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e2e07e7-5dea-48e0-a099-6e212cb6eaac tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:43.478860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e2e07e7-5dea-48e0-a099-6e212cb6eaac tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:43.485962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e2e07e7-5dea-48e0-a099-6e212cb6eaac tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:43.486645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e2e07e7-5dea-48e0-a099-6e212cb6eaac tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:43.541379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] validate_networks() for [('c91c4b92-5eca-4314-95af-3ab75681740f', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:54:44.309066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:54:44.309789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:54:44.310573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:54:44.311314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:54:44.312223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:54:44.329384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:44.333058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:44.334265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:44.338511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:44.372700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Getting quotas for project ab424b95f45b482eab7de3199a1f8048. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:54:44.377374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9e2e07e7-5dea-48e0-a099-6e212cb6eaac tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:44.378576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Getting quotas for user 995976a38f22434194707b7f464980c1 and project ab424b95f45b482eab7de3199a1f8048. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:54:44.385940 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9e2e07e7-5dea-48e0-a099-6e212cb6eaac tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1470 microversion: 2.1 time: 0.942725 Mar 05 20:54:44.386531 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 959/1817] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:43 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1470 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:44.392915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:54:44.395521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:54:44.404142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fc2fc6bd-c81a-4b8a-8ed5-868a59368a8f tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] Calling method '.version_select at 0x7fed61b495e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:44.449784 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4e829302-1110-4e12-8c95-569007377e08 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.340235 Mar 05 20:54:44.455793 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 859/1818] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:54:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:54:44.462472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f8a790ee-5486-4863-96d7-747f5639716d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:44.463360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f8a790ee-5486-4863-96d7-747f5639716d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:44.473649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8a790ee-5486-4863-96d7-747f5639716d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:44.474378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8a790ee-5486-4863-96d7-747f5639716d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:44.475382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8a790ee-5486-4863-96d7-747f5639716d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:44.476270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8a790ee-5486-4863-96d7-747f5639716d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:44.502175 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fc2fc6bd-c81a-4b8a-8ed5-868a59368a8f tempest-VolumesTestJSON-2099402191 tempest-VolumesTestJSON-2099402191-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.102571 Mar 05 20:54:44.502763 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 960/1819] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 20:54:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:44.517833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d1c3cff3-d6d5-4e10-b8d7-38bb2cf0cd88 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:44.518913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d1c3cff3-d6d5-4e10-b8d7-38bb2cf0cd88 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:44.528174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1c3cff3-d6d5-4e10-b8d7-38bb2cf0cd88 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:44.528952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1c3cff3-d6d5-4e10-b8d7-38bb2cf0cd88 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:44.529970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1c3cff3-d6d5-4e10-b8d7-38bb2cf0cd88 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:44.530652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1c3cff3-d6d5-4e10-b8d7-38bb2cf0cd88 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:44.760071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f8a790ee-5486-4863-96d7-747f5639716d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:44.770227 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f8a790ee-5486-4863-96d7-747f5639716d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1321 microversion: 2.1 time: 0.312725 Mar 05 20:54:44.771406 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 860/1820] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:44 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:44.777660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e3467627-0243-4e6b-a15f-7bca2d524675 req-a97e9c94-a3f4-4b49-a432-a41b5d7b7c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbb1c17-d366-4ba5-9665-68a62f95f341", "name": "network-vif-plugged", "status": "completed", "tag": "de431d40-486f-404d-9b88-d63c337d45e9"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:44.787852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e3467627-0243-4e6b-a15f-7bca2d524675 req-a97e9c94-a3f4-4b49-a432-a41b5d7b7c65 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:44.788787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e3467627-0243-4e6b-a15f-7bca2d524675 req-a97e9c94-a3f4-4b49-a432-a41b5d7b7c65 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:44.816451 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e3467627-0243-4e6b-a15f-7bca2d524675 req-a97e9c94-a3f4-4b49-a432-a41b5d7b7c65 service nova] Creating event network-vif-plugged:de431d40-486f-404d-9b88-d63c337d45e9 for instance 6fbb1c17-d366-4ba5-9665-68a62f95f341 on nch2-master-1 Mar 05 20:54:44.825611 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e3467627-0243-4e6b-a15f-7bca2d524675 req-a97e9c94-a3f4-4b49-a432-a41b5d7b7c65 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052674 Mar 05 20:54:44.829681 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 861/1821] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:44.835419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d7aec6b1-d46a-42c8-94a5-053642cdf65e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:44.836435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d7aec6b1-d46a-42c8-94a5-053642cdf65e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:44.846836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7aec6b1-d46a-42c8-94a5-053642cdf65e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:44.847391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7aec6b1-d46a-42c8-94a5-053642cdf65e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:44.848238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7aec6b1-d46a-42c8-94a5-053642cdf65e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:44.848790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7aec6b1-d46a-42c8-94a5-053642cdf65e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:44.887292 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-d7aec6b1-d46a-42c8-94a5-053642cdf65e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] HTTP exception thrown: Instance 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b could not be found. Mar 05 20:54:44.888922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d7aec6b1-d46a-42c8-94a5-053642cdf65e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 404 to user: Instance 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:44.890228 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d7aec6b1-d46a-42c8-94a5-053642cdf65e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 404 len: 111 microversion: 2.1 time: 0.059061 Mar 05 20:54:44.892000 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 862/1822] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:44 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:54:44.917350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a7d562ec-4276-4b6f-b565-7fcc73125158 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c61d9d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:45.080289 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a7d562ec-4276-4b6f-b565-7fcc73125158 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.184790 Mar 05 20:54:45.082725 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 863/1823] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:44 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:45.097784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0de0fbe2-10dd-41cc-ad96-3ea529f3b991 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:45.099543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0de0fbe2-10dd-41cc-ad96-3ea529f3b991 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:45.219415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0de0fbe2-10dd-41cc-ad96-3ea529f3b991 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:45.231508 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0de0fbe2-10dd-41cc-ad96-3ea529f3b991 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1225 microversion: 2.1 time: 0.146915 Mar 05 20:54:45.243955 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 864/1824] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:45 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1225 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:45.257836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-9ecd0c18-10c5-4e93-8958-62cfe616c766 req-9d40b4bb-73fc-4b88-939e-109d39e16503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b", "name": "network-vif-deleted", "tag": "20167121-7ae4-4eaf-b943-f8a27843c51a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:45.276609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9ecd0c18-10c5-4e93-8958-62cfe616c766 req-9d40b4bb-73fc-4b88-939e-109d39e16503 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:45.279418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9ecd0c18-10c5-4e93-8958-62cfe616c766 req-9d40b4bb-73fc-4b88-939e-109d39e16503 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:45.307004 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-9ecd0c18-10c5-4e93-8958-62cfe616c766 req-9d40b4bb-73fc-4b88-939e-109d39e16503 service nova] Creating event network-vif-deleted:20167121-7ae4-4eaf-b943-f8a27843c51a for instance 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b on nch2-master-1 Mar 05 20:54:45.322358 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-9ecd0c18-10c5-4e93-8958-62cfe616c766 req-9d40b4bb-73fc-4b88-939e-109d39e16503 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074782 Mar 05 20:54:45.326826 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 865/1825] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:45.333233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1994143037", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:45.471784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] validate_networks() for [('2946acdb-a2ef-4ca1-ac26-ee00745cfd9f', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:54:45.770741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d1c3cff3-d6d5-4e10-b8d7-38bb2cf0cd88 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:45.813907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d1c3cff3-d6d5-4e10-b8d7-38bb2cf0cd88 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:45.821233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d1c3cff3-d6d5-4e10-b8d7-38bb2cf0cd88 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:45.836431 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d1c3cff3-d6d5-4e10-b8d7-38bb2cf0cd88 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1646 microversion: 2.25 time: 1.311761 Mar 05 20:54:45.849257 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 961/1826] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:44 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1646 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:45.869441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3723d8a2-c8b3-4d9f-b324-6227b2520f88 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:45.873574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3723d8a2-c8b3-4d9f-b324-6227b2520f88 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:45.906592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3723d8a2-c8b3-4d9f-b324-6227b2520f88 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:45.910082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3723d8a2-c8b3-4d9f-b324-6227b2520f88 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:45.913739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3723d8a2-c8b3-4d9f-b324-6227b2520f88 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:45.920566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3723d8a2-c8b3-4d9f-b324-6227b2520f88 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:46.438585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3723d8a2-c8b3-4d9f-b324-6227b2520f88 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:46.447724 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3723d8a2-c8b3-4d9f-b324-6227b2520f88 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1463 microversion: 2.1 time: 0.596081 Mar 05 20:54:46.459503 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 962/1827] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:45 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1463 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:46.465943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b11cf35c-503a-49cc-9e97-ce29cc55a26e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:46.466814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b11cf35c-503a-49cc-9e97-ce29cc55a26e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:46.473700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b11cf35c-503a-49cc-9e97-ce29cc55a26e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:46.474588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b11cf35c-503a-49cc-9e97-ce29cc55a26e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:46.475577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b11cf35c-503a-49cc-9e97-ce29cc55a26e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:46.476409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b11cf35c-503a-49cc-9e97-ce29cc55a26e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:46.969884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:54:46.971567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:54:46.989968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:54:46.991107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:54:46.993788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:54:47.030794 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:47.033015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:47.035067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:47.036140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:47.080359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Getting quotas for project f177f4eebae0479d86a35a7531da201f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:54:47.091710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Getting quotas for user ced50a298a4242d8a1856fe9b2cc454e and project f177f4eebae0479d86a35a7531da201f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:54:47.121274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:54:47.127416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:54:47.258443 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a925aa29-25db-48db-916d-f94be52cbe59 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.929857 Mar 05 20:54:47.264640 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 866/1828] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:54:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:54:47.296101 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4454c309-aa23-40ef-bd9c-86ff8eda82df tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c780670>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:47.457667 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4454c309-aa23-40ef-bd9c-86ff8eda82df tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.191574 Mar 05 20:54:47.459280 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 867/1829] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:47 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:47.478087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fbedea64-fb9b-470a-b2b0-c12f90e8f941 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:47.478932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fbedea64-fb9b-470a-b2b0-c12f90e8f941 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:47.501499 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbedea64-fb9b-470a-b2b0-c12f90e8f941 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:47.509399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbedea64-fb9b-470a-b2b0-c12f90e8f941 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:47.511912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbedea64-fb9b-470a-b2b0-c12f90e8f941 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:47.515100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbedea64-fb9b-470a-b2b0-c12f90e8f941 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:47.610887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b11cf35c-503a-49cc-9e97-ce29cc55a26e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:47.630014 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b11cf35c-503a-49cc-9e97-ce29cc55a26e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1321 microversion: 2.1 time: 1.167119 Mar 05 20:54:47.638980 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 963/1830] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:46 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1321 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:47.669973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91a45a03-2368-4d00-82cf-50abfe5315c3 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:47.672421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91a45a03-2368-4d00-82cf-50abfe5315c3 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:47.705817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fbedea64-fb9b-470a-b2b0-c12f90e8f941 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:47.713102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91a45a03-2368-4d00-82cf-50abfe5315c3 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:47.713663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91a45a03-2368-4d00-82cf-50abfe5315c3 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:47.714353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91a45a03-2368-4d00-82cf-50abfe5315c3 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:47.714802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91a45a03-2368-4d00-82cf-50abfe5315c3 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:47.726592 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fbedea64-fb9b-470a-b2b0-c12f90e8f941 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1283 microversion: 2.1 time: 0.262391 Mar 05 20:54:47.732049 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 868/1831] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:47 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1283 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:47.756594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c4f9f3de-2eec-424e-9a55-c49b5b704d6b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:47.760745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c4f9f3de-2eec-424e-9a55-c49b5b704d6b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:47.802054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4f9f3de-2eec-424e-9a55-c49b5b704d6b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:47.809786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4f9f3de-2eec-424e-9a55-c49b5b704d6b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:47.812358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4f9f3de-2eec-424e-9a55-c49b5b704d6b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:47.815804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4f9f3de-2eec-424e-9a55-c49b5b704d6b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:48.170569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c4f9f3de-2eec-424e-9a55-c49b5b704d6b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:48.192293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c4f9f3de-2eec-424e-9a55-c49b5b704d6b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:48.199515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c4f9f3de-2eec-424e-9a55-c49b5b704d6b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:48.203648 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c4f9f3de-2eec-424e-9a55-c49b5b704d6b tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1646 microversion: 2.25 time: 0.465959 Mar 05 20:54:48.207481 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 869/1832] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:47 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1646 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:48.217615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-64015d9b-71d2-457f-8b6e-fffd3869caa1 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:48.219020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-64015d9b-71d2-457f-8b6e-fffd3869caa1 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:48.360324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-64015d9b-71d2-457f-8b6e-fffd3869caa1 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:48.374055 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-64015d9b-71d2-457f-8b6e-fffd3869caa1 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1225 microversion: 2.1 time: 0.162924 Mar 05 20:54:48.376856 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 870/1833] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:48 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1225 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:48.391528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e1c02092-478c-4f19-b247-1d042855263e req-80deccb1-9bea-4ef3-bc4a-cf308ff2b976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c65952-c3d5-4826-9fe6-48c5f0ec86a7", "name": "network-vif-plugged", "status": "completed", "tag": "727f750d-d4cf-46e8-b684-69803f8825eb"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:48.433842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e1c02092-478c-4f19-b247-1d042855263e req-80deccb1-9bea-4ef3-bc4a-cf308ff2b976 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:48.436377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e1c02092-478c-4f19-b247-1d042855263e req-80deccb1-9bea-4ef3-bc4a-cf308ff2b976 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:48.464586 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e1c02092-478c-4f19-b247-1d042855263e req-80deccb1-9bea-4ef3-bc4a-cf308ff2b976 service nova] Creating event network-vif-plugged:727f750d-d4cf-46e8-b684-69803f8825eb for instance f4c65952-c3d5-4826-9fe6-48c5f0ec86a7 on nch1-master-1 Mar 05 20:54:48.483940 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e1c02092-478c-4f19-b247-1d042855263e req-80deccb1-9bea-4ef3-bc4a-cf308ff2b976 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105487 Mar 05 20:54:48.519361 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 871/1834] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:48.548258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-84308749-5bef-4fce-b2f5-82289030f7f4 req-02d7e96d-560d-4176-965c-2dcccd3ed93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019a8023-9015-41ae-974a-eb725177770d", "name": "network-vif-unplugged", "status": "completed", "tag": "38ee5a79-ec27-42bc-985c-95ae7544d810"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:48.591007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-84308749-5bef-4fce-b2f5-82289030f7f4 req-02d7e96d-560d-4176-965c-2dcccd3ed93a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:48.592499 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-84308749-5bef-4fce-b2f5-82289030f7f4 req-02d7e96d-560d-4176-965c-2dcccd3ed93a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:48.614472 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-84308749-5bef-4fce-b2f5-82289030f7f4 req-02d7e96d-560d-4176-965c-2dcccd3ed93a service nova] Creating event network-vif-unplugged:38ee5a79-ec27-42bc-985c-95ae7544d810 for instance 019a8023-9015-41ae-974a-eb725177770d on nch2-master-1 Mar 05 20:54:48.626222 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-84308749-5bef-4fce-b2f5-82289030f7f4 req-02d7e96d-560d-4176-965c-2dcccd3ed93a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101567 Mar 05 20:54:48.627641 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 872/1835] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:48.646302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-46252631-7978-4c22-b429-9ae0723a3cec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5ed23310>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:48.735059 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-46252631-7978-4c22-b429-9ae0723a3cec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.102688 Mar 05 20:54:48.736329 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 873/1836] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:48 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:48.746781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a6f7f094-60ae-4f54-bda7-08abceee2046 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:48.748344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a6f7f094-60ae-4f54-bda7-08abceee2046 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:48.782713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6f7f094-60ae-4f54-bda7-08abceee2046 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:48.783103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6f7f094-60ae-4f54-bda7-08abceee2046 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:48.783948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6f7f094-60ae-4f54-bda7-08abceee2046 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:48.784397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6f7f094-60ae-4f54-bda7-08abceee2046 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:49.120377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a6f7f094-60ae-4f54-bda7-08abceee2046 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:49.137638 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a6f7f094-60ae-4f54-bda7-08abceee2046 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1321 microversion: 2.1 time: 0.399986 Mar 05 20:54:49.166317 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 874/1837] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:48 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:49.193603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-12dbc5c0-dabb-4539-aaad-71c83bafc744 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:49.195157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-12dbc5c0-dabb-4539-aaad-71c83bafc744 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:49.232538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-12dbc5c0-dabb-4539-aaad-71c83bafc744 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:49.233286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-12dbc5c0-dabb-4539-aaad-71c83bafc744 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:49.234245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-12dbc5c0-dabb-4539-aaad-71c83bafc744 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:49.234845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-12dbc5c0-dabb-4539-aaad-71c83bafc744 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:49.375138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-12dbc5c0-dabb-4539-aaad-71c83bafc744 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:49.391262 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91a45a03-2368-4d00-82cf-50abfe5315c3 tempest-MigrationsAdminTest-296184086 tempest-MigrationsAdminTest-296184086-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1614 microversion: 2.1 time: 1.746511 Mar 05 20:54:49.392738 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-12dbc5c0-dabb-4539-aaad-71c83bafc744 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1283 microversion: 2.1 time: 0.220730 Mar 05 20:54:49.392912 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 875/1838] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:49 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1283 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:49.393630 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 964/1839] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:47 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1614 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:49.407016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0ad5031e-3695-43d1-a021-8f477161884a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:49.408020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0ad5031e-3695-43d1-a021-8f477161884a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:49.423795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-51f700bc-b839-4d31-a915-63200e476115 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:49.424718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-51f700bc-b839-4d31-a915-63200e476115 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:49.434605 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51f700bc-b839-4d31-a915-63200e476115 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:49.435067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51f700bc-b839-4d31-a915-63200e476115 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:49.437198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ad5031e-3695-43d1-a021-8f477161884a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:49.437715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ad5031e-3695-43d1-a021-8f477161884a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:49.438599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ad5031e-3695-43d1-a021-8f477161884a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:49.438988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51f700bc-b839-4d31-a915-63200e476115 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:49.439701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51f700bc-b839-4d31-a915-63200e476115 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:49.440554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ad5031e-3695-43d1-a021-8f477161884a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:49.631937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-51f700bc-b839-4d31-a915-63200e476115 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:49.655558 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-51f700bc-b839-4d31-a915-63200e476115 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1285 microversion: 2.1 time: 0.229922 Mar 05 20:54:49.659801 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 965/1840] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:49 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:54:49.679495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-90cec622-9f38-457f-a5fc-f8d4bd65d4fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:49.681757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-90cec622-9f38-457f-a5fc-f8d4bd65d4fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:49.700293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90cec622-9f38-457f-a5fc-f8d4bd65d4fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:49.701684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90cec622-9f38-457f-a5fc-f8d4bd65d4fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:49.702845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90cec622-9f38-457f-a5fc-f8d4bd65d4fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:49.706241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90cec622-9f38-457f-a5fc-f8d4bd65d4fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:49.775221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-90cec622-9f38-457f-a5fc-f8d4bd65d4fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:54:49.828229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0ad5031e-3695-43d1-a021-8f477161884a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:49.837026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0ad5031e-3695-43d1-a021-8f477161884a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:49.846405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0ad5031e-3695-43d1-a021-8f477161884a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:49.847003 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0ad5031e-3695-43d1-a021-8f477161884a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1646 microversion: 2.25 time: 0.452703 Mar 05 20:54:49.859321 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 876/1841] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:49 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1646 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:49.859321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6f5a0e4a-19a1-4955-b46d-04474c08f866 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c61d940>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:49.933034 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6f5a0e4a-19a1-4955-b46d-04474c08f866 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.080345 Mar 05 20:54:49.933994 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 877/1842] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:49 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:49.944528 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-90cec622-9f38-457f-a5fc-f8d4bd65d4fb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 204 len: 0 microversion: 2.1 time: 0.280839 Mar 05 20:54:49.947001 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 966/1843] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:54:49 2022] DELETE /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:54:49.955282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-68c1fc6f-311c-46c1-ba49-c8e800001f7c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:49.956005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-68c1fc6f-311c-46c1-ba49-c8e800001f7c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:49.969631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68c1fc6f-311c-46c1-ba49-c8e800001f7c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:49.970913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68c1fc6f-311c-46c1-ba49-c8e800001f7c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:49.972003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68c1fc6f-311c-46c1-ba49-c8e800001f7c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:49.972450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68c1fc6f-311c-46c1-ba49-c8e800001f7c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:50.167224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5d5e354d-eeb1-4c84-b2c0-090afb11bb08 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:50.168285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5d5e354d-eeb1-4c84-b2c0-090afb11bb08 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:50.169257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-68c1fc6f-311c-46c1-ba49-c8e800001f7c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:50.178340 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-68c1fc6f-311c-46c1-ba49-c8e800001f7c tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1469 microversion: 2.1 time: 0.227204 Mar 05 20:54:50.180819 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 878/1844] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:49 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1469 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:50.181700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d5e354d-eeb1-4c84-b2c0-090afb11bb08 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:50.182504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d5e354d-eeb1-4c84-b2c0-090afb11bb08 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:50.183372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d5e354d-eeb1-4c84-b2c0-090afb11bb08 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:50.183869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d5e354d-eeb1-4c84-b2c0-090afb11bb08 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:50.417130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0a207a83-63e0-4d83-bf59-413e399e88b6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:50.417889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0a207a83-63e0-4d83-bf59-413e399e88b6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:50.424371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a207a83-63e0-4d83-bf59-413e399e88b6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:50.424823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a207a83-63e0-4d83-bf59-413e399e88b6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:50.425608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a207a83-63e0-4d83-bf59-413e399e88b6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:50.428831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a207a83-63e0-4d83-bf59-413e399e88b6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:50.509624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0a207a83-63e0-4d83-bf59-413e399e88b6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:50.518057 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0a207a83-63e0-4d83-bf59-413e399e88b6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1283 microversion: 2.1 time: 0.112540 Mar 05 20:54:50.537633 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 879/1845] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:50 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1283 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:54:50.619536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-84504b42-a2ef-4dbd-9a48-328210484d96 req-7fddb9c3-569e-4dca-bdcc-759130df5bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c204e8d4-97d5-4836-b7b5-3700e219dea6", "name": "network-vif-plugged", "status": "completed", "tag": "ec3287d8-2694-4693-885a-dc693fd9360a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:50.643383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5d5e354d-eeb1-4c84-b2c0-090afb11bb08 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:50.646836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-84504b42-a2ef-4dbd-9a48-328210484d96 req-7fddb9c3-569e-4dca-bdcc-759130df5bb1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:50.648504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-84504b42-a2ef-4dbd-9a48-328210484d96 req-7fddb9c3-569e-4dca-bdcc-759130df5bb1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:50.656337 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5d5e354d-eeb1-4c84-b2c0-090afb11bb08 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1321 microversion: 2.1 time: 0.492268 Mar 05 20:54:50.664030 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 967/1846] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:50 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1321 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:50.677728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8bac4ee0-8f15-4b49-8f75-b57ba5056323 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:50.678248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8bac4ee0-8f15-4b49-8f75-b57ba5056323 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:50.702019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bac4ee0-8f15-4b49-8f75-b57ba5056323 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:50.702733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bac4ee0-8f15-4b49-8f75-b57ba5056323 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:50.703600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bac4ee0-8f15-4b49-8f75-b57ba5056323 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:50.705325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bac4ee0-8f15-4b49-8f75-b57ba5056323 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:50.714804 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-84504b42-a2ef-4dbd-9a48-328210484d96 req-7fddb9c3-569e-4dca-bdcc-759130df5bb1 service nova] Creating event network-vif-plugged:ec3287d8-2694-4693-885a-dc693fd9360a for instance c204e8d4-97d5-4836-b7b5-3700e219dea6 on nch2-master-1 Mar 05 20:54:50.727024 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-84504b42-a2ef-4dbd-9a48-328210484d96 req-7fddb9c3-569e-4dca-bdcc-759130df5bb1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111619 Mar 05 20:54:50.731553 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 880/1847] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:54:50.763146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d8b07d69-b9b6-4579-b45e-c896c0c537cd req-0bab48e6-faeb-495b-bf5a-338c0994e623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "019a8023-9015-41ae-974a-eb725177770d", "tag": "38ee5a79-ec27-42bc-985c-95ae7544d810"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:50.789083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d8b07d69-b9b6-4579-b45e-c896c0c537cd req-0bab48e6-faeb-495b-bf5a-338c0994e623 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:50.791549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d8b07d69-b9b6-4579-b45e-c896c0c537cd req-0bab48e6-faeb-495b-bf5a-338c0994e623 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:50.814007 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d8b07d69-b9b6-4579-b45e-c896c0c537cd req-0bab48e6-faeb-495b-bf5a-338c0994e623 service nova] Creating event network-changed:38ee5a79-ec27-42bc-985c-95ae7544d810 for instance 019a8023-9015-41ae-974a-eb725177770d on nch2-master-1 Mar 05 20:54:50.833514 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d8b07d69-b9b6-4579-b45e-c896c0c537cd req-0bab48e6-faeb-495b-bf5a-338c0994e623 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076137 Mar 05 20:54:50.836417 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 881/1848] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:50.871588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cdb2f474-ac0b-4aee-b56f-04c0058c7c34 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:50.872863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cdb2f474-ac0b-4aee-b56f-04c0058c7c34 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:50.881569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cdb2f474-ac0b-4aee-b56f-04c0058c7c34 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:50.882764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cdb2f474-ac0b-4aee-b56f-04c0058c7c34 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:50.894697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8bac4ee0-8f15-4b49-8f75-b57ba5056323 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:50.899633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cdb2f474-ac0b-4aee-b56f-04c0058c7c34 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:50.900481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cdb2f474-ac0b-4aee-b56f-04c0058c7c34 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:50.905324 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8bac4ee0-8f15-4b49-8f75-b57ba5056323 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1283 microversion: 2.1 time: 0.231996 Mar 05 20:54:50.920795 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 968/1849] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:50 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1283 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:50.946698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-32f196c6-4796-4c74-929c-46213ae9ed95 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed61b4c0d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:51.058491 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-32f196c6-4796-4c74-929c-46213ae9ed95 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.115794 Mar 05 20:54:51.059318 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 969/1850] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:50 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:54:51.197785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0318f9d8-f483-4e19-9c30-a3179e63f412 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:51.198947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0318f9d8-f483-4e19-9c30-a3179e63f412 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:51.216458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0318f9d8-f483-4e19-9c30-a3179e63f412 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:51.217330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0318f9d8-f483-4e19-9c30-a3179e63f412 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:51.218465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0318f9d8-f483-4e19-9c30-a3179e63f412 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:51.219567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0318f9d8-f483-4e19-9c30-a3179e63f412 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:51.476348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cdb2f474-ac0b-4aee-b56f-04c0058c7c34 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:51.496806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cdb2f474-ac0b-4aee-b56f-04c0058c7c34 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:51.501501 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cdb2f474-ac0b-4aee-b56f-04c0058c7c34 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:51.503595 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cdb2f474-ac0b-4aee-b56f-04c0058c7c34 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1646 microversion: 2.25 time: 0.640176 Mar 05 20:54:51.516657 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 882/1851] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:50 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1646 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:54:51.556695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2c561772-72b0-4b7b-b581-b0f817ba832b tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:51.557135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2c561772-72b0-4b7b-b581-b0f817ba832b tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:51.572750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c561772-72b0-4b7b-b581-b0f817ba832b tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:51.573218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c561772-72b0-4b7b-b581-b0f817ba832b tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:51.574025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c561772-72b0-4b7b-b581-b0f817ba832b tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:51.574472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c561772-72b0-4b7b-b581-b0f817ba832b tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:51.936329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2c561772-72b0-4b7b-b581-b0f817ba832b tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:51.955384 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2c561772-72b0-4b7b-b581-b0f817ba832b tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1325 microversion: 2.1 time: 0.405228 Mar 05 20:54:51.970112 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 883/1852] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:51 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1325 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:51.978224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3bb0b488-b301-4aa8-82dd-a332b4c7caae tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:51.980559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3bb0b488-b301-4aa8-82dd-a332b4c7caae tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:51.999286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bb0b488-b301-4aa8-82dd-a332b4c7caae tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:52.001588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bb0b488-b301-4aa8-82dd-a332b4c7caae tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:52.005215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bb0b488-b301-4aa8-82dd-a332b4c7caae tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:52.005796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bb0b488-b301-4aa8-82dd-a332b4c7caae tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:52.218406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0318f9d8-f483-4e19-9c30-a3179e63f412 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:52.231321 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0318f9d8-f483-4e19-9c30-a3179e63f412 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1469 microversion: 2.1 time: 1.038091 Mar 05 20:54:52.231960 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 970/1853] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:51 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1469 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:54:52.248442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f2e844f3-2caf-4779-af80-49c70ab4707e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:52.260214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f2e844f3-2caf-4779-af80-49c70ab4707e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:52.269615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2e844f3-2caf-4779-af80-49c70ab4707e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:52.270772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2e844f3-2caf-4779-af80-49c70ab4707e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:52.272498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2e844f3-2caf-4779-af80-49c70ab4707e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:52.276766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2e844f3-2caf-4779-af80-49c70ab4707e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:52.492307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3bb0b488-b301-4aa8-82dd-a332b4c7caae tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:52.510858 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3bb0b488-b301-4aa8-82dd-a332b4c7caae tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1321 microversion: 2.1 time: 0.538879 Mar 05 20:54:52.513785 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 884/1854] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:51 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1321 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:52.532977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7ab2011c-c830-4899-9739-42c9f3f8f9fe tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5cf30c10>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:52.625917 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7ab2011c-c830-4899-9739-42c9f3f8f9fe tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1410 microversion: 2.1 time: 0.110467 Mar 05 20:54:52.632952 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 885/1855] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:52 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1410 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:52.639791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-210ba03f-d3ee-443e-ba68-cc3f35035fa6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:52.640647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-210ba03f-d3ee-443e-ba68-cc3f35035fa6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:52.647704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-210ba03f-d3ee-443e-ba68-cc3f35035fa6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:52.648465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-210ba03f-d3ee-443e-ba68-cc3f35035fa6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:52.649698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-210ba03f-d3ee-443e-ba68-cc3f35035fa6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:52.650358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-210ba03f-d3ee-443e-ba68-cc3f35035fa6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:52.852353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-210ba03f-d3ee-443e-ba68-cc3f35035fa6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:52.865564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-210ba03f-d3ee-443e-ba68-cc3f35035fa6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:52.869666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-210ba03f-d3ee-443e-ba68-cc3f35035fa6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:52.871569 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-210ba03f-d3ee-443e-ba68-cc3f35035fa6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1646 microversion: 2.25 time: 0.235935 Mar 05 20:54:52.873328 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 886/1856] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:52 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1646 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:52.891718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-ab7efd16-11cf-4453-8dac-ba4dcb6d2997 req-f1d4dbdd-a598-4b31-a112-2254c8352a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e83e1e1-a9df-4257-a596-e67ee39ac474", "name": "network-vif-plugged", "status": "completed", "tag": "16cf4bd3-62b6-4ec8-863b-656e8ed0397b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:52.908591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ab7efd16-11cf-4453-8dac-ba4dcb6d2997 req-f1d4dbdd-a598-4b31-a112-2254c8352a1a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:52.909323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ab7efd16-11cf-4453-8dac-ba4dcb6d2997 req-f1d4dbdd-a598-4b31-a112-2254c8352a1a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:52.928542 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ab7efd16-11cf-4453-8dac-ba4dcb6d2997 req-f1d4dbdd-a598-4b31-a112-2254c8352a1a service nova] Creating event network-vif-plugged:16cf4bd3-62b6-4ec8-863b-656e8ed0397b for instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 on nch1-master-1 Mar 05 20:54:52.938891 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-ab7efd16-11cf-4453-8dac-ba4dcb6d2997 req-f1d4dbdd-a598-4b31-a112-2254c8352a1a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063458 Mar 05 20:54:52.944542 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 887/1857] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:52.981674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-81418b6a-76ab-441e-9a69-93a5611f3371 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:52.982783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-81418b6a-76ab-441e-9a69-93a5611f3371 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:52.996048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81418b6a-76ab-441e-9a69-93a5611f3371 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:52.997205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81418b6a-76ab-441e-9a69-93a5611f3371 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:52.998648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81418b6a-76ab-441e-9a69-93a5611f3371 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:52.999758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81418b6a-76ab-441e-9a69-93a5611f3371 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:53.155987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f2e844f3-2caf-4779-af80-49c70ab4707e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:53.171648 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f2e844f3-2caf-4779-af80-49c70ab4707e tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1325 microversion: 2.1 time: 0.936093 Mar 05 20:54:53.174389 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 971/1858] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:52 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1325 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:53.239275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-81418b6a-76ab-441e-9a69-93a5611f3371 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:53.248488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ee6be485-cade-4359-9434-5bd2d96ca010 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:53.249819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ee6be485-cade-4359-9434-5bd2d96ca010 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:53.257894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee6be485-cade-4359-9434-5bd2d96ca010 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:53.263474 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-81418b6a-76ab-441e-9a69-93a5611f3371 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1325 microversion: 2.1 time: 0.288844 Mar 05 20:54:53.264291 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 888/1859] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:52 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1325 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:53.273563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee6be485-cade-4359-9434-5bd2d96ca010 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:53.275590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee6be485-cade-4359-9434-5bd2d96ca010 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:53.276393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee6be485-cade-4359-9434-5bd2d96ca010 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:53.534284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fcfd7b06-219c-49d0-ae95-2b66c1f955d5 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:53.534912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fcfd7b06-219c-49d0-ae95-2b66c1f955d5 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:53.547594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fcfd7b06-219c-49d0-ae95-2b66c1f955d5 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:53.549479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fcfd7b06-219c-49d0-ae95-2b66c1f955d5 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:53.550325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fcfd7b06-219c-49d0-ae95-2b66c1f955d5 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:53.550765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fcfd7b06-219c-49d0-ae95-2b66c1f955d5 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:53.744439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fcfd7b06-219c-49d0-ae95-2b66c1f955d5 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:53.768516 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fcfd7b06-219c-49d0-ae95-2b66c1f955d5 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1511 microversion: 2.1 time: 0.238688 Mar 05 20:54:53.769305 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 889/1860] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:53 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:53.791408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45241a46-bb37-4fc7-81c4-0cdff70a1028 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c5829d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:53.861623 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45241a46-bb37-4fc7-81c4-0cdff70a1028 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1419 microversion: 2.1 time: 0.084589 Mar 05 20:54:53.871460 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 890/1861] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:53 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1419 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:53.887482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6baeda9f-a238-4529-bcf4-ee39c36e8e3b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:53.888196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6baeda9f-a238-4529-bcf4-ee39c36e8e3b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:53.904338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6baeda9f-a238-4529-bcf4-ee39c36e8e3b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:53.905241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6baeda9f-a238-4529-bcf4-ee39c36e8e3b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:53.906532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6baeda9f-a238-4529-bcf4-ee39c36e8e3b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:53.907201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6baeda9f-a238-4529-bcf4-ee39c36e8e3b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:54.031217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ee6be485-cade-4359-9434-5bd2d96ca010 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:54.047063 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ee6be485-cade-4359-9434-5bd2d96ca010 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 200 len: 1469 microversion: 2.1 time: 0.801069 Mar 05 20:54:54.051015 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 972/1862] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:53 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 1469 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:54.076784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9e81b5a7-dd19-4494-8637-ddd4767812c1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c42c4c0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:54.156163 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9e81b5a7-dd19-4494-8637-ddd4767812c1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 200 len: 1419 microversion: 2.1 time: 0.102197 Mar 05 20:54:54.170035 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 973/1863] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:54:54 2022] GET /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 1419 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:54.186296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-01ab145f-cd25-4158-a6d2-f5b47994d6d3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:54.187192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-01ab145f-cd25-4158-a6d2-f5b47994d6d3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:54.202142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01ab145f-cd25-4158-a6d2-f5b47994d6d3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:54.202606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01ab145f-cd25-4158-a6d2-f5b47994d6d3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:54.203405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01ab145f-cd25-4158-a6d2-f5b47994d6d3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:54.205148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01ab145f-cd25-4158-a6d2-f5b47994d6d3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:54.219559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6baeda9f-a238-4529-bcf4-ee39c36e8e3b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:54.228682 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6baeda9f-a238-4529-bcf4-ee39c36e8e3b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1511 microversion: 2.1 time: 0.356017 Mar 05 20:54:54.229284 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 891/1864] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:53 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1511 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:54.248160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-3bf55622-b264-4faa-b8d9-cb03dd146a36 req-30200040-bb13-49ca-9839-23f1439769cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e83e1e1-a9df-4257-a596-e67ee39ac474", "name": "network-vif-deleted", "tag": "16cf4bd3-62b6-4ec8-863b-656e8ed0397b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:54.270320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3bf55622-b264-4faa-b8d9-cb03dd146a36 req-30200040-bb13-49ca-9839-23f1439769cf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:54.271487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3bf55622-b264-4faa-b8d9-cb03dd146a36 req-30200040-bb13-49ca-9839-23f1439769cf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:54.296313 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-3bf55622-b264-4faa-b8d9-cb03dd146a36 req-30200040-bb13-49ca-9839-23f1439769cf service nova] Creating event network-vif-deleted:16cf4bd3-62b6-4ec8-863b-656e8ed0397b for instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 on nch1-master-1 Mar 05 20:54:54.302543 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-3bf55622-b264-4faa-b8d9-cb03dd146a36 req-30200040-bb13-49ca-9839-23f1439769cf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071970 Mar 05 20:54:54.303507 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 892/1865] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:54.309495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a31d7e2e-b2b4-43d2-874c-4fb7d63f2266 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c903790>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:54.688174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-01ab145f-cd25-4158-a6d2-f5b47994d6d3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:54.706011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-01ab145f-cd25-4158-a6d2-f5b47994d6d3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:54.708273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-01ab145f-cd25-4158-a6d2-f5b47994d6d3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:54.709582 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-01ab145f-cd25-4158-a6d2-f5b47994d6d3 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1646 microversion: 2.25 time: 0.532210 Mar 05 20:54:54.710250 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 974/1866] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:54 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1646 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:54.730732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cd9d0351-d3ae-4e41-8baf-6f82e7c30149 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:54.732537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cd9d0351-d3ae-4e41-8baf-6f82e7c30149 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:54.751344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd9d0351-d3ae-4e41-8baf-6f82e7c30149 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:54.751939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd9d0351-d3ae-4e41-8baf-6f82e7c30149 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:54.752958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd9d0351-d3ae-4e41-8baf-6f82e7c30149 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:54.753457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd9d0351-d3ae-4e41-8baf-6f82e7c30149 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:55.127952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cd9d0351-d3ae-4e41-8baf-6f82e7c30149 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:55.146375 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cd9d0351-d3ae-4e41-8baf-6f82e7c30149 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1325 microversion: 2.1 time: 0.426763 Mar 05 20:54:55.146996 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 975/1867] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:54 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1325 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:55.158590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5aea2fe7-20f1-461e-9ff6-2c20a4b957f1 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:55.159299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5aea2fe7-20f1-461e-9ff6-2c20a4b957f1 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: f4c65952-c3d5-4826-9fe6-48c5f0ec86a7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:55.169181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5aea2fe7-20f1-461e-9ff6-2c20a4b957f1 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:55.170213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5aea2fe7-20f1-461e-9ff6-2c20a4b957f1 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:55.171552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5aea2fe7-20f1-461e-9ff6-2c20a4b957f1 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:55.172910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5aea2fe7-20f1-461e-9ff6-2c20a4b957f1 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:55.334440 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a31d7e2e-b2b4-43d2-874c-4fb7d63f2266 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 204 len: 0 microversion: 2.1 time: 1.029455 Mar 05 20:54:55.335106 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 893/1868] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:54 2022] DELETE /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:54:55.343113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cb525c31-3596-40e6-95aa-21aa87eeeec5 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:55.343910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cb525c31-3596-40e6-95aa-21aa87eeeec5 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:55.350840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb525c31-3596-40e6-95aa-21aa87eeeec5 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:55.351475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb525c31-3596-40e6-95aa-21aa87eeeec5 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:55.353012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb525c31-3596-40e6-95aa-21aa87eeeec5 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:55.353632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb525c31-3596-40e6-95aa-21aa87eeeec5 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:55.558158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5aea2fe7-20f1-461e-9ff6-2c20a4b957f1 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:55.562538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cb525c31-3596-40e6-95aa-21aa87eeeec5 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:55.569737 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5aea2fe7-20f1-461e-9ff6-2c20a4b957f1 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7" status: 200 len: 1510 microversion: 2.1 time: 0.420357 Mar 05 20:54:55.569737 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 976/1869] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:55 2022] GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7 => generated 1510 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:55.575580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-050204d5-f6ee-428b-9b7c-da3ca7e7635a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:55.576350 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cb525c31-3596-40e6-95aa-21aa87eeeec5 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1325 microversion: 2.1 time: 0.236531 Mar 05 20:54:55.576650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-050204d5-f6ee-428b-9b7c-da3ca7e7635a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 2e83e1e1-a9df-4257-a596-e67ee39ac474] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:55.587364 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 894/1870] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:55 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:55.587689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-050204d5-f6ee-428b-9b7c-da3ca7e7635a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:55.587689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-050204d5-f6ee-428b-9b7c-da3ca7e7635a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:55.587689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-050204d5-f6ee-428b-9b7c-da3ca7e7635a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:55.587957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3f4f3f31-08aa-4be1-baa0-757b7c798106 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:55.587957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3f4f3f31-08aa-4be1-baa0-757b7c798106 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:55.588113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-050204d5-f6ee-428b-9b7c-da3ca7e7635a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:55.596532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f4f3f31-08aa-4be1-baa0-757b7c798106 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:55.598078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f4f3f31-08aa-4be1-baa0-757b7c798106 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:55.599061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f4f3f31-08aa-4be1-baa0-757b7c798106 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:55.599557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f4f3f31-08aa-4be1-baa0-757b7c798106 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:55.618303 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-050204d5-f6ee-428b-9b7c-da3ca7e7635a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] HTTP exception thrown: Instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 could not be found. Mar 05 20:54:55.619140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-050204d5-f6ee-428b-9b7c-da3ca7e7635a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Returning 404 to user: Instance 2e83e1e1-a9df-4257-a596-e67ee39ac474 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:54:55.620707 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-050204d5-f6ee-428b-9b7c-da3ca7e7635a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474" status: 404 len: 111 microversion: 2.1 time: 0.050427 Mar 05 20:54:55.621605 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 977/1871] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:55 2022] GET /compute/v2.1/servers/2e83e1e1-a9df-4257-a596-e67ee39ac474 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:54:55.626971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ff729d99-d4e3-4f1c-a749-462a8613aa6a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:55.632801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ff729d99-d4e3-4f1c-a749-462a8613aa6a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:55.635270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ff729d99-d4e3-4f1c-a749-462a8613aa6a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:54:55.635900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3f4f3f31-08aa-4be1-baa0-757b7c798106 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:54:55.672576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff729d99-d4e3-4f1c-a749-462a8613aa6a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:55.673967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff729d99-d4e3-4f1c-a749-462a8613aa6a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:55.679312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff729d99-d4e3-4f1c-a749-462a8613aa6a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:55.680010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff729d99-d4e3-4f1c-a749-462a8613aa6a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:55.795186 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3f4f3f31-08aa-4be1-baa0-757b7c798106 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 204 len: 0 microversion: 2.1 time: 0.215029 Mar 05 20:54:55.796251 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 895/1872] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:54:55 2022] DELETE /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:54:55.807864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45d58104-17d5-46c6-9365-dc94e0277708 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:55.808732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-45d58104-17d5-46c6-9365-dc94e0277708 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:55.815990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45d58104-17d5-46c6-9365-dc94e0277708 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:55.816820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45d58104-17d5-46c6-9365-dc94e0277708 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:55.817778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45d58104-17d5-46c6-9365-dc94e0277708 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:55.818397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45d58104-17d5-46c6-9365-dc94e0277708 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:55.822786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-ff729d99-d4e3-4f1c-a749-462a8613aa6a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:54:55.880837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-45d58104-17d5-46c6-9365-dc94e0277708 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:54:55.929937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ff729d99-d4e3-4f1c-a749-462a8613aa6a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:55.938928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff729d99-d4e3-4f1c-a749-462a8613aa6a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:55.939769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff729d99-d4e3-4f1c-a749-462a8613aa6a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:56.042111 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45d58104-17d5-46c6-9365-dc94e0277708 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "DELETE /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 204 len: 0 microversion: 2.1 time: 0.238894 Mar 05 20:54:56.042850 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 896/1873] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:54:55 2022] DELETE /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:54:56.049579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-430b9ea1-7876-4d1b-b7c1-ab1b4f44bef1 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:56.050810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-430b9ea1-7876-4d1b-b7c1-ab1b4f44bef1 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:56.058539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-430b9ea1-7876-4d1b-b7c1-ab1b4f44bef1 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:56.059265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-430b9ea1-7876-4d1b-b7c1-ab1b4f44bef1 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:56.060290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-430b9ea1-7876-4d1b-b7c1-ab1b4f44bef1 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:56.060918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-430b9ea1-7876-4d1b-b7c1-ab1b4f44bef1 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:56.294053 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ff729d99-d4e3-4f1c-a749-462a8613aa6a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.670915 Mar 05 20:54:56.308149 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 978/1874] 10.222.0.15 () {58 vars in 1166 bytes} [Sat Mar 5 20:54:55 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:56.314429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1584017556", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "92c1bc99-8218-45a1-b95c-a4c228475460"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:56.380936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] validate_networks() for [('92c1bc99-8218-45a1-b95c-a4c228475460', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:54:56.440774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-430b9ea1-7876-4d1b-b7c1-ab1b4f44bef1 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:56.453292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-430b9ea1-7876-4d1b-b7c1-ab1b4f44bef1 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:56.455392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-430b9ea1-7876-4d1b-b7c1-ab1b4f44bef1 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:56.456938 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-430b9ea1-7876-4d1b-b7c1-ab1b4f44bef1 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1646 microversion: 2.25 time: 0.412403 Mar 05 20:54:56.457874 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 897/1875] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:56 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1646 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:56.464374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a7fd425c-fd62-4327-b3c5-f35e020dc899 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:56.465275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a7fd425c-fd62-4327-b3c5-f35e020dc899 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:56.475145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7fd425c-fd62-4327-b3c5-f35e020dc899 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:56.479021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7fd425c-fd62-4327-b3c5-f35e020dc899 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:56.480533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7fd425c-fd62-4327-b3c5-f35e020dc899 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:56.481358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7fd425c-fd62-4327-b3c5-f35e020dc899 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:56.776909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a7fd425c-fd62-4327-b3c5-f35e020dc899 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:56.790843 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a7fd425c-fd62-4327-b3c5-f35e020dc899 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1534 microversion: 2.1 time: 0.330263 Mar 05 20:54:56.791463 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 898/1876] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:56 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1534 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:56.816974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eaea809b-903a-47de-a7a9-ad64e3d41805 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:56.817684 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eaea809b-903a-47de-a7a9-ad64e3d41805 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:56.831151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eaea809b-903a-47de-a7a9-ad64e3d41805 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:56.833407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eaea809b-903a-47de-a7a9-ad64e3d41805 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:56.835624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eaea809b-903a-47de-a7a9-ad64e3d41805 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:56.836530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eaea809b-903a-47de-a7a9-ad64e3d41805 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:57.101410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eaea809b-903a-47de-a7a9-ad64e3d41805 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:57.112147 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eaea809b-903a-47de-a7a9-ad64e3d41805 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1325 microversion: 2.1 time: 0.307765 Mar 05 20:54:57.112794 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 899/1877] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:56 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1325 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:57.118150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e28cb4ee-0f87-415c-8ef3-a8e5a9df2e2d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:57.122066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e28cb4ee-0f87-415c-8ef3-a8e5a9df2e2d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:57.122930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e28cb4ee-0f87-415c-8ef3-a8e5a9df2e2d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-396293390', 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:54:57.128892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e28cb4ee-0f87-415c-8ef3-a8e5a9df2e2d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:57.129346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e28cb4ee-0f87-415c-8ef3-a8e5a9df2e2d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:57.130641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e28cb4ee-0f87-415c-8ef3-a8e5a9df2e2d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:57.131132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e28cb4ee-0f87-415c-8ef3-a8e5a9df2e2d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:57.208420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:54:57.209490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:54:57.210331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:54:57.210996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:54:57.211805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:54:57.232345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:57.233159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:57.234116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:57.234711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:57.242308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-e28cb4ee-0f87-415c-8ef3-a8e5a9df2e2d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:54:57.254606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Getting quotas for project 1e9d41fd2f8d48d894ddb8ae0aa2799d. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:54:57.261049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Getting quotas for user 8bcf50b3de674240bb695a0d5614ffd9 and project 1e9d41fd2f8d48d894ddb8ae0aa2799d. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:54:57.274801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:54:57.277471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:54:57.334799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e28cb4ee-0f87-415c-8ef3-a8e5a9df2e2d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:57.342960 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4a0feedc-c4cc-4e59-9f5d-0d010c1f74b1 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.033211 Mar 05 20:54:57.343605 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 979/1878] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:54:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:54:57.355088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ae7bca8a-8c4a-485c-9783-d3a4499513d8 req-abdf79f4-9407-45c3-b241-8ab6941faa4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119d9fad-81c8-44d8-8d8c-48223035b62c", "tag": "6a006e06-d1ff-4cfe-a96d-1803354c4689"}, {"name": "network-changed", "server_uuid": "2724db06-c25e-4c20-8c10-9cbcece37005", "tag": "951324d7-3c13-4b4b-813d-7450955e6a0c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:57.356797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e28cb4ee-0f87-415c-8ef3-a8e5a9df2e2d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:57.357258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e28cb4ee-0f87-415c-8ef3-a8e5a9df2e2d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:57.367201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ae7bca8a-8c4a-485c-9783-d3a4499513d8 req-abdf79f4-9407-45c3-b241-8ab6941faa4e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:57.369302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ae7bca8a-8c4a-485c-9783-d3a4499513d8 req-abdf79f4-9407-45c3-b241-8ab6941faa4e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:57.402114 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ae7bca8a-8c4a-485c-9783-d3a4499513d8 req-abdf79f4-9407-45c3-b241-8ab6941faa4e service nova] Creating event network-changed:6a006e06-d1ff-4cfe-a96d-1803354c4689 for instance 119d9fad-81c8-44d8-8d8c-48223035b62c on nch2-master-1 Mar 05 20:54:57.403754 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ae7bca8a-8c4a-485c-9783-d3a4499513d8 req-abdf79f4-9407-45c3-b241-8ab6941faa4e service nova] Creating event network-changed:951324d7-3c13-4b4b-813d-7450955e6a0c for instance 2724db06-c25e-4c20-8c10-9cbcece37005 on nch2-master-1 Mar 05 20:54:57.411253 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ae7bca8a-8c4a-485c-9783-d3a4499513d8 req-abdf79f4-9407-45c3-b241-8ab6941faa4e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.065950 Mar 05 20:54:57.413550 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 980/1879] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:57.421248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cf95ef2a-5884-4c10-81c7-cb5ddd9f3b0c tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:57.422602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cf95ef2a-5884-4c10-81c7-cb5ddd9f3b0c tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:57.431101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf95ef2a-5884-4c10-81c7-cb5ddd9f3b0c tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:57.431797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf95ef2a-5884-4c10-81c7-cb5ddd9f3b0c tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:57.432771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf95ef2a-5884-4c10-81c7-cb5ddd9f3b0c tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:57.433371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf95ef2a-5884-4c10-81c7-cb5ddd9f3b0c tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:57.753272 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e28cb4ee-0f87-415c-8ef3-a8e5a9df2e2d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-396293390" status: 200 len: 1514 microversion: 2.1 time: 0.639436 Mar 05 20:54:57.754445 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 900/1880] 10.222.0.15 () {58 vars in 1260 bytes} [Sat Mar 5 20:54:57 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-396293390 => generated 1514 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:57.759580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-16acd8bd-b9d5-4f16-930d-593196576395 req-c7ebb6e0-3d21-4c68-b066-cd6ca0eb5863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facc63d8-2f5b-4b1f-858c-65e0ba787498", "name": "network-vif-unplugged", "status": "completed", "tag": "727e5026-bc21-477c-93fd-d0897928ef02"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:54:57.777417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-16acd8bd-b9d5-4f16-930d-593196576395 req-c7ebb6e0-3d21-4c68-b066-cd6ca0eb5863 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:57.780660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-16acd8bd-b9d5-4f16-930d-593196576395 req-c7ebb6e0-3d21-4c68-b066-cd6ca0eb5863 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:57.809920 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-16acd8bd-b9d5-4f16-930d-593196576395 req-c7ebb6e0-3d21-4c68-b066-cd6ca0eb5863 service nova] Creating event network-vif-unplugged:727e5026-bc21-477c-93fd-d0897928ef02 for instance facc63d8-2f5b-4b1f-858c-65e0ba787498 on nch1-master-1 Mar 05 20:54:57.823389 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-16acd8bd-b9d5-4f16-930d-593196576395 req-c7ebb6e0-3d21-4c68-b066-cd6ca0eb5863 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067441 Mar 05 20:54:57.826094 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 901/1881] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:54:57.840731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2bc04337-641e-48a2-9cb0-71ec520e6985 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:57.844447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2bc04337-641e-48a2-9cb0-71ec520e6985 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:57.881629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cf95ef2a-5884-4c10-81c7-cb5ddd9f3b0c tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:57.896335 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cf95ef2a-5884-4c10-81c7-cb5ddd9f3b0c tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1325 microversion: 2.1 time: 0.481070 Mar 05 20:54:57.901752 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 981/1882] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:57 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1325 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:57.906898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3aab3249-193b-43d9-ad24-7895d9e8227d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:57.919986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3aab3249-193b-43d9-ad24-7895d9e8227d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:57.935886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3aab3249-193b-43d9-ad24-7895d9e8227d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:57.936369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3aab3249-193b-43d9-ad24-7895d9e8227d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:57.937165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3aab3249-193b-43d9-ad24-7895d9e8227d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:57.938321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3aab3249-193b-43d9-ad24-7895d9e8227d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:58.049292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2bc04337-641e-48a2-9cb0-71ec520e6985 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:58.061412 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2bc04337-641e-48a2-9cb0-71ec520e6985 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 200 len: 1208 microversion: 2.1 time: 0.231307 Mar 05 20:54:58.064212 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 902/1883] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:57 2022] GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 1208 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:58.083497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e5adad2e-c6f1-4736-a186-128accd71c9a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:58.089764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e5adad2e-c6f1-4736-a186-128accd71c9a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:58.091167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e5adad2e-c6f1-4736-a186-128accd71c9a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:54:58.098610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5adad2e-c6f1-4736-a186-128accd71c9a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:58.099396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5adad2e-c6f1-4736-a186-128accd71c9a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:58.100370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5adad2e-c6f1-4736-a186-128accd71c9a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:58.101004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5adad2e-c6f1-4736-a186-128accd71c9a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:58.263494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-e5adad2e-c6f1-4736-a186-128accd71c9a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:54:58.374101 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e5adad2e-c6f1-4736-a186-128accd71c9a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:58.383528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5adad2e-c6f1-4736-a186-128accd71c9a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:58.384467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5adad2e-c6f1-4736-a186-128accd71c9a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:58.386891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3aab3249-193b-43d9-ad24-7895d9e8227d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:58.401930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3aab3249-193b-43d9-ad24-7895d9e8227d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:58.405770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3aab3249-193b-43d9-ad24-7895d9e8227d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:58.408070 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3aab3249-193b-43d9-ad24-7895d9e8227d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1646 microversion: 2.25 time: 0.504749 Mar 05 20:54:58.420868 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 982/1884] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:57 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1646 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:54:58.426967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fe6a4520-4ef1-422c-8e19-1ec65287597a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:58.427874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fe6a4520-4ef1-422c-8e19-1ec65287597a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:58.436985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe6a4520-4ef1-422c-8e19-1ec65287597a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:58.437961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe6a4520-4ef1-422c-8e19-1ec65287597a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:58.439009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe6a4520-4ef1-422c-8e19-1ec65287597a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:58.440289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe6a4520-4ef1-422c-8e19-1ec65287597a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:58.629559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fe6a4520-4ef1-422c-8e19-1ec65287597a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:58.642949 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fe6a4520-4ef1-422c-8e19-1ec65287597a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1534 microversion: 2.1 time: 0.220597 Mar 05 20:54:58.645165 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 983/1885] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:58 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1534 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:58.661513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-acdc6e73-ceaf-4a73-b873-f91cb7b7becd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:58.662798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-acdc6e73-ceaf-4a73-b873-f91cb7b7becd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:58.673348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acdc6e73-ceaf-4a73-b873-f91cb7b7becd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:58.674110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acdc6e73-ceaf-4a73-b873-f91cb7b7becd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:58.675247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acdc6e73-ceaf-4a73-b873-f91cb7b7becd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:58.675894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acdc6e73-ceaf-4a73-b873-f91cb7b7becd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:59.173254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-acdc6e73-ceaf-4a73-b873-f91cb7b7becd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:59.189116 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-acdc6e73-ceaf-4a73-b873-f91cb7b7becd tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1325 microversion: 2.1 time: 0.538557 Mar 05 20:54:59.199327 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 984/1886] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:58 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1325 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:59.204298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f7b09dd1-b034-4599-b65e-1f72ca9f1408 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:59.205035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f7b09dd1-b034-4599-b65e-1f72ca9f1408 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:59.223389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7b09dd1-b034-4599-b65e-1f72ca9f1408 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:59.223966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7b09dd1-b034-4599-b65e-1f72ca9f1408 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:59.224793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7b09dd1-b034-4599-b65e-1f72ca9f1408 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:59.227787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7b09dd1-b034-4599-b65e-1f72ca9f1408 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:59.543080 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e5adad2e-c6f1-4736-a186-128accd71c9a tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 1.464829 Mar 05 20:54:59.544699 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 903/1887] 10.222.0.15 () {58 vars in 1172 bytes} [Sat Mar 5 20:54:58 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:59.550904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-55d6b795-0bcf-4e69-9503-0b5cb45ab6c6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:59.551558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-55d6b795-0bcf-4e69-9503-0b5cb45ab6c6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:59.571775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-55d6b795-0bcf-4e69-9503-0b5cb45ab6c6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:59.572627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-55d6b795-0bcf-4e69-9503-0b5cb45ab6c6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:59.574646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-55d6b795-0bcf-4e69-9503-0b5cb45ab6c6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:59.575540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-55d6b795-0bcf-4e69-9503-0b5cb45ab6c6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:59.700914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f7b09dd1-b034-4599-b65e-1f72ca9f1408 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:59.727543 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f7b09dd1-b034-4599-b65e-1f72ca9f1408 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1325 microversion: 2.1 time: 0.535467 Mar 05 20:54:59.729339 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 985/1888] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:59 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1325 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:59.743923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cb27807e-9473-4fcb-808d-5b1d989ad1c6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:59.744944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cb27807e-9473-4fcb-808d-5b1d989ad1c6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:54:59.752916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb27807e-9473-4fcb-808d-5b1d989ad1c6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:59.753380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb27807e-9473-4fcb-808d-5b1d989ad1c6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:59.754955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb27807e-9473-4fcb-808d-5b1d989ad1c6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:54:59.756731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb27807e-9473-4fcb-808d-5b1d989ad1c6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:54:59.917096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-55d6b795-0bcf-4e69-9503-0b5cb45ab6c6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:59.931163 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-55d6b795-0bcf-4e69-9503-0b5cb45ab6c6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 200 len: 1266 microversion: 2.1 time: 0.384639 Mar 05 20:54:59.941794 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 904/1889] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:54:59 2022] GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 1266 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:54:59.972316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-05253644-b289-41d3-b79d-e82fefe8da4c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:54:59.984517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-05253644-b289-41d3-b79d-e82fefe8da4c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:54:59.990608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.compute.servers [None req-05253644-b289-41d3-b79d-e82fefe8da4c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Removing options 'limit' from query {{(pid=141478) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 05 20:54:59.991705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-05253644-b289-41d3-b79d-e82fefe8da4c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:00.007703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05253644-b289-41d3-b79d-e82fefe8da4c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:00.008298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05253644-b289-41d3-b79d-e82fefe8da4c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:00.009553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05253644-b289-41d3-b79d-e82fefe8da4c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:00.009999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05253644-b289-41d3-b79d-e82fefe8da4c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:00.076950 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cb27807e-9473-4fcb-808d-5b1d989ad1c6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:00.093629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cb27807e-9473-4fcb-808d-5b1d989ad1c6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:00.095613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cb27807e-9473-4fcb-808d-5b1d989ad1c6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:00.099305 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cb27807e-9473-4fcb-808d-5b1d989ad1c6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1636 microversion: 2.25 time: 0.367470 Mar 05 20:55:00.107822 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 986/1890] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:54:59 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1636 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:00.118878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-06eac629-a28a-4265-b1aa-712dc7283180 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:00.120903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-06eac629-a28a-4265-b1aa-712dc7283180 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:00.122732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-05253644-b289-41d3-b79d-e82fefe8da4c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:00.135637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06eac629-a28a-4265-b1aa-712dc7283180 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:00.136368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06eac629-a28a-4265-b1aa-712dc7283180 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:00.138075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06eac629-a28a-4265-b1aa-712dc7283180 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:00.138758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06eac629-a28a-4265-b1aa-712dc7283180 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:00.174979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05253644-b289-41d3-b79d-e82fefe8da4c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:00.175986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05253644-b289-41d3-b79d-e82fefe8da4c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:00.301909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-06eac629-a28a-4265-b1aa-712dc7283180 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:00.320687 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-06eac629-a28a-4265-b1aa-712dc7283180 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 200 len: 1492 microversion: 2.1 time: 0.206734 Mar 05 20:55:00.330023 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 987/1891] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:00 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 1492 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:00.373854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b2c08859-cebd-4245-844b-64c020166bbe tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '.version_select at 0x7fed61acfc10>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:00.382759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2c08859-cebd-4245-844b-64c020166bbe tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:00.385615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2c08859-cebd-4245-844b-64c020166bbe tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:00.443685 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b2c08859-cebd-4245-844b-64c020166bbe tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.109460 Mar 05 20:55:00.459494 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 988/1892] 10.222.0.15 () {60 vars in 1183 bytes} [Sat Mar 5 20:55:00 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:00.474784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-019ec36b-dcbf-4371-90ad-3dff241bd7e1 req-a00fe588-e746-48c1-821f-71c695d26cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4bc94-61de-4cb5-8c5a-4ba4dc781ada", "name": "network-vif-deleted", "tag": "a62edc1f-925c-416d-82a9-ced25df2b5e2"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:00.505670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-019ec36b-dcbf-4371-90ad-3dff241bd7e1 req-a00fe588-e746-48c1-821f-71c695d26cf5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:00.509383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-019ec36b-dcbf-4371-90ad-3dff241bd7e1 req-a00fe588-e746-48c1-821f-71c695d26cf5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:00.545337 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-019ec36b-dcbf-4371-90ad-3dff241bd7e1 req-a00fe588-e746-48c1-821f-71c695d26cf5 service nova] Creating event network-vif-deleted:a62edc1f-925c-416d-82a9-ced25df2b5e2 for instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada on nch1-master-1 Mar 05 20:55:00.561882 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-019ec36b-dcbf-4371-90ad-3dff241bd7e1 req-a00fe588-e746-48c1-821f-71c695d26cf5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097887 Mar 05 20:55:00.566772 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 989/1893] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:00.579894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0425f66e-c3a1-4534-9a59-3739907ed9af tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:00.580946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0425f66e-c3a1-4534-9a59-3739907ed9af tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:00.592170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0425f66e-c3a1-4534-9a59-3739907ed9af tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:00.592866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0425f66e-c3a1-4534-9a59-3739907ed9af tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:00.594096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0425f66e-c3a1-4534-9a59-3739907ed9af tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:00.594752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0425f66e-c3a1-4534-9a59-3739907ed9af tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:00.862027 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-05253644-b289-41d3-b79d-e82fefe8da4c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.921085 Mar 05 20:55:00.863581 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 905/1894] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 20:54:59 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:00.881633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c006ec1-6023-4a8c-bc11-4ab4a4e605f4 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:00.882587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4c006ec1-6023-4a8c-bc11-4ab4a4e605f4 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:00.895871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c006ec1-6023-4a8c-bc11-4ab4a4e605f4 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:00.897067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c006ec1-6023-4a8c-bc11-4ab4a4e605f4 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:00.898093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c006ec1-6023-4a8c-bc11-4ab4a4e605f4 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:00.899306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c006ec1-6023-4a8c-bc11-4ab4a4e605f4 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.216942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0425f66e-c3a1-4534-9a59-3739907ed9af tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:01.226027 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0425f66e-c3a1-4534-9a59-3739907ed9af tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1325 microversion: 2.1 time: 0.655727 Mar 05 20:55:01.229620 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 990/1895] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:00 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1325 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:01.245924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1e92ada1-9d10-426b-8094-24cd33528dbf tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:01.248422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1e92ada1-9d10-426b-8094-24cd33528dbf tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:01.258767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e92ada1-9d10-426b-8094-24cd33528dbf tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.259976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e92ada1-9d10-426b-8094-24cd33528dbf tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.261141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e92ada1-9d10-426b-8094-24cd33528dbf tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.261937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e92ada1-9d10-426b-8094-24cd33528dbf tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.316684 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-4c006ec1-6023-4a8c-bc11-4ab4a4e605f4 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid 019a8023-9015-41ae-974a-eb725177770d {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:55:01.333244 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4c006ec1-6023-4a8c-bc11-4ab4a4e605f4 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 2129 microversion: 2.25 time: 0.468196 Mar 05 20:55:01.334775 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 906/1896] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:00 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 2129 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:01.340628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e8576f8d-cb62-4379-9ede-47cf1376a053 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:01.344703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e8576f8d-cb62-4379-9ede-47cf1376a053 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:01.345686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e8576f8d-cb62-4379-9ede-47cf1376a053 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:01.353732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8576f8d-cb62-4379-9ede-47cf1376a053 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.355051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8576f8d-cb62-4379-9ede-47cf1376a053 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.356476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8576f8d-cb62-4379-9ede-47cf1376a053 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.357144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8576f8d-cb62-4379-9ede-47cf1376a053 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.459653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-e8576f8d-cb62-4379-9ede-47cf1376a053 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:01.523454 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e8576f8d-cb62-4379-9ede-47cf1376a053 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.187354 Mar 05 20:55:01.524949 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 907/1897] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:55:01 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:01.529974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-501fce16-c149-4b40-85c0-63161d58f259 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:01.532323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-501fce16-c149-4b40-85c0-63161d58f259 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:01.539864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-501fce16-c149-4b40-85c0-63161d58f259 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.540381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-501fce16-c149-4b40-85c0-63161d58f259 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.541411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-501fce16-c149-4b40-85c0-63161d58f259 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.541853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-501fce16-c149-4b40-85c0-63161d58f259 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.576963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1e92ada1-9d10-426b-8094-24cd33528dbf tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:01.587580 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1e92ada1-9d10-426b-8094-24cd33528dbf tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1325 microversion: 2.1 time: 0.347363 Mar 05 20:55:01.588247 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 991/1898] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:01 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1325 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:01.593357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-731ba73f-8c6d-4b92-b57a-5239a3b42a95 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:01.594779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-731ba73f-8c6d-4b92-b57a-5239a3b42a95 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:01.602182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-731ba73f-8c6d-4b92-b57a-5239a3b42a95 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.603430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-731ba73f-8c6d-4b92-b57a-5239a3b42a95 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.604268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-731ba73f-8c6d-4b92-b57a-5239a3b42a95 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.605477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-731ba73f-8c6d-4b92-b57a-5239a3b42a95 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.624194 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-731ba73f-8c6d-4b92-b57a-5239a3b42a95 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] HTTP exception thrown: Instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada could not be found. Mar 05 20:55:01.625700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-731ba73f-8c6d-4b92-b57a-5239a3b42a95 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Returning 404 to user: Instance 24a4bc94-61de-4cb5-8c5a-4ba4dc781ada could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:01.627142 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-731ba73f-8c6d-4b92-b57a-5239a3b42a95 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada" status: 404 len: 111 microversion: 2.1 time: 0.037588 Mar 05 20:55:01.628054 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 992/1899] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:01 2022] GET /compute/v2.1/servers/24a4bc94-61de-4cb5-8c5a-4ba4dc781ada => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:01.633925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-92438aa8-49a4-4e2d-ab99-d43dacaba413 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:01.634956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-92438aa8-49a4-4e2d-ab99-d43dacaba413 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:01.647930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92438aa8-49a4-4e2d-ab99-d43dacaba413 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.648419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92438aa8-49a4-4e2d-ab99-d43dacaba413 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.649732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92438aa8-49a4-4e2d-ab99-d43dacaba413 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.650421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92438aa8-49a4-4e2d-ab99-d43dacaba413 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.743427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-501fce16-c149-4b40-85c0-63161d58f259 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:01.752694 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-501fce16-c149-4b40-85c0-63161d58f259 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 200 len: 1308 microversion: 2.1 time: 0.226515 Mar 05 20:55:01.753506 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 908/1900] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:01 2022] GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:01.758345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2fec54af-8743-4052-a2b5-55e038d30416 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:01.762481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2fec54af-8743-4052-a2b5-55e038d30416 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:01.762681 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.compute.servers [None req-2fec54af-8743-4052-a2b5-55e038d30416 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Removing options 'limit' from query {{(pid=141478) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 05 20:55:01.763338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2fec54af-8743-4052-a2b5-55e038d30416 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:01.768755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2fec54af-8743-4052-a2b5-55e038d30416 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.769402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2fec54af-8743-4052-a2b5-55e038d30416 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.770428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2fec54af-8743-4052-a2b5-55e038d30416 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.771087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2fec54af-8743-4052-a2b5-55e038d30416 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.802800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-2fec54af-8743-4052-a2b5-55e038d30416 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:01.840196 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2fec54af-8743-4052-a2b5-55e038d30416 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.085269 Mar 05 20:55:01.841245 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 909/1901] 10.222.0.15 () {58 vars in 1149 bytes} [Sat Mar 5 20:55:01 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:01.846451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-58b4586b-0885-45c0-92b2-9d58f65a6844 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:01.846956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-58b4586b-0885-45c0-92b2-9d58f65a6844 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:01.863301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-58b4586b-0885-45c0-92b2-9d58f65a6844 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.863863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-58b4586b-0885-45c0-92b2-9d58f65a6844 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.864594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-58b4586b-0885-45c0-92b2-9d58f65a6844 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:01.865049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-58b4586b-0885-45c0-92b2-9d58f65a6844 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:01.904690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-58b4586b-0885-45c0-92b2-9d58f65a6844 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:55:02.000828 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-92438aa8-49a4-4e2d-ab99-d43dacaba413 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid 019a8023-9015-41ae-974a-eb725177770d {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:55:02.020180 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-58b4586b-0885-45c0-92b2-9d58f65a6844 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 204 len: 0 microversion: 2.1 time: 0.177064 Mar 05 20:55:02.020931 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 910/1902] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:55:01 2022] DELETE /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:55:02.023590 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-92438aa8-49a4-4e2d-ab99-d43dacaba413 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 2129 microversion: 2.25 time: 0.394146 Mar 05 20:55:02.025286 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 993/1903] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:01 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 2129 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:02.030654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f53a85db-1062-46ef-872e-982187ad11eb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:02.031375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f53a85db-1062-46ef-872e-982187ad11eb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:02.043461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b2003a8e-311c-4df7-a08e-40774de49799 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:02.048554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b2003a8e-311c-4df7-a08e-40774de49799 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:02.049615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b2003a8e-311c-4df7-a08e-40774de49799 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:02.054721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f53a85db-1062-46ef-872e-982187ad11eb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.055914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f53a85db-1062-46ef-872e-982187ad11eb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.056744 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2003a8e-311c-4df7-a08e-40774de49799 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.056869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f53a85db-1062-46ef-872e-982187ad11eb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.057464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f53a85db-1062-46ef-872e-982187ad11eb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.057944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2003a8e-311c-4df7-a08e-40774de49799 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.059460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2003a8e-311c-4df7-a08e-40774de49799 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.060155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2003a8e-311c-4df7-a08e-40774de49799 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.120049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-b2003a8e-311c-4df7-a08e-40774de49799 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:02.152415 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b2003a8e-311c-4df7-a08e-40774de49799 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.124557 Mar 05 20:55:02.153286 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 911/1904] 10.222.0.15 () {58 vars in 1124 bytes} [Sat Mar 5 20:55:02 2022] GET /compute/v2.1/servers => generated 1010 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:02.158393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-65eafae2-26db-40bc-8a3c-30f1091345c8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:02.159230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-65eafae2-26db-40bc-8a3c-30f1091345c8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:02.167928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65eafae2-26db-40bc-8a3c-30f1091345c8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.168363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65eafae2-26db-40bc-8a3c-30f1091345c8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.169391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65eafae2-26db-40bc-8a3c-30f1091345c8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.169839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65eafae2-26db-40bc-8a3c-30f1091345c8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.291937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-65eafae2-26db-40bc-8a3c-30f1091345c8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lazy-loading 'services' on Instance uuid 019a8023-9015-41ae-974a-eb725177770d {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:55:02.372378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f53a85db-1062-46ef-872e-982187ad11eb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:02.378882 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-65eafae2-26db-40bc-8a3c-30f1091345c8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d/os-volume_attachments/26c79aaa-d9c1-41fc-9e06-a62b6b10fcec" status: 202 len: 0 microversion: 2.25 time: 0.223223 Mar 05 20:55:02.379542 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 912/1905] 10.222.0.15 () {60 vars in 1456 bytes} [Sat Mar 5 20:55:02 2022] DELETE /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d/os-volume_attachments/26c79aaa-d9c1-41fc-9e06-a62b6b10fcec => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:55:02.388783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bdef24a0-9eaf-4cfc-8202-a230c4a6b419 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:02.392678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bdef24a0-9eaf-4cfc-8202-a230c4a6b419 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:02.393933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bdef24a0-9eaf-4cfc-8202-a230c4a6b419 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:02.406461 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f53a85db-1062-46ef-872e-982187ad11eb tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1469 microversion: 2.1 time: 0.379823 Mar 05 20:55:02.407776 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 994/1906] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:02 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1469 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:02.417583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bdef24a0-9eaf-4cfc-8202-a230c4a6b419 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.418477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bdef24a0-9eaf-4cfc-8202-a230c4a6b419 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.420312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bdef24a0-9eaf-4cfc-8202-a230c4a6b419 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.420720 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bc657210-4229-4287-bd3d-415c40b2d8ad tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:02.421347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bc657210-4229-4287-bd3d-415c40b2d8ad tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:02.421991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bdef24a0-9eaf-4cfc-8202-a230c4a6b419 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.440113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc657210-4229-4287-bd3d-415c40b2d8ad tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.440579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc657210-4229-4287-bd3d-415c40b2d8ad tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.441670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc657210-4229-4287-bd3d-415c40b2d8ad tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.442110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc657210-4229-4287-bd3d-415c40b2d8ad tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.553245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-bdef24a0-9eaf-4cfc-8202-a230c4a6b419 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:02.635844 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bdef24a0-9eaf-4cfc-8202-a230c4a6b419 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.253653 Mar 05 20:55:02.636957 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 913/1907] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:55:02 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:02.645409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5e80f831-40d9-4010-bbab-1a3b46dd0e4f req-1671d1d1-39a9-4652-b11d-7e2bc82be1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4505753-e31f-4b5b-8ee3-f37ab9176b36", "tag": "455cfb49-cef8-4f8d-8d0a-39162ccccb16"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:02.653105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5e80f831-40d9-4010-bbab-1a3b46dd0e4f req-1671d1d1-39a9-4652-b11d-7e2bc82be1ca service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.653933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5e80f831-40d9-4010-bbab-1a3b46dd0e4f req-1671d1d1-39a9-4652-b11d-7e2bc82be1ca service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.670361 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-5e80f831-40d9-4010-bbab-1a3b46dd0e4f req-1671d1d1-39a9-4652-b11d-7e2bc82be1ca service nova] Creating event network-changed:455cfb49-cef8-4f8d-8d0a-39162ccccb16 for instance a4505753-e31f-4b5b-8ee3-f37ab9176b36 on nch1-master-1 Mar 05 20:55:02.676573 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5e80f831-40d9-4010-bbab-1a3b46dd0e4f req-1671d1d1-39a9-4652-b11d-7e2bc82be1ca service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038497 Mar 05 20:55:02.677374 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 914/1908] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:02.686698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1438a304-b8a8-4d4f-bdc9-be09d2fa09d4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:02.688179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1438a304-b8a8-4d4f-bdc9-be09d2fa09d4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:02.697837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1438a304-b8a8-4d4f-bdc9-be09d2fa09d4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.698483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1438a304-b8a8-4d4f-bdc9-be09d2fa09d4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.699720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1438a304-b8a8-4d4f-bdc9-be09d2fa09d4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.700611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1438a304-b8a8-4d4f-bdc9-be09d2fa09d4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.745460 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1438a304-b8a8-4d4f-bdc9-be09d2fa09d4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.066552 Mar 05 20:55:02.750463 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 915/1909] 10.222.0.15 () {60 vars in 1342 bytes} [Sat Mar 5 20:55:02 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:55:02.754087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d99145ca-8e07-4352-983e-857c90a83e87 req-d5203063-c077-43ef-9145-0955e57a37d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facc63d8-2f5b-4b1f-858c-65e0ba787498", "name": "network-vif-deleted", "tag": "727e5026-bc21-477c-93fd-d0897928ef02"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:02.763529 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d99145ca-8e07-4352-983e-857c90a83e87 req-d5203063-c077-43ef-9145-0955e57a37d0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.764079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d99145ca-8e07-4352-983e-857c90a83e87 req-d5203063-c077-43ef-9145-0955e57a37d0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.780424 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d99145ca-8e07-4352-983e-857c90a83e87 req-d5203063-c077-43ef-9145-0955e57a37d0 service nova] Creating event network-vif-deleted:727e5026-bc21-477c-93fd-d0897928ef02 for instance facc63d8-2f5b-4b1f-858c-65e0ba787498 on nch1-master-1 Mar 05 20:55:02.786872 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d99145ca-8e07-4352-983e-857c90a83e87 req-d5203063-c077-43ef-9145-0955e57a37d0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038970 Mar 05 20:55:02.788314 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 916/1910] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:02.794318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1d5dbd70-3d07-4875-a887-a8c956886777 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:02.795211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1d5dbd70-3d07-4875-a887-a8c956886777 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:02.803370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d5dbd70-3d07-4875-a887-a8c956886777 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.804114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d5dbd70-3d07-4875-a887-a8c956886777 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.805150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d5dbd70-3d07-4875-a887-a8c956886777 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:02.805994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d5dbd70-3d07-4875-a887-a8c956886777 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:02.997664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bc657210-4229-4287-bd3d-415c40b2d8ad tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:03.006578 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bc657210-4229-4287-bd3d-415c40b2d8ad tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1325 microversion: 2.1 time: 0.597060 Mar 05 20:55:03.017244 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 995/1911] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:02 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1325 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:03.017697 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1d5dbd70-3d07-4875-a887-a8c956886777 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:03.026988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-efb49381-d78d-41a1-8c35-148c8e9fe9ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:03.031221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-efb49381-d78d-41a1-8c35-148c8e9fe9ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:03.032948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.compute.servers [None req-efb49381-d78d-41a1-8c35-148c8e9fe9ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Removing options 'limit' from query {{(pid=141479) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 05 20:55:03.033740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-efb49381-d78d-41a1-8c35-148c8e9fe9ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:03.041946 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1d5dbd70-3d07-4875-a887-a8c956886777 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1325 microversion: 2.1 time: 0.252016 Mar 05 20:55:03.042706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efb49381-d78d-41a1-8c35-148c8e9fe9ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.043173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efb49381-d78d-41a1-8c35-148c8e9fe9ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.044028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efb49381-d78d-41a1-8c35-148c8e9fe9ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.044478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efb49381-d78d-41a1-8c35-148c8e9fe9ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.054051 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 917/1912] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:02 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:03.064297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-53d5d990-1ab9-49cc-ba51-be76617cdeb3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:03.065904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-53d5d990-1ab9-49cc-ba51-be76617cdeb3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:03.076954 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-efb49381-d78d-41a1-8c35-148c8e9fe9ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.067437 Mar 05 20:55:03.077915 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 996/1913] 10.222.0.15 () {58 vars in 1139 bytes} [Sat Mar 5 20:55:03 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:03.079456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53d5d990-1ab9-49cc-ba51-be76617cdeb3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.081240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53d5d990-1ab9-49cc-ba51-be76617cdeb3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.083648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53d5d990-1ab9-49cc-ba51-be76617cdeb3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.085276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53d5d990-1ab9-49cc-ba51-be76617cdeb3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.090962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5a839d28-6586-4ca8-bda9-093c4099a278 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:03.095815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5a839d28-6586-4ca8-bda9-093c4099a278 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:03.096674 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5a839d28-6586-4ca8-bda9-093c4099a278 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-396293390', 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:03.105082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a839d28-6586-4ca8-bda9-093c4099a278 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.106255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a839d28-6586-4ca8-bda9-093c4099a278 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.107369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a839d28-6586-4ca8-bda9-093c4099a278 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.107898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a839d28-6586-4ca8-bda9-093c4099a278 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.225980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-5a839d28-6586-4ca8-bda9-093c4099a278 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:03.317033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-53d5d990-1ab9-49cc-ba51-be76617cdeb3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:03.331218 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-53d5d990-1ab9-49cc-ba51-be76617cdeb3 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 200 len: 1308 microversion: 2.1 time: 0.275733 Mar 05 20:55:03.332537 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5a839d28-6586-4ca8-bda9-093c4099a278 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-396293390" status: 200 len: 345 microversion: 2.1 time: 0.246297 Mar 05 20:55:03.333783 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 997/1914] 10.222.0.15 () {58 vars in 1239 bytes} [Sat Mar 5 20:55:03 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-396293390 => generated 345 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:03.334643 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 918/1915] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:03 2022] GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 1308 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:03.354110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ab0a7640-5d9a-47dd-99d4-a7619936fb3e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:03.362920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab0a7640-5d9a-47dd-99d4-a7619936fb3e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.364249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab0a7640-5d9a-47dd-99d4-a7619936fb3e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.395921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ab0a7640-5d9a-47dd-99d4-a7619936fb3e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Going to try to stop instance {{(pid=141479) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 05 20:55:03.431840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2f02aa87-4df5-4205-8768-cf23e74f66bc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:03.432756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2f02aa87-4df5-4205-8768-cf23e74f66bc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:03.449493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f02aa87-4df5-4205-8768-cf23e74f66bc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.451639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f02aa87-4df5-4205-8768-cf23e74f66bc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.454796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f02aa87-4df5-4205-8768-cf23e74f66bc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.455294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f02aa87-4df5-4205-8768-cf23e74f66bc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.509685 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ab0a7640-5d9a-47dd-99d4-a7619936fb3e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "POST /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341/action" status: 202 len: 0 microversion: 2.1 time: 0.165437 Mar 05 20:55:03.516796 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 998/1916] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:55:03 2022] POST /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:55:03.527709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d78c8478-f0cd-46de-a01c-3f77f76eab23 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:03.529311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d78c8478-f0cd-46de-a01c-3f77f76eab23 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:03.539973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d78c8478-f0cd-46de-a01c-3f77f76eab23 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.540688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d78c8478-f0cd-46de-a01c-3f77f76eab23 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.541663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d78c8478-f0cd-46de-a01c-3f77f76eab23 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.543709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d78c8478-f0cd-46de-a01c-3f77f76eab23 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.812568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2f02aa87-4df5-4205-8768-cf23e74f66bc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:03.822705 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2f02aa87-4df5-4205-8768-cf23e74f66bc tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1469 microversion: 2.1 time: 0.398814 Mar 05 20:55:03.826737 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 919/1917] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:03 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1469 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:03.840589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d2951d24-505b-4108-b339-a61f1c6fb688 req-934453fb-862a-4eca-a706-72bd4c3ad6ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119d9fad-81c8-44d8-8d8c-48223035b62c", "name": "network-vif-plugged", "status": "completed", "tag": "6a006e06-d1ff-4cfe-a96d-1803354c4689"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:03.858240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d2951d24-505b-4108-b339-a61f1c6fb688 req-934453fb-862a-4eca-a706-72bd4c3ad6ce service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.860503 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d2951d24-505b-4108-b339-a61f1c6fb688 req-934453fb-862a-4eca-a706-72bd4c3ad6ce service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.886336 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d2951d24-505b-4108-b339-a61f1c6fb688 req-934453fb-862a-4eca-a706-72bd4c3ad6ce service nova] Creating event network-vif-plugged:6a006e06-d1ff-4cfe-a96d-1803354c4689 for instance 119d9fad-81c8-44d8-8d8c-48223035b62c on nch2-master-1 Mar 05 20:55:03.913788 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d2951d24-505b-4108-b339-a61f1c6fb688 req-934453fb-862a-4eca-a706-72bd4c3ad6ce service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085682 Mar 05 20:55:03.916378 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 920/1918] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:03.925469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d1c2aa5e-49e2-418d-8057-7de4319dd449 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:03.927043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d1c2aa5e-49e2-418d-8057-7de4319dd449 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:03.935661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1c2aa5e-49e2-418d-8057-7de4319dd449 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.936552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1c2aa5e-49e2-418d-8057-7de4319dd449 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.937557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1c2aa5e-49e2-418d-8057-7de4319dd449 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:03.938396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1c2aa5e-49e2-418d-8057-7de4319dd449 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:03.963931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d78c8478-f0cd-46de-a01c-3f77f76eab23 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:03.989893 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d78c8478-f0cd-46de-a01c-3f77f76eab23 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.469051 Mar 05 20:55:03.991230 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 999/1919] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:03 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:04.026856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cdf39f21-2600-475d-85ee-ea8d47edaeb7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:04.027366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cdf39f21-2600-475d-85ee-ea8d47edaeb7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:04.035539 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d1c2aa5e-49e2-418d-8057-7de4319dd449 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.115584 Mar 05 20:55:04.053924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdf39f21-2600-475d-85ee-ea8d47edaeb7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:04.055829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdf39f21-2600-475d-85ee-ea8d47edaeb7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:04.056015 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 921/1920] 10.222.0.15 () {60 vars in 1342 bytes} [Sat Mar 5 20:55:03 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:04.058109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdf39f21-2600-475d-85ee-ea8d47edaeb7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:04.058762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdf39f21-2600-475d-85ee-ea8d47edaeb7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:04.067978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-280de251-79c4-4f0d-b2f4-f2eccfb1f4fe tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:04.069190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-280de251-79c4-4f0d-b2f4-f2eccfb1f4fe tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:04.100719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-280de251-79c4-4f0d-b2f4-f2eccfb1f4fe tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:04.109265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-280de251-79c4-4f0d-b2f4-f2eccfb1f4fe tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:04.111872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-280de251-79c4-4f0d-b2f4-f2eccfb1f4fe tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:04.113989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-280de251-79c4-4f0d-b2f4-f2eccfb1f4fe tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:04.360824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cdf39f21-2600-475d-85ee-ea8d47edaeb7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:04.370099 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cdf39f21-2600-475d-85ee-ea8d47edaeb7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1325 microversion: 2.1 time: 0.348763 Mar 05 20:55:04.371372 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1000/1921] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:04 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1325 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:04.377085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3e092aeb-5d3e-4c9a-80e4-b2485ed945d9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:04.377977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3e092aeb-5d3e-4c9a-80e4-b2485ed945d9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:04.385295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e092aeb-5d3e-4c9a-80e4-b2485ed945d9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:04.385994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e092aeb-5d3e-4c9a-80e4-b2485ed945d9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:04.387128 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e092aeb-5d3e-4c9a-80e4-b2485ed945d9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:04.387805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e092aeb-5d3e-4c9a-80e4-b2485ed945d9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:04.435824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-280de251-79c4-4f0d-b2f4-f2eccfb1f4fe tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:04.444231 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-280de251-79c4-4f0d-b2f4-f2eccfb1f4fe tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1325 microversion: 2.1 time: 0.386929 Mar 05 20:55:04.444817 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 922/1922] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:04 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1325 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:04.651301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3e092aeb-5d3e-4c9a-80e4-b2485ed945d9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:04.661865 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3e092aeb-5d3e-4c9a-80e4-b2485ed945d9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 200 len: 1308 microversion: 2.1 time: 0.289196 Mar 05 20:55:04.663067 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1001/1923] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:04 2022] GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 1308 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:04.806737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-73e183d0-294c-4327-ab18-3aa57fbdcb8b req-7ac70f25-de76-4624-8a6c-3c933dfc4598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b0401ca-066c-40a5-b076-b4fd5b6ab3d2", "name": "network-vif-deleted", "tag": "5c0add0b-e16b-4f33-bad0-f6bb5dbab8ca"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:04.822626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-73e183d0-294c-4327-ab18-3aa57fbdcb8b req-7ac70f25-de76-4624-8a6c-3c933dfc4598 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:04.822779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-73e183d0-294c-4327-ab18-3aa57fbdcb8b req-7ac70f25-de76-4624-8a6c-3c933dfc4598 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:04.844515 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-73e183d0-294c-4327-ab18-3aa57fbdcb8b req-7ac70f25-de76-4624-8a6c-3c933dfc4598 service nova] Creating event network-vif-deleted:5c0add0b-e16b-4f33-bad0-f6bb5dbab8ca for instance 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 on nch2-master-1 Mar 05 20:55:04.845259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-20c929d1-eb37-486b-be26-08b587837a60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:04.846002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-20c929d1-eb37-486b-be26-08b587837a60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:04.853803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20c929d1-eb37-486b-be26-08b587837a60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:04.854367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20c929d1-eb37-486b-be26-08b587837a60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:04.855244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20c929d1-eb37-486b-be26-08b587837a60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:04.855789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20c929d1-eb37-486b-be26-08b587837a60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:04.864166 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-73e183d0-294c-4327-ab18-3aa57fbdcb8b req-7ac70f25-de76-4624-8a6c-3c933dfc4598 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060853 Mar 05 20:55:04.866628 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 923/1924] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:55:04.900384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20c929d1-eb37-486b-be26-08b587837a60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:04.907566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20c929d1-eb37-486b-be26-08b587837a60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:04.908443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-20c929d1-eb37-486b-be26-08b587837a60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lazy-loading 'fault' on Instance uuid 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:55:04.966891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-20c929d1-eb37-486b-be26-08b587837a60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:04.976063 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-20c929d1-eb37-486b-be26-08b587837a60 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 200 len: 1303 microversion: 2.1 time: 0.136886 Mar 05 20:55:04.977839 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1002/1925] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:04 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:05.009250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-005d8fbc-3e27-4bb4-bf7d-9ee0a8ffae0c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:05.010375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-005d8fbc-3e27-4bb4-bf7d-9ee0a8ffae0c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:05.019937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-005d8fbc-3e27-4bb4-bf7d-9ee0a8ffae0c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:05.020422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-005d8fbc-3e27-4bb4-bf7d-9ee0a8ffae0c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:05.021217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-005d8fbc-3e27-4bb4-bf7d-9ee0a8ffae0c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:05.021756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-005d8fbc-3e27-4bb4-bf7d-9ee0a8ffae0c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:05.270077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-005d8fbc-3e27-4bb4-bf7d-9ee0a8ffae0c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:05.282203 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-005d8fbc-3e27-4bb4-bf7d-9ee0a8ffae0c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.278125 Mar 05 20:55:05.283992 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 924/1926] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:05 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:05.393599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0df9a48-1e83-4527-970c-b79b0400934a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:05.394262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e0df9a48-1e83-4527-970c-b79b0400934a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:05.405818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0df9a48-1e83-4527-970c-b79b0400934a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:05.407398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0df9a48-1e83-4527-970c-b79b0400934a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:05.409535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0df9a48-1e83-4527-970c-b79b0400934a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:05.410185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0df9a48-1e83-4527-970c-b79b0400934a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:05.463582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e0449c55-a52d-4d39-ac6e-3a8b8460c759 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:05.464799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e0449c55-a52d-4d39-ac6e-3a8b8460c759 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:05.472205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e0449c55-a52d-4d39-ac6e-3a8b8460c759 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:05.472720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e0449c55-a52d-4d39-ac6e-3a8b8460c759 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:05.473505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e0449c55-a52d-4d39-ac6e-3a8b8460c759 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:05.474158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e0449c55-a52d-4d39-ac6e-3a8b8460c759 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:05.648049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e0df9a48-1e83-4527-970c-b79b0400934a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:05.660090 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0df9a48-1e83-4527-970c-b79b0400934a tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1325 microversion: 2.1 time: 0.270570 Mar 05 20:55:05.661015 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1003/1927] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:05 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1325 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:05.690288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e3712cf7-6c8d-4a2e-8df2-5ad8511fed85 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:05.692557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e3712cf7-6c8d-4a2e-8df2-5ad8511fed85 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:05.704290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e0449c55-a52d-4d39-ac6e-3a8b8460c759 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:05.705133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3712cf7-6c8d-4a2e-8df2-5ad8511fed85 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:05.705780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3712cf7-6c8d-4a2e-8df2-5ad8511fed85 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:05.706645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3712cf7-6c8d-4a2e-8df2-5ad8511fed85 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:05.708323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3712cf7-6c8d-4a2e-8df2-5ad8511fed85 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:05.728761 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e0449c55-a52d-4d39-ac6e-3a8b8460c759 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1325 microversion: 2.1 time: 0.268052 Mar 05 20:55:05.738156 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 925/1928] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:05 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1325 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:55:05.890694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e3712cf7-6c8d-4a2e-8df2-5ad8511fed85 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:05.927743 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e3712cf7-6c8d-4a2e-8df2-5ad8511fed85 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 200 len: 1308 microversion: 2.1 time: 0.244306 Mar 05 20:55:05.928206 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1004/1929] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:05 2022] GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:06.001047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-64ba5469-b1fb-4567-9ef4-4ff2b4cc791d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:06.002422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-64ba5469-b1fb-4567-9ef4-4ff2b4cc791d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:06.020804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ec0f0a6a-3455-4e66-8054-8ddfff99ea0a req-74a10070-b198-4533-b19c-3f933d27572c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2724db06-c25e-4c20-8c10-9cbcece37005", "name": "network-vif-plugged", "status": "completed", "tag": "951324d7-3c13-4b4b-813d-7450955e6a0c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:06.026367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64ba5469-b1fb-4567-9ef4-4ff2b4cc791d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.027786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64ba5469-b1fb-4567-9ef4-4ff2b4cc791d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.029289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64ba5469-b1fb-4567-9ef4-4ff2b4cc791d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.030329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64ba5469-b1fb-4567-9ef4-4ff2b4cc791d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.044671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ec0f0a6a-3455-4e66-8054-8ddfff99ea0a req-74a10070-b198-4533-b19c-3f933d27572c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.045165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ec0f0a6a-3455-4e66-8054-8ddfff99ea0a req-74a10070-b198-4533-b19c-3f933d27572c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.055762 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-64ba5469-b1fb-4567-9ef4-4ff2b4cc791d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] HTTP exception thrown: Instance 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 could not be found. Mar 05 20:55:06.056940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-64ba5469-b1fb-4567-9ef4-4ff2b4cc791d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Returning 404 to user: Instance 0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:06.057949 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-64ba5469-b1fb-4567-9ef4-4ff2b4cc791d tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2" status: 404 len: 111 microversion: 2.1 time: 0.067157 Mar 05 20:55:06.059089 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 926/1930] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:05 2022] GET /compute/v2.1/servers/0b0401ca-066c-40a5-b076-b4fd5b6ab3d2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:06.066920 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ec0f0a6a-3455-4e66-8054-8ddfff99ea0a req-74a10070-b198-4533-b19c-3f933d27572c service nova] Creating event network-vif-plugged:951324d7-3c13-4b4b-813d-7450955e6a0c for instance 2724db06-c25e-4c20-8c10-9cbcece37005 on nch2-master-1 Mar 05 20:55:06.075993 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ec0f0a6a-3455-4e66-8054-8ddfff99ea0a req-74a10070-b198-4533-b19c-3f933d27572c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065532 Mar 05 20:55:06.077121 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1005/1931] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:55:06.085103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-befce70c-64e3-443e-9074-e6e65f2066c2 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:06.085470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-befce70c-64e3-443e-9074-e6e65f2066c2 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:06.095989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-befce70c-64e3-443e-9074-e6e65f2066c2 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.096825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-befce70c-64e3-443e-9074-e6e65f2066c2 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.098137 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-befce70c-64e3-443e-9074-e6e65f2066c2 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.098897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-befce70c-64e3-443e-9074-e6e65f2066c2 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.137349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-befce70c-64e3-443e-9074-e6e65f2066c2 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:55:06.249285 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-befce70c-64e3-443e-9074-e6e65f2066c2 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 204 len: 0 microversion: 2.1 time: 0.179944 Mar 05 20:55:06.252896 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 927/1932] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:55:06 2022] DELETE /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:55:06.260116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-57567f13-425e-4a4c-b86f-4078e73fce73 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:06.261427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-57567f13-425e-4a4c-b86f-4078e73fce73 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:06.273556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57567f13-425e-4a4c-b86f-4078e73fce73 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.276163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57567f13-425e-4a4c-b86f-4078e73fce73 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.277489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57567f13-425e-4a4c-b86f-4078e73fce73 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.278469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57567f13-425e-4a4c-b86f-4078e73fce73 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.301115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1a09cc73-0758-4162-a212-0cb90fcecc89 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:06.301894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1a09cc73-0758-4162-a212-0cb90fcecc89 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:06.308222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a09cc73-0758-4162-a212-0cb90fcecc89 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.309035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a09cc73-0758-4162-a212-0cb90fcecc89 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.309878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a09cc73-0758-4162-a212-0cb90fcecc89 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.310268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a09cc73-0758-4162-a212-0cb90fcecc89 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.459883 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-57567f13-425e-4a4c-b86f-4078e73fce73 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:06.468757 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-57567f13-425e-4a4c-b86f-4078e73fce73 tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1466 microversion: 2.1 time: 0.214013 Mar 05 20:55:06.469572 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1006/1933] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:06 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1466 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:06.474544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1a09cc73-0758-4162-a212-0cb90fcecc89 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:06.483095 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1a09cc73-0758-4162-a212-0cb90fcecc89 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.186255 Mar 05 20:55:06.483767 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 928/1934] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:06 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:55:06.690324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d2c2c1a-db45-4eaa-b6a9-5620d23eec06 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:06.691230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7d2c2c1a-db45-4eaa-b6a9-5620d23eec06 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:06.723029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d2c2c1a-db45-4eaa-b6a9-5620d23eec06 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.725497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d2c2c1a-db45-4eaa-b6a9-5620d23eec06 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.726604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d2c2c1a-db45-4eaa-b6a9-5620d23eec06 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.727565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d2c2c1a-db45-4eaa-b6a9-5620d23eec06 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.753370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3467ed96-584c-495e-a935-1d031e9c073d tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:06.754286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3467ed96-584c-495e-a935-1d031e9c073d tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:06.762909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3467ed96-584c-495e-a935-1d031e9c073d tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.763364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3467ed96-584c-495e-a935-1d031e9c073d tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.764359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3467ed96-584c-495e-a935-1d031e9c073d tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.764874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3467ed96-584c-495e-a935-1d031e9c073d tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.928715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3467ed96-584c-495e-a935-1d031e9c073d tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:06.937425 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3467ed96-584c-495e-a935-1d031e9c073d tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1522 microversion: 2.1 time: 0.192335 Mar 05 20:55:06.938512 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 929/1935] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:06 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:06.946622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d2c2c1a-db45-4eaa-b6a9-5620d23eec06 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:06.948055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b76225a2-3105-4c89-8c64-487c212b0c18 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:06.948860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b76225a2-3105-4c89-8c64-487c212b0c18 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:06.955149 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7d2c2c1a-db45-4eaa-b6a9-5620d23eec06 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1325 microversion: 2.1 time: 0.270409 Mar 05 20:55:06.956063 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1007/1936] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:06 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1325 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:06.957443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b76225a2-3105-4c89-8c64-487c212b0c18 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.958178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b76225a2-3105-4c89-8c64-487c212b0c18 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.959222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b76225a2-3105-4c89-8c64-487c212b0c18 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.960102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b76225a2-3105-4c89-8c64-487c212b0c18 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.963826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eb330b74-cd47-4343-9760-dc801ddec823 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:06.963826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eb330b74-cd47-4343-9760-dc801ddec823 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:06.988431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb330b74-cd47-4343-9760-dc801ddec823 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.988549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb330b74-cd47-4343-9760-dc801ddec823 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:06.989463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb330b74-cd47-4343-9760-dc801ddec823 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:06.989906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb330b74-cd47-4343-9760-dc801ddec823 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:07.025051 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-eb330b74-cd47-4343-9760-dc801ddec823 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] HTTP exception thrown: Instance is not a member of specified network Mar 05 20:55:07.026098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eb330b74-cd47-4343-9760-dc801ddec823 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Returning 404 to user: Instance is not a member of specified network {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:07.028242 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eb330b74-cd47-4343-9760-dc801ddec823 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.070120 Mar 05 20:55:07.029460 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1008/1937] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:55:06 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c/ips/invalid => generated 91 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:55:07.038600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eec6dca8-0ed8-47a5-b9d7-ea428c89dc1d tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:07.039491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eec6dca8-0ed8-47a5-b9d7-ea428c89dc1d tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Failed to fetch instance by id 999 {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 05 20:55:07.040259 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-eec6dca8-0ed8-47a5-b9d7-ea428c89dc1d tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] HTTP exception thrown: Instance 999 could not be found. Mar 05 20:55:07.041075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eec6dca8-0ed8-47a5-b9d7-ea428c89dc1d tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Returning 404 to user: Instance 999 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:07.042439 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eec6dca8-0ed8-47a5-b9d7-ea428c89dc1d tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.007931 Mar 05 20:55:07.047346 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1009/1938] 10.222.0.15 () {58 vars in 1148 bytes} [Sat Mar 5 20:55:07 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:55:07.052791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1617643620", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d83df0c3-2a5b-4fbb-9f93-42653588000e"}], "block_device_mapping_v2": [{"uuid": "7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:07.129102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] validate_networks() for [('d83df0c3-2a5b-4fbb-9f93-42653588000e', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:55:07.180543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b76225a2-3105-4c89-8c64-487c212b0c18 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:07.192203 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b76225a2-3105-4c89-8c64-487c212b0c18 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 200 len: 1308 microversion: 2.1 time: 0.249740 Mar 05 20:55:07.194507 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 930/1939] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:06 2022] GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:55:07.201174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c2c9f11a-03e1-486e-a8fb-91c7929cf5c6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:07.201942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c2c9f11a-03e1-486e-a8fb-91c7929cf5c6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:07.209228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2c9f11a-03e1-486e-a8fb-91c7929cf5c6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:07.209759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2c9f11a-03e1-486e-a8fb-91c7929cf5c6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:07.210786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2c9f11a-03e1-486e-a8fb-91c7929cf5c6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:07.211297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2c9f11a-03e1-486e-a8fb-91c7929cf5c6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:07.240068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c2c9f11a-03e1-486e-a8fb-91c7929cf5c6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:55:07.341044 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c2c9f11a-03e1-486e-a8fb-91c7929cf5c6 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "DELETE /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 204 len: 0 microversion: 2.1 time: 0.145107 Mar 05 20:55:07.341818 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 931/1940] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:55:07 2022] DELETE /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:55:07.350892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c2ed36b1-5c7c-4c5c-8168-700f493606f3 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:07.352528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c2ed36b1-5c7c-4c5c-8168-700f493606f3 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:07.359825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2ed36b1-5c7c-4c5c-8168-700f493606f3 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:07.360320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2ed36b1-5c7c-4c5c-8168-700f493606f3 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:07.361410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2ed36b1-5c7c-4c5c-8168-700f493606f3 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:07.362003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2ed36b1-5c7c-4c5c-8168-700f493606f3 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:07.577401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c2ed36b1-5c7c-4c5c-8168-700f493606f3 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:07.585384 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c2ed36b1-5c7c-4c5c-8168-700f493606f3 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1528 microversion: 2.1 time: 0.238967 Mar 05 20:55:07.587098 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 932/1941] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:07 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1528 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:55:07.592214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7e03653d-3e59-465f-9b29-ed151d37085a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:07.592386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:55:07.592755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:55:07.593242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:55:07.593464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7e03653d-3e59-465f-9b29-ed151d37085a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:07.593661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:55:07.594089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:55:07.600541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e03653d-3e59-465f-9b29-ed151d37085a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:07.601007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e03653d-3e59-465f-9b29-ed151d37085a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:07.602574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e03653d-3e59-465f-9b29-ed151d37085a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:07.603287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e03653d-3e59-465f-9b29-ed151d37085a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:07.606199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:07.606660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:07.608033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:07.611527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:07.630802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Getting quotas for project aa37ca4c9ac445f4ab3ab68f30b46d44. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:55:07.637390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Getting quotas for user 33c2e3f240e04849be211c91e18234dd and project aa37ca4c9ac445f4ab3ab68f30b46d44. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:55:07.707966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:55:07.712096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7be5b7fd-f6fb-4a07-9d9d-7f8c8b01fe2e',volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:55:07.781649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7e03653d-3e59-465f-9b29-ed151d37085a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:07.790675 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7e03653d-3e59-465f-9b29-ed151d37085a tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1466 microversion: 2.1 time: 0.202157 Mar 05 20:55:07.791264 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 933/1942] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:07 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1466 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:07.805614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0bf17e48-f0a3-4630-8b77-69e50442a226 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:07.806407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0bf17e48-f0a3-4630-8b77-69e50442a226 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:07.813164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0bf17e48-f0a3-4630-8b77-69e50442a226 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:07.813534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0bf17e48-f0a3-4630-8b77-69e50442a226 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:07.814603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0bf17e48-f0a3-4630-8b77-69e50442a226 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:07.815101 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0bf17e48-f0a3-4630-8b77-69e50442a226 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:07.887089 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-083b1ef9-001f-4416-8696-9eefd8d7bf2a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.838365 Mar 05 20:55:07.889005 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1010/1943] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 20:55:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 05 20:55:07.912871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a66e5706-ac25-46a9-8c50-8ce990751633 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:07.914106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a66e5706-ac25-46a9-8c50-8ce990751633 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:07.973546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a66e5706-ac25-46a9-8c50-8ce990751633 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:07.987371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a66e5706-ac25-46a9-8c50-8ce990751633 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:07.989331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a66e5706-ac25-46a9-8c50-8ce990751633 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:07.991333 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a66e5706-ac25-46a9-8c50-8ce990751633 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1104 microversion: 2.25 time: 0.096767 Mar 05 20:55:07.992027 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1011/1944] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:07 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1104 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:07.998551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-83ddd837-79a8-44fe-922c-d55d09da0ee5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:07.999383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-83ddd837-79a8-44fe-922c-d55d09da0ee5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:08.003767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0bf17e48-f0a3-4630-8b77-69e50442a226 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:08.015599 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0bf17e48-f0a3-4630-8b77-69e50442a226 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.213729 Mar 05 20:55:08.016219 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 934/1945] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:07 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:08.022938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83ddd837-79a8-44fe-922c-d55d09da0ee5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:08.023463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83ddd837-79a8-44fe-922c-d55d09da0ee5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:08.025926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83ddd837-79a8-44fe-922c-d55d09da0ee5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:08.027243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83ddd837-79a8-44fe-922c-d55d09da0ee5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:08.192236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-83ddd837-79a8-44fe-922c-d55d09da0ee5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:08.210940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-de0d7479-3d8d-42d2-b6f3-2a61b36273f2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:08.213416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-de0d7479-3d8d-42d2-b6f3-2a61b36273f2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:08.222462 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-83ddd837-79a8-44fe-922c-d55d09da0ee5 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1521 microversion: 2.1 time: 0.221103 Mar 05 20:55:08.223359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-de0d7479-3d8d-42d2-b6f3-2a61b36273f2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:08.223546 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1012/1946] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:07 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:08.224230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-de0d7479-3d8d-42d2-b6f3-2a61b36273f2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:08.228458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-de0d7479-3d8d-42d2-b6f3-2a61b36273f2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:08.229922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-de0d7479-3d8d-42d2-b6f3-2a61b36273f2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:08.246201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-94c628c5-cf1a-418c-aa29-c7d930f5650f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:08.246628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-94c628c5-cf1a-418c-aa29-c7d930f5650f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:08.258619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94c628c5-cf1a-418c-aa29-c7d930f5650f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:08.259953 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94c628c5-cf1a-418c-aa29-c7d930f5650f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:08.261040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94c628c5-cf1a-418c-aa29-c7d930f5650f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:08.264414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94c628c5-cf1a-418c-aa29-c7d930f5650f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:08.303239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-94c628c5-cf1a-418c-aa29-c7d930f5650f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:55:08.404311 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-94c628c5-cf1a-418c-aa29-c7d930f5650f tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 204 len: 0 microversion: 2.1 time: 0.162246 Mar 05 20:55:08.406086 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1013/1947] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:55:08 2022] DELETE /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:55:08.420900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-405f8612-d191-4917-bced-bfb760643413 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:08.421781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-405f8612-d191-4917-bced-bfb760643413 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:08.429267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-405f8612-d191-4917-bced-bfb760643413 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:08.429817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-405f8612-d191-4917-bced-bfb760643413 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:08.431096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-405f8612-d191-4917-bced-bfb760643413 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:08.431754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-405f8612-d191-4917-bced-bfb760643413 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:08.532777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-de0d7479-3d8d-42d2-b6f3-2a61b36273f2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:08.543009 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-de0d7479-3d8d-42d2-b6f3-2a61b36273f2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 200 len: 1308 microversion: 2.1 time: 0.336462 Mar 05 20:55:08.544345 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 935/1948] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:08 2022] GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:55:08.602886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-11198e8b-f74e-4e5b-b6fa-ae4146faa094 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:08.603563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-11198e8b-f74e-4e5b-b6fa-ae4146faa094 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:08.611401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11198e8b-f74e-4e5b-b6fa-ae4146faa094 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:08.611889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11198e8b-f74e-4e5b-b6fa-ae4146faa094 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:08.613420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11198e8b-f74e-4e5b-b6fa-ae4146faa094 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:08.616736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11198e8b-f74e-4e5b-b6fa-ae4146faa094 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:08.648424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-405f8612-d191-4917-bced-bfb760643413 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:08.661857 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-405f8612-d191-4917-bced-bfb760643413 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1527 microversion: 2.1 time: 0.251007 Mar 05 20:55:08.662856 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1014/1949] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:08 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1527 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:08.808987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dc7f6e83-41be-487d-a6cf-4b5db231ad8e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:08.809626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dc7f6e83-41be-487d-a6cf-4b5db231ad8e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:08.817738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc7f6e83-41be-487d-a6cf-4b5db231ad8e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:08.819010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc7f6e83-41be-487d-a6cf-4b5db231ad8e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:08.820322 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc7f6e83-41be-487d-a6cf-4b5db231ad8e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:08.821351 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc7f6e83-41be-487d-a6cf-4b5db231ad8e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:08.899661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-11198e8b-f74e-4e5b-b6fa-ae4146faa094 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:08.911508 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-11198e8b-f74e-4e5b-b6fa-ae4146faa094 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1528 microversion: 2.1 time: 0.312584 Mar 05 20:55:08.911508 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 936/1950] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:08 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1528 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:08.936033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b7060b18-7127-4863-b6d3-f637f6cd3a3e req-49b160bb-8b6e-49d0-b586-ce9710983520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4505753-e31f-4b5b-8ee3-f37ab9176b36", "name": "network-vif-plugged", "status": "completed", "tag": "455cfb49-cef8-4f8d-8d0a-39162ccccb16"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:08.945218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b7060b18-7127-4863-b6d3-f637f6cd3a3e req-49b160bb-8b6e-49d0-b586-ce9710983520 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:08.946760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b7060b18-7127-4863-b6d3-f637f6cd3a3e req-49b160bb-8b6e-49d0-b586-ce9710983520 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:08.963048 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-b7060b18-7127-4863-b6d3-f637f6cd3a3e req-49b160bb-8b6e-49d0-b586-ce9710983520 service nova] Creating event network-vif-plugged:455cfb49-cef8-4f8d-8d0a-39162ccccb16 for instance a4505753-e31f-4b5b-8ee3-f37ab9176b36 on nch1-master-1 Mar 05 20:55:08.978133 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b7060b18-7127-4863-b6d3-f637f6cd3a3e req-49b160bb-8b6e-49d0-b586-ce9710983520 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063776 Mar 05 20:55:08.981293 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 937/1951] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:09.012804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a633d9a8-d11f-457e-9ab1-1f77a51041cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:09.013530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a633d9a8-d11f-457e-9ab1-1f77a51041cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:09.027434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dc7f6e83-41be-487d-a6cf-4b5db231ad8e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cc30e265f94e3caa91b6adff365209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3501f5d56344468ebc4d50db1a5c5bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:09.038828 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dc7f6e83-41be-487d-a6cf-4b5db231ad8e tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 200 len: 1466 microversion: 2.1 time: 0.234152 Mar 05 20:55:09.041656 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1015/1952] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:08 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 1466 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:09.044550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a633d9a8-d11f-457e-9ab1-1f77a51041cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:09.045273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a633d9a8-d11f-457e-9ab1-1f77a51041cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:09.046162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a633d9a8-d11f-457e-9ab1-1f77a51041cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:09.048385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a633d9a8-d11f-457e-9ab1-1f77a51041cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:09.053316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f156a7f6-e574-4167-824b-1c15994c8f66 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:09.053928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f156a7f6-e574-4167-824b-1c15994c8f66 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:09.063229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f156a7f6-e574-4167-824b-1c15994c8f66 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:09.063704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f156a7f6-e574-4167-824b-1c15994c8f66 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:09.064796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f156a7f6-e574-4167-824b-1c15994c8f66 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:09.065240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f156a7f6-e574-4167-824b-1c15994c8f66 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:09.282084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a633d9a8-d11f-457e-9ab1-1f77a51041cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:09.301937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a633d9a8-d11f-457e-9ab1-1f77a51041cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:09.309868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a633d9a8-d11f-457e-9ab1-1f77a51041cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:09.325658 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a633d9a8-d11f-457e-9ab1-1f77a51041cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1233 microversion: 2.25 time: 0.309572 Mar 05 20:55:09.339023 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 938/1953] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:09 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1233 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:09.339023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-24201e33-5629-4f49-b67c-491e362e469c req-cffdda85-cd84-480e-944c-6cfe48241503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3261ac3a-9665-44b0-965d-06ac66c07d82", "name": "network-vif-deleted", "tag": "de504aa3-bfc4-44ec-a4bc-0df77d0e7550"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:09.359645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-24201e33-5629-4f49-b67c-491e362e469c req-cffdda85-cd84-480e-944c-6cfe48241503 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:09.360211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-24201e33-5629-4f49-b67c-491e362e469c req-cffdda85-cd84-480e-944c-6cfe48241503 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:09.378914 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-24201e33-5629-4f49-b67c-491e362e469c req-cffdda85-cd84-480e-944c-6cfe48241503 service nova] Creating event network-vif-deleted:de504aa3-bfc4-44ec-a4bc-0df77d0e7550 for instance 3261ac3a-9665-44b0-965d-06ac66c07d82 on nch2-master-1 Mar 05 20:55:09.380169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f156a7f6-e574-4167-824b-1c15994c8f66 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:09.388835 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-24201e33-5629-4f49-b67c-491e362e469c req-cffdda85-cd84-480e-944c-6cfe48241503 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057264 Mar 05 20:55:09.389927 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 939/1954] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:09.392111 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f156a7f6-e574-4167-824b-1c15994c8f66 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.349159 Mar 05 20:55:09.392974 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1016/1955] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:09 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:09.561176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3f49d0c6-5bc6-4ab5-90d1-f8e02a2d3de9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:09.562485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3f49d0c6-5bc6-4ab5-90d1-f8e02a2d3de9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:09.572177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f49d0c6-5bc6-4ab5-90d1-f8e02a2d3de9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:09.573681 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f49d0c6-5bc6-4ab5-90d1-f8e02a2d3de9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:09.576693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f49d0c6-5bc6-4ab5-90d1-f8e02a2d3de9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:09.580206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f49d0c6-5bc6-4ab5-90d1-f8e02a2d3de9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:09.680916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d0a94850-a036-4569-aacc-925f00999d96 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:09.681906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d0a94850-a036-4569-aacc-925f00999d96 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:09.690293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d0a94850-a036-4569-aacc-925f00999d96 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:09.691174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d0a94850-a036-4569-aacc-925f00999d96 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:09.692222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d0a94850-a036-4569-aacc-925f00999d96 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:09.692797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d0a94850-a036-4569-aacc-925f00999d96 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:10.013400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3f49d0c6-5bc6-4ab5-90d1-f8e02a2d3de9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:10.029508 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3f49d0c6-5bc6-4ab5-90d1-f8e02a2d3de9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 200 len: 1308 microversion: 2.1 time: 0.473080 Mar 05 20:55:10.030101 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 940/1956] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:09 2022] GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 1308 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:10.038749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ad09cd1f-f6fe-4808-a43d-1c7856c4fac7 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:10.039422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ad09cd1f-f6fe-4808-a43d-1c7856c4fac7 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:10.047165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad09cd1f-f6fe-4808-a43d-1c7856c4fac7 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:10.047546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad09cd1f-f6fe-4808-a43d-1c7856c4fac7 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:10.048556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad09cd1f-f6fe-4808-a43d-1c7856c4fac7 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:10.049947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad09cd1f-f6fe-4808-a43d-1c7856c4fac7 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:10.211464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad09cd1f-f6fe-4808-a43d-1c7856c4fac7 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995976a38f22434194707b7f464980c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab424b95f45b482eab7de3199a1f8048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:10.222294 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ad09cd1f-f6fe-4808-a43d-1c7856c4fac7 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 200 len: 1486 microversion: 2.1 time: 0.188697 Mar 05 20:55:10.223074 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 941/1957] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:10 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 1486 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:10.233116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b42ede3-d407-45da-bd45-177b9855ef8b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:10.234641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4b42ede3-d407-45da-bd45-177b9855ef8b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] [instance: 3261ac3a-9665-44b0-965d-06ac66c07d82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:10.250871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b42ede3-d407-45da-bd45-177b9855ef8b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:10.251689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b42ede3-d407-45da-bd45-177b9855ef8b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:10.252695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b42ede3-d407-45da-bd45-177b9855ef8b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:10.253349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b42ede3-d407-45da-bd45-177b9855ef8b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:10.309696 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4b42ede3-d407-45da-bd45-177b9855ef8b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] HTTP exception thrown: Instance 3261ac3a-9665-44b0-965d-06ac66c07d82 could not be found. Mar 05 20:55:10.310367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b42ede3-d407-45da-bd45-177b9855ef8b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] Returning 404 to user: Instance 3261ac3a-9665-44b0-965d-06ac66c07d82 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:10.311860 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4b42ede3-d407-45da-bd45-177b9855ef8b tempest-MigrationsAdminTest-1211983935 tempest-MigrationsAdminTest-1211983935-project] 10.222.0.15 "GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82" status: 404 len: 111 microversion: 2.1 time: 0.082612 Mar 05 20:55:10.314202 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 942/1958] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:10 2022] GET /compute/v2.1/servers/3261ac3a-9665-44b0-965d-06ac66c07d82 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:10.347235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-727f7b7e-6d16-4502-9178-f3c38add3cae tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:10.356133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-727f7b7e-6d16-4502-9178-f3c38add3cae tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:10.366820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-727f7b7e-6d16-4502-9178-f3c38add3cae tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:10.368911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-727f7b7e-6d16-4502-9178-f3c38add3cae tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:10.370695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-727f7b7e-6d16-4502-9178-f3c38add3cae tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:10.371512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-727f7b7e-6d16-4502-9178-f3c38add3cae tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:10.410698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d0a94850-a036-4569-aacc-925f00999d96 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:10.426292 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d0a94850-a036-4569-aacc-925f00999d96 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1527 microversion: 2.1 time: 0.748757 Mar 05 20:55:10.426926 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1017/1959] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:09 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1527 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:10.455129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cdd1742b-c898-40a1-9dcd-3d71f71e4026 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:10.457363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cdd1742b-c898-40a1-9dcd-3d71f71e4026 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:10.476303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-727f7b7e-6d16-4502-9178-f3c38add3cae tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:10.478693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdd1742b-c898-40a1-9dcd-3d71f71e4026 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:10.481099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdd1742b-c898-40a1-9dcd-3d71f71e4026 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:10.483965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdd1742b-c898-40a1-9dcd-3d71f71e4026 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:10.486961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cdd1742b-c898-40a1-9dcd-3d71f71e4026 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:10.487607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-727f7b7e-6d16-4502-9178-f3c38add3cae tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:10.489770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-727f7b7e-6d16-4502-9178-f3c38add3cae tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:10.493635 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-727f7b7e-6d16-4502-9178-f3c38add3cae tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1251 microversion: 2.25 time: 0.150920 Mar 05 20:55:10.494534 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 943/1960] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:10 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1251 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:55:11.026548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cdd1742b-c898-40a1-9dcd-3d71f71e4026 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:11.044190 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cdd1742b-c898-40a1-9dcd-3d71f71e4026 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.608377 Mar 05 20:55:11.044997 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1018/1961] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:10 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:11.061201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d0fa74ef-5a6b-4bd6-a844-7bc52942a1f9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:11.062152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d0fa74ef-5a6b-4bd6-a844-7bc52942a1f9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:11.079103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d0fa74ef-5a6b-4bd6-a844-7bc52942a1f9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.080812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d0fa74ef-5a6b-4bd6-a844-7bc52942a1f9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:11.081693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d0fa74ef-5a6b-4bd6-a844-7bc52942a1f9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.082081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d0fa74ef-5a6b-4bd6-a844-7bc52942a1f9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:11.244472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c9d3f8cc-ed42-46d8-af11-0e0f173e4cc4 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:11.245100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c9d3f8cc-ed42-46d8-af11-0e0f173e4cc4 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] [instance: 119d9fad-81c8-44d8-8d8c-48223035b62c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:11.255597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9d3f8cc-ed42-46d8-af11-0e0f173e4cc4 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.257573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9d3f8cc-ed42-46d8-af11-0e0f173e4cc4 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:11.258490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9d3f8cc-ed42-46d8-af11-0e0f173e4cc4 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.263718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9d3f8cc-ed42-46d8-af11-0e0f173e4cc4 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:11.293908 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-c9d3f8cc-ed42-46d8-af11-0e0f173e4cc4 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] HTTP exception thrown: Instance 119d9fad-81c8-44d8-8d8c-48223035b62c could not be found. Mar 05 20:55:11.294688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c9d3f8cc-ed42-46d8-af11-0e0f173e4cc4 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] Returning 404 to user: Instance 119d9fad-81c8-44d8-8d8c-48223035b62c could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:11.295547 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c9d3f8cc-ed42-46d8-af11-0e0f173e4cc4 tempest-ServerAddressesNegativeTestJSON-1788779922 tempest-ServerAddressesNegativeTestJSON-1788779922-project] 10.222.0.15 "GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c" status: 404 len: 111 microversion: 2.1 time: 0.055951 Mar 05 20:55:11.296160 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1019/1962] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:11 2022] GET /compute/v2.1/servers/119d9fad-81c8-44d8-8d8c-48223035b62c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:11.382025 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-0feefb40-1682-4bfe-a2de-190160d82cd7 req-80d7114a-a4af-4588-806b-add90286c81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2724db06-c25e-4c20-8c10-9cbcece37005", "name": "network-vif-unplugged", "status": "completed", "tag": "951324d7-3c13-4b4b-813d-7450955e6a0c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:11.397051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0feefb40-1682-4bfe-a2de-190160d82cd7 req-80d7114a-a4af-4588-806b-add90286c81b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.397724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0feefb40-1682-4bfe-a2de-190160d82cd7 req-80d7114a-a4af-4588-806b-add90286c81b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:11.424344 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0feefb40-1682-4bfe-a2de-190160d82cd7 req-80d7114a-a4af-4588-806b-add90286c81b service nova] Creating event network-vif-unplugged:951324d7-3c13-4b4b-813d-7450955e6a0c for instance 2724db06-c25e-4c20-8c10-9cbcece37005 on nch2-master-1 Mar 05 20:55:11.438791 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-0feefb40-1682-4bfe-a2de-190160d82cd7 req-80d7114a-a4af-4588-806b-add90286c81b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058838 Mar 05 20:55:11.439525 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1020/1963] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:55:11.443352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d0fa74ef-5a6b-4bd6-a844-7bc52942a1f9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:11.447879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-859e2f33-fe79-4131-b2bb-40696877c9a9 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:11.451821 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d0fa74ef-5a6b-4bd6-a844-7bc52942a1f9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 200 len: 1488 microversion: 2.1 time: 0.408497 Mar 05 20:55:11.452743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-859e2f33-fe79-4131-b2bb-40696877c9a9 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:11.455846 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 944/1964] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:11 2022] GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 1488 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:55:11.468999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f101c610-f05e-4234-b5a9-3ef2f88fdac2 req-4b26fec5-98ca-41d8-ad53-847be66710f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119d9fad-81c8-44d8-8d8c-48223035b62c", "name": "network-vif-deleted", "tag": "6a006e06-d1ff-4cfe-a96d-1803354c4689"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:11.469582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-859e2f33-fe79-4131-b2bb-40696877c9a9 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.470340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-859e2f33-fe79-4131-b2bb-40696877c9a9 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:11.471359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-859e2f33-fe79-4131-b2bb-40696877c9a9 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.472058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-859e2f33-fe79-4131-b2bb-40696877c9a9 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:11.494068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f101c610-f05e-4234-b5a9-3ef2f88fdac2 req-4b26fec5-98ca-41d8-ad53-847be66710f2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.495404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f101c610-f05e-4234-b5a9-3ef2f88fdac2 req-4b26fec5-98ca-41d8-ad53-847be66710f2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:11.510899 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f101c610-f05e-4234-b5a9-3ef2f88fdac2 req-4b26fec5-98ca-41d8-ad53-847be66710f2 service nova] Creating event network-vif-deleted:6a006e06-d1ff-4cfe-a96d-1803354c4689 for instance 119d9fad-81c8-44d8-8d8c-48223035b62c on nch2-master-1 Mar 05 20:55:11.520831 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f101c610-f05e-4234-b5a9-3ef2f88fdac2 req-4b26fec5-98ca-41d8-ad53-847be66710f2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063257 Mar 05 20:55:11.523014 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 945/1965] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:11.534863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-433b5f36-235f-481f-b64a-e2e29d464f0e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:11.535577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-433b5f36-235f-481f-b64a-e2e29d464f0e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:11.542788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-433b5f36-235f-481f-b64a-e2e29d464f0e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.543326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-433b5f36-235f-481f-b64a-e2e29d464f0e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:11.544262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-433b5f36-235f-481f-b64a-e2e29d464f0e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.544765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-433b5f36-235f-481f-b64a-e2e29d464f0e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:11.574293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-433b5f36-235f-481f-b64a-e2e29d464f0e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lazy-loading 'flavor' on Instance uuid a4505753-e31f-4b5b-8ee3-f37ab9176b36 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:55:11.727703 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-433b5f36-235f-481f-b64a-e2e29d464f0e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "POST /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36/action" status: 202 len: 0 microversion: 2.1 time: 0.202126 Mar 05 20:55:11.728521 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 946/1966] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:55:11 2022] POST /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:55:11.735197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-47edf4a3-c150-45cf-961a-f1d93a241c74 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:11.736786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-47edf4a3-c150-45cf-961a-f1d93a241c74 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:11.744757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47edf4a3-c150-45cf-961a-f1d93a241c74 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.745248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47edf4a3-c150-45cf-961a-f1d93a241c74 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:11.746068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47edf4a3-c150-45cf-961a-f1d93a241c74 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.746526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47edf4a3-c150-45cf-961a-f1d93a241c74 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:11.940619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-47edf4a3-c150-45cf-961a-f1d93a241c74 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:11.950209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-47edf4a3-c150-45cf-961a-f1d93a241c74 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:11.952047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-47edf4a3-c150-45cf-961a-f1d93a241c74 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:11.953276 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-47edf4a3-c150-45cf-961a-f1d93a241c74 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1281 microversion: 2.25 time: 0.223376 Mar 05 20:55:11.954131 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 947/1967] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:11 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1281 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:11.959159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23764c19-08c7-4bf9-93e8-7178c6531171 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:11.959889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-23764c19-08c7-4bf9-93e8-7178c6531171 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:11.967068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23764c19-08c7-4bf9-93e8-7178c6531171 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.967620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23764c19-08c7-4bf9-93e8-7178c6531171 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:11.968530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23764c19-08c7-4bf9-93e8-7178c6531171 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:11.969137 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23764c19-08c7-4bf9-93e8-7178c6531171 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:12.136752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-23764c19-08c7-4bf9-93e8-7178c6531171 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:12.145348 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-23764c19-08c7-4bf9-93e8-7178c6531171 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 200 len: 1496 microversion: 2.1 time: 0.190241 Mar 05 20:55:12.158909 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 948/1968] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:11 2022] GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 1496 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:12.164114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-33288391-cf2c-44f5-aeba-ad4b30e003cc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:12.165469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-33288391-cf2c-44f5-aeba-ad4b30e003cc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:12.171732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33288391-cf2c-44f5-aeba-ad4b30e003cc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:12.172288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33288391-cf2c-44f5-aeba-ad4b30e003cc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:12.173160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33288391-cf2c-44f5-aeba-ad4b30e003cc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:12.173667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33288391-cf2c-44f5-aeba-ad4b30e003cc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:12.353373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-33288391-cf2c-44f5-aeba-ad4b30e003cc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:12.362141 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-33288391-cf2c-44f5-aeba-ad4b30e003cc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.202021 Mar 05 20:55:12.373391 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 949/1969] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:12 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:12.393985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-859e2f33-fe79-4131-b2bb-40696877c9a9 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced50a298a4242d8a1856fe9b2cc454e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f177f4eebae0479d86a35a7531da201f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:12.404971 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-859e2f33-fe79-4131-b2bb-40696877c9a9 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 200 len: 1527 microversion: 2.1 time: 0.964140 Mar 05 20:55:12.405936 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1021/1970] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:11 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 1527 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:12.521588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-938177dc-50db-49a8-bd72-d85b59f841d9 req-70f7d811-61cf-42a7-ab19-d5fc19f3090e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2724db06-c25e-4c20-8c10-9cbcece37005", "name": "network-vif-deleted", "tag": "951324d7-3c13-4b4b-813d-7450955e6a0c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:12.542753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-938177dc-50db-49a8-bd72-d85b59f841d9 req-70f7d811-61cf-42a7-ab19-d5fc19f3090e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:12.544051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-938177dc-50db-49a8-bd72-d85b59f841d9 req-70f7d811-61cf-42a7-ab19-d5fc19f3090e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:12.584538 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-938177dc-50db-49a8-bd72-d85b59f841d9 req-70f7d811-61cf-42a7-ab19-d5fc19f3090e service nova] Creating event network-vif-deleted:951324d7-3c13-4b4b-813d-7450955e6a0c for instance 2724db06-c25e-4c20-8c10-9cbcece37005 on nch2-master-1 Mar 05 20:55:12.592522 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-938177dc-50db-49a8-bd72-d85b59f841d9 req-70f7d811-61cf-42a7-ab19-d5fc19f3090e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076674 Mar 05 20:55:12.595711 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 950/1971] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:12.975176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c5dd85f4-912b-4f2f-8f58-eafd225498e6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:12.976249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c5dd85f4-912b-4f2f-8f58-eafd225498e6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:12.993932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5dd85f4-912b-4f2f-8f58-eafd225498e6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:12.994631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5dd85f4-912b-4f2f-8f58-eafd225498e6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:12.995579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5dd85f4-912b-4f2f-8f58-eafd225498e6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:12.996162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5dd85f4-912b-4f2f-8f58-eafd225498e6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:13.170701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-72a989d6-1e49-4b27-a507-960b2f820c69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:13.171428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-72a989d6-1e49-4b27-a507-960b2f820c69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:13.179413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72a989d6-1e49-4b27-a507-960b2f820c69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:13.180762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72a989d6-1e49-4b27-a507-960b2f820c69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:13.182026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72a989d6-1e49-4b27-a507-960b2f820c69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:13.182656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72a989d6-1e49-4b27-a507-960b2f820c69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:13.395285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-72a989d6-1e49-4b27-a507-960b2f820c69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:13.410600 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-72a989d6-1e49-4b27-a507-960b2f820c69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 200 len: 1479 microversion: 2.1 time: 0.245331 Mar 05 20:55:13.422535 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 951/1972] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:13 2022] GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 1479 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:13.422962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c5dd85f4-912b-4f2f-8f58-eafd225498e6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:13.424818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-576c84b8-75a8-4fab-9622-94cb58790749 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:13.425513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-576c84b8-75a8-4fab-9622-94cb58790749 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:13.433067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c5dd85f4-912b-4f2f-8f58-eafd225498e6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:13.436031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-576c84b8-75a8-4fab-9622-94cb58790749 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:13.436352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c5dd85f4-912b-4f2f-8f58-eafd225498e6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:13.436897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-576c84b8-75a8-4fab-9622-94cb58790749 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:13.437738 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c5dd85f4-912b-4f2f-8f58-eafd225498e6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1281 microversion: 2.25 time: 0.469444 Mar 05 20:55:13.438030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-576c84b8-75a8-4fab-9622-94cb58790749 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:13.438628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-576c84b8-75a8-4fab-9622-94cb58790749 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:13.439074 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1022/1973] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:12 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1281 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:13.444122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-736627d7-040f-48d0-9f9b-2b5a1da14aa7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:13.445130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-736627d7-040f-48d0-9f9b-2b5a1da14aa7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 2724db06-c25e-4c20-8c10-9cbcece37005] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:13.453550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-736627d7-040f-48d0-9f9b-2b5a1da14aa7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:13.454391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-736627d7-040f-48d0-9f9b-2b5a1da14aa7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:13.455541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-736627d7-040f-48d0-9f9b-2b5a1da14aa7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:13.456346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-736627d7-040f-48d0-9f9b-2b5a1da14aa7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:13.478516 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-736627d7-040f-48d0-9f9b-2b5a1da14aa7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] HTTP exception thrown: Instance 2724db06-c25e-4c20-8c10-9cbcece37005 could not be found. Mar 05 20:55:13.479569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-736627d7-040f-48d0-9f9b-2b5a1da14aa7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 404 to user: Instance 2724db06-c25e-4c20-8c10-9cbcece37005 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:13.481050 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-736627d7-040f-48d0-9f9b-2b5a1da14aa7 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005" status: 404 len: 111 microversion: 2.1 time: 0.040860 Mar 05 20:55:13.481858 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1023/1974] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:13 2022] GET /compute/v2.1/servers/2724db06-c25e-4c20-8c10-9cbcece37005 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:13.494453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f3a0619d-97df-4d33-85d6-33f7a1b27046 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1378790280"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:13.501316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f3a0619d-97df-4d33-85d6-33f7a1b27046 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:13.512203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3a0619d-97df-4d33-85d6-33f7a1b27046 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:13.512756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3a0619d-97df-4d33-85d6-33f7a1b27046 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:13.514784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3a0619d-97df-4d33-85d6-33f7a1b27046 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:13.515656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3a0619d-97df-4d33-85d6-33f7a1b27046 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:13.611229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-576c84b8-75a8-4fab-9622-94cb58790749 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:13.622083 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-576c84b8-75a8-4fab-9622-94cb58790749 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.207437 Mar 05 20:55:13.623631 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 952/1975] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:13 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:13.628493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c13a9355-771a-4900-aa92-b38321f94489 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '.version_select at 0x7fed5c27d670>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:13.656729 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-c13a9355-771a-4900-aa92-b38321f94489 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] HTTP exception thrown: Image not found. Mar 05 20:55:13.658177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c13a9355-771a-4900-aa92-b38321f94489 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 404 to user: Image not found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:13.659253 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c13a9355-771a-4900-aa92-b38321f94489 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "DELETE /compute/v2.1/images/194bfac8-2175-45b7-8d3f-24671b826280" status: 404 len: 62 microversion: 2.1 time: 0.034474 Mar 05 20:55:13.660035 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 953/1976] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:13 2022] DELETE /compute/v2.1/images/194bfac8-2175-45b7-8d3f-24671b826280 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:55:13.669968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a50ec54c-3e5d-4560-8df5-896496a3c9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:13.670868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a50ec54c-3e5d-4560-8df5-896496a3c9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:13.679313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a50ec54c-3e5d-4560-8df5-896496a3c9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:13.680357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a50ec54c-3e5d-4560-8df5-896496a3c9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:13.681796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a50ec54c-3e5d-4560-8df5-896496a3c9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:13.682411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a50ec54c-3e5d-4560-8df5-896496a3c9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:13.712580 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-a50ec54c-3e5d-4560-8df5-896496a3c9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] HTTP exception thrown: Instance 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b could not be found. Mar 05 20:55:13.714002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a50ec54c-3e5d-4560-8df5-896496a3c9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 404 to user: Instance 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:13.714878 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a50ec54c-3e5d-4560-8df5-896496a3c9fa tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 404 len: 111 microversion: 2.1 time: 0.050910 Mar 05 20:55:13.718363 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 954/1977] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:55:13 2022] DELETE /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:55:13.730361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3995abc8-2fb9-4950-95a9-0dca635c5f66 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:13.731560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3995abc8-2fb9-4950-95a9-0dca635c5f66 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:13.746378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3995abc8-2fb9-4950-95a9-0dca635c5f66 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:13.747175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3995abc8-2fb9-4950-95a9-0dca635c5f66 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:13.749670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3995abc8-2fb9-4950-95a9-0dca635c5f66 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:13.750352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3995abc8-2fb9-4950-95a9-0dca635c5f66 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:13.788809 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-3995abc8-2fb9-4950-95a9-0dca635c5f66 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] HTTP exception thrown: Instance 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b could not be found. Mar 05 20:55:13.795277 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3995abc8-2fb9-4950-95a9-0dca635c5f66 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 404 to user: Instance 9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:13.796519 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3995abc8-2fb9-4950-95a9-0dca635c5f66 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b" status: 404 len: 111 microversion: 2.1 time: 0.074215 Mar 05 20:55:13.799748 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 955/1978] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:13 2022] GET /compute/v2.1/servers/9970ba4a-c732-4c5e-a4d1-c8f0dfe29c0b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:13.811661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bc94fb43-7219-4b51-aba6-665198d2f5ca tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '.version_select at 0x7fed5c3078b0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:13.851450 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bc94fb43-7219-4b51-aba6-665198d2f5ca tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-386407703" status: 202 len: 0 microversion: 2.1 time: 0.048702 Mar 05 20:55:13.854973 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 956/1979] 10.222.0.15 () {58 vars in 1217 bytes} [Sat Mar 5 20:55:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-386407703 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:55:14.034882 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f3a0619d-97df-4d33-85d6-33f7a1b27046 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "POST /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36/action" status: 202 len: 0 microversion: 2.1 time: 0.549255 Mar 05 20:55:14.040556 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1024/1980] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:55:13 2022] POST /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 20:55:14.046032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8f41c6fe-0772-4375-8abe-176bc0edf822 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c27c8b0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:14.138090 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8f41c6fe-0772-4375-8abe-176bc0edf822 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.095546 Mar 05 20:55:14.144899 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 957/1981] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:14 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:14.460440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-65980f15-cc65-4414-bc55-5219625cff97 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:14.462734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-65980f15-cc65-4414-bc55-5219625cff97 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:14.472041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65980f15-cc65-4414-bc55-5219625cff97 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:14.472851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65980f15-cc65-4414-bc55-5219625cff97 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:14.473934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65980f15-cc65-4414-bc55-5219625cff97 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:14.474546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65980f15-cc65-4414-bc55-5219625cff97 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:14.612533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-43b61c48-86c8-4fbf-a3bc-c1eec8f16d6f req-8fd34fc9-dc6e-40f9-ad0d-c0850a96bf0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2611e78-13fc-4a02-87a7-af3f7c46ddc0", "tag": "449a95d6-0b0c-41dc-8bf1-563531604d17"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:14.623692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-43b61c48-86c8-4fbf-a3bc-c1eec8f16d6f req-8fd34fc9-dc6e-40f9-ad0d-c0850a96bf0c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:14.624719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-43b61c48-86c8-4fbf-a3bc-c1eec8f16d6f req-8fd34fc9-dc6e-40f9-ad0d-c0850a96bf0c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:14.644098 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-43b61c48-86c8-4fbf-a3bc-c1eec8f16d6f req-8fd34fc9-dc6e-40f9-ad0d-c0850a96bf0c service nova] Creating event network-changed:449a95d6-0b0c-41dc-8bf1-563531604d17 for instance f2611e78-13fc-4a02-87a7-af3f7c46ddc0 on nch2-master-1 Mar 05 20:55:14.656812 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-43b61c48-86c8-4fbf-a3bc-c1eec8f16d6f req-8fd34fc9-dc6e-40f9-ad0d-c0850a96bf0c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048692 Mar 05 20:55:14.657882 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 958/1982] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:55:14.667989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dba083f7-fbed-403d-b4c6-27ba6de9964c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:14.669015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dba083f7-fbed-403d-b4c6-27ba6de9964c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:14.689404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dba083f7-fbed-403d-b4c6-27ba6de9964c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:14.690860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dba083f7-fbed-403d-b4c6-27ba6de9964c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:14.692850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dba083f7-fbed-403d-b4c6-27ba6de9964c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:14.693917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dba083f7-fbed-403d-b4c6-27ba6de9964c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:14.767161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-65980f15-cc65-4414-bc55-5219625cff97 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:14.777346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-65980f15-cc65-4414-bc55-5219625cff97 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:14.779193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-65980f15-cc65-4414-bc55-5219625cff97 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:14.780455 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-65980f15-cc65-4414-bc55-5219625cff97 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1281 microversion: 2.25 time: 0.327569 Mar 05 20:55:14.782290 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1025/1983] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:14 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1281 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:14.930080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dba083f7-fbed-403d-b4c6-27ba6de9964c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:14.943850 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dba083f7-fbed-403d-b4c6-27ba6de9964c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.283450 Mar 05 20:55:14.944320 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 959/1984] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:14 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:14.987079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1088b6a6-4f97-40f4-b48f-03e5286ce8d3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '.version_select at 0x7fed5c27f820>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:15.018587 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-1088b6a6-4f97-40f4-b48f-03e5286ce8d3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] HTTP exception thrown: Image not found. Mar 05 20:55:15.019402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1088b6a6-4f97-40f4-b48f-03e5286ce8d3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 404 to user: Image not found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:15.020412 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1088b6a6-4f97-40f4-b48f-03e5286ce8d3 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "DELETE /compute/v2.1/images/6bebdab8-7355-4d92-9ba0-37a0c733b311" status: 404 len: 62 microversion: 2.1 time: 0.037076 Mar 05 20:55:15.021322 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1026/1985] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:14 2022] DELETE /compute/v2.1/images/6bebdab8-7355-4d92-9ba0-37a0c733b311 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:55:15.031923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d549fbbb-e8e1-47e0-a4a9-2bd28cda4649 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:15.032536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d549fbbb-e8e1-47e0-a4a9-2bd28cda4649 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:15.039150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d549fbbb-e8e1-47e0-a4a9-2bd28cda4649 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:15.040170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d549fbbb-e8e1-47e0-a4a9-2bd28cda4649 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:15.041387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d549fbbb-e8e1-47e0-a4a9-2bd28cda4649 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:15.041945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d549fbbb-e8e1-47e0-a4a9-2bd28cda4649 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:15.066539 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-d549fbbb-e8e1-47e0-a4a9-2bd28cda4649 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] HTTP exception thrown: Instance 566b4bf7-27e3-48e9-aa39-9d0f512a146f could not be found. Mar 05 20:55:15.067388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d549fbbb-e8e1-47e0-a4a9-2bd28cda4649 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 404 to user: Instance 566b4bf7-27e3-48e9-aa39-9d0f512a146f could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:15.068348 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d549fbbb-e8e1-47e0-a4a9-2bd28cda4649 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "DELETE /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 404 len: 111 microversion: 2.1 time: 0.042364 Mar 05 20:55:15.069139 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 960/1986] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:55:15 2022] DELETE /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:15.078558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e980267f-b80f-4e5b-98bb-c15b78d75d09 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:15.079829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e980267f-b80f-4e5b-98bb-c15b78d75d09 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] [instance: 566b4bf7-27e3-48e9-aa39-9d0f512a146f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:15.088098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e980267f-b80f-4e5b-98bb-c15b78d75d09 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:15.088828 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e980267f-b80f-4e5b-98bb-c15b78d75d09 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:15.089814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e980267f-b80f-4e5b-98bb-c15b78d75d09 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:15.090569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e980267f-b80f-4e5b-98bb-c15b78d75d09 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:15.108332 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-e980267f-b80f-4e5b-98bb-c15b78d75d09 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] HTTP exception thrown: Instance 566b4bf7-27e3-48e9-aa39-9d0f512a146f could not be found. Mar 05 20:55:15.109230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e980267f-b80f-4e5b-98bb-c15b78d75d09 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] Returning 404 to user: Instance 566b4bf7-27e3-48e9-aa39-9d0f512a146f could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:15.110240 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e980267f-b80f-4e5b-98bb-c15b78d75d09 tempest-ImagesOneServerNegativeTestJSON-388434700 tempest-ImagesOneServerNegativeTestJSON-388434700-project] 10.222.0.15 "GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f" status: 404 len: 111 microversion: 2.1 time: 0.035933 Mar 05 20:55:15.111144 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1027/1987] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:15 2022] GET /compute/v2.1/servers/566b4bf7-27e3-48e9-aa39-9d0f512a146f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:15.155758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e022e43b-6808-4b5e-a54b-286271dc7537 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c1e65e0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:15.228179 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e022e43b-6808-4b5e-a54b-286271dc7537 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.080022 Mar 05 20:55:15.228948 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 961/1988] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:15 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:15.802831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-92807b5c-b89d-49f1-adfe-eadc20d319f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:15.803731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-92807b5c-b89d-49f1-adfe-eadc20d319f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:15.814569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92807b5c-b89d-49f1-adfe-eadc20d319f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:15.815544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92807b5c-b89d-49f1-adfe-eadc20d319f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:15.816439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92807b5c-b89d-49f1-adfe-eadc20d319f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:15.817033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92807b5c-b89d-49f1-adfe-eadc20d319f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:15.864149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1179372273", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:15.937202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:55:16.016849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-92807b5c-b89d-49f1-adfe-eadc20d319f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:16.029277 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-92807b5c-b89d-49f1-adfe-eadc20d319f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:16.031324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-92807b5c-b89d-49f1-adfe-eadc20d319f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:16.033360 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-92807b5c-b89d-49f1-adfe-eadc20d319f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1281 microversion: 2.25 time: 0.238108 Mar 05 20:55:16.034465 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 962/1989] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:15 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1281 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:16.040854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-83c19ede-fecc-4505-8df2-b157ba607088 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:16.042541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-83c19ede-fecc-4505-8df2-b157ba607088 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:16.051456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-83c19ede-fecc-4505-8df2-b157ba607088 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:16.052310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-83c19ede-fecc-4505-8df2-b157ba607088 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:16.053307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-83c19ede-fecc-4505-8df2-b157ba607088 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:16.053915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-83c19ede-fecc-4505-8df2-b157ba607088 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:16.224592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-83c19ede-fecc-4505-8df2-b157ba607088 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:16.235339 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-83c19ede-fecc-4505-8df2-b157ba607088 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.199505 Mar 05 20:55:16.235965 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 963/1990] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:16 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:16.253884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2acb5939-fc15-4acf-959a-502e153b38aa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c27c9d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:16.298202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:55:16.298699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:55:16.299107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:55:16.299528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:55:16.299970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:55:16.314190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:16.314629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:16.315452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:16.321218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:16.322063 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2acb5939-fc15-4acf-959a-502e153b38aa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.072543 Mar 05 20:55:16.328534 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 964/1991] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:16 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:16.342549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Getting quotas for project 1ecf912f62904e9ca0043b0de3b37e92. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:55:16.348336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Getting quotas for user aa267c305be048419839f673eb0ee929 and project 1ecf912f62904e9ca0043b0de3b37e92. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:55:16.363492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:55:16.364951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:55:16.419701 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c2314ad8-1905-4e48-8f8f-144bfc001d66 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907642 Mar 05 20:55:16.420534 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1028/1992] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:55:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:55:16.440021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d3c1ed0a-629d-4c24-a734-198cafc69c2d tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:16.443982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d3c1ed0a-629d-4c24-a734-198cafc69c2d tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:16.530714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d3c1ed0a-629d-4c24-a734-198cafc69c2d tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:16.540972 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d3c1ed0a-629d-4c24-a734-198cafc69c2d tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1223 microversion: 2.1 time: 0.112939 Mar 05 20:55:16.541901 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 965/1993] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:16 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:17.061494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9122b377-8709-420f-8e8e-1c4c09f1c3af tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:17.062338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9122b377-8709-420f-8e8e-1c4c09f1c3af tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:17.084740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9122b377-8709-420f-8e8e-1c4c09f1c3af tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:17.087435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9122b377-8709-420f-8e8e-1c4c09f1c3af tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:17.089631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9122b377-8709-420f-8e8e-1c4c09f1c3af tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:17.092060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9122b377-8709-420f-8e8e-1c4c09f1c3af tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:17.254154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-667e265e-75b5-422a-86e8-448a0506a131 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:17.255296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-667e265e-75b5-422a-86e8-448a0506a131 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:17.269613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-667e265e-75b5-422a-86e8-448a0506a131 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:17.273607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-667e265e-75b5-422a-86e8-448a0506a131 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:17.277560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-667e265e-75b5-422a-86e8-448a0506a131 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:17.279038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-667e265e-75b5-422a-86e8-448a0506a131 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:17.839404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-667e265e-75b5-422a-86e8-448a0506a131 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:17.861820 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-667e265e-75b5-422a-86e8-448a0506a131 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.610367 Mar 05 20:55:17.866515 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 966/1994] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:17 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:17.880695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dd30a52a-3755-4f34-9091-cb712ec5e706 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c1e63a0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:17.944583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9122b377-8709-420f-8e8e-1c4c09f1c3af tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:17.968523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9122b377-8709-420f-8e8e-1c4c09f1c3af tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:17.969427 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dd30a52a-3755-4f34-9091-cb712ec5e706 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.101536 Mar 05 20:55:17.970517 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 967/1995] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:17 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:17.981819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9122b377-8709-420f-8e8e-1c4c09f1c3af tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:17.982859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b1655f9f-0230-481b-a6f9-a351397c185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:17.983268 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9122b377-8709-420f-8e8e-1c4c09f1c3af tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1281 microversion: 2.25 time: 0.927261 Mar 05 20:55:17.983851 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1029/1996] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:17 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1281 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:17.986507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b1655f9f-0230-481b-a6f9-a351397c185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:18.000093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1655f9f-0230-481b-a6f9-a351397c185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:18.000554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1655f9f-0230-481b-a6f9-a351397c185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:18.001348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1655f9f-0230-481b-a6f9-a351397c185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:18.001802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1655f9f-0230-481b-a6f9-a351397c185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:18.320239 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b1655f9f-0230-481b-a6f9-a351397c185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:18.328987 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b1655f9f-0230-481b-a6f9-a351397c185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1275 microversion: 2.1 time: 0.356659 Mar 05 20:55:18.333861 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 968/1997] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:17 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1275 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:18.570990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8cbe3f71-8311-492d-8ac2-41ed424785b9 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Action: 'create', calling method: .version_select at 0x7fed5c239280>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:18.583241 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-8cbe3f71-8311-492d-8ac2-41ed424785b9 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Mar 05 20:55:18.584314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8cbe3f71-8311-492d-8ac2-41ed424785b9 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:18.585465 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8cbe3f71-8311-492d-8ac2-41ed424785b9 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.338385 Mar 05 20:55:18.586486 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1030/1998] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:55:18 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 340 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 05 20:55:18.597519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d7cb1177-fce5-4f5b-96b8-c49c396eac1d tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Action: 'create', calling method: .version_select at 0x7fed5c1e6f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1993784356", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:18.641904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d7cb1177-fce5-4f5b-96b8-c49c396eac1d tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Getting quotas for project 03f0ad4afd524128bf068e63abf3e978. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:55:18.659110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d7cb1177-fce5-4f5b-96b8-c49c396eac1d tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Getting quotas for user 2e1bb82d09744e719fa37474b6a8e0fa and project 03f0ad4afd524128bf068e63abf3e978. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:55:18.692066 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-d7cb1177-fce5-4f5b-96b8-c49c396eac1d tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Mar 05 20:55:18.693872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d7cb1177-fce5-4f5b-96b8-c49c396eac1d tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:18.696655 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d7cb1177-fce5-4f5b-96b8-c49c396eac1d tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.103966 Mar 05 20:55:18.699050 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 969/1999] 10.222.0.15 () {60 vars in 1159 bytes} [Sat Mar 5 20:55:18 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 05 20:55:18.709888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c0c2af4-c5d6-4d10-ab4a-02b6292f4e5a tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Action: 'create', calling method: .version_select at 0x7fed5c79cd30>, body: {"keypair": {"name": "tempest-keypair-274999323"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:18.745409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9c0c2af4-c5d6-4d10-ab4a-02b6292f4e5a tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Getting quotas for project 03f0ad4afd524128bf068e63abf3e978. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:55:18.754115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9c0c2af4-c5d6-4d10-ab4a-02b6292f4e5a tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Getting quotas for user 2e1bb82d09744e719fa37474b6a8e0fa and project 03f0ad4afd524128bf068e63abf3e978. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:55:18.882725 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1ed1f6a4-d912-47c9-ab22-d6c0434fa758 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:18.884513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1ed1f6a4-d912-47c9-ab22-d6c0434fa758 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:18.904655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ed1f6a4-d912-47c9-ab22-d6c0434fa758 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:18.909817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ed1f6a4-d912-47c9-ab22-d6c0434fa758 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:18.913707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ed1f6a4-d912-47c9-ab22-d6c0434fa758 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:18.917180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ed1f6a4-d912-47c9-ab22-d6c0434fa758 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:19.265346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9c0c2af4-c5d6-4d10-ab4a-02b6292f4e5a tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Getting quotas for project 03f0ad4afd524128bf068e63abf3e978. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:55:19.278836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9c0c2af4-c5d6-4d10-ab4a-02b6292f4e5a tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Getting quotas for user 2e1bb82d09744e719fa37474b6a8e0fa and project 03f0ad4afd524128bf068e63abf3e978. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:55:19.364291 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c0c2af4-c5d6-4d10-ab4a-02b6292f4e5a tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.660159 Mar 05 20:55:19.375143 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1031/2000] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:55:18 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:19.383787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-daef9105-110b-4f50-89cf-36e8f973af56 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c241a60>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:19.509584 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-daef9105-110b-4f50-89cf-36e8f973af56 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.131184 Mar 05 20:55:19.512056 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1032/2001] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:19 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:19.526489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d3890426-b747-41bd-bb17-f1ffc89c1d9e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:19.527540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d3890426-b747-41bd-bb17-f1ffc89c1d9e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:19.551409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1ed1f6a4-d912-47c9-ab22-d6c0434fa758 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:19.552755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3890426-b747-41bd-bb17-f1ffc89c1d9e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:19.555637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3890426-b747-41bd-bb17-f1ffc89c1d9e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:19.558667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3890426-b747-41bd-bb17-f1ffc89c1d9e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:19.562015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3890426-b747-41bd-bb17-f1ffc89c1d9e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:19.571232 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1ed1f6a4-d912-47c9-ab22-d6c0434fa758 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.690528 Mar 05 20:55:19.576145 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 970/2002] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:18 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:55:19.581069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9d15c3e4-2718-4869-adcd-ed383813e7ea tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:19.583836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9d15c3e4-2718-4869-adcd-ed383813e7ea tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:19.610966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d15c3e4-2718-4869-adcd-ed383813e7ea tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:19.620402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d15c3e4-2718-4869-adcd-ed383813e7ea tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:19.621610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d15c3e4-2718-4869-adcd-ed383813e7ea tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:19.627243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d15c3e4-2718-4869-adcd-ed383813e7ea tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:19.770289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9d15c3e4-2718-4869-adcd-ed383813e7ea tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:19.786857 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9d15c3e4-2718-4869-adcd-ed383813e7ea tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1281 microversion: 2.1 time: 0.209289 Mar 05 20:55:19.787803 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 971/2003] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:19 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:19.792970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8cce80a1-b165-439e-9e99-2534a2053e3e tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Action: 'create', calling method: .version_select at 0x7fed5c21e280>, body: {"keypair": {"name": "tempest-keypair-274999323"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:19.813876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8cce80a1-b165-439e-9e99-2534a2053e3e tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Getting quotas for project 03f0ad4afd524128bf068e63abf3e978. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:55:19.822793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8cce80a1-b165-439e-9e99-2534a2053e3e tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Getting quotas for user 2e1bb82d09744e719fa37474b6a8e0fa and project 03f0ad4afd524128bf068e63abf3e978. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:55:20.243994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d3890426-b747-41bd-bb17-f1ffc89c1d9e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:20.257285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d3890426-b747-41bd-bb17-f1ffc89c1d9e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:20.261738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d3890426-b747-41bd-bb17-f1ffc89c1d9e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:20.267136 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d3890426-b747-41bd-bb17-f1ffc89c1d9e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1281 microversion: 2.25 time: 0.747711 Mar 05 20:55:20.269109 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1033/2004] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:19 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1281 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:20.473337 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-8cce80a1-b165-439e-9e99-2534a2053e3e tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] HTTP exception thrown: Key pair 'tempest-keypair-274999323' already exists. Mar 05 20:55:20.476953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8cce80a1-b165-439e-9e99-2534a2053e3e tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Returning 409 to user: Key pair 'tempest-keypair-274999323' already exists. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:20.478775 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8cce80a1-b165-439e-9e99-2534a2053e3e tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.689780 Mar 05 20:55:20.483238 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 972/2005] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:55:19 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 694 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:55:20.492062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b30d108c-b4e1-483e-985b-2de52b9d8d8a tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Calling method '.version_select at 0x7fed5c23eaf0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:20.536463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f8ad641b-3ad0-460b-8a18-dc974639b81e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c21e430>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:20.557852 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b30d108c-b4e1-483e-985b-2de52b9d8d8a tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-274999323" status: 202 len: 0 microversion: 2.1 time: 0.065779 Mar 05 20:55:20.559163 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1034/2006] 10.222.0.15 () {58 vars in 1217 bytes} [Sat Mar 5 20:55:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-274999323 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:55:20.573792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8277b55b-1779-41c1-8048-8d57138cec74 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Action: 'create', calling method: .version_select at 0x7fed5c260550>, body: {"keypair": {"name": ""}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:20.575859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8277b55b-1779-41c1-8048-8d57138cec74 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:20.577317 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8277b55b-1779-41c1-8048-8d57138cec74 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.012626 Mar 05 20:55:20.578519 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1035/2007] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:55:20 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:55:20.590980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-71b17555-78b4-4f47-b882-0b31bf52e209 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Action: 'create', calling method: .version_select at 0x7fed61b4c4c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-435685071", "public_key": " "}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:20.625008 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f8ad641b-3ad0-460b-8a18-dc974639b81e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.105155 Mar 05 20:55:20.625727 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 973/2008] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:20 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:55:20.659468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b0542bd5-3790-4e24-9051-08c5b1e3ea4f tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:20.661602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b0542bd5-3790-4e24-9051-08c5b1e3ea4f tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:20.667029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-71b17555-78b4-4f47-b882-0b31bf52e209 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Getting quotas for project 03f0ad4afd524128bf068e63abf3e978. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:55:20.675543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-71b17555-78b4-4f47-b882-0b31bf52e209 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Getting quotas for user 2e1bb82d09744e719fa37474b6a8e0fa and project 03f0ad4afd524128bf068e63abf3e978. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:55:20.682006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0542bd5-3790-4e24-9051-08c5b1e3ea4f tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:20.682594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0542bd5-3790-4e24-9051-08c5b1e3ea4f tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:20.683525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0542bd5-3790-4e24-9051-08c5b1e3ea4f tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:20.684027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0542bd5-3790-4e24-9051-08c5b1e3ea4f tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:20.708979 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-71b17555-78b4-4f47-b882-0b31bf52e209 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Mar 05 20:55:20.710342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-71b17555-78b4-4f47-b882-0b31bf52e209 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:20.711813 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-71b17555-78b4-4f47-b882-0b31bf52e209 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.127619 Mar 05 20:55:20.713812 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1036/2009] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:55:20 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 05 20:55:20.724889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8127c62f-997f-440e-ae2e-552f45085f1d tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Action: 'create', calling method: .version_select at 0x7fed5c241f70>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:20.726361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8127c62f-997f-440e-ae2e-552f45085f1d tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:20.727805 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8127c62f-997f-440e-ae2e-552f45085f1d tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.006976 Mar 05 20:55:20.730370 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1037/2010] 10.222.0.15 () {60 vars in 1158 bytes} [Sat Mar 5 20:55:20 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:55:20.752548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1f133dd4-c87b-4c95-810e-c63106e07688 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Action: 'create', calling method: .version_select at 0x7fed5c23e9d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2059453512", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:20.775305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-1f133dd4-c87b-4c95-810e-c63106e07688 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Getting quotas for project 03f0ad4afd524128bf068e63abf3e978. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:55:20.790207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-1f133dd4-c87b-4c95-810e-c63106e07688 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Getting quotas for user 2e1bb82d09744e719fa37474b6a8e0fa and project 03f0ad4afd524128bf068e63abf3e978. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:55:20.831459 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-1f133dd4-c87b-4c95-810e-c63106e07688 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Mar 05 20:55:20.832230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1f133dd4-c87b-4c95-810e-c63106e07688 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:20.833114 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1f133dd4-c87b-4c95-810e-c63106e07688 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.094241 Mar 05 20:55:20.833692 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1038/2011] 10.222.0.15 () {60 vars in 1158 bytes} [Sat Mar 5 20:55:20 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 05 20:55:20.845955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7821cc90-5957-4dd8-83c4-4d178c40185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:20.846889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7821cc90-5957-4dd8-83c4-4d178c40185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:20.854811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7821cc90-5957-4dd8-83c4-4d178c40185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:20.855330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7821cc90-5957-4dd8-83c4-4d178c40185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:20.856139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7821cc90-5957-4dd8-83c4-4d178c40185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:20.856591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7821cc90-5957-4dd8-83c4-4d178c40185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:21.285723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7821cc90-5957-4dd8-83c4-4d178c40185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:21.293195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b0542bd5-3790-4e24-9051-08c5b1e3ea4f tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:21.298863 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7821cc90-5957-4dd8-83c4-4d178c40185f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1323 microversion: 2.1 time: 0.454761 Mar 05 20:55:21.300494 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1039/2012] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:20 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1323 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:21.310525 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b0542bd5-3790-4e24-9051-08c5b1e3ea4f tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.681649 Mar 05 20:55:21.311253 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 974/2013] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:20 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:21.323132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-275ca768-c6b8-4738-9c51-929051e7280a req-d8d5b23c-b0b6-4686-b531-db4e9bb4ed78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4505753-e31f-4b5b-8ee3-f37ab9176b36", "name": "network-vif-plugged", "status": "completed", "tag": "455cfb49-cef8-4f8d-8d0a-39162ccccb16"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:21.326754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-23cf22fd-4aca-4f58-acdd-bcc2c2cfd589 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Calling method '.version_select at 0x7fed5c2413a0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:21.352482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-275ca768-c6b8-4738-9c51-929051e7280a req-d8d5b23c-b0b6-4686-b531-db4e9bb4ed78 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:21.352482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-275ca768-c6b8-4738-9c51-929051e7280a req-d8d5b23c-b0b6-4686-b531-db4e9bb4ed78 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:21.357452 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-23cf22fd-4aca-4f58-acdd-bcc2c2cfd589 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-181077299 not found for user 2e1bb82d09744e719fa37474b6a8e0fa Mar 05 20:55:21.360015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-23cf22fd-4aca-4f58-acdd-bcc2c2cfd589 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] Returning 404 to user: Keypair tempest-keypair-non-existent-181077299 not found for user 2e1bb82d09744e719fa37474b6a8e0fa {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:21.361241 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-23cf22fd-4aca-4f58-acdd-bcc2c2cfd589 tempest-KeyPairsNegativeTestJSON-1639321982 tempest-KeyPairsNegativeTestJSON-1639321982-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-181077299" status: 404 len: 144 microversion: 2.1 time: 0.059638 Mar 05 20:55:21.363417 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1040/2014] 10.222.0.15 () {58 vars in 1256 bytes} [Sat Mar 5 20:55:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-181077299 => generated 144 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:21.380759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bfa59e2e-2f3d-4c50-a4fc-8f7a6a8afa32 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:21.385046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bfa59e2e-2f3d-4c50-a4fc-8f7a6a8afa32 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:21.387823 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-275ca768-c6b8-4738-9c51-929051e7280a req-d8d5b23c-b0b6-4686-b531-db4e9bb4ed78 service nova] Creating event network-vif-plugged:455cfb49-cef8-4f8d-8d0a-39162ccccb16 for instance a4505753-e31f-4b5b-8ee3-f37ab9176b36 on nch1-master-1 Mar 05 20:55:21.401329 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-275ca768-c6b8-4738-9c51-929051e7280a req-d8d5b23c-b0b6-4686-b531-db4e9bb4ed78 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089051 Mar 05 20:55:21.406180 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 975/2015] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:21.408554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bfa59e2e-2f3d-4c50-a4fc-8f7a6a8afa32 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:21.409417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bfa59e2e-2f3d-4c50-a4fc-8f7a6a8afa32 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:21.415146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bfa59e2e-2f3d-4c50-a4fc-8f7a6a8afa32 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:21.416917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bfa59e2e-2f3d-4c50-a4fc-8f7a6a8afa32 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:21.640705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-91d36bb6-33db-48f8-8011-108a9b395be4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c307a60>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:21.798104 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-91d36bb6-33db-48f8-8011-108a9b395be4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.162566 Mar 05 20:55:21.801786 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 976/2016] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:21 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:21.971291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bfa59e2e-2f3d-4c50-a4fc-8f7a6a8afa32 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:21.983889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bfa59e2e-2f3d-4c50-a4fc-8f7a6a8afa32 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:21.987085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bfa59e2e-2f3d-4c50-a4fc-8f7a6a8afa32 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:21.988275 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bfa59e2e-2f3d-4c50-a4fc-8f7a6a8afa32 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1281 microversion: 2.25 time: 0.622795 Mar 05 20:55:21.992508 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1041/2017] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:21 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1281 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:22.316789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8720f6fc-fb6d-4f34-890e-e33fd84826d3 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:22.318088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8720f6fc-fb6d-4f34-890e-e33fd84826d3 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:22.328433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0e058f62-e1d7-4fce-aca2-a893d77a149e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:22.329057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0e058f62-e1d7-4fce-aca2-a893d77a149e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:22.333515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8720f6fc-fb6d-4f34-890e-e33fd84826d3 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:22.334318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8720f6fc-fb6d-4f34-890e-e33fd84826d3 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:22.337483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8720f6fc-fb6d-4f34-890e-e33fd84826d3 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:22.340218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8720f6fc-fb6d-4f34-890e-e33fd84826d3 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:22.341617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e058f62-e1d7-4fce-aca2-a893d77a149e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:22.342103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e058f62-e1d7-4fce-aca2-a893d77a149e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:22.350860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e058f62-e1d7-4fce-aca2-a893d77a149e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:22.351406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e058f62-e1d7-4fce-aca2-a893d77a149e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:22.839378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0e058f62-e1d7-4fce-aca2-a893d77a149e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:22.849261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8720f6fc-fb6d-4f34-890e-e33fd84826d3 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:22.857098 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0e058f62-e1d7-4fce-aca2-a893d77a149e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.533142 Mar 05 20:55:22.865775 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1042/2018] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:22 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:22.869721 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8720f6fc-fb6d-4f34-890e-e33fd84826d3 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1323 microversion: 2.1 time: 0.549308 Mar 05 20:55:22.871776 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 977/2019] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:22 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1323 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:22.890482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e556a21f-6455-4f4c-ac9f-60622eef2b5c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c2bd5e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:23.011991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2c1cb8fe-9476-441d-99fe-5b68a69eea72 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:23.012603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2c1cb8fe-9476-441d-99fe-5b68a69eea72 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:23.015370 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e556a21f-6455-4f4c-ac9f-60622eef2b5c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.144804 Mar 05 20:55:23.016762 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1043/2020] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:22 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:23.039394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c1cb8fe-9476-441d-99fe-5b68a69eea72 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:23.041036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c1cb8fe-9476-441d-99fe-5b68a69eea72 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:23.042390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c1cb8fe-9476-441d-99fe-5b68a69eea72 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:23.043344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c1cb8fe-9476-441d-99fe-5b68a69eea72 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:23.089117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-3c88445c-9588-4a98-a853-ade0dee405da req-6c60dfe5-5616-4dba-b157-23f909eb0e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877cfd7f-cc15-4e73-87fd-65d5e176d0cd", "tag": "85a2296d-3794-434e-91df-6c4e380c3245"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:23.109491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3c88445c-9588-4a98-a853-ade0dee405da req-6c60dfe5-5616-4dba-b157-23f909eb0e1b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:23.111951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3c88445c-9588-4a98-a853-ade0dee405da req-6c60dfe5-5616-4dba-b157-23f909eb0e1b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:23.143126 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-3c88445c-9588-4a98-a853-ade0dee405da req-6c60dfe5-5616-4dba-b157-23f909eb0e1b service nova] Creating event network-changed:85a2296d-3794-434e-91df-6c4e380c3245 for instance 877cfd7f-cc15-4e73-87fd-65d5e176d0cd on nch2-master-1 Mar 05 20:55:23.160083 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-3c88445c-9588-4a98-a853-ade0dee405da req-6c60dfe5-5616-4dba-b157-23f909eb0e1b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074270 Mar 05 20:55:23.161492 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1044/2021] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:55:23.430404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-af00a8c1-f043-4dc0-93bd-9d3c992c1d65 req-a256f0f5-8f03-4836-abe2-049bc62d0237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2611e78-13fc-4a02-87a7-af3f7c46ddc0", "name": "network-vif-plugged", "status": "completed", "tag": "449a95d6-0b0c-41dc-8bf1-563531604d17"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:23.453102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2c1cb8fe-9476-441d-99fe-5b68a69eea72 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:23.464145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-af00a8c1-f043-4dc0-93bd-9d3c992c1d65 req-a256f0f5-8f03-4836-abe2-049bc62d0237 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:23.464660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-af00a8c1-f043-4dc0-93bd-9d3c992c1d65 req-a256f0f5-8f03-4836-abe2-049bc62d0237 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:23.475315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2c1cb8fe-9476-441d-99fe-5b68a69eea72 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:23.479326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2c1cb8fe-9476-441d-99fe-5b68a69eea72 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:23.481223 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2c1cb8fe-9476-441d-99fe-5b68a69eea72 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1281 microversion: 2.25 time: 0.474460 Mar 05 20:55:23.485239 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 978/2022] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:23 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1281 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:23.504201 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-af00a8c1-f043-4dc0-93bd-9d3c992c1d65 req-a256f0f5-8f03-4836-abe2-049bc62d0237 service nova] Creating event network-vif-plugged:449a95d6-0b0c-41dc-8bf1-563531604d17 for instance f2611e78-13fc-4a02-87a7-af3f7c46ddc0 on nch2-master-1 Mar 05 20:55:23.512745 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-af00a8c1-f043-4dc0-93bd-9d3c992c1d65 req-a256f0f5-8f03-4836-abe2-049bc62d0237 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088056 Mar 05 20:55:23.514126 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1045/2023] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:55:23.883269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eaba5ed5-3c12-42e4-a27e-859db09e8dc0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:23.884161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eaba5ed5-3c12-42e4-a27e-859db09e8dc0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:23.896468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9e0acd5d-a0a9-4e85-b69c-e6f02634a40b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:23.897780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9e0acd5d-a0a9-4e85-b69c-e6f02634a40b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:23.913427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eaba5ed5-3c12-42e4-a27e-859db09e8dc0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:23.915078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eaba5ed5-3c12-42e4-a27e-859db09e8dc0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:23.918179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eaba5ed5-3c12-42e4-a27e-859db09e8dc0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:23.918403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e0acd5d-a0a9-4e85-b69c-e6f02634a40b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:23.919515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e0acd5d-a0a9-4e85-b69c-e6f02634a40b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:23.920640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e0acd5d-a0a9-4e85-b69c-e6f02634a40b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:23.920991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eaba5ed5-3c12-42e4-a27e-859db09e8dc0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:23.926269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e0acd5d-a0a9-4e85-b69c-e6f02634a40b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:24.816991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eaba5ed5-3c12-42e4-a27e-859db09e8dc0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:24.831043 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eaba5ed5-3c12-42e4-a27e-859db09e8dc0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1521 microversion: 2.1 time: 0.951881 Mar 05 20:55:24.832560 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 979/2024] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:23 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1521 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:24.840462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eeb3f322-60ad-41d9-a538-ba9672e8d64d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c1f6670>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:24.922491 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eeb3f322-60ad-41d9-a538-ba9672e8d64d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.088011 Mar 05 20:55:24.931498 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 980/2025] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:24 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:24.949902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5331d174-c25a-4de9-9426-99a4b598542f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:24.950889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5331d174-c25a-4de9-9426-99a4b598542f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:24.970979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5331d174-c25a-4de9-9426-99a4b598542f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:24.971779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5331d174-c25a-4de9-9426-99a4b598542f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:24.973000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5331d174-c25a-4de9-9426-99a4b598542f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:24.973983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5331d174-c25a-4de9-9426-99a4b598542f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:24.985974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9e0acd5d-a0a9-4e85-b69c-e6f02634a40b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:24.995404 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9e0acd5d-a0a9-4e85-b69c-e6f02634a40b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1323 microversion: 2.1 time: 1.105196 Mar 05 20:55:25.005507 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1046/2026] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:23 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1323 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:25.495246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5331d174-c25a-4de9-9426-99a4b598542f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:25.525176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5331d174-c25a-4de9-9426-99a4b598542f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:25.533969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5331d174-c25a-4de9-9426-99a4b598542f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:25.539452 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5331d174-c25a-4de9-9426-99a4b598542f tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1281 microversion: 2.25 time: 0.603734 Mar 05 20:55:25.541450 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 981/2027] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:24 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1281 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:25.850480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3f6be04e-150b-4be3-9060-56b6e3444c34 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:25.851504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3f6be04e-150b-4be3-9060-56b6e3444c34 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:25.868921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f6be04e-150b-4be3-9060-56b6e3444c34 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:25.886626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f6be04e-150b-4be3-9060-56b6e3444c34 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:25.890198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f6be04e-150b-4be3-9060-56b6e3444c34 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:25.890865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f6be04e-150b-4be3-9060-56b6e3444c34 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:25.940279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-30b2399e-f766-42f6-8621-7556a520ef19 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c27c790>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:26.058611 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-30b2399e-f766-42f6-8621-7556a520ef19 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.124280 Mar 05 20:55:26.061580 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 982/2028] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:25 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:26.073176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-90e01b34-4d63-4fb0-8d85-add2b57d5111 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:26.074626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-90e01b34-4d63-4fb0-8d85-add2b57d5111 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:26.088551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90e01b34-4d63-4fb0-8d85-add2b57d5111 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:26.089423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90e01b34-4d63-4fb0-8d85-add2b57d5111 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:26.090606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90e01b34-4d63-4fb0-8d85-add2b57d5111 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:26.096358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90e01b34-4d63-4fb0-8d85-add2b57d5111 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:26.440494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3f6be04e-150b-4be3-9060-56b6e3444c34 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:26.491078 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3f6be04e-150b-4be3-9060-56b6e3444c34 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1498 microversion: 2.1 time: 0.637737 Mar 05 20:55:26.493752 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1047/2029] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:25 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1498 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:26.522330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2feab28c-9651-4e51-9d0e-5e6ef36c21f0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:26.561857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2feab28c-9651-4e51-9d0e-5e6ef36c21f0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:26.569453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2feab28c-9651-4e51-9d0e-5e6ef36c21f0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:26.601564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2feab28c-9651-4e51-9d0e-5e6ef36c21f0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:26.602548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2feab28c-9651-4e51-9d0e-5e6ef36c21f0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:26.605043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2feab28c-9651-4e51-9d0e-5e6ef36c21f0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:26.605513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2feab28c-9651-4e51-9d0e-5e6ef36c21f0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:26.681472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-2feab28c-9651-4e51-9d0e-5e6ef36c21f0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:26.786210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-90e01b34-4d63-4fb0-8d85-add2b57d5111 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:26.796595 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-90e01b34-4d63-4fb0-8d85-add2b57d5111 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1323 microversion: 2.1 time: 0.734934 Mar 05 20:55:26.799990 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 983/2030] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:26 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1323 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:26.808034 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2feab28c-9651-4e51-9d0e-5e6ef36c21f0 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.288229 Mar 05 20:55:26.810747 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1048/2031] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Mar 5 20:55:26 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:26.811496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f60b77c0-84d2-4baa-8bf3-0337745a64d8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:26.812307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f60b77c0-84d2-4baa-8bf3-0337745a64d8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:26.829346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f60b77c0-84d2-4baa-8bf3-0337745a64d8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:26.829839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f60b77c0-84d2-4baa-8bf3-0337745a64d8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:26.830802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f60b77c0-84d2-4baa-8bf3-0337745a64d8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:26.831273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f60b77c0-84d2-4baa-8bf3-0337745a64d8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:26.843026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-41bf346e-e4a3-4313-80b0-91c7491e5b25 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:26.886422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41bf346e-e4a3-4313-80b0-91c7491e5b25 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:26.900412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41bf346e-e4a3-4313-80b0-91c7491e5b25 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:27.033300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-41bf346e-e4a3-4313-80b0-91c7491e5b25 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Going to try to start instance {{(pid=141479) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 05 20:55:27.175368 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-41bf346e-e4a3-4313-80b0-91c7491e5b25 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "POST /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341/action" status: 202 len: 0 microversion: 2.1 time: 0.355253 Mar 05 20:55:27.176972 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1049/2032] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:55:26 2022] POST /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:55:27.213434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6814b5db-db24-4fa4-959c-11a5d7e146d9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed61acdc10>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:27.299892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f60b77c0-84d2-4baa-8bf3-0337745a64d8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:27.316466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f60b77c0-84d2-4baa-8bf3-0337745a64d8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:27.318266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f60b77c0-84d2-4baa-8bf3-0337745a64d8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:27.319435 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f60b77c0-84d2-4baa-8bf3-0337745a64d8 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1477 microversion: 2.25 time: 0.518414 Mar 05 20:55:27.325520 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6814b5db-db24-4fa4-959c-11a5d7e146d9 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.131266 Mar 05 20:55:27.329036 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1050/2033] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:27 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:27.339262 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 984/2034] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:26 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1477 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:27.341049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4af92dc7-3faa-4571-94e4-2a53813e41d2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:27.342907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4af92dc7-3faa-4571-94e4-2a53813e41d2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:27.360882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d493e462-9d2a-4488-bfe1-8edbb384f840 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:27.361570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d493e462-9d2a-4488-bfe1-8edbb384f840 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:27.367936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4af92dc7-3faa-4571-94e4-2a53813e41d2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:27.369999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4af92dc7-3faa-4571-94e4-2a53813e41d2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:27.373284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4af92dc7-3faa-4571-94e4-2a53813e41d2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:27.374388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4af92dc7-3faa-4571-94e4-2a53813e41d2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:27.385841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d493e462-9d2a-4488-bfe1-8edbb384f840 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:27.386626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d493e462-9d2a-4488-bfe1-8edbb384f840 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:27.388011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d493e462-9d2a-4488-bfe1-8edbb384f840 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:27.392366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d493e462-9d2a-4488-bfe1-8edbb384f840 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:27.815376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4af92dc7-3faa-4571-94e4-2a53813e41d2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:27.829490 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4af92dc7-3faa-4571-94e4-2a53813e41d2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1507 microversion: 2.1 time: 0.498739 Mar 05 20:55:27.833910 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1051/2035] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:27 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1507 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:27.867896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dceb2d9e-3b85-4be4-9fd0-6c84aa170124 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:27.869638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dceb2d9e-3b85-4be4-9fd0-6c84aa170124 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:27.888553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dceb2d9e-3b85-4be4-9fd0-6c84aa170124 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:27.889644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dceb2d9e-3b85-4be4-9fd0-6c84aa170124 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:27.893322 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dceb2d9e-3b85-4be4-9fd0-6c84aa170124 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:27.894072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dceb2d9e-3b85-4be4-9fd0-6c84aa170124 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:28.540736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dceb2d9e-3b85-4be4-9fd0-6c84aa170124 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:28.549010 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dceb2d9e-3b85-4be4-9fd0-6c84aa170124 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1323 microversion: 2.1 time: 0.713789 Mar 05 20:55:28.557382 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1052/2036] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:27 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1323 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:28.566839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0cb73d9-feba-4773-9536-92aee83f38e5 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c241670>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:28.650099 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0cb73d9-feba-4773-9536-92aee83f38e5 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.091242 Mar 05 20:55:28.651330 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1053/2037] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:28 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:28.854989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5dcd88cb-ee91-490c-bee0-34a120c75ddb tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:28.855981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5dcd88cb-ee91-490c-bee0-34a120c75ddb tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:28.879273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dcd88cb-ee91-490c-bee0-34a120c75ddb tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:28.879842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dcd88cb-ee91-490c-bee0-34a120c75ddb tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:28.886663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dcd88cb-ee91-490c-bee0-34a120c75ddb tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:28.887156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dcd88cb-ee91-490c-bee0-34a120c75ddb tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:29.046069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-d493e462-9d2a-4488-bfe1-8edbb384f840 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid f2611e78-13fc-4a02-87a7-af3f7c46ddc0 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:55:29.101782 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d493e462-9d2a-4488-bfe1-8edbb384f840 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1970 microversion: 2.25 time: 1.744916 Mar 05 20:55:29.104441 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 985/2038] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:27 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1970 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:55:29.126536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b69c3a82-a1f2-4754-a35f-401e33beebb7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:29.127261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b69c3a82-a1f2-4754-a35f-401e33beebb7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:29.138586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b69c3a82-a1f2-4754-a35f-401e33beebb7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:29.142204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b69c3a82-a1f2-4754-a35f-401e33beebb7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:29.150032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b69c3a82-a1f2-4754-a35f-401e33beebb7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:29.150692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b69c3a82-a1f2-4754-a35f-401e33beebb7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:29.218657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5dcd88cb-ee91-490c-bee0-34a120c75ddb tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:29.232493 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5dcd88cb-ee91-490c-bee0-34a120c75ddb tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1507 microversion: 2.1 time: 0.384922 Mar 05 20:55:29.238113 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1054/2039] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:28 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:29.601108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1449088504", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:29.681431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] validate_networks() for [('c6309286-f935-47ca-ba3b-63029aaed949', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:55:29.689307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-b69c3a82-a1f2-4754-a35f-401e33beebb7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid f2611e78-13fc-4a02-87a7-af3f7c46ddc0 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:55:29.722049 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b69c3a82-a1f2-4754-a35f-401e33beebb7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1970 microversion: 2.25 time: 0.599339 Mar 05 20:55:29.723228 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 986/2040] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:29 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1970 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:29.737996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c7c62d3-7027-4e0e-9a81-20cd69e9fa5c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:29.739105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c7c62d3-7027-4e0e-9a81-20cd69e9fa5c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:29.756647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c7c62d3-7027-4e0e-9a81-20cd69e9fa5c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:29.757028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c7c62d3-7027-4e0e-9a81-20cd69e9fa5c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:29.760249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c7c62d3-7027-4e0e-9a81-20cd69e9fa5c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:29.760886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c7c62d3-7027-4e0e-9a81-20cd69e9fa5c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:30.077888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8c7c62d3-7027-4e0e-9a81-20cd69e9fa5c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:30.094116 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8c7c62d3-7027-4e0e-9a81-20cd69e9fa5c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1323 microversion: 2.1 time: 0.367340 Mar 05 20:55:30.111839 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 987/2041] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:29 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1323 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:30.123059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c15393dc-9914-4b47-8fa8-07121474a434 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c27c9d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:30.223598 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c15393dc-9914-4b47-8fa8-07121474a434 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.107615 Mar 05 20:55:30.224696 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 988/2042] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:30 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:30.242948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-891075ce-e3cf-42b4-bc2b-3c2157a8417e tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:30.252311 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:55:30.252311 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:55:30.265672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-891075ce-e3cf-42b4-bc2b-3c2157a8417e tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:30.267582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-891075ce-e3cf-42b4-bc2b-3c2157a8417e tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:30.272015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-891075ce-e3cf-42b4-bc2b-3c2157a8417e tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:30.276318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-891075ce-e3cf-42b4-bc2b-3c2157a8417e tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:30.377599 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-891075ce-e3cf-42b4-bc2b-3c2157a8417e tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.151722 Mar 05 20:55:30.389479 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 989/2043] 10.222.0.15 () {60 vars in 1216 bytes} [Sat Mar 5 20:55:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:55:30.392770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f3415287-1b25-4b0d-a274-488657a0226d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:30.393424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f3415287-1b25-4b0d-a274-488657a0226d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:30.423016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3415287-1b25-4b0d-a274-488657a0226d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:30.424025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3415287-1b25-4b0d-a274-488657a0226d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:30.425939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3415287-1b25-4b0d-a274-488657a0226d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:30.426392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3415287-1b25-4b0d-a274-488657a0226d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:30.696851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f3415287-1b25-4b0d-a274-488657a0226d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:30.708125 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f3415287-1b25-4b0d-a274-488657a0226d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1511 microversion: 2.1 time: 0.319096 Mar 05 20:55:30.728341 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 990/2044] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:30 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1511 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:30.735438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3af443ba-e30f-48be-a78a-b8d316790ebd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:30.738654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3af443ba-e30f-48be-a78a-b8d316790ebd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:30.752322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3af443ba-e30f-48be-a78a-b8d316790ebd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:30.753553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3af443ba-e30f-48be-a78a-b8d316790ebd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:30.755910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3af443ba-e30f-48be-a78a-b8d316790ebd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:30.761140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3af443ba-e30f-48be-a78a-b8d316790ebd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:30.829353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-3af443ba-e30f-48be-a78a-b8d316790ebd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'flavor' on Instance uuid f2611e78-13fc-4a02-87a7-af3f7c46ddc0 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:55:30.857267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3af443ba-e30f-48be-a78a-b8d316790ebd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Going to try to live migrate instance to nch1-master-1 {{(pid=141478) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 05 20:55:30.869205 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:55:30.869706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:55:30.870119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:55:30.870570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:55:30.870991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:55:30.884752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:30.888272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:30.893093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:30.895304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:30.981143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Getting quotas for project fc76a60f3c6e4f2ea69c0445ba45e4a5. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:55:30.998403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Getting quotas for user 7d8fef08c46741448390a1ab640962eb and project fc76a60f3c6e4f2ea69c0445ba45e4a5. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:55:31.047397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:55:31.063858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:55:31.220025 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-328e50d0-a1c9-4ee0-812e-1d613403ff0c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.851706 Mar 05 20:55:31.221713 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1055/2045] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:55:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 20:55:31.867213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1689181523", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "72f55423-ea6d-4438-a149-d5df19f9ecdd"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:31.994807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] validate_networks() for [('72f55423-ea6d-4438-a149-d5df19f9ecdd', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:55:33.227529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:55:33.228498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:55:33.228498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:55:33.228836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:55:33.229139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:55:33.252235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:33.252751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:33.253824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:33.254614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:33.344478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:55:33.361569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for user e8b67d8bbe9a44898a889826e12ffb0b and project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:55:33.415120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:55:33.417811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:55:33.535314 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2bbcebd2-ee06-45da-ac93-c214d2b9639b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.309910 Mar 05 20:55:33.536626 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1056/2046] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:55:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:55:33.542206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b0617208-ae22-4375-bd98-43addeda60be tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:33.558850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b0617208-ae22-4375-bd98-43addeda60be tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:33.560847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.compute.servers [None req-b0617208-ae22-4375-bd98-43addeda60be tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Removing options 'limit' from query {{(pid=141479) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 05 20:55:33.563738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b0617208-ae22-4375-bd98-43addeda60be tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:33.564960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0617208-ae22-4375-bd98-43addeda60be tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:33.567550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0617208-ae22-4375-bd98-43addeda60be tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:33.571127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0617208-ae22-4375-bd98-43addeda60be tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:33.571582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0617208-ae22-4375-bd98-43addeda60be tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:33.573071 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b0617208-ae22-4375-bd98-43addeda60be tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.035318 Mar 05 20:55:33.573653 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1057/2047] 10.222.0.15 () {58 vars in 1139 bytes} [Sat Mar 5 20:55:33 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:55:33.595735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2fce570a-b59e-4507-9e7a-7eb30d34e3e1 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:33.598611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2fce570a-b59e-4507-9e7a-7eb30d34e3e1 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:33.616732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2fce570a-b59e-4507-9e7a-7eb30d34e3e1 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:33.619817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2fce570a-b59e-4507-9e7a-7eb30d34e3e1 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:33.623460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2fce570a-b59e-4507-9e7a-7eb30d34e3e1 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:33.624188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2fce570a-b59e-4507-9e7a-7eb30d34e3e1 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:33.672470 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3af443ba-e30f-48be-a78a-b8d316790ebd tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0/action" status: 202 len: 0 microversion: 2.25 time: 2.942554 Mar 05 20:55:33.678299 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 991/2048] 10.222.0.15 () {62 vars in 1318 bytes} [Sat Mar 5 20:55:30 2022] POST /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0/action => generated 0 bytes in 2949 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:55:33.685514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-95ed4f7a-35d2-4939-92f4-495e341d7e25 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:33.686699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-95ed4f7a-35d2-4939-92f4-495e341d7e25 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:33.701283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95ed4f7a-35d2-4939-92f4-495e341d7e25 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:33.702844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95ed4f7a-35d2-4939-92f4-495e341d7e25 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:33.704322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95ed4f7a-35d2-4939-92f4-495e341d7e25 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:33.705116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95ed4f7a-35d2-4939-92f4-495e341d7e25 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:33.840104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-95ed4f7a-35d2-4939-92f4-495e341d7e25 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:33.854294 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-95ed4f7a-35d2-4939-92f4-495e341d7e25 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1272 microversion: 2.1 time: 0.171511 Mar 05 20:55:33.856729 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 992/2049] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:33 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:33.875619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-286875bf-2039-4187-9f40-ac7419491706 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c207d30>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:34.027332 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-286875bf-2039-4187-9f40-ac7419491706 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.166562 Mar 05 20:55:34.036425 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 993/2050] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:33 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:34.063280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-4a01a032-543b-4839-8fd8-1d42c805c374 req-6f96b6b3-3990-445d-8490-1bf8f1e89e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877cfd7f-cc15-4e73-87fd-65d5e176d0cd", "name": "network-vif-plugged", "status": "completed", "tag": "85a2296d-3794-434e-91df-6c4e380c3245"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:34.088872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4a01a032-543b-4839-8fd8-1d42c805c374 req-6f96b6b3-3990-445d-8490-1bf8f1e89e81 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:34.089675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4a01a032-543b-4839-8fd8-1d42c805c374 req-6f96b6b3-3990-445d-8490-1bf8f1e89e81 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:34.130391 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-4a01a032-543b-4839-8fd8-1d42c805c374 req-6f96b6b3-3990-445d-8490-1bf8f1e89e81 service nova] Creating event network-vif-plugged:85a2296d-3794-434e-91df-6c4e380c3245 for instance 877cfd7f-cc15-4e73-87fd-65d5e176d0cd on nch2-master-1 Mar 05 20:55:34.146339 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-4a01a032-543b-4839-8fd8-1d42c805c374 req-6f96b6b3-3990-445d-8490-1bf8f1e89e81 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103314 Mar 05 20:55:34.151291 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 994/2051] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:34.176195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-99343ce6-285a-40a6-8407-a4b1bce86fde tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:34.180648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-99343ce6-285a-40a6-8407-a4b1bce86fde tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:34.183182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2fce570a-b59e-4507-9e7a-7eb30d34e3e1 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:34.194673 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2fce570a-b59e-4507-9e7a-7eb30d34e3e1 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1323 microversion: 2.1 time: 0.611324 Mar 05 20:55:34.202105 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1058/2052] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:33 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1323 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:34.214891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-efacf4d1-202c-4957-8c7f-3bacdd8de741 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:34.223443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-efacf4d1-202c-4957-8c7f-3bacdd8de741 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:34.247531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efacf4d1-202c-4957-8c7f-3bacdd8de741 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:34.248271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efacf4d1-202c-4957-8c7f-3bacdd8de741 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:34.256352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efacf4d1-202c-4957-8c7f-3bacdd8de741 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:34.261820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efacf4d1-202c-4957-8c7f-3bacdd8de741 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:34.351546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-99343ce6-285a-40a6-8407-a4b1bce86fde tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:34.359632 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-99343ce6-285a-40a6-8407-a4b1bce86fde tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 200 len: 1215 microversion: 2.1 time: 0.205830 Mar 05 20:55:34.360375 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 995/2053] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:34 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:34.380891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c674ae80-0007-400c-a655-a2ab7d84e153 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:34.381782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c674ae80-0007-400c-a655-a2ab7d84e153 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:34.403943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c674ae80-0007-400c-a655-a2ab7d84e153 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:34.417209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c674ae80-0007-400c-a655-a2ab7d84e153 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:34.421037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c674ae80-0007-400c-a655-a2ab7d84e153 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:34.422447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c674ae80-0007-400c-a655-a2ab7d84e153 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:35.106213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-efacf4d1-202c-4957-8c7f-3bacdd8de741 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:35.119184 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-efacf4d1-202c-4957-8c7f-3bacdd8de741 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1511 microversion: 2.1 time: 0.915872 Mar 05 20:55:35.120400 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1059/2054] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:34 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1511 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:35.125808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bb19a476-24a6-47c0-8cf8-3994c7b8c0e2 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:35.127318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bb19a476-24a6-47c0-8cf8-3994c7b8c0e2 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:35.137036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb19a476-24a6-47c0-8cf8-3994c7b8c0e2 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:35.138083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb19a476-24a6-47c0-8cf8-3994c7b8c0e2 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:35.139795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb19a476-24a6-47c0-8cf8-3994c7b8c0e2 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:35.140698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb19a476-24a6-47c0-8cf8-3994c7b8c0e2 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:35.286003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb19a476-24a6-47c0-8cf8-3994c7b8c0e2 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:35.299110 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bb19a476-24a6-47c0-8cf8-3994c7b8c0e2 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1272 microversion: 2.1 time: 0.177274 Mar 05 20:55:35.300364 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1060/2055] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:35 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:35.307948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-55b76a70-1d15-4b70-8fe5-36500d15e00c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c290f70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:35.417377 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-55b76a70-1d15-4b70-8fe5-36500d15e00c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.114903 Mar 05 20:55:35.419590 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1061/2056] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:35 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:35.425751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91fbdb58-c00e-42fe-8853-50be478665de tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:35.426774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91fbdb58-c00e-42fe-8853-50be478665de tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: f4c65952-c3d5-4826-9fe6-48c5f0ec86a7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:35.443752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91fbdb58-c00e-42fe-8853-50be478665de tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:35.444456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91fbdb58-c00e-42fe-8853-50be478665de tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:35.449511 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91fbdb58-c00e-42fe-8853-50be478665de tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:35.451390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91fbdb58-c00e-42fe-8853-50be478665de tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:35.554851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c674ae80-0007-400c-a655-a2ab7d84e153 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:35.587290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c674ae80-0007-400c-a655-a2ab7d84e153 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:35.595844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c674ae80-0007-400c-a655-a2ab7d84e153 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:35.612669 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c674ae80-0007-400c-a655-a2ab7d84e153 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1487 microversion: 2.25 time: 1.249920 Mar 05 20:55:35.667983 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 996/2057] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:34 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1487 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:35.697089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-48c0a59a-4a45-4c2e-b4b6-530ea314ef7b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:35.700890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-48c0a59a-4a45-4c2e-b4b6-530ea314ef7b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:35.723498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-48c0a59a-4a45-4c2e-b4b6-530ea314ef7b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:35.740289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-48c0a59a-4a45-4c2e-b4b6-530ea314ef7b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:35.744309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-48c0a59a-4a45-4c2e-b4b6-530ea314ef7b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:35.745010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-48c0a59a-4a45-4c2e-b4b6-530ea314ef7b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:36.334760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-48c0a59a-4a45-4c2e-b4b6-530ea314ef7b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:36.349700 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-48c0a59a-4a45-4c2e-b4b6-530ea314ef7b tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1323 microversion: 2.1 time: 0.677821 Mar 05 20:55:36.351298 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 997/2058] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:35 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1323 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:36.373113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3c87673c-5d42-4d7b-ac53-41f50a1a4ab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:36.376954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3c87673c-5d42-4d7b-ac53-41f50a1a4ab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:36.420292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c87673c-5d42-4d7b-ac53-41f50a1a4ab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:36.425245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c87673c-5d42-4d7b-ac53-41f50a1a4ab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:36.432126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c87673c-5d42-4d7b-ac53-41f50a1a4ab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:36.433116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c87673c-5d42-4d7b-ac53-41f50a1a4ab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:36.451301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-91fbdb58-c00e-42fe-8853-50be478665de tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:36.504731 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91fbdb58-c00e-42fe-8853-50be478665de tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7" status: 200 len: 1510 microversion: 2.1 time: 1.080927 Mar 05 20:55:36.528465 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1062/2059] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:35 2022] GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7 => generated 1510 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:36.543182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ea4940e1-d8b4-4610-8f84-d708f513b19e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:36.547897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ea4940e1-d8b4-4610-8f84-d708f513b19e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:36.559148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea4940e1-d8b4-4610-8f84-d708f513b19e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:36.567744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea4940e1-d8b4-4610-8f84-d708f513b19e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:36.569659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea4940e1-d8b4-4610-8f84-d708f513b19e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:36.571652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea4940e1-d8b4-4610-8f84-d708f513b19e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:36.769992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3c87673c-5d42-4d7b-ac53-41f50a1a4ab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:36.800745 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3c87673c-5d42-4d7b-ac53-41f50a1a4ab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 200 len: 1273 microversion: 2.1 time: 0.443437 Mar 05 20:55:36.819758 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 998/2060] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:36 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 1273 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:36.865660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-469d71cd-4b0c-4669-9641-2549dada0146 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c1f5a60>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:36.969559 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-469d71cd-4b0c-4669-9641-2549dada0146 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.144853 Mar 05 20:55:36.975310 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 999/2061] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:36 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:36.981912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-02ae747f-c5ff-4418-8d00-4a1b0e203686 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:36.982885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-02ae747f-c5ff-4418-8d00-4a1b0e203686 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:36.994042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-02ae747f-c5ff-4418-8d00-4a1b0e203686 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:36.995162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-02ae747f-c5ff-4418-8d00-4a1b0e203686 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:36.996606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-02ae747f-c5ff-4418-8d00-4a1b0e203686 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:36.997311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-02ae747f-c5ff-4418-8d00-4a1b0e203686 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:37.141498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ea4940e1-d8b4-4610-8f84-d708f513b19e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:37.152346 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ea4940e1-d8b4-4610-8f84-d708f513b19e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1314 microversion: 2.1 time: 0.619732 Mar 05 20:55:37.158163 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1063/2062] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:36 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:37.168615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7444128b-6d3d-4a56-a38c-8914959cbdcc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:37.170831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7444128b-6d3d-4a56-a38c-8914959cbdcc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:37.183590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7444128b-6d3d-4a56-a38c-8914959cbdcc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:37.185456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7444128b-6d3d-4a56-a38c-8914959cbdcc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:37.188393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7444128b-6d3d-4a56-a38c-8914959cbdcc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:37.190831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7444128b-6d3d-4a56-a38c-8914959cbdcc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:37.529325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7444128b-6d3d-4a56-a38c-8914959cbdcc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:37.545015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7444128b-6d3d-4a56-a38c-8914959cbdcc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:37.548702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7444128b-6d3d-4a56-a38c-8914959cbdcc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:37.555637 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7444128b-6d3d-4a56-a38c-8914959cbdcc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1487 microversion: 2.25 time: 0.394990 Mar 05 20:55:37.559939 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1064/2063] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:37 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1487 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:37.577150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-28542a9b-5f4c-477f-887f-547a7c75660f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:37.578435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-28542a9b-5f4c-477f-887f-547a7c75660f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:37.591770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28542a9b-5f4c-477f-887f-547a7c75660f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:37.593661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28542a9b-5f4c-477f-887f-547a7c75660f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:37.596799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28542a9b-5f4c-477f-887f-547a7c75660f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:37.600017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28542a9b-5f4c-477f-887f-547a7c75660f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:37.940526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-02ae747f-c5ff-4418-8d00-4a1b0e203686 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:37.956130 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-02ae747f-c5ff-4418-8d00-4a1b0e203686 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1511 microversion: 2.1 time: 0.976492 Mar 05 20:55:37.957356 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1000/2064] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:36 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1511 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:38.017342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-86a77e73-f858-43d5-a050-c4d0e41a79d3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:38.019464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-86a77e73-f858-43d5-a050-c4d0e41a79d3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:38.033963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86a77e73-f858-43d5-a050-c4d0e41a79d3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:38.034875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86a77e73-f858-43d5-a050-c4d0e41a79d3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:38.037823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86a77e73-f858-43d5-a050-c4d0e41a79d3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:38.039851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86a77e73-f858-43d5-a050-c4d0e41a79d3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:38.121560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-28542a9b-5f4c-477f-887f-547a7c75660f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:38.138773 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-28542a9b-5f4c-477f-887f-547a7c75660f tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1473 microversion: 2.1 time: 0.575257 Mar 05 20:55:38.143995 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1065/2065] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:37 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1473 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:38.178818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eb0e9e13-3879-4961-a905-b931c0812697 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:38.187775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eb0e9e13-3879-4961-a905-b931c0812697 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:38.188481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eb0e9e13-3879-4961-a905-b931c0812697 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:38.444486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb0e9e13-3879-4961-a905-b931c0812697 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:38.446303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb0e9e13-3879-4961-a905-b931c0812697 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:38.447387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb0e9e13-3879-4961-a905-b931c0812697 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:38.448235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb0e9e13-3879-4961-a905-b931c0812697 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:38.653984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-86a77e73-f858-43d5-a050-c4d0e41a79d3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:38.662113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-eb0e9e13-3879-4961-a905-b931c0812697 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:38.666376 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-86a77e73-f858-43d5-a050-c4d0e41a79d3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 200 len: 1315 microversion: 2.1 time: 0.695399 Mar 05 20:55:38.668268 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1001/2066] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:37 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:38.683902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a56ce2e0-f1e3-4f6b-ba01-b1861eddcc3b tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c7e58b0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:38.775240 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a56ce2e0-f1e3-4f6b-ba01-b1861eddcc3b tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.101107 Mar 05 20:55:38.776296 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1002/2067] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:38 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:38.798362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-385bbe66-04fc-4c3c-bd62-f8e89d5ef929 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:38.801743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-385bbe66-04fc-4c3c-bd62-f8e89d5ef929 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:38.808009 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eb0e9e13-3879-4961-a905-b931c0812697 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 345 microversion: 2.1 time: 0.647962 Mar 05 20:55:38.809311 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1066/2068] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Mar 5 20:55:38 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 345 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:38.818751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0fdf2c7a-0dc1-4383-b1c9-b00ce8ae2283 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:38.820426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0fdf2c7a-0dc1-4383-b1c9-b00ce8ae2283 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:38.831421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fdf2c7a-0dc1-4383-b1c9-b00ce8ae2283 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:38.832890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fdf2c7a-0dc1-4383-b1c9-b00ce8ae2283 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:38.834175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fdf2c7a-0dc1-4383-b1c9-b00ce8ae2283 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:38.835263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fdf2c7a-0dc1-4383-b1c9-b00ce8ae2283 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:38.837835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-385bbe66-04fc-4c3c-bd62-f8e89d5ef929 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:38.838356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-385bbe66-04fc-4c3c-bd62-f8e89d5ef929 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:38.840130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-385bbe66-04fc-4c3c-bd62-f8e89d5ef929 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:38.840587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-385bbe66-04fc-4c3c-bd62-f8e89d5ef929 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:38.928193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-385bbe66-04fc-4c3c-bd62-f8e89d5ef929 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:38.939467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-385bbe66-04fc-4c3c-bd62-f8e89d5ef929 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:38.941582 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-385bbe66-04fc-4c3c-bd62-f8e89d5ef929 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.157987 Mar 05 20:55:38.942356 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1003/2069] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:55:38 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd/diagnostics => generated 117 bytes in 163 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:38.946987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d58e4503-3f2c-4101-bc0a-e1e2271817af req-00b119de-ef9d-4b3b-ad7a-3dadcc61cb30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf09b77b-5755-4ebd-bbcd-c47541a58af5", "tag": "c02ff863-577b-4f41-9058-0e457c4739d0"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:38.971204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d58e4503-3f2c-4101-bc0a-e1e2271817af req-00b119de-ef9d-4b3b-ad7a-3dadcc61cb30 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:38.973593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d58e4503-3f2c-4101-bc0a-e1e2271817af req-00b119de-ef9d-4b3b-ad7a-3dadcc61cb30 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:39.005208 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d58e4503-3f2c-4101-bc0a-e1e2271817af req-00b119de-ef9d-4b3b-ad7a-3dadcc61cb30 service nova] Creating event network-changed:c02ff863-577b-4f41-9058-0e457c4739d0 for instance bf09b77b-5755-4ebd-bbcd-c47541a58af5 on nch1-master-1 Mar 05 20:55:39.012359 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d58e4503-3f2c-4101-bc0a-e1e2271817af req-00b119de-ef9d-4b3b-ad7a-3dadcc61cb30 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068677 Mar 05 20:55:39.013645 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1004/2070] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:39.021796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-919c51b4-0ba3-48b4-a0eb-cb58719d453d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:39.023751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-919c51b4-0ba3-48b4-a0eb-cb58719d453d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:39.032293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-919c51b4-0ba3-48b4-a0eb-cb58719d453d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:39.033017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-919c51b4-0ba3-48b4-a0eb-cb58719d453d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:39.033831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-919c51b4-0ba3-48b4-a0eb-cb58719d453d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:39.034275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-919c51b4-0ba3-48b4-a0eb-cb58719d453d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:39.211432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0fdf2c7a-0dc1-4383-b1c9-b00ce8ae2283 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:39.228428 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0fdf2c7a-0dc1-4383-b1c9-b00ce8ae2283 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1314 microversion: 2.1 time: 0.417523 Mar 05 20:55:39.229319 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1067/2071] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:38 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:39.241435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-36408ddf-1640-4e4f-895c-89f9913cc43b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:39.244239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-36408ddf-1640-4e4f-895c-89f9913cc43b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:39.258558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36408ddf-1640-4e4f-895c-89f9913cc43b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:39.259245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36408ddf-1640-4e4f-895c-89f9913cc43b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:39.263015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36408ddf-1640-4e4f-895c-89f9913cc43b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:39.263478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36408ddf-1640-4e4f-895c-89f9913cc43b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:39.501521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-919c51b4-0ba3-48b4-a0eb-cb58719d453d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:39.516656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-919c51b4-0ba3-48b4-a0eb-cb58719d453d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:39.520010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-919c51b4-0ba3-48b4-a0eb-cb58719d453d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:39.525760 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-919c51b4-0ba3-48b4-a0eb-cb58719d453d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1487 microversion: 2.25 time: 0.507915 Mar 05 20:55:39.540149 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1005/2072] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:39 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1487 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:39.556413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6c76ae57-6fa5-498a-b4f9-bde6d6217c6c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:39.562626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6c76ae57-6fa5-498a-b4f9-bde6d6217c6c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:39.572734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-36408ddf-1640-4e4f-895c-89f9913cc43b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:39.577986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c76ae57-6fa5-498a-b4f9-bde6d6217c6c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:39.579581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c76ae57-6fa5-498a-b4f9-bde6d6217c6c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:39.582055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c76ae57-6fa5-498a-b4f9-bde6d6217c6c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:39.584231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c76ae57-6fa5-498a-b4f9-bde6d6217c6c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:39.586730 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-36408ddf-1640-4e4f-895c-89f9913cc43b tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1511 microversion: 2.1 time: 0.354298 Mar 05 20:55:39.599893 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1068/2073] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:39 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:39.623489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a3278906-572b-4fff-b3c0-d189edffbae9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:39.626573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a3278906-572b-4fff-b3c0-d189edffbae9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: f4c65952-c3d5-4826-9fe6-48c5f0ec86a7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:39.646810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3278906-572b-4fff-b3c0-d189edffbae9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:39.649783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3278906-572b-4fff-b3c0-d189edffbae9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:39.654185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3278906-572b-4fff-b3c0-d189edffbae9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:39.654850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3278906-572b-4fff-b3c0-d189edffbae9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:39.665654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6c76ae57-6fa5-498a-b4f9-bde6d6217c6c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:55:39.950122 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6c76ae57-6fa5-498a-b4f9-bde6d6217c6c tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "DELETE /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 204 len: 0 microversion: 2.1 time: 0.406814 Mar 05 20:55:39.950928 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1006/2074] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:55:39 2022] DELETE /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:55:39.957866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-95458910-db70-484a-bc41-445dc467c646 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:39.958575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-95458910-db70-484a-bc41-445dc467c646 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:39.975168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95458910-db70-484a-bc41-445dc467c646 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:39.975880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95458910-db70-484a-bc41-445dc467c646 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:39.978245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95458910-db70-484a-bc41-445dc467c646 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:39.978870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95458910-db70-484a-bc41-445dc467c646 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:40.200665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a3278906-572b-4fff-b3c0-d189edffbae9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:40.207754 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a3278906-572b-4fff-b3c0-d189edffbae9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7" status: 200 len: 1510 microversion: 2.1 time: 0.604125 Mar 05 20:55:40.210732 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1069/2075] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:39 2022] GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7 => generated 1510 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:40.215560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2dd2c871-63dd-4e43-a261-be67b9c145a7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c221820>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:40.300658 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2dd2c871-63dd-4e43-a261-be67b9c145a7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.088849 Mar 05 20:55:40.301242 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1070/2076] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:40 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:40.323791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-95458910-db70-484a-bc41-445dc467c646 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:40.324052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b08aa3c3-21ab-4c7c-b9c6-876ada2995df tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:40.324533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b08aa3c3-21ab-4c7c-b9c6-876ada2995df tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:40.332320 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-95458910-db70-484a-bc41-445dc467c646 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 200 len: 1315 microversion: 2.1 time: 0.380420 Mar 05 20:55:40.345862 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1007/2077] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:39 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:40.346781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b08aa3c3-21ab-4c7c-b9c6-876ada2995df tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:40.347243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b08aa3c3-21ab-4c7c-b9c6-876ada2995df tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:40.353177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b08aa3c3-21ab-4c7c-b9c6-876ada2995df tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:40.354292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b08aa3c3-21ab-4c7c-b9c6-876ada2995df tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:40.357311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-9d92b78f-6777-4988-b0d7-db2360d3c083 req-eac94ca8-8d9c-4904-ae3c-719a8662aa88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b49a93-adf5-4a9e-8359-60d106b3433f", "tag": "2ca65ea5-4d5f-472b-b108-55db231b87c0"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:40.382504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9d92b78f-6777-4988-b0d7-db2360d3c083 req-eac94ca8-8d9c-4904-ae3c-719a8662aa88 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:40.383356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9d92b78f-6777-4988-b0d7-db2360d3c083 req-eac94ca8-8d9c-4904-ae3c-719a8662aa88 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:40.408615 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-9d92b78f-6777-4988-b0d7-db2360d3c083 req-eac94ca8-8d9c-4904-ae3c-719a8662aa88 service nova] Creating event network-changed:2ca65ea5-4d5f-472b-b108-55db231b87c0 for instance 28b49a93-adf5-4a9e-8359-60d106b3433f on nch1-master-1 Mar 05 20:55:40.415963 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-9d92b78f-6777-4988-b0d7-db2360d3c083 req-eac94ca8-8d9c-4904-ae3c-719a8662aa88 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067022 Mar 05 20:55:40.416566 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1008/2078] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:40.424271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-84aebfcd-de0d-438f-ad2e-f3b924b21ba6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:40.425314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-84aebfcd-de0d-438f-ad2e-f3b924b21ba6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:40.433237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84aebfcd-de0d-438f-ad2e-f3b924b21ba6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:40.434058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84aebfcd-de0d-438f-ad2e-f3b924b21ba6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:40.435234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84aebfcd-de0d-438f-ad2e-f3b924b21ba6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:40.435853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84aebfcd-de0d-438f-ad2e-f3b924b21ba6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:40.740325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-84aebfcd-de0d-438f-ad2e-f3b924b21ba6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:40.758557 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-84aebfcd-de0d-438f-ad2e-f3b924b21ba6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1511 microversion: 2.1 time: 0.340069 Mar 05 20:55:40.776810 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1009/2079] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:40 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1511 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:40.788099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0cd37aa4-533a-414e-838d-66cbc07c0906 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:40.789604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0cd37aa4-533a-414e-838d-66cbc07c0906 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:40.805379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0cd37aa4-533a-414e-838d-66cbc07c0906 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:40.806925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0cd37aa4-533a-414e-838d-66cbc07c0906 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:40.811414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0cd37aa4-533a-414e-838d-66cbc07c0906 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:40.812763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0cd37aa4-533a-414e-838d-66cbc07c0906 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:40.857015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b08aa3c3-21ab-4c7c-b9c6-876ada2995df tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:40.872830 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b08aa3c3-21ab-4c7c-b9c6-876ada2995df tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1479 microversion: 2.1 time: 0.569532 Mar 05 20:55:40.877665 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1071/2080] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:40 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1479 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:40.885371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cfc0ee01-b1ec-4e16-b5a0-6cae9943c7f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:40.886138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cfc0ee01-b1ec-4e16-b5a0-6cae9943c7f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:40.906229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfc0ee01-b1ec-4e16-b5a0-6cae9943c7f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:40.907438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfc0ee01-b1ec-4e16-b5a0-6cae9943c7f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:40.908872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfc0ee01-b1ec-4e16-b5a0-6cae9943c7f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:40.910353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfc0ee01-b1ec-4e16-b5a0-6cae9943c7f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:41.294629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0cd37aa4-533a-414e-838d-66cbc07c0906 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:41.307019 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0cd37aa4-533a-414e-838d-66cbc07c0906 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1314 microversion: 2.1 time: 0.528983 Mar 05 20:55:41.313309 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1010/2081] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:40 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:41.331171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1f76d5ff-8e91-4cd3-9f5c-e994677a24ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:41.347922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1f76d5ff-8e91-4cd3-9f5c-e994677a24ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:41.353698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1f76d5ff-8e91-4cd3-9f5c-e994677a24ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:41.361943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cfc0ee01-b1ec-4e16-b5a0-6cae9943c7f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:41.370576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cfc0ee01-b1ec-4e16-b5a0-6cae9943c7f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:41.374484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f76d5ff-8e91-4cd3-9f5c-e994677a24ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:41.374985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f76d5ff-8e91-4cd3-9f5c-e994677a24ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:41.376101 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f76d5ff-8e91-4cd3-9f5c-e994677a24ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:41.376852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f76d5ff-8e91-4cd3-9f5c-e994677a24ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:41.395915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cfc0ee01-b1ec-4e16-b5a0-6cae9943c7f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:41.401218 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cfc0ee01-b1ec-4e16-b5a0-6cae9943c7f0 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1487 microversion: 2.25 time: 0.521580 Mar 05 20:55:41.406312 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1072/2082] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:40 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1487 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:41.418274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-87b77a08-edfd-40aa-bc39-778ea7191e0a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed61ada3a0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:41.468408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-1f76d5ff-8e91-4cd3-9f5c-e994677a24ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:41.504966 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-87b77a08-edfd-40aa-bc39-778ea7191e0a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.094092 Mar 05 20:55:41.512887 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1073/2083] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:41 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:41.524062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-094df536-d052-4cf1-ac2b-404bde54c3e7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:41.530808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-094df536-d052-4cf1-ac2b-404bde54c3e7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:41.544874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-094df536-d052-4cf1-ac2b-404bde54c3e7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:41.545853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-094df536-d052-4cf1-ac2b-404bde54c3e7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:41.552376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-094df536-d052-4cf1-ac2b-404bde54c3e7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:41.553239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-094df536-d052-4cf1-ac2b-404bde54c3e7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:41.562287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1f76d5ff-8e91-4cd3-9f5c-e994677a24ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:41.587626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f76d5ff-8e91-4cd3-9f5c-e994677a24ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:41.592256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f76d5ff-8e91-4cd3-9f5c-e994677a24ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:42.039782 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1f76d5ff-8e91-4cd3-9f5c-e994677a24ce tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.721127 Mar 05 20:55:42.040883 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1011/2084] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:55:41 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:42.045917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b600c117-502c-448c-a17d-712cdc6b8ae7 req-4096530e-1488-4636-8839-c65bd7aaf51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2611e78-13fc-4a02-87a7-af3f7c46ddc0", "name": "network-vif-unplugged", "status": "completed", "tag": "449a95d6-0b0c-41dc-8bf1-563531604d17"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:42.074618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b600c117-502c-448c-a17d-712cdc6b8ae7 req-4096530e-1488-4636-8839-c65bd7aaf51d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:42.076269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b600c117-502c-448c-a17d-712cdc6b8ae7 req-4096530e-1488-4636-8839-c65bd7aaf51d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:42.111365 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-b600c117-502c-448c-a17d-712cdc6b8ae7 req-4096530e-1488-4636-8839-c65bd7aaf51d service nova] Creating event network-vif-unplugged:449a95d6-0b0c-41dc-8bf1-563531604d17 for instance f2611e78-13fc-4a02-87a7-af3f7c46ddc0 on nch2-master-1 Mar 05 20:55:42.129656 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b600c117-502c-448c-a17d-712cdc6b8ae7 req-4096530e-1488-4636-8839-c65bd7aaf51d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087317 Mar 05 20:55:42.131698 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1012/2085] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:42.146448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-093af232-835d-40cc-9a39-6a06d2a0a4bc tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:42.147155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-093af232-835d-40cc-9a39-6a06d2a0a4bc tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:42.172697 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-093af232-835d-40cc-9a39-6a06d2a0a4bc tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:42.173649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-093af232-835d-40cc-9a39-6a06d2a0a4bc tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:42.175500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-093af232-835d-40cc-9a39-6a06d2a0a4bc tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:42.178813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-093af232-835d-40cc-9a39-6a06d2a0a4bc tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:42.394201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-094df536-d052-4cf1-ac2b-404bde54c3e7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:42.404253 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-094df536-d052-4cf1-ac2b-404bde54c3e7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 200 len: 1315 microversion: 2.1 time: 0.886745 Mar 05 20:55:42.405420 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1074/2086] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:41 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 1315 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:42.410797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a3497c43-ece7-4d70-a56c-e4b5df0d7309 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:42.416015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a3497c43-ece7-4d70-a56c-e4b5df0d7309 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:42.417045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a3497c43-ece7-4d70-a56c-e4b5df0d7309 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:42.419060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-093af232-835d-40cc-9a39-6a06d2a0a4bc tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:42.429012 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-093af232-835d-40cc-9a39-6a06d2a0a4bc tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1479 microversion: 2.1 time: 0.292032 Mar 05 20:55:42.440999 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1013/2087] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:42 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1479 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:42.440999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cccdc147-0336-4b77-b598-cfa9e1b2d8c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:42.440999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cccdc147-0336-4b77-b598-cfa9e1b2d8c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:42.455458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cccdc147-0336-4b77-b598-cfa9e1b2d8c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:42.462197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cccdc147-0336-4b77-b598-cfa9e1b2d8c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:42.463263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cccdc147-0336-4b77-b598-cfa9e1b2d8c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:42.463819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cccdc147-0336-4b77-b598-cfa9e1b2d8c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:42.717327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cccdc147-0336-4b77-b598-cfa9e1b2d8c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:42.730755 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cccdc147-0336-4b77-b598-cfa9e1b2d8c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1314 microversion: 2.1 time: 0.297056 Mar 05 20:55:42.731879 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1014/2088] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:42 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:42.737838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-27ff25d6-507d-4b4f-ba66-63286d82c0dc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:42.738776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-27ff25d6-507d-4b4f-ba66-63286d82c0dc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:42.749823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27ff25d6-507d-4b4f-ba66-63286d82c0dc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:42.750692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27ff25d6-507d-4b4f-ba66-63286d82c0dc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:42.751736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27ff25d6-507d-4b4f-ba66-63286d82c0dc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:42.752346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27ff25d6-507d-4b4f-ba66-63286d82c0dc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:42.783085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3497c43-ece7-4d70-a56c-e4b5df0d7309 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:42.783733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3497c43-ece7-4d70-a56c-e4b5df0d7309 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:42.784639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3497c43-ece7-4d70-a56c-e4b5df0d7309 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:42.785483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3497c43-ece7-4d70-a56c-e4b5df0d7309 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:42.839315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-a3497c43-ece7-4d70-a56c-e4b5df0d7309 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:42.926116 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a3497c43-ece7-4d70-a56c-e4b5df0d7309 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.518087 Mar 05 20:55:42.929445 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1075/2089] 10.222.0.15 () {58 vars in 1149 bytes} [Sat Mar 5 20:55:42 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:42.936666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d5fa902-a45d-4223-aa52-4eb34d411ce6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c27f8b0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:43.011200 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7d5fa902-a45d-4223-aa52-4eb34d411ce6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1438 microversion: 2.1 time: 0.078358 Mar 05 20:55:43.017889 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1076/2090] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:42 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1438 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:43.026337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-34787db8-1ec2-4703-a62a-6954c0343f85 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:43.032608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-34787db8-1ec2-4703-a62a-6954c0343f85 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:43.033587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-34787db8-1ec2-4703-a62a-6954c0343f85 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:43.037002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-27ff25d6-507d-4b4f-ba66-63286d82c0dc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:43.041442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34787db8-1ec2-4703-a62a-6954c0343f85 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:43.042331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34787db8-1ec2-4703-a62a-6954c0343f85 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:43.044595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34787db8-1ec2-4703-a62a-6954c0343f85 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:43.045304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34787db8-1ec2-4703-a62a-6954c0343f85 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:43.048811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-27ff25d6-507d-4b4f-ba66-63286d82c0dc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:43.050583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-27ff25d6-507d-4b4f-ba66-63286d82c0dc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:43.052043 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-27ff25d6-507d-4b4f-ba66-63286d82c0dc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1487 microversion: 2.25 time: 0.318739 Mar 05 20:55:43.053129 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1015/2091] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:42 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1487 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:43.236663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-34787db8-1ec2-4703-a62a-6954c0343f85 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:43.387501 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-34787db8-1ec2-4703-a62a-6954c0343f85 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.368035 Mar 05 20:55:43.391305 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1077/2092] 10.222.0.15 () {58 vars in 1211 bytes} [Sat Mar 5 20:55:43 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:43.401699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2ee0ab3c-99af-4028-ae06-8766c18740fc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:43.408488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2ee0ab3c-99af-4028-ae06-8766c18740fc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:43.409387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2ee0ab3c-99af-4028-ae06-8766c18740fc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:43.422203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-52c136cf-0d17-4d58-a0d2-86d9724cdaf0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:43.422853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-52c136cf-0d17-4d58-a0d2-86d9724cdaf0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:43.440559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ee0ab3c-99af-4028-ae06-8766c18740fc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:43.440559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ee0ab3c-99af-4028-ae06-8766c18740fc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:43.440559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ee0ab3c-99af-4028-ae06-8766c18740fc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:43.440559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ee0ab3c-99af-4028-ae06-8766c18740fc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:43.454050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52c136cf-0d17-4d58-a0d2-86d9724cdaf0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:43.454778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52c136cf-0d17-4d58-a0d2-86d9724cdaf0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:43.455650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52c136cf-0d17-4d58-a0d2-86d9724cdaf0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:43.457880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52c136cf-0d17-4d58-a0d2-86d9724cdaf0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:43.681292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-2ee0ab3c-99af-4028-ae06-8766c18740fc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:43.766487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-52c136cf-0d17-4d58-a0d2-86d9724cdaf0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:43.775511 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-52c136cf-0d17-4d58-a0d2-86d9724cdaf0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 200 len: 1315 microversion: 2.1 time: 0.357301 Mar 05 20:55:43.776810 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1078/2093] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:43 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:55:43.791346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-22d4f233-4a47-4c5b-a19b-a0ef77081fcd tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:43.792241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-22d4f233-4a47-4c5b-a19b-a0ef77081fcd tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:43.800440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22d4f233-4a47-4c5b-a19b-a0ef77081fcd tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:43.801692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22d4f233-4a47-4c5b-a19b-a0ef77081fcd tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:43.803214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22d4f233-4a47-4c5b-a19b-a0ef77081fcd tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:43.803991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22d4f233-4a47-4c5b-a19b-a0ef77081fcd tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:43.849599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22d4f233-4a47-4c5b-a19b-a0ef77081fcd tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:43.850454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22d4f233-4a47-4c5b-a19b-a0ef77081fcd tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:43.851188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-22d4f233-4a47-4c5b-a19b-a0ef77081fcd tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lazy-loading 'fault' on Instance uuid 877cfd7f-cc15-4e73-87fd-65d5e176d0cd {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:55:43.864670 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2ee0ab3c-99af-4028-ae06-8766c18740fc tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.467384 Mar 05 20:55:43.872374 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1016/2094] 10.222.0.15 () {58 vars in 1195 bytes} [Sat Mar 5 20:55:43 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:43.872374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-001c5cfb-9625-400b-b5ab-c15939abf5d0 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:43.872653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-001c5cfb-9625-400b-b5ab-c15939abf5d0 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:43.879179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-001c5cfb-9625-400b-b5ab-c15939abf5d0 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:43.879661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-001c5cfb-9625-400b-b5ab-c15939abf5d0 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:43.880468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-001c5cfb-9625-400b-b5ab-c15939abf5d0 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:43.880908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-001c5cfb-9625-400b-b5ab-c15939abf5d0 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:43.942527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-22d4f233-4a47-4c5b-a19b-a0ef77081fcd tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa267c305be048419839f673eb0ee929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf912f62904e9ca0043b0de3b37e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:43.952295 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-22d4f233-4a47-4c5b-a19b-a0ef77081fcd tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 200 len: 1313 microversion: 2.1 time: 0.173447 Mar 05 20:55:43.953144 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1079/2095] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:43 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:43.959422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1673e24d-2259-4c7c-a513-2a497b0d9d42 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:43.964689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1673e24d-2259-4c7c-a513-2a497b0d9d42 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:43.966612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1673e24d-2259-4c7c-a513-2a497b0d9d42 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'name': '-396293390', 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:43.973063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1673e24d-2259-4c7c-a513-2a497b0d9d42 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:43.973789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1673e24d-2259-4c7c-a513-2a497b0d9d42 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:43.974866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1673e24d-2259-4c7c-a513-2a497b0d9d42 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:43.975567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1673e24d-2259-4c7c-a513-2a497b0d9d42 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:44.104496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-1673e24d-2259-4c7c-a513-2a497b0d9d42 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:44.191263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-001c5cfb-9625-400b-b5ab-c15939abf5d0 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:44.205918 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-001c5cfb-9625-400b-b5ab-c15939abf5d0 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1314 microversion: 2.1 time: 0.339112 Mar 05 20:55:44.207454 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1017/2096] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:43 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:44.225278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cb5a5e3a-02e0-4ca3-9d2e-29d98db76193 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c310820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:44.306111 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cb5a5e3a-02e0-4ca3-9d2e-29d98db76193 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1447 microversion: 2.1 time: 0.094852 Mar 05 20:55:44.306756 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1018/2097] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:44 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1447 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:44.316734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9fb0d1e4-041d-48e7-bb01-c6d6b0f60cdc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:44.317894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9fb0d1e4-041d-48e7-bb01-c6d6b0f60cdc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:44.327920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9fb0d1e4-041d-48e7-bb01-c6d6b0f60cdc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:44.328578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9fb0d1e4-041d-48e7-bb01-c6d6b0f60cdc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:44.329587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9fb0d1e4-041d-48e7-bb01-c6d6b0f60cdc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:44.330208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9fb0d1e4-041d-48e7-bb01-c6d6b0f60cdc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:44.447364 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1673e24d-2259-4c7c-a513-2a497b0d9d42 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?name=-396293390" status: 200 len: 345 microversion: 2.1 time: 0.492285 Mar 05 20:55:44.448317 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1080/2098] 10.222.0.15 () {58 vars in 1155 bytes} [Sat Mar 5 20:55:43 2022] GET /compute/v2.1/servers?name=-396293390 => generated 345 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:44.453162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-0e9225fd-f536-48e4-a5b6-d7ddd190484c req-3df0694e-e990-4174-81fe-8414e3ca31da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2611e78-13fc-4a02-87a7-af3f7c46ddc0", "tag": "449a95d6-0b0c-41dc-8bf1-563531604d17"}, {"server_uuid": "877cfd7f-cc15-4e73-87fd-65d5e176d0cd", "name": "network-vif-deleted", "tag": "85a2296d-3794-434e-91df-6c4e380c3245"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:44.462289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0e9225fd-f536-48e4-a5b6-d7ddd190484c req-3df0694e-e990-4174-81fe-8414e3ca31da service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:44.462739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0e9225fd-f536-48e4-a5b6-d7ddd190484c req-3df0694e-e990-4174-81fe-8414e3ca31da service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:44.475032 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0e9225fd-f536-48e4-a5b6-d7ddd190484c req-3df0694e-e990-4174-81fe-8414e3ca31da service nova] Creating event network-changed:449a95d6-0b0c-41dc-8bf1-563531604d17 for instance f2611e78-13fc-4a02-87a7-af3f7c46ddc0 on nch2-master-1 Mar 05 20:55:44.475545 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0e9225fd-f536-48e4-a5b6-d7ddd190484c req-3df0694e-e990-4174-81fe-8414e3ca31da service nova] Creating event network-vif-deleted:85a2296d-3794-434e-91df-6c4e380c3245 for instance 877cfd7f-cc15-4e73-87fd-65d5e176d0cd on nch2-master-1 Mar 05 20:55:44.483189 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-0e9225fd-f536-48e4-a5b6-d7ddd190484c req-3df0694e-e990-4174-81fe-8414e3ca31da service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.033602 Mar 05 20:55:44.484076 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1081/2099] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:44.489813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aa54be54-e2ce-41b1-b8b1-b8b116c425f7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c1f1ca0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:44.496387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9fb0d1e4-041d-48e7-bb01-c6d6b0f60cdc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:44.513180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9fb0d1e4-041d-48e7-bb01-c6d6b0f60cdc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:44.514581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9fb0d1e4-041d-48e7-bb01-c6d6b0f60cdc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:44.515745 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9fb0d1e4-041d-48e7-bb01-c6d6b0f60cdc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1487 microversion: 2.25 time: 0.208026 Mar 05 20:55:44.516318 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1019/2100] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:44 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1487 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:44.533788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b0bafe4c-b052-4aca-9a09-6bafe0b8f944 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:44.541347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b0bafe4c-b052-4aca-9a09-6bafe0b8f944 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:44.542072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b0bafe4c-b052-4aca-9a09-6bafe0b8f944 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:44.547827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0bafe4c-b052-4aca-9a09-6bafe0b8f944 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:44.548276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0bafe4c-b052-4aca-9a09-6bafe0b8f944 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:44.549444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0bafe4c-b052-4aca-9a09-6bafe0b8f944 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:44.550199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0bafe4c-b052-4aca-9a09-6bafe0b8f944 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:44.566640 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aa54be54-e2ce-41b1-b8b1-b8b116c425f7 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 200 len: 1447 microversion: 2.1 time: 0.081176 Mar 05 20:55:44.567404 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1082/2101] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:55:44 2022] GET /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 1447 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:44.582097 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67a6dec5-3fdd-4bb2-9b66-b93a7768aa95 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c221f70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:44.644182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-b0bafe4c-b052-4aca-9a09-6bafe0b8f944 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:44.777916 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b0bafe4c-b052-4aca-9a09-6bafe0b8f944 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.260224 Mar 05 20:55:44.784126 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1020/2102] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Mar 5 20:55:44 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:44.790651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f1f8afd6-3ffb-428f-a9e2-f36d4ef6bea9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:44.795386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f1f8afd6-3ffb-428f-a9e2-f36d4ef6bea9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:44.796275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f1f8afd6-3ffb-428f-a9e2-f36d4ef6bea9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-39629339', 'deleted': False, 'project_id': '7f868fae33d848129fabf0f797c73be4'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:55:44.802036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1f8afd6-3ffb-428f-a9e2-f36d4ef6bea9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:44.802482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1f8afd6-3ffb-428f-a9e2-f36d4ef6bea9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:44.803559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1f8afd6-3ffb-428f-a9e2-f36d4ef6bea9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:44.805014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1f8afd6-3ffb-428f-a9e2-f36d4ef6bea9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:44.920051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-f1f8afd6-3ffb-428f-a9e2-f36d4ef6bea9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:55:45.003502 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f1f8afd6-3ffb-428f-a9e2-f36d4ef6bea9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-39629339" status: 200 len: 345 microversion: 2.1 time: 0.217467 Mar 05 20:55:45.011566 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1021/2103] 10.222.0.15 () {58 vars in 1225 bytes} [Sat Mar 5 20:55:44 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-39629339 => generated 345 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:55:45.016961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45911d49-9fcd-48cb-a056-d03b3b8a66eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:45.018120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-45911d49-9fcd-48cb-a056-d03b3b8a66eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:45.027081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45911d49-9fcd-48cb-a056-d03b3b8a66eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.038306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45911d49-9fcd-48cb-a056-d03b3b8a66eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.040427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45911d49-9fcd-48cb-a056-d03b3b8a66eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.041209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45911d49-9fcd-48cb-a056-d03b3b8a66eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.227528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-45911d49-9fcd-48cb-a056-d03b3b8a66eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:45.236251 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45911d49-9fcd-48cb-a056-d03b3b8a66eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 200 len: 1315 microversion: 2.1 time: 0.222256 Mar 05 20:55:45.236872 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1022/2104] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:45 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:45.244145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-52a66f25-ef8a-43f4-9a8d-70a3e77c8744 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:45.245107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-52a66f25-ef8a-43f4-9a8d-70a3e77c8744 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] [instance: 877cfd7f-cc15-4e73-87fd-65d5e176d0cd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:45.253098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a66f25-ef8a-43f4-9a8d-70a3e77c8744 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.253624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a66f25-ef8a-43f4-9a8d-70a3e77c8744 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.254412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a66f25-ef8a-43f4-9a8d-70a3e77c8744 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.254893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a66f25-ef8a-43f4-9a8d-70a3e77c8744 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.278665 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-52a66f25-ef8a-43f4-9a8d-70a3e77c8744 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] HTTP exception thrown: Instance 877cfd7f-cc15-4e73-87fd-65d5e176d0cd could not be found. Mar 05 20:55:45.279273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-52a66f25-ef8a-43f4-9a8d-70a3e77c8744 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] Returning 404 to user: Instance 877cfd7f-cc15-4e73-87fd-65d5e176d0cd could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:45.280568 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-52a66f25-ef8a-43f4-9a8d-70a3e77c8744 tempest-ServerDiagnosticsNegativeTest-1838680606 tempest-ServerDiagnosticsNegativeTest-1838680606-project] 10.222.0.15 "GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd" status: 404 len: 111 microversion: 2.1 time: 0.042302 Mar 05 20:55:45.285265 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1023/2105] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:45 2022] GET /compute/v2.1/servers/877cfd7f-cc15-4e73-87fd-65d5e176d0cd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:45.296073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3f4548a7-4d31-4188-9e16-e83feb0509c9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:45.296652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3f4548a7-4d31-4188-9e16-e83feb0509c9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:45.305294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f4548a7-4d31-4188-9e16-e83feb0509c9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.305969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f4548a7-4d31-4188-9e16-e83feb0509c9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.307281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f4548a7-4d31-4188-9e16-e83feb0509c9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.307762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f4548a7-4d31-4188-9e16-e83feb0509c9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.339625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3f4548a7-4d31-4188-9e16-e83feb0509c9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:55:45.411168 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67a6dec5-3fdd-4bb2-9b66-b93a7768aa95 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 204 len: 0 microversion: 2.1 time: 0.835445 Mar 05 20:55:45.411794 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1083/2106] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:44 2022] DELETE /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:55:45.421064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c0cbb2d0-2fa0-4cf0-b76e-72bab263e42f req-568d4f8f-5551-425b-bcfd-4287b9c9c0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf09b77b-5755-4ebd-bbcd-c47541a58af5", "name": "network-vif-plugged", "status": "completed", "tag": "c02ff863-577b-4f41-9058-0e457c4739d0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:45.440965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c0cbb2d0-2fa0-4cf0-b76e-72bab263e42f req-568d4f8f-5551-425b-bcfd-4287b9c9c0d5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.441493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c0cbb2d0-2fa0-4cf0-b76e-72bab263e42f req-568d4f8f-5551-425b-bcfd-4287b9c9c0d5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.456774 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c0cbb2d0-2fa0-4cf0-b76e-72bab263e42f req-568d4f8f-5551-425b-bcfd-4287b9c9c0d5 service nova] Creating event network-vif-plugged:c02ff863-577b-4f41-9058-0e457c4739d0 for instance bf09b77b-5755-4ebd-bbcd-c47541a58af5 on nch1-master-1 Mar 05 20:55:45.464709 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c0cbb2d0-2fa0-4cf0-b76e-72bab263e42f req-568d4f8f-5551-425b-bcfd-4287b9c9c0d5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047754 Mar 05 20:55:45.465372 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1084/2107] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:45.472962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d8537819-8ce8-407f-aeb2-4679b0d1fb98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:45.473424 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3f4548a7-4d31-4188-9e16-e83feb0509c9 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 204 len: 0 microversion: 2.1 time: 0.186306 Mar 05 20:55:45.474614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d8537819-8ce8-407f-aeb2-4679b0d1fb98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:45.474770 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1024/2108] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:55:45 2022] DELETE /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:55:45.485139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8537819-8ce8-407f-aeb2-4679b0d1fb98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.485671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9b375bd3-7d4b-4532-abee-a4729a34ae1c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:45.486066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8537819-8ce8-407f-aeb2-4679b0d1fb98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.486900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9b375bd3-7d4b-4532-abee-a4729a34ae1c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:45.487265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8537819-8ce8-407f-aeb2-4679b0d1fb98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.488958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8537819-8ce8-407f-aeb2-4679b0d1fb98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.498107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b375bd3-7d4b-4532-abee-a4729a34ae1c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.499632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b375bd3-7d4b-4532-abee-a4729a34ae1c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.501008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b375bd3-7d4b-4532-abee-a4729a34ae1c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.501750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b375bd3-7d4b-4532-abee-a4729a34ae1c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.551055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9b375bd3-7d4b-4532-abee-a4729a34ae1c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:55:45.683628 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9b375bd3-7d4b-4532-abee-a4729a34ae1c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 204 len: 0 microversion: 2.1 time: 0.205569 Mar 05 20:55:45.684389 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1025/2109] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:55:45 2022] DELETE /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:55:45.694479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3ae3a3f0-2491-4337-b51b-8602add1ec6d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:45.695551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3ae3a3f0-2491-4337-b51b-8602add1ec6d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:45.724089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ae3a3f0-2491-4337-b51b-8602add1ec6d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.728143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ae3a3f0-2491-4337-b51b-8602add1ec6d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.729404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ae3a3f0-2491-4337-b51b-8602add1ec6d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.730040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ae3a3f0-2491-4337-b51b-8602add1ec6d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.866084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d8537819-8ce8-407f-aeb2-4679b0d1fb98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:45.874931 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d8537819-8ce8-407f-aeb2-4679b0d1fb98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1314 microversion: 2.1 time: 0.408061 Mar 05 20:55:45.876095 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1085/2110] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:45 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:45.881132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0a46708-e599-43f6-af5f-acb031b7f3fc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:45.881750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e0a46708-e599-43f6-af5f-acb031b7f3fc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:45.888292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a46708-e599-43f6-af5f-acb031b7f3fc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.889057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a46708-e599-43f6-af5f-acb031b7f3fc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.890085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a46708-e599-43f6-af5f-acb031b7f3fc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:45.890604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a46708-e599-43f6-af5f-acb031b7f3fc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:45.931915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3ae3a3f0-2491-4337-b51b-8602add1ec6d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:45.944114 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3ae3a3f0-2491-4337-b51b-8602add1ec6d tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1517 microversion: 2.1 time: 0.258280 Mar 05 20:55:45.945680 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1026/2111] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:45 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1517 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:45.950883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1620248617", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "92c1bc99-8218-45a1-b95c-a4c228475460"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:46.013745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] validate_networks() for [('92c1bc99-8218-45a1-b95c-a4c228475460', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:55:46.062287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e0a46708-e599-43f6-af5f-acb031b7f3fc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:46.071948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e0a46708-e599-43f6-af5f-acb031b7f3fc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:46.073737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e0a46708-e599-43f6-af5f-acb031b7f3fc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:46.075839 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0a46708-e599-43f6-af5f-acb031b7f3fc tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1487 microversion: 2.25 time: 0.198543 Mar 05 20:55:46.076906 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1086/2112] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:45 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1487 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:46.255760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b711667a-a23b-4031-8ee6-01a426fd1111 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:46.273589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b711667a-a23b-4031-8ee6-01a426fd1111 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:46.284719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b711667a-a23b-4031-8ee6-01a426fd1111 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:46.285596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b711667a-a23b-4031-8ee6-01a426fd1111 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:46.287129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b711667a-a23b-4031-8ee6-01a426fd1111 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:46.287917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b711667a-a23b-4031-8ee6-01a426fd1111 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:46.511873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:55:46.512483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:55:46.512887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:55:46.513533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:55:46.513987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:55:46.526434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:46.527534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:46.528844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:46.529665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:46.551975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Getting quotas for project 1e9d41fd2f8d48d894ddb8ae0aa2799d. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:55:46.559073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Getting quotas for user 8bcf50b3de674240bb695a0d5614ffd9 and project 1e9d41fd2f8d48d894ddb8ae0aa2799d. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:55:46.576504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:55:46.578972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:55:46.611835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b711667a-a23b-4031-8ee6-01a426fd1111 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:46.623882 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b711667a-a23b-4031-8ee6-01a426fd1111 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 200 len: 1315 microversion: 2.1 time: 0.374035 Mar 05 20:55:46.625225 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1087/2113] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:46 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:55:46.645228 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f10ec6cf-ab86-4813-815c-dbadef7e281a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697599 Mar 05 20:55:46.646193 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1027/2114] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:55:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:55:46.658284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8d96b753-664c-47f8-9923-8e2fda8ee07e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:46.659286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8d96b753-664c-47f8-9923-8e2fda8ee07e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:46.752949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8d96b753-664c-47f8-9923-8e2fda8ee07e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:46.763794 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8d96b753-664c-47f8-9923-8e2fda8ee07e tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1208 microversion: 2.1 time: 0.108889 Mar 05 20:55:46.776215 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1088/2115] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:46 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1208 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:46.898329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cdaf1811-40e6-49dd-b9b0-2c59822f3a4a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:46.899028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cdaf1811-40e6-49dd-b9b0-2c59822f3a4a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:46.916053 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cdaf1811-40e6-49dd-b9b0-2c59822f3a4a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:46.916533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cdaf1811-40e6-49dd-b9b0-2c59822f3a4a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:46.921077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cdaf1811-40e6-49dd-b9b0-2c59822f3a4a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:46.921996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cdaf1811-40e6-49dd-b9b0-2c59822f3a4a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:46.965217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8ef546d9-89fd-4453-abab-35f3259c18e2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:46.966415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8ef546d9-89fd-4453-abab-35f3259c18e2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:46.976515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ef546d9-89fd-4453-abab-35f3259c18e2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:46.977426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ef546d9-89fd-4453-abab-35f3259c18e2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:46.979006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ef546d9-89fd-4453-abab-35f3259c18e2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:46.979698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ef546d9-89fd-4453-abab-35f3259c18e2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:47.294783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cdaf1811-40e6-49dd-b9b0-2c59822f3a4a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:47.308923 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cdaf1811-40e6-49dd-b9b0-2c59822f3a4a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1314 microversion: 2.1 time: 0.418596 Mar 05 20:55:47.310794 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1028/2116] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:46 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:47.317078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-088452ac-4db8-4b32-8e23-dd4499ebf7cf tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:47.318116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-088452ac-4db8-4b32-8e23-dd4499ebf7cf tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:47.328454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-088452ac-4db8-4b32-8e23-dd4499ebf7cf tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:47.329016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-088452ac-4db8-4b32-8e23-dd4499ebf7cf tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:47.330087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-088452ac-4db8-4b32-8e23-dd4499ebf7cf tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:47.330613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-088452ac-4db8-4b32-8e23-dd4499ebf7cf tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:47.603656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-088452ac-4db8-4b32-8e23-dd4499ebf7cf tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:47.616580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-088452ac-4db8-4b32-8e23-dd4499ebf7cf tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:47.618665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-088452ac-4db8-4b32-8e23-dd4499ebf7cf tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:47.623362 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-088452ac-4db8-4b32-8e23-dd4499ebf7cf tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1487 microversion: 2.25 time: 0.308569 Mar 05 20:55:47.634797 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1029/2117] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:47 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1487 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:47.640667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-843151d6-ba55-4fca-8e85-20aa80c2f261 req-6e9df8dd-c331-4e03-b085-e47472c04fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b49a93-adf5-4a9e-8359-60d106b3433f", "name": "network-vif-plugged", "status": "completed", "tag": "2ca65ea5-4d5f-472b-b108-55db231b87c0"}, {"server_uuid": "a4505753-e31f-4b5b-8ee3-f37ab9176b36", "name": "network-vif-unplugged", "status": "completed", "tag": "455cfb49-cef8-4f8d-8d0a-39162ccccb16"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:47.645384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8ef546d9-89fd-4453-abab-35f3259c18e2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:47.650733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-843151d6-ba55-4fca-8e85-20aa80c2f261 req-6e9df8dd-c331-4e03-b085-e47472c04fd5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:47.651186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-843151d6-ba55-4fca-8e85-20aa80c2f261 req-6e9df8dd-c331-4e03-b085-e47472c04fd5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:47.656722 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8ef546d9-89fd-4453-abab-35f3259c18e2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 200 len: 1517 microversion: 2.1 time: 0.697855 Mar 05 20:55:47.657875 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1089/2118] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:46 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 1517 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:47.662769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2e4a6b5e-6e41-4baa-b66c-896e8d5157b7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:47.663782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2e4a6b5e-6e41-4baa-b66c-896e8d5157b7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:47.673808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e4a6b5e-6e41-4baa-b66c-896e8d5157b7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:47.674789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e4a6b5e-6e41-4baa-b66c-896e8d5157b7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:47.676231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e4a6b5e-6e41-4baa-b66c-896e8d5157b7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:47.677833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e4a6b5e-6e41-4baa-b66c-896e8d5157b7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:47.678752 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-843151d6-ba55-4fca-8e85-20aa80c2f261 req-6e9df8dd-c331-4e03-b085-e47472c04fd5 service nova] Creating event network-vif-plugged:2ca65ea5-4d5f-472b-b108-55db231b87c0 for instance 28b49a93-adf5-4a9e-8359-60d106b3433f on nch1-master-1 Mar 05 20:55:47.679863 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-843151d6-ba55-4fca-8e85-20aa80c2f261 req-6e9df8dd-c331-4e03-b085-e47472c04fd5 service nova] Creating event network-vif-unplugged:455cfb49-cef8-4f8d-8d0a-39162ccccb16 for instance a4505753-e31f-4b5b-8ee3-f37ab9176b36 on nch1-master-1 Mar 05 20:55:47.686989 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-843151d6-ba55-4fca-8e85-20aa80c2f261 req-6e9df8dd-c331-4e03-b085-e47472c04fd5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.050599 Mar 05 20:55:47.692649 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1030/2119] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:47.785577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-855d5dda-8418-4704-b8ae-2988c7e6da69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:47.799967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-855d5dda-8418-4704-b8ae-2988c7e6da69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:47.830908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-855d5dda-8418-4704-b8ae-2988c7e6da69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:47.831879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-855d5dda-8418-4704-b8ae-2988c7e6da69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:47.834332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-855d5dda-8418-4704-b8ae-2988c7e6da69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:47.837376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-855d5dda-8418-4704-b8ae-2988c7e6da69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:47.952585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-855d5dda-8418-4704-b8ae-2988c7e6da69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:47.964859 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-855d5dda-8418-4704-b8ae-2988c7e6da69 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1260 microversion: 2.1 time: 0.183608 Mar 05 20:55:47.966554 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1031/2120] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:47 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:55:48.214091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2e4a6b5e-6e41-4baa-b66c-896e8d5157b7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:48.232287 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2e4a6b5e-6e41-4baa-b66c-896e8d5157b7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 200 len: 1315 microversion: 2.1 time: 0.573160 Mar 05 20:55:48.233441 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1090/2121] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:47 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:48.328339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cbe01382-442d-42c5-8709-c2af4b6956c7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:48.328963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cbe01382-442d-42c5-8709-c2af4b6956c7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:48.339164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbe01382-442d-42c5-8709-c2af4b6956c7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:48.340072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbe01382-442d-42c5-8709-c2af4b6956c7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:48.341432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbe01382-442d-42c5-8709-c2af4b6956c7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:48.341870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbe01382-442d-42c5-8709-c2af4b6956c7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:48.637029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e7ee2efd-6132-4222-a0d0-80972e3c8547 req-cac165ad-3c58-43b1-bace-930f4d45275a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c204e8d4-97d5-4836-b7b5-3700e219dea6", "name": "network-vif-deleted", "tag": "ec3287d8-2694-4693-885a-dc693fd9360a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:48.655417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e7ee2efd-6132-4222-a0d0-80972e3c8547 req-cac165ad-3c58-43b1-bace-930f4d45275a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:48.658380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e7ee2efd-6132-4222-a0d0-80972e3c8547 req-cac165ad-3c58-43b1-bace-930f4d45275a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:48.686370 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e7ee2efd-6132-4222-a0d0-80972e3c8547 req-cac165ad-3c58-43b1-bace-930f4d45275a service nova] Creating event network-vif-deleted:ec3287d8-2694-4693-885a-dc693fd9360a for instance c204e8d4-97d5-4836-b7b5-3700e219dea6 on nch2-master-1 Mar 05 20:55:48.721292 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e7ee2efd-6132-4222-a0d0-80972e3c8547 req-cac165ad-3c58-43b1-bace-930f4d45275a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089444 Mar 05 20:55:48.721292 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1091/2122] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:48.747458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ce16e336-a001-47d9-a1e5-efec6022ef6e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:48.750981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ce16e336-a001-47d9-a1e5-efec6022ef6e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:48.771449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce16e336-a001-47d9-a1e5-efec6022ef6e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:48.773348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce16e336-a001-47d9-a1e5-efec6022ef6e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:48.782289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce16e336-a001-47d9-a1e5-efec6022ef6e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:48.785419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce16e336-a001-47d9-a1e5-efec6022ef6e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:49.514374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cbe01382-442d-42c5-8709-c2af4b6956c7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:49.527382 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cbe01382-442d-42c5-8709-c2af4b6956c7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1501 microversion: 2.1 time: 1.203777 Mar 05 20:55:49.528767 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1032/2123] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:48 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1501 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:49.537839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-047cd3f6-4803-448d-a476-ac3487f57fd2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:49.538843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-047cd3f6-4803-448d-a476-ac3487f57fd2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: c204e8d4-97d5-4836-b7b5-3700e219dea6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:49.558167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-047cd3f6-4803-448d-a476-ac3487f57fd2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:49.559043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-047cd3f6-4803-448d-a476-ac3487f57fd2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:49.560280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-047cd3f6-4803-448d-a476-ac3487f57fd2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:49.560946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-047cd3f6-4803-448d-a476-ac3487f57fd2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:49.584444 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-047cd3f6-4803-448d-a476-ac3487f57fd2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] HTTP exception thrown: Instance c204e8d4-97d5-4836-b7b5-3700e219dea6 could not be found. Mar 05 20:55:49.585604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-047cd3f6-4803-448d-a476-ac3487f57fd2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Returning 404 to user: Instance c204e8d4-97d5-4836-b7b5-3700e219dea6 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:49.586947 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-047cd3f6-4803-448d-a476-ac3487f57fd2 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6" status: 404 len: 111 microversion: 2.1 time: 0.056782 Mar 05 20:55:49.588107 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1033/2124] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:49 2022] GET /compute/v2.1/servers/c204e8d4-97d5-4836-b7b5-3700e219dea6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:49.593860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6a92f7a-8eac-465b-9038-bb35c96398b8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:49.594833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6a92f7a-8eac-465b-9038-bb35c96398b8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:49.602331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6a92f7a-8eac-465b-9038-bb35c96398b8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:49.603925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6a92f7a-8eac-465b-9038-bb35c96398b8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:49.604966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6a92f7a-8eac-465b-9038-bb35c96398b8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:49.605650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6a92f7a-8eac-465b-9038-bb35c96398b8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:49.731163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6a92f7a-8eac-465b-9038-bb35c96398b8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:49.742829 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6a92f7a-8eac-465b-9038-bb35c96398b8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1266 microversion: 2.1 time: 0.153041 Mar 05 20:55:49.748559 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1034/2125] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:49 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:49.753527 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1783c3de-668d-43f1-b697-8566cc8b428d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:49.755705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1783c3de-668d-43f1-b697-8566cc8b428d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:49.765169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1783c3de-668d-43f1-b697-8566cc8b428d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:49.766032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1783c3de-668d-43f1-b697-8566cc8b428d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:49.767181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1783c3de-668d-43f1-b697-8566cc8b428d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:49.767978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1783c3de-668d-43f1-b697-8566cc8b428d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:49.917894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ce16e336-a001-47d9-a1e5-efec6022ef6e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:49.938152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ce16e336-a001-47d9-a1e5-efec6022ef6e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:49.948882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ce16e336-a001-47d9-a1e5-efec6022ef6e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:49.953016 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ce16e336-a001-47d9-a1e5-efec6022ef6e tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1487 microversion: 2.25 time: 1.230025 Mar 05 20:55:49.954129 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1092/2126] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:48 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1487 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:50.000871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0c3dc35f-a117-4e43-873e-ad22790844c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:50.001931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0c3dc35f-a117-4e43-873e-ad22790844c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:50.025844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c3dc35f-a117-4e43-873e-ad22790844c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:50.026417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c3dc35f-a117-4e43-873e-ad22790844c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:50.027275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c3dc35f-a117-4e43-873e-ad22790844c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:50.028016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c3dc35f-a117-4e43-873e-ad22790844c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:50.087316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-0c3dc35f-a117-4e43-873e-ad22790844c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lazy-loading 'flavor' on Instance uuid bf09b77b-5755-4ebd-bbcd-c47541a58af5 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:55:50.219233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1783c3de-668d-43f1-b697-8566cc8b428d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:50.255492 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1783c3de-668d-43f1-b697-8566cc8b428d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 200 len: 1502 microversion: 2.1 time: 0.505341 Mar 05 20:55:50.256596 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1035/2127] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:49 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 1502 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:50.291615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a6daec23-e2f0-4ba1-af27-fc92545fe1c6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:50.292311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a6daec23-e2f0-4ba1-af27-fc92545fe1c6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: f4c65952-c3d5-4826-9fe6-48c5f0ec86a7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:50.316138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6daec23-e2f0-4ba1-af27-fc92545fe1c6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:50.316626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6daec23-e2f0-4ba1-af27-fc92545fe1c6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:50.317461 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0c3dc35f-a117-4e43-873e-ad22790844c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "POST /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5/action" status: 200 len: 32 microversion: 2.1 time: 0.358362 Mar 05 20:55:50.318441 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1093/2128] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:55:49 2022] POST /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:55:50.325180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6daec23-e2f0-4ba1-af27-fc92545fe1c6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:50.325180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6daec23-e2f0-4ba1-af27-fc92545fe1c6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:50.340234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1532a15f-69ec-435c-b5f8-f05663cd0d00 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:50.341824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1532a15f-69ec-435c-b5f8-f05663cd0d00 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:50.357587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1532a15f-69ec-435c-b5f8-f05663cd0d00 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:50.358066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1532a15f-69ec-435c-b5f8-f05663cd0d00 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:50.359063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1532a15f-69ec-435c-b5f8-f05663cd0d00 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:50.359518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1532a15f-69ec-435c-b5f8-f05663cd0d00 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:50.384138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a6daec23-e2f0-4ba1-af27-fc92545fe1c6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: f4c65952-c3d5-4826-9fe6-48c5f0ec86a7] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:55:50.402952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1532a15f-69ec-435c-b5f8-f05663cd0d00 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:55:50.577526 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a6daec23-e2f0-4ba1-af27-fc92545fe1c6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7" status: 204 len: 0 microversion: 2.1 time: 0.318093 Mar 05 20:55:50.582420 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1036/2129] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:55:50 2022] DELETE /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:55:50.598642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d77be2f9-6307-459a-97fa-2bd4fb01778e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:50.600320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d77be2f9-6307-459a-97fa-2bd4fb01778e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:50.609733 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1532a15f-69ec-435c-b5f8-f05663cd0d00 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 204 len: 0 microversion: 2.1 time: 0.280953 Mar 05 20:55:50.610355 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1094/2130] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:55:50 2022] DELETE /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:55:50.626078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d77be2f9-6307-459a-97fa-2bd4fb01778e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:50.627305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d77be2f9-6307-459a-97fa-2bd4fb01778e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:50.628155 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b0f0bb04-eba3-4571-b8ce-60b462b83e35 req-273de97e-5307-4ec2-b53c-3556e9d02197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4505753-e31f-4b5b-8ee3-f37ab9176b36", "name": "network-vif-deleted", "tag": "455cfb49-cef8-4f8d-8d0a-39162ccccb16"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:50.630127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d77be2f9-6307-459a-97fa-2bd4fb01778e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:50.632316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d77be2f9-6307-459a-97fa-2bd4fb01778e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:50.668600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b0f0bb04-eba3-4571-b8ce-60b462b83e35 req-273de97e-5307-4ec2-b53c-3556e9d02197 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:50.671164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b0f0bb04-eba3-4571-b8ce-60b462b83e35 req-273de97e-5307-4ec2-b53c-3556e9d02197 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:50.698532 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b0f0bb04-eba3-4571-b8ce-60b462b83e35 req-273de97e-5307-4ec2-b53c-3556e9d02197 service nova] Creating event network-vif-deleted:455cfb49-cef8-4f8d-8d0a-39162ccccb16 for instance a4505753-e31f-4b5b-8ee3-f37ab9176b36 on nch1-master-1 Mar 05 20:55:50.705497 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b0f0bb04-eba3-4571-b8ce-60b462b83e35 req-273de97e-5307-4ec2-b53c-3556e9d02197 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090037 Mar 05 20:55:50.707023 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1095/2131] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:50.715109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eb7c56d5-4e8a-4d53-bafe-b33245bc39b6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:50.716847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eb7c56d5-4e8a-4d53-bafe-b33245bc39b6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: f4c65952-c3d5-4826-9fe6-48c5f0ec86a7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:50.725137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb7c56d5-4e8a-4d53-bafe-b33245bc39b6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:50.726685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb7c56d5-4e8a-4d53-bafe-b33245bc39b6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:50.728192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb7c56d5-4e8a-4d53-bafe-b33245bc39b6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:50.728825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb7c56d5-4e8a-4d53-bafe-b33245bc39b6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:50.994871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d77be2f9-6307-459a-97fa-2bd4fb01778e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:51.009527 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d77be2f9-6307-459a-97fa-2bd4fb01778e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 0.424528 Mar 05 20:55:51.011157 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1037/2132] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:50 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:51.020122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-402a74a1-76bf-4330-8a7c-5d80852a3034 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:51.023683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-402a74a1-76bf-4330-8a7c-5d80852a3034 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:51.040782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-402a74a1-76bf-4330-8a7c-5d80852a3034 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.041580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-402a74a1-76bf-4330-8a7c-5d80852a3034 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.043663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-402a74a1-76bf-4330-8a7c-5d80852a3034 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.047462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-402a74a1-76bf-4330-8a7c-5d80852a3034 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.325214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-402a74a1-76bf-4330-8a7c-5d80852a3034 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:51.341391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eb7c56d5-4e8a-4d53-bafe-b33245bc39b6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:51.349172 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-402a74a1-76bf-4330-8a7c-5d80852a3034 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 200 len: 1508 microversion: 2.1 time: 0.324564 Mar 05 20:55:51.352259 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eb7c56d5-4e8a-4d53-bafe-b33245bc39b6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7" status: 200 len: 1516 microversion: 2.1 time: 0.643217 Mar 05 20:55:51.353279 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1038/2133] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:51 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 1508 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:51.357664 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1096/2134] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:50 2022] GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7 => generated 1516 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:51.366218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c5d62f56-6a88-4143-9b35-10eb7c69bda5 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:51.367887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c5d62f56-6a88-4143-9b35-10eb7c69bda5 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:51.376042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5d62f56-6a88-4143-9b35-10eb7c69bda5 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.376840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5d62f56-6a88-4143-9b35-10eb7c69bda5 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.377663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5d62f56-6a88-4143-9b35-10eb7c69bda5 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.378343 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5d62f56-6a88-4143-9b35-10eb7c69bda5 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.552161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-83a5559e-16b2-4dbf-8905-92dabb623d2d tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:51.557309 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:55:51.557309 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:55:51.561250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a5559e-16b2-4dbf-8905-92dabb623d2d tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.561250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a5559e-16b2-4dbf-8905-92dabb623d2d tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.562361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a5559e-16b2-4dbf-8905-92dabb623d2d tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.567732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a5559e-16b2-4dbf-8905-92dabb623d2d tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.606031 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-83a5559e-16b2-4dbf-8905-92dabb623d2d tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.247029 Mar 05 20:55:51.606808 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1097/2135] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:55:51 2022] GET /compute/v2.1/os-services => generated 947 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:51.613248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c5d62f56-6a88-4143-9b35-10eb7c69bda5 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:51.618804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e4a00ee2-85ff-436c-a5db-7075bd3b04a6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:51.619828 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e4a00ee2-85ff-436c-a5db-7075bd3b04a6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:51.626750 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c5d62f56-6a88-4143-9b35-10eb7c69bda5 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1308 microversion: 2.1 time: 0.271863 Mar 05 20:55:51.627741 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1039/2136] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:51 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1308 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:51.628011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4a00ee2-85ff-436c-a5db-7075bd3b04a6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.628603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4a00ee2-85ff-436c-a5db-7075bd3b04a6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.629492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4a00ee2-85ff-436c-a5db-7075bd3b04a6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.630001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4a00ee2-85ff-436c-a5db-7075bd3b04a6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.634618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f7722595-4d77-4812-8872-3a336c6aa5a4 tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:51.636164 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:55:51.636164 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:55:51.637508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7722595-4d77-4812-8872-3a336c6aa5a4 tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.637954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7722595-4d77-4812-8872-3a336c6aa5a4 tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.639725 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7722595-4d77-4812-8872-3a336c6aa5a4 tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.640460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7722595-4d77-4812-8872-3a336c6aa5a4 tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.675771 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f7722595-4d77-4812-8872-3a336c6aa5a4 tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.046716 Mar 05 20:55:51.677343 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1040/2137] 10.222.0.15 () {58 vars in 1173 bytes} [Sat Mar 5 20:55:51 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:51.691941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d957d6e1-f05b-4da9-8bdb-db66ea3ccd5f tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:51.697028 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:55:51.697028 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:55:51.700891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d957d6e1-f05b-4da9-8bdb-db66ea3ccd5f tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.702175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d957d6e1-f05b-4da9-8bdb-db66ea3ccd5f tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.703425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d957d6e1-f05b-4da9-8bdb-db66ea3ccd5f tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.704323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d957d6e1-f05b-4da9-8bdb-db66ea3ccd5f tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.751397 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d957d6e1-f05b-4da9-8bdb-db66ea3ccd5f tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065025 Mar 05 20:55:51.752626 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1041/2138] 10.222.0.15 () {58 vars in 1175 bytes} [Sat Mar 5 20:55:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:51.764739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c970d806-c186-45f3-a867-5723653369bc tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:51.765986 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:55:51.765986 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:55:51.767270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c970d806-c186-45f3-a867-5723653369bc tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.767945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c970d806-c186-45f3-a867-5723653369bc tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.768715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c970d806-c186-45f3-a867-5723653369bc tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:51.769214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c970d806-c186-45f3-a867-5723653369bc tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:51.796258 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c970d806-c186-45f3-a867-5723653369bc tempest-ServicesAdminTestJSON-968797779 tempest-ServicesAdminTestJSON-968797779-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.034952 Mar 05 20:55:51.797471 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1042/2139] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 20:55:51 2022] GET /compute/v2.1/os-services => generated 947 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:55:52.029267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6787ed99-8b70-44cc-adb2-b18af98ec227 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:52.030114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6787ed99-8b70-44cc-adb2-b18af98ec227 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:52.047521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6787ed99-8b70-44cc-adb2-b18af98ec227 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:52.050935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6787ed99-8b70-44cc-adb2-b18af98ec227 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:52.056110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6787ed99-8b70-44cc-adb2-b18af98ec227 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:52.059344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6787ed99-8b70-44cc-adb2-b18af98ec227 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:52.068395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e4a00ee2-85ff-436c-a5db-7075bd3b04a6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:52.091058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e4a00ee2-85ff-436c-a5db-7075bd3b04a6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:52.092763 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e4a00ee2-85ff-436c-a5db-7075bd3b04a6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:52.094044 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e4a00ee2-85ff-436c-a5db-7075bd3b04a6 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1477 microversion: 2.25 time: 0.480990 Mar 05 20:55:52.108912 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1098/2140] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:51 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1477 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:52.123512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-12264f8e-7e13-41da-b78d-9121f3d89c01 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '.version_select at 0x7fed5c239790>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:52.126082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-12264f8e-7e13-41da-b78d-9121f3d89c01 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:52.126545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-12264f8e-7e13-41da-b78d-9121f3d89c01 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:52.164880 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-12264f8e-7e13-41da-b78d-9121f3d89c01 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.049257 Mar 05 20:55:52.180276 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1099/2141] 10.222.0.15 () {60 vars in 1183 bytes} [Sat Mar 5 20:55:52 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:55:52.190458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f480dbbb-0870-4fb9-9e04-3f9088b371b7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:52.191141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f480dbbb-0870-4fb9-9e04-3f9088b371b7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:52.203518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f480dbbb-0870-4fb9-9e04-3f9088b371b7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:52.204023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f480dbbb-0870-4fb9-9e04-3f9088b371b7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:52.204918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f480dbbb-0870-4fb9-9e04-3f9088b371b7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:52.205418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f480dbbb-0870-4fb9-9e04-3f9088b371b7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:52.328908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6787ed99-8b70-44cc-adb2-b18af98ec227 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:52.338274 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6787ed99-8b70-44cc-adb2-b18af98ec227 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 0.312790 Mar 05 20:55:52.339400 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1043/2142] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:52 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:52.344827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5ba0a262-a208-4712-be51-9f67d181a904 req-2b92f50d-afd0-44f2-81b7-ee1fa26de834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f1c9b56-f7e9-411e-bd5d-71b8230e4b19", "tag": "c9f91447-b5aa-4520-9cac-255e0c084b36"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:52.355484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5ba0a262-a208-4712-be51-9f67d181a904 req-2b92f50d-afd0-44f2-81b7-ee1fa26de834 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:52.355964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5ba0a262-a208-4712-be51-9f67d181a904 req-2b92f50d-afd0-44f2-81b7-ee1fa26de834 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:52.373850 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-5ba0a262-a208-4712-be51-9f67d181a904 req-2b92f50d-afd0-44f2-81b7-ee1fa26de834 service nova] Creating event network-changed:c9f91447-b5aa-4520-9cac-255e0c084b36 for instance 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 on nch2-master-1 Mar 05 20:55:52.381322 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5ba0a262-a208-4712-be51-9f67d181a904 req-2b92f50d-afd0-44f2-81b7-ee1fa26de834 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040812 Mar 05 20:55:52.384240 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1044/2143] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:52.393032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-25a0ffa2-1cc0-4454-9ef1-171ccc84d772 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:52.394009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-25a0ffa2-1cc0-4454-9ef1-171ccc84d772 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: f4c65952-c3d5-4826-9fe6-48c5f0ec86a7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:52.404461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25a0ffa2-1cc0-4454-9ef1-171ccc84d772 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:52.405206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25a0ffa2-1cc0-4454-9ef1-171ccc84d772 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:52.406232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25a0ffa2-1cc0-4454-9ef1-171ccc84d772 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:52.406925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25a0ffa2-1cc0-4454-9ef1-171ccc84d772 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:52.604737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-f480dbbb-0870-4fb9-9e04-3f9088b371b7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] Lazy-loading 'services' on Instance uuid f2611e78-13fc-4a02-87a7-af3f7c46ddc0 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:55:52.623620 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f480dbbb-0870-4fb9-9e04-3f9088b371b7 tempest-LiveAutoBlockMigrationV225Test-1747675317 tempest-LiveAutoBlockMigrationV225Test-1747675317-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1970 microversion: 2.25 time: 0.442087 Mar 05 20:55:52.624701 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1100/2144] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:52 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1970 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:52.630593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-584651dd-bf44-4010-98b6-5496d524abeb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:52.631970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-584651dd-bf44-4010-98b6-5496d524abeb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:52.640574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-584651dd-bf44-4010-98b6-5496d524abeb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:52.641843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-584651dd-bf44-4010-98b6-5496d524abeb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:52.642811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-584651dd-bf44-4010-98b6-5496d524abeb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:52.643457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-584651dd-bf44-4010-98b6-5496d524abeb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:52.757944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-25a0ffa2-1cc0-4454-9ef1-171ccc84d772 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:52.768385 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-25a0ffa2-1cc0-4454-9ef1-171ccc84d772 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7" status: 200 len: 1516 microversion: 2.1 time: 0.382218 Mar 05 20:55:52.778370 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1045/2145] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:52 2022] GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7 => generated 1516 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:52.783342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-94cd9077-9e7d-4612-906e-11bbac181624 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:52.784158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-94cd9077-9e7d-4612-906e-11bbac181624 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:52.791025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94cd9077-9e7d-4612-906e-11bbac181624 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:52.791758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94cd9077-9e7d-4612-906e-11bbac181624 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:52.793569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94cd9077-9e7d-4612-906e-11bbac181624 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:52.796438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94cd9077-9e7d-4612-906e-11bbac181624 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:53.037945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-584651dd-bf44-4010-98b6-5496d524abeb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:53.049882 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-584651dd-bf44-4010-98b6-5496d524abeb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 200 len: 1508 microversion: 2.1 time: 0.424063 Mar 05 20:55:53.053154 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1101/2146] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:52 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 1508 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:53.066586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ec865a9c-779c-486e-b895-b976e08a3c49 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:53.067103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ec865a9c-779c-486e-b895-b976e08a3c49 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:53.076318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec865a9c-779c-486e-b895-b976e08a3c49 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:53.077127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec865a9c-779c-486e-b895-b976e08a3c49 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:53.078102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec865a9c-779c-486e-b895-b976e08a3c49 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:53.078773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec865a9c-779c-486e-b895-b976e08a3c49 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:53.157585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-94cd9077-9e7d-4612-906e-11bbac181624 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:53.171414 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-94cd9077-9e7d-4612-906e-11bbac181624 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1308 microversion: 2.1 time: 0.391536 Mar 05 20:55:53.176279 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1046/2147] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:52 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1308 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:53.178766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ec865a9c-779c-486e-b895-b976e08a3c49 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:55:53.290192 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ec865a9c-779c-486e-b895-b976e08a3c49 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 204 len: 0 microversion: 2.25 time: 0.233537 Mar 05 20:55:53.290192 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1102/2148] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 20:55:53 2022] DELETE /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:55:53.299855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-80da9e9d-b7ee-48cb-a0b5-de475213d625 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:53.300635 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-80da9e9d-b7ee-48cb-a0b5-de475213d625 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:53.309639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80da9e9d-b7ee-48cb-a0b5-de475213d625 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:53.310194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80da9e9d-b7ee-48cb-a0b5-de475213d625 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:53.311397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80da9e9d-b7ee-48cb-a0b5-de475213d625 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:53.311946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80da9e9d-b7ee-48cb-a0b5-de475213d625 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:53.363765 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d66918d0-dff8-43fc-930c-dd3e78885222 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:53.365060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d66918d0-dff8-43fc-930c-dd3e78885222 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:53.373985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d66918d0-dff8-43fc-930c-dd3e78885222 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:53.375083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d66918d0-dff8-43fc-930c-dd3e78885222 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:53.376178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d66918d0-dff8-43fc-930c-dd3e78885222 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:53.376783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d66918d0-dff8-43fc-930c-dd3e78885222 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:53.640930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-80da9e9d-b7ee-48cb-a0b5-de475213d625 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:53.649513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-80da9e9d-b7ee-48cb-a0b5-de475213d625 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:53.651384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-80da9e9d-b7ee-48cb-a0b5-de475213d625 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:53.653149 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-80da9e9d-b7ee-48cb-a0b5-de475213d625 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1483 microversion: 2.25 time: 0.358274 Mar 05 20:55:53.665037 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1047/2149] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:53 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1483 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:53.786278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-62e8b551-acbf-439b-b06b-d89e7be005cf tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:53.786914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-62e8b551-acbf-439b-b06b-d89e7be005cf tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: f4c65952-c3d5-4826-9fe6-48c5f0ec86a7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:53.800506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62e8b551-acbf-439b-b06b-d89e7be005cf tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:53.800866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62e8b551-acbf-439b-b06b-d89e7be005cf tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:53.802240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62e8b551-acbf-439b-b06b-d89e7be005cf tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:53.802868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62e8b551-acbf-439b-b06b-d89e7be005cf tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:53.984854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-62e8b551-acbf-439b-b06b-d89e7be005cf tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:54.002082 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-62e8b551-acbf-439b-b06b-d89e7be005cf tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7" status: 200 len: 1474 microversion: 2.1 time: 0.220007 Mar 05 20:55:54.002735 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1048/2150] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:53 2022] GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7 => generated 1474 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:55:54.009343 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7aad4df0-1089-4577-8603-2606ea263adf req-90eb45fd-32d2-4d79-b842-0c7ec32d6fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c65952-c3d5-4826-9fe6-48c5f0ec86a7", "name": "network-vif-deleted", "tag": "727f750d-d4cf-46e8-b684-69803f8825eb"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:54.033405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7aad4df0-1089-4577-8603-2606ea263adf req-90eb45fd-32d2-4d79-b842-0c7ec32d6fd0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:54.034988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7aad4df0-1089-4577-8603-2606ea263adf req-90eb45fd-32d2-4d79-b842-0c7ec32d6fd0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:54.078272 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7aad4df0-1089-4577-8603-2606ea263adf req-90eb45fd-32d2-4d79-b842-0c7ec32d6fd0 service nova] Creating event network-vif-deleted:727f750d-d4cf-46e8-b684-69803f8825eb for instance f4c65952-c3d5-4826-9fe6-48c5f0ec86a7 on nch1-master-1 Mar 05 20:55:54.090867 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7aad4df0-1089-4577-8603-2606ea263adf req-90eb45fd-32d2-4d79-b842-0c7ec32d6fd0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086212 Mar 05 20:55:54.094686 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1049/2151] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:54.105929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-39fe8424-48bd-4b48-9094-d2f58e567595 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:54.109048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-39fe8424-48bd-4b48-9094-d2f58e567595 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:54.123043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39fe8424-48bd-4b48-9094-d2f58e567595 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:54.125817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39fe8424-48bd-4b48-9094-d2f58e567595 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:54.127424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39fe8424-48bd-4b48-9094-d2f58e567595 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:54.129903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39fe8424-48bd-4b48-9094-d2f58e567595 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:54.280024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-39fe8424-48bd-4b48-9094-d2f58e567595 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:54.293175 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-39fe8424-48bd-4b48-9094-d2f58e567595 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 200 len: 1466 microversion: 2.1 time: 0.195618 Mar 05 20:55:54.307369 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1050/2152] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:54 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 1466 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:54.314181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c2e4a718-8519-4a4a-ab79-d47a3c3f3199 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:54.315326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c2e4a718-8519-4a4a-ab79-d47a3c3f3199 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:54.325995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2e4a718-8519-4a4a-ab79-d47a3c3f3199 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:54.327271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2e4a718-8519-4a4a-ab79-d47a3c3f3199 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:54.329505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2e4a718-8519-4a4a-ab79-d47a3c3f3199 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:54.330251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2e4a718-8519-4a4a-ab79-d47a3c3f3199 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:54.385780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d66918d0-dff8-43fc-930c-dd3e78885222 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:54.395858 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d66918d0-dff8-43fc-930c-dd3e78885222 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 1.040830 Mar 05 20:55:54.396129 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1103/2153] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:53 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:55:54.555224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6b23fb6e-a014-4f70-8937-2c4820eb5f79 req-9662a98a-f5f4-4767-80ab-49ab2cbd6eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b49a93-adf5-4a9e-8359-60d106b3433f", "name": "network-vif-deleted", "tag": "2ca65ea5-4d5f-472b-b108-55db231b87c0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:54.568973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6b23fb6e-a014-4f70-8937-2c4820eb5f79 req-9662a98a-f5f4-4767-80ab-49ab2cbd6eac service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:54.574747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6b23fb6e-a014-4f70-8937-2c4820eb5f79 req-9662a98a-f5f4-4767-80ab-49ab2cbd6eac service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:54.604665 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6b23fb6e-a014-4f70-8937-2c4820eb5f79 req-9662a98a-f5f4-4767-80ab-49ab2cbd6eac service nova] Creating event network-vif-deleted:2ca65ea5-4d5f-472b-b108-55db231b87c0 for instance 28b49a93-adf5-4a9e-8359-60d106b3433f on nch1-master-1 Mar 05 20:55:54.629769 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6b23fb6e-a014-4f70-8937-2c4820eb5f79 req-9662a98a-f5f4-4767-80ab-49ab2cbd6eac service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078002 Mar 05 20:55:54.633114 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1104/2154] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:54.675965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2672c783-c990-44dc-be61-b6ed47567453 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:54.677442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2672c783-c990-44dc-be61-b6ed47567453 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:54.701219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2672c783-c990-44dc-be61-b6ed47567453 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:54.702486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2672c783-c990-44dc-be61-b6ed47567453 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:54.705721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2672c783-c990-44dc-be61-b6ed47567453 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:54.708813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2672c783-c990-44dc-be61-b6ed47567453 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:54.780461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c2e4a718-8519-4a4a-ab79-d47a3c3f3199 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:54.799560 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c2e4a718-8519-4a4a-ab79-d47a3c3f3199 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1308 microversion: 2.1 time: 0.487658 Mar 05 20:55:54.802953 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1051/2155] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:54 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1308 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:55.023570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-27109fc4-cc41-4790-afb0-f60e8d9c8283 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:55.024636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-27109fc4-cc41-4790-afb0-f60e8d9c8283 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: f4c65952-c3d5-4826-9fe6-48c5f0ec86a7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:55.037814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27109fc4-cc41-4790-afb0-f60e8d9c8283 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:55.038893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27109fc4-cc41-4790-afb0-f60e8d9c8283 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:55.039821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27109fc4-cc41-4790-afb0-f60e8d9c8283 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:55.040461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27109fc4-cc41-4790-afb0-f60e8d9c8283 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:55.061109 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-27109fc4-cc41-4790-afb0-f60e8d9c8283 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] HTTP exception thrown: Instance f4c65952-c3d5-4826-9fe6-48c5f0ec86a7 could not be found. Mar 05 20:55:55.062719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-27109fc4-cc41-4790-afb0-f60e8d9c8283 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Returning 404 to user: Instance f4c65952-c3d5-4826-9fe6-48c5f0ec86a7 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:55.064967 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-27109fc4-cc41-4790-afb0-f60e8d9c8283 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7" status: 404 len: 111 microversion: 2.1 time: 0.045909 Mar 05 20:55:55.069681 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1052/2156] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:55 2022] GET /compute/v2.1/servers/f4c65952-c3d5-4826-9fe6-48c5f0ec86a7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:55.079823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c750358a-38b8-43ca-a549-200bfcdaabd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:55.080660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c750358a-38b8-43ca-a549-200bfcdaabd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:55.090724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c750358a-38b8-43ca-a549-200bfcdaabd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:55.091761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c750358a-38b8-43ca-a549-200bfcdaabd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:55.093904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c750358a-38b8-43ca-a549-200bfcdaabd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:55.094733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c750358a-38b8-43ca-a549-200bfcdaabd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:55.122613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2672c783-c990-44dc-be61-b6ed47567453 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:55.148380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c750358a-38b8-43ca-a549-200bfcdaabd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:55:55.152823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2672c783-c990-44dc-be61-b6ed47567453 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:55.154846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2672c783-c990-44dc-be61-b6ed47567453 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:55.161589 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2672c783-c990-44dc-be61-b6ed47567453 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 200 len: 1483 microversion: 2.25 time: 0.487260 Mar 05 20:55:55.162591 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1105/2157] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:54 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 1483 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:55:55.315233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6aa3ec19-ed6f-4d25-8438-af5348e8f7f3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:55.316050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6aa3ec19-ed6f-4d25-8438-af5348e8f7f3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:55.340157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6aa3ec19-ed6f-4d25-8438-af5348e8f7f3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:55.345660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6aa3ec19-ed6f-4d25-8438-af5348e8f7f3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:55.350213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6aa3ec19-ed6f-4d25-8438-af5348e8f7f3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:55.354654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6aa3ec19-ed6f-4d25-8438-af5348e8f7f3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:55.387000 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c750358a-38b8-43ca-a549-200bfcdaabd6 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 204 len: 0 microversion: 2.1 time: 0.314159 Mar 05 20:55:55.387895 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1053/2158] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:55:55 2022] DELETE /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:55:55.404625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-93f0604a-9955-46c2-8533-b1b15fd8f59c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:55.407636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-93f0604a-9955-46c2-8533-b1b15fd8f59c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:55.417560 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-6aa3ec19-ed6f-4d25-8438-af5348e8f7f3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance 28b49a93-adf5-4a9e-8359-60d106b3433f could not be found. Mar 05 20:55:55.419721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93f0604a-9955-46c2-8533-b1b15fd8f59c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:55.420908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93f0604a-9955-46c2-8533-b1b15fd8f59c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:55.421099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6aa3ec19-ed6f-4d25-8438-af5348e8f7f3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance 28b49a93-adf5-4a9e-8359-60d106b3433f could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:55.422130 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6aa3ec19-ed6f-4d25-8438-af5348e8f7f3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 404 len: 111 microversion: 2.1 time: 0.113285 Mar 05 20:55:55.422993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93f0604a-9955-46c2-8533-b1b15fd8f59c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:55.423701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93f0604a-9955-46c2-8533-b1b15fd8f59c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:55.425111 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1106/2159] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:55 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:55:55.454231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e6a64849-2aeb-44a9-84c6-b10bab3ad351 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:55.458364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e6a64849-2aeb-44a9-84c6-b10bab3ad351 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:55.472430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6a64849-2aeb-44a9-84c6-b10bab3ad351 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:55.473197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6a64849-2aeb-44a9-84c6-b10bab3ad351 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:55.474254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6a64849-2aeb-44a9-84c6-b10bab3ad351 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:55.474859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6a64849-2aeb-44a9-84c6-b10bab3ad351 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:55.884573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e6a64849-2aeb-44a9-84c6-b10bab3ad351 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:55.899646 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e6a64849-2aeb-44a9-84c6-b10bab3ad351 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 0.453315 Mar 05 20:55:55.902938 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1107/2160] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:55 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:55.922409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1784507835", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "72f55423-ea6d-4438-a149-d5df19f9ecdd"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:55.970173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-93f0604a-9955-46c2-8533-b1b15fd8f59c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:55.984746 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-93f0604a-9955-46c2-8533-b1b15fd8f59c tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1517 microversion: 2.1 time: 0.591001 Mar 05 20:55:55.985343 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1054/2161] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:55 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1517 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:55.992286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23dafc7a-8b3e-495b-95fd-31db24c33b62 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:55.993261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-23dafc7a-8b3e-495b-95fd-31db24c33b62 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:56.000523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23dafc7a-8b3e-495b-95fd-31db24c33b62 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:56.001188 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23dafc7a-8b3e-495b-95fd-31db24c33b62 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:56.002530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23dafc7a-8b3e-495b-95fd-31db24c33b62 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:56.002876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23dafc7a-8b3e-495b-95fd-31db24c33b62 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:56.095315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] validate_networks() for [('72f55423-ea6d-4438-a149-d5df19f9ecdd', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:55:56.324199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-23dafc7a-8b3e-495b-95fd-31db24c33b62 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:56.341816 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-23dafc7a-8b3e-495b-95fd-31db24c33b62 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1308 microversion: 2.1 time: 0.354991 Mar 05 20:55:56.353179 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1055/2162] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:55 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:56.358950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-860ec825-3cc5-444d-bf69-b061e598bb41 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:56.361116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-860ec825-3cc5-444d-bf69-b061e598bb41 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: f2611e78-13fc-4a02-87a7-af3f7c46ddc0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:56.370745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-860ec825-3cc5-444d-bf69-b061e598bb41 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:56.371311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-860ec825-3cc5-444d-bf69-b061e598bb41 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:56.372249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-860ec825-3cc5-444d-bf69-b061e598bb41 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:56.372978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-860ec825-3cc5-444d-bf69-b061e598bb41 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:56.391406 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-860ec825-3cc5-444d-bf69-b061e598bb41 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] HTTP exception thrown: Instance f2611e78-13fc-4a02-87a7-af3f7c46ddc0 could not be found. Mar 05 20:55:56.394748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-860ec825-3cc5-444d-bf69-b061e598bb41 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Returning 404 to user: Instance f2611e78-13fc-4a02-87a7-af3f7c46ddc0 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:55:56.394748 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-860ec825-3cc5-444d-bf69-b061e598bb41 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0" status: 404 len: 111 microversion: 2.25 time: 0.049227 Mar 05 20:55:56.394748 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1056/2163] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:56 2022] GET /compute/v2.1/servers/f2611e78-13fc-4a02-87a7-af3f7c46ddc0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:55:56.404445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-c1d8f0dd-59ce-48cd-809e-5733872c778d req-9fe4cb8a-7377-40a1-a2ef-656ead84bf27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2611e78-13fc-4a02-87a7-af3f7c46ddc0", "name": "network-vif-deleted", "tag": "449a95d6-0b0c-41dc-8bf1-563531604d17"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:56.416214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c1d8f0dd-59ce-48cd-809e-5733872c778d req-9fe4cb8a-7377-40a1-a2ef-656ead84bf27 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:56.417344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c1d8f0dd-59ce-48cd-809e-5733872c778d req-9fe4cb8a-7377-40a1-a2ef-656ead84bf27 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:56.433750 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-c1d8f0dd-59ce-48cd-809e-5733872c778d req-9fe4cb8a-7377-40a1-a2ef-656ead84bf27 service nova] Creating event network-vif-deleted:449a95d6-0b0c-41dc-8bf1-563531604d17 for instance f2611e78-13fc-4a02-87a7-af3f7c46ddc0 on nch1-master-1 Mar 05 20:55:56.440402 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-c1d8f0dd-59ce-48cd-809e-5733872c778d req-9fe4cb8a-7377-40a1-a2ef-656ead84bf27 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040167 Mar 05 20:55:56.441585 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1057/2164] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:56.770573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:55:56.772264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:55:56.773099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:55:56.773825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:55:56.774516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:55:56.786941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:56.787704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:56.789624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:56.790485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:56.829342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:55:56.835801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for user e8b67d8bbe9a44898a889826e12ffb0b and project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:55:56.861527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:55:56.864777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:55:56.921743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5edbf1b7-a6da-45e6-83c1-5480e872b098 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:56.922708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5edbf1b7-a6da-45e6-83c1-5480e872b098 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:56.932346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5edbf1b7-a6da-45e6-83c1-5480e872b098 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:56.933156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5edbf1b7-a6da-45e6-83c1-5480e872b098 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:56.934252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5edbf1b7-a6da-45e6-83c1-5480e872b098 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:56.934897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5edbf1b7-a6da-45e6-83c1-5480e872b098 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:56.940955 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f709bedf-5a95-41ef-8b29-c27da39a3adb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030875 Mar 05 20:55:56.943115 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1108/2165] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:55:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:55:56.958768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-238ecc76-777b-4865-b09e-5b3c2ea4e9a7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:56.959364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-238ecc76-777b-4865-b09e-5b3c2ea4e9a7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:57.108318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-238ecc76-777b-4865-b09e-5b3c2ea4e9a7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:57.118711 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-238ecc76-777b-4865-b09e-5b3c2ea4e9a7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 200 len: 1215 microversion: 2.1 time: 0.166760 Mar 05 20:55:57.124924 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1109/2166] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:56 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 1215 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:57.140980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e77d1262-7930-4353-90b4-2e5631d55366 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:57.141942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e77d1262-7930-4353-90b4-2e5631d55366 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:57.155973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e77d1262-7930-4353-90b4-2e5631d55366 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:57.156467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e77d1262-7930-4353-90b4-2e5631d55366 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:57.157274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e77d1262-7930-4353-90b4-2e5631d55366 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:57.161404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e77d1262-7930-4353-90b4-2e5631d55366 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:57.238962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5edbf1b7-a6da-45e6-83c1-5480e872b098 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:57.252182 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5edbf1b7-a6da-45e6-83c1-5480e872b098 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 0.335722 Mar 05 20:55:57.253051 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1058/2167] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:56 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:57.362480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd2437c3-4049-4dc3-ba9f-0ede4748351d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:57.364345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd2437c3-4049-4dc3-ba9f-0ede4748351d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:57.373138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd2437c3-4049-4dc3-ba9f-0ede4748351d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:57.373621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd2437c3-4049-4dc3-ba9f-0ede4748351d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:57.374693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd2437c3-4049-4dc3-ba9f-0ede4748351d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:57.375322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd2437c3-4049-4dc3-ba9f-0ede4748351d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:57.648052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd2437c3-4049-4dc3-ba9f-0ede4748351d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:57.660870 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd2437c3-4049-4dc3-ba9f-0ede4748351d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1308 microversion: 2.1 time: 0.303173 Mar 05 20:55:57.661464 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1059/2168] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:57 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:57.691058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dc566112-da88-4f82-96a3-8e4432834241 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:57.692159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dc566112-da88-4f82-96a3-8e4432834241 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:57.692634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e77d1262-7930-4353-90b4-2e5631d55366 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:57.702138 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e77d1262-7930-4353-90b4-2e5631d55366 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1517 microversion: 2.1 time: 0.575333 Mar 05 20:55:57.708948 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1110/2169] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:57 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1517 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:57.723064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc566112-da88-4f82-96a3-8e4432834241 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:57.725146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-43c6cda9-6101-4976-9039-4c6947117753 req-b92dee2e-2479-4f59-aa27-0dedbc8172cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1c9b56-f7e9-411e-bd5d-71b8230e4b19", "name": "network-vif-plugged", "status": "completed", "tag": "c9f91447-b5aa-4520-9cac-255e0c084b36"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:57.725309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc566112-da88-4f82-96a3-8e4432834241 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:57.727267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc566112-da88-4f82-96a3-8e4432834241 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:57.729088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc566112-da88-4f82-96a3-8e4432834241 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:57.759302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-43c6cda9-6101-4976-9039-4c6947117753 req-b92dee2e-2479-4f59-aa27-0dedbc8172cd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:57.761434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-43c6cda9-6101-4976-9039-4c6947117753 req-b92dee2e-2479-4f59-aa27-0dedbc8172cd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:57.800099 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-43c6cda9-6101-4976-9039-4c6947117753 req-b92dee2e-2479-4f59-aa27-0dedbc8172cd service nova] Creating event network-vif-plugged:c9f91447-b5aa-4520-9cac-255e0c084b36 for instance 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 on nch2-master-1 Mar 05 20:55:57.809204 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-43c6cda9-6101-4976-9039-4c6947117753 req-b92dee2e-2479-4f59-aa27-0dedbc8172cd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087917 Mar 05 20:55:57.810075 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1111/2170] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:57.813388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dc566112-da88-4f82-96a3-8e4432834241 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:55:58.029830 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dc566112-da88-4f82-96a3-8e4432834241 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 204 len: 0 microversion: 2.25 time: 0.363814 Mar 05 20:55:58.030821 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1060/2171] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 20:55:57 2022] DELETE /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:55:58.063925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5e8f2677-6b17-45db-b4a4-35b10afb43e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:58.066132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5e8f2677-6b17-45db-b4a4-35b10afb43e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:58.082733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e8f2677-6b17-45db-b4a4-35b10afb43e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:58.083215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e8f2677-6b17-45db-b4a4-35b10afb43e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:58.084407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e8f2677-6b17-45db-b4a4-35b10afb43e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:58.085545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e8f2677-6b17-45db-b4a4-35b10afb43e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:58.145038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c86c89f1-5ec4-483c-9696-d2d0dbcdd1ca tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:58.146151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c86c89f1-5ec4-483c-9696-d2d0dbcdd1ca tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:58.156608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c86c89f1-5ec4-483c-9696-d2d0dbcdd1ca tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:58.157423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c86c89f1-5ec4-483c-9696-d2d0dbcdd1ca tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:58.158613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c86c89f1-5ec4-483c-9696-d2d0dbcdd1ca tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:58.159260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c86c89f1-5ec4-483c-9696-d2d0dbcdd1ca tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:58.308034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c86c89f1-5ec4-483c-9696-d2d0dbcdd1ca tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:58.323594 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c86c89f1-5ec4-483c-9696-d2d0dbcdd1ca tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 200 len: 1219 microversion: 2.1 time: 0.180177 Mar 05 20:55:58.324750 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1061/2172] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:58 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 1219 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:58.345443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ba920d31-94ac-4797-9394-5db65ba7fae4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:58.346676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ba920d31-94ac-4797-9394-5db65ba7fae4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:58.369664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ba920d31-94ac-4797-9394-5db65ba7fae4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:58.371550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ba920d31-94ac-4797-9394-5db65ba7fae4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:58.372761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ba920d31-94ac-4797-9394-5db65ba7fae4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:58.373419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ba920d31-94ac-4797-9394-5db65ba7fae4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:58.507402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5e8f2677-6b17-45db-b4a4-35b10afb43e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:58.528095 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5e8f2677-6b17-45db-b4a4-35b10afb43e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:58.530761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5e8f2677-6b17-45db-b4a4-35b10afb43e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:58.532631 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5e8f2677-6b17-45db-b4a4-35b10afb43e7 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1564 microversion: 2.25 time: 0.494192 Mar 05 20:55:58.533324 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1112/2173] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:58 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1564 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:55:58.537672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-8b886120-0843-4441-af1a-dc748ff4ce63 req-61d5ea80-f6e2-40f5-876e-c1b222fe6582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbb1c17-d366-4ba5-9665-68a62f95f341", "name": "network-vif-deleted", "tag": "de431d40-486f-404d-9b88-d63c337d45e9"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:55:58.548718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8b886120-0843-4441-af1a-dc748ff4ce63 req-61d5ea80-f6e2-40f5-876e-c1b222fe6582 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:58.549166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8b886120-0843-4441-af1a-dc748ff4ce63 req-61d5ea80-f6e2-40f5-876e-c1b222fe6582 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:58.564531 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-8b886120-0843-4441-af1a-dc748ff4ce63 req-61d5ea80-f6e2-40f5-876e-c1b222fe6582 service nova] Creating event network-vif-deleted:de431d40-486f-404d-9b88-d63c337d45e9 for instance 6fbb1c17-d366-4ba5-9665-68a62f95f341 on nch2-master-1 Mar 05 20:55:58.570379 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-8b886120-0843-4441-af1a-dc748ff4ce63 req-61d5ea80-f6e2-40f5-876e-c1b222fe6582 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035984 Mar 05 20:55:58.571746 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1113/2174] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:55:58.681927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e85c1c0d-6f62-4411-8b77-8f3a82e19518 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:58.683012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e85c1c0d-6f62-4411-8b77-8f3a82e19518 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:58.692109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e85c1c0d-6f62-4411-8b77-8f3a82e19518 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:58.692809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e85c1c0d-6f62-4411-8b77-8f3a82e19518 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:58.694829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e85c1c0d-6f62-4411-8b77-8f3a82e19518 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:58.695468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e85c1c0d-6f62-4411-8b77-8f3a82e19518 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:58.753420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ba920d31-94ac-4797-9394-5db65ba7fae4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:58.763174 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ba920d31-94ac-4797-9394-5db65ba7fae4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 0.436708 Mar 05 20:55:58.763795 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1062/2175] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:58 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:58.777003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bbba22b5-eaaa-45d9-9399-29a7f967f228 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:58.778679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bbba22b5-eaaa-45d9-9399-29a7f967f228 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:58.795762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bbba22b5-eaaa-45d9-9399-29a7f967f228 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:58.797670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bbba22b5-eaaa-45d9-9399-29a7f967f228 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:58.800900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bbba22b5-eaaa-45d9-9399-29a7f967f228 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:58.802642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bbba22b5-eaaa-45d9-9399-29a7f967f228 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:58.900908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bbba22b5-eaaa-45d9-9399-29a7f967f228 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:58.903326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bbba22b5-eaaa-45d9-9399-29a7f967f228 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:58.905549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-bbba22b5-eaaa-45d9-9399-29a7f967f228 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lazy-loading 'fault' on Instance uuid 6fbb1c17-d366-4ba5-9665-68a62f95f341 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:55:59.008739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bbba22b5-eaaa-45d9-9399-29a7f967f228 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a21adbe60d34fdf81d780364a0c4367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f868fae33d848129fabf0f797c73be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:59.009409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e85c1c0d-6f62-4411-8b77-8f3a82e19518 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:59.023463 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e85c1c0d-6f62-4411-8b77-8f3a82e19518 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1308 microversion: 2.1 time: 0.346258 Mar 05 20:55:59.024855 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bbba22b5-eaaa-45d9-9399-29a7f967f228 tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 200 len: 1310 microversion: 2.1 time: 0.257901 Mar 05 20:55:59.026197 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1063/2176] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:58 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 1310 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:59.030238 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1114/2177] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:58 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1308 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:59.347207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c986a5df-a096-4cec-9864-a6cd31aa1404 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:59.348283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c986a5df-a096-4cec-9864-a6cd31aa1404 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:59.369072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c986a5df-a096-4cec-9864-a6cd31aa1404 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:59.369937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c986a5df-a096-4cec-9864-a6cd31aa1404 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:59.370514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c986a5df-a096-4cec-9864-a6cd31aa1404 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:59.371191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c986a5df-a096-4cec-9864-a6cd31aa1404 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:59.495797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c986a5df-a096-4cec-9864-a6cd31aa1404 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:55:59.516028 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c986a5df-a096-4cec-9864-a6cd31aa1404 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 200 len: 1273 microversion: 2.1 time: 0.176237 Mar 05 20:55:59.517203 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1064/2178] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:55:59 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:55:59.552417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f3ce80b9-b251-4180-862e-1ae84fce7d5d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:59.553080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f3ce80b9-b251-4180-862e-1ae84fce7d5d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:59.572276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3ce80b9-b251-4180-862e-1ae84fce7d5d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:59.575257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3ce80b9-b251-4180-862e-1ae84fce7d5d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:59.576553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3ce80b9-b251-4180-862e-1ae84fce7d5d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:59.577319 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3ce80b9-b251-4180-862e-1ae84fce7d5d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:59.760050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-78437ed9-b12a-4963-9e06-4ac92f590e86 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:55:59.760757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-78437ed9-b12a-4963-9e06-4ac92f590e86 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:55:59.767531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78437ed9-b12a-4963-9e06-4ac92f590e86 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:59.768025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78437ed9-b12a-4963-9e06-4ac92f590e86 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:55:59.769036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78437ed9-b12a-4963-9e06-4ac92f590e86 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:55:59.769837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78437ed9-b12a-4963-9e06-4ac92f590e86 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:00.106662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f3ce80b9-b251-4180-862e-1ae84fce7d5d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:00.116148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f3ce80b9-b251-4180-862e-1ae84fce7d5d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:00.121232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f3ce80b9-b251-4180-862e-1ae84fce7d5d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:00.124994 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f3ce80b9-b251-4180-862e-1ae84fce7d5d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 200 len: 1564 microversion: 2.25 time: 0.574426 Mar 05 20:56:00.129623 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1115/2179] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:59 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 1564 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:56:00.137521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7a7ca8c3-4bce-4afb-914b-824c5931cc07 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:00.138406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7a7ca8c3-4bce-4afb-914b-824c5931cc07 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:00.158270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a7ca8c3-4bce-4afb-914b-824c5931cc07 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:00.158734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a7ca8c3-4bce-4afb-914b-824c5931cc07 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:00.159539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a7ca8c3-4bce-4afb-914b-824c5931cc07 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:00.160075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a7ca8c3-4bce-4afb-914b-824c5931cc07 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:00.372385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-78437ed9-b12a-4963-9e06-4ac92f590e86 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:00.393037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-78437ed9-b12a-4963-9e06-4ac92f590e86 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:00.398481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-78437ed9-b12a-4963-9e06-4ac92f590e86 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:00.404545 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-78437ed9-b12a-4963-9e06-4ac92f590e86 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 2943 microversion: 2.32 time: 0.647192 Mar 05 20:56:00.408360 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1065/2180] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:55:59 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 2943 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:56:00.414202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-68294333-8208-4158-8ff7-fcf8632d609e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:00.414854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-68294333-8208-4158-8ff7-fcf8632d609e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] [instance: 6fbb1c17-d366-4ba5-9665-68a62f95f341] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:00.449697 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68294333-8208-4158-8ff7-fcf8632d609e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:00.451185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68294333-8208-4158-8ff7-fcf8632d609e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:00.454861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68294333-8208-4158-8ff7-fcf8632d609e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:00.458197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68294333-8208-4158-8ff7-fcf8632d609e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:00.513267 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-68294333-8208-4158-8ff7-fcf8632d609e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] HTTP exception thrown: Instance 6fbb1c17-d366-4ba5-9665-68a62f95f341 could not be found. Mar 05 20:56:00.514490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-68294333-8208-4158-8ff7-fcf8632d609e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] Returning 404 to user: Instance 6fbb1c17-d366-4ba5-9665-68a62f95f341 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:00.515543 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-68294333-8208-4158-8ff7-fcf8632d609e tempest-ListServerFiltersTestJSON-647599521 tempest-ListServerFiltersTestJSON-647599521-project] 10.222.0.15 "GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341" status: 404 len: 111 microversion: 2.1 time: 0.105987 Mar 05 20:56:00.516269 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1066/2181] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:00 2022] GET /compute/v2.1/servers/6fbb1c17-d366-4ba5-9665-68a62f95f341 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:00.527203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-68d792c4-5cd4-40cf-984f-6a93390da5ec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:00.528724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-68d792c4-5cd4-40cf-984f-6a93390da5ec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:00.537605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68d792c4-5cd4-40cf-984f-6a93390da5ec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:00.539923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68d792c4-5cd4-40cf-984f-6a93390da5ec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:00.540958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68d792c4-5cd4-40cf-984f-6a93390da5ec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:00.542485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68d792c4-5cd4-40cf-984f-6a93390da5ec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:00.555090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7a7ca8c3-4bce-4afb-914b-824c5931cc07 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:00.574070 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7a7ca8c3-4bce-4afb-914b-824c5931cc07 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 0.441360 Mar 05 20:56:00.575892 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1116/2182] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:00 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:00.598619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-d2de7f1d-91d0-4fda-bd76-ff15ae19f736 req-fc080047-11bc-43d5-ad15-d9833c0492db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019a8023-9015-41ae-974a-eb725177770d", "name": "network-vif-deleted", "tag": "38ee5a79-ec27-42bc-985c-95ae7544d810"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:00.634542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d2de7f1d-91d0-4fda-bd76-ff15ae19f736 req-fc080047-11bc-43d5-ad15-d9833c0492db service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:00.635918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d2de7f1d-91d0-4fda-bd76-ff15ae19f736 req-fc080047-11bc-43d5-ad15-d9833c0492db service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:00.670462 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-d2de7f1d-91d0-4fda-bd76-ff15ae19f736 req-fc080047-11bc-43d5-ad15-d9833c0492db service nova] Creating event network-vif-deleted:38ee5a79-ec27-42bc-985c-95ae7544d810 for instance 019a8023-9015-41ae-974a-eb725177770d on nch1-master-1 Mar 05 20:56:00.689191 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-d2de7f1d-91d0-4fda-bd76-ff15ae19f736 req-fc080047-11bc-43d5-ad15-d9833c0492db service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108462 Mar 05 20:56:00.692163 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1117/2183] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:00.715182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-26ced3e7-94cc-499e-9e5c-9d8cdf466285 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:00.716245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-26ced3e7-94cc-499e-9e5c-9d8cdf466285 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:00.727405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26ced3e7-94cc-499e-9e5c-9d8cdf466285 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:00.728127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26ced3e7-94cc-499e-9e5c-9d8cdf466285 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:00.729096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26ced3e7-94cc-499e-9e5c-9d8cdf466285 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:00.729700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26ced3e7-94cc-499e-9e5c-9d8cdf466285 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:01.002390 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-26ced3e7-94cc-499e-9e5c-9d8cdf466285 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.303268 Mar 05 20:56:01.003487 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1118/2184] 10.222.0.15 () {60 vars in 1315 bytes} [Sat Mar 5 20:56:00 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77/os-interface => generated 1830 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:56:01.018770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6f9dad8e-968f-4302-bf66-34a0f04128c8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:01.019688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6f9dad8e-968f-4302-bf66-34a0f04128c8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:01.034674 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f9dad8e-968f-4302-bf66-34a0f04128c8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:01.040696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f9dad8e-968f-4302-bf66-34a0f04128c8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:01.042405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f9dad8e-968f-4302-bf66-34a0f04128c8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:01.043042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f9dad8e-968f-4302-bf66-34a0f04128c8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:01.226246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-68d792c4-5cd4-40cf-984f-6a93390da5ec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:01.238349 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-68d792c4-5cd4-40cf-984f-6a93390da5ec tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1487 microversion: 2.1 time: 0.720025 Mar 05 20:56:01.238933 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1067/2185] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:00 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1487 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:01.293092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d695f0f1-aec0-4f68-8997-229b74a63ece tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:01.294176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d695f0f1-aec0-4f68-8997-229b74a63ece tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 019a8023-9015-41ae-974a-eb725177770d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:01.302085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d695f0f1-aec0-4f68-8997-229b74a63ece tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:01.302642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d695f0f1-aec0-4f68-8997-229b74a63ece tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:01.303872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d695f0f1-aec0-4f68-8997-229b74a63ece tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:01.305095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d695f0f1-aec0-4f68-8997-229b74a63ece tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:01.334121 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-d695f0f1-aec0-4f68-8997-229b74a63ece tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] HTTP exception thrown: Instance 019a8023-9015-41ae-974a-eb725177770d could not be found. Mar 05 20:56:01.336760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d695f0f1-aec0-4f68-8997-229b74a63ece tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Returning 404 to user: Instance 019a8023-9015-41ae-974a-eb725177770d could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:01.337897 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d695f0f1-aec0-4f68-8997-229b74a63ece tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d" status: 404 len: 111 microversion: 2.25 time: 0.086439 Mar 05 20:56:01.339079 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1068/2186] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:56:01 2022] GET /compute/v2.1/servers/019a8023-9015-41ae-974a-eb725177770d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:56:01.345958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d33f46af-2deb-472e-9b33-45cb7f5b98ef tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2026547583"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:01.347382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d33f46af-2deb-472e-9b33-45cb7f5b98ef tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:01.355838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d33f46af-2deb-472e-9b33-45cb7f5b98ef tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:01.356720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d33f46af-2deb-472e-9b33-45cb7f5b98ef tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:01.357844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d33f46af-2deb-472e-9b33-45cb7f5b98ef tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:01.358577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d33f46af-2deb-472e-9b33-45cb7f5b98ef tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:01.520010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6f9dad8e-968f-4302-bf66-34a0f04128c8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:01.531455 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6f9dad8e-968f-4302-bf66-34a0f04128c8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 200 len: 1315 microversion: 2.1 time: 0.526710 Mar 05 20:56:01.534223 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1119/2187] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:01 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:01.547086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b57a259a-c84d-4819-be48-f706eb2d622d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:01.549496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b57a259a-c84d-4819-be48-f706eb2d622d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:01.568123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b57a259a-c84d-4819-be48-f706eb2d622d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:01.568588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b57a259a-c84d-4819-be48-f706eb2d622d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:01.570920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b57a259a-c84d-4819-be48-f706eb2d622d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:01.571396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b57a259a-c84d-4819-be48-f706eb2d622d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:01.651715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b57a259a-c84d-4819-be48-f706eb2d622d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:56:01.881718 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d33f46af-2deb-472e-9b33-45cb7f5b98ef tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "POST /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19/action" status: 202 len: 0 microversion: 2.1 time: 0.532516 Mar 05 20:56:01.884868 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1069/2188] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:56:01 2022] POST /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 20:56:01.900496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b4c67639-0abf-4534-9dd0-2ec2ddcfca7b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:01.904499 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b4c67639-0abf-4534-9dd0-2ec2ddcfca7b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:01.923010 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b57a259a-c84d-4819-be48-f706eb2d622d tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 204 len: 0 microversion: 2.25 time: 0.384436 Mar 05 20:56:01.924324 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1120/2189] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 20:56:01 2022] DELETE /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:56:01.930873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4c67639-0abf-4534-9dd0-2ec2ddcfca7b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:01.931478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4c67639-0abf-4534-9dd0-2ec2ddcfca7b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:01.935287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4c67639-0abf-4534-9dd0-2ec2ddcfca7b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:01.937577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4c67639-0abf-4534-9dd0-2ec2ddcfca7b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:01.949935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-85f3aa4b-1147-4661-95c1-0c918a70c44a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c221550>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:02.016619 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-85f3aa4b-1147-4661-95c1-0c918a70c44a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5e41ef8-ec7e-4d4a-8594-11325b7a3fc5" status: 200 len: 1412 microversion: 2.1 time: 0.090734 Mar 05 20:56:02.017493 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1121/2190] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:56:01 2022] GET /compute/v2.1/images/a5e41ef8-ec7e-4d4a-8594-11325b7a3fc5 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:02.025525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-31f48758-bdf2-4c54-9e68-079f6f7293c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:02.026544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-31f48758-bdf2-4c54-9e68-079f6f7293c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:02.034423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31f48758-bdf2-4c54-9e68-079f6f7293c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:02.036003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31f48758-bdf2-4c54-9e68-079f6f7293c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:02.037103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31f48758-bdf2-4c54-9e68-079f6f7293c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:02.040596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31f48758-bdf2-4c54-9e68-079f6f7293c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:02.520474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-31f48758-bdf2-4c54-9e68-079f6f7293c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:02.534555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-31f48758-bdf2-4c54-9e68-079f6f7293c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:02.539368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-31f48758-bdf2-4c54-9e68-079f6f7293c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:02.543453 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-31f48758-bdf2-4c54-9e68-079f6f7293c5 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1549 microversion: 2.25 time: 0.524567 Mar 05 20:56:02.546238 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1122/2191] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:56:02 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1549 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:56:02.552648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c806a22-44f1-45a3-84b9-7f3c8e4b282d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed61ada430>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:02.626959 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c806a22-44f1-45a3-84b9-7f3c8e4b282d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5e41ef8-ec7e-4d4a-8594-11325b7a3fc5" status: 200 len: 1412 microversion: 2.1 time: 0.079563 Mar 05 20:56:02.629726 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1123/2192] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:56:02 2022] GET /compute/v2.1/images/a5e41ef8-ec7e-4d4a-8594-11325b7a3fc5 => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:02.641088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-2a421e39-a9cb-4b9a-b1b1-a7054042a271 req-73876acf-3ccf-4d03-8de3-5db875484d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1527592-5a69-44bf-ac58-d019d5ee71ac", "tag": "5586f1d6-6aa1-482b-ae10-2cd96cf1d45d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:02.662428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2a421e39-a9cb-4b9a-b1b1-a7054042a271 req-73876acf-3ccf-4d03-8de3-5db875484d18 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:02.662885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2a421e39-a9cb-4b9a-b1b1-a7054042a271 req-73876acf-3ccf-4d03-8de3-5db875484d18 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:02.675186 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-2a421e39-a9cb-4b9a-b1b1-a7054042a271 req-73876acf-3ccf-4d03-8de3-5db875484d18 service nova] Creating event network-changed:5586f1d6-6aa1-482b-ae10-2cd96cf1d45d for instance e1527592-5a69-44bf-ac58-d019d5ee71ac on nch2-master-1 Mar 05 20:56:02.681434 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-2a421e39-a9cb-4b9a-b1b1-a7054042a271 req-73876acf-3ccf-4d03-8de3-5db875484d18 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049827 Mar 05 20:56:02.682353 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1124/2193] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:02.688615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-747fbbf4-b125-4573-88b7-1b9c46209baf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:02.689815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-747fbbf4-b125-4573-88b7-1b9c46209baf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:02.699015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-747fbbf4-b125-4573-88b7-1b9c46209baf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:02.700290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-747fbbf4-b125-4573-88b7-1b9c46209baf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:02.701731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-747fbbf4-b125-4573-88b7-1b9c46209baf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:02.702430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-747fbbf4-b125-4573-88b7-1b9c46209baf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:03.380426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-747fbbf4-b125-4573-88b7-1b9c46209baf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:03.395350 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-747fbbf4-b125-4573-88b7-1b9c46209baf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 200 len: 1315 microversion: 2.1 time: 0.711615 Mar 05 20:56:03.397259 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1125/2194] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:02 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:03.404854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-20d6a791-90c2-41e3-a04f-b4ad61b2225a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed61ada820>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:03.629101 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-20d6a791-90c2-41e3-a04f-b4ad61b2225a tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/images/a5e41ef8-ec7e-4d4a-8594-11325b7a3fc5" status: 204 len: 0 microversion: 2.1 time: 0.229586 Mar 05 20:56:03.630952 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1126/2195] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:03 2022] DELETE /compute/v2.1/images/a5e41ef8-ec7e-4d4a-8594-11325b7a3fc5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:03.638134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d09d385d-7390-4529-8fab-21615c371533 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:03.638758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d09d385d-7390-4529-8fab-21615c371533 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:03.649096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d09d385d-7390-4529-8fab-21615c371533 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:03.655314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d09d385d-7390-4529-8fab-21615c371533 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:03.656388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d09d385d-7390-4529-8fab-21615c371533 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:03.657016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d09d385d-7390-4529-8fab-21615c371533 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:03.682819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b4c67639-0abf-4534-9dd0-2ec2ddcfca7b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:03.690435 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b4c67639-0abf-4534-9dd0-2ec2ddcfca7b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 1.803281 Mar 05 20:56:03.691020 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1070/2196] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:01 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:03.708993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-93f23d98-3a9f-4eb6-a9e3-fc8486ac6226 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c1f6430>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:03.735141 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-93f23d98-3a9f-4eb6-a9e3-fc8486ac6226 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] HTTP exception thrown: Image not found. Mar 05 20:56:03.735811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-93f23d98-3a9f-4eb6-a9e3-fc8486ac6226 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Returning 404 to user: Image not found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:03.736642 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-93f23d98-3a9f-4eb6-a9e3-fc8486ac6226 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/images/a5e41ef8-ec7e-4d4a-8594-11325b7a3fc5" status: 404 len: 62 microversion: 2.1 time: 0.031834 Mar 05 20:56:03.740445 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1071/2197] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:56:03 2022] GET /compute/v2.1/images/a5e41ef8-ec7e-4d4a-8594-11325b7a3fc5 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:56:03.745973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-418b0414-8bd6-4ee7-96a0-c345d0df817d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:03.746805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-418b0414-8bd6-4ee7-96a0-c345d0df817d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:03.754378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-418b0414-8bd6-4ee7-96a0-c345d0df817d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:03.754842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-418b0414-8bd6-4ee7-96a0-c345d0df817d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:03.755630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-418b0414-8bd6-4ee7-96a0-c345d0df817d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:03.756156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-418b0414-8bd6-4ee7-96a0-c345d0df817d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:04.078040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d09d385d-7390-4529-8fab-21615c371533 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:04.089540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d09d385d-7390-4529-8fab-21615c371533 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:04.092023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d09d385d-7390-4529-8fab-21615c371533 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:04.094574 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d09d385d-7390-4529-8fab-21615c371533 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1549 microversion: 2.25 time: 0.461480 Mar 05 20:56:04.095489 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1127/2198] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:56:03 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1549 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:56:04.326750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-418b0414-8bd6-4ee7-96a0-c345d0df817d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:04.343324 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-418b0414-8bd6-4ee7-96a0-c345d0df817d tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1505 microversion: 2.1 time: 0.601463 Mar 05 20:56:04.345621 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1072/2199] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:03 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:04.418239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-51d09b91-777d-4b3c-8d5f-ec34ba32d47d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:04.419077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-51d09b91-777d-4b3c-8d5f-ec34ba32d47d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:04.425978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51d09b91-777d-4b3c-8d5f-ec34ba32d47d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:04.426857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51d09b91-777d-4b3c-8d5f-ec34ba32d47d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:04.427901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51d09b91-777d-4b3c-8d5f-ec34ba32d47d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:04.428755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51d09b91-777d-4b3c-8d5f-ec34ba32d47d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:04.703468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-51d09b91-777d-4b3c-8d5f-ec34ba32d47d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:04.715511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ecd56660-c968-42dc-8199-e18bfcf5aa08 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:04.717032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ecd56660-c968-42dc-8199-e18bfcf5aa08 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:04.717986 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-51d09b91-777d-4b3c-8d5f-ec34ba32d47d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 200 len: 1315 microversion: 2.1 time: 0.306647 Mar 05 20:56:04.719688 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1128/2200] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:04 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:04.733517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ecd56660-c968-42dc-8199-e18bfcf5aa08 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:04.734134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ecd56660-c968-42dc-8199-e18bfcf5aa08 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:04.735026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ecd56660-c968-42dc-8199-e18bfcf5aa08 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:04.735603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ecd56660-c968-42dc-8199-e18bfcf5aa08 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:05.123917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-783771fa-00ad-4904-abb1-f7b325a423cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:05.124736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-783771fa-00ad-4904-abb1-f7b325a423cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:05.148375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-783771fa-00ad-4904-abb1-f7b325a423cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:05.149499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-783771fa-00ad-4904-abb1-f7b325a423cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:05.150523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-783771fa-00ad-4904-abb1-f7b325a423cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:05.161070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-783771fa-00ad-4904-abb1-f7b325a423cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:05.192518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ecd56660-c968-42dc-8199-e18bfcf5aa08 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:05.202265 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ecd56660-c968-42dc-8199-e18bfcf5aa08 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 0.494848 Mar 05 20:56:05.204958 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1073/2201] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:04 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:05.210838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-28c35321-2976-4101-810a-4eaf4a1af8c1 req-de91541b-3b78-4d7f-8c2d-a2f26c33fe0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd", "name": "network-vif-deleted", "tag": "675294b3-97d2-451e-9c82-33eef5c81bf5"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:05.219412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-28c35321-2976-4101-810a-4eaf4a1af8c1 req-de91541b-3b78-4d7f-8c2d-a2f26c33fe0d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:05.220157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-28c35321-2976-4101-810a-4eaf4a1af8c1 req-de91541b-3b78-4d7f-8c2d-a2f26c33fe0d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:05.234823 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-28c35321-2976-4101-810a-4eaf4a1af8c1 req-de91541b-3b78-4d7f-8c2d-a2f26c33fe0d service nova] Creating event network-vif-deleted:675294b3-97d2-451e-9c82-33eef5c81bf5 for instance fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd on nch1-master-1 Mar 05 20:56:05.245792 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-28c35321-2976-4101-810a-4eaf4a1af8c1 req-de91541b-3b78-4d7f-8c2d-a2f26c33fe0d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039353 Mar 05 20:56:05.246587 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1074/2202] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:05.321693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-783771fa-00ad-4904-abb1-f7b325a423cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:05.332404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-783771fa-00ad-4904-abb1-f7b325a423cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:05.335581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-783771fa-00ad-4904-abb1-f7b325a423cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:05.337272 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-783771fa-00ad-4904-abb1-f7b325a423cd tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 200 len: 1507 microversion: 2.25 time: 0.218298 Mar 05 20:56:05.338569 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1129/2203] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:56:05 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:56:05.364222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-828f546e-dc55-4a8c-bbc7-e0abf1f15de2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:05.364956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-828f546e-dc55-4a8c-bbc7-e0abf1f15de2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:05.377564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-828f546e-dc55-4a8c-bbc7-e0abf1f15de2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:05.378042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-828f546e-dc55-4a8c-bbc7-e0abf1f15de2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:05.378855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-828f546e-dc55-4a8c-bbc7-e0abf1f15de2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:05.379308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-828f546e-dc55-4a8c-bbc7-e0abf1f15de2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:05.643740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-828f546e-dc55-4a8c-bbc7-e0abf1f15de2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:05.654393 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-828f546e-dc55-4a8c-bbc7-e0abf1f15de2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1487 microversion: 2.1 time: 0.295346 Mar 05 20:56:05.655312 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1075/2204] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:05 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1487 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:05.673667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b42cd2c9-4586-4ef0-a065-b31a023ed901 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:05.674703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b42cd2c9-4586-4ef0-a065-b31a023ed901 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:05.695988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b42cd2c9-4586-4ef0-a065-b31a023ed901 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:05.698678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b42cd2c9-4586-4ef0-a065-b31a023ed901 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:05.705267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b42cd2c9-4586-4ef0-a065-b31a023ed901 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:05.707597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b42cd2c9-4586-4ef0-a065-b31a023ed901 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:05.737938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-14eb94c1-e605-482f-b17e-d667692c6415 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:05.738570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-14eb94c1-e605-482f-b17e-d667692c6415 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:05.749235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14eb94c1-e605-482f-b17e-d667692c6415 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:05.751177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14eb94c1-e605-482f-b17e-d667692c6415 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:05.755415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14eb94c1-e605-482f-b17e-d667692c6415 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:05.756689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14eb94c1-e605-482f-b17e-d667692c6415 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:05.815607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b42cd2c9-4586-4ef0-a065-b31a023ed901 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:56:06.077622 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b42cd2c9-4586-4ef0-a065-b31a023ed901 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 204 len: 0 microversion: 2.1 time: 0.407585 Mar 05 20:56:06.078708 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1130/2205] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:05 2022] DELETE /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:06.093208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ac47f75c-3dac-4bf9-844b-dbeed0e61da2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c241f70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:06.120139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-14eb94c1-e605-482f-b17e-d667692c6415 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:06.129775 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-14eb94c1-e605-482f-b17e-d667692c6415 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 200 len: 1315 microversion: 2.1 time: 0.396503 Mar 05 20:56:06.132007 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-ac47f75c-3dac-4bf9-844b-dbeed0e61da2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] HTTP exception thrown: Image not found. Mar 05 20:56:06.133949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ac47f75c-3dac-4bf9-844b-dbeed0e61da2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Returning 404 to user: Image not found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:06.134579 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1076/2206] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:05 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:06.136262 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ac47f75c-3dac-4bf9-844b-dbeed0e61da2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/images/a5e41ef8-ec7e-4d4a-8594-11325b7a3fc5" status: 404 len: 62 microversion: 2.1 time: 0.048572 Mar 05 20:56:06.138158 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1131/2207] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:06 2022] DELETE /compute/v2.1/images/a5e41ef8-ec7e-4d4a-8594-11325b7a3fc5 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:56:06.146969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a7958bd4-ac38-46a4-93f1-5f674b5015ea tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:06.153535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a7958bd4-ac38-46a4-93f1-5f674b5015ea tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:06.168307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7958bd4-ac38-46a4-93f1-5f674b5015ea tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:06.168714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7958bd4-ac38-46a4-93f1-5f674b5015ea tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:06.169866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7958bd4-ac38-46a4-93f1-5f674b5015ea tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:06.172771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7958bd4-ac38-46a4-93f1-5f674b5015ea tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:06.224572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a7958bd4-ac38-46a4-93f1-5f674b5015ea tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:56:06.225010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1cae9cfe-d73f-4d91-8e93-235e6f9a98d8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:06.225947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1cae9cfe-d73f-4d91-8e93-235e6f9a98d8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:06.250080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cae9cfe-d73f-4d91-8e93-235e6f9a98d8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:06.252586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cae9cfe-d73f-4d91-8e93-235e6f9a98d8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:06.257453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cae9cfe-d73f-4d91-8e93-235e6f9a98d8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:06.261521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cae9cfe-d73f-4d91-8e93-235e6f9a98d8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:06.326697 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.compute.api [None req-a7958bd4-ac38-46a4-93f1-5f674b5015ea tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Instance is already in deleting state, ignoring this request Mar 05 20:56:06.327754 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a7958bd4-ac38-46a4-93f1-5f674b5015ea tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 204 len: 0 microversion: 2.1 time: 0.185264 Mar 05 20:56:06.340763 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1077/2208] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:06 2022] DELETE /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:06.347103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5576d491-f4d7-48b1-8ac3-376d9a031ffa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:06.351396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5576d491-f4d7-48b1-8ac3-376d9a031ffa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:06.359064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5576d491-f4d7-48b1-8ac3-376d9a031ffa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:06.359810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5576d491-f4d7-48b1-8ac3-376d9a031ffa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:06.361602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5576d491-f4d7-48b1-8ac3-376d9a031ffa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:06.362282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5576d491-f4d7-48b1-8ac3-376d9a031ffa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:06.672367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5576d491-f4d7-48b1-8ac3-376d9a031ffa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:06.685024 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5576d491-f4d7-48b1-8ac3-376d9a031ffa tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1493 microversion: 2.1 time: 0.342280 Mar 05 20:56:06.698279 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1078/2209] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:06 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1493 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:06.707075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d730254f-e570-4ab2-b14d-695b9f35b680 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:06.707459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d730254f-e570-4ab2-b14d-695b9f35b680 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:06.717273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d730254f-e570-4ab2-b14d-695b9f35b680 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:06.718818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d730254f-e570-4ab2-b14d-695b9f35b680 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:06.719688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d730254f-e570-4ab2-b14d-695b9f35b680 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:06.719971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d730254f-e570-4ab2-b14d-695b9f35b680 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:06.737919 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-d730254f-e570-4ab2-b14d-695b9f35b680 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] HTTP exception thrown: Instance fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd could not be found. Mar 05 20:56:06.739008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d730254f-e570-4ab2-b14d-695b9f35b680 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Returning 404 to user: Instance fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:06.740218 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d730254f-e570-4ab2-b14d-695b9f35b680 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd" status: 404 len: 111 microversion: 2.25 time: 0.040272 Mar 05 20:56:06.755162 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1079/2210] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:56:06 2022] GET /compute/v2.1/servers/fdd208d9-1b94-4ab3-8e79-cf940c8d4ddd => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:56:06.764669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ca705227-e9c6-4d99-9a55-aeec942716c4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:06.766091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ca705227-e9c6-4d99-9a55-aeec942716c4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:06.776743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca705227-e9c6-4d99-9a55-aeec942716c4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:06.778577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca705227-e9c6-4d99-9a55-aeec942716c4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:06.779546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca705227-e9c6-4d99-9a55-aeec942716c4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:06.780426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca705227-e9c6-4d99-9a55-aeec942716c4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:06.811543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1cae9cfe-d73f-4d91-8e93-235e6f9a98d8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:06.820587 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1cae9cfe-d73f-4d91-8e93-235e6f9a98d8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 0.602405 Mar 05 20:56:06.824545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ca705227-e9c6-4d99-9a55-aeec942716c4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:56:06.825758 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1132/2211] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:06 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:07.006211 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ca705227-e9c6-4d99-9a55-aeec942716c4 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "DELETE /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 204 len: 0 microversion: 2.25 time: 0.248481 Mar 05 20:56:07.006988 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1080/2212] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 20:56:06 2022] DELETE /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:56:07.015933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-090843da-b58e-49ed-8266-c9439bb32b55 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:07.016671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-090843da-b58e-49ed-8266-c9439bb32b55 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:07.034272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-090843da-b58e-49ed-8266-c9439bb32b55 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:07.034744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-090843da-b58e-49ed-8266-c9439bb32b55 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:07.035624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-090843da-b58e-49ed-8266-c9439bb32b55 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:07.036473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-090843da-b58e-49ed-8266-c9439bb32b55 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:07.151729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-28ec3825-8551-4cdd-a33e-ec735e7d4b6f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:07.152784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-28ec3825-8551-4cdd-a33e-ec735e7d4b6f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:07.170550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28ec3825-8551-4cdd-a33e-ec735e7d4b6f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:07.171027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28ec3825-8551-4cdd-a33e-ec735e7d4b6f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:07.172036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28ec3825-8551-4cdd-a33e-ec735e7d4b6f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:07.172815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28ec3825-8551-4cdd-a33e-ec735e7d4b6f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:07.620536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-090843da-b58e-49ed-8266-c9439bb32b55 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:07.640789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-090843da-b58e-49ed-8266-c9439bb32b55 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:07.642326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-090843da-b58e-49ed-8266-c9439bb32b55 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:07.643637 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-090843da-b58e-49ed-8266-c9439bb32b55 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1564 microversion: 2.25 time: 0.631871 Mar 05 20:56:07.650021 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1133/2213] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:56:07 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1564 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:56:07.703913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-10aa6e33-7a17-48b3-a4a9-0c7e7e2ff5ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:07.707156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-10aa6e33-7a17-48b3-a4a9-0c7e7e2ff5ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:07.738732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-10aa6e33-7a17-48b3-a4a9-0c7e7e2ff5ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:07.739502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-10aa6e33-7a17-48b3-a4a9-0c7e7e2ff5ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:07.740441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-10aa6e33-7a17-48b3-a4a9-0c7e7e2ff5ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:07.741563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-10aa6e33-7a17-48b3-a4a9-0c7e7e2ff5ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:07.893436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-28ec3825-8551-4cdd-a33e-ec735e7d4b6f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:07.915128 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-28ec3825-8551-4cdd-a33e-ec735e7d4b6f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 200 len: 1315 microversion: 2.1 time: 0.767946 Mar 05 20:56:07.916337 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1081/2214] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:07 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 1315 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:07.921767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-878a1d61-1b79-48c9-8b93-cdaf2c539db8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:07.922666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-878a1d61-1b79-48c9-8b93-cdaf2c539db8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:07.945207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-878a1d61-1b79-48c9-8b93-cdaf2c539db8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:07.945973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-878a1d61-1b79-48c9-8b93-cdaf2c539db8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:07.946966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-878a1d61-1b79-48c9-8b93-cdaf2c539db8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:07.947596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-878a1d61-1b79-48c9-8b93-cdaf2c539db8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:08.494891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-10aa6e33-7a17-48b3-a4a9-0c7e7e2ff5ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:08.515394 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-10aa6e33-7a17-48b3-a4a9-0c7e7e2ff5ff tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1493 microversion: 2.1 time: 0.815622 Mar 05 20:56:08.517630 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1134/2215] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:07 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1493 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:08.529538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6e70dc46-74a7-4e5e-80b8-b556f504cd5f req-3098f519-c2c0-4d24-a749-e9460fa31db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1527592-5a69-44bf-ac58-d019d5ee71ac", "name": "network-vif-plugged", "status": "completed", "tag": "5586f1d6-6aa1-482b-ae10-2cd96cf1d45d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:08.544728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6e70dc46-74a7-4e5e-80b8-b556f504cd5f req-3098f519-c2c0-4d24-a749-e9460fa31db7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:08.545189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6e70dc46-74a7-4e5e-80b8-b556f504cd5f req-3098f519-c2c0-4d24-a749-e9460fa31db7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:08.615544 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6e70dc46-74a7-4e5e-80b8-b556f504cd5f req-3098f519-c2c0-4d24-a749-e9460fa31db7 service nova] Creating event network-vif-plugged:5586f1d6-6aa1-482b-ae10-2cd96cf1d45d for instance e1527592-5a69-44bf-ac58-d019d5ee71ac on nch2-master-1 Mar 05 20:56:08.633308 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6e70dc46-74a7-4e5e-80b8-b556f504cd5f req-3098f519-c2c0-4d24-a749-e9460fa31db7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109934 Mar 05 20:56:08.634289 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1135/2216] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:08.898394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1213216340", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "c80579ab-d9de-42ba-ab7b-c6606dc5ef7e"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:08.912122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-878a1d61-1b79-48c9-8b93-cdaf2c539db8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:08.921970 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-878a1d61-1b79-48c9-8b93-cdaf2c539db8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 1.004235 Mar 05 20:56:08.922895 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1082/2217] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:07 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:08.930710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-abd5d503-5206-4092-8695-34ebf18e435a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:08.931335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-abd5d503-5206-4092-8695-34ebf18e435a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:08.945789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abd5d503-5206-4092-8695-34ebf18e435a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:08.946248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abd5d503-5206-4092-8695-34ebf18e435a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:08.947234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abd5d503-5206-4092-8695-34ebf18e435a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:08.947953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abd5d503-5206-4092-8695-34ebf18e435a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:09.016018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] validate_networks() for [('c80579ab-d9de-42ba-ab7b-c6606dc5ef7e', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:56:09.044175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-abd5d503-5206-4092-8695-34ebf18e435a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:09.057100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-abd5d503-5206-4092-8695-34ebf18e435a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:09.059106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-abd5d503-5206-4092-8695-34ebf18e435a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33c2e3f240e04849be211c91e18234dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa37ca4c9ac445f4ab3ab68f30b46d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:09.060722 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-abd5d503-5206-4092-8695-34ebf18e435a tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 200 len: 1346 microversion: 2.25 time: 0.136816 Mar 05 20:56:09.061911 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1083/2218] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:56:08 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 1346 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:56:09.070343 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b277fb38-d941-4349-b2bf-28cf160c8e1c req-7808f910-74a3-425b-af60-18ce61d4e436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31db5aa9-c804-4757-af1b-3354d442b6d8", "name": "network-vif-deleted", "tag": "c0110646-dc95-417d-ac53-0985cc88a5b8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:09.079619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b277fb38-d941-4349-b2bf-28cf160c8e1c req-7808f910-74a3-425b-af60-18ce61d4e436 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:09.080290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b277fb38-d941-4349-b2bf-28cf160c8e1c req-7808f910-74a3-425b-af60-18ce61d4e436 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:09.096522 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-b277fb38-d941-4349-b2bf-28cf160c8e1c req-7808f910-74a3-425b-af60-18ce61d4e436 service nova] Creating event network-vif-deleted:c0110646-dc95-417d-ac53-0985cc88a5b8 for instance 31db5aa9-c804-4757-af1b-3354d442b6d8 on nch1-master-1 Mar 05 20:56:09.101876 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b277fb38-d941-4349-b2bf-28cf160c8e1c req-7808f910-74a3-425b-af60-18ce61d4e436 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038552 Mar 05 20:56:09.103135 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1084/2219] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:09.111212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a45582d0-8fff-46fa-bedd-729c1d54fc98 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:09.112183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a45582d0-8fff-46fa-bedd-729c1d54fc98 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:09.124334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a45582d0-8fff-46fa-bedd-729c1d54fc98 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:09.125080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a45582d0-8fff-46fa-bedd-729c1d54fc98 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:09.127210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a45582d0-8fff-46fa-bedd-729c1d54fc98 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:09.127884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a45582d0-8fff-46fa-bedd-729c1d54fc98 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:09.348606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a45582d0-8fff-46fa-bedd-729c1d54fc98 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:09.358810 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a45582d0-8fff-46fa-bedd-729c1d54fc98 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 200 len: 1315 microversion: 2.1 time: 0.254171 Mar 05 20:56:09.369864 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1085/2220] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:09 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:09.533774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7f75d5f0-c6af-45db-8e17-3040d9549dcd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:09.534522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7f75d5f0-c6af-45db-8e17-3040d9549dcd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:09.541071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f75d5f0-c6af-45db-8e17-3040d9549dcd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:09.541627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f75d5f0-c6af-45db-8e17-3040d9549dcd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:09.542491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f75d5f0-c6af-45db-8e17-3040d9549dcd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:09.543007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f75d5f0-c6af-45db-8e17-3040d9549dcd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:09.764035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7f75d5f0-c6af-45db-8e17-3040d9549dcd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:09.786791 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7f75d5f0-c6af-45db-8e17-3040d9549dcd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1493 microversion: 2.1 time: 0.257434 Mar 05 20:56:09.789760 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1086/2221] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:09 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1493 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:09.941394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-61345c8c-4432-4bc0-bc71-c8316551f572 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:09.943803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-61345c8c-4432-4bc0-bc71-c8316551f572 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:09.950552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61345c8c-4432-4bc0-bc71-c8316551f572 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:09.951038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61345c8c-4432-4bc0-bc71-c8316551f572 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:09.952019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61345c8c-4432-4bc0-bc71-c8316551f572 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:09.952466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61345c8c-4432-4bc0-bc71-c8316551f572 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:10.188136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:56:10.189950 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:56:10.190648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:56:10.191257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:56:10.191927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:56:10.212493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:10.213279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:10.214371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:10.215078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:10.278461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Getting quotas for project bd82543db15443c69b77efe94c71e251. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:10.293932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Getting quotas for user bed1a5c3ac0c452e9212f081bc4f365d and project bd82543db15443c69b77efe94c71e251. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:10.316383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Going to run 3 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:56:10.320974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 876a2098-5755-45a2-879f-9665c69d764e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:56:10.392964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=876a2098-5755-45a2-879f-9665c69d764e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:56:10.437789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:56:10.588352 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cefb9186-ee47-4215-8d41-56d31df4fc97 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.952607 Mar 05 20:56:10.597479 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1136/2222] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:56:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:56:10.614116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ef27e93b-6354-48bc-b2e3-aacc565df568 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:10.616991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ef27e93b-6354-48bc-b2e3-aacc565df568 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] [instance: 31db5aa9-c804-4757-af1b-3354d442b6d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:10.630779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef27e93b-6354-48bc-b2e3-aacc565df568 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:10.632956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef27e93b-6354-48bc-b2e3-aacc565df568 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:10.636324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef27e93b-6354-48bc-b2e3-aacc565df568 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:10.637584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef27e93b-6354-48bc-b2e3-aacc565df568 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:10.663587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-61345c8c-4432-4bc0-bc71-c8316551f572 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:10.680330 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-61345c8c-4432-4bc0-bc71-c8316551f572 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 0.742171 Mar 05 20:56:10.680966 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1087/2223] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:09 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:10.688596 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-ef27e93b-6354-48bc-b2e3-aacc565df568 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] HTTP exception thrown: Instance 31db5aa9-c804-4757-af1b-3354d442b6d8 could not be found. Mar 05 20:56:10.689563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ef27e93b-6354-48bc-b2e3-aacc565df568 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] Returning 404 to user: Instance 31db5aa9-c804-4757-af1b-3354d442b6d8 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:10.691532 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ef27e93b-6354-48bc-b2e3-aacc565df568 tempest-LiveAutoBlockMigrationV225Test-1363872199 tempest-LiveAutoBlockMigrationV225Test-1363872199-project] 10.222.0.15 "GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8" status: 404 len: 111 microversion: 2.25 time: 0.092978 Mar 05 20:56:10.698896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-c5d6b376-2128-484f-887c-0a3586b03641 req-ecf5f007-5598-450f-a90d-2f0c07755879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1c9b56-f7e9-411e-bd5d-71b8230e4b19", "name": "network-vif-deleted", "tag": "c9f91447-b5aa-4520-9cac-255e0c084b36"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:10.699556 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1137/2224] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:56:10 2022] GET /compute/v2.1/servers/31db5aa9-c804-4757-af1b-3354d442b6d8 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:56:10.704626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1f6b111e-381b-4397-a071-561acd5542b5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:10.705338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1f6b111e-381b-4397-a071-561acd5542b5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:10.712817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f6b111e-381b-4397-a071-561acd5542b5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:10.713564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f6b111e-381b-4397-a071-561acd5542b5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:10.715325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f6b111e-381b-4397-a071-561acd5542b5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:10.715994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f6b111e-381b-4397-a071-561acd5542b5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:10.733550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c5d6b376-2128-484f-887c-0a3586b03641 req-ecf5f007-5598-450f-a90d-2f0c07755879 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:10.734282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c5d6b376-2128-484f-887c-0a3586b03641 req-ecf5f007-5598-450f-a90d-2f0c07755879 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:10.792425 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-c5d6b376-2128-484f-887c-0a3586b03641 req-ecf5f007-5598-450f-a90d-2f0c07755879 service nova] Creating event network-vif-deleted:c9f91447-b5aa-4520-9cac-255e0c084b36 for instance 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 on nch2-master-1 Mar 05 20:56:10.807771 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-c5d6b376-2128-484f-887c-0a3586b03641 req-ecf5f007-5598-450f-a90d-2f0c07755879 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122664 Mar 05 20:56:10.808724 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1088/2225] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:10.844201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1cd1e461-10a9-4593-8c27-0a8900c2132d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:10.862909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1cd1e461-10a9-4593-8c27-0a8900c2132d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:10.863789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1cd1e461-10a9-4593-8c27-0a8900c2132d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Searching by: {'deleted': False, 'project_id': 'bd82543db15443c69b77efe94c71e251'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:56:10.973179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1cd1e461-10a9-4593-8c27-0a8900c2132d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:10.973841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1cd1e461-10a9-4593-8c27-0a8900c2132d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:10.974471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1cd1e461-10a9-4593-8c27-0a8900c2132d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:10.974918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1cd1e461-10a9-4593-8c27-0a8900c2132d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:10.997514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1f6b111e-381b-4397-a071-561acd5542b5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:11.006512 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1f6b111e-381b-4397-a071-561acd5542b5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 200 len: 1315 microversion: 2.1 time: 0.305830 Mar 05 20:56:11.017958 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1138/2226] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:10 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:11.047284 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1cd1e461-10a9-4593-8c27-0a8900c2132d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.232313 Mar 05 20:56:11.048312 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1089/2227] 10.222.0.15 () {58 vars in 1124 bytes} [Sat Mar 5 20:56:10 2022] GET /compute/v2.1/servers => generated 1018 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:11.053156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e97270c3-ac7c-4c97-85bc-271a5a5f7730 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:11.063486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e97270c3-ac7c-4c97-85bc-271a5a5f7730 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:11.077279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e97270c3-ac7c-4c97-85bc-271a5a5f7730 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:11.078086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e97270c3-ac7c-4c97-85bc-271a5a5f7730 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:11.079101 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e97270c3-ac7c-4c97-85bc-271a5a5f7730 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:11.085690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e97270c3-ac7c-4c97-85bc-271a5a5f7730 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:11.154680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e97270c3-ac7c-4c97-85bc-271a5a5f7730 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:11.155147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e97270c3-ac7c-4c97-85bc-271a5a5f7730 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:11.155618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-e97270c3-ac7c-4c97-85bc-271a5a5f7730 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lazy-loading 'fault' on Instance uuid 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:56:11.299645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e97270c3-ac7c-4c97-85bc-271a5a5f7730 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bcf50b3de674240bb695a0d5614ffd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9d41fd2f8d48d894ddb8ae0aa2799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:11.310532 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e97270c3-ac7c-4c97-85bc-271a5a5f7730 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 200 len: 1298 microversion: 2.1 time: 0.261078 Mar 05 20:56:11.311865 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1090/2228] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:11 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 1298 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:11.323629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-df8687d7-dc1c-4333-bd51-366c50a83c85 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:11.326898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-df8687d7-dc1c-4333-bd51-366c50a83c85 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:11.426777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-df8687d7-dc1c-4333-bd51-366c50a83c85 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:11.435115 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-df8687d7-dc1c-4333-bd51-366c50a83c85 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1223 microversion: 2.1 time: 0.121982 Mar 05 20:56:11.436906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-706263123", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "a0fc1ef5-7d58-4956-8ec7-37c47d9df56c"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:11.438055 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1091/2229] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:11 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:11.558572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] validate_networks() for [('a0fc1ef5-7d58-4956-8ec7-37c47d9df56c', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:56:11.698277 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9922e364-8a46-44c3-bcc5-accdfc542dd7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:11.699033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9922e364-8a46-44c3-bcc5-accdfc542dd7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:11.710832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9922e364-8a46-44c3-bcc5-accdfc542dd7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:11.724383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9922e364-8a46-44c3-bcc5-accdfc542dd7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:11.726273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9922e364-8a46-44c3-bcc5-accdfc542dd7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:11.726917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9922e364-8a46-44c3-bcc5-accdfc542dd7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:12.041476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9922e364-8a46-44c3-bcc5-accdfc542dd7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:12.055592 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9922e364-8a46-44c3-bcc5-accdfc542dd7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 0.361950 Mar 05 20:56:12.056299 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1092/2230] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:11 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:12.065437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d7b11524-5445-412b-9839-5dffc6de0d76 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:12.065437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d7b11524-5445-412b-9839-5dffc6de0d76 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:12.102570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7b11524-5445-412b-9839-5dffc6de0d76 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:12.104409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7b11524-5445-412b-9839-5dffc6de0d76 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:12.107979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7b11524-5445-412b-9839-5dffc6de0d76 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:12.112890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7b11524-5445-412b-9839-5dffc6de0d76 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:12.613883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d7b11524-5445-412b-9839-5dffc6de0d76 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:12.624436 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d7b11524-5445-412b-9839-5dffc6de0d76 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 200 len: 1502 microversion: 2.1 time: 0.566896 Mar 05 20:56:12.625745 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1093/2231] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:12 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 1502 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:12.630666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2abe013f-3231-4f65-a2b9-3a67c1a1b6e8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:12.631416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2abe013f-3231-4f65-a2b9-3a67c1a1b6e8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:12.639808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2abe013f-3231-4f65-a2b9-3a67c1a1b6e8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:12.640714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2abe013f-3231-4f65-a2b9-3a67c1a1b6e8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:12.642709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2abe013f-3231-4f65-a2b9-3a67c1a1b6e8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:12.643400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2abe013f-3231-4f65-a2b9-3a67c1a1b6e8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:12.680756 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-2abe013f-3231-4f65-a2b9-3a67c1a1b6e8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] HTTP exception thrown: Instance 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 could not be found. Mar 05 20:56:12.685271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:56:12.685746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:56:12.686188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:56:12.686884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2abe013f-3231-4f65-a2b9-3a67c1a1b6e8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Returning 404 to user: Instance 0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:12.687501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:56:12.687927 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2abe013f-3231-4f65-a2b9-3a67c1a1b6e8 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19" status: 404 len: 111 microversion: 2.1 time: 0.060956 Mar 05 20:56:12.688588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:56:12.689251 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1094/2232] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:12 2022] GET /compute/v2.1/servers/0f1c9b56-f7e9-411e-bd5d-71b8230e4b19 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:12.703207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0c6d5cdf-4b38-461c-a395-edf04b42d5f8 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:12.704007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0c6d5cdf-4b38-461c-a395-edf04b42d5f8 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:12.707565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:12.708072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:12.709605 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:12.710802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:12.746248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c6d5cdf-4b38-461c-a395-edf04b42d5f8 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:12.747575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c6d5cdf-4b38-461c-a395-edf04b42d5f8 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:12.749607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c6d5cdf-4b38-461c-a395-edf04b42d5f8 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:12.750564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c6d5cdf-4b38-461c-a395-edf04b42d5f8 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:12.757060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Getting quotas for project 933b162d4a3044f38bed8c339cc621ed. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:12.768484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Getting quotas for user 9680dd9b3f2b47c9810ae22052714bea and project 933b162d4a3044f38bed8c339cc621ed. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:12.797184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:56:12.804978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:56:12.854123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0c6d5cdf-4b38-461c-a395-edf04b42d5f8 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:12.866464 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0c6d5cdf-4b38-461c-a395-edf04b42d5f8 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1219 microversion: 2.1 time: 0.175107 Mar 05 20:56:12.867421 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1095/2233] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:12 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1219 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:12.873811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0a8fe490-7753-41f9-9486-b10e624d10ce tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c2061f0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:12.941182 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a80488aa-0462-4c8e-bab6-b2fd6f4fadb8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.930745 Mar 05 20:56:12.945077 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1139/2234] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:56:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:56:12.950150 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-0a8fe490-7753-41f9-9486-b10e624d10ce tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] HTTP exception thrown: Image not found. Mar 05 20:56:12.951915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0a8fe490-7753-41f9-9486-b10e624d10ce tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Returning 404 to user: Image not found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:12.953128 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0a8fe490-7753-41f9-9486-b10e624d10ce tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3" status: 404 len: 62 microversion: 2.1 time: 0.084326 Mar 05 20:56:12.954390 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1096/2235] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:12 2022] DELETE /compute/v2.1/images/0b4b1a47-60bf-4081-870a-b897de3a2de3 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:56:12.960368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3b4f0411-ba72-481d-a203-9b341df0905e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:12.961427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3b4f0411-ba72-481d-a203-9b341df0905e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:12.966690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82ae8a5e-9f82-411c-81e0-36eac75b5eaf tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:12.969735 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-82ae8a5e-9f82-411c-81e0-36eac75b5eaf tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:12.995864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82ae8a5e-9f82-411c-81e0-36eac75b5eaf tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:12.998114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82ae8a5e-9f82-411c-81e0-36eac75b5eaf tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.000047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82ae8a5e-9f82-411c-81e0-36eac75b5eaf tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.001367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82ae8a5e-9f82-411c-81e0-36eac75b5eaf tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.043400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3b4f0411-ba72-481d-a203-9b341df0905e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:13.049952 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-82ae8a5e-9f82-411c-81e0-36eac75b5eaf tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] HTTP exception thrown: Instance a4505753-e31f-4b5b-8ee3-f37ab9176b36 could not be found. Mar 05 20:56:13.050701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82ae8a5e-9f82-411c-81e0-36eac75b5eaf tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Returning 404 to user: Instance a4505753-e31f-4b5b-8ee3-f37ab9176b36 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:13.054876 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3b4f0411-ba72-481d-a203-9b341df0905e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1223 microversion: 2.1 time: 0.099181 Mar 05 20:56:13.056241 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1140/2236] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:12 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:13.061479 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-82ae8a5e-9f82-411c-81e0-36eac75b5eaf tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 404 len: 111 microversion: 2.1 time: 0.093540 Mar 05 20:56:13.065940 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1097/2237] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:12 2022] DELETE /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:56:13.075466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1a51835d-8369-44ee-b43a-229aae1ec796 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:13.076240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1725e0f2-fa42-44a9-889d-d4cec374687e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:13.077317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1725e0f2-fa42-44a9-889d-d4cec374687e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:13.083357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1a51835d-8369-44ee-b43a-229aae1ec796 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a4505753-e31f-4b5b-8ee3-f37ab9176b36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:13.085566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1725e0f2-fa42-44a9-889d-d4cec374687e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.086970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1725e0f2-fa42-44a9-889d-d4cec374687e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.088122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1725e0f2-fa42-44a9-889d-d4cec374687e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.088916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1725e0f2-fa42-44a9-889d-d4cec374687e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.096864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1a51835d-8369-44ee-b43a-229aae1ec796 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.099405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1a51835d-8369-44ee-b43a-229aae1ec796 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.100774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1a51835d-8369-44ee-b43a-229aae1ec796 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.106783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1a51835d-8369-44ee-b43a-229aae1ec796 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.166547 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-1a51835d-8369-44ee-b43a-229aae1ec796 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] HTTP exception thrown: Instance a4505753-e31f-4b5b-8ee3-f37ab9176b36 could not be found. Mar 05 20:56:13.167816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1a51835d-8369-44ee-b43a-229aae1ec796 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Returning 404 to user: Instance a4505753-e31f-4b5b-8ee3-f37ab9176b36 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:13.169005 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1a51835d-8369-44ee-b43a-229aae1ec796 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36" status: 404 len: 111 microversion: 2.1 time: 0.101964 Mar 05 20:56:13.172038 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1141/2238] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:13 2022] GET /compute/v2.1/servers/a4505753-e31f-4b5b-8ee3-f37ab9176b36 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:13.183349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7e2cfdec-c7be-4731-9761-2d9a096e30a2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed61acd550>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:13.218516 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-7e2cfdec-c7be-4731-9761-2d9a096e30a2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] HTTP exception thrown: Image not found. Mar 05 20:56:13.219635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7e2cfdec-c7be-4731-9761-2d9a096e30a2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Returning 404 to user: Image not found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:13.227716 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7e2cfdec-c7be-4731-9761-2d9a096e30a2 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99" status: 404 len: 62 microversion: 2.1 time: 0.052767 Mar 05 20:56:13.228368 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1142/2239] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:13 2022] DELETE /compute/v2.1/images/83a920d1-334c-4309-987f-7294f66c9a99 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 05 20:56:13.245002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b86cd135-2f81-4df6-a7d3-0f51f4f839f6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:13.245714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b86cd135-2f81-4df6-a7d3-0f51f4f839f6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:13.273118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b86cd135-2f81-4df6-a7d3-0f51f4f839f6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.273671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b86cd135-2f81-4df6-a7d3-0f51f4f839f6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.278139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b86cd135-2f81-4df6-a7d3-0f51f4f839f6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.278609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b86cd135-2f81-4df6-a7d3-0f51f4f839f6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.347820 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-b86cd135-2f81-4df6-a7d3-0f51f4f839f6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] HTTP exception thrown: Instance facc63d8-2f5b-4b1f-858c-65e0ba787498 could not be found. Mar 05 20:56:13.354918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b86cd135-2f81-4df6-a7d3-0f51f4f839f6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Returning 404 to user: Instance facc63d8-2f5b-4b1f-858c-65e0ba787498 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:13.357214 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b86cd135-2f81-4df6-a7d3-0f51f4f839f6 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 404 len: 111 microversion: 2.1 time: 0.124416 Mar 05 20:56:13.362604 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1143/2240] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:13 2022] DELETE /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:13.404578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f8871c46-36bc-4f47-8846-4b5ebc37214c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:13.408314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f8871c46-36bc-4f47-8846-4b5ebc37214c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: facc63d8-2f5b-4b1f-858c-65e0ba787498] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:13.446369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8871c46-36bc-4f47-8846-4b5ebc37214c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.448719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8871c46-36bc-4f47-8846-4b5ebc37214c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.451845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8871c46-36bc-4f47-8846-4b5ebc37214c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.454015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8871c46-36bc-4f47-8846-4b5ebc37214c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.532479 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-f8871c46-36bc-4f47-8846-4b5ebc37214c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] HTTP exception thrown: Instance facc63d8-2f5b-4b1f-858c-65e0ba787498 could not be found. Mar 05 20:56:13.537425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f8871c46-36bc-4f47-8846-4b5ebc37214c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Returning 404 to user: Instance facc63d8-2f5b-4b1f-858c-65e0ba787498 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:13.539013 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f8871c46-36bc-4f47-8846-4b5ebc37214c tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498" status: 404 len: 111 microversion: 2.1 time: 0.157710 Mar 05 20:56:13.541510 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1144/2241] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:13 2022] GET /compute/v2.1/servers/facc63d8-2f5b-4b1f-858c-65e0ba787498 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:13.566034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ee9a822-b827-44f8-a173-1170fb8f48c4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '.version_select at 0x7fed5c2375e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:13.618470 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-4ee9a822-b827-44f8-a173-1170fb8f48c4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] HTTP exception thrown: Image not found. Mar 05 20:56:13.619182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ee9a822-b827-44f8-a173-1170fb8f48c4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Returning 404 to user: Image not found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:13.620175 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4ee9a822-b827-44f8-a173-1170fb8f48c4 tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2" status: 404 len: 62 microversion: 2.1 time: 0.074530 Mar 05 20:56:13.622255 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1145/2242] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:13 2022] DELETE /compute/v2.1/images/a5c68755-f580-4841-9600-b23447cfb8c2 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:56:13.628885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9618f56e-80fa-441b-873a-0098dc0fa5bd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:13.640870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9618f56e-80fa-441b-873a-0098dc0fa5bd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:13.693649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9618f56e-80fa-441b-873a-0098dc0fa5bd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.694926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9618f56e-80fa-441b-873a-0098dc0fa5bd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.701799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9618f56e-80fa-441b-873a-0098dc0fa5bd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.708455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9618f56e-80fa-441b-873a-0098dc0fa5bd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.781434 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-9618f56e-80fa-441b-873a-0098dc0fa5bd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] HTTP exception thrown: Instance a78b93bf-150c-4b48-b376-5c2ba3a624b9 could not be found. Mar 05 20:56:13.788584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9618f56e-80fa-441b-873a-0098dc0fa5bd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Returning 404 to user: Instance a78b93bf-150c-4b48-b376-5c2ba3a624b9 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:13.795506 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9618f56e-80fa-441b-873a-0098dc0fa5bd tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 404 len: 111 microversion: 2.1 time: 0.170348 Mar 05 20:56:13.798547 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1146/2243] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:13 2022] DELETE /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:13.807317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7f7260d3-4f97-4822-ab32-54d8c7eed6ae tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:13.830102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7f7260d3-4f97-4822-ab32-54d8c7eed6ae tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] [instance: a78b93bf-150c-4b48-b376-5c2ba3a624b9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:13.860656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f7260d3-4f97-4822-ab32-54d8c7eed6ae tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.861386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f7260d3-4f97-4822-ab32-54d8c7eed6ae tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.862836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f7260d3-4f97-4822-ab32-54d8c7eed6ae tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.863878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f7260d3-4f97-4822-ab32-54d8c7eed6ae tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.912179 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-7f7260d3-4f97-4822-ab32-54d8c7eed6ae tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] HTTP exception thrown: Instance a78b93bf-150c-4b48-b376-5c2ba3a624b9 could not be found. Mar 05 20:56:13.916725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7f7260d3-4f97-4822-ab32-54d8c7eed6ae tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] Returning 404 to user: Instance a78b93bf-150c-4b48-b376-5c2ba3a624b9 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:13.920517 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7f7260d3-4f97-4822-ab32-54d8c7eed6ae tempest-ImagesTestJSON-881227991 tempest-ImagesTestJSON-881227991-project] 10.222.0.15 "GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9" status: 404 len: 111 microversion: 2.1 time: 0.118119 Mar 05 20:56:13.924738 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1147/2244] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:13 2022] GET /compute/v2.1/servers/a78b93bf-150c-4b48-b376-5c2ba3a624b9 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:13.933678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8376c4df-fb37-4c95-b484-6c991edd1057 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:13.936200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8376c4df-fb37-4c95-b484-6c991edd1057 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:13.945117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8376c4df-fb37-4c95-b484-6c991edd1057 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.945861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8376c4df-fb37-4c95-b484-6c991edd1057 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:13.958877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8376c4df-fb37-4c95-b484-6c991edd1057 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:13.961948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8376c4df-fb37-4c95-b484-6c991edd1057 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:14.173059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1725e0f2-fa42-44a9-889d-d4cec374687e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:14.185961 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1725e0f2-fa42-44a9-889d-d4cec374687e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 1.116867 Mar 05 20:56:14.189872 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1098/2245] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:13 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:14.210649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e2ee52d6-ef8d-427b-bab4-a3db35fafba2 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:14.212455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e2ee52d6-ef8d-427b-bab4-a3db35fafba2 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:14.227946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e2ee52d6-ef8d-427b-bab4-a3db35fafba2 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:14.228820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e2ee52d6-ef8d-427b-bab4-a3db35fafba2 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:14.232378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e2ee52d6-ef8d-427b-bab4-a3db35fafba2 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:14.233090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e2ee52d6-ef8d-427b-bab4-a3db35fafba2 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:14.421193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e2ee52d6-ef8d-427b-bab4-a3db35fafba2 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:14.441359 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e2ee52d6-ef8d-427b-bab4-a3db35fafba2 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1227 microversion: 2.1 time: 0.248889 Mar 05 20:56:14.442229 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1099/2246] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:14 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1227 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:14.500862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-07b57ec9-3553-4bfd-80e1-8dc5582827e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "107837e7-b61e-41fc-9310-a10876d5a787"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:14.502776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-07b57ec9-3553-4bfd-80e1-8dc5582827e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:14.513569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-07b57ec9-3553-4bfd-80e1-8dc5582827e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:14.516867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-07b57ec9-3553-4bfd-80e1-8dc5582827e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:14.518429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-07b57ec9-3553-4bfd-80e1-8dc5582827e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:14.519737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-07b57ec9-3553-4bfd-80e1-8dc5582827e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:15.033557 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-07b57ec9-3553-4bfd-80e1-8dc5582827e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "POST /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.536192 Mar 05 20:56:15.035772 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1100/2247] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 20:56:14 2022] POST /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac/os-volume_attachments => generated 194 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:56:15.213224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-420fb8a7-cbf4-4de9-893c-814632f1a4c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:15.214814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-420fb8a7-cbf4-4de9-893c-814632f1a4c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:15.243110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-420fb8a7-cbf4-4de9-893c-814632f1a4c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:15.243756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-420fb8a7-cbf4-4de9-893c-814632f1a4c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:15.244828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-420fb8a7-cbf4-4de9-893c-814632f1a4c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:15.245392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-420fb8a7-cbf4-4de9-893c-814632f1a4c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:15.380208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8376c4df-fb37-4c95-b484-6c991edd1057 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:15.392171 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8376c4df-fb37-4c95-b484-6c991edd1057 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1283 microversion: 2.1 time: 1.464057 Mar 05 20:56:15.395350 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1148/2248] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:13 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1283 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:15.459313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-925a34a0-3523-4c89-8ccc-30e28806f80d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:15.460628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-925a34a0-3523-4c89-8ccc-30e28806f80d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:15.477611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-925a34a0-3523-4c89-8ccc-30e28806f80d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:15.478500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-925a34a0-3523-4c89-8ccc-30e28806f80d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:15.479538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-925a34a0-3523-4c89-8ccc-30e28806f80d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:15.480186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-925a34a0-3523-4c89-8ccc-30e28806f80d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:15.977561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-925a34a0-3523-4c89-8ccc-30e28806f80d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:15.988098 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-925a34a0-3523-4c89-8ccc-30e28806f80d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1293 microversion: 2.1 time: 0.532464 Mar 05 20:56:16.000802 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1149/2249] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:15 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1293 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:16.097633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-420fb8a7-cbf4-4de9-893c-814632f1a4c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:16.123125 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-420fb8a7-cbf4-4de9-893c-814632f1a4c9 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 0.917234 Mar 05 20:56:16.138033 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1101/2250] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:15 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:16.409905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c48edc95-e68e-49d8-904a-78b5ee7e0b6e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:16.410672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c48edc95-e68e-49d8-904a-78b5ee7e0b6e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:16.424490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c48edc95-e68e-49d8-904a-78b5ee7e0b6e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:16.425146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c48edc95-e68e-49d8-904a-78b5ee7e0b6e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:16.427378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c48edc95-e68e-49d8-904a-78b5ee7e0b6e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:16.427969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c48edc95-e68e-49d8-904a-78b5ee7e0b6e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:16.707656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c48edc95-e68e-49d8-904a-78b5ee7e0b6e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:16.720827 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c48edc95-e68e-49d8-904a-78b5ee7e0b6e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1281 microversion: 2.1 time: 0.315008 Mar 05 20:56:16.723997 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1150/2251] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:16 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1281 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:17.012036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f1f57be6-0a29-44dd-b796-7a147bb92397 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:17.014378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f1f57be6-0a29-44dd-b796-7a147bb92397 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:17.039621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1f57be6-0a29-44dd-b796-7a147bb92397 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:17.043710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1f57be6-0a29-44dd-b796-7a147bb92397 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:17.044738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1f57be6-0a29-44dd-b796-7a147bb92397 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:17.047040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1f57be6-0a29-44dd-b796-7a147bb92397 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:17.142098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-35fc8466-9e33-4b80-b14e-0b12d53f08c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:17.143207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-35fc8466-9e33-4b80-b14e-0b12d53f08c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:17.150771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35fc8466-9e33-4b80-b14e-0b12d53f08c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:17.151230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35fc8466-9e33-4b80-b14e-0b12d53f08c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:17.152049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35fc8466-9e33-4b80-b14e-0b12d53f08c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:17.152750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35fc8466-9e33-4b80-b14e-0b12d53f08c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:17.191820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f1f57be6-0a29-44dd-b796-7a147bb92397 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:17.201847 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f1f57be6-0a29-44dd-b796-7a147bb92397 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1281 microversion: 2.1 time: 0.196972 Mar 05 20:56:17.202693 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1102/2252] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:17 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1281 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:17.574209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-35fc8466-9e33-4b80-b14e-0b12d53f08c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:17.596966 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-35fc8466-9e33-4b80-b14e-0b12d53f08c6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 0.453771 Mar 05 20:56:17.613639 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1151/2253] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:17 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:17.741108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bfd0af43-87ef-46aa-b141-e4b95d808499 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:17.743032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bfd0af43-87ef-46aa-b141-e4b95d808499 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:17.761855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfd0af43-87ef-46aa-b141-e4b95d808499 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:17.762364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfd0af43-87ef-46aa-b141-e4b95d808499 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:17.763206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfd0af43-87ef-46aa-b141-e4b95d808499 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:17.763697 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfd0af43-87ef-46aa-b141-e4b95d808499 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:17.865722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bfd0af43-87ef-46aa-b141-e4b95d808499 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:17.874476 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bfd0af43-87ef-46aa-b141-e4b95d808499 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1281 microversion: 2.1 time: 0.137691 Mar 05 20:56:17.875346 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1103/2254] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:17 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1281 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:18.219243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2bc8b312-ace2-4a97-aab8-2f7ca4f8c9a9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:18.220232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2bc8b312-ace2-4a97-aab8-2f7ca4f8c9a9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:18.234558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2bc8b312-ace2-4a97-aab8-2f7ca4f8c9a9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:18.235065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2bc8b312-ace2-4a97-aab8-2f7ca4f8c9a9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:18.237845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2bc8b312-ace2-4a97-aab8-2f7ca4f8c9a9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:18.238691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2bc8b312-ace2-4a97-aab8-2f7ca4f8c9a9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:18.586189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-618a6692-7fdd-4757-a89b-8db108a7e1d7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:18.586670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-618a6692-7fdd-4757-a89b-8db108a7e1d7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:18.600812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-618a6692-7fdd-4757-a89b-8db108a7e1d7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:18.601602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-618a6692-7fdd-4757-a89b-8db108a7e1d7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:18.603702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-618a6692-7fdd-4757-a89b-8db108a7e1d7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:18.604339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-618a6692-7fdd-4757-a89b-8db108a7e1d7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:18.640439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-618a6692-7fdd-4757-a89b-8db108a7e1d7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:56:18.777020 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-618a6692-7fdd-4757-a89b-8db108a7e1d7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 204 len: 0 microversion: 2.1 time: 0.204428 Mar 05 20:56:18.779520 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1104/2255] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:18 2022] DELETE /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:18.791803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ad47fdcf-eda3-4b36-bc30-8df99cca47d7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:18.792611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ad47fdcf-eda3-4b36-bc30-8df99cca47d7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:18.800347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad47fdcf-eda3-4b36-bc30-8df99cca47d7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:18.801278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad47fdcf-eda3-4b36-bc30-8df99cca47d7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:18.802475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad47fdcf-eda3-4b36-bc30-8df99cca47d7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:18.802776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad47fdcf-eda3-4b36-bc30-8df99cca47d7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:19.130152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2bc8b312-ace2-4a97-aab8-2f7ca4f8c9a9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:19.143830 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2bc8b312-ace2-4a97-aab8-2f7ca4f8c9a9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1323 microversion: 2.1 time: 0.928330 Mar 05 20:56:19.154569 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1152/2256] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:18 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1323 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:19.158385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b1943fe4-a025-4644-90fb-578083d386eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:19.159621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b1943fe4-a025-4644-90fb-578083d386eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:19.178125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1943fe4-a025-4644-90fb-578083d386eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:19.179947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1943fe4-a025-4644-90fb-578083d386eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:19.183013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1943fe4-a025-4644-90fb-578083d386eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:19.184991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1943fe4-a025-4644-90fb-578083d386eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:19.888010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad47fdcf-eda3-4b36-bc30-8df99cca47d7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:19.894246 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ad47fdcf-eda3-4b36-bc30-8df99cca47d7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1507 microversion: 2.1 time: 1.113070 Mar 05 20:56:19.894832 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1105/2257] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:18 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1507 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:19.904785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-30948037-6f36-4b8e-bc43-66417822d72d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:19.910326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-30948037-6f36-4b8e-bc43-66417822d72d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:19.923557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30948037-6f36-4b8e-bc43-66417822d72d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:19.928932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30948037-6f36-4b8e-bc43-66417822d72d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:19.930039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30948037-6f36-4b8e-bc43-66417822d72d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:19.930650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30948037-6f36-4b8e-bc43-66417822d72d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:20.102193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b1943fe4-a025-4644-90fb-578083d386eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:20.119262 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b1943fe4-a025-4644-90fb-578083d386eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 200 len: 1554 microversion: 2.1 time: 0.968610 Mar 05 20:56:20.129144 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1153/2258] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:19 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 1554 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:20.163218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-00e00804-d917-47bb-ba82-54b72634c08e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:20.163951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-00e00804-d917-47bb-ba82-54b72634c08e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:20.173764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00e00804-d917-47bb-ba82-54b72634c08e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:20.179965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00e00804-d917-47bb-ba82-54b72634c08e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:20.191211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00e00804-d917-47bb-ba82-54b72634c08e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:20.196227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00e00804-d917-47bb-ba82-54b72634c08e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:20.489024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-30948037-6f36-4b8e-bc43-66417822d72d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:20.499076 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-30948037-6f36-4b8e-bc43-66417822d72d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1323 microversion: 2.1 time: 0.600657 Mar 05 20:56:20.505549 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1106/2259] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:19 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1323 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:20.770111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-532131593", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:20.846704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:56:21.177947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-00e00804-d917-47bb-ba82-54b72634c08e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:21.193588 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-00e00804-d917-47bb-ba82-54b72634c08e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1323 microversion: 2.1 time: 1.035575 Mar 05 20:56:21.196291 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1154/2260] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:20 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1323 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:21.218230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-bcece50b-9027-4830-aa33-8873b755e2f4 req-a3ef7698-973c-48d6-9342-c480aae63641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc", "tag": "8ac1b815-0a98-4dee-b99b-4a42f8faeb8d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:21.234538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-bcece50b-9027-4830-aa33-8873b755e2f4 req-a3ef7698-973c-48d6-9342-c480aae63641 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:21.235261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-bcece50b-9027-4830-aa33-8873b755e2f4 req-a3ef7698-973c-48d6-9342-c480aae63641 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:21.264445 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-bcece50b-9027-4830-aa33-8873b755e2f4 req-a3ef7698-973c-48d6-9342-c480aae63641 service nova] Creating event network-changed:8ac1b815-0a98-4dee-b99b-4a42f8faeb8d for instance 15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc on nch1-master-1 Mar 05 20:56:21.273524 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-bcece50b-9027-4830-aa33-8873b755e2f4 req-a3ef7698-973c-48d6-9342-c480aae63641 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075933 Mar 05 20:56:21.274926 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1155/2261] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:21.286679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-699cf345-6fac-4efe-a119-1a45a863a9f6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:21.287808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-699cf345-6fac-4efe-a119-1a45a863a9f6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:21.295434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-699cf345-6fac-4efe-a119-1a45a863a9f6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:21.296690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-699cf345-6fac-4efe-a119-1a45a863a9f6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:21.297893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-699cf345-6fac-4efe-a119-1a45a863a9f6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:21.317878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-699cf345-6fac-4efe-a119-1a45a863a9f6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:21.605901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:56:21.606836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:56:21.607526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:56:21.608148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:56:21.608859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:56:21.630013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:21.630013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:21.630662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:21.631101 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:21.656306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Getting quotas for project aa9adff4bad8486fae6271261a8137d2. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:21.664190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Getting quotas for user 0cd929c57fe3445face2514365fe503c and project aa9adff4bad8486fae6271261a8137d2. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:21.688901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:56:21.692262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:56:21.782514 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f109a32f-9b71-46c9-9b56-b78410530d57 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.238130 Mar 05 20:56:21.784105 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1107/2262] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:56:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 20:56:21.791788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c2b09707-a25f-4e39-b0d4-b437cc173bcb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:21.792797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c2b09707-a25f-4e39-b0d4-b437cc173bcb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:21.802432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2b09707-a25f-4e39-b0d4-b437cc173bcb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:21.803190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2b09707-a25f-4e39-b0d4-b437cc173bcb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:21.806906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2b09707-a25f-4e39-b0d4-b437cc173bcb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:21.813617 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2b09707-a25f-4e39-b0d4-b437cc173bcb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:21.861179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-699cf345-6fac-4efe-a119-1a45a863a9f6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:21.875990 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-699cf345-6fac-4efe-a119-1a45a863a9f6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1487 microversion: 2.1 time: 0.595351 Mar 05 20:56:21.878375 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1156/2263] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:21 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1487 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:21.883501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2128708d-1b40-4568-b053-4162aaf6c3fe tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:21.900467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2128708d-1b40-4568-b053-4162aaf6c3fe tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:21.926797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2128708d-1b40-4568-b053-4162aaf6c3fe tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:21.927508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2128708d-1b40-4568-b053-4162aaf6c3fe tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:21.929285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2128708d-1b40-4568-b053-4162aaf6c3fe tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:21.932125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2128708d-1b40-4568-b053-4162aaf6c3fe tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:22.856735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2128708d-1b40-4568-b053-4162aaf6c3fe tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:22.863911 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2128708d-1b40-4568-b053-4162aaf6c3fe tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1323 microversion: 2.1 time: 0.984306 Mar 05 20:56:22.873305 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1157/2264] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:21 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1323 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:22.878101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-addaffc3-205f-49e7-b2ea-243c8cc718cb tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:22.878715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-addaffc3-205f-49e7-b2ea-243c8cc718cb tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:22.892713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-addaffc3-205f-49e7-b2ea-243c8cc718cb tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:22.893337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-addaffc3-205f-49e7-b2ea-243c8cc718cb tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:22.894298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-addaffc3-205f-49e7-b2ea-243c8cc718cb tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:22.894903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-addaffc3-205f-49e7-b2ea-243c8cc718cb tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:23.049691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-addaffc3-205f-49e7-b2ea-243c8cc718cb tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd929c57fe3445face2514365fe503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9adff4bad8486fae6271261a8137d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:23.058405 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-addaffc3-205f-49e7-b2ea-243c8cc718cb tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 200 len: 1211 microversion: 2.1 time: 0.184030 Mar 05 20:56:23.059044 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1158/2265] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:22 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 1211 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:23.064393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c2b09707-a25f-4e39-b0d4-b437cc173bcb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:23.080736 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c2b09707-a25f-4e39-b0d4-b437cc173bcb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 200 len: 1554 microversion: 2.1 time: 1.295257 Mar 05 20:56:23.083373 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1108/2266] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:21 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 1554 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:23.093974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-909809c1-a68c-4c67-9109-49508067afb8 req-7fca13c9-2617-48e7-8e2d-9a49fbb9accb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876a2098-5755-45a2-879f-9665c69d764e", "tag": "3a39d010-7efb-4d30-aa59-44e63c57a224"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:23.095545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1378925046", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:23.109725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-909809c1-a68c-4c67-9109-49508067afb8 req-7fca13c9-2617-48e7-8e2d-9a49fbb9accb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:23.110531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-909809c1-a68c-4c67-9109-49508067afb8 req-7fca13c9-2617-48e7-8e2d-9a49fbb9accb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:23.131156 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-909809c1-a68c-4c67-9109-49508067afb8 req-7fca13c9-2617-48e7-8e2d-9a49fbb9accb service nova] Creating event network-changed:3a39d010-7efb-4d30-aa59-44e63c57a224 for instance 876a2098-5755-45a2-879f-9665c69d764e on nch2-master-1 Mar 05 20:56:23.145503 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-909809c1-a68c-4c67-9109-49508067afb8 req-7fca13c9-2617-48e7-8e2d-9a49fbb9accb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064470 Mar 05 20:56:23.146695 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1159/2267] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:23.155522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0018814c-89c4-45f1-9b10-7a2078b8a459 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:23.159727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0018814c-89c4-45f1-9b10-7a2078b8a459 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:23.174375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0018814c-89c4-45f1-9b10-7a2078b8a459 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:23.177519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0018814c-89c4-45f1-9b10-7a2078b8a459 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:23.179116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0018814c-89c4-45f1-9b10-7a2078b8a459 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:23.181880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0018814c-89c4-45f1-9b10-7a2078b8a459 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:23.193029 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] validate_networks() for [('c6309286-f935-47ca-ba3b-63029aaed949', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:56:24.084182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0018814c-89c4-45f1-9b10-7a2078b8a459 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:24.102353 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0018814c-89c4-45f1-9b10-7a2078b8a459 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1323 microversion: 2.1 time: 0.954010 Mar 05 20:56:24.103544 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1160/2268] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:23 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1323 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:24.108666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-89c810dc-bdde-494f-ae79-c50ac8d11af5 req-ee582e43-dbd0-4b03-91a6-edbd97840cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429f5dde-84d7-4bd3-a37a-066ac19fdc53", "tag": "2710cf64-1285-4d3b-8a24-95520a144b8c"}, {"server_uuid": "e1527592-5a69-44bf-ac58-d019d5ee71ac", "name": "network-vif-deleted", "tag": "5586f1d6-6aa1-482b-ae10-2cd96cf1d45d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:24.127209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-89c810dc-bdde-494f-ae79-c50ac8d11af5 req-ee582e43-dbd0-4b03-91a6-edbd97840cc5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:24.128008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-89c810dc-bdde-494f-ae79-c50ac8d11af5 req-ee582e43-dbd0-4b03-91a6-edbd97840cc5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:24.146014 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-89c810dc-bdde-494f-ae79-c50ac8d11af5 req-ee582e43-dbd0-4b03-91a6-edbd97840cc5 service nova] Creating event network-changed:2710cf64-1285-4d3b-8a24-95520a144b8c for instance 429f5dde-84d7-4bd3-a37a-066ac19fdc53 on nch2-master-1 Mar 05 20:56:24.148032 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-89c810dc-bdde-494f-ae79-c50ac8d11af5 req-ee582e43-dbd0-4b03-91a6-edbd97840cc5 service nova] Creating event network-vif-deleted:5586f1d6-6aa1-482b-ae10-2cd96cf1d45d for instance e1527592-5a69-44bf-ac58-d019d5ee71ac on nch2-master-1 Mar 05 20:56:24.156007 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-89c810dc-bdde-494f-ae79-c50ac8d11af5 req-ee582e43-dbd0-4b03-91a6-edbd97840cc5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050706 Mar 05 20:56:24.157202 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1161/2269] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:24.167088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-abea1376-1158-4547-8056-9326b347e382 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:24.168182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-abea1376-1158-4547-8056-9326b347e382 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:24.177598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-abea1376-1158-4547-8056-9326b347e382 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:24.179109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-abea1376-1158-4547-8056-9326b347e382 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:24.180373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-abea1376-1158-4547-8056-9326b347e382 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:24.181501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-abea1376-1158-4547-8056-9326b347e382 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:24.622928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:56:24.623948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:56:24.624633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:56:24.625835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:56:24.626479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:56:24.638231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:24.638842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:24.639789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:24.640592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:24.662963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Getting quotas for project fc76a60f3c6e4f2ea69c0445ba45e4a5. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:24.669310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Getting quotas for user 7d8fef08c46741448390a1ab640962eb and project fc76a60f3c6e4f2ea69c0445ba45e4a5. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:24.683474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:56:24.686746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:56:24.743460 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e03b9a34-c885-4943-9c69-84e907bebcd4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.658872 Mar 05 20:56:24.752782 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1109/2270] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:56:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:56:24.761043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6a15aaf-f046-4d45-8d2f-7fdd37b14827 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:24.761803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6a15aaf-f046-4d45-8d2f-7fdd37b14827 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:24.770089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6a15aaf-f046-4d45-8d2f-7fdd37b14827 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:24.770611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6a15aaf-f046-4d45-8d2f-7fdd37b14827 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:24.777128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6a15aaf-f046-4d45-8d2f-7fdd37b14827 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:24.778132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6a15aaf-f046-4d45-8d2f-7fdd37b14827 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:24.873610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6a15aaf-f046-4d45-8d2f-7fdd37b14827 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd929c57fe3445face2514365fe503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9adff4bad8486fae6271261a8137d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:24.890012 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6a15aaf-f046-4d45-8d2f-7fdd37b14827 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 200 len: 1273 microversion: 2.1 time: 0.135905 Mar 05 20:56:24.891859 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1110/2271] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:24 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:24.899663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4af1e9e1-e3f4-4994-ba35-50c26c7fbbe8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:24.900530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4af1e9e1-e3f4-4994-ba35-50c26c7fbbe8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:24.908192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4af1e9e1-e3f4-4994-ba35-50c26c7fbbe8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:24.908868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4af1e9e1-e3f4-4994-ba35-50c26c7fbbe8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:24.910743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4af1e9e1-e3f4-4994-ba35-50c26c7fbbe8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:24.911601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4af1e9e1-e3f4-4994-ba35-50c26c7fbbe8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:24.927025 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4af1e9e1-e3f4-4994-ba35-50c26c7fbbe8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance e1527592-5a69-44bf-ac58-d019d5ee71ac could not be found. Mar 05 20:56:24.927650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4af1e9e1-e3f4-4994-ba35-50c26c7fbbe8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance e1527592-5a69-44bf-ac58-d019d5ee71ac could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:24.929355 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4af1e9e1-e3f4-4994-ba35-50c26c7fbbe8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 404 len: 111 microversion: 2.1 time: 0.036085 Mar 05 20:56:24.929824 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1111/2272] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:24 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:24.935777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7ead4366-4b97-4733-bc88-0b7ab2ff9a72 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:24.937871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7ead4366-4b97-4733-bc88-0b7ab2ff9a72 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:24.948143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-abea1376-1158-4547-8056-9326b347e382 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:24.962446 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-abea1376-1158-4547-8056-9326b347e382 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1323 microversion: 2.1 time: 0.800558 Mar 05 20:56:24.965065 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1162/2273] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:24 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1323 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:25.076659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7ead4366-4b97-4733-bc88-0b7ab2ff9a72 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:25.086553 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7ead4366-4b97-4733-bc88-0b7ab2ff9a72 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1214 microversion: 2.1 time: 0.153707 Mar 05 20:56:25.098011 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1112/2274] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:24 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1214 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:25.121235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1dee234c-d536-4ec7-b9a0-e78f6efc8554 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:25.121999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1dee234c-d536-4ec7-b9a0-e78f6efc8554 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:25.131371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1dee234c-d536-4ec7-b9a0-e78f6efc8554 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:25.138751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1dee234c-d536-4ec7-b9a0-e78f6efc8554 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:25.139659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1dee234c-d536-4ec7-b9a0-e78f6efc8554 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:25.140186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1dee234c-d536-4ec7-b9a0-e78f6efc8554 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:25.159756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cac12e81-6e99-4895-8a0a-b87679af9e38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:25.160783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cac12e81-6e99-4895-8a0a-b87679af9e38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:25.175071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cac12e81-6e99-4895-8a0a-b87679af9e38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:25.175593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cac12e81-6e99-4895-8a0a-b87679af9e38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:25.176447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cac12e81-6e99-4895-8a0a-b87679af9e38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:25.176888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cac12e81-6e99-4895-8a0a-b87679af9e38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:25.202676 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-cac12e81-6e99-4895-8a0a-b87679af9e38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance e1527592-5a69-44bf-ac58-d019d5ee71ac could not be found. Mar 05 20:56:25.219969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cac12e81-6e99-4895-8a0a-b87679af9e38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance e1527592-5a69-44bf-ac58-d019d5ee71ac could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:25.223895 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cac12e81-6e99-4895-8a0a-b87679af9e38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066467 Mar 05 20:56:25.226643 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1113/2275] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 20:56:25 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac/os-volume_attachments => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:56:25.524805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-705833785", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "72f55423-ea6d-4438-a149-d5df19f9ecdd"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:25.624190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] validate_networks() for [('72f55423-ea6d-4438-a149-d5df19f9ecdd', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:56:26.081685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1dee234c-d536-4ec7-b9a0-e78f6efc8554 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:26.091235 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1dee234c-d536-4ec7-b9a0-e78f6efc8554 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1323 microversion: 2.1 time: 0.975445 Mar 05 20:56:26.098202 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1163/2276] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:25 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1323 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:26.104187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9d6dc9e3-f817-4927-bdc1-adb1e4b56420 req-6f86c004-7bac-4110-b733-78e2dcece480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d79358d-efb1-46c8-96c1-e0e3777d55e0", "tag": "e507f9d3-0b19-45f5-87ed-8f1f65b523b8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:26.137976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9d6dc9e3-f817-4927-bdc1-adb1e4b56420 req-6f86c004-7bac-4110-b733-78e2dcece480 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:26.139168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9d6dc9e3-f817-4927-bdc1-adb1e4b56420 req-6f86c004-7bac-4110-b733-78e2dcece480 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:26.197119 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9d6dc9e3-f817-4927-bdc1-adb1e4b56420 req-6f86c004-7bac-4110-b733-78e2dcece480 service nova] Creating event network-changed:e507f9d3-0b19-45f5-87ed-8f1f65b523b8 for instance 6d79358d-efb1-46c8-96c1-e0e3777d55e0 on nch2-master-1 Mar 05 20:56:26.218818 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9d6dc9e3-f817-4927-bdc1-adb1e4b56420 req-6f86c004-7bac-4110-b733-78e2dcece480 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118237 Mar 05 20:56:26.220965 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1164/2277] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:26.237315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8e2149a0-b4af-4b90-a7e7-a06447e62f82 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:26.247994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8e2149a0-b4af-4b90-a7e7-a06447e62f82 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:26.265732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e2149a0-b4af-4b90-a7e7-a06447e62f82 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:26.266314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e2149a0-b4af-4b90-a7e7-a06447e62f82 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:26.267219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e2149a0-b4af-4b90-a7e7-a06447e62f82 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:26.267906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e2149a0-b4af-4b90-a7e7-a06447e62f82 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:26.797764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8e2149a0-b4af-4b90-a7e7-a06447e62f82 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd929c57fe3445face2514365fe503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9adff4bad8486fae6271261a8137d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:26.815172 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8e2149a0-b4af-4b90-a7e7-a06447e62f82 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 200 len: 1315 microversion: 2.1 time: 0.581729 Mar 05 20:56:26.815532 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1165/2278] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:26 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:26.831015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c9301532-9123-45ce-99c6-2d48e58e47ab tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:26.832058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c9301532-9123-45ce-99c6-2d48e58e47ab tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:26.840021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9301532-9123-45ce-99c6-2d48e58e47ab tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:26.840857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9301532-9123-45ce-99c6-2d48e58e47ab tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:26.841910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9301532-9123-45ce-99c6-2d48e58e47ab tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:26.842603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9301532-9123-45ce-99c6-2d48e58e47ab tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:26.875860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:56:26.876366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:56:26.876876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:56:26.877365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:56:26.877853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:56:26.895323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:26.895818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:26.897876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:26.898621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:26.919338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:26.925678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for user e8b67d8bbe9a44898a889826e12ffb0b and project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:26.940337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:56:26.942933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: dd7ff36e-aca6-461f-9905-214d5b79f9bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:56:27.001343 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b4c6a6d4-a305-461e-b15c-577e137168f8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.481752 Mar 05 20:56:27.002803 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1114/2279] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:56:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 20:56:27.009982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ebbb47d1-289f-48e7-81ef-9da60ffd9c98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:27.010994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ebbb47d1-289f-48e7-81ef-9da60ffd9c98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:27.020796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ebbb47d1-289f-48e7-81ef-9da60ffd9c98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:27.021674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ebbb47d1-289f-48e7-81ef-9da60ffd9c98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:27.023340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ebbb47d1-289f-48e7-81ef-9da60ffd9c98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:27.024080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ebbb47d1-289f-48e7-81ef-9da60ffd9c98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:27.201033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ebbb47d1-289f-48e7-81ef-9da60ffd9c98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:27.213655 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ebbb47d1-289f-48e7-81ef-9da60ffd9c98 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1272 microversion: 2.1 time: 0.209044 Mar 05 20:56:27.228077 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1115/2280] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:27 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:27.233935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a72f827f-81d6-47a5-84e0-ac7c127fa146 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:27.234772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a72f827f-81d6-47a5-84e0-ac7c127fa146 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: dd7ff36e-aca6-461f-9905-214d5b79f9bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:27.326782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a72f827f-81d6-47a5-84e0-ac7c127fa146 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:27.346254 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a72f827f-81d6-47a5-84e0-ac7c127fa146 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb" status: 200 len: 1214 microversion: 2.1 time: 0.116820 Mar 05 20:56:27.358048 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1116/2281] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:27 2022] GET /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:27.358048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b428cf5d-5edd-4829-89a3-6cbdedf1b6e3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:27.358048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b428cf5d-5edd-4829-89a3-6cbdedf1b6e3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:27.366631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b428cf5d-5edd-4829-89a3-6cbdedf1b6e3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:27.367366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b428cf5d-5edd-4829-89a3-6cbdedf1b6e3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:27.368446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b428cf5d-5edd-4829-89a3-6cbdedf1b6e3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:27.370177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b428cf5d-5edd-4829-89a3-6cbdedf1b6e3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:27.678593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c9301532-9123-45ce-99c6-2d48e58e47ab tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:27.690383 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c9301532-9123-45ce-99c6-2d48e58e47ab tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1323 microversion: 2.1 time: 0.863687 Mar 05 20:56:27.691541 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1166/2282] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:26 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1323 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:27.704957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:27.705136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: dd7ff36e-aca6-461f-9905-214d5b79f9bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:27.711980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:27.712708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:27.713816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:27.714502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:27.745808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: dd7ff36e-aca6-461f-9905-214d5b79f9bb] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:56:27.757830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:27.758295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:27.870793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lazy-loading 'flavor' on Instance uuid dd7ff36e-aca6-461f-9905-214d5b79f9bb {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:56:27.892875 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lazy-loading 'system_metadata' on Instance uuid dd7ff36e-aca6-461f-9905-214d5b79f9bb {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:56:27.995825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lazy-loading 'metadata' on Instance uuid dd7ff36e-aca6-461f-9905-214d5b79f9bb {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:56:28.158202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:28.158671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:28.330228 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c80aeae3-c788-4926-b26b-b267ebef0d5c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb" status: 204 len: 0 microversion: 2.1 time: 0.637114 Mar 05 20:56:28.333710 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1167/2283] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:27 2022] DELETE /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb => generated 0 bytes in 639 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:28.340829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-66933118-40e0-4304-989d-73863f2e1004 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:28.341557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-66933118-40e0-4304-989d-73863f2e1004 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:28.358162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-66933118-40e0-4304-989d-73863f2e1004 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:28.358568 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-66933118-40e0-4304-989d-73863f2e1004 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:28.359371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-66933118-40e0-4304-989d-73863f2e1004 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:28.359859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-66933118-40e0-4304-989d-73863f2e1004 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:28.540046 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b428cf5d-5edd-4829-89a3-6cbdedf1b6e3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:28.552099 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b428cf5d-5edd-4829-89a3-6cbdedf1b6e3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1323 microversion: 2.1 time: 1.203703 Mar 05 20:56:28.553075 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1117/2284] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:27 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1323 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:28.573375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-054886a0-9d55-4860-bb25-4f45d52e4a7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:28.574502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-054886a0-9d55-4860-bb25-4f45d52e4a7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:28.582878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-054886a0-9d55-4860-bb25-4f45d52e4a7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:28.583561 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-054886a0-9d55-4860-bb25-4f45d52e4a7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:28.584637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-054886a0-9d55-4860-bb25-4f45d52e4a7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:28.585264 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-054886a0-9d55-4860-bb25-4f45d52e4a7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:28.690957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-054886a0-9d55-4860-bb25-4f45d52e4a7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:28.704741 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-054886a0-9d55-4860-bb25-4f45d52e4a7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1272 microversion: 2.1 time: 0.137133 Mar 05 20:56:28.705727 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1118/2285] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:28 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:28.712945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3e81e9cc-96b5-462d-bb1c-edcac55e6a53 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:28.714023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3e81e9cc-96b5-462d-bb1c-edcac55e6a53 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: dd7ff36e-aca6-461f-9905-214d5b79f9bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:28.721963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e81e9cc-96b5-462d-bb1c-edcac55e6a53 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:28.722782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e81e9cc-96b5-462d-bb1c-edcac55e6a53 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:28.725930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e81e9cc-96b5-462d-bb1c-edcac55e6a53 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:28.726849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e81e9cc-96b5-462d-bb1c-edcac55e6a53 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:28.780729 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-66933118-40e0-4304-989d-73863f2e1004 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd929c57fe3445face2514365fe503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9adff4bad8486fae6271261a8137d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:28.792401 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-66933118-40e0-4304-989d-73863f2e1004 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 200 len: 1315 microversion: 2.1 time: 0.457802 Mar 05 20:56:28.793161 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1168/2286] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:28 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:28.822104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3e81e9cc-96b5-462d-bb1c-edcac55e6a53 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:28.844673 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3e81e9cc-96b5-462d-bb1c-edcac55e6a53 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb" status: 200 len: 1272 microversion: 2.1 time: 0.130614 Mar 05 20:56:28.845430 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1119/2287] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:28 2022] GET /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:28.858336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1fffe943-ebf6-4759-87a6-7898b4a8e7ad tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:28.862376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1fffe943-ebf6-4759-87a6-7898b4a8e7ad tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:28.876444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1fffe943-ebf6-4759-87a6-7898b4a8e7ad tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:28.879117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1fffe943-ebf6-4759-87a6-7898b4a8e7ad tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:28.882132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1fffe943-ebf6-4759-87a6-7898b4a8e7ad tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:28.884045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1fffe943-ebf6-4759-87a6-7898b4a8e7ad tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:29.172812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-205798240", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "93578ff8-1ca6-4e6e-b4ae-025cd8c9d397"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:29.293579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] validate_networks() for [('93578ff8-1ca6-4e6e-b4ae-025cd8c9d397', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:56:29.522741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1fffe943-ebf6-4759-87a6-7898b4a8e7ad tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:29.535576 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1fffe943-ebf6-4759-87a6-7898b4a8e7ad tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1323 microversion: 2.1 time: 0.684885 Mar 05 20:56:29.536475 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1120/2288] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:28 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1323 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:29.549002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-136d2abd-55e5-484f-95ce-2ef49c67e9af req-baf8b3b3-1ed1-4100-98d3-cfb1ca14b34f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7219cb01-3958-42f5-9196-0ab130421997", "tag": "f42b72f9-4e53-4581-998e-872c13953811"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:29.576137 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-136d2abd-55e5-484f-95ce-2ef49c67e9af req-baf8b3b3-1ed1-4100-98d3-cfb1ca14b34f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:29.576453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-136d2abd-55e5-484f-95ce-2ef49c67e9af req-baf8b3b3-1ed1-4100-98d3-cfb1ca14b34f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:29.608612 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-136d2abd-55e5-484f-95ce-2ef49c67e9af req-baf8b3b3-1ed1-4100-98d3-cfb1ca14b34f service nova] Creating event network-changed:f42b72f9-4e53-4581-998e-872c13953811 for instance 7219cb01-3958-42f5-9196-0ab130421997 on nch1-master-1 Mar 05 20:56:29.618370 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-136d2abd-55e5-484f-95ce-2ef49c67e9af req-baf8b3b3-1ed1-4100-98d3-cfb1ca14b34f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078747 Mar 05 20:56:29.619194 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1121/2289] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:29.632758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0062b71f-9927-4ea7-a2f2-b3acae6dac02 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:29.633559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0062b71f-9927-4ea7-a2f2-b3acae6dac02 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:29.653025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0062b71f-9927-4ea7-a2f2-b3acae6dac02 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:29.656132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0062b71f-9927-4ea7-a2f2-b3acae6dac02 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:29.657153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0062b71f-9927-4ea7-a2f2-b3acae6dac02 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:29.657762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0062b71f-9927-4ea7-a2f2-b3acae6dac02 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:29.784533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:56:29.785019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:56:29.785430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:56:29.785845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:56:29.786261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:56:29.799609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:29.800131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:29.801059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:29.801652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:29.825471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Getting quotas for project 77c35382c7454a51ab1fbd37f9157ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:29.837313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Getting quotas for user 4ff43fd6998d454887c5aae39464ab72 and project 77c35382c7454a51ab1fbd37f9157ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:29.851338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:56:29.854259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:56:29.941092 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e9e9a7a0-fc6c-4969-8cb7-a240f84e43a4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137060 Mar 05 20:56:29.942463 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1169/2290] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:56:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:56:29.948666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-de75971d-ba11-4456-9379-3f21f20ab9cd req-a590c932-672e-47b3-8f4f-89409bd7e650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc", "name": "network-vif-plugged", "status": "completed", "tag": "8ac1b815-0a98-4dee-b99b-4a42f8faeb8d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:29.966597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-de75971d-ba11-4456-9379-3f21f20ab9cd req-a590c932-672e-47b3-8f4f-89409bd7e650 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:29.967291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-de75971d-ba11-4456-9379-3f21f20ab9cd req-a590c932-672e-47b3-8f4f-89409bd7e650 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:29.981388 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-de75971d-ba11-4456-9379-3f21f20ab9cd req-a590c932-672e-47b3-8f4f-89409bd7e650 service nova] Creating event network-vif-plugged:8ac1b815-0a98-4dee-b99b-4a42f8faeb8d for instance 15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc on nch1-master-1 Mar 05 20:56:29.987307 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-de75971d-ba11-4456-9379-3f21f20ab9cd req-a590c932-672e-47b3-8f4f-89409bd7e650 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043244 Mar 05 20:56:29.988209 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1170/2291] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:29.994484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ce59c8c-22a3-47dd-b97a-fecf6262b1c8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:29.995920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ce59c8c-22a3-47dd-b97a-fecf6262b1c8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:30.003598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ce59c8c-22a3-47dd-b97a-fecf6262b1c8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:30.004161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ce59c8c-22a3-47dd-b97a-fecf6262b1c8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:30.004919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ce59c8c-22a3-47dd-b97a-fecf6262b1c8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:30.005367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ce59c8c-22a3-47dd-b97a-fecf6262b1c8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:30.271383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4ce59c8c-22a3-47dd-b97a-fecf6262b1c8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:30.280606 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4ce59c8c-22a3-47dd-b97a-fecf6262b1c8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1314 microversion: 2.1 time: 0.291223 Mar 05 20:56:30.283126 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1171/2292] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:29 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:30.298336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-24d7258c-8867-4489-8f5e-f043f3e63a39 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:30.299188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-24d7258c-8867-4489-8f5e-f043f3e63a39 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:30.312350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-24d7258c-8867-4489-8f5e-f043f3e63a39 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:30.315531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-24d7258c-8867-4489-8f5e-f043f3e63a39 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:30.317683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-24d7258c-8867-4489-8f5e-f043f3e63a39 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:30.319642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-24d7258c-8867-4489-8f5e-f043f3e63a39 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:30.446232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0062b71f-9927-4ea7-a2f2-b3acae6dac02 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:30.460180 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0062b71f-9927-4ea7-a2f2-b3acae6dac02 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1323 microversion: 2.1 time: 0.838536 Mar 05 20:56:30.462493 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1122/2293] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:29 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1323 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:30.477515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aebdcb6f-536a-41ce-888c-08d36fa7c6c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:30.478205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aebdcb6f-536a-41ce-888c-08d36fa7c6c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: dd7ff36e-aca6-461f-9905-214d5b79f9bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:30.489350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aebdcb6f-536a-41ce-888c-08d36fa7c6c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:30.492311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aebdcb6f-536a-41ce-888c-08d36fa7c6c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:30.494041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aebdcb6f-536a-41ce-888c-08d36fa7c6c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:30.496425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aebdcb6f-536a-41ce-888c-08d36fa7c6c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:30.505668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-24d7258c-8867-4489-8f5e-f043f3e63a39 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd929c57fe3445face2514365fe503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9adff4bad8486fae6271261a8137d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:30.519615 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-24d7258c-8867-4489-8f5e-f043f3e63a39 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 200 len: 1315 microversion: 2.1 time: 0.234165 Mar 05 20:56:30.520863 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1172/2294] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:30 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:30.528973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3a26737e-8f1b-442e-8ee5-862110ac5377 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:30.530373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3a26737e-8f1b-442e-8ee5-862110ac5377 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:30.620305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3a26737e-8f1b-442e-8ee5-862110ac5377 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:30.633497 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3a26737e-8f1b-442e-8ee5-862110ac5377 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1210 microversion: 2.1 time: 0.110912 Mar 05 20:56:30.645312 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1173/2295] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:30 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1210 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:30.651866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ae8e4e07-756c-4d8e-aa14-4b538b09a196 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:30.653028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ae8e4e07-756c-4d8e-aa14-4b538b09a196 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:30.661455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae8e4e07-756c-4d8e-aa14-4b538b09a196 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:30.662276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae8e4e07-756c-4d8e-aa14-4b538b09a196 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:30.664041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae8e4e07-756c-4d8e-aa14-4b538b09a196 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:30.665176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae8e4e07-756c-4d8e-aa14-4b538b09a196 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:30.771990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aebdcb6f-536a-41ce-888c-08d36fa7c6c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:30.790940 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aebdcb6f-536a-41ce-888c-08d36fa7c6c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb" status: 200 len: 1216 microversion: 2.1 time: 0.323229 Mar 05 20:56:30.796730 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1123/2296] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:30 2022] GET /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb => generated 1216 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:30.912343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ae8e4e07-756c-4d8e-aa14-4b538b09a196 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:30.922763 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ae8e4e07-756c-4d8e-aa14-4b538b09a196 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1323 microversion: 2.1 time: 0.275854 Mar 05 20:56:30.933814 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1174/2297] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:30 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1323 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:31.300138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0309aa97-3c2e-4036-a01b-9281a736f063 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:31.301040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0309aa97-3c2e-4036-a01b-9281a736f063 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:31.308759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0309aa97-3c2e-4036-a01b-9281a736f063 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:31.309539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0309aa97-3c2e-4036-a01b-9281a736f063 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:31.310504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0309aa97-3c2e-4036-a01b-9281a736f063 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:31.311118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0309aa97-3c2e-4036-a01b-9281a736f063 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:31.479410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e6e2966a-3c69-4373-b6ae-c7f7df0293db tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:31.480370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e6e2966a-3c69-4373-b6ae-c7f7df0293db tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:31.499243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6e2966a-3c69-4373-b6ae-c7f7df0293db tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:31.500215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6e2966a-3c69-4373-b6ae-c7f7df0293db tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:31.501166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6e2966a-3c69-4373-b6ae-c7f7df0293db tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:31.501759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6e2966a-3c69-4373-b6ae-c7f7df0293db tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:31.778218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0309aa97-3c2e-4036-a01b-9281a736f063 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:31.786859 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0309aa97-3c2e-4036-a01b-9281a736f063 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1314 microversion: 2.1 time: 0.490578 Mar 05 20:56:31.797824 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1124/2298] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:31 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:31.809954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1a4b23d0-c917-4c86-b28a-0f2efd9e73ef tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:31.810935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1a4b23d0-c917-4c86-b28a-0f2efd9e73ef tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:31.817666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a4b23d0-c917-4c86-b28a-0f2efd9e73ef tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:31.820125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a4b23d0-c917-4c86-b28a-0f2efd9e73ef tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:31.821122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a4b23d0-c917-4c86-b28a-0f2efd9e73ef tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:31.821829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a4b23d0-c917-4c86-b28a-0f2efd9e73ef tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:32.098387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e6e2966a-3c69-4373-b6ae-c7f7df0293db tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:32.106790 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e6e2966a-3c69-4373-b6ae-c7f7df0293db tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1323 microversion: 2.1 time: 0.632277 Mar 05 20:56:32.107732 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1175/2299] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:31 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1323 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:32.113900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bf511a35-5ab4-4296-a8f0-eb5279540b99 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:32.114793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bf511a35-5ab4-4296-a8f0-eb5279540b99 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:32.122700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf511a35-5ab4-4296-a8f0-eb5279540b99 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:32.123469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf511a35-5ab4-4296-a8f0-eb5279540b99 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:32.124478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf511a35-5ab4-4296-a8f0-eb5279540b99 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:32.124918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bf511a35-5ab4-4296-a8f0-eb5279540b99 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:32.198331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bf511a35-5ab4-4296-a8f0-eb5279540b99 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:32.208382 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bf511a35-5ab4-4296-a8f0-eb5279540b99 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1268 microversion: 2.1 time: 0.099343 Mar 05 20:56:32.210804 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1176/2300] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:32 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1268 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:32.216300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-269da861-bf24-49ff-9548-592e2923eed3 req-f326d17b-7f08-4931-8ee9-1edc6ec3e0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac5525dc-a44a-4aa9-af58-a6f93058155e", "tag": "207ec9a3-97bb-4f65-9dd6-1a65d33c9cf5"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:32.225141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-269da861-bf24-49ff-9548-592e2923eed3 req-f326d17b-7f08-4931-8ee9-1edc6ec3e0dd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:32.225588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-269da861-bf24-49ff-9548-592e2923eed3 req-f326d17b-7f08-4931-8ee9-1edc6ec3e0dd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:32.238112 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-269da861-bf24-49ff-9548-592e2923eed3 req-f326d17b-7f08-4931-8ee9-1edc6ec3e0dd service nova] Creating event network-changed:207ec9a3-97bb-4f65-9dd6-1a65d33c9cf5 for instance ac5525dc-a44a-4aa9-af58-a6f93058155e on nch2-master-1 Mar 05 20:56:32.243712 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-269da861-bf24-49ff-9548-592e2923eed3 req-f326d17b-7f08-4931-8ee9-1edc6ec3e0dd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031230 Mar 05 20:56:32.244841 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1177/2301] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:32.251483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e221a3a9-25b7-461a-8595-552ea20bb030 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:32.252247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e221a3a9-25b7-461a-8595-552ea20bb030 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: dd7ff36e-aca6-461f-9905-214d5b79f9bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:32.259481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e221a3a9-25b7-461a-8595-552ea20bb030 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:32.259965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e221a3a9-25b7-461a-8595-552ea20bb030 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:32.260757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e221a3a9-25b7-461a-8595-552ea20bb030 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:32.261219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e221a3a9-25b7-461a-8595-552ea20bb030 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:32.596471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1a4b23d0-c917-4c86-b28a-0f2efd9e73ef tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd929c57fe3445face2514365fe503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9adff4bad8486fae6271261a8137d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:32.605374 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1a4b23d0-c917-4c86-b28a-0f2efd9e73ef tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 200 len: 1315 microversion: 2.1 time: 0.805904 Mar 05 20:56:32.606110 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1125/2302] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:31 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 1315 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:32.611160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7ef77b9b-56a2-483e-9fde-8bf861ae8f43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:32.612221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7ef77b9b-56a2-483e-9fde-8bf861ae8f43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:32.626964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ef77b9b-56a2-483e-9fde-8bf861ae8f43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:32.627807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ef77b9b-56a2-483e-9fde-8bf861ae8f43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:32.632387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ef77b9b-56a2-483e-9fde-8bf861ae8f43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:32.633222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ef77b9b-56a2-483e-9fde-8bf861ae8f43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:32.671907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e221a3a9-25b7-461a-8595-552ea20bb030 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:32.679897 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e221a3a9-25b7-461a-8595-552ea20bb030 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb" status: 200 len: 1218 microversion: 2.1 time: 0.433350 Mar 05 20:56:32.680794 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1178/2303] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:32 2022] GET /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb => generated 1218 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:32.685680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-996c2c92-020e-48d1-83ac-f435b3485034 req-0a0d5255-7aec-408f-a6ab-c73e66e60ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429f5dde-84d7-4bd3-a37a-066ac19fdc53", "name": "network-vif-plugged", "status": "completed", "tag": "2710cf64-1285-4d3b-8a24-95520a144b8c"}, {"server_uuid": "6d79358d-efb1-46c8-96c1-e0e3777d55e0", "name": "network-vif-plugged", "status": "completed", "tag": "e507f9d3-0b19-45f5-87ed-8f1f65b523b8"}, {"server_uuid": "876a2098-5755-45a2-879f-9665c69d764e", "name": "network-vif-plugged", "status": "completed", "tag": "3a39d010-7efb-4d30-aa59-44e63c57a224"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:32.696229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-996c2c92-020e-48d1-83ac-f435b3485034 req-0a0d5255-7aec-408f-a6ab-c73e66e60ca9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:32.697175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-996c2c92-020e-48d1-83ac-f435b3485034 req-0a0d5255-7aec-408f-a6ab-c73e66e60ca9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:32.713267 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-996c2c92-020e-48d1-83ac-f435b3485034 req-0a0d5255-7aec-408f-a6ab-c73e66e60ca9 service nova] Creating event network-vif-plugged:2710cf64-1285-4d3b-8a24-95520a144b8c for instance 429f5dde-84d7-4bd3-a37a-066ac19fdc53 on nch2-master-1 Mar 05 20:56:32.714140 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-996c2c92-020e-48d1-83ac-f435b3485034 req-0a0d5255-7aec-408f-a6ab-c73e66e60ca9 service nova] Creating event network-vif-plugged:e507f9d3-0b19-45f5-87ed-8f1f65b523b8 for instance 6d79358d-efb1-46c8-96c1-e0e3777d55e0 on nch2-master-1 Mar 05 20:56:32.714850 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-996c2c92-020e-48d1-83ac-f435b3485034 req-0a0d5255-7aec-408f-a6ab-c73e66e60ca9 service nova] Creating event network-vif-plugged:3a39d010-7efb-4d30-aa59-44e63c57a224 for instance 876a2098-5755-45a2-879f-9665c69d764e on nch2-master-1 Mar 05 20:56:32.725578 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-996c2c92-020e-48d1-83ac-f435b3485034 req-0a0d5255-7aec-408f-a6ab-c73e66e60ca9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.043264 Mar 05 20:56:32.726310 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1179/2304] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:32.807712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-20a41520-ac3f-47e6-9a73-66e9cb93df31 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:32.809514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-20a41520-ac3f-47e6-9a73-66e9cb93df31 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:32.817316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20a41520-ac3f-47e6-9a73-66e9cb93df31 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:32.818038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20a41520-ac3f-47e6-9a73-66e9cb93df31 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:32.819924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20a41520-ac3f-47e6-9a73-66e9cb93df31 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:32.820938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20a41520-ac3f-47e6-9a73-66e9cb93df31 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:32.954830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7ef77b9b-56a2-483e-9fde-8bf861ae8f43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:32.970660 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7ef77b9b-56a2-483e-9fde-8bf861ae8f43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1323 microversion: 2.1 time: 0.363219 Mar 05 20:56:32.971904 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1126/2305] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:32 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1323 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:33.124200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-86e971c7-7f7a-4019-aa4e-cec1acff0c2f tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:33.124830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-86e971c7-7f7a-4019-aa4e-cec1acff0c2f tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:33.130898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86e971c7-7f7a-4019-aa4e-cec1acff0c2f tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:33.132196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86e971c7-7f7a-4019-aa4e-cec1acff0c2f tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:33.132965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86e971c7-7f7a-4019-aa4e-cec1acff0c2f tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:33.133415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86e971c7-7f7a-4019-aa4e-cec1acff0c2f tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:33.319454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-86e971c7-7f7a-4019-aa4e-cec1acff0c2f tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:33.327418 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-86e971c7-7f7a-4019-aa4e-cec1acff0c2f tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1323 microversion: 2.1 time: 0.207050 Mar 05 20:56:33.328142 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1127/2306] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:33 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1323 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:33.332958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-066d0840-4144-4886-ae53-541e012a0882 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:33.333876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-066d0840-4144-4886-ae53-541e012a0882 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:33.340243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-066d0840-4144-4886-ae53-541e012a0882 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:33.340782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-066d0840-4144-4886-ae53-541e012a0882 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:33.341704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-066d0840-4144-4886-ae53-541e012a0882 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:33.342221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-066d0840-4144-4886-ae53-541e012a0882 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:33.421108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-066d0840-4144-4886-ae53-541e012a0882 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:33.423000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-20a41520-ac3f-47e6-9a73-66e9cb93df31 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:33.430945 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-066d0840-4144-4886-ae53-541e012a0882 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1268 microversion: 2.1 time: 0.101433 Mar 05 20:56:33.431982 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1128/2307] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:33 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1268 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:33.436473 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-20a41520-ac3f-47e6-9a73-66e9cb93df31 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1314 microversion: 2.1 time: 0.635008 Mar 05 20:56:33.437594 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1180/2308] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:32 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:33.624285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5c5b486a-99f3-42a5-83bd-e520c5a6a8cd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:33.624924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5c5b486a-99f3-42a5-83bd-e520c5a6a8cd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:33.634735 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5c5b486a-99f3-42a5-83bd-e520c5a6a8cd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:33.635189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5c5b486a-99f3-42a5-83bd-e520c5a6a8cd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:33.635999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5c5b486a-99f3-42a5-83bd-e520c5a6a8cd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:33.636438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5c5b486a-99f3-42a5-83bd-e520c5a6a8cd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:33.698049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c10ca7c0-a79a-495a-901a-69271b878158 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:33.698691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c10ca7c0-a79a-495a-901a-69271b878158 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: dd7ff36e-aca6-461f-9905-214d5b79f9bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:33.706349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c10ca7c0-a79a-495a-901a-69271b878158 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:33.706903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c10ca7c0-a79a-495a-901a-69271b878158 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:33.708189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c10ca7c0-a79a-495a-901a-69271b878158 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:33.708706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c10ca7c0-a79a-495a-901a-69271b878158 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:33.730060 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-c10ca7c0-a79a-495a-901a-69271b878158 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance dd7ff36e-aca6-461f-9905-214d5b79f9bb could not be found. Mar 05 20:56:33.730680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c10ca7c0-a79a-495a-901a-69271b878158 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance dd7ff36e-aca6-461f-9905-214d5b79f9bb could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:33.731770 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c10ca7c0-a79a-495a-901a-69271b878158 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb" status: 404 len: 111 microversion: 2.1 time: 0.038853 Mar 05 20:56:33.732640 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1181/2309] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:33 2022] GET /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:33.814421 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5c5b486a-99f3-42a5-83bd-e520c5a6a8cd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd929c57fe3445face2514365fe503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9adff4bad8486fae6271261a8137d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:33.823785 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5c5b486a-99f3-42a5-83bd-e520c5a6a8cd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 200 len: 1315 microversion: 2.1 time: 0.204361 Mar 05 20:56:33.824478 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1129/2310] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:33 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:33.851636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-410959096", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "72f55423-ea6d-4438-a149-d5df19f9ecdd"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:33.925843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] validate_networks() for [('72f55423-ea6d-4438-a149-d5df19f9ecdd', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:56:33.991422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a1d9bc03-b0b6-4aa2-a113-1ea50b953e03 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:33.992363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a1d9bc03-b0b6-4aa2-a113-1ea50b953e03 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:33.998528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1d9bc03-b0b6-4aa2-a113-1ea50b953e03 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:33.998980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1d9bc03-b0b6-4aa2-a113-1ea50b953e03 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:33.999848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1d9bc03-b0b6-4aa2-a113-1ea50b953e03 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:34.000406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1d9bc03-b0b6-4aa2-a113-1ea50b953e03 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:34.141401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a1d9bc03-b0b6-4aa2-a113-1ea50b953e03 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:34.149205 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a1d9bc03-b0b6-4aa2-a113-1ea50b953e03 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1323 microversion: 2.1 time: 0.163920 Mar 05 20:56:34.149966 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1130/2311] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:33 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1323 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:34.344886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4423b0f0-be50-42c7-a6f4-268a1bdfaf6d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:34.345619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4423b0f0-be50-42c7-a6f4-268a1bdfaf6d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:34.352989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4423b0f0-be50-42c7-a6f4-268a1bdfaf6d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:34.353570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4423b0f0-be50-42c7-a6f4-268a1bdfaf6d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:34.354361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4423b0f0-be50-42c7-a6f4-268a1bdfaf6d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:34.354805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4423b0f0-be50-42c7-a6f4-268a1bdfaf6d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:34.495419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4423b0f0-be50-42c7-a6f4-268a1bdfaf6d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:34.502930 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4423b0f0-be50-42c7-a6f4-268a1bdfaf6d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1323 microversion: 2.1 time: 0.161896 Mar 05 20:56:34.503513 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1131/2312] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:34 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:34.510312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-01ea1fdf-e0fd-4f69-9cfe-61e7bbad83c4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:34.511154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-01ea1fdf-e0fd-4f69-9cfe-61e7bbad83c4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:34.517959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-01ea1fdf-e0fd-4f69-9cfe-61e7bbad83c4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:34.518683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-01ea1fdf-e0fd-4f69-9cfe-61e7bbad83c4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:34.519788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-01ea1fdf-e0fd-4f69-9cfe-61e7bbad83c4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:34.520418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-01ea1fdf-e0fd-4f69-9cfe-61e7bbad83c4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:34.680773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-01ea1fdf-e0fd-4f69-9cfe-61e7bbad83c4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:34.689240 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-01ea1fdf-e0fd-4f69-9cfe-61e7bbad83c4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1310 microversion: 2.1 time: 0.184505 Mar 05 20:56:34.689825 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1132/2313] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:34 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1310 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:34.703099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1bf53c14-7d13-4c69-b3d0-782f224f0855 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:34.704303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1bf53c14-7d13-4c69-b3d0-782f224f0855 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:34.716435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bf53c14-7d13-4c69-b3d0-782f224f0855 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:34.716985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bf53c14-7d13-4c69-b3d0-782f224f0855 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:34.717861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bf53c14-7d13-4c69-b3d0-782f224f0855 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:34.718723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bf53c14-7d13-4c69-b3d0-782f224f0855 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:34.763171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:56:34.763701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:56:34.764091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:56:34.764501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:56:34.764913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:56:34.776616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:34.777756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:34.779847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:34.788430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:34.813774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:34.821133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for user e8b67d8bbe9a44898a889826e12ffb0b and project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:34.837320 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:56:34.855779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:56:34.922231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1bf53c14-7d13-4c69-b3d0-782f224f0855 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:34.933942 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1bf53c14-7d13-4c69-b3d0-782f224f0855 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1314 microversion: 2.1 time: 0.242169 Mar 05 20:56:34.943272 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1133/2314] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:34 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:34.944407 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d9d73d49-29af-4741-86a3-adc67f47a27c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096816 Mar 05 20:56:34.948587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f0c3c575-fad0-49a6-b9be-0443bbc4c2fd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:34.949224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f0c3c575-fad0-49a6-b9be-0443bbc4c2fd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:34.956754 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1182/2315] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:56:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:56:34.964561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-612cd740-c29b-4b67-9c5f-8845555cc688 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:34.965855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-612cd740-c29b-4b67-9c5f-8845555cc688 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:34.969084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0c3c575-fad0-49a6-b9be-0443bbc4c2fd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:34.970969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0c3c575-fad0-49a6-b9be-0443bbc4c2fd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:34.973250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0c3c575-fad0-49a6-b9be-0443bbc4c2fd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:34.974606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0c3c575-fad0-49a6-b9be-0443bbc4c2fd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:35.081584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-612cd740-c29b-4b67-9c5f-8845555cc688 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:35.088781 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-612cd740-c29b-4b67-9c5f-8845555cc688 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1214 microversion: 2.1 time: 0.130724 Mar 05 20:56:35.092824 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1183/2316] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:34 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1214 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:35.168450 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fd01a467-d111-4373-9b29-e3e0e3ef3371 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:35.169084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fd01a467-d111-4373-9b29-e3e0e3ef3371 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:35.179883 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd01a467-d111-4373-9b29-e3e0e3ef3371 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:35.183615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd01a467-d111-4373-9b29-e3e0e3ef3371 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:35.184512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd01a467-d111-4373-9b29-e3e0e3ef3371 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:35.192342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd01a467-d111-4373-9b29-e3e0e3ef3371 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:35.280743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f0c3c575-fad0-49a6-b9be-0443bbc4c2fd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd929c57fe3445face2514365fe503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9adff4bad8486fae6271261a8137d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:35.293591 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f0c3c575-fad0-49a6-b9be-0443bbc4c2fd tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 200 len: 1315 microversion: 2.1 time: 0.357625 Mar 05 20:56:35.294579 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1134/2317] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:34 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:35.306611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-abbcb2d0-dc06-44a9-962b-9c2ad5c51582 req-f291e61f-0350-4dc0-858c-36cddf799362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81ff1cf-7bf9-40ae-a814-4465e0f3783e", "tag": "a1950e50-9c39-44c3-af17-454a8fc9713b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:35.319502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-abbcb2d0-dc06-44a9-962b-9c2ad5c51582 req-f291e61f-0350-4dc0-858c-36cddf799362 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:35.320300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-abbcb2d0-dc06-44a9-962b-9c2ad5c51582 req-f291e61f-0350-4dc0-858c-36cddf799362 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:35.341132 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-abbcb2d0-dc06-44a9-962b-9c2ad5c51582 req-f291e61f-0350-4dc0-858c-36cddf799362 service nova] Creating event network-changed:a1950e50-9c39-44c3-af17-454a8fc9713b for instance d81ff1cf-7bf9-40ae-a814-4465e0f3783e on nch1-master-1 Mar 05 20:56:35.353387 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-abbcb2d0-dc06-44a9-962b-9c2ad5c51582 req-f291e61f-0350-4dc0-858c-36cddf799362 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052626 Mar 05 20:56:35.357863 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1135/2318] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:35.522975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a9e38740-5803-4fea-b477-0d43a001e78b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:35.524628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a9e38740-5803-4fea-b477-0d43a001e78b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:35.539641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9e38740-5803-4fea-b477-0d43a001e78b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:35.541164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9e38740-5803-4fea-b477-0d43a001e78b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:35.543124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9e38740-5803-4fea-b477-0d43a001e78b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:35.543968 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fd01a467-d111-4373-9b29-e3e0e3ef3371 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:35.545777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9e38740-5803-4fea-b477-0d43a001e78b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:35.554759 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fd01a467-d111-4373-9b29-e3e0e3ef3371 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 200 len: 1515 microversion: 2.1 time: 0.391044 Mar 05 20:56:35.558166 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1184/2319] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:35 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 1515 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:35.574255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0133cd87-e578-471d-bfea-2c2e5f04b60d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:35.574894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0133cd87-e578-471d-bfea-2c2e5f04b60d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:35.600729 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0133cd87-e578-471d-bfea-2c2e5f04b60d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:35.601433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0133cd87-e578-471d-bfea-2c2e5f04b60d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:35.604208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0133cd87-e578-471d-bfea-2c2e5f04b60d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:35.604686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0133cd87-e578-471d-bfea-2c2e5f04b60d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:35.838389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a9e38740-5803-4fea-b477-0d43a001e78b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:35.848589 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a9e38740-5803-4fea-b477-0d43a001e78b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1519 microversion: 2.1 time: 0.332180 Mar 05 20:56:35.862620 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1136/2320] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:35 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1519 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:35.876781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6494bfaf-6400-4abc-baa8-7991f3a24fb9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:35.886023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6494bfaf-6400-4abc-baa8-7991f3a24fb9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:35.895519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6494bfaf-6400-4abc-baa8-7991f3a24fb9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:35.896179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6494bfaf-6400-4abc-baa8-7991f3a24fb9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:35.898465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6494bfaf-6400-4abc-baa8-7991f3a24fb9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:35.898985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6494bfaf-6400-4abc-baa8-7991f3a24fb9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:36.104248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6494bfaf-6400-4abc-baa8-7991f3a24fb9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:36.121456 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6494bfaf-6400-4abc-baa8-7991f3a24fb9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1310 microversion: 2.1 time: 0.257421 Mar 05 20:56:36.124037 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1137/2321] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:35 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1310 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:36.131949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-449bd4bc-6428-4d25-a5d2-5c93b05af5d4 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Action: 'create', calling method: .version_select at 0x7fed5c204550>, body: {"pool": null} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:36.398834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0133cd87-e578-471d-bfea-2c2e5f04b60d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:36.409320 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0133cd87-e578-471d-bfea-2c2e5f04b60d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc" status: 200 len: 1515 microversion: 2.1 time: 0.839717 Mar 05 20:56:36.410077 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1185/2322] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:35 2022] GET /compute/v2.1/servers/15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc => generated 1515 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:36.417763 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cb760654-9121-4b7b-a144-dfac6ea1ca7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:36.418588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cb760654-9121-4b7b-a144-dfac6ea1ca7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:36.425829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb760654-9121-4b7b-a144-dfac6ea1ca7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:36.426649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb760654-9121-4b7b-a144-dfac6ea1ca7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:36.427771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb760654-9121-4b7b-a144-dfac6ea1ca7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:36.429234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb760654-9121-4b7b-a144-dfac6ea1ca7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:36.692053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cb760654-9121-4b7b-a144-dfac6ea1ca7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:36.704959 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cb760654-9121-4b7b-a144-dfac6ea1ca7c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1314 microversion: 2.1 time: 0.293395 Mar 05 20:56:36.706057 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1186/2323] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:36 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:36.733250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5a209fb8-88a6-404c-86a4-2050fcaa3202 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:36.734821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5a209fb8-88a6-404c-86a4-2050fcaa3202 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:36.744861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a209fb8-88a6-404c-86a4-2050fcaa3202 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:36.746223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a209fb8-88a6-404c-86a4-2050fcaa3202 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:36.747396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a209fb8-88a6-404c-86a4-2050fcaa3202 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:36.748133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a209fb8-88a6-404c-86a4-2050fcaa3202 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:36.853148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5a209fb8-88a6-404c-86a4-2050fcaa3202 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:36.865151 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5a209fb8-88a6-404c-86a4-2050fcaa3202 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1272 microversion: 2.1 time: 0.157434 Mar 05 20:56:36.867817 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1187/2324] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:36 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:36.895406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fdeeca1a-a366-4776-af2b-709d6c5b82e3 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:36.896199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fdeeca1a-a366-4776-af2b-709d6c5b82e3 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:36.906357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fdeeca1a-a366-4776-af2b-709d6c5b82e3 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:36.906804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fdeeca1a-a366-4776-af2b-709d6c5b82e3 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:36.907869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fdeeca1a-a366-4776-af2b-709d6c5b82e3 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:36.908326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fdeeca1a-a366-4776-af2b-709d6c5b82e3 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:37.214552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fdeeca1a-a366-4776-af2b-709d6c5b82e3 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd929c57fe3445face2514365fe503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9adff4bad8486fae6271261a8137d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:37.229775 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fdeeca1a-a366-4776-af2b-709d6c5b82e3 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 200 len: 1315 microversion: 2.1 time: 0.349666 Mar 05 20:56:37.230967 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1188/2325] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:36 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:37.249943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-47b28fe9-40be-4ab9-8f67-ffc8ea4afff0 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:37.250879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-47b28fe9-40be-4ab9-8f67-ffc8ea4afff0 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 876a2098-5755-45a2-879f-9665c69d764e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:37.266882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47b28fe9-40be-4ab9-8f67-ffc8ea4afff0 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:37.268061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47b28fe9-40be-4ab9-8f67-ffc8ea4afff0 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:37.270552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47b28fe9-40be-4ab9-8f67-ffc8ea4afff0 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:37.271343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47b28fe9-40be-4ab9-8f67-ffc8ea4afff0 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:37.667405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-47b28fe9-40be-4ab9-8f67-ffc8ea4afff0 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:37.679360 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-47b28fe9-40be-4ab9-8f67-ffc8ea4afff0 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e" status: 200 len: 1516 microversion: 2.1 time: 0.447050 Mar 05 20:56:37.679992 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1189/2326] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:37 2022] GET /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e => generated 1516 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:37.694064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b0069ff6-dc4d-4118-9b53-6796321808ce tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:37.694957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b0069ff6-dc4d-4118-9b53-6796321808ce tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:37.710132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0069ff6-dc4d-4118-9b53-6796321808ce tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:37.716366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0069ff6-dc4d-4118-9b53-6796321808ce tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:37.718913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0069ff6-dc4d-4118-9b53-6796321808ce tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:37.719556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0069ff6-dc4d-4118-9b53-6796321808ce tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:38.027938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b0069ff6-dc4d-4118-9b53-6796321808ce tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:38.036070 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b0069ff6-dc4d-4118-9b53-6796321808ce tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1310 microversion: 2.1 time: 0.352645 Mar 05 20:56:38.045911 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1190/2327] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:37 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1310 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:38.045911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-5bd7921e-ff63-4e2d-8f8f-448498ea27f5 req-68cc87a8-c4e0-4964-a48b-7bb922f56683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7219cb01-3958-42f5-9196-0ab130421997", "name": "network-vif-plugged", "status": "completed", "tag": "f42b72f9-4e53-4581-998e-872c13953811"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:38.051267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5bd7921e-ff63-4e2d-8f8f-448498ea27f5 req-68cc87a8-c4e0-4964-a48b-7bb922f56683 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:38.052086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5bd7921e-ff63-4e2d-8f8f-448498ea27f5 req-68cc87a8-c4e0-4964-a48b-7bb922f56683 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:38.063453 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-5bd7921e-ff63-4e2d-8f8f-448498ea27f5 req-68cc87a8-c4e0-4964-a48b-7bb922f56683 service nova] Creating event network-vif-plugged:f42b72f9-4e53-4581-998e-872c13953811 for instance 7219cb01-3958-42f5-9196-0ab130421997 on nch1-master-1 Mar 05 20:56:38.070454 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-5bd7921e-ff63-4e2d-8f8f-448498ea27f5 req-68cc87a8-c4e0-4964-a48b-7bb922f56683 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032168 Mar 05 20:56:38.071178 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1191/2328] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:38.078766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-824c181a-01f7-42a7-ac99-848bdc1f028e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:38.078766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-824c181a-01f7-42a7-ac99-848bdc1f028e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 876a2098-5755-45a2-879f-9665c69d764e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:38.086119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-824c181a-01f7-42a7-ac99-848bdc1f028e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:38.086710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-824c181a-01f7-42a7-ac99-848bdc1f028e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:38.087628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-824c181a-01f7-42a7-ac99-848bdc1f028e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:38.088195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-824c181a-01f7-42a7-ac99-848bdc1f028e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:38.129422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-824c181a-01f7-42a7-ac99-848bdc1f028e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 876a2098-5755-45a2-879f-9665c69d764e] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:56:38.160239 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-449bd4bc-6428-4d25-a5d2-5c93b05af5d4 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.033797 Mar 05 20:56:38.160851 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1138/2329] 10.222.0.15 () {60 vars in 1169 bytes} [Sat Mar 5 20:56:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:38.166834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b8841a9a-9a4f-4ae5-8300-aecb41bf59f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:38.167694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b8841a9a-9a4f-4ae5-8300-aecb41bf59f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:38.192315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8841a9a-9a4f-4ae5-8300-aecb41bf59f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:38.193138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8841a9a-9a4f-4ae5-8300-aecb41bf59f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:38.195410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8841a9a-9a4f-4ae5-8300-aecb41bf59f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:38.196643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8841a9a-9a4f-4ae5-8300-aecb41bf59f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:38.293536 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-824c181a-01f7-42a7-ac99-848bdc1f028e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "DELETE /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e" status: 204 len: 0 microversion: 2.1 time: 0.219704 Mar 05 20:56:38.297313 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1192/2330] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:38 2022] DELETE /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:38.301983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d6357d23-ab44-4140-a657-ad09d8fc6604 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:38.303430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d6357d23-ab44-4140-a657-ad09d8fc6604 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:38.314173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6357d23-ab44-4140-a657-ad09d8fc6604 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:38.314173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6357d23-ab44-4140-a657-ad09d8fc6604 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:38.314173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6357d23-ab44-4140-a657-ad09d8fc6604 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:38.315019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6357d23-ab44-4140-a657-ad09d8fc6604 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:38.477353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b8841a9a-9a4f-4ae5-8300-aecb41bf59f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:38.488878 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b8841a9a-9a4f-4ae5-8300-aecb41bf59f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1314 microversion: 2.1 time: 0.326438 Mar 05 20:56:38.489710 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1139/2331] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:38 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:38.501954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d99d7a08-90c1-4006-bdb8-c10d5c5fce73 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:38.502606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d99d7a08-90c1-4006-bdb8-c10d5c5fce73 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:38.508864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d99d7a08-90c1-4006-bdb8-c10d5c5fce73 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:38.509315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d99d7a08-90c1-4006-bdb8-c10d5c5fce73 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:38.510093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d99d7a08-90c1-4006-bdb8-c10d5c5fce73 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:38.510532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d99d7a08-90c1-4006-bdb8-c10d5c5fce73 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:38.607026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d6357d23-ab44-4140-a657-ad09d8fc6604 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:38.614616 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d6357d23-ab44-4140-a657-ad09d8fc6604 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1314 microversion: 2.1 time: 0.318651 Mar 05 20:56:38.615615 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1193/2332] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:38 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:38.620725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6425d8f6-de8f-405c-be13-9ca2cac60f32 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:38.621840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6425d8f6-de8f-405c-be13-9ca2cac60f32 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 876a2098-5755-45a2-879f-9665c69d764e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:38.628853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6425d8f6-de8f-405c-be13-9ca2cac60f32 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:38.629915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6425d8f6-de8f-405c-be13-9ca2cac60f32 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:38.631015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6425d8f6-de8f-405c-be13-9ca2cac60f32 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:38.631710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6425d8f6-de8f-405c-be13-9ca2cac60f32 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:38.698073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d99d7a08-90c1-4006-bdb8-c10d5c5fce73 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd929c57fe3445face2514365fe503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9adff4bad8486fae6271261a8137d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:38.714840 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d99d7a08-90c1-4006-bdb8-c10d5c5fce73 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 200 len: 1315 microversion: 2.1 time: 0.223571 Mar 05 20:56:38.715635 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1140/2333] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:38 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:38.721584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-926124407", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "a0fc1ef5-7d58-4956-8ec7-37c47d9df56c"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:38.803949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] validate_networks() for [('a0fc1ef5-7d58-4956-8ec7-37c47d9df56c', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:56:38.893424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6425d8f6-de8f-405c-be13-9ca2cac60f32 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:38.902068 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6425d8f6-de8f-405c-be13-9ca2cac60f32 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e" status: 200 len: 1522 microversion: 2.1 time: 0.284785 Mar 05 20:56:38.903175 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1194/2334] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:38 2022] GET /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:38.918379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-d5a2f6fe-8236-4d20-ba81-36def74987e7 req-d89cc77c-0fc7-4203-ad01-1e4127d8d3be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a6900c-db11-4225-b22d-a9ce4efe4ce0", "tag": "45b7f0b0-889d-474f-9ac1-a67a655d982b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:38.930172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d5a2f6fe-8236-4d20-ba81-36def74987e7 req-d89cc77c-0fc7-4203-ad01-1e4127d8d3be service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:38.930638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d5a2f6fe-8236-4d20-ba81-36def74987e7 req-d89cc77c-0fc7-4203-ad01-1e4127d8d3be service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:38.942789 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-d5a2f6fe-8236-4d20-ba81-36def74987e7 req-d89cc77c-0fc7-4203-ad01-1e4127d8d3be service nova] Creating event network-changed:45b7f0b0-889d-474f-9ac1-a67a655d982b for instance b8a6900c-db11-4225-b22d-a9ce4efe4ce0 on nch1-master-1 Mar 05 20:56:38.950683 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-d5a2f6fe-8236-4d20-ba81-36def74987e7 req-d89cc77c-0fc7-4203-ad01-1e4127d8d3be service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033849 Mar 05 20:56:38.950683 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1195/2335] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:39.055489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7e8e78d9-3b51-4807-9ccf-92aa9a4e16da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:39.056236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7e8e78d9-3b51-4807-9ccf-92aa9a4e16da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:39.065352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e8e78d9-3b51-4807-9ccf-92aa9a4e16da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:39.065804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e8e78d9-3b51-4807-9ccf-92aa9a4e16da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:39.066588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e8e78d9-3b51-4807-9ccf-92aa9a4e16da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:39.067024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e8e78d9-3b51-4807-9ccf-92aa9a4e16da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:39.290841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:56:39.291365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:56:39.291755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:56:39.292173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:56:39.292593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:56:39.301294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:39.301743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:39.302732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:39.304061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:39.323551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Getting quotas for project 933b162d4a3044f38bed8c339cc621ed. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:39.329623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Getting quotas for user 9680dd9b3f2b47c9810ae22052714bea and project 933b162d4a3044f38bed8c339cc621ed. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:39.342229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7e8e78d9-3b51-4807-9ccf-92aa9a4e16da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:39.348843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:56:39.349583 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7e8e78d9-3b51-4807-9ccf-92aa9a4e16da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1310 microversion: 2.1 time: 0.298988 Mar 05 20:56:39.351654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:56:39.359365 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1196/2336] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:39 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1310 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:39.407894 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45a61514-201b-4033-bfb5-61171f14c044 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689795 Mar 05 20:56:39.411697 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1141/2337] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:56:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:56:39.420629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c99ec8ea-b9fe-4f60-9e08-1cbfa19c1ee0 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:39.421536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c99ec8ea-b9fe-4f60-9e08-1cbfa19c1ee0 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:39.508174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4edc8cc5-34ef-4569-b241-055927b6b415 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:39.510803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4edc8cc5-34ef-4569-b241-055927b6b415 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:39.523046 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4edc8cc5-34ef-4569-b241-055927b6b415 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:39.523782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4edc8cc5-34ef-4569-b241-055927b6b415 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:39.525140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4edc8cc5-34ef-4569-b241-055927b6b415 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:39.525751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4edc8cc5-34ef-4569-b241-055927b6b415 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:39.599000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c99ec8ea-b9fe-4f60-9e08-1cbfa19c1ee0 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:39.606952 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c99ec8ea-b9fe-4f60-9e08-1cbfa19c1ee0 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579" status: 200 len: 1223 microversion: 2.1 time: 0.190643 Mar 05 20:56:39.611590 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1197/2338] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:39 2022] GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579 => generated 1223 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:39.641058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2dbbe839-1d1a-4ac7-b75f-f6cf8d295d5a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:39.642673 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2dbbe839-1d1a-4ac7-b75f-f6cf8d295d5a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:39.658643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dbbe839-1d1a-4ac7-b75f-f6cf8d295d5a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:39.661133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dbbe839-1d1a-4ac7-b75f-f6cf8d295d5a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:39.664153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dbbe839-1d1a-4ac7-b75f-f6cf8d295d5a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:39.665299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dbbe839-1d1a-4ac7-b75f-f6cf8d295d5a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:39.728495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4edc8cc5-34ef-4569-b241-055927b6b415 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:39.744486 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4edc8cc5-34ef-4569-b241-055927b6b415 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1314 microversion: 2.1 time: 0.241925 Mar 05 20:56:39.745190 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1142/2339] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:39 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:39.750246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0a5237b1-0ff9-42e5-8944-d0dce34688c1 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:39.751146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0a5237b1-0ff9-42e5-8944-d0dce34688c1 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:39.758852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a5237b1-0ff9-42e5-8944-d0dce34688c1 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:39.759614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a5237b1-0ff9-42e5-8944-d0dce34688c1 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:39.760639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a5237b1-0ff9-42e5-8944-d0dce34688c1 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:39.761288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a5237b1-0ff9-42e5-8944-d0dce34688c1 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:39.939704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2dbbe839-1d1a-4ac7-b75f-f6cf8d295d5a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:39.949614 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2dbbe839-1d1a-4ac7-b75f-f6cf8d295d5a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1314 microversion: 2.1 time: 0.320228 Mar 05 20:56:39.962275 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1198/2340] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:39 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:39.968703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aa312b49-35bc-46f7-9b26-6526fcb82325 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:39.969531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-aa312b49-35bc-46f7-9b26-6526fcb82325 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 876a2098-5755-45a2-879f-9665c69d764e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:39.978294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa312b49-35bc-46f7-9b26-6526fcb82325 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:39.978976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa312b49-35bc-46f7-9b26-6526fcb82325 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:39.980024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa312b49-35bc-46f7-9b26-6526fcb82325 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:39.980666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa312b49-35bc-46f7-9b26-6526fcb82325 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.084761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0a5237b1-0ff9-42e5-8944-d0dce34688c1 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd929c57fe3445face2514365fe503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9adff4bad8486fae6271261a8137d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:40.104162 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0a5237b1-0ff9-42e5-8944-d0dce34688c1 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 200 len: 1465 microversion: 2.1 time: 0.357413 Mar 05 20:56:40.106755 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1143/2341] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:39 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 1465 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:40.112095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f3758885-b55b-46d3-a98a-a237f22f3eb0 req-59dff1b5-92c1-4bbf-a22f-00eee333ac3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5525dc-a44a-4aa9-af58-a6f93058155e", "name": "network-vif-plugged", "status": "completed", "tag": "207ec9a3-97bb-4f65-9dd6-1a65d33c9cf5"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:40.124581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f3758885-b55b-46d3-a98a-a237f22f3eb0 req-59dff1b5-92c1-4bbf-a22f-00eee333ac3f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.125187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f3758885-b55b-46d3-a98a-a237f22f3eb0 req-59dff1b5-92c1-4bbf-a22f-00eee333ac3f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.143027 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f3758885-b55b-46d3-a98a-a237f22f3eb0 req-59dff1b5-92c1-4bbf-a22f-00eee333ac3f service nova] Creating event network-vif-plugged:207ec9a3-97bb-4f65-9dd6-1a65d33c9cf5 for instance ac5525dc-a44a-4aa9-af58-a6f93058155e on nch2-master-1 Mar 05 20:56:40.149689 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f3758885-b55b-46d3-a98a-a237f22f3eb0 req-59dff1b5-92c1-4bbf-a22f-00eee333ac3f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040535 Mar 05 20:56:40.151831 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1144/2342] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:40.161925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a5f966bf-1770-4484-b5a3-477e75eefbd7 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:40.164275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a5f966bf-1770-4484-b5a3-477e75eefbd7 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:40.172088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5f966bf-1770-4484-b5a3-477e75eefbd7 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.172546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5f966bf-1770-4484-b5a3-477e75eefbd7 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.173488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5f966bf-1770-4484-b5a3-477e75eefbd7 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.173943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5f966bf-1770-4484-b5a3-477e75eefbd7 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.214726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a5f966bf-1770-4484-b5a3-477e75eefbd7 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:56:40.322654 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a5f966bf-1770-4484-b5a3-477e75eefbd7 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 204 len: 0 microversion: 2.1 time: 0.167919 Mar 05 20:56:40.324300 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1145/2343] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:40 2022] DELETE /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:40.333870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-369d288a-6862-459d-83d9-37102da98b89 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:40.334921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-369d288a-6862-459d-83d9-37102da98b89 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:40.341650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-369d288a-6862-459d-83d9-37102da98b89 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.342205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-369d288a-6862-459d-83d9-37102da98b89 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.343116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-369d288a-6862-459d-83d9-37102da98b89 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.343633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-369d288a-6862-459d-83d9-37102da98b89 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.403113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-aa312b49-35bc-46f7-9b26-6526fcb82325 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:40.411421 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aa312b49-35bc-46f7-9b26-6526fcb82325 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e" status: 200 len: 1522 microversion: 2.1 time: 0.446581 Mar 05 20:56:40.413164 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1199/2344] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:39 2022] GET /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:40.418685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-20b89666-575b-4700-932f-2cb54883514f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:40.420260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-20b89666-575b-4700-932f-2cb54883514f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:40.429785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20b89666-575b-4700-932f-2cb54883514f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.430490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20b89666-575b-4700-932f-2cb54883514f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.431495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20b89666-575b-4700-932f-2cb54883514f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.432161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20b89666-575b-4700-932f-2cb54883514f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.636130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-20b89666-575b-4700-932f-2cb54883514f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:40.645643 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-20b89666-575b-4700-932f-2cb54883514f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1310 microversion: 2.1 time: 0.230717 Mar 05 20:56:40.648182 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1200/2345] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:40 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1310 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:40.653743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6f815846-7665-4382-9432-f75cf54235f8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:40.654424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6f815846-7665-4382-9432-f75cf54235f8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:40.661999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f815846-7665-4382-9432-f75cf54235f8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.663960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f815846-7665-4382-9432-f75cf54235f8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.665215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f815846-7665-4382-9432-f75cf54235f8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.665975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f815846-7665-4382-9432-f75cf54235f8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.670775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-369d288a-6862-459d-83d9-37102da98b89 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd929c57fe3445face2514365fe503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9adff4bad8486fae6271261a8137d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:40.679249 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-369d288a-6862-459d-83d9-37102da98b89 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 200 len: 1471 microversion: 2.1 time: 0.350261 Mar 05 20:56:40.680163 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1146/2346] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:40 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 1471 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:40.684652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-53154112-78a1-41ae-94ee-571517c2c525 req-3f4f770c-bd81-4931-b9d2-d9bbd94c60b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876a2098-5755-45a2-879f-9665c69d764e", "name": "network-vif-deleted", "tag": "3a39d010-7efb-4d30-aa59-44e63c57a224"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:40.693050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-53154112-78a1-41ae-94ee-571517c2c525 req-3f4f770c-bd81-4931-b9d2-d9bbd94c60b6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.693620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-53154112-78a1-41ae-94ee-571517c2c525 req-3f4f770c-bd81-4931-b9d2-d9bbd94c60b6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.710489 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-53154112-78a1-41ae-94ee-571517c2c525 req-3f4f770c-bd81-4931-b9d2-d9bbd94c60b6 service nova] Creating event network-vif-deleted:3a39d010-7efb-4d30-aa59-44e63c57a224 for instance 876a2098-5755-45a2-879f-9665c69d764e on nch2-master-1 Mar 05 20:56:40.716498 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-53154112-78a1-41ae-94ee-571517c2c525 req-3f4f770c-bd81-4931-b9d2-d9bbd94c60b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035120 Mar 05 20:56:40.721828 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1147/2347] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:40.753710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6f815846-7665-4382-9432-f75cf54235f8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:40.767626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e8ddd77b-74fe-491a-ab41-280051999988 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:40.769496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e8ddd77b-74fe-491a-ab41-280051999988 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:40.779648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8ddd77b-74fe-491a-ab41-280051999988 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.780673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8ddd77b-74fe-491a-ab41-280051999988 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.782021 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6f815846-7665-4382-9432-f75cf54235f8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579" status: 200 len: 1275 microversion: 2.1 time: 0.130780 Mar 05 20:56:40.782227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8ddd77b-74fe-491a-ab41-280051999988 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.783832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8ddd77b-74fe-491a-ab41-280051999988 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.795895 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1201/2348] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:40 2022] GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579 => generated 1275 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:40.971502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-76b38327-e872-4908-8e77-6bd43369ef87 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:40.973186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-76b38327-e872-4908-8e77-6bd43369ef87 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:40.985577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-76b38327-e872-4908-8e77-6bd43369ef87 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.986126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-76b38327-e872-4908-8e77-6bd43369ef87 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:40.987386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-76b38327-e872-4908-8e77-6bd43369ef87 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:40.988138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-76b38327-e872-4908-8e77-6bd43369ef87 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:41.162326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e8ddd77b-74fe-491a-ab41-280051999988 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:41.171082 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e8ddd77b-74fe-491a-ab41-280051999988 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1314 microversion: 2.1 time: 0.411027 Mar 05 20:56:41.183614 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1148/2349] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:40 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:41.206629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-76b38327-e872-4908-8e77-6bd43369ef87 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:41.223610 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-76b38327-e872-4908-8e77-6bd43369ef87 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1314 microversion: 2.1 time: 0.260379 Mar 05 20:56:41.239117 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1202/2350] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:40 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:41.430006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fbaa5d52-8c1b-4fa5-9f57-cf16ae83485c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:41.431351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fbaa5d52-8c1b-4fa5-9f57-cf16ae83485c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 876a2098-5755-45a2-879f-9665c69d764e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:41.438584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbaa5d52-8c1b-4fa5-9f57-cf16ae83485c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:41.439051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbaa5d52-8c1b-4fa5-9f57-cf16ae83485c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:41.439888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbaa5d52-8c1b-4fa5-9f57-cf16ae83485c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:41.440527 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbaa5d52-8c1b-4fa5-9f57-cf16ae83485c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:41.456534 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-fbaa5d52-8c1b-4fa5-9f57-cf16ae83485c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] HTTP exception thrown: Instance 876a2098-5755-45a2-879f-9665c69d764e could not be found. Mar 05 20:56:41.457570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fbaa5d52-8c1b-4fa5-9f57-cf16ae83485c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Returning 404 to user: Instance 876a2098-5755-45a2-879f-9665c69d764e could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:41.458453 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fbaa5d52-8c1b-4fa5-9f57-cf16ae83485c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e" status: 404 len: 111 microversion: 2.1 time: 0.033666 Mar 05 20:56:41.459656 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1149/2351] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:41 2022] GET /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:41.468821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-12432541-121b-4e1b-9a4d-5a6b650ce61e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:41.473643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-12432541-121b-4e1b-9a4d-5a6b650ce61e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:41.475457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-12432541-121b-4e1b-9a4d-5a6b650ce61e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'bd82543db15443c69b77efe94c71e251'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:56:41.481186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-12432541-121b-4e1b-9a4d-5a6b650ce61e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:41.481755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-12432541-121b-4e1b-9a4d-5a6b650ce61e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:41.482844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-12432541-121b-4e1b-9a4d-5a6b650ce61e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:41.483358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-12432541-121b-4e1b-9a4d-5a6b650ce61e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:41.572186 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-12432541-121b-4e1b-9a4d-5a6b650ce61e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.107608 Mar 05 20:56:41.573063 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1203/2352] 10.222.0.15 () {58 vars in 1229 bytes} [Sat Mar 5 20:56:41 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:56:41.583720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b1fc7e3-64d4-4519-8b3d-102ada367312 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:41.585823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b1fc7e3-64d4-4519-8b3d-102ada367312 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:41.586673 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4b1fc7e3-64d4-4519-8b3d-102ada367312 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.006815 Mar 05 20:56:41.587191 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1150/2353] 10.222.0.15 () {58 vars in 1181 bytes} [Sat Mar 5 20:56:41 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:56:41.596180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-35da5ad0-e01b-421a-9d48-478c48f73be1 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:41.599473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-35da5ad0-e01b-421a-9d48-478c48f73be1 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:41.600203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-35da5ad0-e01b-421a-9d48-478c48f73be1 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Searching by: {'deleted': False, 'project_id': 'bd82543db15443c69b77efe94c71e251'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:56:41.605511 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35da5ad0-e01b-421a-9d48-478c48f73be1 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:41.605966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35da5ad0-e01b-421a-9d48-478c48f73be1 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:41.606766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35da5ad0-e01b-421a-9d48-478c48f73be1 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:41.607201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35da5ad0-e01b-421a-9d48-478c48f73be1 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:41.649954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-35da5ad0-e01b-421a-9d48-478c48f73be1 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:56:41.668215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-11a68096-de38-4db4-9112-fe445193050e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:41.668848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-11a68096-de38-4db4-9112-fe445193050e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:41.680375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11a68096-de38-4db4-9112-fe445193050e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:41.681594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11a68096-de38-4db4-9112-fe445193050e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:41.683098 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-35da5ad0-e01b-421a-9d48-478c48f73be1 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.090675 Mar 05 20:56:41.684070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11a68096-de38-4db4-9112-fe445193050e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:41.684761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11a68096-de38-4db4-9112-fe445193050e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:41.689503 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1204/2354] 10.222.0.15 () {58 vars in 1124 bytes} [Sat Mar 5 20:56:41 2022] GET /compute/v2.1/servers => generated 683 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:41.697448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3fa46979-4a23-4ddb-95fb-3c318fda6e25 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:41.720198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3fa46979-4a23-4ddb-95fb-3c318fda6e25 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:41.722211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.compute.servers [None req-3fa46979-4a23-4ddb-95fb-3c318fda6e25 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Removing options 'limit' from query {{(pid=141479) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 05 20:56:41.724025 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3fa46979-4a23-4ddb-95fb-3c318fda6e25 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Searching by: {'deleted': False, 'project_id': 'bd82543db15443c69b77efe94c71e251'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:56:41.737341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fa46979-4a23-4ddb-95fb-3c318fda6e25 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:41.738087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fa46979-4a23-4ddb-95fb-3c318fda6e25 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:41.739225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fa46979-4a23-4ddb-95fb-3c318fda6e25 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:41.740000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fa46979-4a23-4ddb-95fb-3c318fda6e25 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:41.801723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-3fa46979-4a23-4ddb-95fb-3c318fda6e25 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:56:41.848289 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3fa46979-4a23-4ddb-95fb-3c318fda6e25 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.157210 Mar 05 20:56:41.856700 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1205/2355] 10.222.0.15 () {58 vars in 1143 bytes} [Sat Mar 5 20:56:41 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:41.863070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b1e32cc3-8725-4cb2-aa5a-39bca4ef6740 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:41.864262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b1e32cc3-8725-4cb2-aa5a-39bca4ef6740 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:41.873791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1e32cc3-8725-4cb2-aa5a-39bca4ef6740 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:41.874695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1e32cc3-8725-4cb2-aa5a-39bca4ef6740 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:41.875757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1e32cc3-8725-4cb2-aa5a-39bca4ef6740 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:41.876720 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1e32cc3-8725-4cb2-aa5a-39bca4ef6740 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:42.048424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-11a68096-de38-4db4-9112-fe445193050e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:42.058519 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-11a68096-de38-4db4-9112-fe445193050e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1310 microversion: 2.1 time: 0.396030 Mar 05 20:56:42.059133 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1151/2356] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:41 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1310 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:42.073729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5738422c-57f4-4b30-aaf3-30ddf6a09561 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:42.074375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5738422c-57f4-4b30-aaf3-30ddf6a09561 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:42.083205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5738422c-57f4-4b30-aaf3-30ddf6a09561 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:42.084450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5738422c-57f4-4b30-aaf3-30ddf6a09561 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:42.085278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5738422c-57f4-4b30-aaf3-30ddf6a09561 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:42.086802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5738422c-57f4-4b30-aaf3-30ddf6a09561 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:42.332459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b1e32cc3-8725-4cb2-aa5a-39bca4ef6740 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd929c57fe3445face2514365fe503c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9adff4bad8486fae6271261a8137d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:42.341263 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b1e32cc3-8725-4cb2-aa5a-39bca4ef6740 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 200 len: 1471 microversion: 2.1 time: 0.482595 Mar 05 20:56:42.351779 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1206/2357] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:41 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 1471 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:42.357711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cc351c07-c0ba-45ef-886e-c944952f27f3 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:42.359222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cc351c07-c0ba-45ef-886e-c944952f27f3 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:42.360108 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cc351c07-c0ba-45ef-886e-c944952f27f3 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.017098 Mar 05 20:56:42.360834 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1207/2358] 10.222.0.15 () {58 vars in 1141 bytes} [Sat Mar 5 20:56:42 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:56:42.370657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b31a9100-40b4-4cf3-8067-bce7281420f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:42.371288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b31a9100-40b4-4cf3-8067-bce7281420f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:42.376011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5738422c-57f4-4b30-aaf3-30ddf6a09561 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:42.378635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b31a9100-40b4-4cf3-8067-bce7281420f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:42.379420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b31a9100-40b4-4cf3-8067-bce7281420f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:42.380051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b31a9100-40b4-4cf3-8067-bce7281420f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:42.380506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b31a9100-40b4-4cf3-8067-bce7281420f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:42.387643 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5738422c-57f4-4b30-aaf3-30ddf6a09561 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579" status: 200 len: 1323 microversion: 2.1 time: 0.322830 Mar 05 20:56:42.395730 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1152/2359] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:42 2022] GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579 => generated 1323 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:42.397771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1e247127-8760-419b-bd28-606c706e1f38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:42.398575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1e247127-8760-419b-bd28-606c706e1f38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:42.415083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e247127-8760-419b-bd28-606c706e1f38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:42.415870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e247127-8760-419b-bd28-606c706e1f38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:42.419150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e247127-8760-419b-bd28-606c706e1f38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:42.424275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e247127-8760-419b-bd28-606c706e1f38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:42.674333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1e247127-8760-419b-bd28-606c706e1f38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:42.690790 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1e247127-8760-419b-bd28-606c706e1f38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1314 microversion: 2.1 time: 0.301419 Mar 05 20:56:42.691383 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1153/2360] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:42 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:42.696733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-edb3d88b-8465-4f22-9068-530de3ebd9bb tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:42.698521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-edb3d88b-8465-4f22-9068-530de3ebd9bb tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:42.699530 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-edb3d88b-8465-4f22-9068-530de3ebd9bb tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.007201 Mar 05 20:56:42.704501 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1154/2361] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:56:42 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:56:42.710929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b81f43a-8671-4937-9105-4080e2d43283 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:42.714849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4b81f43a-8671-4937-9105-4080e2d43283 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:42.715910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4b81f43a-8671-4937-9105-4080e2d43283 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'bd82543db15443c69b77efe94c71e251'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:56:42.723756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.compute.servers [None req-4b81f43a-8671-4937-9105-4080e2d43283 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Flavor 'non_existing_flavor' could not be found {{(pid=141478) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Mar 05 20:56:42.726233 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4b81f43a-8671-4937-9105-4080e2d43283 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.019921 Mar 05 20:56:42.733222 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1155/2362] 10.222.0.15 () {58 vars in 1177 bytes} [Sat Mar 5 20:56:42 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:56:42.738357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-84e50556-7e46-4f1b-80b6-2f09284684f7 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:42.743908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-84e50556-7e46-4f1b-80b6-2f09284684f7 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:42.744601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-84e50556-7e46-4f1b-80b6-2f09284684f7 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'bd82543db15443c69b77efe94c71e251'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:56:42.757868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84e50556-7e46-4f1b-80b6-2f09284684f7 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:42.758328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84e50556-7e46-4f1b-80b6-2f09284684f7 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:42.759160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84e50556-7e46-4f1b-80b6-2f09284684f7 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:42.759592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84e50556-7e46-4f1b-80b6-2f09284684f7 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:42.801493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b31a9100-40b4-4cf3-8067-bce7281420f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:42.822315 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b31a9100-40b4-4cf3-8067-bce7281420f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1501 microversion: 2.1 time: 0.453755 Mar 05 20:56:42.824070 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1208/2363] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:42 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1501 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:42.865715 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-84e50556-7e46-4f1b-80b6-2f09284684f7 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.131043 Mar 05 20:56:42.869158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-18527a30-7fd8-4d1c-bf89-d41599e70030 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:42.870449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-18527a30-7fd8-4d1c-bf89-d41599e70030 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:42.872534 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1156/2364] 10.222.0.15 () {58 vars in 1173 bytes} [Sat Mar 5 20:56:42 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:56:42.878700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-04f84b52-b481-44d9-97fd-b07f3efe2c02 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:42.880434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18527a30-7fd8-4d1c-bf89-d41599e70030 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:42.881117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18527a30-7fd8-4d1c-bf89-d41599e70030 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:42.882743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18527a30-7fd8-4d1c-bf89-d41599e70030 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:42.883592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-04f84b52-b481-44d9-97fd-b07f3efe2c02 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:42.884933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-04f84b52-b481-44d9-97fd-b07f3efe2c02 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'bd82543db15443c69b77efe94c71e251'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:56:42.885847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18527a30-7fd8-4d1c-bf89-d41599e70030 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:42.893249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04f84b52-b481-44d9-97fd-b07f3efe2c02 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:42.893904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04f84b52-b481-44d9-97fd-b07f3efe2c02 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:42.895230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04f84b52-b481-44d9-97fd-b07f3efe2c02 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:42.896107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04f84b52-b481-44d9-97fd-b07f3efe2c02 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:42.930847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-18527a30-7fd8-4d1c-bf89-d41599e70030 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lazy-loading 'flavor' on Instance uuid ac5525dc-a44a-4aa9-af58-a6f93058155e {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:56:43.013319 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-04f84b52-b481-44d9-97fd-b07f3efe2c02 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.139415 Mar 05 20:56:43.014233 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1157/2365] 10.222.0.15 () {58 vars in 1183 bytes} [Sat Mar 5 20:56:42 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:56:43.027157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c83b0e65-250f-45e1-b1f1-6d010b3e9f86 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:43.032409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c83b0e65-250f-45e1-b1f1-6d010b3e9f86 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:43.033959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c83b0e65-250f-45e1-b1f1-6d010b3e9f86 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Searching by: {'deleted': False, 'project_id': 'bd82543db15443c69b77efe94c71e251'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:56:43.043977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c83b0e65-250f-45e1-b1f1-6d010b3e9f86 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:43.044675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c83b0e65-250f-45e1-b1f1-6d010b3e9f86 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:43.058743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c83b0e65-250f-45e1-b1f1-6d010b3e9f86 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:43.059440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c83b0e65-250f-45e1-b1f1-6d010b3e9f86 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:43.070306 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-18527a30-7fd8-4d1c-bf89-d41599e70030 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "POST /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e/action" status: 200 len: 32 microversion: 2.1 time: 0.209632 Mar 05 20:56:43.071063 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1209/2366] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:56:42 2022] POST /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:56:43.087725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b90382c2-ff8e-4be0-9e73-575f367517f0 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:43.088505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b90382c2-ff8e-4be0-9e73-575f367517f0 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:43.096570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-c83b0e65-250f-45e1-b1f1-6d010b3e9f86 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:56:43.102971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b90382c2-ff8e-4be0-9e73-575f367517f0 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:43.105079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b90382c2-ff8e-4be0-9e73-575f367517f0 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:43.106045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b90382c2-ff8e-4be0-9e73-575f367517f0 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:43.106504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b90382c2-ff8e-4be0-9e73-575f367517f0 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:43.149206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c83b0e65-250f-45e1-b1f1-6d010b3e9f86 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:43.168455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c83b0e65-250f-45e1-b1f1-6d010b3e9f86 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:43.171588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c83b0e65-250f-45e1-b1f1-6d010b3e9f86 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:43.419877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b90382c2-ff8e-4be0-9e73-575f367517f0 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:43.429234 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b90382c2-ff8e-4be0-9e73-575f367517f0 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1310 microversion: 2.1 time: 0.353206 Mar 05 20:56:43.440141 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1210/2367] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:43 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1310 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:43.445240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b9e98033-6636-4b67-899f-fd1d1c067595 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:43.445865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b9e98033-6636-4b67-899f-fd1d1c067595 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:43.452475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9e98033-6636-4b67-899f-fd1d1c067595 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:43.452936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9e98033-6636-4b67-899f-fd1d1c067595 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:43.453721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9e98033-6636-4b67-899f-fd1d1c067595 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:43.454161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9e98033-6636-4b67-899f-fd1d1c067595 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.000752 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c83b0e65-250f-45e1-b1f1-6d010b3e9f86 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.977473 Mar 05 20:56:44.001351 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1158/2368] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 20:56:43 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:44.006816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-89e52c85-612b-4198-b8b4-3d12fe224d0b req-88b3445e-6ffe-49e7-877c-502f4f27f870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7219cb01-3958-42f5-9196-0ab130421997", "name": "network-vif-deleted", "tag": "f42b72f9-4e53-4581-998e-872c13953811"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:44.027613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-89e52c85-612b-4198-b8b4-3d12fe224d0b req-88b3445e-6ffe-49e7-877c-502f4f27f870 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.030558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-89e52c85-612b-4198-b8b4-3d12fe224d0b req-88b3445e-6ffe-49e7-877c-502f4f27f870 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.046882 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-89e52c85-612b-4198-b8b4-3d12fe224d0b req-88b3445e-6ffe-49e7-877c-502f4f27f870 service nova] Creating event network-vif-deleted:f42b72f9-4e53-4581-998e-872c13953811 for instance 7219cb01-3958-42f5-9196-0ab130421997 on nch1-master-1 Mar 05 20:56:44.052261 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-89e52c85-612b-4198-b8b4-3d12fe224d0b req-88b3445e-6ffe-49e7-877c-502f4f27f870 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049523 Mar 05 20:56:44.054585 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1159/2369] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:44.060564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9dfd256e-428a-4a35-a1d5-a83227b5e957 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:44.061642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9dfd256e-428a-4a35-a1d5-a83227b5e957 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:44.076634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9dfd256e-428a-4a35-a1d5-a83227b5e957 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.077524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9dfd256e-428a-4a35-a1d5-a83227b5e957 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.078553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9dfd256e-428a-4a35-a1d5-a83227b5e957 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.079246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9dfd256e-428a-4a35-a1d5-a83227b5e957 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.095805 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-9dfd256e-428a-4a35-a1d5-a83227b5e957 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] HTTP exception thrown: Instance 7219cb01-3958-42f5-9196-0ab130421997 could not be found. Mar 05 20:56:44.097105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9dfd256e-428a-4a35-a1d5-a83227b5e957 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Returning 404 to user: Instance 7219cb01-3958-42f5-9196-0ab130421997 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:44.098302 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9dfd256e-428a-4a35-a1d5-a83227b5e957 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 404 len: 111 microversion: 2.1 time: 0.042119 Mar 05 20:56:44.100214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b9e98033-6636-4b67-899f-fd1d1c067595 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:44.103867 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1160/2370] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:44 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:44.109983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e3fe141a-7e97-428b-a860-e03bf5e1cd2b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:44.110780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e3fe141a-7e97-428b-a860-e03bf5e1cd2b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:44.113100 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b9e98033-6636-4b67-899f-fd1d1c067595 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.671751 Mar 05 20:56:44.113898 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1211/2371] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:43 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:44.124488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3fe141a-7e97-428b-a860-e03bf5e1cd2b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.124488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3fe141a-7e97-428b-a860-e03bf5e1cd2b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.124488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3fe141a-7e97-428b-a860-e03bf5e1cd2b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.124488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3fe141a-7e97-428b-a860-e03bf5e1cd2b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.132890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0acd6f46-323d-40d9-8ec4-15bd1cc8512a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:44.133968 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0acd6f46-323d-40d9-8ec4-15bd1cc8512a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:44.142046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0acd6f46-323d-40d9-8ec4-15bd1cc8512a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.143146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0acd6f46-323d-40d9-8ec4-15bd1cc8512a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.144623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0acd6f46-323d-40d9-8ec4-15bd1cc8512a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.145240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0acd6f46-323d-40d9-8ec4-15bd1cc8512a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.360545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0acd6f46-323d-40d9-8ec4-15bd1cc8512a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:44.371961 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0acd6f46-323d-40d9-8ec4-15bd1cc8512a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1314 microversion: 2.1 time: 0.245109 Mar 05 20:56:44.372568 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1212/2372] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:44 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:44.389396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-67314c2b-616d-4e01-9e03-867affe9d4f4 req-839d59a1-3d40-48da-b1f6-054e6b7050a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1567b85e-c179-4c65-9ec1-47b86cdba579", "tag": "7d12cb43-6b68-44ec-be62-881ac11e38d1"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:44.398767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-67314c2b-616d-4e01-9e03-867affe9d4f4 req-839d59a1-3d40-48da-b1f6-054e6b7050a5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.399220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-67314c2b-616d-4e01-9e03-867affe9d4f4 req-839d59a1-3d40-48da-b1f6-054e6b7050a5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.411120 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-67314c2b-616d-4e01-9e03-867affe9d4f4 req-839d59a1-3d40-48da-b1f6-054e6b7050a5 service nova] Creating event network-changed:7d12cb43-6b68-44ec-be62-881ac11e38d1 for instance 1567b85e-c179-4c65-9ec1-47b86cdba579 on nch2-master-1 Mar 05 20:56:44.416528 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-67314c2b-616d-4e01-9e03-867affe9d4f4 req-839d59a1-3d40-48da-b1f6-054e6b7050a5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042865 Mar 05 20:56:44.417124 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1213/2373] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:44.421953 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9bfefb17-c437-417f-b47a-5c470440839c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:44.425312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9bfefb17-c437-417f-b47a-5c470440839c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:44.426229 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9bfefb17-c437-417f-b47a-5c470440839c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.008065 Mar 05 20:56:44.426742 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1214/2374] 10.222.0.15 () {58 vars in 1177 bytes} [Sat Mar 5 20:56:44 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:56:44.432247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cb561982-d626-4fc6-99fc-0ce02efd7b58 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1082948884", "metadata": {"image_type": "test"}}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:44.433305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cb561982-d626-4fc6-99fc-0ce02efd7b58 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:44.439188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb561982-d626-4fc6-99fc-0ce02efd7b58 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.440934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb561982-d626-4fc6-99fc-0ce02efd7b58 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.440934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb561982-d626-4fc6-99fc-0ce02efd7b58 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.442210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb561982-d626-4fc6-99fc-0ce02efd7b58 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.456534 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-cb561982-d626-4fc6-99fc-0ce02efd7b58 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] HTTP exception thrown: Instance 7219cb01-3958-42f5-9196-0ab130421997 could not be found. Mar 05 20:56:44.457244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cb561982-d626-4fc6-99fc-0ce02efd7b58 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Returning 404 to user: Instance 7219cb01-3958-42f5-9196-0ab130421997 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:44.458176 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cb561982-d626-4fc6-99fc-0ce02efd7b58 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "POST /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997/action" status: 404 len: 111 microversion: 2.1 time: 0.030520 Mar 05 20:56:44.458878 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1215/2375] 10.222.0.15 () {60 vars in 1278 bytes} [Sat Mar 5 20:56:44 2022] POST /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:44.466182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-47688029-9e1f-4d54-8fd7-89472aa51f83 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:44.469529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-47688029-9e1f-4d54-8fd7-89472aa51f83 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:44.470332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-47688029-9e1f-4d54-8fd7-89472aa51f83 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Searching by: {'deleted': False, 'project_id': 'bd82543db15443c69b77efe94c71e251'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 20:56:44.477198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47688029-9e1f-4d54-8fd7-89472aa51f83 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.477703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47688029-9e1f-4d54-8fd7-89472aa51f83 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.478517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47688029-9e1f-4d54-8fd7-89472aa51f83 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.478968 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47688029-9e1f-4d54-8fd7-89472aa51f83 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.505259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-47688029-9e1f-4d54-8fd7-89472aa51f83 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 20:56:44.541540 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-47688029-9e1f-4d54-8fd7-89472aa51f83 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.079380 Mar 05 20:56:44.542246 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1216/2376] 10.222.0.15 () {58 vars in 1124 bytes} [Sat Mar 5 20:56:44 2022] GET /compute/v2.1/servers => generated 683 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:44.549512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-224698d2-7d3e-401f-806e-5ebb83772580 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:44.550339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-224698d2-7d3e-401f-806e-5ebb83772580 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:44.556822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-224698d2-7d3e-401f-806e-5ebb83772580 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.557461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-224698d2-7d3e-401f-806e-5ebb83772580 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.558287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-224698d2-7d3e-401f-806e-5ebb83772580 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.558725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-224698d2-7d3e-401f-806e-5ebb83772580 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.580985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e3fe141a-7e97-428b-a860-e03bf5e1cd2b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:44.594317 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e3fe141a-7e97-428b-a860-e03bf5e1cd2b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579" status: 200 len: 1323 microversion: 2.1 time: 0.489229 Mar 05 20:56:44.595025 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1161/2377] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:44 2022] GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579 => generated 1323 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:44.601947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c31b2685-fb7a-409a-835e-4a8c52e888d2 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1760864593", "metadata": {"image_type": "test"}}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:44.603331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c31b2685-fb7a-409a-835e-4a8c52e888d2 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Failed to fetch instance by id tempest-invalid-1824170867 {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 05 20:56:44.604207 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-c31b2685-fb7a-409a-835e-4a8c52e888d2 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] HTTP exception thrown: Instance tempest-invalid-1824170867 could not be found. Mar 05 20:56:44.605045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c31b2685-fb7a-409a-835e-4a8c52e888d2 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Returning 404 to user: Instance tempest-invalid-1824170867 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:44.606101 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c31b2685-fb7a-409a-835e-4a8c52e888d2 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "POST /compute/v2.1/servers/tempest-invalid-1824170867/action" status: 404 len: 101 microversion: 2.1 time: 0.010072 Mar 05 20:56:44.606736 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1162/2378] 10.222.0.15 () {60 vars in 1248 bytes} [Sat Mar 5 20:56:44 2022] POST /compute/v2.1/servers/tempest-invalid-1824170867/action => generated 101 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:44.618210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7856fd5b-1249-42d2-83ba-329dfb1b8f39 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:44.618963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7856fd5b-1249-42d2-83ba-329dfb1b8f39 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 876a2098-5755-45a2-879f-9665c69d764e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:44.626704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7856fd5b-1249-42d2-83ba-329dfb1b8f39 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.627163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7856fd5b-1249-42d2-83ba-329dfb1b8f39 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.628013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7856fd5b-1249-42d2-83ba-329dfb1b8f39 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.628472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7856fd5b-1249-42d2-83ba-329dfb1b8f39 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.648762 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-7856fd5b-1249-42d2-83ba-329dfb1b8f39 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] HTTP exception thrown: Instance 876a2098-5755-45a2-879f-9665c69d764e could not be found. Mar 05 20:56:44.649716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7856fd5b-1249-42d2-83ba-329dfb1b8f39 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Returning 404 to user: Instance 876a2098-5755-45a2-879f-9665c69d764e could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:44.650577 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7856fd5b-1249-42d2-83ba-329dfb1b8f39 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "DELETE /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e" status: 404 len: 111 microversion: 2.1 time: 0.037828 Mar 05 20:56:44.651285 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1163/2379] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:44 2022] DELETE /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:44.657542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-af05d711-7164-4af2-acc6-4fef7a62fc02 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-166484612"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:44.658610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-af05d711-7164-4af2-acc6-4fef7a62fc02 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 05 20:56:44.659121 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-af05d711-7164-4af2-acc6-4fef7a62fc02 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Mar 05 20:56:44.659709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-af05d711-7164-4af2-acc6-4fef7a62fc02 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:44.660505 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-af05d711-7164-4af2-acc6-4fef7a62fc02 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.008027 Mar 05 20:56:44.661037 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1164/2380] 10.222.0.15 () {60 vars in 1274 bytes} [Sat Mar 5 20:56:44 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:44.668465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d2495eca-2e6e-466b-9232-ef34f38eae75 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:44.668982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d2495eca-2e6e-466b-9232-ef34f38eae75 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:44.676432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2495eca-2e6e-466b-9232-ef34f38eae75 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.676898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2495eca-2e6e-466b-9232-ef34f38eae75 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.677696 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2495eca-2e6e-466b-9232-ef34f38eae75 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.679274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2495eca-2e6e-466b-9232-ef34f38eae75 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.711759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d2495eca-2e6e-466b-9232-ef34f38eae75 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:56:44.817659 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d2495eca-2e6e-466b-9232-ef34f38eae75 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "DELETE /compute/v2.1/servers/15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc" status: 204 len: 0 microversion: 2.1 time: 0.153576 Mar 05 20:56:44.818285 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1165/2381] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:44 2022] DELETE /compute/v2.1/servers/15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:44.827615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3c48822b-f057-45bb-9600-01eba1be5b51 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-609939593"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:44.828666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-224698d2-7d3e-401f-806e-5ebb83772580 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:44.828944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3c48822b-f057-45bb-9600-01eba1be5b51 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 05 20:56:44.829381 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-3c48822b-f057-45bb-9600-01eba1be5b51 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Mar 05 20:56:44.829962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3c48822b-f057-45bb-9600-01eba1be5b51 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:44.830794 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3c48822b-f057-45bb-9600-01eba1be5b51 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.008245 Mar 05 20:56:44.831370 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1166/2382] 10.222.0.15 () {60 vars in 1280 bytes} [Sat Mar 5 20:56:44 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:44.839252 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-224698d2-7d3e-401f-806e-5ebb83772580 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1310 microversion: 2.1 time: 0.294249 Mar 05 20:56:44.840411 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1217/2383] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:44 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1310 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:44.840677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f2f30afe-0bc5-43f5-9931-ee863a85eb43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:44.841296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f2f30afe-0bc5-43f5-9931-ee863a85eb43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:44.853735 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2f30afe-0bc5-43f5-9931-ee863a85eb43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.855325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d2fdd085-c461-4419-8b31-6679fb51f4da tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:44.855997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d2fdd085-c461-4419-8b31-6679fb51f4da tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:44.856729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2f30afe-0bc5-43f5-9931-ee863a85eb43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.860889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2f30afe-0bc5-43f5-9931-ee863a85eb43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.860889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2f30afe-0bc5-43f5-9931-ee863a85eb43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.863771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2fdd085-c461-4419-8b31-6679fb51f4da tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.864304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2fdd085-c461-4419-8b31-6679fb51f4da tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.865167 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2fdd085-c461-4419-8b31-6679fb51f4da tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.866386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2fdd085-c461-4419-8b31-6679fb51f4da tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.880813 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-d2fdd085-c461-4419-8b31-6679fb51f4da tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] HTTP exception thrown: Instance 7219cb01-3958-42f5-9196-0ab130421997 could not be found. Mar 05 20:56:44.881926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d2fdd085-c461-4419-8b31-6679fb51f4da tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Returning 404 to user: Instance 7219cb01-3958-42f5-9196-0ab130421997 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:44.882786 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d2fdd085-c461-4419-8b31-6679fb51f4da tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 404 len: 111 microversion: 2.1 time: 0.031384 Mar 05 20:56:44.883359 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1218/2384] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:44 2022] DELETE /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:44.895603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f2f30afe-0bc5-43f5-9931-ee863a85eb43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:56:44.896385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2a44d1ea-e2a0-4c06-a337-25d83af81556 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:44.897464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2a44d1ea-e2a0-4c06-a337-25d83af81556 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] [instance: 7219cb01-3958-42f5-9196-0ab130421997] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:44.904192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a44d1ea-e2a0-4c06-a337-25d83af81556 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.904748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a44d1ea-e2a0-4c06-a337-25d83af81556 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.905621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a44d1ea-e2a0-4c06-a337-25d83af81556 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:44.906146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a44d1ea-e2a0-4c06-a337-25d83af81556 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:44.921805 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-2a44d1ea-e2a0-4c06-a337-25d83af81556 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] HTTP exception thrown: Instance 7219cb01-3958-42f5-9196-0ab130421997 could not be found. Mar 05 20:56:44.922531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2a44d1ea-e2a0-4c06-a337-25d83af81556 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] Returning 404 to user: Instance 7219cb01-3958-42f5-9196-0ab130421997 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:44.923459 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2a44d1ea-e2a0-4c06-a337-25d83af81556 tempest-ImagesNegativeTestJSON-225835623 tempest-ImagesNegativeTestJSON-225835623-project] 10.222.0.15 "GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997" status: 404 len: 111 microversion: 2.1 time: 0.034324 Mar 05 20:56:44.924130 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1219/2385] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:44 2022] GET /compute/v2.1/servers/7219cb01-3958-42f5-9196-0ab130421997 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:45.009326 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f2f30afe-0bc5-43f5-9931-ee863a85eb43 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 204 len: 0 microversion: 2.1 time: 0.172066 Mar 05 20:56:45.010803 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1167/2386] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:44 2022] DELETE /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:45.019541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b2fe5199-9dcf-45b3-9055-e8b3263d22af tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:45.020202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b2fe5199-9dcf-45b3-9055-e8b3263d22af tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 876a2098-5755-45a2-879f-9665c69d764e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:45.027792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2fe5199-9dcf-45b3-9055-e8b3263d22af tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:45.028263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2fe5199-9dcf-45b3-9055-e8b3263d22af tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:45.029077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2fe5199-9dcf-45b3-9055-e8b3263d22af tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:45.029531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2fe5199-9dcf-45b3-9055-e8b3263d22af tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:45.047012 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-b2fe5199-9dcf-45b3-9055-e8b3263d22af tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] HTTP exception thrown: Instance 876a2098-5755-45a2-879f-9665c69d764e could not be found. Mar 05 20:56:45.047641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b2fe5199-9dcf-45b3-9055-e8b3263d22af tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Returning 404 to user: Instance 876a2098-5755-45a2-879f-9665c69d764e could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:45.048901 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b2fe5199-9dcf-45b3-9055-e8b3263d22af tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e" status: 404 len: 111 microversion: 2.1 time: 0.033804 Mar 05 20:56:45.052491 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1220/2387] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:45 2022] GET /compute/v2.1/servers/876a2098-5755-45a2-879f-9665c69d764e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:56:45.059137 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4017c146-e755-4fe2-b1a7-c297af06c705 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:45.059900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4017c146-e755-4fe2-b1a7-c297af06c705 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:45.074910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4017c146-e755-4fe2-b1a7-c297af06c705 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:45.075375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4017c146-e755-4fe2-b1a7-c297af06c705 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:45.076217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4017c146-e755-4fe2-b1a7-c297af06c705 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:45.076657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4017c146-e755-4fe2-b1a7-c297af06c705 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:45.135068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9bd9ff6d-6846-4f21-bef7-bb2696394518 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:45.135722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9bd9ff6d-6846-4f21-bef7-bb2696394518 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:45.145862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9bd9ff6d-6846-4f21-bef7-bb2696394518 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:45.146420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9bd9ff6d-6846-4f21-bef7-bb2696394518 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:45.148490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9bd9ff6d-6846-4f21-bef7-bb2696394518 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:45.148975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9bd9ff6d-6846-4f21-bef7-bb2696394518 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:45.418988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4017c146-e755-4fe2-b1a7-c297af06c705 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:45.433534 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4017c146-e755-4fe2-b1a7-c297af06c705 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc" status: 200 len: 1521 microversion: 2.1 time: 0.378602 Mar 05 20:56:45.434923 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1168/2388] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:45 2022] GET /compute/v2.1/servers/15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:45.439921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-ca1ab694-33b8-42f1-b1d1-e1c60b565405 req-6b154b39-4b02-4e3b-99e5-b097289367fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81ff1cf-7bf9-40ae-a814-4465e0f3783e", "name": "network-vif-plugged", "status": "completed", "tag": "a1950e50-9c39-44c3-af17-454a8fc9713b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:45.445085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9bd9ff6d-6846-4f21-bef7-bb2696394518 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:45.450680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ca1ab694-33b8-42f1-b1d1-e1c60b565405 req-6b154b39-4b02-4e3b-99e5-b097289367fe service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:45.451357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ca1ab694-33b8-42f1-b1d1-e1c60b565405 req-6b154b39-4b02-4e3b-99e5-b097289367fe service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:45.460868 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9bd9ff6d-6846-4f21-bef7-bb2696394518 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.330153 Mar 05 20:56:45.470572 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1221/2389] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:45 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:45.475854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-afc53c52-c958-403d-a090-ee6b94dcb31f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:45.476492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-afc53c52-c958-403d-a090-ee6b94dcb31f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:45.479832 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ca1ab694-33b8-42f1-b1d1-e1c60b565405 req-6b154b39-4b02-4e3b-99e5-b097289367fe service nova] Creating event network-vif-plugged:a1950e50-9c39-44c3-af17-454a8fc9713b for instance d81ff1cf-7bf9-40ae-a814-4465e0f3783e on nch1-master-1 Mar 05 20:56:45.485496 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-ca1ab694-33b8-42f1-b1d1-e1c60b565405 req-6b154b39-4b02-4e3b-99e5-b097289367fe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049265 Mar 05 20:56:45.486844 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1169/2390] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:45.491352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afc53c52-c958-403d-a090-ee6b94dcb31f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:45.491861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afc53c52-c958-403d-a090-ee6b94dcb31f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:45.492654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afc53c52-c958-403d-a090-ee6b94dcb31f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:45.493113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afc53c52-c958-403d-a090-ee6b94dcb31f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:45.612839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7991d844-96fe-48d3-a602-8e58616d2129 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:45.613851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7991d844-96fe-48d3-a602-8e58616d2129 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:45.620865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7991d844-96fe-48d3-a602-8e58616d2129 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:45.621573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7991d844-96fe-48d3-a602-8e58616d2129 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:45.622589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7991d844-96fe-48d3-a602-8e58616d2129 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:45.623210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7991d844-96fe-48d3-a602-8e58616d2129 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:45.836578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-afc53c52-c958-403d-a090-ee6b94dcb31f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:45.845130 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-afc53c52-c958-403d-a090-ee6b94dcb31f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1314 microversion: 2.1 time: 0.382783 Mar 05 20:56:45.846117 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1222/2391] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:45 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:45.862184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aabc54ec-e773-4138-a675-19fb2c1d7d0f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:45.862654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-aabc54ec-e773-4138-a675-19fb2c1d7d0f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:45.870431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aabc54ec-e773-4138-a675-19fb2c1d7d0f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:45.870984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aabc54ec-e773-4138-a675-19fb2c1d7d0f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:45.871890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aabc54ec-e773-4138-a675-19fb2c1d7d0f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:45.872417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aabc54ec-e773-4138-a675-19fb2c1d7d0f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:45.917403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7991d844-96fe-48d3-a602-8e58616d2129 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:45.926342 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7991d844-96fe-48d3-a602-8e58616d2129 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579" status: 200 len: 1323 microversion: 2.1 time: 0.317647 Mar 05 20:56:45.936916 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1170/2392] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:45 2022] GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579 => generated 1323 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:46.172192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-aabc54ec-e773-4138-a675-19fb2c1d7d0f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:46.180675 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aabc54ec-e773-4138-a675-19fb2c1d7d0f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1310 microversion: 2.1 time: 0.324366 Mar 05 20:56:46.181658 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1223/2393] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:45 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1310 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:46.450737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-26380ee3-6a69-4970-91bf-341d829bad30 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:46.451755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-26380ee3-6a69-4970-91bf-341d829bad30 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:46.459939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-26380ee3-6a69-4970-91bf-341d829bad30 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:46.460593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-26380ee3-6a69-4970-91bf-341d829bad30 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:46.461535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-26380ee3-6a69-4970-91bf-341d829bad30 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:46.461802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-26380ee3-6a69-4970-91bf-341d829bad30 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:46.479847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b46fff0b-f836-4252-9a4b-549963b240e3 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:46.481104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b46fff0b-f836-4252-9a4b-549963b240e3 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:46.488112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b46fff0b-f836-4252-9a4b-549963b240e3 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:46.488758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b46fff0b-f836-4252-9a4b-549963b240e3 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:46.489717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b46fff0b-f836-4252-9a4b-549963b240e3 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:46.490915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b46fff0b-f836-4252-9a4b-549963b240e3 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:46.648189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-26380ee3-6a69-4970-91bf-341d829bad30 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:46.658720 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-26380ee3-6a69-4970-91bf-341d829bad30 tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc" status: 200 len: 1521 microversion: 2.1 time: 0.211954 Mar 05 20:56:46.663729 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1171/2394] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:46 2022] GET /compute/v2.1/servers/15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:46.832081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b46fff0b-f836-4252-9a4b-549963b240e3 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:46.837476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aed82045-9d6d-4e0f-b8b0-45831f9493b5 tempest-ListImageFiltersNegativeTestJSON-1933283248 tempest-ListImageFiltersNegativeTestJSON-1933283248-project] Calling method '.version_select at 0x7fed5c835f70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:46.845436 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b46fff0b-f836-4252-9a4b-549963b240e3 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.370689 Mar 05 20:56:46.849345 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1224/2395] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:46 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:46.866830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8532ba95-e901-4d05-867d-b167f7d372c5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:46.867520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8532ba95-e901-4d05-867d-b167f7d372c5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:46.871645 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-aed82045-9d6d-4e0f-b8b0-45831f9493b5 tempest-ListImageFiltersNegativeTestJSON-1933283248 tempest-ListImageFiltersNegativeTestJSON-1933283248-project] HTTP exception thrown: Image not found. Mar 05 20:56:46.872537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aed82045-9d6d-4e0f-b8b0-45831f9493b5 tempest-ListImageFiltersNegativeTestJSON-1933283248 tempest-ListImageFiltersNegativeTestJSON-1933283248-project] Returning 404 to user: Image not found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:46.873664 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aed82045-9d6d-4e0f-b8b0-45831f9493b5 tempest-ListImageFiltersNegativeTestJSON-1933283248 tempest-ListImageFiltersNegativeTestJSON-1933283248-project] 10.222.0.15 "GET /compute/v2.1/images/940cf036-926c-4e54-941d-33fbb708ba88" status: 404 len: 62 microversion: 2.1 time: 0.183400 Mar 05 20:56:46.874404 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1172/2396] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:56:46 2022] GET /compute/v2.1/images/940cf036-926c-4e54-941d-33fbb708ba88 => generated 62 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 05 20:56:46.889048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8532ba95-e901-4d05-867d-b167f7d372c5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:46.893451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8532ba95-e901-4d05-867d-b167f7d372c5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:46.894289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8532ba95-e901-4d05-867d-b167f7d372c5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:46.894742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8532ba95-e901-4d05-867d-b167f7d372c5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:46.945218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-37e02d5c-842f-4b31-9a43-da7149ede199 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:46.945840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-37e02d5c-842f-4b31-9a43-da7149ede199 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:46.954282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-37e02d5c-842f-4b31-9a43-da7149ede199 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:46.954740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-37e02d5c-842f-4b31-9a43-da7149ede199 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:46.955528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-37e02d5c-842f-4b31-9a43-da7149ede199 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:46.956001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-37e02d5c-842f-4b31-9a43-da7149ede199 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:47.190255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-37e02d5c-842f-4b31-9a43-da7149ede199 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:47.199650 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-37e02d5c-842f-4b31-9a43-da7149ede199 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579" status: 200 len: 1323 microversion: 2.1 time: 0.259465 Mar 05 20:56:47.200276 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1173/2397] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:46 2022] GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579 => generated 1323 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:47.222406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5d0a1fee-1ea9-4400-b698-3d53ea539e3b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:47.223058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5d0a1fee-1ea9-4400-b698-3d53ea539e3b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:47.236806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d0a1fee-1ea9-4400-b698-3d53ea539e3b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:47.241110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d0a1fee-1ea9-4400-b698-3d53ea539e3b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:47.245225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d0a1fee-1ea9-4400-b698-3d53ea539e3b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:47.245857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d0a1fee-1ea9-4400-b698-3d53ea539e3b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:47.419687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8532ba95-e901-4d05-867d-b167f7d372c5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:47.431733 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8532ba95-e901-4d05-867d-b167f7d372c5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1314 microversion: 2.1 time: 0.567188 Mar 05 20:56:47.432551 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1225/2398] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:46 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:47.457060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-81549267-d263-49bf-b1ab-13982f728889 req-ea6dcfaa-445b-4eec-a774-744fa6663def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d79358d-efb1-46c8-96c1-e0e3777d55e0", "name": "network-vif-deleted", "tag": "e507f9d3-0b19-45f5-87ed-8f1f65b523b8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:47.486837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-81549267-d263-49bf-b1ab-13982f728889 req-ea6dcfaa-445b-4eec-a774-744fa6663def service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:47.488251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-81549267-d263-49bf-b1ab-13982f728889 req-ea6dcfaa-445b-4eec-a774-744fa6663def service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:47.518508 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-81549267-d263-49bf-b1ab-13982f728889 req-ea6dcfaa-445b-4eec-a774-744fa6663def service nova] Creating event network-vif-deleted:e507f9d3-0b19-45f5-87ed-8f1f65b523b8 for instance 6d79358d-efb1-46c8-96c1-e0e3777d55e0 on nch2-master-1 Mar 05 20:56:47.531494 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-81549267-d263-49bf-b1ab-13982f728889 req-ea6dcfaa-445b-4eec-a774-744fa6663def service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092885 Mar 05 20:56:47.534921 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1226/2399] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:47.571278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5d0a1fee-1ea9-4400-b698-3d53ea539e3b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:47.582035 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5d0a1fee-1ea9-4400-b698-3d53ea539e3b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1493 microversion: 2.1 time: 0.378004 Mar 05 20:56:47.583586 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1174/2400] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:47 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1493 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:47.586325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-a10bb8d4-f945-4b74-a86d-29c9982e6f65 req-a185ed52-d837-4c05-ab79-bdc3dd2e7282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a6900c-db11-4225-b22d-a9ce4efe4ce0", "name": "network-vif-plugged", "status": "completed", "tag": "45b7f0b0-889d-474f-9ac1-a67a655d982b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:47.606678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a10bb8d4-f945-4b74-a86d-29c9982e6f65 req-a185ed52-d837-4c05-ab79-bdc3dd2e7282 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:47.607743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a10bb8d4-f945-4b74-a86d-29c9982e6f65 req-a185ed52-d837-4c05-ab79-bdc3dd2e7282 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:47.638388 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-a10bb8d4-f945-4b74-a86d-29c9982e6f65 req-a185ed52-d837-4c05-ab79-bdc3dd2e7282 service nova] Creating event network-vif-plugged:45b7f0b0-889d-474f-9ac1-a67a655d982b for instance b8a6900c-db11-4225-b22d-a9ce4efe4ce0 on nch1-master-1 Mar 05 20:56:47.644350 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-a10bb8d4-f945-4b74-a86d-29c9982e6f65 req-a185ed52-d837-4c05-ab79-bdc3dd2e7282 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067126 Mar 05 20:56:47.647016 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1227/2401] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:56:47.680189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a2ebbf3a-885e-41a1-b371-74d91ce5f43c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:47.681064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a2ebbf3a-885e-41a1-b371-74d91ce5f43c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:47.694910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2ebbf3a-885e-41a1-b371-74d91ce5f43c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:47.698899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2ebbf3a-885e-41a1-b371-74d91ce5f43c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:47.702315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2ebbf3a-885e-41a1-b371-74d91ce5f43c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:47.703101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2ebbf3a-885e-41a1-b371-74d91ce5f43c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:47.847289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a2ebbf3a-885e-41a1-b371-74d91ce5f43c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed1a5c3ac0c452e9212f081bc4f365d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82543db15443c69b77efe94c71e251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:47.860277 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a2ebbf3a-885e-41a1-b371-74d91ce5f43c tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc" status: 200 len: 1479 microversion: 2.1 time: 0.187290 Mar 05 20:56:47.862030 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1228/2402] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:47 2022] GET /compute/v2.1/servers/15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc => generated 1479 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:47.874179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-0ebdf9ee-d721-47fa-9a76-125e0f7a8e33 req-f8de72d5-61d9-472f-a24b-b2891a4b2529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc", "name": "network-vif-deleted", "tag": "8ac1b815-0a98-4dee-b99b-4a42f8faeb8d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:47.884530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0ebdf9ee-d721-47fa-9a76-125e0f7a8e33 req-f8de72d5-61d9-472f-a24b-b2891a4b2529 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:47.885249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0ebdf9ee-d721-47fa-9a76-125e0f7a8e33 req-f8de72d5-61d9-472f-a24b-b2891a4b2529 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:47.930233 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0ebdf9ee-d721-47fa-9a76-125e0f7a8e33 req-f8de72d5-61d9-472f-a24b-b2891a4b2529 service nova] Creating event network-vif-deleted:8ac1b815-0a98-4dee-b99b-4a42f8faeb8d for instance 15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc on nch1-master-1 Mar 05 20:56:47.942367 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-0ebdf9ee-d721-47fa-9a76-125e0f7a8e33 req-f8de72d5-61d9-472f-a24b-b2891a4b2529 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078835 Mar 05 20:56:47.944537 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1229/2403] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:47.962279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cb5fdb0f-1535-4e29-90ef-9b31908eed06 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:47.963894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cb5fdb0f-1535-4e29-90ef-9b31908eed06 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:47.983755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb5fdb0f-1535-4e29-90ef-9b31908eed06 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:47.985090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb5fdb0f-1535-4e29-90ef-9b31908eed06 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:47.988288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb5fdb0f-1535-4e29-90ef-9b31908eed06 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:47.989333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb5fdb0f-1535-4e29-90ef-9b31908eed06 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.029290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7df2c196-74e0-4ec8-a5ed-3e7dd27b0c8a tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:48.029917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7df2c196-74e0-4ec8-a5ed-3e7dd27b0c8a tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:48.038114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7df2c196-74e0-4ec8-a5ed-3e7dd27b0c8a tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.042454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7df2c196-74e0-4ec8-a5ed-3e7dd27b0c8a tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.043480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7df2c196-74e0-4ec8-a5ed-3e7dd27b0c8a tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.044141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7df2c196-74e0-4ec8-a5ed-3e7dd27b0c8a tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.312593 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7df2c196-74e0-4ec8-a5ed-3e7dd27b0c8a tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1644 microversion: 2.1 time: 0.716449 Mar 05 20:56:48.313339 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1175/2404] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:47 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1644 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:48.319338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a287b5d4-ca78-4be0-96cd-cabb6073918a tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:48.320081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a287b5d4-ca78-4be0-96cd-cabb6073918a tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:48.332437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cb5fdb0f-1535-4e29-90ef-9b31908eed06 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:48.336407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a287b5d4-ca78-4be0-96cd-cabb6073918a tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.337365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a287b5d4-ca78-4be0-96cd-cabb6073918a tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.339599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a287b5d4-ca78-4be0-96cd-cabb6073918a tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.340280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a287b5d4-ca78-4be0-96cd-cabb6073918a tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.341485 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cb5fdb0f-1535-4e29-90ef-9b31908eed06 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.394115 Mar 05 20:56:48.353619 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1230/2405] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:47 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:48.364310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3082d3b7-395c-419d-acc7-14aa372b96b8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:48.364980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3082d3b7-395c-419d-acc7-14aa372b96b8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:48.382151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3082d3b7-395c-419d-acc7-14aa372b96b8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.382620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3082d3b7-395c-419d-acc7-14aa372b96b8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.388471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3082d3b7-395c-419d-acc7-14aa372b96b8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.389509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3082d3b7-395c-419d-acc7-14aa372b96b8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.524679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a287b5d4-ca78-4be0-96cd-cabb6073918a tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:48.534275 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a287b5d4-ca78-4be0-96cd-cabb6073918a tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579" status: 200 len: 1323 microversion: 2.1 time: 0.219395 Mar 05 20:56:48.535140 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1176/2406] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:48 2022] GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579 => generated 1323 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:48.540893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a9958352-6522-4597-b534-c77782205b1f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:48.541544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a9958352-6522-4597-b534-c77782205b1f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:48.554737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9958352-6522-4597-b534-c77782205b1f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.555850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9958352-6522-4597-b534-c77782205b1f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.557431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9958352-6522-4597-b534-c77782205b1f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.557902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9958352-6522-4597-b534-c77782205b1f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.768906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a9958352-6522-4597-b534-c77782205b1f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:48.771595 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3082d3b7-395c-419d-acc7-14aa372b96b8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1644 microversion: 2.1 time: 0.413147 Mar 05 20:56:48.772838 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1231/2407] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:48 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1644 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:48.777949 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a9958352-6522-4597-b534-c77782205b1f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1314 microversion: 2.1 time: 0.241164 Mar 05 20:56:48.778642 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1177/2408] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:48 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:48.792683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dcd2623c-7aed-4c46-9c10-292ae65c4541 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:48.794029 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:56:48.794029 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:56:48.795243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcd2623c-7aed-4c46-9c10-292ae65c4541 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.795730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcd2623c-7aed-4c46-9c10-292ae65c4541 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.796560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcd2623c-7aed-4c46-9c10-292ae65c4541 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.797092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcd2623c-7aed-4c46-9c10-292ae65c4541 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.823639 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dcd2623c-7aed-4c46-9c10-292ae65c4541 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.034469 Mar 05 20:56:48.824264 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1232/2409] 10.222.0.15 () {58 vars in 1175 bytes} [Sat Mar 5 20:56:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:48.836772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a49b9bab-9947-4589-8481-2706f5a6de72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:48.838650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a49b9bab-9947-4589-8481-2706f5a6de72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:48.845046 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a49b9bab-9947-4589-8481-2706f5a6de72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.845503 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a49b9bab-9947-4589-8481-2706f5a6de72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.846287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a49b9bab-9947-4589-8481-2706f5a6de72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.846728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a49b9bab-9947-4589-8481-2706f5a6de72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.877794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0b2ef133-418f-4887-b57c-1cf70afe285e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:48.878424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0b2ef133-418f-4887-b57c-1cf70afe285e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:48.881060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-a49b9bab-9947-4589-8481-2706f5a6de72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lazy-loading 'flavor' on Instance uuid d81ff1cf-7bf9-40ae-a814-4465e0f3783e {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:56:48.885243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b2ef133-418f-4887-b57c-1cf70afe285e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.885992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b2ef133-418f-4887-b57c-1cf70afe285e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.887009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b2ef133-418f-4887-b57c-1cf70afe285e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.887640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b2ef133-418f-4887-b57c-1cf70afe285e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.895106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a49b9bab-9947-4589-8481-2706f5a6de72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Going to try to live migrate instance to nch2-master-1 {{(pid=141478) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 05 20:56:48.911184 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-0b2ef133-418f-4887-b57c-1cf70afe285e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] HTTP exception thrown: Instance 15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc could not be found. Mar 05 20:56:48.913091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0b2ef133-418f-4887-b57c-1cf70afe285e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Returning 404 to user: Instance 15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:48.914155 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0b2ef133-418f-4887-b57c-1cf70afe285e tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc" status: 404 len: 111 microversion: 2.1 time: 0.040309 Mar 05 20:56:48.916740 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1233/2410] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:48 2022] GET /compute/v2.1/servers/15b83a1a-a0b4-4f3c-9142-b2e92dc2f1cc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:48.923551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0c7f2d3-0749-4f7a-962c-8defe234bf4d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:48.924210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e0c7f2d3-0749-4f7a-962c-8defe234bf4d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] [instance: 6d79358d-efb1-46c8-96c1-e0e3777d55e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:48.931159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0c7f2d3-0749-4f7a-962c-8defe234bf4d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.931621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0c7f2d3-0749-4f7a-962c-8defe234bf4d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.932815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0c7f2d3-0749-4f7a-962c-8defe234bf4d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:48.933257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0c7f2d3-0749-4f7a-962c-8defe234bf4d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:48.949038 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-e0c7f2d3-0749-4f7a-962c-8defe234bf4d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] HTTP exception thrown: Instance 6d79358d-efb1-46c8-96c1-e0e3777d55e0 could not be found. Mar 05 20:56:48.949647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0c7f2d3-0749-4f7a-962c-8defe234bf4d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] Returning 404 to user: Instance 6d79358d-efb1-46c8-96c1-e0e3777d55e0 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:48.950795 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0c7f2d3-0749-4f7a-962c-8defe234bf4d tempest-ListServersNegativeTestJSON-233823613 tempest-ListServersNegativeTestJSON-233823613-project] 10.222.0.15 "GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0" status: 404 len: 111 microversion: 2.1 time: 0.031825 Mar 05 20:56:48.956028 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1234/2411] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:48 2022] GET /compute/v2.1/servers/6d79358d-efb1-46c8-96c1-e0e3777d55e0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:56:49.467255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8e99c846-36c5-4545-91cc-9963e86d7262 tempest-ListImagesTestJSON-530550220 tempest-ListImagesTestJSON-530550220-project] Calling method '.version_select at 0x7fed5caff160>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:49.523048 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8e99c846-36c5-4545-91cc-9963e86d7262 tempest-ListImagesTestJSON-530550220 tempest-ListImagesTestJSON-530550220-project] 10.222.0.15 "GET /compute/v2.1/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80" status: 200 len: 784 microversion: 2.1 time: 0.183149 Mar 05 20:56:49.523635 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1235/2412] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:56:49 2022] GET /compute/v2.1/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80 => generated 784 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:56:49.536852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-030a95de-2592-4d2f-b9bf-dc93eaed12ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:49.537810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-030a95de-2592-4d2f-b9bf-dc93eaed12ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:49.553966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-030a95de-2592-4d2f-b9bf-dc93eaed12ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:49.554753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-030a95de-2592-4d2f-b9bf-dc93eaed12ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:49.555344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-030a95de-2592-4d2f-b9bf-dc93eaed12ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:49.555989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-030a95de-2592-4d2f-b9bf-dc93eaed12ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:49.829498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-030a95de-2592-4d2f-b9bf-dc93eaed12ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:49.838003 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-030a95de-2592-4d2f-b9bf-dc93eaed12ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.313014 Mar 05 20:56:49.838648 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1236/2413] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:49 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:49.843311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-341910cf-0889-452d-b264-fbb0f4da339d tempest-ListImagesTestJSON-530550220 tempest-ListImagesTestJSON-530550220-project] Calling method '.version_select at 0x7fed5caff310>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:49.973832 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-341910cf-0889-452d-b264-fbb0f4da339d tempest-ListImagesTestJSON-530550220 tempest-ListImagesTestJSON-530550220-project] 10.222.0.15 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.134049 Mar 05 20:56:49.975035 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1237/2414] 10.222.0.15 () {58 vars in 1121 bytes} [Sat Mar 5 20:56:49 2022] GET /compute/v2.1/images => generated 445 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:49.984945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c83b332-bede-4235-aaa1-2f5aee23f19b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:49.988266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3c83b332-bede-4235-aaa1-2f5aee23f19b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:49.996001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c83b332-bede-4235-aaa1-2f5aee23f19b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:49.996748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c83b332-bede-4235-aaa1-2f5aee23f19b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:49.997940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c83b332-bede-4235-aaa1-2f5aee23f19b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:49.998392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c83b332-bede-4235-aaa1-2f5aee23f19b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:50.205940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3c83b332-bede-4235-aaa1-2f5aee23f19b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:50.216271 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3c83b332-bede-4235-aaa1-2f5aee23f19b tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579" status: 200 len: 1323 microversion: 2.1 time: 0.239610 Mar 05 20:56:50.231063 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1238/2415] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:49 2022] GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579 => generated 1323 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:50.236936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6dfa2e1a-1674-467b-9500-4ffc5f7105bc req-72a1116b-17fc-4001-804c-b42bcf97e3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1567b85e-c179-4c65-9ec1-47b86cdba579", "name": "network-vif-plugged", "status": "completed", "tag": "7d12cb43-6b68-44ec-be62-881ac11e38d1"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:50.245879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6dfa2e1a-1674-467b-9500-4ffc5f7105bc req-72a1116b-17fc-4001-804c-b42bcf97e3e0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:50.246601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6dfa2e1a-1674-467b-9500-4ffc5f7105bc req-72a1116b-17fc-4001-804c-b42bcf97e3e0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:50.259485 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6dfa2e1a-1674-467b-9500-4ffc5f7105bc req-72a1116b-17fc-4001-804c-b42bcf97e3e0 service nova] Creating event network-vif-plugged:7d12cb43-6b68-44ec-be62-881ac11e38d1 for instance 1567b85e-c179-4c65-9ec1-47b86cdba579 on nch2-master-1 Mar 05 20:56:50.268582 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6dfa2e1a-1674-467b-9500-4ffc5f7105bc req-72a1116b-17fc-4001-804c-b42bcf97e3e0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035952 Mar 05 20:56:50.274221 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1239/2416] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:50.279711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8a288573-3add-4659-bae2-5764f75d4f22 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:50.280404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8a288573-3add-4659-bae2-5764f75d4f22 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:50.287103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a288573-3add-4659-bae2-5764f75d4f22 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:50.287552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a288573-3add-4659-bae2-5764f75d4f22 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:50.288390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a288573-3add-4659-bae2-5764f75d4f22 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:50.288834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a288573-3add-4659-bae2-5764f75d4f22 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:50.497460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8a288573-3add-4659-bae2-5764f75d4f22 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:50.515698 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8a288573-3add-4659-bae2-5764f75d4f22 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1501 microversion: 2.1 time: 0.240137 Mar 05 20:56:50.516534 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1240/2417] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:50 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1501 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:50.521584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1ee6c68c-f95e-4afa-b293-d4501e4dac19 tempest-ListImagesTestJSON-530550220 tempest-ListImagesTestJSON-530550220-project] Calling method '.version_select at 0x7fed5c808280>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:50.579355 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1ee6c68c-f95e-4afa-b293-d4501e4dac19 tempest-ListImagesTestJSON-530550220 tempest-ListImagesTestJSON-530550220-project] 10.222.0.15 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.061593 Mar 05 20:56:50.580682 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1241/2418] 10.222.0.15 () {58 vars in 1142 bytes} [Sat Mar 5 20:56:50 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:50.587510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3e2d9137-29a9-4719-93be-d1673bbba826 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:50.588552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3e2d9137-29a9-4719-93be-d1673bbba826 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:50.595018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e2d9137-29a9-4719-93be-d1673bbba826 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:50.595486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e2d9137-29a9-4719-93be-d1673bbba826 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:50.596598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e2d9137-29a9-4719-93be-d1673bbba826 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:50.597051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e2d9137-29a9-4719-93be-d1673bbba826 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:50.731715 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3e2d9137-29a9-4719-93be-d1673bbba826 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "POST /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0/action" status: 202 len: 0 microversion: 2.1 time: 0.149663 Mar 05 20:56:50.735276 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1242/2419] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:56:50 2022] POST /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:56:50.744689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-775c33ae-2798-4dc0-a809-3ea963b41129 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:50.749272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-775c33ae-2798-4dc0-a809-3ea963b41129 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:50.764613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-775c33ae-2798-4dc0-a809-3ea963b41129 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:50.765098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-775c33ae-2798-4dc0-a809-3ea963b41129 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:50.765977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-775c33ae-2798-4dc0-a809-3ea963b41129 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:50.767732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-775c33ae-2798-4dc0-a809-3ea963b41129 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:51.047687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-775c33ae-2798-4dc0-a809-3ea963b41129 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:51.056118 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-775c33ae-2798-4dc0-a809-3ea963b41129 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1506 microversion: 2.1 time: 0.316168 Mar 05 20:56:51.059904 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1243/2420] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:50 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:56:51.069882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8e86a85b-4ec7-4523-90f4-34d22998628e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:51.074799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8e86a85b-4ec7-4523-90f4-34d22998628e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:51.085859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e86a85b-4ec7-4523-90f4-34d22998628e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:51.088509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e86a85b-4ec7-4523-90f4-34d22998628e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:51.090533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e86a85b-4ec7-4523-90f4-34d22998628e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:51.092132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e86a85b-4ec7-4523-90f4-34d22998628e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:51.331802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8e86a85b-4ec7-4523-90f4-34d22998628e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:51.366646 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a49b9bab-9947-4589-8481-2706f5a6de72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e/action" status: 202 len: 0 microversion: 2.1 time: 2.534984 Mar 05 20:56:51.378033 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1178/2421] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:56:48 2022] POST /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e/action => generated 0 bytes in 2544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:56:51.387961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c1192d65-9377-40b2-bd5f-1d09481d6608 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:51.390343 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c1192d65-9377-40b2-bd5f-1d09481d6608 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:51.392505 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8e86a85b-4ec7-4523-90f4-34d22998628e tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.300510 Mar 05 20:56:51.403204 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1244/2422] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:51 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:51.419269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-42dea529-2a45-4afa-b88a-5dd8c7205245 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:51.419872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-42dea529-2a45-4afa-b88a-5dd8c7205245 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:51.437564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c1192d65-9377-40b2-bd5f-1d09481d6608 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:51.439022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c1192d65-9377-40b2-bd5f-1d09481d6608 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:51.444507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c1192d65-9377-40b2-bd5f-1d09481d6608 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:51.447325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c1192d65-9377-40b2-bd5f-1d09481d6608 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:51.453472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42dea529-2a45-4afa-b88a-5dd8c7205245 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:51.458097 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42dea529-2a45-4afa-b88a-5dd8c7205245 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:51.466570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42dea529-2a45-4afa-b88a-5dd8c7205245 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:51.469294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42dea529-2a45-4afa-b88a-5dd8c7205245 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:51.869658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c1192d65-9377-40b2-bd5f-1d09481d6608 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:51.891851 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c1192d65-9377-40b2-bd5f-1d09481d6608 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579" status: 200 len: 1323 microversion: 2.1 time: 0.513730 Mar 05 20:56:51.895316 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1179/2423] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:51 2022] GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579 => generated 1323 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:51.918341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-42dea529-2a45-4afa-b88a-5dd8c7205245 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:51.933210 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-42dea529-2a45-4afa-b88a-5dd8c7205245 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1503 microversion: 2.1 time: 0.531688 Mar 05 20:56:51.933841 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1245/2424] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:51 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1503 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:52.080782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-65f67d1b-a9a8-46bc-b9f3-57feafe841a3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:52.082367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-65f67d1b-a9a8-46bc-b9f3-57feafe841a3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:52.092601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65f67d1b-a9a8-46bc-b9f3-57feafe841a3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:52.093537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65f67d1b-a9a8-46bc-b9f3-57feafe841a3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:52.094971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65f67d1b-a9a8-46bc-b9f3-57feafe841a3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:52.095771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65f67d1b-a9a8-46bc-b9f3-57feafe841a3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:52.361591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-65f67d1b-a9a8-46bc-b9f3-57feafe841a3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:52.374026 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-65f67d1b-a9a8-46bc-b9f3-57feafe841a3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1486 microversion: 2.1 time: 0.299901 Mar 05 20:56:52.385101 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1180/2425] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:52 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1486 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:52.395550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9df39b19-6640-44d0-bb5c-7c677f86d6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:52.396395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9df39b19-6640-44d0-bb5c-7c677f86d6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:52.405713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9df39b19-6640-44d0-bb5c-7c677f86d6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:52.406435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9df39b19-6640-44d0-bb5c-7c677f86d6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:52.407291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9df39b19-6640-44d0-bb5c-7c677f86d6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:52.407653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9df39b19-6640-44d0-bb5c-7c677f86d6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:52.415359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e3f6d293-5ad1-493a-8838-6d714a2fea3c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:52.419133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e3f6d293-5ad1-493a-8838-6d714a2fea3c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:52.439195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3f6d293-5ad1-493a-8838-6d714a2fea3c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:52.439663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3f6d293-5ad1-493a-8838-6d714a2fea3c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:52.440229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9df39b19-6640-44d0-bb5c-7c677f86d6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:56:52.449137 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3f6d293-5ad1-493a-8838-6d714a2fea3c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:52.449598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3f6d293-5ad1-493a-8838-6d714a2fea3c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:52.572756 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9df39b19-6640-44d0-bb5c-7c677f86d6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 204 len: 0 microversion: 2.1 time: 0.182212 Mar 05 20:56:52.579638 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1246/2426] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:56:52 2022] DELETE /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:52.592151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-09ea981b-032c-4ebf-92aa-a8b90b27c6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:52.593502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-09ea981b-032c-4ebf-92aa-a8b90b27c6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:52.604735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09ea981b-032c-4ebf-92aa-a8b90b27c6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:52.605538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09ea981b-032c-4ebf-92aa-a8b90b27c6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:52.606544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09ea981b-032c-4ebf-92aa-a8b90b27c6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:52.607203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09ea981b-032c-4ebf-92aa-a8b90b27c6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:52.751647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e3f6d293-5ad1-493a-8838-6d714a2fea3c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:52.760903 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e3f6d293-5ad1-493a-8838-6d714a2fea3c tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.350252 Mar 05 20:56:52.761690 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1181/2427] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:52 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:52.914976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-28e82031-b8dd-4358-8b03-a8dfe4f772e8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:52.915602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-28e82031-b8dd-4358-8b03-a8dfe4f772e8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:52.922718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28e82031-b8dd-4358-8b03-a8dfe4f772e8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:52.923543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28e82031-b8dd-4358-8b03-a8dfe4f772e8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:52.924717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28e82031-b8dd-4358-8b03-a8dfe4f772e8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:52.925386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28e82031-b8dd-4358-8b03-a8dfe4f772e8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:53.224917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-09ea981b-032c-4ebf-92aa-a8b90b27c6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:53.242176 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-09ea981b-032c-4ebf-92aa-a8b90b27c6b4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1492 microversion: 2.1 time: 0.659236 Mar 05 20:56:53.252448 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1247/2428] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:52 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1492 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:53.261234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3cfb6bb6-00d2-45e4-9349-34025c7248f3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:53.262658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3cfb6bb6-00d2-45e4-9349-34025c7248f3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:53.270535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3cfb6bb6-00d2-45e4-9349-34025c7248f3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:53.270885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3cfb6bb6-00d2-45e4-9349-34025c7248f3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:53.273271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3cfb6bb6-00d2-45e4-9349-34025c7248f3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:53.273725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3cfb6bb6-00d2-45e4-9349-34025c7248f3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:53.639560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-28e82031-b8dd-4358-8b03-a8dfe4f772e8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:53.646884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3cfb6bb6-00d2-45e4-9349-34025c7248f3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:53.651164 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-28e82031-b8dd-4358-8b03-a8dfe4f772e8 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579" status: 200 len: 1518 microversion: 2.1 time: 0.740273 Mar 05 20:56:53.658823 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1182/2429] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:52 2022] GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579 => generated 1518 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:53.666042 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3cfb6bb6-00d2-45e4-9349-34025c7248f3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1503 microversion: 2.1 time: 0.410566 Mar 05 20:56:53.671009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9e37d151-aa89-4902-ba64-90f34a538ff6 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Action: 'action', calling method: .version_select at 0x7fed5f110b80>, body: {"addFloatingIp": {"address": "172.35.0.115"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:53.672451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9e37d151-aa89-4902-ba64-90f34a538ff6 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:53.681475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e37d151-aa89-4902-ba64-90f34a538ff6 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:53.681935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e37d151-aa89-4902-ba64-90f34a538ff6 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:53.682164 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1248/2430] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:53 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1503 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:53.683181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e37d151-aa89-4902-ba64-90f34a538ff6 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:53.683876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e37d151-aa89-4902-ba64-90f34a538ff6 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:53.769918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e37d151-aa89-4902-ba64-90f34a538ff6 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Acquired lock "refresh_cache-429f5dde-84d7-4bd3-a37a-066ac19fdc53" {{(pid=141478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 20:56:53.778717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-61faa6c5-ddaf-47d1-9670-c1fb7ec7bed6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:53.779871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-61faa6c5-ddaf-47d1-9670-c1fb7ec7bed6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:53.794387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61faa6c5-ddaf-47d1-9670-c1fb7ec7bed6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:53.794858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61faa6c5-ddaf-47d1-9670-c1fb7ec7bed6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:53.795714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61faa6c5-ddaf-47d1-9670-c1fb7ec7bed6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:53.800796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61faa6c5-ddaf-47d1-9670-c1fb7ec7bed6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:54.246912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-61faa6c5-ddaf-47d1-9670-c1fb7ec7bed6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:54.255473 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-61faa6c5-ddaf-47d1-9670-c1fb7ec7bed6 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.480879 Mar 05 20:56:54.257239 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1249/2431] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:53 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:54.271541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-8a8d65a5-4ff7-435b-a313-3d9457040029 req-33cfb020-6757-4e44-98c2-88a21d294fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81ff1cf-7bf9-40ae-a814-4465e0f3783e", "name": "network-vif-unplugged", "status": "completed", "tag": "a1950e50-9c39-44c3-af17-454a8fc9713b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:54.280195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8a8d65a5-4ff7-435b-a313-3d9457040029 req-33cfb020-6757-4e44-98c2-88a21d294fa8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:54.280774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8a8d65a5-4ff7-435b-a313-3d9457040029 req-33cfb020-6757-4e44-98c2-88a21d294fa8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:54.294252 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-8a8d65a5-4ff7-435b-a313-3d9457040029 req-33cfb020-6757-4e44-98c2-88a21d294fa8 service nova] Creating event network-vif-unplugged:a1950e50-9c39-44c3-af17-454a8fc9713b for instance d81ff1cf-7bf9-40ae-a814-4465e0f3783e on nch1-master-1 Mar 05 20:56:54.299503 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-8a8d65a5-4ff7-435b-a313-3d9457040029 req-33cfb020-6757-4e44-98c2-88a21d294fa8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031657 Mar 05 20:56:54.300340 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1250/2432] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:54.423991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6d2489a7-55d4-4961-9ab4-b4f227c473c4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Action: 'create', calling method: .version_select at 0x7fed5c72aa60>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-157787945", "policies": ["affinity"]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:54.460669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-6d2489a7-55d4-4961-9ab4-b4f227c473c4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:54.474909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-6d2489a7-55d4-4961-9ab4-b4f227c473c4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for user 7e550a9e464a43f696a831eac675623e and project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:54.531889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-6d2489a7-55d4-4961-9ab4-b4f227c473c4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:54.537915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-6d2489a7-55d4-4961-9ab4-b4f227c473c4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for user 7e550a9e464a43f696a831eac675623e and project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:54.551708 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6d2489a7-55d4-4961-9ab4-b4f227c473c4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.249914 Mar 05 20:56:54.552578 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1251/2433] 10.222.0.15 () {60 vars in 1173 bytes} [Sat Mar 5 20:56:54 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:54.558370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-80edc059-85f5-420a-8817-1fd81308e994 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:54.559384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-80edc059-85f5-420a-8817-1fd81308e994 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:54.566315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80edc059-85f5-420a-8817-1fd81308e994 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:54.566786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80edc059-85f5-420a-8817-1fd81308e994 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:54.567611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80edc059-85f5-420a-8817-1fd81308e994 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:54.568827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80edc059-85f5-420a-8817-1fd81308e994 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:54.903407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-80edc059-85f5-420a-8817-1fd81308e994 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:54.916879 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-80edc059-85f5-420a-8817-1fd81308e994 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1492 microversion: 2.1 time: 0.362390 Mar 05 20:56:54.926202 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1252/2434] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:54 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1492 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:54.930955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0643a6cf-0e2a-4319-9fb9-5faabf7fe24c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Action: 'create', calling method: .version_select at 0x7fed5c808c10>, body: {"server_group": {"name": "tempest-server-group-1305257530", "policies": ["affinity"]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:54.955183 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-0643a6cf-0e2a-4319-9fb9-5faabf7fe24c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:54.971062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-0643a6cf-0e2a-4319-9fb9-5faabf7fe24c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for user 7e550a9e464a43f696a831eac675623e and project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:55.055453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-0643a6cf-0e2a-4319-9fb9-5faabf7fe24c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:55.062730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-0643a6cf-0e2a-4319-9fb9-5faabf7fe24c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for user 7e550a9e464a43f696a831eac675623e and project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:55.082489 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0643a6cf-0e2a-4319-9fb9-5faabf7fe24c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.163430 Mar 05 20:56:55.089831 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1253/2435] 10.222.0.15 () {60 vars in 1172 bytes} [Sat Mar 5 20:56:54 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:55.094984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-012990e9-77c2-43d9-86e6-c425d30d4919 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:55.095822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-012990e9-77c2-43d9-86e6-c425d30d4919 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:55.102719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-012990e9-77c2-43d9-86e6-c425d30d4919 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:55.103185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-012990e9-77c2-43d9-86e6-c425d30d4919 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:55.104034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-012990e9-77c2-43d9-86e6-c425d30d4919 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:55.104486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-012990e9-77c2-43d9-86e6-c425d30d4919 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:55.551530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-012990e9-77c2-43d9-86e6-c425d30d4919 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:55.560893 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-012990e9-77c2-43d9-86e6-c425d30d4919 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1503 microversion: 2.1 time: 0.469771 Mar 05 20:56:55.571865 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1254/2436] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:55 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1503 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:55.577467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cc389a0c-8fe7-4f32-affd-31c584ecc7e7 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Action: 'create', calling method: .version_select at 0x7fed5caff820>, body: {"server_group": {"name": "tempest-server-group-1305257530", "policies": ["affinity"]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:55.596433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-cc389a0c-8fe7-4f32-affd-31c584ecc7e7 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:55.604316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-cc389a0c-8fe7-4f32-affd-31c584ecc7e7 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for user 7e550a9e464a43f696a831eac675623e and project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:55.664774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-cc389a0c-8fe7-4f32-affd-31c584ecc7e7 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:55.675866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-cc389a0c-8fe7-4f32-affd-31c584ecc7e7 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for user 7e550a9e464a43f696a831eac675623e and project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:55.700126 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cc389a0c-8fe7-4f32-affd-31c584ecc7e7 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.126611 Mar 05 20:56:55.701267 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1255/2437] 10.222.0.15 () {60 vars in 1172 bytes} [Sat Mar 5 20:56:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:55.708068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f8d55c7e-1b36-4594-a2f8-c22d607ef7e7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:55.709229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f8d55c7e-1b36-4594-a2f8-c22d607ef7e7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:55.722913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8d55c7e-1b36-4594-a2f8-c22d607ef7e7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:55.725434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8d55c7e-1b36-4594-a2f8-c22d607ef7e7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:55.727140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8d55c7e-1b36-4594-a2f8-c22d607ef7e7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:55.727800 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8d55c7e-1b36-4594-a2f8-c22d607ef7e7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:56.029557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f8d55c7e-1b36-4594-a2f8-c22d607ef7e7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:56.044085 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f8d55c7e-1b36-4594-a2f8-c22d607ef7e7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.341196 Mar 05 20:56:56.045534 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1256/2438] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:55 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:56.054323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-088b8f05-7f82-4159-b5f1-aab88b218217 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:56.103884 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-088b8f05-7f82-4159-b5f1-aab88b218217 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "DELETE /compute/v2.1/os-server-groups/e29f7e78-8c6c-4aeb-a0ca-40cf155a5bdf" status: 204 len: 0 microversion: 2.1 time: 0.055152 Mar 05 20:56:56.106671 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1257/2439] 10.222.0.15 () {58 vars in 1265 bytes} [Sat Mar 5 20:56:56 2022] DELETE /compute/v2.1/os-server-groups/e29f7e78-8c6c-4aeb-a0ca-40cf155a5bdf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:56.130060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e522cf5a-a089-4e90-a0fe-81a2075608e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:56.135228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e522cf5a-a089-4e90-a0fe-81a2075608e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:56.145295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e522cf5a-a089-4e90-a0fe-81a2075608e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:56.146236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e522cf5a-a089-4e90-a0fe-81a2075608e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:56.149237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e522cf5a-a089-4e90-a0fe-81a2075608e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:56.150125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e522cf5a-a089-4e90-a0fe-81a2075608e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:56.305492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e522cf5a-a089-4e90-a0fe-81a2075608e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:56.313676 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e522cf5a-a089-4e90-a0fe-81a2075608e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 200 len: 1284 microversion: 2.1 time: 0.205650 Mar 05 20:56:56.314604 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1258/2440] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:56 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 1284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:56.320672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-037af3a7-1de1-4c16-940b-6b9f708dd338 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:56.336002 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-037af3a7-1de1-4c16-940b-6b9f708dd338 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.020143 Mar 05 20:56:56.337020 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1259/2441] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:56:56 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:56.346715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6e17cbc3-3ac4-4bd3-811c-8c65e61ec56c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:56.386198 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6e17cbc3-3ac4-4bd3-811c-8c65e61ec56c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "DELETE /compute/v2.1/os-server-groups/10bbfeea-6deb-43b2-a87e-bc37f450dfaa" status: 204 len: 0 microversion: 2.1 time: 0.043493 Mar 05 20:56:56.392512 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1260/2442] 10.222.0.15 () {58 vars in 1265 bytes} [Sat Mar 5 20:56:56 2022] DELETE /compute/v2.1/os-server-groups/10bbfeea-6deb-43b2-a87e-bc37f450dfaa => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:56.399191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c43d192e-5df4-4984-a419-c617203ee452 req-d2fe9ab4-6314-4f7d-9720-d9714594794e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81ff1cf-7bf9-40ae-a814-4465e0f3783e", "tag": "a1950e50-9c39-44c3-af17-454a8fc9713b"}, {"server_uuid": "b8a6900c-db11-4225-b22d-a9ce4efe4ce0", "name": "network-vif-deleted", "tag": "45b7f0b0-889d-474f-9ac1-a67a655d982b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:56.417939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c43d192e-5df4-4984-a419-c617203ee452 req-d2fe9ab4-6314-4f7d-9720-d9714594794e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:56.417939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c43d192e-5df4-4984-a419-c617203ee452 req-d2fe9ab4-6314-4f7d-9720-d9714594794e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:56.451230 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c43d192e-5df4-4984-a419-c617203ee452 req-d2fe9ab4-6314-4f7d-9720-d9714594794e service nova] Creating event network-changed:a1950e50-9c39-44c3-af17-454a8fc9713b for instance d81ff1cf-7bf9-40ae-a814-4465e0f3783e on nch1-master-1 Mar 05 20:56:56.452050 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c43d192e-5df4-4984-a419-c617203ee452 req-d2fe9ab4-6314-4f7d-9720-d9714594794e service nova] Creating event network-vif-deleted:45b7f0b0-889d-474f-9ac1-a67a655d982b for instance b8a6900c-db11-4225-b22d-a9ce4efe4ce0 on nch1-master-1 Mar 05 20:56:56.462518 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c43d192e-5df4-4984-a419-c617203ee452 req-d2fe9ab4-6314-4f7d-9720-d9714594794e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.069083 Mar 05 20:56:56.467204 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1261/2443] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:56.493738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dd07cc4e-69e4-49e8-ac13-e27d4dc53aa4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:56.500467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-9e37d151-aa89-4902-ba64-90f34a538ff6 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Building network info cache for instance {{(pid=141478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 05 20:56:56.532329 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dd07cc4e-69e4-49e8-ac13-e27d4dc53aa4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.055515 Mar 05 20:56:56.554509 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1262/2444] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:56:56 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:56.560514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ebba299-bf89-4284-83d8-fd162f8211ed tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Action: 'create', calling method: .version_select at 0x7fed5c7243a0>, body: {"server_group": {"name": "tempest-server-group-682081174", "policies": ["affinity"]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:56.587268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9ebba299-bf89-4284-83d8-fd162f8211ed tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:56.598737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9ebba299-bf89-4284-83d8-fd162f8211ed tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for user 7e550a9e464a43f696a831eac675623e and project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:56.693744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9ebba299-bf89-4284-83d8-fd162f8211ed tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:56.701985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9ebba299-bf89-4284-83d8-fd162f8211ed tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for user 7e550a9e464a43f696a831eac675623e and project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:56.725011 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ebba299-bf89-4284-83d8-fd162f8211ed tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.168373 Mar 05 20:56:56.732391 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1263/2445] 10.222.0.15 () {60 vars in 1172 bytes} [Sat Mar 5 20:56:56 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:56.740752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9563a174-6a31-4da5-9fac-cfef6615a215 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:56.741618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9563a174-6a31-4da5-9fac-cfef6615a215 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:56.751017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9563a174-6a31-4da5-9fac-cfef6615a215 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:56.752138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9563a174-6a31-4da5-9fac-cfef6615a215 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:56.752715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9563a174-6a31-4da5-9fac-cfef6615a215 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:56.753313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9563a174-6a31-4da5-9fac-cfef6615a215 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:57.134950 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9563a174-6a31-4da5-9fac-cfef6615a215 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:57.143702 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9563a174-6a31-4da5-9fac-cfef6615a215 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1503 microversion: 2.1 time: 0.410132 Mar 05 20:56:57.153248 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1264/2446] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:56 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1503 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:57.162244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d3606b1a-70ee-40f8-ba2c-98804e10ca24 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:57.219877 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d3606b1a-70ee-40f8-ba2c-98804e10ca24 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "DELETE /compute/v2.1/os-server-groups/42000a2c-8730-4c43-826b-48bcd83166b7" status: 204 len: 0 microversion: 2.1 time: 0.049164 Mar 05 20:56:57.220512 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1265/2447] 10.222.0.15 () {58 vars in 1265 bytes} [Sat Mar 5 20:56:57 2022] DELETE /compute/v2.1/os-server-groups/42000a2c-8730-4c43-826b-48bcd83166b7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:57.236792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-731e8dab-bd03-421c-be5d-33e333f051f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:57.237547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-731e8dab-bd03-421c-be5d-33e333f051f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:57.254072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-731e8dab-bd03-421c-be5d-33e333f051f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:57.254560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-731e8dab-bd03-421c-be5d-33e333f051f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:57.259607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-731e8dab-bd03-421c-be5d-33e333f051f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:57.260097 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-731e8dab-bd03-421c-be5d-33e333f051f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:58.100733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-731e8dab-bd03-421c-be5d-33e333f051f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:58.119025 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-731e8dab-bd03-421c-be5d-33e333f051f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.892020 Mar 05 20:56:58.119860 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1266/2448] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:57 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:58.126050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-121a20f2-dcf1-4f2a-b96b-1f26bc8937ac tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:58.138058 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-121a20f2-dcf1-4f2a-b96b-1f26bc8937ac tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.016464 Mar 05 20:56:58.145066 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1267/2449] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:56:58 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:58.146796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d041f1c1-caab-4596-9a79-dd11d62a8787 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:58.147498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d041f1c1-caab-4596-9a79-dd11d62a8787 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:58.154969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d041f1c1-caab-4596-9a79-dd11d62a8787 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:58.155426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d041f1c1-caab-4596-9a79-dd11d62a8787 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:58.156305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d041f1c1-caab-4596-9a79-dd11d62a8787 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:58.156969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d041f1c1-caab-4596-9a79-dd11d62a8787 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:58.171885 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-d041f1c1-caab-4596-9a79-dd11d62a8787 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance b8a6900c-db11-4225-b22d-a9ce4efe4ce0 could not be found. Mar 05 20:56:58.172904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d041f1c1-caab-4596-9a79-dd11d62a8787 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance b8a6900c-db11-4225-b22d-a9ce4efe4ce0 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:56:58.173344 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d041f1c1-caab-4596-9a79-dd11d62a8787 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 404 len: 111 microversion: 2.1 time: 0.033415 Mar 05 20:56:58.173913 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1268/2450] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:58 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:56:58.181552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-548d81ef-126a-4797-bb34-402fac507adf tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Action: 'create', calling method: .version_select at 0x7fed5c64a280>, body: {"server_group": {"name": "tempest-server-group-1044062387", "policies": ["anti-affinity"]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:58.218853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-548d81ef-126a-4797-bb34-402fac507adf tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:58.238230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-548d81ef-126a-4797-bb34-402fac507adf tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for user 7e550a9e464a43f696a831eac675623e and project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:58.345642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-548d81ef-126a-4797-bb34-402fac507adf tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:58.360656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-548d81ef-126a-4797-bb34-402fac507adf tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for user 7e550a9e464a43f696a831eac675623e and project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_groups'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:58.379110 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-548d81ef-126a-4797-bb34-402fac507adf tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.204121 Mar 05 20:56:58.380155 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1269/2451] 10.222.0.15 () {60 vars in 1172 bytes} [Sat Mar 5 20:56:58 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:58.389346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-35a28948-ec75-4e44-98fa-a2036a68ab07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:58.390128 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-35a28948-ec75-4e44-98fa-a2036a68ab07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:58.397350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35a28948-ec75-4e44-98fa-a2036a68ab07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:58.397860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35a28948-ec75-4e44-98fa-a2036a68ab07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:58.398599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35a28948-ec75-4e44-98fa-a2036a68ab07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:58.399037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35a28948-ec75-4e44-98fa-a2036a68ab07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:58.774469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-35a28948-ec75-4e44-98fa-a2036a68ab07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:56:58.783038 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-35a28948-ec75-4e44-98fa-a2036a68ab07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1503 microversion: 2.1 time: 0.401629 Mar 05 20:56:58.787189 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1270/2452] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:58 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1503 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:56:58.803731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-562844548", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "72f55423-ea6d-4438-a149-d5df19f9ecdd"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:58.918942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] validate_networks() for [('72f55423-ea6d-4438-a149-d5df19f9ecdd', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:56:59.178795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-9e37d151-aa89-4902-ba64-90f34a538ff6 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Updating instance_info_cache with network_info: [{"id": "2710cf64-1285-4d3b-8a24-95520a144b8c", "address": "fa:16:3e:7e:1d:4e", "network": {"id": "a0fc1ef5-7d58-4956-8ec7-37c47d9df56c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-172908316-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "933b162d4a3044f38bed8c339cc621ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2710cf64-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 05 20:56:59.207733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e37d151-aa89-4902-ba64-90f34a538ff6 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Releasing lock "refresh_cache-429f5dde-84d7-4bd3-a37a-066ac19fdc53" {{(pid=141478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 20:56:59.210696 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9e37d151-aa89-4902-ba64-90f34a538ff6 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "POST /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53/action" status: 202 len: 0 microversion: 2.1 time: 5.542919 Mar 05 20:56:59.212161 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1183/2453] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:56:53 2022] POST /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53/action => generated 0 bytes in 5546 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Mar 05 20:56:59.221982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-afdc3397-4a98-4e71-a0e0-e82380151f40 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:59.280457 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-afdc3397-4a98-4e71-a0e0-e82380151f40 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "DELETE /compute/v2.1/os-server-groups/72633088-44cd-4da5-9dc3-e31bbd5a224a" status: 204 len: 0 microversion: 2.1 time: 0.066053 Mar 05 20:56:59.283796 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1184/2454] 10.222.0.15 () {58 vars in 1265 bytes} [Sat Mar 5 20:56:59 2022] DELETE /compute/v2.1/os-server-groups/72633088-44cd-4da5-9dc3-e31bbd5a224a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:56:59.297474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-86db9b53-675f-4c96-a4d7-79ca0500ff02 req-a6bf49dd-72c4-41b4-9469-a0491ec010bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429f5dde-84d7-4bd3-a37a-066ac19fdc53", "tag": "2710cf64-1285-4d3b-8a24-95520a144b8c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:59.318082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-86db9b53-675f-4c96-a4d7-79ca0500ff02 req-a6bf49dd-72c4-41b4-9469-a0491ec010bf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:59.321131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-86db9b53-675f-4c96-a4d7-79ca0500ff02 req-a6bf49dd-72c4-41b4-9469-a0491ec010bf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:59.346098 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-86db9b53-675f-4c96-a4d7-79ca0500ff02 req-a6bf49dd-72c4-41b4-9469-a0491ec010bf service nova] Creating event network-changed:2710cf64-1285-4d3b-8a24-95520a144b8c for instance 429f5dde-84d7-4bd3-a37a-066ac19fdc53 on nch2-master-1 Mar 05 20:56:59.364340 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-86db9b53-675f-4c96-a4d7-79ca0500ff02 req-a6bf49dd-72c4-41b4-9469-a0491ec010bf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075752 Mar 05 20:56:59.366547 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1185/2455] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:56:59.378159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b2ca1dbc-d3b5-4ef0-9d3d-3df9aaccfda8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:56:59.382263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b2ca1dbc-d3b5-4ef0-9d3d-3df9aaccfda8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:59.394921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2ca1dbc-d3b5-4ef0-9d3d-3df9aaccfda8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:59.397787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2ca1dbc-d3b5-4ef0-9d3d-3df9aaccfda8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:59.401500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2ca1dbc-d3b5-4ef0-9d3d-3df9aaccfda8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:59.405769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2ca1dbc-d3b5-4ef0-9d3d-3df9aaccfda8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:59.708814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:56:59.709359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:56:59.710146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:56:59.710653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:56:59.711196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:56:59.726190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:59.726695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:59.727462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:59.727942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:59.778625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:56:59.784941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for user e8b67d8bbe9a44898a889826e12ffb0b and project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:56:59.811473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:56:59.815182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:56:59.950795 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8e49fa18-7d58-4ef9-9adb-75c66f8e30c4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.155479 Mar 05 20:56:59.951993 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1271/2456] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:56:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:56:59.957120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Action: 'action', calling method: .version_select at 0x7fed5f0f9ca0>, body: {"addFloatingIp": {"address": "172.35.0.115"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:56:59.958548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:56:59.967410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:59.970294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:56:59.971344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:56:59.977213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:00.139027 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Acquired lock "refresh_cache-1567b85e-c179-4c65-9ec1-47b86cdba579" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 20:57:00.323374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b2ca1dbc-d3b5-4ef0-9d3d-3df9aaccfda8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:00.336638 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b2ca1dbc-d3b5-4ef0-9d3d-3df9aaccfda8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.964220 Mar 05 20:57:00.337924 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1186/2457] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:56:59 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:00.346909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b2178965-493d-47b2-adc9-2293c15b7ef2 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:00.382947 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b2178965-493d-47b2-adc9-2293c15b7ef2 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.043690 Mar 05 20:57:00.384964 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1187/2458] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:57:00 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:00.390533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2368e6cd-6150-4b34-9f16-557d2fdced07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:00.391478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2368e6cd-6150-4b34-9f16-557d2fdced07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:00.410142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2368e6cd-6150-4b34-9f16-557d2fdced07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:00.410604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2368e6cd-6150-4b34-9f16-557d2fdced07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:00.417579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2368e6cd-6150-4b34-9f16-557d2fdced07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:00.418121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2368e6cd-6150-4b34-9f16-557d2fdced07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:00.940056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2368e6cd-6150-4b34-9f16-557d2fdced07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:00.952649 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2368e6cd-6150-4b34-9f16-557d2fdced07 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1503 microversion: 2.1 time: 0.565245 Mar 05 20:57:00.953772 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1188/2459] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:00 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1503 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:00.971036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-62535040-7911-41a8-9999-487c7e99a91e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:00.971954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-62535040-7911-41a8-9999-487c7e99a91e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:00.980275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62535040-7911-41a8-9999-487c7e99a91e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:00.981051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62535040-7911-41a8-9999-487c7e99a91e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:00.982083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62535040-7911-41a8-9999-487c7e99a91e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:00.982714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62535040-7911-41a8-9999-487c7e99a91e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:01.146419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-62535040-7911-41a8-9999-487c7e99a91e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:01.164859 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-62535040-7911-41a8-9999-487c7e99a91e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1210 microversion: 2.1 time: 0.195041 Mar 05 20:57:01.166046 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1189/2460] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:00 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1210 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:01.184430 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1141248346", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "5a4b4054-c218-4ff5-8873-f67c4a707764"}]}, "os:scheduler_hints": {"group": "c4c6220d-c94b-401f-a643-d6b70bed83c9"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:01.301941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] validate_networks() for [('5a4b4054-c218-4ff5-8873-f67c4a707764', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:57:02.419358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:57:02.420515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:57:02.421189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:57:02.421770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:57:02.422352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:57:02.442431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:02.444001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:02.445871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:02.446572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:02.468742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:57:02.476984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for user 7e550a9e464a43f696a831eac675623e and project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:57:02.492732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:57:02.495629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:57:02.543020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=141478) is_qfd_populated /opt/stack/nova/nova/quota.py:1248}} Mar 05 20:57:02.570099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_group_members'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:57:02.581661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for user 7e550a9e464a43f696a831eac675623e and project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_group_members'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:57:02.664519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_group_members'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:57:02.672667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Getting quotas for user 7e550a9e464a43f696a831eac675623e and project 3e7d92a8aac446c19a53879985b3aa08. Resources: {'server_group_members'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:57:02.720145 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fad6f86f-3d2d-467e-b9d1-5c1b5574c93f tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.550585 Mar 05 20:57:02.721753 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1190/2461] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:57:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:57:02.729674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d84595a1-b4b8-4942-a377-c2871c44d22a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:02.730892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d84595a1-b4b8-4942-a377-c2871c44d22a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:02.738384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d84595a1-b4b8-4942-a377-c2871c44d22a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:02.739627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d84595a1-b4b8-4942-a377-c2871c44d22a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:02.741597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d84595a1-b4b8-4942-a377-c2871c44d22a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:02.743105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d84595a1-b4b8-4942-a377-c2871c44d22a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:03.072326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d84595a1-b4b8-4942-a377-c2871c44d22a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:03.084634 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d84595a1-b4b8-4942-a377-c2871c44d22a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.361204 Mar 05 20:57:03.084856 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1191/2462] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:02 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:03.092649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aa1a79a8-fccb-4a6b-be03-d0e05b4e0714 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:03.093285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aa1a79a8-fccb-4a6b-be03-d0e05b4e0714 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:03.103131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa1a79a8-fccb-4a6b-be03-d0e05b4e0714 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:03.108712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa1a79a8-fccb-4a6b-be03-d0e05b4e0714 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:03.111402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa1a79a8-fccb-4a6b-be03-d0e05b4e0714 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:03.112159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa1a79a8-fccb-4a6b-be03-d0e05b4e0714 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:03.412855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aa1a79a8-fccb-4a6b-be03-d0e05b4e0714 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:03.432624 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aa1a79a8-fccb-4a6b-be03-d0e05b4e0714 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1503 microversion: 2.1 time: 0.343972 Mar 05 20:57:03.433977 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1192/2463] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:03 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1503 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:03.447534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d2019f49-e65a-4002-b3c4-c01cbef57abe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:03.448196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d2019f49-e65a-4002-b3c4-c01cbef57abe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:03.455800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2019f49-e65a-4002-b3c4-c01cbef57abe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:03.456439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2019f49-e65a-4002-b3c4-c01cbef57abe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:03.457383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2019f49-e65a-4002-b3c4-c01cbef57abe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:03.457906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2019f49-e65a-4002-b3c4-c01cbef57abe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:03.534991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d2019f49-e65a-4002-b3c4-c01cbef57abe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:03.550362 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d2019f49-e65a-4002-b3c4-c01cbef57abe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1272 microversion: 2.1 time: 0.113580 Mar 05 20:57:03.552978 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1193/2464] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:03 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1272 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:03.585823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-943daf83-9707-4764-a8a5-78b1eb315b78 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:03.588168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-943daf83-9707-4764-a8a5-78b1eb315b78 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:03.595830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-943daf83-9707-4764-a8a5-78b1eb315b78 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:03.596228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-943daf83-9707-4764-a8a5-78b1eb315b78 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:03.597021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-943daf83-9707-4764-a8a5-78b1eb315b78 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:03.597474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-943daf83-9707-4764-a8a5-78b1eb315b78 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:03.675300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-943daf83-9707-4764-a8a5-78b1eb315b78 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e550a9e464a43f696a831eac675623e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e7d92a8aac446c19a53879985b3aa08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:03.685365 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-943daf83-9707-4764-a8a5-78b1eb315b78 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 200 len: 1209 microversion: 2.1 time: 0.107936 Mar 05 20:57:03.704749 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1194/2465] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:03 2022] GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 1209 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:04.106250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1e3f8092-b7aa-40a4-b1bd-b93f9bcd03ff tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:04.107191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1e3f8092-b7aa-40a4-b1bd-b93f9bcd03ff tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:04.122588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e3f8092-b7aa-40a4-b1bd-b93f9bcd03ff tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:04.123350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e3f8092-b7aa-40a4-b1bd-b93f9bcd03ff tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:04.124522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e3f8092-b7aa-40a4-b1bd-b93f9bcd03ff tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:04.129866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e3f8092-b7aa-40a4-b1bd-b93f9bcd03ff tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:04.692486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1e3f8092-b7aa-40a4-b1bd-b93f9bcd03ff tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:04.703084 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1e3f8092-b7aa-40a4-b1bd-b93f9bcd03ff tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.600966 Mar 05 20:57:04.704054 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1195/2466] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:04 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:57:04.712105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ad7de87f-d411-449d-aeb8-795153db8e42 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:04.712947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ad7de87f-d411-449d-aeb8-795153db8e42 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:04.719758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad7de87f-d411-449d-aeb8-795153db8e42 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:04.720261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad7de87f-d411-449d-aeb8-795153db8e42 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:04.721448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad7de87f-d411-449d-aeb8-795153db8e42 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:04.721967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad7de87f-d411-449d-aeb8-795153db8e42 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:05.171333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad7de87f-d411-449d-aeb8-795153db8e42 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:05.186765 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ad7de87f-d411-449d-aeb8-795153db8e42 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1493 microversion: 2.1 time: 0.481066 Mar 05 20:57:05.195891 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1196/2467] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:04 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1493 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:05.213673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f81d074-94c1-4def-bc9c-d7571f82b3f7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:05.216027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5f81d074-94c1-4def-bc9c-d7571f82b3f7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:05.245572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f81d074-94c1-4def-bc9c-d7571f82b3f7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:05.246556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f81d074-94c1-4def-bc9c-d7571f82b3f7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:05.248059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f81d074-94c1-4def-bc9c-d7571f82b3f7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:05.248836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f81d074-94c1-4def-bc9c-d7571f82b3f7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:05.910359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5f81d074-94c1-4def-bc9c-d7571f82b3f7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:05.921112 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5f81d074-94c1-4def-bc9c-d7571f82b3f7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1314 microversion: 2.1 time: 0.721960 Mar 05 20:57:05.935096 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1197/2468] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:05 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:05.949976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d8279cfc-4996-4b81-b983-efddfce27bc4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:05.950605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d8279cfc-4996-4b81-b983-efddfce27bc4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:05.967714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d8279cfc-4996-4b81-b983-efddfce27bc4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:05.968471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d8279cfc-4996-4b81-b983-efddfce27bc4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:05.969837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d8279cfc-4996-4b81-b983-efddfce27bc4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:05.970549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d8279cfc-4996-4b81-b983-efddfce27bc4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:06.456484 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.network.neutron [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] re-assign floating IP 172.35.0.115 from instance 429f5dde-84d7-4bd3-a37a-066ac19fdc53 Mar 05 20:57:06.487604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Building network info cache for instance {{(pid=141479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 05 20:57:06.694299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d8279cfc-4996-4b81-b983-efddfce27bc4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e550a9e464a43f696a831eac675623e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e7d92a8aac446c19a53879985b3aa08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:06.707091 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d8279cfc-4996-4b81-b983-efddfce27bc4 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 200 len: 1313 microversion: 2.1 time: 0.770314 Mar 05 20:57:06.722289 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1198/2469] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:05 2022] GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 1313 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:07.151385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b70cfe4-5ab9-4fac-96f9-38aebf1ac568 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Action: 'create', calling method: .version_select at 0x7fed5c5dc790>, body: {"keypair": {"name": "tempest-keypair-369340614"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:07.202909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-4b70cfe4-5ab9-4fac-96f9-38aebf1ac568 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Getting quotas for project f2bfa48c6cd94b69aa05b9cfd60c4bc3. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:57:07.219644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-4b70cfe4-5ab9-4fac-96f9-38aebf1ac568 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Getting quotas for user 9e7510851e9a44fba867de9245a59391 and project f2bfa48c6cd94b69aa05b9cfd60c4bc3. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:57:07.519034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-4b70cfe4-5ab9-4fac-96f9-38aebf1ac568 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Getting quotas for project f2bfa48c6cd94b69aa05b9cfd60c4bc3. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:57:07.527247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-4b70cfe4-5ab9-4fac-96f9-38aebf1ac568 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Getting quotas for user 9e7510851e9a44fba867de9245a59391 and project f2bfa48c6cd94b69aa05b9cfd60c4bc3. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:57:07.559569 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4b70cfe4-5ab9-4fac-96f9-38aebf1ac568 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.835052 Mar 05 20:57:07.568282 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1199/2470] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:57:06 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:07.574625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1711aa07-3da8-498a-986a-497bfdb6c15f tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '.version_select at 0x7fed5c52bee0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:07.579406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1711aa07-3da8-498a-986a-497bfdb6c15f tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:07.580201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1711aa07-3da8-498a-986a-497bfdb6c15f tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:07.593515 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1711aa07-3da8-498a-986a-497bfdb6c15f tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.023429 Mar 05 20:57:07.594792 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1200/2471] 10.222.0.15 () {58 vars in 1142 bytes} [Sat Mar 5 20:57:07 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:07.603354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7986846a-f82e-4373-8487-8c66c3263cfa tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:07.604526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7986846a-f82e-4373-8487-8c66c3263cfa tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:07.616938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7986846a-f82e-4373-8487-8c66c3263cfa tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:07.617730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7986846a-f82e-4373-8487-8c66c3263cfa tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:07.619144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7986846a-f82e-4373-8487-8c66c3263cfa tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:07.619703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7986846a-f82e-4373-8487-8c66c3263cfa tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:07.676211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Updating instance_info_cache with network_info: [{"id": "2710cf64-1285-4d3b-8a24-95520a144b8c", "address": "fa:16:3e:7e:1d:4e", "network": {"id": "a0fc1ef5-7d58-4956-8ec7-37c47d9df56c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-172908316-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "933b162d4a3044f38bed8c339cc621ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2710cf64-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 05 20:57:07.695184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Building network info cache for instance {{(pid=141479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 05 20:57:08.007214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7986846a-f82e-4373-8487-8c66c3263cfa tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:08.017478 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7986846a-f82e-4373-8487-8c66c3263cfa tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.420452 Mar 05 20:57:08.020546 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1201/2472] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:07 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:08.048172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-08df0246-005a-4525-be87-eba600c27fc3 req-41694c40-59fb-41f7-9955-a2caa9f09a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429f5dde-84d7-4bd3-a37a-066ac19fdc53", "tag": "2710cf64-1285-4d3b-8a24-95520a144b8c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:08.071402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-08df0246-005a-4525-be87-eba600c27fc3 req-41694c40-59fb-41f7-9955-a2caa9f09a20 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:08.072177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-08df0246-005a-4525-be87-eba600c27fc3 req-41694c40-59fb-41f7-9955-a2caa9f09a20 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:08.093574 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-08df0246-005a-4525-be87-eba600c27fc3 req-41694c40-59fb-41f7-9955-a2caa9f09a20 service nova] Creating event network-changed:2710cf64-1285-4d3b-8a24-95520a144b8c for instance 429f5dde-84d7-4bd3-a37a-066ac19fdc53 on nch2-master-1 Mar 05 20:57:08.113052 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-08df0246-005a-4525-be87-eba600c27fc3 req-41694c40-59fb-41f7-9955-a2caa9f09a20 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089705 Mar 05 20:57:08.114134 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1202/2473] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:08.120067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c636fea-3fc6-4592-a4ba-770fa7fbbad0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:08.120846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c636fea-3fc6-4592-a4ba-770fa7fbbad0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:08.138532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c636fea-3fc6-4592-a4ba-770fa7fbbad0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:08.144554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c636fea-3fc6-4592-a4ba-770fa7fbbad0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:08.145738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c636fea-3fc6-4592-a4ba-770fa7fbbad0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:08.146982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c636fea-3fc6-4592-a4ba-770fa7fbbad0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:08.711399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8c636fea-3fc6-4592-a4ba-770fa7fbbad0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:08.730071 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8c636fea-3fc6-4592-a4ba-770fa7fbbad0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1314 microversion: 2.1 time: 0.614314 Mar 05 20:57:08.731167 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1203/2474] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:08 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:08.747207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3fca5e45-2aaa-4aeb-ada5-0164b8e122cd tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:08.748512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3fca5e45-2aaa-4aeb-ada5-0164b8e122cd tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:08.759986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3fca5e45-2aaa-4aeb-ada5-0164b8e122cd tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:08.760835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3fca5e45-2aaa-4aeb-ada5-0164b8e122cd tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:08.767118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3fca5e45-2aaa-4aeb-ada5-0164b8e122cd tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:08.767913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3fca5e45-2aaa-4aeb-ada5-0164b8e122cd tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:09.521766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Updating instance_info_cache with network_info: [{"id": "7d12cb43-6b68-44ec-be62-881ac11e38d1", "address": "fa:16:3e:16:73:6c", "network": {"id": "a0fc1ef5-7d58-4956-8ec7-37c47d9df56c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-172908316-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "933b162d4a3044f38bed8c339cc621ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7d12cb43-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 05 20:57:09.544830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Releasing lock "refresh_cache-1567b85e-c179-4c65-9ec1-47b86cdba579" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 20:57:09.550063 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5dd4161b-42c6-44b4-8e10-cfdd8f303744 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "POST /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579/action" status: 202 len: 0 microversion: 2.1 time: 9.594175 Mar 05 20:57:09.554198 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1272/2475] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:56:59 2022] POST /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579/action => generated 0 bytes in 9601 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 05 20:57:09.572091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1ccf53cf-66fb-44d1-9070-ab07b6eebf5c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:09.573909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1ccf53cf-66fb-44d1-9070-ab07b6eebf5c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:09.594514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ccf53cf-66fb-44d1-9070-ab07b6eebf5c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:09.596296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ccf53cf-66fb-44d1-9070-ab07b6eebf5c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:09.598842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ccf53cf-66fb-44d1-9070-ab07b6eebf5c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:09.600558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ccf53cf-66fb-44d1-9070-ab07b6eebf5c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:09.650596 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3fca5e45-2aaa-4aeb-ada5-0164b8e122cd tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1644 microversion: 2.1 time: 0.917919 Mar 05 20:57:09.663617 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1204/2476] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:08 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1644 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:09.686120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-be9bc28c-2ad2-424c-a397-d88dbe3c1d92 req-3d8bb469-8e4e-485a-af08-f5ebd16febe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfc91a5-551d-4094-992f-f0efeefc3861", "tag": "5273f935-dd07-4fd5-a9bc-622b643001cf"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:09.708129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-be9bc28c-2ad2-424c-a397-d88dbe3c1d92 req-3d8bb469-8e4e-485a-af08-f5ebd16febe6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:09.710304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-be9bc28c-2ad2-424c-a397-d88dbe3c1d92 req-3d8bb469-8e4e-485a-af08-f5ebd16febe6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:09.754410 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-be9bc28c-2ad2-424c-a397-d88dbe3c1d92 req-3d8bb469-8e4e-485a-af08-f5ebd16febe6 service nova] Creating event network-changed:5273f935-dd07-4fd5-a9bc-622b643001cf for instance 9dfc91a5-551d-4094-992f-f0efeefc3861 on nch1-master-1 Mar 05 20:57:09.768912 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-be9bc28c-2ad2-424c-a397-d88dbe3c1d92 req-3d8bb469-8e4e-485a-af08-f5ebd16febe6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103848 Mar 05 20:57:09.771032 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1205/2477] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:09.799501 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-57a6315f-1024-4a5f-8f30-1f42f583c760 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:09.801757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-57a6315f-1024-4a5f-8f30-1f42f583c760 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:09.822277 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-57a6315f-1024-4a5f-8f30-1f42f583c760 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:09.822778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-57a6315f-1024-4a5f-8f30-1f42f583c760 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:09.823816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-57a6315f-1024-4a5f-8f30-1f42f583c760 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:09.827278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-57a6315f-1024-4a5f-8f30-1f42f583c760 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:10.026778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1ccf53cf-66fb-44d1-9070-ab07b6eebf5c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e550a9e464a43f696a831eac675623e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e7d92a8aac446c19a53879985b3aa08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:10.035357 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1ccf53cf-66fb-44d1-9070-ab07b6eebf5c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 200 len: 1313 microversion: 2.1 time: 0.477905 Mar 05 20:57:10.045248 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1273/2478] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:09 2022] GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:10.050662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91f537fc-9c0b-4858-a37f-e6ec1217d90d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Action: 'action', calling method: .version_select at 0x7fed5f0f9c10>, body: {"removeFloatingIp": {"address": "172.35.0.115"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:10.441917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91f537fc-9c0b-4858-a37f-e6ec1217d90d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:10.446303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-57a6315f-1024-4a5f-8f30-1f42f583c760 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:10.449188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91f537fc-9c0b-4858-a37f-e6ec1217d90d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:10.449707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91f537fc-9c0b-4858-a37f-e6ec1217d90d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:10.450566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91f537fc-9c0b-4858-a37f-e6ec1217d90d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:10.451112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91f537fc-9c0b-4858-a37f-e6ec1217d90d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:10.476038 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-57a6315f-1024-4a5f-8f30-1f42f583c760 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.672321 Mar 05 20:57:10.490457 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1206/2479] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:09 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:10.506626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3dba021e-8f17-468f-bb53-8b2ba69f6bfe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:10.515191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3dba021e-8f17-468f-bb53-8b2ba69f6bfe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:10.529244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3dba021e-8f17-468f-bb53-8b2ba69f6bfe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:10.531371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3dba021e-8f17-468f-bb53-8b2ba69f6bfe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:10.533187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3dba021e-8f17-468f-bb53-8b2ba69f6bfe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:10.534338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3dba021e-8f17-468f-bb53-8b2ba69f6bfe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:10.940942 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-91f537fc-9c0b-4858-a37f-e6ec1217d90d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] HTTP exception thrown: Floating IP 172.35.0.115 is not associated with instance 429f5dde-84d7-4bd3-a37a-066ac19fdc53. Mar 05 20:57:10.941976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91f537fc-9c0b-4858-a37f-e6ec1217d90d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Returning 409 to user: Floating IP 172.35.0.115 is not associated with instance 429f5dde-84d7-4bd3-a37a-066ac19fdc53. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:10.945576 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91f537fc-9c0b-4858-a37f-e6ec1217d90d tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "POST /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53/action" status: 409 len: 146 microversion: 2.1 time: 0.898798 Mar 05 20:57:10.946378 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1274/2480] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:57:10 2022] POST /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53/action => generated 146 bytes in 900 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:57:10.952796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1253918011", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "93578ff8-1ca6-4e6e-b4ae-025cd8c9d397"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:11.030140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] validate_networks() for [('93578ff8-1ca6-4e6e-b4ae-025cd8c9d397', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:57:11.187160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3dba021e-8f17-468f-bb53-8b2ba69f6bfe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:11.220675 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3dba021e-8f17-468f-bb53-8b2ba69f6bfe tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1314 microversion: 2.1 time: 0.726564 Mar 05 20:57:11.222844 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1207/2481] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:10 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:11.230487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-724ea518-6047-4f7d-ac37-69909350e239 req-77374f65-9ce5-41f9-8ac6-687672f7400f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1567b85e-c179-4c65-9ec1-47b86cdba579", "tag": "7d12cb43-6b68-44ec-be62-881ac11e38d1"}, {"name": "network-changed", "server_uuid": "af3b961b-384e-4246-8bee-f44c06d45447", "tag": "bce80fbd-c4e1-4382-be80-b1be28c5138e"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:11.251579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-724ea518-6047-4f7d-ac37-69909350e239 req-77374f65-9ce5-41f9-8ac6-687672f7400f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:11.252881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-724ea518-6047-4f7d-ac37-69909350e239 req-77374f65-9ce5-41f9-8ac6-687672f7400f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:11.303578 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-724ea518-6047-4f7d-ac37-69909350e239 req-77374f65-9ce5-41f9-8ac6-687672f7400f service nova] Creating event network-changed:7d12cb43-6b68-44ec-be62-881ac11e38d1 for instance 1567b85e-c179-4c65-9ec1-47b86cdba579 on nch2-master-1 Mar 05 20:57:11.304264 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-724ea518-6047-4f7d-ac37-69909350e239 req-77374f65-9ce5-41f9-8ac6-687672f7400f service nova] Creating event network-changed:bce80fbd-c4e1-4382-be80-b1be28c5138e for instance af3b961b-384e-4246-8bee-f44c06d45447 on nch1-master-1 Mar 05 20:57:11.324675 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-724ea518-6047-4f7d-ac37-69909350e239 req-77374f65-9ce5-41f9-8ac6-687672f7400f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.099838 Mar 05 20:57:11.327237 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1208/2482] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:11.338973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b719f54-1e69-464c-85ac-ad5162d9981e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Action: 'action', calling method: .version_select at 0x7fed5f110ee0>, body: {"removeFloatingIp": {"address": "172.35.0.115"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:11.744037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4b719f54-1e69-464c-85ac-ad5162d9981e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:11.753317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b719f54-1e69-464c-85ac-ad5162d9981e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:11.754404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b719f54-1e69-464c-85ac-ad5162d9981e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:11.755942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b719f54-1e69-464c-85ac-ad5162d9981e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:11.757022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b719f54-1e69-464c-85ac-ad5162d9981e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:12.168019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:57:12.169578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:57:12.171770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:57:12.172533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:57:12.173054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:57:12.191829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:12.192732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:12.194687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:12.196180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:12.220918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Getting quotas for project 77c35382c7454a51ab1fbd37f9157ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:57:12.227875 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Getting quotas for user 4ff43fd6998d454887c5aae39464ab72 and project 77c35382c7454a51ab1fbd37f9157ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:57:12.244678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:57:12.247015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:57:12.306138 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e789e882-1a37-40cd-b1df-1450f28abe8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.358230 Mar 05 20:57:12.307174 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1275/2483] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:57:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:57:12.312340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2338cd9e-b666-42a2-b468-df99206ad458 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:12.313303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2338cd9e-b666-42a2-b468-df99206ad458 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:12.320219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2338cd9e-b666-42a2-b468-df99206ad458 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:12.320964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2338cd9e-b666-42a2-b468-df99206ad458 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:12.322020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2338cd9e-b666-42a2-b468-df99206ad458 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:12.322660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2338cd9e-b666-42a2-b468-df99206ad458 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:12.574103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2338cd9e-b666-42a2-b468-df99206ad458 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e550a9e464a43f696a831eac675623e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e7d92a8aac446c19a53879985b3aa08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:12.591558 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2338cd9e-b666-42a2-b468-df99206ad458 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 200 len: 1313 microversion: 2.1 time: 0.282982 Mar 05 20:57:12.592728 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1276/2484] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:12 2022] GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:12.598185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-de3ff66c-e3d0-4966-a273-efc878afa3d4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:12.599307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-de3ff66c-e3d0-4966-a273-efc878afa3d4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:12.606728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de3ff66c-e3d0-4966-a273-efc878afa3d4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:12.607475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de3ff66c-e3d0-4966-a273-efc878afa3d4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:12.608469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de3ff66c-e3d0-4966-a273-efc878afa3d4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:12.609073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de3ff66c-e3d0-4966-a273-efc878afa3d4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:12.747863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b719f54-1e69-464c-85ac-ad5162d9981e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Acquired lock "refresh_cache-1567b85e-c179-4c65-9ec1-47b86cdba579" {{(pid=141478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 20:57:12.926928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-de3ff66c-e3d0-4966-a273-efc878afa3d4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:12.937238 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-de3ff66c-e3d0-4966-a273-efc878afa3d4 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.343255 Mar 05 20:57:12.938787 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1277/2485] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:12 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:12.945864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "cef49219-74b2-4998-a1b8-20eff7615b33"}], "security_groups": [{"name": "tempest-securitygroup--1604065866"}], "key_name": "tempest-keypair-369340614", "user_data": "}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:13.111379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] validate_networks() for [('cef49219-74b2-4998-a1b8-20eff7615b33', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:57:13.725992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:57:13.726591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:57:13.726963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:57:13.727615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:57:13.728065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:57:13.737109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:13.737498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:13.738308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:13.738751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:13.756730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Getting quotas for project f2bfa48c6cd94b69aa05b9cfd60c4bc3. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:57:13.761892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Getting quotas for user 9e7510851e9a44fba867de9245a59391 and project f2bfa48c6cd94b69aa05b9cfd60c4bc3. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:57:13.775196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:57:13.777697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:57:13.825163 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2a29815a-de49-4066-9186-7ef67d4de1bb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.885045 Mar 05 20:57:13.826045 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1278/2486] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:57:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:57:13.830273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6a40b7c3-e93e-4792-9433-6d6d6311326b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:13.831126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6a40b7c3-e93e-4792-9433-6d6d6311326b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:13.838164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a40b7c3-e93e-4792-9433-6d6d6311326b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:13.838757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a40b7c3-e93e-4792-9433-6d6d6311326b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:13.839634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a40b7c3-e93e-4792-9433-6d6d6311326b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:13.840289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a40b7c3-e93e-4792-9433-6d6d6311326b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:14.101360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6a40b7c3-e93e-4792-9433-6d6d6311326b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:14.112134 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6a40b7c3-e93e-4792-9433-6d6d6311326b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1314 microversion: 2.1 time: 0.285194 Mar 05 20:57:14.125114 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1279/2487] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:13 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:14.131619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bc6ce858-4eb6-4603-b617-2acd9b7a1ad2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:14.132608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bc6ce858-4eb6-4603-b617-2acd9b7a1ad2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:14.143043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc6ce858-4eb6-4603-b617-2acd9b7a1ad2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:14.143754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc6ce858-4eb6-4603-b617-2acd9b7a1ad2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:14.145180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc6ce858-4eb6-4603-b617-2acd9b7a1ad2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:14.146668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc6ce858-4eb6-4603-b617-2acd9b7a1ad2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:14.229563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bc6ce858-4eb6-4603-b617-2acd9b7a1ad2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:14.237631 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bc6ce858-4eb6-4603-b617-2acd9b7a1ad2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1269 microversion: 2.1 time: 0.110991 Mar 05 20:57:14.247938 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1280/2488] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:14 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1269 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:14.253519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-1dee9978-7f4a-43f4-9189-585140f5379e req-605d1433-2a6c-4e35-82d7-b5325a56aa56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3b961b-384e-4246-8bee-f44c06d45447", "name": "network-vif-plugged", "status": "completed", "tag": "bce80fbd-c4e1-4382-be80-b1be28c5138e"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:14.262569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1dee9978-7f4a-43f4-9189-585140f5379e req-605d1433-2a6c-4e35-82d7-b5325a56aa56 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:14.263018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1dee9978-7f4a-43f4-9189-585140f5379e req-605d1433-2a6c-4e35-82d7-b5325a56aa56 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:14.274889 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-1dee9978-7f4a-43f4-9189-585140f5379e req-605d1433-2a6c-4e35-82d7-b5325a56aa56 service nova] Creating event network-vif-plugged:bce80fbd-c4e1-4382-be80-b1be28c5138e for instance af3b961b-384e-4246-8bee-f44c06d45447 on nch1-master-1 Mar 05 20:57:14.280316 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-1dee9978-7f4a-43f4-9189-585140f5379e req-605d1433-2a6c-4e35-82d7-b5325a56aa56 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030777 Mar 05 20:57:14.281165 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1281/2489] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:14.289379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ff15de42-55b6-4e58-af92-e483b4c6f82a tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:14.290159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ff15de42-55b6-4e58-af92-e483b4c6f82a tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:14.296821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff15de42-55b6-4e58-af92-e483b4c6f82a tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:14.297279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff15de42-55b6-4e58-af92-e483b4c6f82a tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:14.298074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff15de42-55b6-4e58-af92-e483b4c6f82a tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:14.298519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff15de42-55b6-4e58-af92-e483b4c6f82a tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:14.666386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-4b719f54-1e69-464c-85ac-ad5162d9981e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Building network info cache for instance {{(pid=141478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 05 20:57:14.842582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ff15de42-55b6-4e58-af92-e483b4c6f82a tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e550a9e464a43f696a831eac675623e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e7d92a8aac446c19a53879985b3aa08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:14.851617 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ff15de42-55b6-4e58-af92-e483b4c6f82a tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 200 len: 1313 microversion: 2.1 time: 0.566319 Mar 05 20:57:14.852329 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1282/2490] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:14 2022] GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:14.867002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-acefd21c-36e6-4166-959c-a04fc5db21dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:14.868028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-acefd21c-36e6-4166-959c-a04fc5db21dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:14.875157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acefd21c-36e6-4166-959c-a04fc5db21dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:14.875921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acefd21c-36e6-4166-959c-a04fc5db21dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:14.876945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acefd21c-36e6-4166-959c-a04fc5db21dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:14.878290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acefd21c-36e6-4166-959c-a04fc5db21dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:14.960988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-acefd21c-36e6-4166-959c-a04fc5db21dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:14.971416 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-acefd21c-36e6-4166-959c-a04fc5db21dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1277 microversion: 2.1 time: 0.108454 Mar 05 20:57:14.972645 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1283/2491] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:14 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:14.985257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e6849da7-a405-4a4b-8a18-61b0f85c648b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:14.985880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e6849da7-a405-4a4b-8a18-61b0f85c648b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:14.993525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6849da7-a405-4a4b-8a18-61b0f85c648b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:14.994217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6849da7-a405-4a4b-8a18-61b0f85c648b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:14.995291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6849da7-a405-4a4b-8a18-61b0f85c648b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:14.995923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6849da7-a405-4a4b-8a18-61b0f85c648b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:15.171714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e6849da7-a405-4a4b-8a18-61b0f85c648b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:15.194314 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e6849da7-a405-4a4b-8a18-61b0f85c648b tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.220421 Mar 05 20:57:15.210159 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1284/2492] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:14 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:15.215049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-635a7d1f-6572-4190-b6ad-c74cdb856648 req-11953f84-cbad-4bb5-b748-f456a9780a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1567b85e-c179-4c65-9ec1-47b86cdba579", "tag": "7d12cb43-6b68-44ec-be62-881ac11e38d1"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:15.226592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-635a7d1f-6572-4190-b6ad-c74cdb856648 req-11953f84-cbad-4bb5-b748-f456a9780a6b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:15.227222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-635a7d1f-6572-4190-b6ad-c74cdb856648 req-11953f84-cbad-4bb5-b748-f456a9780a6b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:15.242670 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-635a7d1f-6572-4190-b6ad-c74cdb856648 req-11953f84-cbad-4bb5-b748-f456a9780a6b service nova] Creating event network-changed:7d12cb43-6b68-44ec-be62-881ac11e38d1 for instance 1567b85e-c179-4c65-9ec1-47b86cdba579 on nch2-master-1 Mar 05 20:57:15.251032 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-635a7d1f-6572-4190-b6ad-c74cdb856648 req-11953f84-cbad-4bb5-b748-f456a9780a6b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048002 Mar 05 20:57:15.252960 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1285/2493] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:15.259909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d71d86e7-7f1b-4c0b-9c15-f02ea6d4d48f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:15.261125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d71d86e7-7f1b-4c0b-9c15-f02ea6d4d48f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:15.272914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d71d86e7-7f1b-4c0b-9c15-f02ea6d4d48f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:15.273792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d71d86e7-7f1b-4c0b-9c15-f02ea6d4d48f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:15.275066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d71d86e7-7f1b-4c0b-9c15-f02ea6d4d48f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:15.275965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d71d86e7-7f1b-4c0b-9c15-f02ea6d4d48f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:15.517424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d71d86e7-7f1b-4c0b-9c15-f02ea6d4d48f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:15.527534 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d71d86e7-7f1b-4c0b-9c15-f02ea6d4d48f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1314 microversion: 2.1 time: 0.272678 Mar 05 20:57:15.528388 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1286/2494] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:15 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:15.542531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d9f5973b-7a3e-474a-bac8-0143c7a8ff0e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:15.543176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d9f5973b-7a3e-474a-bac8-0143c7a8ff0e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:15.549674 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9f5973b-7a3e-474a-bac8-0143c7a8ff0e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:15.550547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9f5973b-7a3e-474a-bac8-0143c7a8ff0e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:15.551288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9f5973b-7a3e-474a-bac8-0143c7a8ff0e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:15.551846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9f5973b-7a3e-474a-bac8-0143c7a8ff0e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:15.821783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d9f5973b-7a3e-474a-bac8-0143c7a8ff0e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:15.832329 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d9f5973b-7a3e-474a-bac8-0143c7a8ff0e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1311 microversion: 2.1 time: 0.294246 Mar 05 20:57:15.850992 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1287/2495] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:15 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1311 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:15.869126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fdbbec01-e874-42a9-9c49-197565959bdc tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:15.870009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fdbbec01-e874-42a9-9c49-197565959bdc tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:15.879946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fdbbec01-e874-42a9-9c49-197565959bdc tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:15.881028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fdbbec01-e874-42a9-9c49-197565959bdc tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:15.884435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fdbbec01-e874-42a9-9c49-197565959bdc tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:15.885134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fdbbec01-e874-42a9-9c49-197565959bdc tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:16.278931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fdbbec01-e874-42a9-9c49-197565959bdc tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e550a9e464a43f696a831eac675623e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e7d92a8aac446c19a53879985b3aa08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:16.291592 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fdbbec01-e874-42a9-9c49-197565959bdc tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 200 len: 1313 microversion: 2.1 time: 0.426421 Mar 05 20:57:16.304915 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1288/2496] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:15 2022] GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:57:16.311769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8ed8b3fb-1329-463a-b464-b597150a2fcf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:16.312400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8ed8b3fb-1329-463a-b464-b597150a2fcf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:16.322081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ed8b3fb-1329-463a-b464-b597150a2fcf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:16.322720 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ed8b3fb-1329-463a-b464-b597150a2fcf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:16.323811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ed8b3fb-1329-463a-b464-b597150a2fcf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:16.324307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ed8b3fb-1329-463a-b464-b597150a2fcf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:16.405530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8ed8b3fb-1329-463a-b464-b597150a2fcf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:16.413772 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8ed8b3fb-1329-463a-b464-b597150a2fcf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1283 microversion: 2.1 time: 0.107325 Mar 05 20:57:16.414355 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1289/2497] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:16 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1283 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:16.418762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-633dbdad-0b57-47dd-a84e-c87c565b4801 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:16.419570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-633dbdad-0b57-47dd-a84e-c87c565b4801 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:16.426608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-633dbdad-0b57-47dd-a84e-c87c565b4801 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:16.427328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-633dbdad-0b57-47dd-a84e-c87c565b4801 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:16.428329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-633dbdad-0b57-47dd-a84e-c87c565b4801 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:16.428907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-633dbdad-0b57-47dd-a84e-c87c565b4801 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:16.569472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-633dbdad-0b57-47dd-a84e-c87c565b4801 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:16.577030 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-633dbdad-0b57-47dd-a84e-c87c565b4801 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.161671 Mar 05 20:57:16.577865 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1290/2498] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:16 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:16.582427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-71603aae-cde9-4f32-9c50-ece5c50ba7df req-241b302a-6e69-433e-bec5-64f2455dd3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfc91a5-551d-4094-992f-f0efeefc3861", "name": "network-vif-plugged", "status": "completed", "tag": "5273f935-dd07-4fd5-a9bc-622b643001cf"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:16.591267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-71603aae-cde9-4f32-9c50-ece5c50ba7df req-241b302a-6e69-433e-bec5-64f2455dd3b5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:16.591923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-71603aae-cde9-4f32-9c50-ece5c50ba7df req-241b302a-6e69-433e-bec5-64f2455dd3b5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:16.603202 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-71603aae-cde9-4f32-9c50-ece5c50ba7df req-241b302a-6e69-433e-bec5-64f2455dd3b5 service nova] Creating event network-vif-plugged:5273f935-dd07-4fd5-a9bc-622b643001cf for instance 9dfc91a5-551d-4094-992f-f0efeefc3861 on nch1-master-1 Mar 05 20:57:16.608269 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-71603aae-cde9-4f32-9c50-ece5c50ba7df req-241b302a-6e69-433e-bec5-64f2455dd3b5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029173 Mar 05 20:57:16.608867 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1291/2499] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:16.614259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-298ad021-20b1-4b20-8ad2-f9dc10d6e062 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:16.615611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-298ad021-20b1-4b20-8ad2-f9dc10d6e062 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:16.621967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-298ad021-20b1-4b20-8ad2-f9dc10d6e062 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:16.622550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-298ad021-20b1-4b20-8ad2-f9dc10d6e062 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:16.623212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-298ad021-20b1-4b20-8ad2-f9dc10d6e062 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:16.623661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-298ad021-20b1-4b20-8ad2-f9dc10d6e062 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:16.712764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-4b719f54-1e69-464c-85ac-ad5162d9981e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Updating instance_info_cache with network_info: [{"id": "7d12cb43-6b68-44ec-be62-881ac11e38d1", "address": "fa:16:3e:16:73:6c", "network": {"id": "a0fc1ef5-7d58-4956-8ec7-37c47d9df56c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-172908316-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "933b162d4a3044f38bed8c339cc621ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7d12cb43-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 05 20:57:16.722824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b719f54-1e69-464c-85ac-ad5162d9981e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Releasing lock "refresh_cache-1567b85e-c179-4c65-9ec1-47b86cdba579" {{(pid=141478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 20:57:16.724112 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4b719f54-1e69-464c-85ac-ad5162d9981e tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "POST /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579/action" status: 202 len: 0 microversion: 2.1 time: 5.395020 Mar 05 20:57:16.725975 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1209/2500] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:57:11 2022] POST /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579/action => generated 0 bytes in 5398 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 05 20:57:16.735017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-60ad538d-01c5-413c-bd5c-c1801f436736 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:16.735603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-60ad538d-01c5-413c-bd5c-c1801f436736 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:16.745627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60ad538d-01c5-413c-bd5c-c1801f436736 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:16.745991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60ad538d-01c5-413c-bd5c-c1801f436736 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:16.747229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60ad538d-01c5-413c-bd5c-c1801f436736 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:16.748237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60ad538d-01c5-413c-bd5c-c1801f436736 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:16.827893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-298ad021-20b1-4b20-8ad2-f9dc10d6e062 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:16.835861 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-298ad021-20b1-4b20-8ad2-f9dc10d6e062 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1502 microversion: 2.1 time: 0.225516 Mar 05 20:57:16.836462 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1292/2501] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:16 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:16.850389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-84416560-cdab-4b07-a1a9-878643d451bf tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:16.853958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-84416560-cdab-4b07-a1a9-878643d451bf tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:16.863634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84416560-cdab-4b07-a1a9-878643d451bf tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:16.864158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-60ad538d-01c5-413c-bd5c-c1801f436736 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:57:16.866286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84416560-cdab-4b07-a1a9-878643d451bf tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:16.870548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84416560-cdab-4b07-a1a9-878643d451bf tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:16.871200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84416560-cdab-4b07-a1a9-878643d451bf tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:16.994065 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-60ad538d-01c5-413c-bd5c-c1801f436736 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579" status: 204 len: 0 microversion: 2.1 time: 0.262373 Mar 05 20:57:16.996058 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1210/2502] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:57:16 2022] DELETE /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 20:57:17.004460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-46eaa232-a9d6-4772-8d4b-82bf614208eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:17.006861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-46eaa232-a9d6-4772-8d4b-82bf614208eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:17.014528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46eaa232-a9d6-4772-8d4b-82bf614208eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:17.017525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46eaa232-a9d6-4772-8d4b-82bf614208eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:17.019479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46eaa232-a9d6-4772-8d4b-82bf614208eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:17.020208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46eaa232-a9d6-4772-8d4b-82bf614208eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:17.040869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-84416560-cdab-4b07-a1a9-878643d451bf tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:17.048765 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-84416560-cdab-4b07-a1a9-878643d451bf tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1311 microversion: 2.1 time: 0.202749 Mar 05 20:57:17.052870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-46eaa232-a9d6-4772-8d4b-82bf614208eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lazy-loading 'flavor' on Instance uuid af3b961b-384e-4246-8bee-f44c06d45447 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:57:17.058793 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1293/2503] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:16 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1311 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:57:17.064115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ffead607-f47a-4ad6-9bb5-695899d16b6c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.115"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:17.065423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ffead607-f47a-4ad6-9bb5-695899d16b6c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:17.072138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ffead607-f47a-4ad6-9bb5-695899d16b6c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:17.072827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ffead607-f47a-4ad6-9bb5-695899d16b6c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:17.073791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ffead607-f47a-4ad6-9bb5-695899d16b6c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:17.074400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ffead607-f47a-4ad6-9bb5-695899d16b6c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:17.107475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ffead607-f47a-4ad6-9bb5-695899d16b6c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Acquired lock "refresh_cache-429f5dde-84d7-4bd3-a37a-066ac19fdc53" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 20:57:17.335325 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-46eaa232-a9d6-4772-8d4b-82bf614208eb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "POST /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447/action" status: 202 len: 0 microversion: 2.1 time: 0.336082 Mar 05 20:57:17.338999 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1211/2504] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:57:16 2022] POST /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:57:17.342151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1df7cc4c-79a2-4876-98d0-035885930843 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:17.342947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1df7cc4c-79a2-4876-98d0-035885930843 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:17.350553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1df7cc4c-79a2-4876-98d0-035885930843 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:17.350782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1df7cc4c-79a2-4876-98d0-035885930843 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:17.351575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1df7cc4c-79a2-4876-98d0-035885930843 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:17.352191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1df7cc4c-79a2-4876-98d0-035885930843 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:17.762173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1df7cc4c-79a2-4876-98d0-035885930843 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e550a9e464a43f696a831eac675623e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e7d92a8aac446c19a53879985b3aa08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:17.775133 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1df7cc4c-79a2-4876-98d0-035885930843 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 200 len: 1313 microversion: 2.1 time: 0.437469 Mar 05 20:57:17.777988 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1212/2505] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:17 2022] GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:17.795568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-24b7a08f-3835-467c-9a09-57b727ec4d9b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:17.797210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-24b7a08f-3835-467c-9a09-57b727ec4d9b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:17.821208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24b7a08f-3835-467c-9a09-57b727ec4d9b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:17.822104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24b7a08f-3835-467c-9a09-57b727ec4d9b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:17.823069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24b7a08f-3835-467c-9a09-57b727ec4d9b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:17.823759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24b7a08f-3835-467c-9a09-57b727ec4d9b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:18.174747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-24b7a08f-3835-467c-9a09-57b727ec4d9b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:18.183467 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-24b7a08f-3835-467c-9a09-57b727ec4d9b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.404346 Mar 05 20:57:18.184089 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1213/2506] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:17 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:18.196021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-88b590e8-5ce5-4ac9-a697-7db2f508ccaf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:18.196760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-88b590e8-5ce5-4ac9-a697-7db2f508ccaf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:18.205626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-88b590e8-5ce5-4ac9-a697-7db2f508ccaf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:18.206500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-88b590e8-5ce5-4ac9-a697-7db2f508ccaf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:18.207460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-88b590e8-5ce5-4ac9-a697-7db2f508ccaf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:18.208148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-88b590e8-5ce5-4ac9-a697-7db2f508ccaf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:18.835525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-88b590e8-5ce5-4ac9-a697-7db2f508ccaf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:18.844139 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-88b590e8-5ce5-4ac9-a697-7db2f508ccaf tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1351 microversion: 2.1 time: 0.658561 Mar 05 20:57:18.845917 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1214/2507] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:18 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1351 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:18.854330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c8019c8-845e-4f7e-ace3-4f058baea1f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:18.855279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c8019c8-845e-4f7e-ace3-4f058baea1f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:18.862241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c8019c8-845e-4f7e-ace3-4f058baea1f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:18.863296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c8019c8-845e-4f7e-ace3-4f058baea1f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:18.864253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c8019c8-845e-4f7e-ace3-4f058baea1f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:18.864954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c8019c8-845e-4f7e-ace3-4f058baea1f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:19.273198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8c8019c8-845e-4f7e-ace3-4f058baea1f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:19.284898 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8c8019c8-845e-4f7e-ace3-4f058baea1f8 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1487 microversion: 2.1 time: 0.434324 Mar 05 20:57:19.285836 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1215/2508] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:18 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1487 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:19.289313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-ffead607-f47a-4ad6-9bb5-695899d16b6c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Building network info cache for instance {{(pid=141479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 05 20:57:19.292821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-3ec5d5cf-9216-4232-9065-a376dd892530 req-4bb9042d-103c-4b6c-919d-3e5b11b7c2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eefc9ca-6a02-4bf8-8239-ad67aaab69b0", "tag": "66b1650a-3e82-4d7d-b60f-82261d656e4c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:19.309636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3ec5d5cf-9216-4232-9065-a376dd892530 req-4bb9042d-103c-4b6c-919d-3e5b11b7c2d6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:19.310311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3ec5d5cf-9216-4232-9065-a376dd892530 req-4bb9042d-103c-4b6c-919d-3e5b11b7c2d6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:19.324506 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-3ec5d5cf-9216-4232-9065-a376dd892530 req-4bb9042d-103c-4b6c-919d-3e5b11b7c2d6 service nova] Creating event network-changed:66b1650a-3e82-4d7d-b60f-82261d656e4c for instance 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 on nch1-master-1 Mar 05 20:57:19.330100 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-3ec5d5cf-9216-4232-9065-a376dd892530 req-4bb9042d-103c-4b6c-919d-3e5b11b7c2d6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041293 Mar 05 20:57:19.331037 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1216/2509] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:19.337921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e7ec1d33-d601-41a9-90ff-f7f422e67c21 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:19.338960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e7ec1d33-d601-41a9-90ff-f7f422e67c21 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:19.345558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7ec1d33-d601-41a9-90ff-f7f422e67c21 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:19.346038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7ec1d33-d601-41a9-90ff-f7f422e67c21 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:19.349017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7ec1d33-d601-41a9-90ff-f7f422e67c21 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:19.349748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7ec1d33-d601-41a9-90ff-f7f422e67c21 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:19.762676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e7ec1d33-d601-41a9-90ff-f7f422e67c21 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:19.778380 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e7ec1d33-d601-41a9-90ff-f7f422e67c21 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1311 microversion: 2.1 time: 0.445944 Mar 05 20:57:19.779022 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1217/2510] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:19 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1311 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:19.793186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7d0e041e-af94-465a-93f1-eb51b51db139 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:19.793815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7d0e041e-af94-465a-93f1-eb51b51db139 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:19.800827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d0e041e-af94-465a-93f1-eb51b51db139 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:19.801761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d0e041e-af94-465a-93f1-eb51b51db139 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:19.803531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d0e041e-af94-465a-93f1-eb51b51db139 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:19.804163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d0e041e-af94-465a-93f1-eb51b51db139 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:20.285509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7d0e041e-af94-465a-93f1-eb51b51db139 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e550a9e464a43f696a831eac675623e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e7d92a8aac446c19a53879985b3aa08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:20.329749 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7d0e041e-af94-465a-93f1-eb51b51db139 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 200 len: 1499 microversion: 2.1 time: 0.540512 Mar 05 20:57:20.331395 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1218/2511] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:19 2022] GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 1499 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:20.339571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b81c6c93-d8f5-4b92-83e6-5d947d5d28be tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:20.341013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b81c6c93-d8f5-4b92-83e6-5d947d5d28be tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:20.350351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b81c6c93-d8f5-4b92-83e6-5d947d5d28be tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:20.351470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b81c6c93-d8f5-4b92-83e6-5d947d5d28be tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:20.352479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b81c6c93-d8f5-4b92-83e6-5d947d5d28be tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:20.354840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b81c6c93-d8f5-4b92-83e6-5d947d5d28be tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:20.645104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b81c6c93-d8f5-4b92-83e6-5d947d5d28be tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:20.655550 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b81c6c93-d8f5-4b92-83e6-5d947d5d28be tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.322823 Mar 05 20:57:20.662712 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1219/2512] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:20 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:20.670269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f9d1eae6-b678-4c90-8cc0-ef9088fa356a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:20.671232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f9d1eae6-b678-4c90-8cc0-ef9088fa356a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:20.681238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9d1eae6-b678-4c90-8cc0-ef9088fa356a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:20.682058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9d1eae6-b678-4c90-8cc0-ef9088fa356a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:20.683107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9d1eae6-b678-4c90-8cc0-ef9088fa356a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:20.683880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9d1eae6-b678-4c90-8cc0-ef9088fa356a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:20.779160 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f9d1eae6-b678-4c90-8cc0-ef9088fa356a tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "POST /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e/action" status: 202 len: 0 microversion: 2.1 time: 0.115149 Mar 05 20:57:20.780701 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1220/2513] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:57:20 2022] POST /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:57:20.787282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f0b20d51-2792-446e-b5b6-9678b4cc2d56 req-2e695875-5bbd-4332-bd81-46f1151bbfdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429f5dde-84d7-4bd3-a37a-066ac19fdc53", "tag": "2710cf64-1285-4d3b-8a24-95520a144b8c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:20.800439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f0b20d51-2792-446e-b5b6-9678b4cc2d56 req-2e695875-5bbd-4332-bd81-46f1151bbfdc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:20.801250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f0b20d51-2792-446e-b5b6-9678b4cc2d56 req-2e695875-5bbd-4332-bd81-46f1151bbfdc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:20.831060 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f0b20d51-2792-446e-b5b6-9678b4cc2d56 req-2e695875-5bbd-4332-bd81-46f1151bbfdc service nova] Creating event network-changed:2710cf64-1285-4d3b-8a24-95520a144b8c for instance 429f5dde-84d7-4bd3-a37a-066ac19fdc53 on nch2-master-1 Mar 05 20:57:20.852028 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f0b20d51-2792-446e-b5b6-9678b4cc2d56 req-2e695875-5bbd-4332-bd81-46f1151bbfdc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069160 Mar 05 20:57:20.852941 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1221/2514] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:20.858399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6344fd0a-649a-47c0-b4cd-9abb2693d194 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:20.860021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6344fd0a-649a-47c0-b4cd-9abb2693d194 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:20.867335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6344fd0a-649a-47c0-b4cd-9abb2693d194 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:20.867970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6344fd0a-649a-47c0-b4cd-9abb2693d194 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:20.869087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6344fd0a-649a-47c0-b4cd-9abb2693d194 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:20.869792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6344fd0a-649a-47c0-b4cd-9abb2693d194 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:21.179432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6344fd0a-649a-47c0-b4cd-9abb2693d194 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:21.191247 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6344fd0a-649a-47c0-b4cd-9abb2693d194 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1351 microversion: 2.1 time: 0.334405 Mar 05 20:57:21.192319 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1222/2515] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:20 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1351 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:21.204329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-13844227-f45a-407b-ac10-6b5832cfe492 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:21.236330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.compute.server_groups [None req-13844227-f45a-407b-ac10-6b5832cfe492 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Querying cell 591cc087-7d9b-4967-a4cd-9c96e8077593(cell1) for 1 instances {{(pid=141478) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 05 20:57:21.241038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13844227-f45a-407b-ac10-6b5832cfe492 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:21.241872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13844227-f45a-407b-ac10-6b5832cfe492 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:21.274317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-ffead607-f47a-4ad6-9bb5-695899d16b6c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Updating instance_info_cache with network_info: [{"id": "2710cf64-1285-4d3b-8a24-95520a144b8c", "address": "fa:16:3e:7e:1d:4e", "network": {"id": "a0fc1ef5-7d58-4956-8ec7-37c47d9df56c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-172908316-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "933b162d4a3044f38bed8c339cc621ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2710cf64-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 05 20:57:21.283739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ffead607-f47a-4ad6-9bb5-695899d16b6c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Releasing lock "refresh_cache-429f5dde-84d7-4bd3-a37a-066ac19fdc53" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 20:57:21.284995 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ffead607-f47a-4ad6-9bb5-695899d16b6c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "POST /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53/action" status: 202 len: 0 microversion: 2.1 time: 4.224929 Mar 05 20:57:21.285795 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1294/2516] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:57:17 2022] POST /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53/action => generated 0 bytes in 4226 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 05 20:57:21.291029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dc5a7840-b32b-42b9-97c3-262262886326 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:21.291740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dc5a7840-b32b-42b9-97c3-262262886326 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:21.291972 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-13844227-f45a-407b-ac10-6b5832cfe492 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/os-server-groups/c4c6220d-c94b-401f-a643-d6b70bed83c9" status: 200 len: 221 microversion: 2.1 time: 0.097073 Mar 05 20:57:21.297241 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1223/2517] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:57:21 2022] GET /compute/v2.1/os-server-groups/c4c6220d-c94b-401f-a643-d6b70bed83c9 => generated 221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:21.298237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc5a7840-b32b-42b9-97c3-262262886326 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:21.298710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc5a7840-b32b-42b9-97c3-262262886326 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:21.299502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc5a7840-b32b-42b9-97c3-262262886326 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:21.299981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc5a7840-b32b-42b9-97c3-262262886326 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:21.305226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2ba5d225-c18d-4c19-8aaf-dbc83f5c7bcc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:21.305860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2ba5d225-c18d-4c19-8aaf-dbc83f5c7bcc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:21.313013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ba5d225-c18d-4c19-8aaf-dbc83f5c7bcc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:21.313469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ba5d225-c18d-4c19-8aaf-dbc83f5c7bcc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:21.314256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ba5d225-c18d-4c19-8aaf-dbc83f5c7bcc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:21.314685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ba5d225-c18d-4c19-8aaf-dbc83f5c7bcc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:21.576247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2ba5d225-c18d-4c19-8aaf-dbc83f5c7bcc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:21.585139 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2ba5d225-c18d-4c19-8aaf-dbc83f5c7bcc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1311 microversion: 2.1 time: 0.291429 Mar 05 20:57:21.595111 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1224/2518] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:21 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1311 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:21.600080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4352e720-afa5-412e-bd71-8c2106a84676 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '.version_select at 0x7fed5c52b820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:21.773578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dc5a7840-b32b-42b9-97c3-262262886326 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:21.783355 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dc5a7840-b32b-42b9-97c3-262262886326 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1495 microversion: 2.1 time: 0.496258 Mar 05 20:57:21.784325 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1295/2519] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:21 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1495 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:21.789409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-57bcf6ad-69fb-41d3-abb4-d8db37313f45 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:21.796054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-57bcf6ad-69fb-41d3-abb4-d8db37313f45 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:21.806260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57bcf6ad-69fb-41d3-abb4-d8db37313f45 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:21.807005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57bcf6ad-69fb-41d3-abb4-d8db37313f45 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:21.808012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57bcf6ad-69fb-41d3-abb4-d8db37313f45 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:21.808693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57bcf6ad-69fb-41d3-abb4-d8db37313f45 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:21.837332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-57bcf6ad-69fb-41d3-abb4-d8db37313f45 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:57:21.863603 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4352e720-afa5-412e-bd71-8c2106a84676 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/os-floating-ips/9af4ff89-b376-4e3c-9626-d9bf55b8f125" status: 200 len: 185 microversion: 2.1 time: 0.260758 Mar 05 20:57:21.863603 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1225/2520] 10.222.0.15 () {58 vars in 1259 bytes} [Sat Mar 5 20:57:21 2022] GET /compute/v2.1/os-floating-ips/9af4ff89-b376-4e3c-9626-d9bf55b8f125 => generated 185 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:21.871478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-97ea3ada-0610-42de-8653-71553561b177 req-98f5a94d-4ee1-431b-a398-77a9b4ba5e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6207958f-00b7-4d0e-b1a7-e17e3ddf371c", "tag": "b7562f27-5f06-4bcc-a8b8-962b8a5a7750"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:21.900723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-97ea3ada-0610-42de-8653-71553561b177 req-98f5a94d-4ee1-431b-a398-77a9b4ba5e76 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:21.901191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-97ea3ada-0610-42de-8653-71553561b177 req-98f5a94d-4ee1-431b-a398-77a9b4ba5e76 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:21.923232 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-97ea3ada-0610-42de-8653-71553561b177 req-98f5a94d-4ee1-431b-a398-77a9b4ba5e76 service nova] Creating event network-changed:b7562f27-5f06-4bcc-a8b8-962b8a5a7750 for instance 6207958f-00b7-4d0e-b1a7-e17e3ddf371c on nch2-master-1 Mar 05 20:57:21.930097 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-97ea3ada-0610-42de-8653-71553561b177 req-98f5a94d-4ee1-431b-a398-77a9b4ba5e76 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069822 Mar 05 20:57:21.931527 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1226/2521] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:21.952918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-408845ef-02b5-48d4-a1b5-421ffb9ab4a1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:21.954106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-408845ef-02b5-48d4-a1b5-421ffb9ab4a1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:21.964435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-408845ef-02b5-48d4-a1b5-421ffb9ab4a1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:21.965531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-408845ef-02b5-48d4-a1b5-421ffb9ab4a1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:21.966494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-408845ef-02b5-48d4-a1b5-421ffb9ab4a1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:21.967519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-408845ef-02b5-48d4-a1b5-421ffb9ab4a1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:22.036593 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-57bcf6ad-69fb-41d3-abb4-d8db37313f45 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 204 len: 0 microversion: 2.1 time: 0.249965 Mar 05 20:57:22.038418 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1296/2522] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:57:21 2022] DELETE /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:57:22.049485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7a47f0aa-d65b-4249-bef8-290df61b3692 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.115"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:22.241693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-408845ef-02b5-48d4-a1b5-421ffb9ab4a1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:22.250695 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-408845ef-02b5-48d4-a1b5-421ffb9ab4a1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.317719 Mar 05 20:57:22.259852 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1227/2523] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:21 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:22.264847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dc464c45-b85f-43e4-9796-c2238fb86c05 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:22.265481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dc464c45-b85f-43e4-9796-c2238fb86c05 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:22.272053 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc464c45-b85f-43e4-9796-c2238fb86c05 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:22.275986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc464c45-b85f-43e4-9796-c2238fb86c05 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:22.277284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc464c45-b85f-43e4-9796-c2238fb86c05 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:22.277885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc464c45-b85f-43e4-9796-c2238fb86c05 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:22.438160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7a47f0aa-d65b-4249-bef8-290df61b3692 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:22.444900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a47f0aa-d65b-4249-bef8-290df61b3692 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:22.445764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a47f0aa-d65b-4249-bef8-290df61b3692 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:22.446977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a47f0aa-d65b-4249-bef8-290df61b3692 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:22.447517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a47f0aa-d65b-4249-bef8-290df61b3692 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:22.514672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dc464c45-b85f-43e4-9796-c2238fb86c05 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e550a9e464a43f696a831eac675623e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e7d92a8aac446c19a53879985b3aa08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:22.525472 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dc464c45-b85f-43e4-9796-c2238fb86c05 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 200 len: 1505 microversion: 2.1 time: 0.264477 Mar 05 20:57:22.535270 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1228/2524] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:22 2022] GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:22.535270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-035abe9e-1f6c-47f3-b59d-7e32bd4e7beb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:22.535270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-035abe9e-1f6c-47f3-b59d-7e32bd4e7beb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:22.540731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-035abe9e-1f6c-47f3-b59d-7e32bd4e7beb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:22.541182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-035abe9e-1f6c-47f3-b59d-7e32bd4e7beb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:22.541971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-035abe9e-1f6c-47f3-b59d-7e32bd4e7beb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:22.542774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-035abe9e-1f6c-47f3-b59d-7e32bd4e7beb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:22.722820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-035abe9e-1f6c-47f3-b59d-7e32bd4e7beb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:22.730898 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-035abe9e-1f6c-47f3-b59d-7e32bd4e7beb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1351 microversion: 2.1 time: 0.202926 Mar 05 20:57:22.731470 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1229/2525] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:22 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1351 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:22.736034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b219b02-9632-4596-8c07-c4ec48a0b95e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:22.736651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4b219b02-9632-4596-8c07-c4ec48a0b95e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:22.742530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b219b02-9632-4596-8c07-c4ec48a0b95e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:22.742985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b219b02-9632-4596-8c07-c4ec48a0b95e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:22.743800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b219b02-9632-4596-8c07-c4ec48a0b95e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:22.744249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b219b02-9632-4596-8c07-c4ec48a0b95e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:22.882447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4b219b02-9632-4596-8c07-c4ec48a0b95e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:22.897353 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4b219b02-9632-4596-8c07-c4ec48a0b95e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1311 microversion: 2.1 time: 0.164806 Mar 05 20:57:22.898516 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1230/2526] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:22 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1311 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:22.910450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-968fe83e-9ac4-4b9a-b95d-906dc95faafb tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:22.912131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-968fe83e-9ac4-4b9a-b95d-906dc95faafb tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:22.919463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-968fe83e-9ac4-4b9a-b95d-906dc95faafb tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:22.919889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-968fe83e-9ac4-4b9a-b95d-906dc95faafb tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:22.920692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-968fe83e-9ac4-4b9a-b95d-906dc95faafb tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:22.921172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-968fe83e-9ac4-4b9a-b95d-906dc95faafb tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:22.948392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a47f0aa-d65b-4249-bef8-290df61b3692 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Acquired lock "refresh_cache-429f5dde-84d7-4bd3-a37a-066ac19fdc53" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 20:57:23.056826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-968fe83e-9ac4-4b9a-b95d-906dc95faafb tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:23.064440 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-968fe83e-9ac4-4b9a-b95d-906dc95faafb tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1495 microversion: 2.1 time: 0.164672 Mar 05 20:57:23.065072 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1231/2527] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:22 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1495 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:23.070828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e0071ee1-4fde-49e1-bf24-b8886edb2c6e req-b5507b1a-b649-415c-bc0e-e862e72fd7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1567b85e-c179-4c65-9ec1-47b86cdba579", "name": "network-vif-deleted", "tag": "7d12cb43-6b68-44ec-be62-881ac11e38d1"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:23.079120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e0071ee1-4fde-49e1-bf24-b8886edb2c6e req-b5507b1a-b649-415c-bc0e-e862e72fd7b3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:23.079573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e0071ee1-4fde-49e1-bf24-b8886edb2c6e req-b5507b1a-b649-415c-bc0e-e862e72fd7b3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:23.091327 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e0071ee1-4fde-49e1-bf24-b8886edb2c6e req-b5507b1a-b649-415c-bc0e-e862e72fd7b3 service nova] Creating event network-vif-deleted:7d12cb43-6b68-44ec-be62-881ac11e38d1 for instance 1567b85e-c179-4c65-9ec1-47b86cdba579 on nch2-master-1 Mar 05 20:57:23.096163 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e0071ee1-4fde-49e1-bf24-b8886edb2c6e req-b5507b1a-b649-415c-bc0e-e862e72fd7b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029664 Mar 05 20:57:23.096765 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1232/2528] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:23.268570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6ce262ee-d78c-4251-98c2-e8699c4637da tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:23.269284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6ce262ee-d78c-4251-98c2-e8699c4637da tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:23.277634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ce262ee-d78c-4251-98c2-e8699c4637da tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:23.278089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ce262ee-d78c-4251-98c2-e8699c4637da tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:23.285544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ce262ee-d78c-4251-98c2-e8699c4637da tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:23.285983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ce262ee-d78c-4251-98c2-e8699c4637da tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:23.474229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6ce262ee-d78c-4251-98c2-e8699c4637da tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:23.487778 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6ce262ee-d78c-4251-98c2-e8699c4637da tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.223262 Mar 05 20:57:23.498661 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1233/2529] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:23 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:23.542884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e02bd3f0-91dd-47ee-aee2-9cc1af6f55ef tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:23.543785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e02bd3f0-91dd-47ee-aee2-9cc1af6f55ef tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:23.552832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e02bd3f0-91dd-47ee-aee2-9cc1af6f55ef tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:23.553055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e02bd3f0-91dd-47ee-aee2-9cc1af6f55ef tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:23.555707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e02bd3f0-91dd-47ee-aee2-9cc1af6f55ef tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:23.555863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e02bd3f0-91dd-47ee-aee2-9cc1af6f55ef tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.084617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-7a47f0aa-d65b-4249-bef8-290df61b3692 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Building network info cache for instance {{(pid=141479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 05 20:57:24.126583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e02bd3f0-91dd-47ee-aee2-9cc1af6f55ef tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e550a9e464a43f696a831eac675623e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e7d92a8aac446c19a53879985b3aa08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:24.137729 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e02bd3f0-91dd-47ee-aee2-9cc1af6f55ef tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 200 len: 1505 microversion: 2.1 time: 0.598613 Mar 05 20:57:24.151320 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1234/2530] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:23 2022] GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 1505 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:24.162102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-393af95f-3077-4fc0-9955-4d323ad70421 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:24.162964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-393af95f-3077-4fc0-9955-4d323ad70421 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:24.176472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-393af95f-3077-4fc0-9955-4d323ad70421 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:24.177494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-393af95f-3077-4fc0-9955-4d323ad70421 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.178304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-393af95f-3077-4fc0-9955-4d323ad70421 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:24.178743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-393af95f-3077-4fc0-9955-4d323ad70421 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.392619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-393af95f-3077-4fc0-9955-4d323ad70421 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:24.406163 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-393af95f-3077-4fc0-9955-4d323ad70421 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1351 microversion: 2.1 time: 0.253139 Mar 05 20:57:24.407141 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1235/2531] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:24 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1351 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:24.420117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c07555ed-d048-42fe-9e6f-c6d25f6ee50c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:24.420848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c07555ed-d048-42fe-9e6f-c6d25f6ee50c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:24.428521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c07555ed-d048-42fe-9e6f-c6d25f6ee50c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:24.428521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c07555ed-d048-42fe-9e6f-c6d25f6ee50c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.428521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c07555ed-d048-42fe-9e6f-c6d25f6ee50c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:24.429495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c07555ed-d048-42fe-9e6f-c6d25f6ee50c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.653818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c07555ed-d048-42fe-9e6f-c6d25f6ee50c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:24.666944 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c07555ed-d048-42fe-9e6f-c6d25f6ee50c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1311 microversion: 2.1 time: 0.258186 Mar 05 20:57:24.668562 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1236/2532] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:24 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1311 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:24.673948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8d3c0ad9-6994-4780-bddd-5f5b23102880 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:24.674625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8d3c0ad9-6994-4780-bddd-5f5b23102880 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:24.686533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d3c0ad9-6994-4780-bddd-5f5b23102880 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:24.686989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d3c0ad9-6994-4780-bddd-5f5b23102880 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.687811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d3c0ad9-6994-4780-bddd-5f5b23102880 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:24.688254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d3c0ad9-6994-4780-bddd-5f5b23102880 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.723157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-7a47f0aa-d65b-4249-bef8-290df61b3692 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Updating instance_info_cache with network_info: [{"id": "2710cf64-1285-4d3b-8a24-95520a144b8c", "address": "fa:16:3e:7e:1d:4e", "network": {"id": "a0fc1ef5-7d58-4956-8ec7-37c47d9df56c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-172908316-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "933b162d4a3044f38bed8c339cc621ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2710cf64-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 05 20:57:24.735255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a47f0aa-d65b-4249-bef8-290df61b3692 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Releasing lock "refresh_cache-429f5dde-84d7-4bd3-a37a-066ac19fdc53" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 20:57:24.736226 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7a47f0aa-d65b-4249-bef8-290df61b3692 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "POST /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53/action" status: 202 len: 0 microversion: 2.1 time: 2.695820 Mar 05 20:57:24.741764 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1297/2533] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:57:22 2022] POST /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53/action => generated 0 bytes in 2698 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 05 20:57:24.744055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-35034875-863b-4c2d-bd0a-00d4b53b2334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:24.744685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-35034875-863b-4c2d-bd0a-00d4b53b2334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:24.751175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35034875-863b-4c2d-bd0a-00d4b53b2334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:24.751887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35034875-863b-4c2d-bd0a-00d4b53b2334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.752892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35034875-863b-4c2d-bd0a-00d4b53b2334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:24.753383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35034875-863b-4c2d-bd0a-00d4b53b2334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.853664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8d3c0ad9-6994-4780-bddd-5f5b23102880 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:24.861220 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8d3c0ad9-6994-4780-bddd-5f5b23102880 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1501 microversion: 2.1 time: 0.191515 Mar 05 20:57:24.862003 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1237/2534] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:24 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1501 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:24.866374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-60f86be3-bdf2-4d63-972d-56cbbcb60845 req-6429f580-cbc7-4e3a-8316-8b0c435818c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfc91a5-551d-4094-992f-f0efeefc3861", "name": "network-vif-deleted", "tag": "5273f935-dd07-4fd5-a9bc-622b643001cf"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:24.885909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-60f86be3-bdf2-4d63-972d-56cbbcb60845 req-6429f580-cbc7-4e3a-8316-8b0c435818c6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:24.886370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-60f86be3-bdf2-4d63-972d-56cbbcb60845 req-6429f580-cbc7-4e3a-8316-8b0c435818c6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.913698 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-60f86be3-bdf2-4d63-972d-56cbbcb60845 req-6429f580-cbc7-4e3a-8316-8b0c435818c6 service nova] Creating event network-vif-deleted:5273f935-dd07-4fd5-a9bc-622b643001cf for instance 9dfc91a5-551d-4094-992f-f0efeefc3861 on nch1-master-1 Mar 05 20:57:24.919629 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-60f86be3-bdf2-4d63-972d-56cbbcb60845 req-6429f580-cbc7-4e3a-8316-8b0c435818c6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056329 Mar 05 20:57:24.920472 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1238/2535] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:24.926138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-76cf0f9b-42d2-43cb-bb12-641bacad77f9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:24.926296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-76cf0f9b-42d2-43cb-bb12-641bacad77f9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:24.932412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76cf0f9b-42d2-43cb-bb12-641bacad77f9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:24.932906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76cf0f9b-42d2-43cb-bb12-641bacad77f9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.934090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76cf0f9b-42d2-43cb-bb12-641bacad77f9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:24.934394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76cf0f9b-42d2-43cb-bb12-641bacad77f9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.952018 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-76cf0f9b-42d2-43cb-bb12-641bacad77f9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] HTTP exception thrown: Instance 1567b85e-c179-4c65-9ec1-47b86cdba579 could not be found. Mar 05 20:57:24.952635 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-76cf0f9b-42d2-43cb-bb12-641bacad77f9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Returning 404 to user: Instance 1567b85e-c179-4c65-9ec1-47b86cdba579 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:24.960550 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-76cf0f9b-42d2-43cb-bb12-641bacad77f9 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579" status: 404 len: 111 microversion: 2.1 time: 0.039034 Mar 05 20:57:24.965225 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1239/2536] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:57:24 2022] DELETE /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:57:24.971991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6ff672c2-32aa-4097-bb50-a90812a1256f tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:24.972839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6ff672c2-32aa-4097-bb50-a90812a1256f tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:24.985235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ff672c2-32aa-4097-bb50-a90812a1256f tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:24.986587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-35034875-863b-4c2d-bd0a-00d4b53b2334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:24.987721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ff672c2-32aa-4097-bb50-a90812a1256f tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.988586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ff672c2-32aa-4097-bb50-a90812a1256f tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:24.989041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ff672c2-32aa-4097-bb50-a90812a1256f tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:24.995286 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-35034875-863b-4c2d-bd0a-00d4b53b2334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.255882 Mar 05 20:57:24.996128 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1298/2537] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:24 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:25.004251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3ddb2c4e-6504-4f52-9574-7227edeade59 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:25.005160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3ddb2c4e-6504-4f52-9574-7227edeade59 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 1567b85e-c179-4c65-9ec1-47b86cdba579] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:25.018859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3ddb2c4e-6504-4f52-9574-7227edeade59 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.019323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3ddb2c4e-6504-4f52-9574-7227edeade59 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.023366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3ddb2c4e-6504-4f52-9574-7227edeade59 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.024008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3ddb2c4e-6504-4f52-9574-7227edeade59 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.039775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6ff672c2-32aa-4097-bb50-a90812a1256f tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:57:25.068158 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-3ddb2c4e-6504-4f52-9574-7227edeade59 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] HTTP exception thrown: Instance 1567b85e-c179-4c65-9ec1-47b86cdba579 could not be found. Mar 05 20:57:25.068706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3ddb2c4e-6504-4f52-9574-7227edeade59 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Returning 404 to user: Instance 1567b85e-c179-4c65-9ec1-47b86cdba579 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:25.069570 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3ddb2c4e-6504-4f52-9574-7227edeade59 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579" status: 404 len: 111 microversion: 2.1 time: 0.069010 Mar 05 20:57:25.070325 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1299/2538] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:24 2022] GET /compute/v2.1/servers/1567b85e-c179-4c65-9ec1-47b86cdba579 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:57:25.078075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b61d7fd4-dcdc-42de-a297-31602e78445f tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '.version_select at 0x7fed5c77c550>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:25.142147 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6ff672c2-32aa-4097-bb50-a90812a1256f tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 204 len: 0 microversion: 2.1 time: 0.174806 Mar 05 20:57:25.143243 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1240/2539] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:57:24 2022] DELETE /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:57:25.153903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-96323a6c-5a56-4be7-aba9-3aa810a6346f req-75e90093-6e19-4a2a-afa0-8856e3c22950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429f5dde-84d7-4bd3-a37a-066ac19fdc53", "tag": "2710cf64-1285-4d3b-8a24-95520a144b8c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:25.170664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-96323a6c-5a56-4be7-aba9-3aa810a6346f req-75e90093-6e19-4a2a-afa0-8856e3c22950 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.171429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-96323a6c-5a56-4be7-aba9-3aa810a6346f req-75e90093-6e19-4a2a-afa0-8856e3c22950 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.190130 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-96323a6c-5a56-4be7-aba9-3aa810a6346f req-75e90093-6e19-4a2a-afa0-8856e3c22950 service nova] Creating event network-changed:2710cf64-1285-4d3b-8a24-95520a144b8c for instance 429f5dde-84d7-4bd3-a37a-066ac19fdc53 on nch2-master-1 Mar 05 20:57:25.200610 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-96323a6c-5a56-4be7-aba9-3aa810a6346f req-75e90093-6e19-4a2a-afa0-8856e3c22950 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055136 Mar 05 20:57:25.202267 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1241/2540] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:25.211362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e8d29f08-b3f4-4ada-804b-c9e5396ece86 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:25.212594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e8d29f08-b3f4-4ada-804b-c9e5396ece86 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:25.221366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8d29f08-b3f4-4ada-804b-c9e5396ece86 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.222210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8d29f08-b3f4-4ada-804b-c9e5396ece86 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.224266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8d29f08-b3f4-4ada-804b-c9e5396ece86 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.224993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8d29f08-b3f4-4ada-804b-c9e5396ece86 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.390506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e8d29f08-b3f4-4ada-804b-c9e5396ece86 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:25.399352 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e8d29f08-b3f4-4ada-804b-c9e5396ece86 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.195781 Mar 05 20:57:25.400281 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1242/2541] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:25 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:25.415657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0ef3e432-b2fe-45b7-818b-4a9e93ff98ee tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:25.416543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0ef3e432-b2fe-45b7-818b-4a9e93ff98ee tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:25.424214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ef3e432-b2fe-45b7-818b-4a9e93ff98ee tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.424668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ef3e432-b2fe-45b7-818b-4a9e93ff98ee tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.425464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ef3e432-b2fe-45b7-818b-4a9e93ff98ee tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.426142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ef3e432-b2fe-45b7-818b-4a9e93ff98ee tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.440933 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-0ef3e432-b2fe-45b7-818b-4a9e93ff98ee tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] HTTP exception thrown: Instance 9dfc91a5-551d-4094-992f-f0efeefc3861 could not be found. Mar 05 20:57:25.441535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0ef3e432-b2fe-45b7-818b-4a9e93ff98ee tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Returning 404 to user: Instance 9dfc91a5-551d-4094-992f-f0efeefc3861 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:25.442414 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0ef3e432-b2fe-45b7-818b-4a9e93ff98ee tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 404 len: 111 microversion: 2.1 time: 0.041180 Mar 05 20:57:25.447793 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1243/2542] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:25 2022] GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:57:25.452556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8e5672a1-ffa4-4a46-bde4-e0feb31655e0 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:25.453175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8e5672a1-ffa4-4a46-bde4-e0feb31655e0 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:25.460956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e5672a1-ffa4-4a46-bde4-e0feb31655e0 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.461203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e5672a1-ffa4-4a46-bde4-e0feb31655e0 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.461932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e5672a1-ffa4-4a46-bde4-e0feb31655e0 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.462475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e5672a1-ffa4-4a46-bde4-e0feb31655e0 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.615997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8e5672a1-ffa4-4a46-bde4-e0feb31655e0 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:25.625964 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8e5672a1-ffa4-4a46-bde4-e0feb31655e0 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1351 microversion: 2.1 time: 0.177095 Mar 05 20:57:25.628019 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1244/2543] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:25 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1351 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:25.642611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ff903cdf-ab92-4f9f-b988-6828174b7eb8 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:25.669355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.compute.server_groups [None req-ff903cdf-ab92-4f9f-b988-6828174b7eb8 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Querying cell 591cc087-7d9b-4967-a4cd-9c96e8077593(cell1) for 1 instances {{(pid=141478) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 05 20:57:25.670290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff903cdf-ab92-4f9f-b988-6828174b7eb8 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.671559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff903cdf-ab92-4f9f-b988-6828174b7eb8 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.685777 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ff903cdf-ab92-4f9f-b988-6828174b7eb8 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.056234 Mar 05 20:57:25.691822 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1245/2544] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 20:57:25 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:25.693426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-936c9ada-a229-4fa7-bb9a-b5fbb11d3cbc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:25.693575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-936c9ada-a229-4fa7-bb9a-b5fbb11d3cbc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:25.700130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-936c9ada-a229-4fa7-bb9a-b5fbb11d3cbc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.700501 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-936c9ada-a229-4fa7-bb9a-b5fbb11d3cbc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.701627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-936c9ada-a229-4fa7-bb9a-b5fbb11d3cbc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.702035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-936c9ada-a229-4fa7-bb9a-b5fbb11d3cbc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.868336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-936c9ada-a229-4fa7-bb9a-b5fbb11d3cbc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:25.890497 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-936c9ada-a229-4fa7-bb9a-b5fbb11d3cbc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1311 microversion: 2.1 time: 0.194647 Mar 05 20:57:25.903512 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1246/2545] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:25 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:25.917182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-96564849-4602-4f2d-8912-565941b54970 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:25.932893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.compute.server_groups [None req-96564849-4602-4f2d-8912-565941b54970 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Querying cell 591cc087-7d9b-4967-a4cd-9c96e8077593(cell1) for 1 instances {{(pid=141478) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 05 20:57:25.933738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96564849-4602-4f2d-8912-565941b54970 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.934189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96564849-4602-4f2d-8912-565941b54970 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.949047 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-96564849-4602-4f2d-8912-565941b54970 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/os-server-groups/c4c6220d-c94b-401f-a643-d6b70bed83c9" status: 200 len: 183 microversion: 2.1 time: 0.043823 Mar 05 20:57:25.949855 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1247/2546] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:57:25 2022] GET /compute/v2.1/os-server-groups/c4c6220d-c94b-401f-a643-d6b70bed83c9 => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:25.961813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d5ae7e65-30cb-4619-919b-41a68ca6f310 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:25.962332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d5ae7e65-30cb-4619-919b-41a68ca6f310 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:25.969632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d5ae7e65-30cb-4619-919b-41a68ca6f310 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.970089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d5ae7e65-30cb-4619-919b-41a68ca6f310 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.971013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d5ae7e65-30cb-4619-919b-41a68ca6f310 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:25.971459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d5ae7e65-30cb-4619-919b-41a68ca6f310 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:25.987551 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-d5ae7e65-30cb-4619-919b-41a68ca6f310 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] HTTP exception thrown: Instance 9dfc91a5-551d-4094-992f-f0efeefc3861 could not be found. Mar 05 20:57:25.988240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d5ae7e65-30cb-4619-919b-41a68ca6f310 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Returning 404 to user: Instance 9dfc91a5-551d-4094-992f-f0efeefc3861 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:25.989112 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d5ae7e65-30cb-4619-919b-41a68ca6f310 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 404 len: 111 microversion: 2.1 time: 0.032808 Mar 05 20:57:25.990626 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1248/2547] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:57:25 2022] DELETE /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:57:25.999114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-24b010c2-61b0-4665-b8df-e3072b8a9864 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:25.999780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-24b010c2-61b0-4665-b8df-e3072b8a9864 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] [instance: 9dfc91a5-551d-4094-992f-f0efeefc3861] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:26.009409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24b010c2-61b0-4665-b8df-e3072b8a9864 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:26.009871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24b010c2-61b0-4665-b8df-e3072b8a9864 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:26.010687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24b010c2-61b0-4665-b8df-e3072b8a9864 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:26.011129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24b010c2-61b0-4665-b8df-e3072b8a9864 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:26.027982 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-24b010c2-61b0-4665-b8df-e3072b8a9864 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] HTTP exception thrown: Instance 9dfc91a5-551d-4094-992f-f0efeefc3861 could not be found. Mar 05 20:57:26.028823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-24b010c2-61b0-4665-b8df-e3072b8a9864 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Returning 404 to user: Instance 9dfc91a5-551d-4094-992f-f0efeefc3861 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:26.029703 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-24b010c2-61b0-4665-b8df-e3072b8a9864 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861" status: 404 len: 111 microversion: 2.1 time: 0.034832 Mar 05 20:57:26.033305 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1249/2548] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:25 2022] GET /compute/v2.1/servers/9dfc91a5-551d-4094-992f-f0efeefc3861 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:57:26.038742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3198c19b-b74b-49af-b342-a5ecec8ee43e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:26.039565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3198c19b-b74b-49af-b342-a5ecec8ee43e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:26.046735 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3198c19b-b74b-49af-b342-a5ecec8ee43e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:26.047348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3198c19b-b74b-49af-b342-a5ecec8ee43e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:26.048316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3198c19b-b74b-49af-b342-a5ecec8ee43e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:26.048868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3198c19b-b74b-49af-b342-a5ecec8ee43e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:26.219720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3198c19b-b74b-49af-b342-a5ecec8ee43e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:26.230072 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3198c19b-b74b-49af-b342-a5ecec8ee43e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.198211 Mar 05 20:57:26.231369 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1250/2549] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:26 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:26.243607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9198bf22-eb93-4bf0-94b2-08be89fa963b tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:26.251731 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-9198bf22-eb93-4bf0-94b2-08be89fa963b tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] HTTP exception thrown: Instance group 72633088-44cd-4da5-9dc3-e31bbd5a224a could not be found. Mar 05 20:57:26.252923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9198bf22-eb93-4bf0-94b2-08be89fa963b tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Returning 404 to user: Instance group 72633088-44cd-4da5-9dc3-e31bbd5a224a could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:26.254169 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9198bf22-eb93-4bf0-94b2-08be89fa963b tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "DELETE /compute/v2.1/os-server-groups/72633088-44cd-4da5-9dc3-e31bbd5a224a" status: 404 len: 117 microversion: 2.1 time: 0.016992 Mar 05 20:57:26.255696 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1251/2550] 10.222.0.15 () {58 vars in 1265 bytes} [Sat Mar 5 20:57:26 2022] DELETE /compute/v2.1/os-server-groups/72633088-44cd-4da5-9dc3-e31bbd5a224a => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:57:26.266520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7b94d97c-3693-42ef-9790-ae1da43cc62c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:26.277633 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-7b94d97c-3693-42ef-9790-ae1da43cc62c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] HTTP exception thrown: Instance group 42000a2c-8730-4c43-826b-48bcd83166b7 could not be found. Mar 05 20:57:26.278984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7b94d97c-3693-42ef-9790-ae1da43cc62c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Returning 404 to user: Instance group 42000a2c-8730-4c43-826b-48bcd83166b7 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:26.280263 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7b94d97c-3693-42ef-9790-ae1da43cc62c tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "DELETE /compute/v2.1/os-server-groups/42000a2c-8730-4c43-826b-48bcd83166b7" status: 404 len: 117 microversion: 2.1 time: 0.019997 Mar 05 20:57:26.284604 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1252/2551] 10.222.0.15 () {58 vars in 1265 bytes} [Sat Mar 5 20:57:26 2022] DELETE /compute/v2.1/os-server-groups/42000a2c-8730-4c43-826b-48bcd83166b7 => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:57:26.291445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23f859da-3522-46af-b410-e514ac3c9626 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:26.300235 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-23f859da-3522-46af-b410-e514ac3c9626 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] HTTP exception thrown: Instance group 10bbfeea-6deb-43b2-a87e-bc37f450dfaa could not be found. Mar 05 20:57:26.300962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23f859da-3522-46af-b410-e514ac3c9626 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Returning 404 to user: Instance group 10bbfeea-6deb-43b2-a87e-bc37f450dfaa could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:26.302774 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-23f859da-3522-46af-b410-e514ac3c9626 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "DELETE /compute/v2.1/os-server-groups/10bbfeea-6deb-43b2-a87e-bc37f450dfaa" status: 404 len: 117 microversion: 2.1 time: 0.016119 Mar 05 20:57:26.303659 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1253/2552] 10.222.0.15 () {58 vars in 1265 bytes} [Sat Mar 5 20:57:26 2022] DELETE /compute/v2.1/os-server-groups/10bbfeea-6deb-43b2-a87e-bc37f450dfaa => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:57:26.311860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2533ec73-eee1-4dc7-9ab9-fb3130fa54df tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:26.319290 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-2533ec73-eee1-4dc7-9ab9-fb3130fa54df tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] HTTP exception thrown: Instance group e29f7e78-8c6c-4aeb-a0ca-40cf155a5bdf could not be found. Mar 05 20:57:26.319927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2533ec73-eee1-4dc7-9ab9-fb3130fa54df tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Returning 404 to user: Instance group e29f7e78-8c6c-4aeb-a0ca-40cf155a5bdf could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:26.321219 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2533ec73-eee1-4dc7-9ab9-fb3130fa54df tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "DELETE /compute/v2.1/os-server-groups/e29f7e78-8c6c-4aeb-a0ca-40cf155a5bdf" status: 404 len: 117 microversion: 2.1 time: 0.013302 Mar 05 20:57:26.321777 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1254/2553] 10.222.0.15 () {58 vars in 1265 bytes} [Sat Mar 5 20:57:26 2022] DELETE /compute/v2.1/os-server-groups/e29f7e78-8c6c-4aeb-a0ca-40cf155a5bdf => generated 117 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:57:26.331437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-abf6081d-0950-474d-b693-69bd6f5a2140 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:26.363134 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-abf6081d-0950-474d-b693-69bd6f5a2140 tempest-ServerGroupTestJSON-224511159 tempest-ServerGroupTestJSON-224511159-project] 10.222.0.15 "DELETE /compute/v2.1/os-server-groups/c4c6220d-c94b-401f-a643-d6b70bed83c9" status: 204 len: 0 microversion: 2.1 time: 0.036494 Mar 05 20:57:26.377951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1255/2554] 10.222.0.15 () {58 vars in 1265 bytes} [Sat Mar 5 20:57:26 2022] DELETE /compute/v2.1/os-server-groups/c4c6220d-c94b-401f-a643-d6b70bed83c9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:57:26.419023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-48c64998-42ef-4df5-87e3-58e5df904d79 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:26.419574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-48c64998-42ef-4df5-87e3-58e5df904d79 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:26.430118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-48c64998-42ef-4df5-87e3-58e5df904d79 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:26.430118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-48c64998-42ef-4df5-87e3-58e5df904d79 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:26.431400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-48c64998-42ef-4df5-87e3-58e5df904d79 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:26.431878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-48c64998-42ef-4df5-87e3-58e5df904d79 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:26.708887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-48c64998-42ef-4df5-87e3-58e5df904d79 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:26.718958 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-48c64998-42ef-4df5-87e3-58e5df904d79 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.305776 Mar 05 20:57:26.728951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1256/2555] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:26 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:26.733918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-07e5efd9-ca59-4574-ab8e-d9304734763c tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:26.735034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-07e5efd9-ca59-4574-ab8e-d9304734763c tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:26.749730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-07e5efd9-ca59-4574-ab8e-d9304734763c tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:26.750522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-07e5efd9-ca59-4574-ab8e-d9304734763c tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:26.759739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-07e5efd9-ca59-4574-ab8e-d9304734763c tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:26.760486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-07e5efd9-ca59-4574-ab8e-d9304734763c tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:27.174908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-07e5efd9-ca59-4574-ab8e-d9304734763c tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:27.188249 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-07e5efd9-ca59-4574-ab8e-d9304734763c tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1351 microversion: 2.1 time: 0.465593 Mar 05 20:57:27.211204 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1257/2556] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:26 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1351 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:27.252758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-499eb68d-4651-4390-bfc5-cba78dc6d6db tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:27.254340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-499eb68d-4651-4390-bfc5-cba78dc6d6db tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:27.264918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-499eb68d-4651-4390-bfc5-cba78dc6d6db tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:27.265700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-499eb68d-4651-4390-bfc5-cba78dc6d6db tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:27.266728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-499eb68d-4651-4390-bfc5-cba78dc6d6db tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:27.267399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-499eb68d-4651-4390-bfc5-cba78dc6d6db tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:27.339701 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b61d7fd4-dcdc-42de-a297-31602e78445f tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "DELETE /compute/v2.1/os-floating-ips/9af4ff89-b376-4e3c-9626-d9bf55b8f125" status: 202 len: 0 microversion: 2.1 time: 2.265391 Mar 05 20:57:27.341217 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1300/2557] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:57:25 2022] DELETE /compute/v2.1/os-floating-ips/9af4ff89-b376-4e3c-9626-d9bf55b8f125 => generated 0 bytes in 2267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 20:57:27.347468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3cf46b28-7198-467a-9237-4ce5f84e8e2f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:27.348389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3cf46b28-7198-467a-9237-4ce5f84e8e2f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:27.363548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3cf46b28-7198-467a-9237-4ce5f84e8e2f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:27.364021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3cf46b28-7198-467a-9237-4ce5f84e8e2f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:27.365339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3cf46b28-7198-467a-9237-4ce5f84e8e2f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:27.365495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3cf46b28-7198-467a-9237-4ce5f84e8e2f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:27.495657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-499eb68d-4651-4390-bfc5-cba78dc6d6db tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:27.504878 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-499eb68d-4651-4390-bfc5-cba78dc6d6db tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1311 microversion: 2.1 time: 0.279436 Mar 05 20:57:27.506060 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1258/2558] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:27 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1311 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:27.524769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6bc651aa-6536-42db-8a3e-6fca44255ee3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:27.535963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6bc651aa-6536-42db-8a3e-6fca44255ee3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:27.549260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6bc651aa-6536-42db-8a3e-6fca44255ee3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:27.549688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6bc651aa-6536-42db-8a3e-6fca44255ee3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:27.550478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6bc651aa-6536-42db-8a3e-6fca44255ee3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:27.550910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6bc651aa-6536-42db-8a3e-6fca44255ee3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:27.610826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6bc651aa-6536-42db-8a3e-6fca44255ee3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:57:27.756518 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6bc651aa-6536-42db-8a3e-6fca44255ee3 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "DELETE /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 204 len: 0 microversion: 2.1 time: 0.236890 Mar 05 20:57:27.757502 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1259/2559] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:57:27 2022] DELETE /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:57:27.770849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-000cf4b6-68f0-4ecf-ae5b-6582b1486493 req-496490b4-5543-467d-b966-a6828f98eb5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eefc9ca-6a02-4bf8-8239-ad67aaab69b0", "name": "network-vif-plugged", "status": "completed", "tag": "66b1650a-3e82-4d7d-b60f-82261d656e4c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:27.796284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-000cf4b6-68f0-4ecf-ae5b-6582b1486493 req-496490b4-5543-467d-b966-a6828f98eb5c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:27.796635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3cf46b28-7198-467a-9237-4ce5f84e8e2f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:27.796808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-000cf4b6-68f0-4ecf-ae5b-6582b1486493 req-496490b4-5543-467d-b966-a6828f98eb5c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:27.806684 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3cf46b28-7198-467a-9237-4ce5f84e8e2f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.464172 Mar 05 20:57:27.812687 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1301/2560] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:27 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:27.826793 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-000cf4b6-68f0-4ecf-ae5b-6582b1486493 req-496490b4-5543-467d-b966-a6828f98eb5c service nova] Creating event network-vif-plugged:66b1650a-3e82-4d7d-b60f-82261d656e4c for instance 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 on nch1-master-1 Mar 05 20:57:27.829478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0e29bff7-6708-4a5b-9094-b99ea99212fe tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:27.831213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0e29bff7-6708-4a5b-9094-b99ea99212fe tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:27.837892 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-000cf4b6-68f0-4ecf-ae5b-6582b1486493 req-496490b4-5543-467d-b966-a6828f98eb5c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078562 Mar 05 20:57:27.839137 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1260/2561] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:27.845312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e29bff7-6708-4a5b-9094-b99ea99212fe tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:27.846726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9546aaa0-e0a6-4943-857a-69b0937e9665 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:27.847535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9546aaa0-e0a6-4943-857a-69b0937e9665 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:27.861061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e29bff7-6708-4a5b-9094-b99ea99212fe tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:27.864015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e29bff7-6708-4a5b-9094-b99ea99212fe tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:27.873643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9546aaa0-e0a6-4943-857a-69b0937e9665 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:27.874130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9546aaa0-e0a6-4943-857a-69b0937e9665 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:27.874945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9546aaa0-e0a6-4943-857a-69b0937e9665 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:27.875388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9546aaa0-e0a6-4943-857a-69b0937e9665 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:27.879176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e29bff7-6708-4a5b-9094-b99ea99212fe tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:28.281569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0e29bff7-6708-4a5b-9094-b99ea99212fe tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:28.287817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9546aaa0-e0a6-4943-857a-69b0937e9665 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:28.289412 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0e29bff7-6708-4a5b-9094-b99ea99212fe tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1507 microversion: 2.1 time: 0.474458 Mar 05 20:57:28.304037 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1302/2562] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:27 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1507 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:28.310821 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9546aaa0-e0a6-4943-857a-69b0937e9665 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1525 microversion: 2.1 time: 0.466272 Mar 05 20:57:28.311551 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1261/2563] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:27 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1525 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:28.313981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-25491738-a959-44d1-a9c8-02589c7f7e86 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:28.314873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-25491738-a959-44d1-a9c8-02589c7f7e86 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:28.323379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-25491738-a959-44d1-a9c8-02589c7f7e86 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:28.324726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-25491738-a959-44d1-a9c8-02589c7f7e86 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:28.325762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-25491738-a959-44d1-a9c8-02589c7f7e86 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:28.326286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-25491738-a959-44d1-a9c8-02589c7f7e86 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:28.525316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3f999854-181f-454c-b665-df9873c5b378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:28.525954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3f999854-181f-454c-b665-df9873c5b378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:28.538739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f999854-181f-454c-b665-df9873c5b378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:28.539509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f999854-181f-454c-b665-df9873c5b378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:28.543845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f999854-181f-454c-b665-df9873c5b378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:28.544510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f999854-181f-454c-b665-df9873c5b378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:28.603885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-25491738-a959-44d1-a9c8-02589c7f7e86 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:28.615725 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-25491738-a959-44d1-a9c8-02589c7f7e86 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1351 microversion: 2.1 time: 0.306385 Mar 05 20:57:28.626357 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1303/2564] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:28 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1351 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:28.828626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-da491639-507c-4dc8-8cfc-44e80d6c32bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:28.829251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-da491639-507c-4dc8-8cfc-44e80d6c32bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:28.837218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da491639-507c-4dc8-8cfc-44e80d6c32bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:28.837681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da491639-507c-4dc8-8cfc-44e80d6c32bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:28.838481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da491639-507c-4dc8-8cfc-44e80d6c32bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:28.838926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da491639-507c-4dc8-8cfc-44e80d6c32bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:28.912311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3f999854-181f-454c-b665-df9873c5b378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:28.920304 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3f999854-181f-454c-b665-df9873c5b378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1311 microversion: 2.1 time: 0.401031 Mar 05 20:57:28.931524 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1262/2565] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:28 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1311 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:57:29.188478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5819cec7-da5b-49da-aa86-16a7495f9e32 req-5d139074-7382-41a2-9ec8-e4237d1c9751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5525dc-a44a-4aa9-af58-a6f93058155e", "name": "network-vif-deleted", "tag": "207ec9a3-97bb-4f65-9dd6-1a65d33c9cf5"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:29.191349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-da491639-507c-4dc8-8cfc-44e80d6c32bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:29.204912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5819cec7-da5b-49da-aa86-16a7495f9e32 req-5d139074-7382-41a2-9ec8-e4237d1c9751 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:29.205387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5819cec7-da5b-49da-aa86-16a7495f9e32 req-5d139074-7382-41a2-9ec8-e4237d1c9751 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:29.210201 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-da491639-507c-4dc8-8cfc-44e80d6c32bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.385439 Mar 05 20:57:29.212198 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1304/2566] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:28 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:57:29.227356 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-5819cec7-da5b-49da-aa86-16a7495f9e32 req-5d139074-7382-41a2-9ec8-e4237d1c9751 service nova] Creating event network-vif-deleted:207ec9a3-97bb-4f65-9dd6-1a65d33c9cf5 for instance ac5525dc-a44a-4aa9-af58-a6f93058155e on nch2-master-1 Mar 05 20:57:29.233121 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5819cec7-da5b-49da-aa86-16a7495f9e32 req-5d139074-7382-41a2-9ec8-e4237d1c9751 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048859 Mar 05 20:57:29.238013 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1263/2567] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:29.311346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-70a6281c-722b-43c8-802f-3bb5732085ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:29.313271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-70a6281c-722b-43c8-802f-3bb5732085ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:29.324100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70a6281c-722b-43c8-802f-3bb5732085ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:29.324886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70a6281c-722b-43c8-802f-3bb5732085ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:29.326103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70a6281c-722b-43c8-802f-3bb5732085ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:29.326854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70a6281c-722b-43c8-802f-3bb5732085ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:29.331101 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-08ac9a3a-0153-4032-87a5-d71a94f677f7 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:29.331864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-08ac9a3a-0153-4032-87a5-d71a94f677f7 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:29.339543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08ac9a3a-0153-4032-87a5-d71a94f677f7 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:29.340396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08ac9a3a-0153-4032-87a5-d71a94f677f7 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:29.341371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08ac9a3a-0153-4032-87a5-d71a94f677f7 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:29.341987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08ac9a3a-0153-4032-87a5-d71a94f677f7 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:29.366555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70a6281c-722b-43c8-802f-3bb5732085ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:29.367313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70a6281c-722b-43c8-802f-3bb5732085ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:29.367915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-70a6281c-722b-43c8-802f-3bb5732085ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lazy-loading 'fault' on Instance uuid ac5525dc-a44a-4aa9-af58-a6f93058155e {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:57:29.411108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-70a6281c-722b-43c8-802f-3bb5732085ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:29.420174 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-70a6281c-722b-43c8-802f-3bb5732085ba tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 200 len: 1304 microversion: 2.1 time: 0.116560 Mar 05 20:57:29.420945 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1305/2568] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:29 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:29.633375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7220138b-036e-4180-9178-e0867a9ac1f6 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:29.635572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7220138b-036e-4180-9178-e0867a9ac1f6 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:29.642258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7220138b-036e-4180-9178-e0867a9ac1f6 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:29.642721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7220138b-036e-4180-9178-e0867a9ac1f6 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:29.643510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7220138b-036e-4180-9178-e0867a9ac1f6 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:29.644207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7220138b-036e-4180-9178-e0867a9ac1f6 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:29.797047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7220138b-036e-4180-9178-e0867a9ac1f6 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:29.805312 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7220138b-036e-4180-9178-e0867a9ac1f6 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1351 microversion: 2.1 time: 0.176287 Mar 05 20:57:29.805897 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1306/2569] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:29 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1351 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:57:29.856434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-08ac9a3a-0153-4032-87a5-d71a94f677f7 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:29.861184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-0a00c81c-6e11-463f-a10e-7897d5c51a70 req-6505d38a-e935-4764-ac3a-3a5ad1effbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6207958f-00b7-4d0e-b1a7-e17e3ddf371c", "name": "network-vif-plugged", "status": "completed", "tag": "b7562f27-5f06-4bcc-a8b8-962b8a5a7750"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:29.866030 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-08ac9a3a-0153-4032-87a5-d71a94f677f7 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1525 microversion: 2.1 time: 0.538799 Mar 05 20:57:29.866951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1264/2570] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:29 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1525 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:29.871706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0a00c81c-6e11-463f-a10e-7897d5c51a70 req-6505d38a-e935-4764-ac3a-3a5ad1effbc1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:29.872279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0a00c81c-6e11-463f-a10e-7897d5c51a70 req-6505d38a-e935-4764-ac3a-3a5ad1effbc1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:29.884516 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0a00c81c-6e11-463f-a10e-7897d5c51a70 req-6505d38a-e935-4764-ac3a-3a5ad1effbc1 service nova] Creating event network-vif-plugged:b7562f27-5f06-4bcc-a8b8-962b8a5a7750 for instance 6207958f-00b7-4d0e-b1a7-e17e3ddf371c on nch2-master-1 Mar 05 20:57:29.890946 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-0a00c81c-6e11-463f-a10e-7897d5c51a70 req-6505d38a-e935-4764-ac3a-3a5ad1effbc1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034586 Mar 05 20:57:29.891726 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1307/2571] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:57:29.938295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-30fa510a-4eb5-425c-b54e-02074a427b74 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:29.939607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-30fa510a-4eb5-425c-b54e-02074a427b74 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:29.948855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30fa510a-4eb5-425c-b54e-02074a427b74 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:29.949604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30fa510a-4eb5-425c-b54e-02074a427b74 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:29.950657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30fa510a-4eb5-425c-b54e-02074a427b74 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:29.951373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30fa510a-4eb5-425c-b54e-02074a427b74 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.230841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eb80936d-549c-487d-a18b-39169c4c9a46 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:30.231741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eb80936d-549c-487d-a18b-39169c4c9a46 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:30.245672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb80936d-549c-487d-a18b-39169c4c9a46 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:30.248406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb80936d-549c-487d-a18b-39169c4c9a46 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.249831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb80936d-549c-487d-a18b-39169c4c9a46 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:30.251275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb80936d-549c-487d-a18b-39169c4c9a46 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.289432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-30fa510a-4eb5-425c-b54e-02074a427b74 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:30.305301 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-30fa510a-4eb5-425c-b54e-02074a427b74 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1494 microversion: 2.1 time: 0.370774 Mar 05 20:57:30.305915 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1265/2572] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:29 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1494 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:30.322413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f6e0937b-33a6-4614-bcf1-abf44b49b23f tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:30.325960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f6e0937b-33a6-4614-bcf1-abf44b49b23f tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:30.335878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6e0937b-33a6-4614-bcf1-abf44b49b23f tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:30.336572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6e0937b-33a6-4614-bcf1-abf44b49b23f tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.338360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6e0937b-33a6-4614-bcf1-abf44b49b23f tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:30.338998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6e0937b-33a6-4614-bcf1-abf44b49b23f tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.573826 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f6e0937b-33a6-4614-bcf1-abf44b49b23f tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1645 microversion: 2.1 time: 0.255056 Mar 05 20:57:30.586800 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1266/2573] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:30 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1645 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:30.592449 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f75d1f42-602d-4f79-920e-f3f4c3f999f7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:30.593136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f75d1f42-602d-4f79-920e-f3f4c3f999f7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: ac5525dc-a44a-4aa9-af58-a6f93058155e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:30.600176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f75d1f42-602d-4f79-920e-f3f4c3f999f7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:30.600637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f75d1f42-602d-4f79-920e-f3f4c3f999f7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.601424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f75d1f42-602d-4f79-920e-f3f4c3f999f7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:30.601869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f75d1f42-602d-4f79-920e-f3f4c3f999f7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.617198 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-f75d1f42-602d-4f79-920e-f3f4c3f999f7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] HTTP exception thrown: Instance ac5525dc-a44a-4aa9-af58-a6f93058155e could not be found. Mar 05 20:57:30.618154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f75d1f42-602d-4f79-920e-f3f4c3f999f7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Returning 404 to user: Instance ac5525dc-a44a-4aa9-af58-a6f93058155e could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:30.619206 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f75d1f42-602d-4f79-920e-f3f4c3f999f7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e" status: 404 len: 111 microversion: 2.1 time: 0.031136 Mar 05 20:57:30.623151 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1267/2574] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:30 2022] GET /compute/v2.1/servers/ac5525dc-a44a-4aa9-af58-a6f93058155e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:57:30.628251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-0f2e2c95-0ccf-4a5c-95ef-7f16c4b16c70 req-73a0a61a-c98e-4003-89fe-8a6f3be5a369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429f5dde-84d7-4bd3-a37a-066ac19fdc53", "name": "network-vif-deleted", "tag": "2710cf64-1285-4d3b-8a24-95520a144b8c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:30.638039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-0f2e2c95-0ccf-4a5c-95ef-7f16c4b16c70 req-73a0a61a-c98e-4003-89fe-8a6f3be5a369 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:30.638699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-0f2e2c95-0ccf-4a5c-95ef-7f16c4b16c70 req-73a0a61a-c98e-4003-89fe-8a6f3be5a369 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.639461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eb80936d-549c-487d-a18b-39169c4c9a46 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:30.652545 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eb80936d-549c-487d-a18b-39169c4c9a46 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.426030 Mar 05 20:57:30.653945 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1308/2575] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:30 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:57:30.660597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c5222fcc-7f36-482a-bdd3-8d244078a840 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:30.661546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c5222fcc-7f36-482a-bdd3-8d244078a840 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:30.669068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5222fcc-7f36-482a-bdd3-8d244078a840 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:30.669716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5222fcc-7f36-482a-bdd3-8d244078a840 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.670680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5222fcc-7f36-482a-bdd3-8d244078a840 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:30.671303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5222fcc-7f36-482a-bdd3-8d244078a840 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.672384 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-0f2e2c95-0ccf-4a5c-95ef-7f16c4b16c70 req-73a0a61a-c98e-4003-89fe-8a6f3be5a369 service nova] Creating event network-vif-deleted:2710cf64-1285-4d3b-8a24-95520a144b8c for instance 429f5dde-84d7-4bd3-a37a-066ac19fdc53 on nch2-master-1 Mar 05 20:57:30.678818 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-0f2e2c95-0ccf-4a5c-95ef-7f16c4b16c70 req-73a0a61a-c98e-4003-89fe-8a6f3be5a369 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053979 Mar 05 20:57:30.679486 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1268/2576] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:30.687337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8bf0abd8-387f-4e58-865c-6d27a512ede7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:30.688202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8bf0abd8-387f-4e58-865c-6d27a512ede7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:30.695364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bf0abd8-387f-4e58-865c-6d27a512ede7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:30.696154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bf0abd8-387f-4e58-865c-6d27a512ede7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.697117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bf0abd8-387f-4e58-865c-6d27a512ede7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:30.697573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bf0abd8-387f-4e58-865c-6d27a512ede7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.731456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8bf0abd8-387f-4e58-865c-6d27a512ede7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:57:30.903955 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8bf0abd8-387f-4e58-865c-6d27a512ede7 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 204 len: 0 microversion: 2.1 time: 0.222605 Mar 05 20:57:30.905969 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1269/2577] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:57:30 2022] DELETE /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:57:30.925010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a360a06f-ec04-429a-b6bb-e55c4f2222dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:30.926105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a360a06f-ec04-429a-b6bb-e55c4f2222dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:30.941269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a360a06f-ec04-429a-b6bb-e55c4f2222dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:30.941929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a360a06f-ec04-429a-b6bb-e55c4f2222dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.945649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a360a06f-ec04-429a-b6bb-e55c4f2222dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:30.946118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a360a06f-ec04-429a-b6bb-e55c4f2222dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:30.981485 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c5222fcc-7f36-482a-bdd3-8d244078a840 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1645 microversion: 2.1 time: 0.325675 Mar 05 20:57:30.994999 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1309/2578] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:30 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1645 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:31.007280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-93348e40-0af6-485f-a87f-c9d72180c672 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:31.008193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-93348e40-0af6-485f-a87f-c9d72180c672 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:31.021408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93348e40-0af6-485f-a87f-c9d72180c672 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:31.024441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93348e40-0af6-485f-a87f-c9d72180c672 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:31.028094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93348e40-0af6-485f-a87f-c9d72180c672 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:31.028867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93348e40-0af6-485f-a87f-c9d72180c672 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:31.081152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93348e40-0af6-485f-a87f-c9d72180c672 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:31.081986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93348e40-0af6-485f-a87f-c9d72180c672 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:31.082452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-93348e40-0af6-485f-a87f-c9d72180c672 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lazy-loading 'fault' on Instance uuid 429f5dde-84d7-4bd3-a37a-066ac19fdc53 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:57:31.150121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-93348e40-0af6-485f-a87f-c9d72180c672 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9680dd9b3f2b47c9810ae22052714bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933b162d4a3044f38bed8c339cc621ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:31.159375 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-93348e40-0af6-485f-a87f-c9d72180c672 tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 200 len: 1313 microversion: 2.1 time: 0.162947 Mar 05 20:57:31.161426 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1310/2579] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:30 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:31.166651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eeb91f87-369e-4d3e-a6d8-d8b5b5db8436 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:31.167263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eeb91f87-369e-4d3e-a6d8-d8b5b5db8436 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:31.178124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eeb91f87-369e-4d3e-a6d8-d8b5b5db8436 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:31.178570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eeb91f87-369e-4d3e-a6d8-d8b5b5db8436 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:31.180780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eeb91f87-369e-4d3e-a6d8-d8b5b5db8436 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:31.181398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eeb91f87-369e-4d3e-a6d8-d8b5b5db8436 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:31.228409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a360a06f-ec04-429a-b6bb-e55c4f2222dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:31.247785 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a360a06f-ec04-429a-b6bb-e55c4f2222dc tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1351 microversion: 2.1 time: 0.339773 Mar 05 20:57:31.256572 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1270/2580] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:30 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1351 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:31.265888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-774403d1-9e74-4e45-bb67-9d3674da7a72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:31.271454 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:57:31.271454 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:57:31.274705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-774403d1-9e74-4e45-bb67-9d3674da7a72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:31.276582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-774403d1-9e74-4e45-bb67-9d3674da7a72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:31.279311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-774403d1-9e74-4e45-bb67-9d3674da7a72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:31.280556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-774403d1-9e74-4e45-bb67-9d3674da7a72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:31.337302 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-774403d1-9e74-4e45-bb67-9d3674da7a72 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.079342 Mar 05 20:57:31.338351 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1271/2581] 10.222.0.15 () {58 vars in 1175 bytes} [Sat Mar 5 20:57:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:31.352640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f3d33f01-e78e-4abd-aec7-3cb236a22996 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:31.353784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f3d33f01-e78e-4abd-aec7-3cb236a22996 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:31.373649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3d33f01-e78e-4abd-aec7-3cb236a22996 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:31.374358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3d33f01-e78e-4abd-aec7-3cb236a22996 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:31.375459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3d33f01-e78e-4abd-aec7-3cb236a22996 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:31.378091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3d33f01-e78e-4abd-aec7-3cb236a22996 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:31.433172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eeb91f87-369e-4d3e-a6d8-d8b5b5db8436 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:31.442527 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eeb91f87-369e-4d3e-a6d8-d8b5b5db8436 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1493 microversion: 2.1 time: 0.279539 Mar 05 20:57:31.443184 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1311/2582] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:31 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1493 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:31.465771 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f3d33f01-e78e-4abd-aec7-3cb236a22996 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0/action" status: 202 len: 0 microversion: 2.1 time: 0.120108 Mar 05 20:57:31.469778 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1272/2583] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:57:31 2022] POST /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 20:57:31.476082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8fa6faad-18cb-41f0-9f56-6a81abed3b9e tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:31.476819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8fa6faad-18cb-41f0-9f56-6a81abed3b9e tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:31.484144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8fa6faad-18cb-41f0-9f56-6a81abed3b9e tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:31.484736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8fa6faad-18cb-41f0-9f56-6a81abed3b9e tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:31.485694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8fa6faad-18cb-41f0-9f56-6a81abed3b9e tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:31.486143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8fa6faad-18cb-41f0-9f56-6a81abed3b9e tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:31.645272 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8fa6faad-18cb-41f0-9f56-6a81abed3b9e tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1650 microversion: 2.1 time: 0.174173 Mar 05 20:57:31.648323 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1273/2584] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:31 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1650 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:31.672642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-365f8664-38cf-4193-8c26-c1f26763c6e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:31.673649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-365f8664-38cf-4193-8c26-c1f26763c6e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:31.683435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-365f8664-38cf-4193-8c26-c1f26763c6e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:31.684419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-365f8664-38cf-4193-8c26-c1f26763c6e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:31.685649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-365f8664-38cf-4193-8c26-c1f26763c6e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:31.686499 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-365f8664-38cf-4193-8c26-c1f26763c6e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:31.731413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1820370080", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "392366d0-e40a-42b0-9a34-c5edf1d859e7"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:31.793480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] validate_networks() for [('392366d0-e40a-42b0-9a34-c5edf1d859e7', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:57:31.851081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-365f8664-38cf-4193-8c26-c1f26763c6e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:31.860514 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-365f8664-38cf-4193-8c26-c1f26763c6e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.193411 Mar 05 20:57:31.864015 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1274/2585] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:31 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:32.162709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:57:32.163146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:57:32.163628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:57:32.164075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:57:32.164531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:57:32.173966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.174427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.175234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.175698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.177335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7240f6d6-8979-44d7-81b9-05b798500d4c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:32.177967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7240f6d6-8979-44d7-81b9-05b798500d4c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] [instance: 429f5dde-84d7-4bd3-a37a-066ac19fdc53] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:32.184863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7240f6d6-8979-44d7-81b9-05b798500d4c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.185325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7240f6d6-8979-44d7-81b9-05b798500d4c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.186113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7240f6d6-8979-44d7-81b9-05b798500d4c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.186555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7240f6d6-8979-44d7-81b9-05b798500d4c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.193246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Getting quotas for project 942cce2cde71460d95a12bea3862813d. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:57:32.198519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Getting quotas for user fb81a21681024c0188aedcc5f5287d7d and project 942cce2cde71460d95a12bea3862813d. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:57:32.200936 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-7240f6d6-8979-44d7-81b9-05b798500d4c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] HTTP exception thrown: Instance 429f5dde-84d7-4bd3-a37a-066ac19fdc53 could not be found. Mar 05 20:57:32.201572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7240f6d6-8979-44d7-81b9-05b798500d4c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] Returning 404 to user: Instance 429f5dde-84d7-4bd3-a37a-066ac19fdc53 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:32.202623 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7240f6d6-8979-44d7-81b9-05b798500d4c tempest-FloatingIPsAssociationTestJSON-180952550 tempest-FloatingIPsAssociationTestJSON-180952550-project] 10.222.0.15 "GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53" status: 404 len: 111 microversion: 2.1 time: 0.029182 Mar 05 20:57:32.203354 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1275/2586] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:32 2022] GET /compute/v2.1/servers/429f5dde-84d7-4bd3-a37a-066ac19fdc53 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:57:32.212734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:57:32.215776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:57:32.273383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd4c42ae-2d3d-4364-8b66-026ed962ef7d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:32.273886 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2476b8f4-9c9b-4360-a5e5-7a4ceabef7f4 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829414 Mar 05 20:57:32.274961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd4c42ae-2d3d-4364-8b66-026ed962ef7d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:32.275263 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1312/2587] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:57:32.287062 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd4c42ae-2d3d-4364-8b66-026ed962ef7d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.287958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-144e6022-d728-46c2-9411-cb49cbb12bcc tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:32.288750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-144e6022-d728-46c2-9411-cb49cbb12bcc tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:32.289119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd4c42ae-2d3d-4364-8b66-026ed962ef7d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.290213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd4c42ae-2d3d-4364-8b66-026ed962ef7d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.290829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd4c42ae-2d3d-4364-8b66-026ed962ef7d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.365313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-144e6022-d728-46c2-9411-cb49cbb12bcc tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:32.371970 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-144e6022-d728-46c2-9411-cb49cbb12bcc tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1216 microversion: 2.1 time: 0.090388 Mar 05 20:57:32.373684 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1313/2588] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:32 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1216 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:32.459979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f68ec0fe-37c7-4b5a-aa98-e4304fe5c075 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:32.460610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f68ec0fe-37c7-4b5a-aa98-e4304fe5c075 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:32.468621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f68ec0fe-37c7-4b5a-aa98-e4304fe5c075 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.469159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f68ec0fe-37c7-4b5a-aa98-e4304fe5c075 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.470065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f68ec0fe-37c7-4b5a-aa98-e4304fe5c075 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.478532 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f68ec0fe-37c7-4b5a-aa98-e4304fe5c075 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.598093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd4c42ae-2d3d-4364-8b66-026ed962ef7d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:32.609523 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd4c42ae-2d3d-4364-8b66-026ed962ef7d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1540 microversion: 2.1 time: 0.340508 Mar 05 20:57:32.620644 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1276/2589] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:32 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1540 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:32.629038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bb10a221-215f-400f-bc47-60087b0a7feb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:32.629868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bb10a221-215f-400f-bc47-60087b0a7feb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:32.637645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bb10a221-215f-400f-bc47-60087b0a7feb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.638566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bb10a221-215f-400f-bc47-60087b0a7feb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.639877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bb10a221-215f-400f-bc47-60087b0a7feb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.641640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bb10a221-215f-400f-bc47-60087b0a7feb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.660144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f68ec0fe-37c7-4b5a-aa98-e4304fe5c075 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:32.669037 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f68ec0fe-37c7-4b5a-aa98-e4304fe5c075 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1493 microversion: 2.1 time: 0.213849 Mar 05 20:57:32.678833 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1314/2590] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:32 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1493 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:32.683710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-03f8ab88-0774-416c-a788-0e71e59783ff tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:32.684609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-03f8ab88-0774-416c-a788-0e71e59783ff tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:32.691438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03f8ab88-0774-416c-a788-0e71e59783ff tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.692788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03f8ab88-0774-416c-a788-0e71e59783ff tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.693961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03f8ab88-0774-416c-a788-0e71e59783ff tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.694407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03f8ab88-0774-416c-a788-0e71e59783ff tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.821324 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bb10a221-215f-400f-bc47-60087b0a7feb tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196316 Mar 05 20:57:32.822392 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1277/2591] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 20:57:32 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:32.904767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-abef0c23-4789-4ddc-b8ec-e77aa4553e1c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:32.906120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-abef0c23-4789-4ddc-b8ec-e77aa4553e1c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:32.914444 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-03f8ab88-0774-416c-a788-0e71e59783ff tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1630 microversion: 2.1 time: 0.230981 Mar 05 20:57:32.917843 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1315/2592] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:32 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1630 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:32.940975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abef0c23-4789-4ddc-b8ec-e77aa4553e1c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.945972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b5cdaafe-b821-4bde-b65a-1e0aed570abc tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:32.947219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abef0c23-4789-4ddc-b8ec-e77aa4553e1c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.950265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abef0c23-4789-4ddc-b8ec-e77aa4553e1c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.950741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abef0c23-4789-4ddc-b8ec-e77aa4553e1c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.952152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b5cdaafe-b821-4bde-b65a-1e0aed570abc tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:32.968940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5cdaafe-b821-4bde-b65a-1e0aed570abc tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.969383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5cdaafe-b821-4bde-b65a-1e0aed570abc tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:32.970500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5cdaafe-b821-4bde-b65a-1e0aed570abc tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:32.979849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5cdaafe-b821-4bde-b65a-1e0aed570abc tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:33.037481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-b5cdaafe-b821-4bde-b65a-1e0aed570abc tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lazy-loading 'flavor' on Instance uuid 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:57:33.052198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b5cdaafe-b821-4bde-b65a-1e0aed570abc tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Going to try to live migrate instance to nch2-master-1 {{(pid=141479) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 05 20:57:33.925825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-abef0c23-4789-4ddc-b8ec-e77aa4553e1c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:33.934582 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-abef0c23-4789-4ddc-b8ec-e77aa4553e1c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 1.060494 Mar 05 20:57:33.945442 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1278/2593] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:32 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:57:33.951631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a9f5c9db-5c52-4f87-8cb5-807d65ad4510 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:33.952287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a9f5c9db-5c52-4f87-8cb5-807d65ad4510 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:33.962428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9f5c9db-5c52-4f87-8cb5-807d65ad4510 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:33.962987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9f5c9db-5c52-4f87-8cb5-807d65ad4510 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:33.963888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9f5c9db-5c52-4f87-8cb5-807d65ad4510 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:33.964321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9f5c9db-5c52-4f87-8cb5-807d65ad4510 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:34.078969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a9f5c9db-5c52-4f87-8cb5-807d65ad4510 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:34.090185 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a9f5c9db-5c52-4f87-8cb5-807d65ad4510 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1274 microversion: 2.1 time: 0.143214 Mar 05 20:57:34.091132 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1279/2594] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:33 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1274 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:34.101475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0d0f447d-2f19-4500-bc27-dc7f92bb6d23 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:34.102542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0d0f447d-2f19-4500-bc27-dc7f92bb6d23 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:34.110395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d0f447d-2f19-4500-bc27-dc7f92bb6d23 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:34.110855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d0f447d-2f19-4500-bc27-dc7f92bb6d23 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:34.111656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d0f447d-2f19-4500-bc27-dc7f92bb6d23 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:34.112128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d0f447d-2f19-4500-bc27-dc7f92bb6d23 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:34.514288 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b5cdaafe-b821-4bde-b65a-1e0aed570abc tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0/action" status: 202 len: 0 microversion: 2.1 time: 1.578424 Mar 05 20:57:34.515350 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1316/2595] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:57:32 2022] POST /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0/action => generated 0 bytes in 1581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:57:34.524581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-15c707c3-5f12-45ec-b553-b271280d642b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:34.525395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-15c707c3-5f12-45ec-b553-b271280d642b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:34.536124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-15c707c3-5f12-45ec-b553-b271280d642b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:34.536574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-15c707c3-5f12-45ec-b553-b271280d642b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:34.537729 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-15c707c3-5f12-45ec-b553-b271280d642b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:34.538364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-15c707c3-5f12-45ec-b553-b271280d642b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:34.773903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-15c707c3-5f12-45ec-b553-b271280d642b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:34.783945 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-15c707c3-5f12-45ec-b553-b271280d642b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1504 microversion: 2.1 time: 0.264739 Mar 05 20:57:34.785310 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1317/2596] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:34 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:34.952497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-39e3dc09-51fc-4966-a85e-eff6c30f916d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:34.953536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-39e3dc09-51fc-4966-a85e-eff6c30f916d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:34.962124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39e3dc09-51fc-4966-a85e-eff6c30f916d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:34.962913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39e3dc09-51fc-4966-a85e-eff6c30f916d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:34.963994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39e3dc09-51fc-4966-a85e-eff6c30f916d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:34.964636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39e3dc09-51fc-4966-a85e-eff6c30f916d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:35.122436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0d0f447d-2f19-4500-bc27-dc7f92bb6d23 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:35.131194 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0d0f447d-2f19-4500-bc27-dc7f92bb6d23 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1493 microversion: 2.1 time: 1.038820 Mar 05 20:57:35.141888 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1280/2597] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:34 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1493 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:35.147828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5b02da15-4750-407a-bd42-23e8b8c2e6cf tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:35.148661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5b02da15-4750-407a-bd42-23e8b8c2e6cf tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:35.155832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b02da15-4750-407a-bd42-23e8b8c2e6cf tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:35.156482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b02da15-4750-407a-bd42-23e8b8c2e6cf tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:35.157495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b02da15-4750-407a-bd42-23e8b8c2e6cf tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:35.158100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b02da15-4750-407a-bd42-23e8b8c2e6cf tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:35.258241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-39e3dc09-51fc-4966-a85e-eff6c30f916d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:35.269494 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-39e3dc09-51fc-4966-a85e-eff6c30f916d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.320754 Mar 05 20:57:35.273230 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1318/2598] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:34 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:35.337944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5b02da15-4750-407a-bd42-23e8b8c2e6cf tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:35.349323 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5b02da15-4750-407a-bd42-23e8b8c2e6cf tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1274 microversion: 2.1 time: 0.204971 Mar 05 20:57:35.352222 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1281/2599] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:35 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:35.803014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-19f24dc4-8e6d-421c-9efc-50f708e27b70 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:35.803752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-19f24dc4-8e6d-421c-9efc-50f708e27b70 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:35.813119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19f24dc4-8e6d-421c-9efc-50f708e27b70 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:35.813653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19f24dc4-8e6d-421c-9efc-50f708e27b70 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:35.814686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19f24dc4-8e6d-421c-9efc-50f708e27b70 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:35.815346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19f24dc4-8e6d-421c-9efc-50f708e27b70 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:35.845340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b9b29e21-6bd8-406e-a2f1-446fb0cc9317 req-134ec8d7-41ca-414a-9f1e-12dfcf77c371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf09b77b-5755-4ebd-bbcd-c47541a58af5", "name": "network-vif-deleted", "tag": "c02ff863-577b-4f41-9058-0e457c4739d0"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:35.860949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b9b29e21-6bd8-406e-a2f1-446fb0cc9317 req-134ec8d7-41ca-414a-9f1e-12dfcf77c371 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:35.869127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b9b29e21-6bd8-406e-a2f1-446fb0cc9317 req-134ec8d7-41ca-414a-9f1e-12dfcf77c371 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:35.896487 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-b9b29e21-6bd8-406e-a2f1-446fb0cc9317 req-134ec8d7-41ca-414a-9f1e-12dfcf77c371 service nova] Creating event network-vif-deleted:c02ff863-577b-4f41-9058-0e457c4739d0 for instance bf09b77b-5755-4ebd-bbcd-c47541a58af5 on nch1-master-1 Mar 05 20:57:35.901677 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b9b29e21-6bd8-406e-a2f1-446fb0cc9317 req-134ec8d7-41ca-414a-9f1e-12dfcf77c371 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060827 Mar 05 20:57:35.903492 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1282/2600] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:36.150253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0b657b77-70ac-475d-83bb-3f0ab7df3224 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:36.151133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0b657b77-70ac-475d-83bb-3f0ab7df3224 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:36.158199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b657b77-70ac-475d-83bb-3f0ab7df3224 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:36.158889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b657b77-70ac-475d-83bb-3f0ab7df3224 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:36.159935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b657b77-70ac-475d-83bb-3f0ab7df3224 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:36.160381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b657b77-70ac-475d-83bb-3f0ab7df3224 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:36.197824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b657b77-70ac-475d-83bb-3f0ab7df3224 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:36.198268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b657b77-70ac-475d-83bb-3f0ab7df3224 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:36.199083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-0b657b77-70ac-475d-83bb-3f0ab7df3224 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lazy-loading 'fault' on Instance uuid bf09b77b-5755-4ebd-bbcd-c47541a58af5 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:57:36.267818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-19f24dc4-8e6d-421c-9efc-50f708e27b70 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:36.290127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0b657b77-70ac-475d-83bb-3f0ab7df3224 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8fef08c46741448390a1ab640962eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc76a60f3c6e4f2ea69c0445ba45e4a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:36.297025 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-19f24dc4-8e6d-421c-9efc-50f708e27b70 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1504 microversion: 2.1 time: 0.495816 Mar 05 20:57:36.308459 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1319/2601] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:35 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1504 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:36.314236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d6b6a906-db02-4fd3-b9ce-b89a8b196791 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:36.315140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d6b6a906-db02-4fd3-b9ce-b89a8b196791 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:36.323393 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0b657b77-70ac-475d-83bb-3f0ab7df3224 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 200 len: 1304 microversion: 2.1 time: 0.177519 Mar 05 20:57:36.324020 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1283/2602] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:36 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 1304 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:36.334237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6b6a906-db02-4fd3-b9ce-b89a8b196791 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:36.335037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6b6a906-db02-4fd3-b9ce-b89a8b196791 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:36.336642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6b6a906-db02-4fd3-b9ce-b89a8b196791 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:36.337334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6b6a906-db02-4fd3-b9ce-b89a8b196791 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:36.370012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9ab43c7c-0c8c-449e-afb1-7c945e2222f7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:36.370641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9ab43c7c-0c8c-449e-afb1-7c945e2222f7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:36.382805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ab43c7c-0c8c-449e-afb1-7c945e2222f7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:36.383437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ab43c7c-0c8c-449e-afb1-7c945e2222f7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:36.389918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ab43c7c-0c8c-449e-afb1-7c945e2222f7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:36.390679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ab43c7c-0c8c-449e-afb1-7c945e2222f7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:36.717342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d6b6a906-db02-4fd3-b9ce-b89a8b196791 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:36.733648 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d6b6a906-db02-4fd3-b9ce-b89a8b196791 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.423350 Mar 05 20:57:36.734484 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1320/2603] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:36 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:36.741415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-733ffb4d-8b26-440e-be78-c2563e93892c req-d1281349-35d6-4e2b-a935-7010135039e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eefc9ca-6a02-4bf8-8239-ad67aaab69b0", "name": "network-vif-unplugged", "status": "completed", "tag": "66b1650a-3e82-4d7d-b60f-82261d656e4c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:36.756020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-733ffb4d-8b26-440e-be78-c2563e93892c req-d1281349-35d6-4e2b-a935-7010135039e9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:36.756842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-733ffb4d-8b26-440e-be78-c2563e93892c req-d1281349-35d6-4e2b-a935-7010135039e9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:36.777248 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-733ffb4d-8b26-440e-be78-c2563e93892c req-d1281349-35d6-4e2b-a935-7010135039e9 service nova] Creating event network-vif-unplugged:66b1650a-3e82-4d7d-b60f-82261d656e4c for instance 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 on nch1-master-1 Mar 05 20:57:36.789053 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-733ffb4d-8b26-440e-be78-c2563e93892c req-d1281349-35d6-4e2b-a935-7010135039e9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052770 Mar 05 20:57:36.790288 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1321/2604] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:36.917954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9ab43c7c-0c8c-449e-afb1-7c945e2222f7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:36.933886 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9ab43c7c-0c8c-449e-afb1-7c945e2222f7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1316 microversion: 2.1 time: 0.568415 Mar 05 20:57:36.934862 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1284/2605] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:36 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:57:37.315698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3eb43320-507f-4bb1-8c7d-9cc6fb14bc19 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:37.316403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3eb43320-507f-4bb1-8c7d-9cc6fb14bc19 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:37.332004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3eb43320-507f-4bb1-8c7d-9cc6fb14bc19 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:37.332465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3eb43320-507f-4bb1-8c7d-9cc6fb14bc19 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:37.333965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3eb43320-507f-4bb1-8c7d-9cc6fb14bc19 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:37.336118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3eb43320-507f-4bb1-8c7d-9cc6fb14bc19 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:37.341131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ce60cf98-f490-4605-a535-ab0ea37a9a44 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:37.341739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ce60cf98-f490-4605-a535-ab0ea37a9a44 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] [instance: bf09b77b-5755-4ebd-bbcd-c47541a58af5] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:37.381518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce60cf98-f490-4605-a535-ab0ea37a9a44 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:37.385175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce60cf98-f490-4605-a535-ab0ea37a9a44 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:37.386806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce60cf98-f490-4605-a535-ab0ea37a9a44 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:37.387497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce60cf98-f490-4605-a535-ab0ea37a9a44 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:37.418134 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-ce60cf98-f490-4605-a535-ab0ea37a9a44 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] HTTP exception thrown: Instance bf09b77b-5755-4ebd-bbcd-c47541a58af5 could not be found. Mar 05 20:57:37.419111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ce60cf98-f490-4605-a535-ab0ea37a9a44 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] Returning 404 to user: Instance bf09b77b-5755-4ebd-bbcd-c47541a58af5 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:37.429371 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ce60cf98-f490-4605-a535-ab0ea37a9a44 tempest-ServerRescueTestJSON-1383827747 tempest-ServerRescueTestJSON-1383827747-project] 10.222.0.15 "GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5" status: 404 len: 111 microversion: 2.1 time: 0.083447 Mar 05 20:57:37.430352 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1285/2606] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:37 2022] GET /compute/v2.1/servers/bf09b77b-5755-4ebd-bbcd-c47541a58af5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:57:37.666376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3eb43320-507f-4bb1-8c7d-9cc6fb14bc19 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:37.678411 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3eb43320-507f-4bb1-8c7d-9cc6fb14bc19 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1504 microversion: 2.1 time: 0.366597 Mar 05 20:57:37.679794 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1322/2607] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:37 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:37.751406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23a4e5c2-6b63-435e-9527-71cb1487a6a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:37.752052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-23a4e5c2-6b63-435e-9527-71cb1487a6a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:37.768827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23a4e5c2-6b63-435e-9527-71cb1487a6a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:37.769294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23a4e5c2-6b63-435e-9527-71cb1487a6a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:37.770106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23a4e5c2-6b63-435e-9527-71cb1487a6a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:37.771131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23a4e5c2-6b63-435e-9527-71cb1487a6a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:37.935749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-727a6db1-43eb-4770-92a0-17cf27cff403 req-ea955ba2-e293-4741-8dfc-559551ba3229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6207958f-00b7-4d0e-b1a7-e17e3ddf371c", "tag": "b7562f27-5f06-4bcc-a8b8-962b8a5a7750"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:37.953138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-727a6db1-43eb-4770-92a0-17cf27cff403 req-ea955ba2-e293-4741-8dfc-559551ba3229 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:37.954081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-727a6db1-43eb-4770-92a0-17cf27cff403 req-ea955ba2-e293-4741-8dfc-559551ba3229 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:37.969946 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-727a6db1-43eb-4770-92a0-17cf27cff403 req-ea955ba2-e293-4741-8dfc-559551ba3229 service nova] Creating event network-changed:b7562f27-5f06-4bcc-a8b8-962b8a5a7750 for instance 6207958f-00b7-4d0e-b1a7-e17e3ddf371c on nch2-master-1 Mar 05 20:57:37.978155 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-727a6db1-43eb-4770-92a0-17cf27cff403 req-ea955ba2-e293-4741-8dfc-559551ba3229 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047249 Mar 05 20:57:37.980063 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1323/2608] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:57:38.007576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c60f9bd9-6542-4d05-b492-ba7f6816f2b8 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:38.008596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c60f9bd9-6542-4d05-b492-ba7f6816f2b8 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:38.040955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c60f9bd9-6542-4d05-b492-ba7f6816f2b8 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:38.041896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c60f9bd9-6542-4d05-b492-ba7f6816f2b8 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:38.044812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c60f9bd9-6542-4d05-b492-ba7f6816f2b8 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:38.045349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c60f9bd9-6542-4d05-b492-ba7f6816f2b8 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:38.369959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-23a4e5c2-6b63-435e-9527-71cb1487a6a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:38.385585 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-23a4e5c2-6b63-435e-9527-71cb1487a6a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.637823 Mar 05 20:57:38.387110 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1286/2609] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:37 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:38.416393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c60f9bd9-6542-4d05-b492-ba7f6816f2b8 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:38.424821 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c60f9bd9-6542-4d05-b492-ba7f6816f2b8 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1316 microversion: 2.1 time: 0.443069 Mar 05 20:57:38.433972 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1324/2610] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:37 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:38.700097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2309ebec-1c5b-484a-b5b1-b90f01f8e881 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:38.700918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2309ebec-1c5b-484a-b5b1-b90f01f8e881 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:38.711405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2309ebec-1c5b-484a-b5b1-b90f01f8e881 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:38.712988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2309ebec-1c5b-484a-b5b1-b90f01f8e881 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:38.714597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2309ebec-1c5b-484a-b5b1-b90f01f8e881 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:38.715345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2309ebec-1c5b-484a-b5b1-b90f01f8e881 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:38.837251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-1615e55b-c11e-4f9c-87e3-34387c8eb16b req-48796ee5-164b-4907-9bf6-d291f2c8e98a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eefc9ca-6a02-4bf8-8239-ad67aaab69b0", "tag": "66b1650a-3e82-4d7d-b60f-82261d656e4c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:38.852596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1615e55b-c11e-4f9c-87e3-34387c8eb16b req-48796ee5-164b-4907-9bf6-d291f2c8e98a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:38.853040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1615e55b-c11e-4f9c-87e3-34387c8eb16b req-48796ee5-164b-4907-9bf6-d291f2c8e98a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:38.869516 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-1615e55b-c11e-4f9c-87e3-34387c8eb16b req-48796ee5-164b-4907-9bf6-d291f2c8e98a service nova] Creating event network-changed:66b1650a-3e82-4d7d-b60f-82261d656e4c for instance 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 on nch1-master-1 Mar 05 20:57:38.874660 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-1615e55b-c11e-4f9c-87e3-34387c8eb16b req-48796ee5-164b-4907-9bf6-d291f2c8e98a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045682 Mar 05 20:57:38.875526 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1325/2611] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:39.230812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2309ebec-1c5b-484a-b5b1-b90f01f8e881 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:39.238324 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2309ebec-1c5b-484a-b5b1-b90f01f8e881 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1504 microversion: 2.1 time: 0.544483 Mar 05 20:57:39.239471 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1287/2612] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:38 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1504 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:39.406931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5dc7535b-9e71-44c4-a02c-99e6eaa04712 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:39.408286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5dc7535b-9e71-44c4-a02c-99e6eaa04712 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:39.425572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dc7535b-9e71-44c4-a02c-99e6eaa04712 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:39.429275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dc7535b-9e71-44c4-a02c-99e6eaa04712 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:39.431784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dc7535b-9e71-44c4-a02c-99e6eaa04712 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:39.444428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dc7535b-9e71-44c4-a02c-99e6eaa04712 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:39.449118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f40e148d-7c4c-4a1c-803e-7ca540dc7e13 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:39.449745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f40e148d-7c4c-4a1c-803e-7ca540dc7e13 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:39.459177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f40e148d-7c4c-4a1c-803e-7ca540dc7e13 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:39.461494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f40e148d-7c4c-4a1c-803e-7ca540dc7e13 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:39.462540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f40e148d-7c4c-4a1c-803e-7ca540dc7e13 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:39.465809 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f40e148d-7c4c-4a1c-803e-7ca540dc7e13 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:39.731161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5dc7535b-9e71-44c4-a02c-99e6eaa04712 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:39.747082 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5dc7535b-9e71-44c4-a02c-99e6eaa04712 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.347003 Mar 05 20:57:39.747708 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1326/2613] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:39 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:40.027552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-632506d2-77b1-4860-8b8c-d10a60e6f41e req-a61dc9d2-0828-4c3e-8363-c90834add6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "056687e6-170e-40fd-8aba-54f356d86d39", "tag": "fb31d45e-66c4-411f-b2d5-2f7fc846eb16"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:40.028287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f40e148d-7c4c-4a1c-803e-7ca540dc7e13 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:40.039617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-632506d2-77b1-4860-8b8c-d10a60e6f41e req-a61dc9d2-0828-4c3e-8363-c90834add6c3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:40.040860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-632506d2-77b1-4860-8b8c-d10a60e6f41e req-a61dc9d2-0828-4c3e-8363-c90834add6c3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:40.041398 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f40e148d-7c4c-4a1c-803e-7ca540dc7e13 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1316 microversion: 2.1 time: 0.595451 Mar 05 20:57:40.042013 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1288/2614] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:39 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1316 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:40.072940 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-632506d2-77b1-4860-8b8c-d10a60e6f41e req-a61dc9d2-0828-4c3e-8363-c90834add6c3 service nova] Creating event network-changed:fb31d45e-66c4-411f-b2d5-2f7fc846eb16 for instance 056687e6-170e-40fd-8aba-54f356d86d39 on nch2-master-1 Mar 05 20:57:40.078233 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-632506d2-77b1-4860-8b8c-d10a60e6f41e req-a61dc9d2-0828-4c3e-8363-c90834add6c3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058702 Mar 05 20:57:40.079971 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1327/2615] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:57:40.256382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-230dfe3b-8bb4-42cc-ad46-0e2a76b77478 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:40.257225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-230dfe3b-8bb4-42cc-ad46-0e2a76b77478 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:40.269789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-230dfe3b-8bb4-42cc-ad46-0e2a76b77478 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:40.272260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-230dfe3b-8bb4-42cc-ad46-0e2a76b77478 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:40.273322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-230dfe3b-8bb4-42cc-ad46-0e2a76b77478 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:40.273991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-230dfe3b-8bb4-42cc-ad46-0e2a76b77478 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:40.767359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-79b1d1dc-61c6-4ab8-93a6-77d72b033c31 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:40.768222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-79b1d1dc-61c6-4ab8-93a6-77d72b033c31 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:40.775059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-79b1d1dc-61c6-4ab8-93a6-77d72b033c31 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:40.775593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-79b1d1dc-61c6-4ab8-93a6-77d72b033c31 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:40.776527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-79b1d1dc-61c6-4ab8-93a6-77d72b033c31 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:40.777417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-79b1d1dc-61c6-4ab8-93a6-77d72b033c31 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:40.850276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-230dfe3b-8bb4-42cc-ad46-0e2a76b77478 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:40.865060 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-230dfe3b-8bb4-42cc-ad46-0e2a76b77478 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1504 microversion: 2.1 time: 0.611364 Mar 05 20:57:40.866687 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1289/2616] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:40 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1504 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:41.062776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0026fa38-4710-4cbf-ae4c-bf82830c5eca tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:41.064366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0026fa38-4710-4cbf-ae4c-bf82830c5eca tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:41.091363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0026fa38-4710-4cbf-ae4c-bf82830c5eca tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:41.094125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0026fa38-4710-4cbf-ae4c-bf82830c5eca tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:41.097212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0026fa38-4710-4cbf-ae4c-bf82830c5eca tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:41.101466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0026fa38-4710-4cbf-ae4c-bf82830c5eca tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:41.187547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-79b1d1dc-61c6-4ab8-93a6-77d72b033c31 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:41.196957 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-79b1d1dc-61c6-4ab8-93a6-77d72b033c31 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.436045 Mar 05 20:57:41.198325 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1328/2617] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:40 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:41.729562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0026fa38-4710-4cbf-ae4c-bf82830c5eca tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:41.742423 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0026fa38-4710-4cbf-ae4c-bf82830c5eca tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1316 microversion: 2.1 time: 0.687634 Mar 05 20:57:41.743484 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1290/2618] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:41 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:41.884428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-21402eb9-017b-4f66-827b-1764cf9bce8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:41.885139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-21402eb9-017b-4f66-827b-1764cf9bce8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:41.894099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21402eb9-017b-4f66-827b-1764cf9bce8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:41.894629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21402eb9-017b-4f66-827b-1764cf9bce8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:41.896763 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21402eb9-017b-4f66-827b-1764cf9bce8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:41.897293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21402eb9-017b-4f66-827b-1764cf9bce8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:42.207623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-21402eb9-017b-4f66-827b-1764cf9bce8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:42.215292 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-21402eb9-017b-4f66-827b-1764cf9bce8a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1504 microversion: 2.1 time: 0.336727 Mar 05 20:57:42.215808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a34d61ac-e0c8-4841-8921-3112bfcbd1d9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:42.217511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a34d61ac-e0c8-4841-8921-3112bfcbd1d9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:42.224198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a34d61ac-e0c8-4841-8921-3112bfcbd1d9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:42.225131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a34d61ac-e0c8-4841-8921-3112bfcbd1d9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:42.226055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a34d61ac-e0c8-4841-8921-3112bfcbd1d9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:42.226207 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1329/2619] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:41 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:42.227035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a34d61ac-e0c8-4841-8921-3112bfcbd1d9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:42.721640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a34d61ac-e0c8-4841-8921-3112bfcbd1d9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:42.730829 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a34d61ac-e0c8-4841-8921-3112bfcbd1d9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.520289 Mar 05 20:57:42.742774 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1291/2620] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:42 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:42.761932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-678ba214-ff61-4389-a6f3-6b126fd7669d tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:42.763794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-678ba214-ff61-4389-a6f3-6b126fd7669d tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:42.774195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-678ba214-ff61-4389-a6f3-6b126fd7669d tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:42.776010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-678ba214-ff61-4389-a6f3-6b126fd7669d tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:42.777541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-678ba214-ff61-4389-a6f3-6b126fd7669d tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:42.778702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-678ba214-ff61-4389-a6f3-6b126fd7669d tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:43.010319 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-678ba214-ff61-4389-a6f3-6b126fd7669d tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:43.018363 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-678ba214-ff61-4389-a6f3-6b126fd7669d tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1316 microversion: 2.1 time: 0.262866 Mar 05 20:57:43.019785 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1330/2621] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:42 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:43.235080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4a053e21-b25f-4842-a61e-7081ba88dda3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:43.236619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4a053e21-b25f-4842-a61e-7081ba88dda3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:43.245322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4a053e21-b25f-4842-a61e-7081ba88dda3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:43.246250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4a053e21-b25f-4842-a61e-7081ba88dda3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:43.247364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4a053e21-b25f-4842-a61e-7081ba88dda3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:43.248130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4a053e21-b25f-4842-a61e-7081ba88dda3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:43.451437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4a053e21-b25f-4842-a61e-7081ba88dda3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:43.463512 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4a053e21-b25f-4842-a61e-7081ba88dda3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1479 microversion: 2.1 time: 0.233779 Mar 05 20:57:43.464417 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1292/2622] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:43 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1479 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:43.480642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b68139a8-58ea-4a4d-b665-8821c5aa2f25 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '.version_select at 0x7fed5c62b5e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:43.483579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b68139a8-58ea-4a4d-b665-8821c5aa2f25 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:43.484252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b68139a8-58ea-4a4d-b665-8821c5aa2f25 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:43.500634 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b68139a8-58ea-4a4d-b665-8821c5aa2f25 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/os-migrations" status: 200 len: 783 microversion: 2.1 time: 0.023672 Mar 05 20:57:43.501246 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1331/2623] 10.222.0.15 () {58 vars in 1142 bytes} [Sat Mar 5 20:57:43 2022] GET /compute/v2.1/os-migrations => generated 783 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:43.514842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-175005c2-760c-41d2-a45a-d22a84638ad8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:43.515647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-175005c2-760c-41d2-a45a-d22a84638ad8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:43.532884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-175005c2-760c-41d2-a45a-d22a84638ad8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:43.533945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-175005c2-760c-41d2-a45a-d22a84638ad8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:43.537267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-175005c2-760c-41d2-a45a-d22a84638ad8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:43.538824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-175005c2-760c-41d2-a45a-d22a84638ad8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:43.749712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b2df1b9c-4720-4026-9e0d-68362e4e3d21 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:43.750658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b2df1b9c-4720-4026-9e0d-68362e4e3d21 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:43.766455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2df1b9c-4720-4026-9e0d-68362e4e3d21 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:43.771166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2df1b9c-4720-4026-9e0d-68362e4e3d21 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:43.789936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2df1b9c-4720-4026-9e0d-68362e4e3d21 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:43.790984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2df1b9c-4720-4026-9e0d-68362e4e3d21 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:44.213548 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-175005c2-760c-41d2-a45a-d22a84638ad8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1630 microversion: 2.1 time: 0.702908 Mar 05 20:57:44.230979 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1293/2624] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:43 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1630 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:44.236336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b2df1b9c-4720-4026-9e0d-68362e4e3d21 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:44.249620 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b2df1b9c-4720-4026-9e0d-68362e4e3d21 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.504084 Mar 05 20:57:44.251640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-009125ae-f1e5-44ea-9934-53f79cb210de tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:44.254834 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1332/2625] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:43 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:44.256885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-009125ae-f1e5-44ea-9934-53f79cb210de tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:44.264520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-009125ae-f1e5-44ea-9934-53f79cb210de tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:44.266734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-009125ae-f1e5-44ea-9934-53f79cb210de tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:44.268521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-009125ae-f1e5-44ea-9934-53f79cb210de tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:44.269150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-009125ae-f1e5-44ea-9934-53f79cb210de tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:44.454508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-009125ae-f1e5-44ea-9934-53f79cb210de tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:44.465211 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-009125ae-f1e5-44ea-9934-53f79cb210de tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1316 microversion: 2.1 time: 0.238104 Mar 05 20:57:44.477139 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1294/2626] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:44 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:44.536347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-278092753", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "93578ff8-1ca6-4e6e-b4ae-025cd8c9d397"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:44.651932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] validate_networks() for [('93578ff8-1ca6-4e6e-b4ae-025cd8c9d397', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:57:45.271120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e21f3b3c-5f3c-42e7-97bd-c022c2d20615 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:45.272900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e21f3b3c-5f3c-42e7-97bd-c022c2d20615 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:45.283635 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e21f3b3c-5f3c-42e7-97bd-c022c2d20615 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:45.284332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e21f3b3c-5f3c-42e7-97bd-c022c2d20615 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:45.285718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e21f3b3c-5f3c-42e7-97bd-c022c2d20615 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:45.287656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e21f3b3c-5f3c-42e7-97bd-c022c2d20615 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:45.613286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:57:45.613859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:57:45.614237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:57:45.614686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:57:45.615168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:57:45.625561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:45.626037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:45.626802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:45.627264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:45.649262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Getting quotas for project 77c35382c7454a51ab1fbd37f9157ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:57:45.649816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e21f3b3c-5f3c-42e7-97bd-c022c2d20615 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:45.658528 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e21f3b3c-5f3c-42e7-97bd-c022c2d20615 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.391893 Mar 05 20:57:45.659127 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1295/2627] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:45 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:45.659585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Getting quotas for user 4ff43fd6998d454887c5aae39464ab72 and project 77c35382c7454a51ab1fbd37f9157ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:57:45.664420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f347da55-c114-4778-87d6-cd1f6900b4ce tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:45.665031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f347da55-c114-4778-87d6-cd1f6900b4ce tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:45.675975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:57:45.680095 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:57:45.686906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f347da55-c114-4778-87d6-cd1f6900b4ce tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:45.687362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f347da55-c114-4778-87d6-cd1f6900b4ce tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:45.688276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f347da55-c114-4778-87d6-cd1f6900b4ce tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:45.688733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f347da55-c114-4778-87d6-cd1f6900b4ce tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:45.752918 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-06d51e60-71e2-4a1d-9998-28d06d5baba4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.221402 Mar 05 20:57:45.753957 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1333/2628] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:57:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:57:45.798991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-08111462-05b0-4540-b59f-d0e0357b622b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:45.799651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-08111462-05b0-4540-b59f-d0e0357b622b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:45.940043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-08111462-05b0-4540-b59f-d0e0357b622b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:45.948401 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-08111462-05b0-4540-b59f-d0e0357b622b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1210 microversion: 2.1 time: 0.179890 Mar 05 20:57:45.953558 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1334/2629] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:45 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1210 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:45.984471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f347da55-c114-4778-87d6-cd1f6900b4ce tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:45.995547 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f347da55-c114-4778-87d6-cd1f6900b4ce tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1316 microversion: 2.1 time: 0.335125 Mar 05 20:57:45.996385 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1296/2630] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:45 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:46.204093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-02d39a2b-73f3-4916-87f2-f02bfbf98d3f req-23b4ebe7-f915-4591-99bc-a761b8fbada9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "056687e6-170e-40fd-8aba-54f356d86d39", "name": "network-vif-plugged", "status": "completed", "tag": "fb31d45e-66c4-411f-b2d5-2f7fc846eb16"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:46.219949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-02d39a2b-73f3-4916-87f2-f02bfbf98d3f req-23b4ebe7-f915-4591-99bc-a761b8fbada9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:46.220931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-02d39a2b-73f3-4916-87f2-f02bfbf98d3f req-23b4ebe7-f915-4591-99bc-a761b8fbada9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:46.246433 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-02d39a2b-73f3-4916-87f2-f02bfbf98d3f req-23b4ebe7-f915-4591-99bc-a761b8fbada9 service nova] Creating event network-vif-plugged:fb31d45e-66c4-411f-b2d5-2f7fc846eb16 for instance 056687e6-170e-40fd-8aba-54f356d86d39 on nch2-master-1 Mar 05 20:57:46.259304 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-02d39a2b-73f3-4916-87f2-f02bfbf98d3f req-23b4ebe7-f915-4591-99bc-a761b8fbada9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059662 Mar 05 20:57:46.262500 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1335/2631] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:46.679718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0fca1bcb-671b-4e11-8b0f-4d652410b5c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:46.680562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0fca1bcb-671b-4e11-8b0f-4d652410b5c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:46.696893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fca1bcb-671b-4e11-8b0f-4d652410b5c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:46.697360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fca1bcb-671b-4e11-8b0f-4d652410b5c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:46.699654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fca1bcb-671b-4e11-8b0f-4d652410b5c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:46.701073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fca1bcb-671b-4e11-8b0f-4d652410b5c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:46.973779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-148e1df4-b9d0-4636-bbcd-93e3cb1fc26e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:46.974989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-148e1df4-b9d0-4636-bbcd-93e3cb1fc26e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:46.982661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0fca1bcb-671b-4e11-8b0f-4d652410b5c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:46.988145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-148e1df4-b9d0-4636-bbcd-93e3cb1fc26e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:46.988613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-148e1df4-b9d0-4636-bbcd-93e3cb1fc26e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:46.992154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-148e1df4-b9d0-4636-bbcd-93e3cb1fc26e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:46.993503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-148e1df4-b9d0-4636-bbcd-93e3cb1fc26e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:46.996816 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0fca1bcb-671b-4e11-8b0f-4d652410b5c6 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1508 microversion: 2.1 time: 0.323013 Mar 05 20:57:47.000469 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1297/2632] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:46 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:47.013928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7222839f-2903-4e54-881b-155a28549ac2 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:47.015213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7222839f-2903-4e54-881b-155a28549ac2 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:47.029569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7222839f-2903-4e54-881b-155a28549ac2 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:47.030502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7222839f-2903-4e54-881b-155a28549ac2 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:47.031340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7222839f-2903-4e54-881b-155a28549ac2 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:47.031814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7222839f-2903-4e54-881b-155a28549ac2 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:47.257542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-148e1df4-b9d0-4636-bbcd-93e3cb1fc26e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:47.277337 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-148e1df4-b9d0-4636-bbcd-93e3cb1fc26e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1262 microversion: 2.1 time: 0.306284 Mar 05 20:57:47.280682 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1336/2633] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:46 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1262 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:47.296951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7222839f-2903-4e54-881b-155a28549ac2 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:47.316128 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7222839f-2903-4e54-881b-155a28549ac2 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1316 microversion: 2.1 time: 0.306257 Mar 05 20:57:47.316730 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1298/2634] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:47 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:57:48.019027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3f5abaa8-3ea2-469a-8f56-7360c321eabc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:48.019882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3f5abaa8-3ea2-469a-8f56-7360c321eabc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:48.028968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f5abaa8-3ea2-469a-8f56-7360c321eabc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:48.029632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f5abaa8-3ea2-469a-8f56-7360c321eabc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:48.030933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f5abaa8-3ea2-469a-8f56-7360c321eabc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:48.031385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f5abaa8-3ea2-469a-8f56-7360c321eabc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:48.092277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-241315876", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": "none"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:48.169668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:57:48.170110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:57:48.170594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:57:48.171014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:57:48.171429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:57:48.183488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:48.184221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:48.185359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:48.186585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:48.222031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Getting quotas for project 87102c8d550443778df9ee34facca0b4. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:57:48.225025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3f5abaa8-3ea2-469a-8f56-7360c321eabc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:48.234967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Getting quotas for user 101d571886ab4901be96f849865a2cc4 and project 87102c8d550443778df9ee34facca0b4. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:57:48.237585 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3f5abaa8-3ea2-469a-8f56-7360c321eabc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1529 microversion: 2.1 time: 0.223058 Mar 05 20:57:48.248506 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1299/2635] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:48 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1529 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:57:48.260040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:57:48.262702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:57:48.296774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-165b6f5c-a229-427e-9e1b-60c4674e42c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:48.298354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-165b6f5c-a229-427e-9e1b-60c4674e42c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:48.305598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-165b6f5c-a229-427e-9e1b-60c4674e42c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:48.306241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-165b6f5c-a229-427e-9e1b-60c4674e42c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:48.307212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-165b6f5c-a229-427e-9e1b-60c4674e42c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:48.307652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-165b6f5c-a229-427e-9e1b-60c4674e42c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:48.340912 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6171d086-d88b-49ed-827b-7197275f1681 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.498561 Mar 05 20:57:48.342825 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1337/2636] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 20:57:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 05 20:57:48.355812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7ac50ef9-ca42-43da-b27e-6b0e5e585784 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:48.356489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7ac50ef9-ca42-43da-b27e-6b0e5e585784 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:48.374718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ac50ef9-ca42-43da-b27e-6b0e5e585784 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:48.375227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ac50ef9-ca42-43da-b27e-6b0e5e585784 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:48.376195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ac50ef9-ca42-43da-b27e-6b0e5e585784 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:48.376652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ac50ef9-ca42-43da-b27e-6b0e5e585784 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:48.403181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-165b6f5c-a229-427e-9e1b-60c4674e42c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:48.414046 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-165b6f5c-a229-427e-9e1b-60c4674e42c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1268 microversion: 2.1 time: 0.121121 Mar 05 20:57:48.414716 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1300/2637] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:48 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1268 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:48.421065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f82a6ae2-cca1-40ed-bca7-a2e3095d47f4 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:48.421878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f82a6ae2-cca1-40ed-bca7-a2e3095d47f4 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:48.494162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f82a6ae2-cca1-40ed-bca7-a2e3095d47f4 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:48.501649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f82a6ae2-cca1-40ed-bca7-a2e3095d47f4 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:48.503460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f82a6ae2-cca1-40ed-bca7-a2e3095d47f4 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:48.505397 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f82a6ae2-cca1-40ed-bca7-a2e3095d47f4 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1277 microversion: 2.57 time: 0.089533 Mar 05 20:57:48.506400 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1301/2638] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:57:48 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:57:48.894876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7ac50ef9-ca42-43da-b27e-6b0e5e585784 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:48.910697 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7ac50ef9-ca42-43da-b27e-6b0e5e585784 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1503 microversion: 2.1 time: 0.566470 Mar 05 20:57:48.922765 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1338/2639] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:48 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1503 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:48.929618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2dda02d8-d0fc-4093-91dd-03162622172b tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:48.930075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2dda02d8-d0fc-4093-91dd-03162622172b tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:48.937181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dda02d8-d0fc-4093-91dd-03162622172b tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:48.937643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dda02d8-d0fc-4093-91dd-03162622172b tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:48.938422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dda02d8-d0fc-4093-91dd-03162622172b tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:48.938867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dda02d8-d0fc-4093-91dd-03162622172b tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:49.047014 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2dda02d8-d0fc-4093-91dd-03162622172b tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "DELETE /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.121116 Mar 05 20:57:49.048172 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1302/2640] 10.222.0.15 () {58 vars in 1295 bytes} [Sat Mar 5 20:57:48 2022] DELETE /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39/os-server-password => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:57:49.059520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9080ecbe-f083-427c-943d-ee48281cbc4c tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:49.060259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9080ecbe-f083-427c-943d-ee48281cbc4c tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:49.069596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9080ecbe-f083-427c-943d-ee48281cbc4c tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:49.070279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9080ecbe-f083-427c-943d-ee48281cbc4c tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:49.071064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9080ecbe-f083-427c-943d-ee48281cbc4c tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:49.071779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9080ecbe-f083-427c-943d-ee48281cbc4c tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:49.098005 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9080ecbe-f083-427c-943d-ee48281cbc4c tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.044049 Mar 05 20:57:49.103879 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1339/2641] 10.222.0.15 () {58 vars in 1292 bytes} [Sat Mar 5 20:57:49 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39/os-server-password => generated 16 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:57:49.109795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d491e79d-74ae-4ca2-afad-6275d4ce2497 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:49.110337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d491e79d-74ae-4ca2-afad-6275d4ce2497 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:49.126729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d491e79d-74ae-4ca2-afad-6275d4ce2497 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:49.127240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d491e79d-74ae-4ca2-afad-6275d4ce2497 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:49.128113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d491e79d-74ae-4ca2-afad-6275d4ce2497 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:49.128567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d491e79d-74ae-4ca2-afad-6275d4ce2497 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:49.164565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d491e79d-74ae-4ca2-afad-6275d4ce2497 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:57:49.261652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c9765264-4cc2-4c6f-9cb5-c6ad1ab1f51a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:49.262679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c9765264-4cc2-4c6f-9cb5-c6ad1ab1f51a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:49.283088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9765264-4cc2-4c6f-9cb5-c6ad1ab1f51a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:49.285184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9765264-4cc2-4c6f-9cb5-c6ad1ab1f51a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:49.289288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9765264-4cc2-4c6f-9cb5-c6ad1ab1f51a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:49.291358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9765264-4cc2-4c6f-9cb5-c6ad1ab1f51a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:49.353612 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d491e79d-74ae-4ca2-afad-6275d4ce2497 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "DELETE /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 204 len: 0 microversion: 2.1 time: 0.247788 Mar 05 20:57:49.354798 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1303/2642] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:57:49 2022] DELETE /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 20:57:49.376865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3eddcd53-d403-4807-bd48-0b043a958937 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:49.378261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3eddcd53-d403-4807-bd48-0b043a958937 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:49.393205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3eddcd53-d403-4807-bd48-0b043a958937 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:49.393885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3eddcd53-d403-4807-bd48-0b043a958937 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:49.395157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3eddcd53-d403-4807-bd48-0b043a958937 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:49.395969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3eddcd53-d403-4807-bd48-0b043a958937 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:49.603094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3eddcd53-d403-4807-bd48-0b043a958937 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:49.615038 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3eddcd53-d403-4807-bd48-0b043a958937 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1509 microversion: 2.1 time: 0.253615 Mar 05 20:57:49.627984 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1304/2643] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:49 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1509 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:49.644272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-328a7078-77c0-4960-9cf9-0ee0ae83ca23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:49.646184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-328a7078-77c0-4960-9cf9-0ee0ae83ca23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:49.654782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-328a7078-77c0-4960-9cf9-0ee0ae83ca23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:49.655936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-328a7078-77c0-4960-9cf9-0ee0ae83ca23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:49.657013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-328a7078-77c0-4960-9cf9-0ee0ae83ca23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:49.657687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-328a7078-77c0-4960-9cf9-0ee0ae83ca23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:49.865984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-328a7078-77c0-4960-9cf9-0ee0ae83ca23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:49.876813 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-328a7078-77c0-4960-9cf9-0ee0ae83ca23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1310 microversion: 2.1 time: 0.246346 Mar 05 20:57:49.878317 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1305/2644] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:49 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1310 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:49.888560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5c58bc87-18c7-4ab7-bca7-d5fa0f825d36 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:49.895307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5c58bc87-18c7-4ab7-bca7-d5fa0f825d36 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:49.910627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5c58bc87-18c7-4ab7-bca7-d5fa0f825d36 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:49.911102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5c58bc87-18c7-4ab7-bca7-d5fa0f825d36 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:49.912272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5c58bc87-18c7-4ab7-bca7-d5fa0f825d36 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:49.917508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5c58bc87-18c7-4ab7-bca7-d5fa0f825d36 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:50.063971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5c58bc87-18c7-4ab7-bca7-d5fa0f825d36 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:50.074798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5c58bc87-18c7-4ab7-bca7-d5fa0f825d36 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:50.078128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5c58bc87-18c7-4ab7-bca7-d5fa0f825d36 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:50.080601 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5c58bc87-18c7-4ab7-bca7-d5fa0f825d36 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1347 microversion: 2.57 time: 0.197925 Mar 05 20:57:50.081869 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1306/2645] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:57:49 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1347 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:57:50.360714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c9765264-4cc2-4c6f-9cb5-c6ad1ab1f51a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:50.371085 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c9765264-4cc2-4c6f-9cb5-c6ad1ab1f51a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1529 microversion: 2.1 time: 1.117451 Mar 05 20:57:50.380388 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1340/2646] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:49 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1529 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:57:50.647042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-987d6be9-d1b7-4842-bcfd-fabd0b6b1252 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:50.647185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-987d6be9-d1b7-4842-bcfd-fabd0b6b1252 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:50.663567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-987d6be9-d1b7-4842-bcfd-fabd0b6b1252 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:50.664433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-987d6be9-d1b7-4842-bcfd-fabd0b6b1252 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:50.665699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-987d6be9-d1b7-4842-bcfd-fabd0b6b1252 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:50.666359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-987d6be9-d1b7-4842-bcfd-fabd0b6b1252 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:50.896156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a7564c53-77c9-4132-af55-0ae7075efd44 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:50.896921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a7564c53-77c9-4132-af55-0ae7075efd44 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:50.911370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7564c53-77c9-4132-af55-0ae7075efd44 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:50.912126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7564c53-77c9-4132-af55-0ae7075efd44 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:50.914621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7564c53-77c9-4132-af55-0ae7075efd44 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:50.915170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7564c53-77c9-4132-af55-0ae7075efd44 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:51.048134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-987d6be9-d1b7-4842-bcfd-fabd0b6b1252 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:51.062607 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-987d6be9-d1b7-4842-bcfd-fabd0b6b1252 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1509 microversion: 2.1 time: 0.417315 Mar 05 20:57:51.063180 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1307/2647] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:50 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1509 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:51.105844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f734356f-9321-4fdc-a0f3-fdbb6880df8c tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:51.106487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f734356f-9321-4fdc-a0f3-fdbb6880df8c tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:51.118241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f734356f-9321-4fdc-a0f3-fdbb6880df8c tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:51.118708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f734356f-9321-4fdc-a0f3-fdbb6880df8c tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:51.119504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f734356f-9321-4fdc-a0f3-fdbb6880df8c tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:51.119997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f734356f-9321-4fdc-a0f3-fdbb6880df8c tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:51.272513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a7564c53-77c9-4132-af55-0ae7075efd44 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:51.283834 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a7564c53-77c9-4132-af55-0ae7075efd44 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1310 microversion: 2.1 time: 0.392326 Mar 05 20:57:51.292491 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1341/2648] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:50 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1310 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:51.326123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c5e87346-a44b-42a6-93a0-ee3a60c761da req-b6d3cc4e-d7bd-4141-b8ef-5b3956a6c231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97c5a8d-7d31-43dc-a2e2-0227ff5b4050", "tag": "7705d2a3-c4f0-4f14-82f2-b7d4a3c2ab9f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:51.338617 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f734356f-9321-4fdc-a0f3-fdbb6880df8c tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:51.345643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c5e87346-a44b-42a6-93a0-ee3a60c761da req-b6d3cc4e-d7bd-4141-b8ef-5b3956a6c231 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:51.346269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c5e87346-a44b-42a6-93a0-ee3a60c761da req-b6d3cc4e-d7bd-4141-b8ef-5b3956a6c231 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:51.349048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f734356f-9321-4fdc-a0f3-fdbb6880df8c tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:51.350806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f734356f-9321-4fdc-a0f3-fdbb6880df8c tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:51.355433 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f734356f-9321-4fdc-a0f3-fdbb6880df8c tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1335 microversion: 2.57 time: 0.253903 Mar 05 20:57:51.356315 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1308/2649] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:57:51 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1335 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:57:51.377261 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c5e87346-a44b-42a6-93a0-ee3a60c761da req-b6d3cc4e-d7bd-4141-b8ef-5b3956a6c231 service nova] Creating event network-changed:7705d2a3-c4f0-4f14-82f2-b7d4a3c2ab9f for instance e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 on nch1-master-1 Mar 05 20:57:51.387850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3bcc161f-a6e1-47f8-ac5d-50722abac8a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:51.388721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3bcc161f-a6e1-47f8-ac5d-50722abac8a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:51.395846 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c5e87346-a44b-42a6-93a0-ee3a60c761da req-b6d3cc4e-d7bd-4141-b8ef-5b3956a6c231 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073562 Mar 05 20:57:51.397768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bcc161f-a6e1-47f8-ac5d-50722abac8a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:51.398377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bcc161f-a6e1-47f8-ac5d-50722abac8a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:51.399386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bcc161f-a6e1-47f8-ac5d-50722abac8a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:51.400677 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1342/2650] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:57:51.401351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bcc161f-a6e1-47f8-ac5d-50722abac8a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:51.917100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-916f70b1-2a98-4db7-8608-c9f454652c1c req-bd062ef9-1e14-4cde-9ded-1e40c489d296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3b961b-384e-4246-8bee-f44c06d45447", "name": "network-vif-plugged", "status": "completed", "tag": "bce80fbd-c4e1-4382-be80-b1be28c5138e"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:51.935754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-916f70b1-2a98-4db7-8608-c9f454652c1c req-bd062ef9-1e14-4cde-9ded-1e40c489d296 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:51.937513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-916f70b1-2a98-4db7-8608-c9f454652c1c req-bd062ef9-1e14-4cde-9ded-1e40c489d296 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:51.963821 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-916f70b1-2a98-4db7-8608-c9f454652c1c req-bd062ef9-1e14-4cde-9ded-1e40c489d296 service nova] Creating event network-vif-plugged:bce80fbd-c4e1-4382-be80-b1be28c5138e for instance af3b961b-384e-4246-8bee-f44c06d45447 on nch1-master-1 Mar 05 20:57:51.976159 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-916f70b1-2a98-4db7-8608-c9f454652c1c req-bd062ef9-1e14-4cde-9ded-1e40c489d296 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065625 Mar 05 20:57:51.978430 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1343/2651] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:57:51.987165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3bcc161f-a6e1-47f8-ac5d-50722abac8a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:51.995172 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3bcc161f-a6e1-47f8-ac5d-50722abac8a5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1524 microversion: 2.1 time: 0.611227 Mar 05 20:57:52.002598 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1309/2652] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:51 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1524 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:52.081236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d5292666-3f42-4563-b70d-a46db8b726e7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:52.083201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d5292666-3f42-4563-b70d-a46db8b726e7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:52.091426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5292666-3f42-4563-b70d-a46db8b726e7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:52.092467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5292666-3f42-4563-b70d-a46db8b726e7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:52.093680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5292666-3f42-4563-b70d-a46db8b726e7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:52.094355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5292666-3f42-4563-b70d-a46db8b726e7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:52.296861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d5292666-3f42-4563-b70d-a46db8b726e7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:52.305267 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d5292666-3f42-4563-b70d-a46db8b726e7 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1509 microversion: 2.1 time: 0.228320 Mar 05 20:57:52.306089 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1344/2653] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:52 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:52.306872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-df2ad198-a712-4288-9d6e-68fbfb78f3c2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:52.308173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-df2ad198-a712-4288-9d6e-68fbfb78f3c2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:52.318606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df2ad198-a712-4288-9d6e-68fbfb78f3c2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:52.319409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df2ad198-a712-4288-9d6e-68fbfb78f3c2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:52.324047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df2ad198-a712-4288-9d6e-68fbfb78f3c2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:52.324871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df2ad198-a712-4288-9d6e-68fbfb78f3c2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:52.381913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b05ef1cf-dd02-46a8-a9e0-eec2180c4cbb tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:52.382546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b05ef1cf-dd02-46a8-a9e0-eec2180c4cbb tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:52.396987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b05ef1cf-dd02-46a8-a9e0-eec2180c4cbb tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:52.397638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b05ef1cf-dd02-46a8-a9e0-eec2180c4cbb tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:52.398641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b05ef1cf-dd02-46a8-a9e0-eec2180c4cbb tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:52.407646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b05ef1cf-dd02-46a8-a9e0-eec2180c4cbb tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:52.608002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b05ef1cf-dd02-46a8-a9e0-eec2180c4cbb tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:52.618439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b05ef1cf-dd02-46a8-a9e0-eec2180c4cbb tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:52.636762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b05ef1cf-dd02-46a8-a9e0-eec2180c4cbb tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:52.638301 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b05ef1cf-dd02-46a8-a9e0-eec2180c4cbb tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1335 microversion: 2.57 time: 0.261325 Mar 05 20:57:52.639077 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1345/2654] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:57:52 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1335 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 20:57:52.767129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-96cbc881-40ee-484a-8be6-0fbf763819f6 req-c932fcf7-f3a4-47e9-9b11-b601588e3134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "056687e6-170e-40fd-8aba-54f356d86d39", "name": "network-vif-deleted", "tag": "fb31d45e-66c4-411f-b2d5-2f7fc846eb16"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:52.785554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-96cbc881-40ee-484a-8be6-0fbf763819f6 req-c932fcf7-f3a4-47e9-9b11-b601588e3134 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:52.786649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-96cbc881-40ee-484a-8be6-0fbf763819f6 req-c932fcf7-f3a4-47e9-9b11-b601588e3134 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:52.813878 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-96cbc881-40ee-484a-8be6-0fbf763819f6 req-c932fcf7-f3a4-47e9-9b11-b601588e3134 service nova] Creating event network-vif-deleted:fb31d45e-66c4-411f-b2d5-2f7fc846eb16 for instance 056687e6-170e-40fd-8aba-54f356d86d39 on nch2-master-1 Mar 05 20:57:52.822372 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-96cbc881-40ee-484a-8be6-0fbf763819f6 req-c932fcf7-f3a4-47e9-9b11-b601588e3134 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059342 Mar 05 20:57:52.823292 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1346/2655] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:57:53.013375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-34200755-cb39-4828-acba-3fd5d9bde6fd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:53.014094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-34200755-cb39-4828-acba-3fd5d9bde6fd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:53.023841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34200755-cb39-4828-acba-3fd5d9bde6fd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:53.024296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34200755-cb39-4828-acba-3fd5d9bde6fd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:53.025091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34200755-cb39-4828-acba-3fd5d9bde6fd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:53.025547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34200755-cb39-4828-acba-3fd5d9bde6fd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:53.296491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-34200755-cb39-4828-acba-3fd5d9bde6fd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:53.309275 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-34200755-cb39-4828-acba-3fd5d9bde6fd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1524 microversion: 2.1 time: 0.300174 Mar 05 20:57:53.310554 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1347/2656] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:53 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1524 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:53.338552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c016b94-4807-4afa-9d83-5da4679e0c29 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:53.339282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3c016b94-4807-4afa-9d83-5da4679e0c29 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:53.345975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c016b94-4807-4afa-9d83-5da4679e0c29 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:53.346443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c016b94-4807-4afa-9d83-5da4679e0c29 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:53.347296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c016b94-4807-4afa-9d83-5da4679e0c29 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:53.347824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c016b94-4807-4afa-9d83-5da4679e0c29 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:53.431499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c016b94-4807-4afa-9d83-5da4679e0c29 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:53.433011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c016b94-4807-4afa-9d83-5da4679e0c29 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:53.433761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-3c016b94-4807-4afa-9d83-5da4679e0c29 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lazy-loading 'fault' on Instance uuid 056687e6-170e-40fd-8aba-54f356d86d39 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:57:53.487197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3c016b94-4807-4afa-9d83-5da4679e0c29 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb81a21681024c0188aedcc5f5287d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '942cce2cde71460d95a12bea3862813d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:53.496312 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3c016b94-4807-4afa-9d83-5da4679e0c29 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 200 len: 1306 microversion: 2.1 time: 0.176774 Mar 05 20:57:53.508487 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1348/2657] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:53 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 1306 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:53.590711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-df2ad198-a712-4288-9d6e-68fbfb78f3c2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:53.609523 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-df2ad198-a712-4288-9d6e-68fbfb78f3c2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1310 microversion: 2.1 time: 1.305253 Mar 05 20:57:53.610207 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1310/2658] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:52 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1310 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:57:53.658404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-732fd7b0-2f0c-4f0b-abb4-5de0308c9a85 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:53.658869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-732fd7b0-2f0c-4f0b-abb4-5de0308c9a85 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:53.673723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-732fd7b0-2f0c-4f0b-abb4-5de0308c9a85 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:53.674178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-732fd7b0-2f0c-4f0b-abb4-5de0308c9a85 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:53.674961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-732fd7b0-2f0c-4f0b-abb4-5de0308c9a85 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:53.675398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-732fd7b0-2f0c-4f0b-abb4-5de0308c9a85 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:53.793399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-732fd7b0-2f0c-4f0b-abb4-5de0308c9a85 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:53.812679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-732fd7b0-2f0c-4f0b-abb4-5de0308c9a85 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:53.814558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-732fd7b0-2f0c-4f0b-abb4-5de0308c9a85 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:53.816084 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-732fd7b0-2f0c-4f0b-abb4-5de0308c9a85 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1356 microversion: 2.57 time: 0.161740 Mar 05 20:57:53.817654 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1349/2659] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:57:53 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:57:53.844212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:53.867353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:53.882403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:53.884293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:53.886008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:53.889181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:54.047301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:57:54.047885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:57:54.048458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:57:54.049067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:57:54.049558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:57:54.159694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:54.168969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:54.175046 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:54.176791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:54.177389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:54.222234 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c25b6351-5834-4997-92eb-504266eb4979 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "POST /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751/action" status: 202 len: 1137 microversion: 2.57 time: 0.389321 Mar 05 20:57:54.225252 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1311/2660] 10.222.0.15 () {62 vars in 1319 bytes} [Sat Mar 5 20:57:53 2022] POST /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751/action => generated 1137 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 05 20:57:54.245826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a168f975-cfd4-4cea-acc8-a34eed5b8019 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:54.246695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a168f975-cfd4-4cea-acc8-a34eed5b8019 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:54.268349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a168f975-cfd4-4cea-acc8-a34eed5b8019 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:54.271015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a168f975-cfd4-4cea-acc8-a34eed5b8019 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:54.273954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a168f975-cfd4-4cea-acc8-a34eed5b8019 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:54.292487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a168f975-cfd4-4cea-acc8-a34eed5b8019 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:54.326755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b1495bb1-86e3-40b2-98bf-cded1fce6907 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:54.328203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b1495bb1-86e3-40b2-98bf-cded1fce6907 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:54.344034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1495bb1-86e3-40b2-98bf-cded1fce6907 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:54.345941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1495bb1-86e3-40b2-98bf-cded1fce6907 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:54.347003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1495bb1-86e3-40b2-98bf-cded1fce6907 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:54.351495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1495bb1-86e3-40b2-98bf-cded1fce6907 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:54.487661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a168f975-cfd4-4cea-acc8-a34eed5b8019 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:54.497030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a168f975-cfd4-4cea-acc8-a34eed5b8019 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:54.498541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a168f975-cfd4-4cea-acc8-a34eed5b8019 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:54.499746 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a168f975-cfd4-4cea-acc8-a34eed5b8019 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.261271 Mar 05 20:57:54.500324 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1350/2661] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:57:54 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:57:54.528597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fb06be3f-d200-4175-9cc6-041d26e9e328 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:54.532815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fb06be3f-d200-4175-9cc6-041d26e9e328 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] [instance: 056687e6-170e-40fd-8aba-54f356d86d39] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:54.562405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb06be3f-d200-4175-9cc6-041d26e9e328 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:54.562806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb06be3f-d200-4175-9cc6-041d26e9e328 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:54.563632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb06be3f-d200-4175-9cc6-041d26e9e328 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:54.564118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb06be3f-d200-4175-9cc6-041d26e9e328 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:54.640042 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-fb06be3f-d200-4175-9cc6-041d26e9e328 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] HTTP exception thrown: Instance 056687e6-170e-40fd-8aba-54f356d86d39 could not be found. Mar 05 20:57:54.641204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fb06be3f-d200-4175-9cc6-041d26e9e328 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] Returning 404 to user: Instance 056687e6-170e-40fd-8aba-54f356d86d39 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:57:54.642467 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fb06be3f-d200-4175-9cc6-041d26e9e328 tempest-ServerPasswordTestJSON-234222548 tempest-ServerPasswordTestJSON-234222548-project] 10.222.0.15 "GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39" status: 404 len: 111 microversion: 2.1 time: 0.120536 Mar 05 20:57:54.645232 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1351/2662] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:54 2022] GET /compute/v2.1/servers/056687e6-170e-40fd-8aba-54f356d86d39 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:57:54.658280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6908b3fc-4e3d-4399-a257-28afaf0e65f5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:54.659075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6908b3fc-4e3d-4399-a257-28afaf0e65f5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:54.685604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6908b3fc-4e3d-4399-a257-28afaf0e65f5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:54.686072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6908b3fc-4e3d-4399-a257-28afaf0e65f5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:54.686872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6908b3fc-4e3d-4399-a257-28afaf0e65f5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:54.687317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6908b3fc-4e3d-4399-a257-28afaf0e65f5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:55.312992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b1495bb1-86e3-40b2-98bf-cded1fce6907 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:55.324555 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b1495bb1-86e3-40b2-98bf-cded1fce6907 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1524 microversion: 2.1 time: 1.001905 Mar 05 20:57:55.325130 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1312/2663] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:54 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1524 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:55.336918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6908b3fc-4e3d-4399-a257-28afaf0e65f5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:55.341028 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6908b3fc-4e3d-4399-a257-28afaf0e65f5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1310 microversion: 2.1 time: 0.693754 Mar 05 20:57:55.350654 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1352/2664] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:54 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1310 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:55.521675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-acc91141-a99f-4b44-958b-d40a334d9ee6 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:55.522582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-acc91141-a99f-4b44-958b-d40a334d9ee6 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:55.530960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-acc91141-a99f-4b44-958b-d40a334d9ee6 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:55.536793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-acc91141-a99f-4b44-958b-d40a334d9ee6 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:55.537950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-acc91141-a99f-4b44-958b-d40a334d9ee6 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:55.538575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-acc91141-a99f-4b44-958b-d40a334d9ee6 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:55.746985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-acc91141-a99f-4b44-958b-d40a334d9ee6 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:55.757843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-acc91141-a99f-4b44-958b-d40a334d9ee6 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:55.759354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-acc91141-a99f-4b44-958b-d40a334d9ee6 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:55.768382 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-acc91141-a99f-4b44-958b-d40a334d9ee6 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.251171 Mar 05 20:57:55.769873 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1313/2665] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:57:55 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:57:56.343351 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-49407581-c8ab-44e1-ba58-21cb65320426 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:56.344067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-49407581-c8ab-44e1-ba58-21cb65320426 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:56.361536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2a01bda8-325a-49d6-b67d-5c848306725c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:56.362153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2a01bda8-325a-49d6-b67d-5c848306725c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:56.386642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-49407581-c8ab-44e1-ba58-21cb65320426 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:56.387201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-49407581-c8ab-44e1-ba58-21cb65320426 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:56.388274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-49407581-c8ab-44e1-ba58-21cb65320426 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:56.388861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-49407581-c8ab-44e1-ba58-21cb65320426 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:56.391629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a01bda8-325a-49d6-b67d-5c848306725c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:56.392388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a01bda8-325a-49d6-b67d-5c848306725c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:56.396840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a01bda8-325a-49d6-b67d-5c848306725c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:56.397494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a01bda8-325a-49d6-b67d-5c848306725c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:56.760525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2a01bda8-325a-49d6-b67d-5c848306725c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:56.786841 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2a01bda8-325a-49d6-b67d-5c848306725c tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1310 microversion: 2.1 time: 0.429718 Mar 05 20:57:56.787984 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1314/2666] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:56 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1310 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:56.800844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c52e7250-4a09-4a0c-9dff-1b4d811f7240 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:56.802426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c52e7250-4a09-4a0c-9dff-1b4d811f7240 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:56.828046 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c52e7250-4a09-4a0c-9dff-1b4d811f7240 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:56.829194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c52e7250-4a09-4a0c-9dff-1b4d811f7240 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:56.830993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c52e7250-4a09-4a0c-9dff-1b4d811f7240 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:56.834893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c52e7250-4a09-4a0c-9dff-1b4d811f7240 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:56.903199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-49407581-c8ab-44e1-ba58-21cb65320426 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:56.912213 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-49407581-c8ab-44e1-ba58-21cb65320426 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1524 microversion: 2.1 time: 0.573610 Mar 05 20:57:56.918311 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1353/2667] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:56 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1524 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:57.096562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c52e7250-4a09-4a0c-9dff-1b4d811f7240 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:57.113967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c52e7250-4a09-4a0c-9dff-1b4d811f7240 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:57.123961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c52e7250-4a09-4a0c-9dff-1b4d811f7240 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:57.126075 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c52e7250-4a09-4a0c-9dff-1b4d811f7240 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.334594 Mar 05 20:57:57.131102 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1315/2668] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:57:56 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:57:57.806278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-21117b0a-6bd2-491e-be5a-12f2775d8378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:57.808557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-21117b0a-6bd2-491e-be5a-12f2775d8378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:57.826712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21117b0a-6bd2-491e-be5a-12f2775d8378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:57.827537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21117b0a-6bd2-491e-be5a-12f2775d8378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:57.828623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21117b0a-6bd2-491e-be5a-12f2775d8378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:57.829252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21117b0a-6bd2-491e-be5a-12f2775d8378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:57.907921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a893c488-bbd4-4349-afb7-ebbbaad5c8c6 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] Action: 'create', calling method: .version_select at 0x7fed4f89bc10>, body: {"pool": null} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:57:58.144319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-21117b0a-6bd2-491e-be5a-12f2775d8378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:58.153656 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-21117b0a-6bd2-491e-be5a-12f2775d8378 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1310 microversion: 2.1 time: 0.352845 Mar 05 20:57:58.174933 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1316/2669] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:57 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1310 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:58.181743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ec985a27-a685-4cb6-a412-088143d34338 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:58.182848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ec985a27-a685-4cb6-a412-088143d34338 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:58.218407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec985a27-a685-4cb6-a412-088143d34338 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:58.219150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec985a27-a685-4cb6-a412-088143d34338 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:58.220217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec985a27-a685-4cb6-a412-088143d34338 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:58.220854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec985a27-a685-4cb6-a412-088143d34338 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:58.542786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ec985a27-a685-4cb6-a412-088143d34338 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:58.553901 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ec985a27-a685-4cb6-a412-088143d34338 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1524 microversion: 2.1 time: 0.376400 Mar 05 20:57:58.554495 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1317/2670] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:58 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1524 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:58.570930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e363767c-f9c5-4c94-956c-56648b1cfad3 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:58.574299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e363767c-f9c5-4c94-956c-56648b1cfad3 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:58.591488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e363767c-f9c5-4c94-956c-56648b1cfad3 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:58.592677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e363767c-f9c5-4c94-956c-56648b1cfad3 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:58.593618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e363767c-f9c5-4c94-956c-56648b1cfad3 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:58.594491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e363767c-f9c5-4c94-956c-56648b1cfad3 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:58.812757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e363767c-f9c5-4c94-956c-56648b1cfad3 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:58.831413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e363767c-f9c5-4c94-956c-56648b1cfad3 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:58.837258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e363767c-f9c5-4c94-956c-56648b1cfad3 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:58.841150 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e363767c-f9c5-4c94-956c-56648b1cfad3 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.285612 Mar 05 20:57:58.842430 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1318/2671] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:57:58 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:57:59.174791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ae40adf6-be1f-4507-a5d0-83c560267c68 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:59.175684 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ae40adf6-be1f-4507-a5d0-83c560267c68 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:59.187184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae40adf6-be1f-4507-a5d0-83c560267c68 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:59.190609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae40adf6-be1f-4507-a5d0-83c560267c68 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:59.193688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae40adf6-be1f-4507-a5d0-83c560267c68 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:59.195061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae40adf6-be1f-4507-a5d0-83c560267c68 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:59.506796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ae40adf6-be1f-4507-a5d0-83c560267c68 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:59.514674 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ae40adf6-be1f-4507-a5d0-83c560267c68 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1310 microversion: 2.1 time: 0.344102 Mar 05 20:57:59.523931 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1319/2672] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:59 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1310 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:59.571852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-201c24ae-d8ab-4449-b165-309808f81ae1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:57:59.572504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-201c24ae-d8ab-4449-b165-309808f81ae1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:57:59.584955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-201c24ae-d8ab-4449-b165-309808f81ae1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:59.590451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-201c24ae-d8ab-4449-b165-309808f81ae1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:59.592909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-201c24ae-d8ab-4449-b165-309808f81ae1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:57:59.593536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-201c24ae-d8ab-4449-b165-309808f81ae1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:57:59.946109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-201c24ae-d8ab-4449-b165-309808f81ae1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:57:59.953405 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-201c24ae-d8ab-4449-b165-309808f81ae1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1524 microversion: 2.1 time: 0.385952 Mar 05 20:57:59.963847 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1320/2673] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:57:59 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1524 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:57:59.970620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d78c0ce0-c9b0-48c8-893a-17f847cfbbf8 req-aa40fc98-3ec2-4955-8d18-ddd6200ff6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97c5a8d-7d31-43dc-a2e2-0227ff5b4050", "name": "network-vif-plugged", "status": "completed", "tag": "7705d2a3-c4f0-4f14-82f2-b7d4a3c2ab9f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:00.021461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d78c0ce0-c9b0-48c8-893a-17f847cfbbf8 req-aa40fc98-3ec2-4955-8d18-ddd6200ff6fa service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:00.021962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d78c0ce0-c9b0-48c8-893a-17f847cfbbf8 req-aa40fc98-3ec2-4955-8d18-ddd6200ff6fa service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:00.061585 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d78c0ce0-c9b0-48c8-893a-17f847cfbbf8 req-aa40fc98-3ec2-4955-8d18-ddd6200ff6fa service nova] Creating event network-vif-plugged:7705d2a3-c4f0-4f14-82f2-b7d4a3c2ab9f for instance e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 on nch1-master-1 Mar 05 20:58:00.068820 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d78c0ce0-c9b0-48c8-893a-17f847cfbbf8 req-aa40fc98-3ec2-4955-8d18-ddd6200ff6fa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111185 Mar 05 20:58:00.069991 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1321/2674] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:00.077457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4f6d5783-6c19-4c1b-904f-79f2e0986c95 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:00.078344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4f6d5783-6c19-4c1b-904f-79f2e0986c95 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:00.087892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f6d5783-6c19-4c1b-904f-79f2e0986c95 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:00.088596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f6d5783-6c19-4c1b-904f-79f2e0986c95 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:00.101858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f6d5783-6c19-4c1b-904f-79f2e0986c95 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:00.102659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f6d5783-6c19-4c1b-904f-79f2e0986c95 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:00.284071 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a893c488-bbd4-4349-afb7-ebbbaad5c8c6 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] 10.222.0.15 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.916095 Mar 05 20:58:00.284767 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1354/2675] 10.222.0.15 () {60 vars in 1169 bytes} [Sat Mar 5 20:57:57 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:00.299475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3bc932bd-61b0-4553-ab0a-7b3c8183c455 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] Calling method '.version_select at 0x7fed61adaf70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:00.480288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4f6d5783-6c19-4c1b-904f-79f2e0986c95 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:00.492888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4f6d5783-6c19-4c1b-904f-79f2e0986c95 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:00.503416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4f6d5783-6c19-4c1b-904f-79f2e0986c95 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:00.507071 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4f6d5783-6c19-4c1b-904f-79f2e0986c95 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.435714 Mar 05 20:58:00.510768 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1322/2676] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:00 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:00.534218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-61ebb08d-b7bb-47da-b4e5-ab6c93b0b371 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:00.535096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-61ebb08d-b7bb-47da-b4e5-ab6c93b0b371 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:00.561978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61ebb08d-b7bb-47da-b4e5-ab6c93b0b371 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:00.570251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61ebb08d-b7bb-47da-b4e5-ab6c93b0b371 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:00.572326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61ebb08d-b7bb-47da-b4e5-ab6c93b0b371 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:00.574464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61ebb08d-b7bb-47da-b4e5-ab6c93b0b371 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:00.646995 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3bc932bd-61b0-4553-ab0a-7b3c8183c455 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] 10.222.0.15 "GET /compute/v2.1/os-floating-ips/128431d3-5ad7-4739-99f4-a9a410846fe8" status: 200 len: 142 microversion: 2.1 time: 0.354691 Mar 05 20:58:00.648301 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1355/2677] 10.222.0.15 () {58 vars in 1259 bytes} [Sat Mar 5 20:58:00 2022] GET /compute/v2.1/os-floating-ips/128431d3-5ad7-4739-99f4-a9a410846fe8 => generated 142 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:00.673965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-07f9843e-6ebd-4c25-8028-363372ad75be tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] Calling method '.version_select at 0x7fed4f8b2f70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:01.084712 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-07f9843e-6ebd-4c25-8028-363372ad75be tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] 10.222.0.15 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.425631 Mar 05 20:58:01.085765 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1356/2678] 10.222.0.15 () {58 vars in 1148 bytes} [Sat Mar 5 20:58:00 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:01.090620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8701cf73-4404-44b6-8f02-c258ac77a66c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:01.093938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8701cf73-4404-44b6-8f02-c258ac77a66c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:01.105129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8701cf73-4404-44b6-8f02-c258ac77a66c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:01.106009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8701cf73-4404-44b6-8f02-c258ac77a66c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:01.106992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8701cf73-4404-44b6-8f02-c258ac77a66c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:01.107606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8701cf73-4404-44b6-8f02-c258ac77a66c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:01.393357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8701cf73-4404-44b6-8f02-c258ac77a66c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:01.405399 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8701cf73-4404-44b6-8f02-c258ac77a66c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1524 microversion: 2.1 time: 0.317410 Mar 05 20:58:01.417367 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1357/2679] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:01 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1524 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:01.422706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a37a831f-b579-408a-b6ad-5e8d05fa8707 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] Calling method '.version_select at 0x7fed4f89bee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:01.706360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-61ebb08d-b7bb-47da-b4e5-ab6c93b0b371 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:01.727758 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-61ebb08d-b7bb-47da-b4e5-ab6c93b0b371 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1310 microversion: 2.1 time: 1.194894 Mar 05 20:58:01.730870 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1323/2680] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:00 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1310 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:01.743370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c3aadeb-06e5-4f54-97d6-a99a7e7a10a0 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:01.744455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4c3aadeb-06e5-4f54-97d6-a99a7e7a10a0 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:01.758455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c3aadeb-06e5-4f54-97d6-a99a7e7a10a0 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:01.759143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c3aadeb-06e5-4f54-97d6-a99a7e7a10a0 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:01.760305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c3aadeb-06e5-4f54-97d6-a99a7e7a10a0 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:01.760936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c3aadeb-06e5-4f54-97d6-a99a7e7a10a0 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:01.941403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4c3aadeb-06e5-4f54-97d6-a99a7e7a10a0 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:01.956170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4c3aadeb-06e5-4f54-97d6-a99a7e7a10a0 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:01.957752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4c3aadeb-06e5-4f54-97d6-a99a7e7a10a0 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:01.965035 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4c3aadeb-06e5-4f54-97d6-a99a7e7a10a0 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.230401 Mar 05 20:58:01.974088 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1324/2681] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:01 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:02.423722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82afc8e9-98cd-4e99-9322-8a72996332bd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:02.424507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-82afc8e9-98cd-4e99-9322-8a72996332bd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:02.450598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82afc8e9-98cd-4e99-9322-8a72996332bd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:02.453749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82afc8e9-98cd-4e99-9322-8a72996332bd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:02.460133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82afc8e9-98cd-4e99-9322-8a72996332bd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:02.463858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82afc8e9-98cd-4e99-9322-8a72996332bd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:02.772450 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a37a831f-b579-408a-b6ad-5e8d05fa8707 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] 10.222.0.15 "DELETE /compute/v2.1/os-floating-ips/128431d3-5ad7-4739-99f4-a9a410846fe8" status: 202 len: 0 microversion: 2.1 time: 1.351982 Mar 05 20:58:02.773430 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1358/2682] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:58:01 2022] DELETE /compute/v2.1/os-floating-ips/128431d3-5ad7-4739-99f4-a9a410846fe8 => generated 0 bytes in 1355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:58:02.782855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2ec7c7d2-3743-4d38-81f4-6b1cc7ba5040 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:02.783475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2ec7c7d2-3743-4d38-81f4-6b1cc7ba5040 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:02.801725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ec7c7d2-3743-4d38-81f4-6b1cc7ba5040 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:02.802024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ec7c7d2-3743-4d38-81f4-6b1cc7ba5040 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:02.804530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-82afc8e9-98cd-4e99-9322-8a72996332bd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:02.811229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ec7c7d2-3743-4d38-81f4-6b1cc7ba5040 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:02.811719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ec7c7d2-3743-4d38-81f4-6b1cc7ba5040 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:02.813628 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-82afc8e9-98cd-4e99-9322-8a72996332bd tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1524 microversion: 2.1 time: 0.394211 Mar 05 20:58:02.825784 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1325/2683] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:02 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1524 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:02.833662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2458b7e8-ca83-46af-be5d-be4a6fb65bb4 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] Action: 'create', calling method: .version_select at 0x7fed61b90040>, body: {"pool": null} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:03.103916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2ec7c7d2-3743-4d38-81f4-6b1cc7ba5040 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:03.111754 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2ec7c7d2-3743-4d38-81f4-6b1cc7ba5040 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1310 microversion: 2.1 time: 0.332663 Mar 05 20:58:03.112346 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1359/2684] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:02 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1310 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:03.121760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8821ac14-336a-4f27-9109-0fe060157a15 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:03.122663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8821ac14-336a-4f27-9109-0fe060157a15 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:03.131353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8821ac14-336a-4f27-9109-0fe060157a15 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:03.132174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8821ac14-336a-4f27-9109-0fe060157a15 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:03.133790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8821ac14-336a-4f27-9109-0fe060157a15 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:03.134591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8821ac14-336a-4f27-9109-0fe060157a15 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:03.267292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8821ac14-336a-4f27-9109-0fe060157a15 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:03.282394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8821ac14-336a-4f27-9109-0fe060157a15 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:03.284089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8821ac14-336a-4f27-9109-0fe060157a15 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:03.285945 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8821ac14-336a-4f27-9109-0fe060157a15 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.168335 Mar 05 20:58:03.296821 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1360/2685] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:03 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:03.831280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8f480b06-efed-4143-bc36-7904968d1e42 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:03.832722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8f480b06-efed-4143-bc36-7904968d1e42 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:03.842045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f480b06-efed-4143-bc36-7904968d1e42 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:03.842147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f480b06-efed-4143-bc36-7904968d1e42 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:03.842955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f480b06-efed-4143-bc36-7904968d1e42 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:03.843325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f480b06-efed-4143-bc36-7904968d1e42 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:04.069253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8f480b06-efed-4143-bc36-7904968d1e42 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:04.078408 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8f480b06-efed-4143-bc36-7904968d1e42 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1524 microversion: 2.1 time: 0.251011 Mar 05 20:58:04.089023 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1361/2686] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:03 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1524 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:04.131029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b1833cee-aaa3-4083-815a-42bc4a765392 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:04.131697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b1833cee-aaa3-4083-815a-42bc4a765392 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:04.152456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1833cee-aaa3-4083-815a-42bc4a765392 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:04.153202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1833cee-aaa3-4083-815a-42bc4a765392 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:04.155821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1833cee-aaa3-4083-815a-42bc4a765392 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:04.161241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1833cee-aaa3-4083-815a-42bc4a765392 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:04.408701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b1833cee-aaa3-4083-815a-42bc4a765392 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:04.422739 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b1833cee-aaa3-4083-815a-42bc4a765392 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1492 microversion: 2.1 time: 0.297197 Mar 05 20:58:04.423803 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1362/2687] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:04 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1492 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:04.429508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-00d69fab-814b-466f-8d36-a273aea69f04 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:04.430304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-00d69fab-814b-466f-8d36-a273aea69f04 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:04.438432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00d69fab-814b-466f-8d36-a273aea69f04 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:04.439056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00d69fab-814b-466f-8d36-a273aea69f04 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:04.440546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00d69fab-814b-466f-8d36-a273aea69f04 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:04.442103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00d69fab-814b-466f-8d36-a273aea69f04 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:04.536442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-00d69fab-814b-466f-8d36-a273aea69f04 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:04.552006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-00d69fab-814b-466f-8d36-a273aea69f04 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:04.554011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-00d69fab-814b-466f-8d36-a273aea69f04 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:04.555554 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-00d69fab-814b-466f-8d36-a273aea69f04 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.130640 Mar 05 20:58:04.556305 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1363/2688] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:04 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:04.561101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d7d0a92d-4761-465e-a5f3-0d6848a9404c tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:04.561917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d7d0a92d-4761-465e-a5f3-0d6848a9404c tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:04.568977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7d0a92d-4761-465e-a5f3-0d6848a9404c tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:04.569626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7d0a92d-4761-465e-a5f3-0d6848a9404c tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:04.570673 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7d0a92d-4761-465e-a5f3-0d6848a9404c tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:04.571346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7d0a92d-4761-465e-a5f3-0d6848a9404c tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:04.733507 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d7d0a92d-4761-465e-a5f3-0d6848a9404c tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1643 microversion: 2.1 time: 0.175927 Mar 05 20:58:04.734100 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1364/2689] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:04 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1643 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:04.753263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2b380663-efa7-4147-a93f-15c790a12c4b tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:04.755280 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:58:04.755280 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 20:58:04.756531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b380663-efa7-4147-a93f-15c790a12c4b tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:04.756994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b380663-efa7-4147-a93f-15c790a12c4b tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:04.757804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b380663-efa7-4147-a93f-15c790a12c4b tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:04.758247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b380663-efa7-4147-a93f-15c790a12c4b tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:04.811524 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2b380663-efa7-4147-a93f-15c790a12c4b tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.060943 Mar 05 20:58:04.811524 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1365/2690] 10.222.0.15 () {58 vars in 1175 bytes} [Sat Mar 5 20:58:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:58:05.098717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d093f461-a032-470d-bfe4-4a1e1a0662ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:05.099408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d093f461-a032-470d-bfe4-4a1e1a0662ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:05.112257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d093f461-a032-470d-bfe4-4a1e1a0662ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:05.113050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d093f461-a032-470d-bfe4-4a1e1a0662ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:05.114255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d093f461-a032-470d-bfe4-4a1e1a0662ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:05.115324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d093f461-a032-470d-bfe4-4a1e1a0662ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:05.452198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d093f461-a032-470d-bfe4-4a1e1a0662ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:05.471412 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d093f461-a032-470d-bfe4-4a1e1a0662ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1524 microversion: 2.1 time: 0.376952 Mar 05 20:58:05.471694 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1366/2691] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:05 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1524 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:05.576149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6ee94362-6a99-4332-978f-2c1238688443 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:05.576149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6ee94362-6a99-4332-978f-2c1238688443 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:05.587289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ee94362-6a99-4332-978f-2c1238688443 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:05.590540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ee94362-6a99-4332-978f-2c1238688443 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:05.591614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ee94362-6a99-4332-978f-2c1238688443 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:05.592294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ee94362-6a99-4332-978f-2c1238688443 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:05.711238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6ee94362-6a99-4332-978f-2c1238688443 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:05.727071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6ee94362-6a99-4332-978f-2c1238688443 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:05.728982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6ee94362-6a99-4332-978f-2c1238688443 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:05.730729 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6ee94362-6a99-4332-978f-2c1238688443 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.160243 Mar 05 20:58:05.731827 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1367/2692] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:05 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:05.966905 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2458b7e8-ca83-46af-be5d-be4a6fb65bb4 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] 10.222.0.15 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.139643 Mar 05 20:58:05.968009 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1326/2693] 10.222.0.15 () {60 vars in 1169 bytes} [Sat Mar 5 20:58:02 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:05.982851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1fed6378-a958-4f62-b9f4-0fc88972efa5 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] Calling method '.version_select at 0x7fed61b8c0d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:06.118806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-588bf5ec-c391-4eb5-970f-faca559910e7 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:06.119349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-588bf5ec-c391-4eb5-970f-faca559910e7 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:06.133226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-588bf5ec-c391-4eb5-970f-faca559910e7 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:06.133679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-588bf5ec-c391-4eb5-970f-faca559910e7 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:06.134474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-588bf5ec-c391-4eb5-970f-faca559910e7 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:06.134913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-588bf5ec-c391-4eb5-970f-faca559910e7 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:06.234218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-588bf5ec-c391-4eb5-970f-faca559910e7 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:58:06.445082 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-588bf5ec-c391-4eb5-970f-faca559910e7 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "DELETE /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 204 len: 0 microversion: 2.32 time: 0.710605 Mar 05 20:58:06.446152 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1368/2694] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 20:58:05 2022] DELETE /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:58:06.455308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-44eabd75-d2df-4f06-b485-c015c8ba9562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4d17444-3aa0-4844-b95f-1594f1c1b9ec", "device": "/dev/xvdb"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:06.459552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-44eabd75-d2df-4f06-b485-c015c8ba9562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:06.473679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44eabd75-d2df-4f06-b485-c015c8ba9562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:06.473679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44eabd75-d2df-4f06-b485-c015c8ba9562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:06.484818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44eabd75-d2df-4f06-b485-c015c8ba9562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:06.485237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44eabd75-d2df-4f06-b485-c015c8ba9562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:06.990723 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-44eabd75-d2df-4f06-b485-c015c8ba9562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "POST /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.542717 Mar 05 20:58:06.991594 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1369/2695] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 20:58:06 2022] POST /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050/os-volume_attachments => generated 194 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:07.012050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c2c5c6e-e6df-42a5-9515-31fd3dd409a5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:07.014145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9c2c5c6e-e6df-42a5-9515-31fd3dd409a5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:07.030477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c2c5c6e-e6df-42a5-9515-31fd3dd409a5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:07.032271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c2c5c6e-e6df-42a5-9515-31fd3dd409a5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:07.036085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c2c5c6e-e6df-42a5-9515-31fd3dd409a5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:07.038041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c2c5c6e-e6df-42a5-9515-31fd3dd409a5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:07.683186 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1fed6378-a958-4f62-b9f4-0fc88972efa5 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] 10.222.0.15 "DELETE /compute/v2.1/os-floating-ips/f38f28a5-39f9-4a6b-835e-ed30d1f02e0e" status: 202 len: 0 microversion: 2.1 time: 1.707734 Mar 05 20:58:07.691249 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1327/2696] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:58:05 2022] DELETE /compute/v2.1/os-floating-ips/f38f28a5-39f9-4a6b-835e-ed30d1f02e0e => generated 0 bytes in 1717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 20:58:07.699104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f2e7b02e-92c1-48e1-8013-5fb5acefb17c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:07.702550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f2e7b02e-92c1-48e1-8013-5fb5acefb17c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:07.732160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2e7b02e-92c1-48e1-8013-5fb5acefb17c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:07.734344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9c2c5c6e-e6df-42a5-9515-31fd3dd409a5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:07.735625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2e7b02e-92c1-48e1-8013-5fb5acefb17c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:07.737257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2e7b02e-92c1-48e1-8013-5fb5acefb17c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:07.739840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2e7b02e-92c1-48e1-8013-5fb5acefb17c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:07.746267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9c2c5c6e-e6df-42a5-9515-31fd3dd409a5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:07.751315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9c2c5c6e-e6df-42a5-9515-31fd3dd409a5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:07.758313 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c2c5c6e-e6df-42a5-9515-31fd3dd409a5 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 2949 microversion: 2.32 time: 0.760628 Mar 05 20:58:07.771632 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1370/2697] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:06 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 2949 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:07.782859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b309c88b-e806-42fc-9730-9620e5eebd39 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:07.783650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b309c88b-e806-42fc-9730-9620e5eebd39 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:07.801274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b309c88b-e806-42fc-9730-9620e5eebd39 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:07.802116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b309c88b-e806-42fc-9730-9620e5eebd39 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:07.803098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b309c88b-e806-42fc-9730-9620e5eebd39 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:07.803612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b309c88b-e806-42fc-9730-9620e5eebd39 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:07.913910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b309c88b-e806-42fc-9730-9620e5eebd39 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:07.922742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b309c88b-e806-42fc-9730-9620e5eebd39 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:07.937078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b309c88b-e806-42fc-9730-9620e5eebd39 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:07.938416 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b309c88b-e806-42fc-9730-9620e5eebd39 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.165594 Mar 05 20:58:07.939102 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1371/2698] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:07 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:07.951152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f2e7b02e-92c1-48e1-8013-5fb5acefb17c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:07.955159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1a414c23-6aef-42c8-8999-bdfbbaa60b01 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] Calling method '.version_select at 0x7fed5c5f7670>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:07.959867 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f2e7b02e-92c1-48e1-8013-5fb5acefb17c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1524 microversion: 2.1 time: 0.264943 Mar 05 20:58:07.966884 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1328/2699] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:07 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1524 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:08.058327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG neutronclient.v2_0.client [None req-1a414c23-6aef-42c8-8999-bdfbbaa60b01 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f38f28a5-39f9-4a6b-835e-ed30d1f02e0e could not be found", "detail": ""}} {{(pid=141479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:58:08.059335 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-1a414c23-6aef-42c8-8999-bdfbbaa60b01 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] HTTP exception thrown: Floating IP not found for ID f38f28a5-39f9-4a6b-835e-ed30d1f02e0e Mar 05 20:58:08.060501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1a414c23-6aef-42c8-8999-bdfbbaa60b01 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] Returning 404 to user: Floating IP not found for ID f38f28a5-39f9-4a6b-835e-ed30d1f02e0e {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:08.061614 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1a414c23-6aef-42c8-8999-bdfbbaa60b01 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] 10.222.0.15 "GET /compute/v2.1/os-floating-ips/f38f28a5-39f9-4a6b-835e-ed30d1f02e0e" status: 404 len: 111 microversion: 2.1 time: 0.110328 Mar 05 20:58:08.062417 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1372/2700] 10.222.0.15 () {58 vars in 1259 bytes} [Sat Mar 5 20:58:07 2022] GET /compute/v2.1/os-floating-ips/f38f28a5-39f9-4a6b-835e-ed30d1f02e0e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:58:08.072556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e9dc070b-565d-488a-b721-35086ca93ee7 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] Calling method '.version_select at 0x7fed61b24700>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:08.183035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-e9dc070b-565d-488a-b721-35086ca93ee7 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f38f28a5-39f9-4a6b-835e-ed30d1f02e0e could not be found", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 20:58:08.183970 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-e9dc070b-565d-488a-b721-35086ca93ee7 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] HTTP exception thrown: Floating IP not found for ID f38f28a5-39f9-4a6b-835e-ed30d1f02e0e Mar 05 20:58:08.184721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e9dc070b-565d-488a-b721-35086ca93ee7 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] Returning 404 to user: Floating IP not found for ID f38f28a5-39f9-4a6b-835e-ed30d1f02e0e {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:08.185772 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e9dc070b-565d-488a-b721-35086ca93ee7 tempest-FloatingIPsTestJSON-490041709 tempest-FloatingIPsTestJSON-490041709-project] 10.222.0.15 "DELETE /compute/v2.1/os-floating-ips/f38f28a5-39f9-4a6b-835e-ed30d1f02e0e" status: 404 len: 111 microversion: 2.1 time: 0.117349 Mar 05 20:58:08.190250 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1329/2701] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:58:08 2022] DELETE /compute/v2.1/os-floating-ips/f38f28a5-39f9-4a6b-835e-ed30d1f02e0e => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:58:08.782136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-84af9d0b-dda7-4811-a1d2-fb740082d5b9 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:08.783626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-84af9d0b-dda7-4811-a1d2-fb740082d5b9 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:08.872821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84af9d0b-dda7-4811-a1d2-fb740082d5b9 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:08.872821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84af9d0b-dda7-4811-a1d2-fb740082d5b9 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:08.872821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84af9d0b-dda7-4811-a1d2-fb740082d5b9 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:08.872821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84af9d0b-dda7-4811-a1d2-fb740082d5b9 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:08.993441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-11d95723-ddff-4d32-8304-94b098bc711b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:08.994745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-11d95723-ddff-4d32-8304-94b098bc711b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:09.012444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11d95723-ddff-4d32-8304-94b098bc711b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:09.018169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11d95723-ddff-4d32-8304-94b098bc711b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:09.019879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11d95723-ddff-4d32-8304-94b098bc711b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:09.022416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11d95723-ddff-4d32-8304-94b098bc711b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:09.485668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-11d95723-ddff-4d32-8304-94b098bc711b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:09.495491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-84af9d0b-dda7-4811-a1d2-fb740082d5b9 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:09.513778 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-11d95723-ddff-4d32-8304-94b098bc711b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1524 microversion: 2.1 time: 0.523614 Mar 05 20:58:09.514625 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1330/2702] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:08 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1524 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:09.514774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-84af9d0b-dda7-4811-a1d2-fb740082d5b9 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:09.521287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-84af9d0b-dda7-4811-a1d2-fb740082d5b9 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:09.523527 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-84af9d0b-dda7-4811-a1d2-fb740082d5b9 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 2949 microversion: 2.32 time: 0.747740 Mar 05 20:58:09.538980 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1373/2703] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:08 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 2949 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:09.541424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b8888771-9a59-4fe6-af3b-c225144a41dd tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:09.546019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b8888771-9a59-4fe6-af3b-c225144a41dd tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:09.567282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8888771-9a59-4fe6-af3b-c225144a41dd tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:09.568056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8888771-9a59-4fe6-af3b-c225144a41dd tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:09.569047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8888771-9a59-4fe6-af3b-c225144a41dd tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:09.569645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8888771-9a59-4fe6-af3b-c225144a41dd tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:09.713872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b8888771-9a59-4fe6-af3b-c225144a41dd tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:09.727849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b8888771-9a59-4fe6-af3b-c225144a41dd tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:09.735591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b8888771-9a59-4fe6-af3b-c225144a41dd tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:09.737753 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b8888771-9a59-4fe6-af3b-c225144a41dd tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.221055 Mar 05 20:58:09.739746 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1331/2704] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:09 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:10.532546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5a470a21-d4bb-4707-bd65-2f1734224ff3 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:10.533793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-398b07a5-6b9b-45af-b91f-ab9e6323fa8f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:10.534425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-398b07a5-6b9b-45af-b91f-ab9e6323fa8f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:10.538776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5a470a21-d4bb-4707-bd65-2f1734224ff3 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:10.551178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a470a21-d4bb-4707-bd65-2f1734224ff3 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:10.553054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-398b07a5-6b9b-45af-b91f-ab9e6323fa8f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:10.553664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-398b07a5-6b9b-45af-b91f-ab9e6323fa8f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:10.555578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a470a21-d4bb-4707-bd65-2f1734224ff3 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:10.556607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-398b07a5-6b9b-45af-b91f-ab9e6323fa8f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:10.559366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a470a21-d4bb-4707-bd65-2f1734224ff3 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:10.559943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-398b07a5-6b9b-45af-b91f-ab9e6323fa8f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:10.560830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a470a21-d4bb-4707-bd65-2f1734224ff3 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:10.754674 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5a470a21-d4bb-4707-bd65-2f1734224ff3 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1689 microversion: 2.1 time: 0.232353 Mar 05 20:58:10.755253 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1374/2705] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:10 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1689 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:11.124107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-398b07a5-6b9b-45af-b91f-ab9e6323fa8f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:11.136689 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-398b07a5-6b9b-45af-b91f-ab9e6323fa8f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1524 microversion: 2.1 time: 0.609713 Mar 05 20:58:11.148254 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1332/2706] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:10 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1524 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:11.153971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-37ce3692-acc8-4aef-9faa-baf096bbf29e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:11.154583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-37ce3692-acc8-4aef-9faa-baf096bbf29e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:11.162750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-37ce3692-acc8-4aef-9faa-baf096bbf29e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:11.163178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-37ce3692-acc8-4aef-9faa-baf096bbf29e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:11.165797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-37ce3692-acc8-4aef-9faa-baf096bbf29e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:11.166401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-37ce3692-acc8-4aef-9faa-baf096bbf29e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:11.271661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-504914418", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:11.340843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] validate_networks() for [('dd3faab4-7d75-49f7-880e-c7d935436cb4', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:58:11.775762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-37ce3692-acc8-4aef-9faa-baf096bbf29e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:11.786563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-37ce3692-acc8-4aef-9faa-baf096bbf29e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:11.801363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-37ce3692-acc8-4aef-9faa-baf096bbf29e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:11.802849 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-37ce3692-acc8-4aef-9faa-baf096bbf29e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 2949 microversion: 2.32 time: 0.653555 Mar 05 20:58:11.803616 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1333/2707] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:11 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 2949 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:11.808683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3b55775a-b3df-43d8-a88c-80089a651eac tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:11.809242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3b55775a-b3df-43d8-a88c-80089a651eac tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:11.826643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b55775a-b3df-43d8-a88c-80089a651eac tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:11.827337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b55775a-b3df-43d8-a88c-80089a651eac tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:11.828381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b55775a-b3df-43d8-a88c-80089a651eac tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:11.828972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b55775a-b3df-43d8-a88c-80089a651eac tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:12.118409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:58:12.118939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:58:12.119523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:58:12.120079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:58:12.120617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:58:12.135366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:12.139302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:12.144091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:12.145157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:12.201518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Getting quotas for project 99fe3e49fc5e47c3bd99ee3debc420ee. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:58:12.208360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Getting quotas for user c4bbe0a5d6524aae9838cc663f70caa4 and project 99fe3e49fc5e47c3bd99ee3debc420ee. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:58:12.225117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:58:12.227981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:58:12.336579 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f84d7042-2ae3-4c39-b72d-13aebb7ecf7a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.578398 Mar 05 20:58:12.337825 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1375/2708] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:58:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:58:12.355059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b5662f02-4b99-4575-995f-228880b83da6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:12.367329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b5662f02-4b99-4575-995f-228880b83da6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:12.374533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5662f02-4b99-4575-995f-228880b83da6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:12.374766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5662f02-4b99-4575-995f-228880b83da6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:12.376235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5662f02-4b99-4575-995f-228880b83da6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:12.377096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5662f02-4b99-4575-995f-228880b83da6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:12.433825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-b5662f02-4b99-4575-995f-228880b83da6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lazy-loading 'flavor' on Instance uuid e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:58:12.464286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b5662f02-4b99-4575-995f-228880b83da6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Going to try to live migrate instance to nch2-master-1 {{(pid=141479) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 05 20:58:12.497775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3b55775a-b3df-43d8-a88c-80089a651eac tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:12.515537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3b55775a-b3df-43d8-a88c-80089a651eac tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:12.518184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3b55775a-b3df-43d8-a88c-80089a651eac tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:12.520916 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3b55775a-b3df-43d8-a88c-80089a651eac tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.715737 Mar 05 20:58:12.521660 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1334/2709] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:11 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:12.527753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-44463a29-cc61-4446-8b0c-80a8cf2f1f4a tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:12.529128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-44463a29-cc61-4446-8b0c-80a8cf2f1f4a tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:12.541970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44463a29-cc61-4446-8b0c-80a8cf2f1f4a tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:12.542934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44463a29-cc61-4446-8b0c-80a8cf2f1f4a tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:12.548290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44463a29-cc61-4446-8b0c-80a8cf2f1f4a tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:12.549627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44463a29-cc61-4446-8b0c-80a8cf2f1f4a tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:12.637271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-44463a29-cc61-4446-8b0c-80a8cf2f1f4a tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:58:12.806125 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-44463a29-cc61-4446-8b0c-80a8cf2f1f4a tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 204 len: 0 microversion: 2.1 time: 0.282735 Mar 05 20:58:12.806735 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1335/2710] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:58:12 2022] DELETE /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:58:12.825578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d1ad2d3b-ef08-4bb3-9312-170aaa8a347f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:12.826446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d1ad2d3b-ef08-4bb3-9312-170aaa8a347f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:12.843884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1ad2d3b-ef08-4bb3-9312-170aaa8a347f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:12.845907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1ad2d3b-ef08-4bb3-9312-170aaa8a347f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:12.848842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1ad2d3b-ef08-4bb3-9312-170aaa8a347f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:12.850124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1ad2d3b-ef08-4bb3-9312-170aaa8a347f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:13.489355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d1ad2d3b-ef08-4bb3-9312-170aaa8a347f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:13.499207 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d1ad2d3b-ef08-4bb3-9312-170aaa8a347f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1506 microversion: 2.1 time: 0.689095 Mar 05 20:58:13.503176 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1336/2711] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:12 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1506 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:13.511718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ae3cb883-b238-43f9-96d9-5a32f07a9f2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:13.512777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ae3cb883-b238-43f9-96d9-5a32f07a9f2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:13.551779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae3cb883-b238-43f9-96d9-5a32f07a9f2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:13.552974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae3cb883-b238-43f9-96d9-5a32f07a9f2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:13.556688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae3cb883-b238-43f9-96d9-5a32f07a9f2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:13.560397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae3cb883-b238-43f9-96d9-5a32f07a9f2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:13.818356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ae3cb883-b238-43f9-96d9-5a32f07a9f2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:13.848201 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ae3cb883-b238-43f9-96d9-5a32f07a9f2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1218 microversion: 2.1 time: 0.339066 Mar 05 20:58:13.852387 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1337/2712] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:13 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1218 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:13.874663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-24b53a92-4e19-41f0-9a53-1c5a0ad9355f tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:13.876613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-24b53a92-4e19-41f0-9a53-1c5a0ad9355f tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:13.938146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24b53a92-4e19-41f0-9a53-1c5a0ad9355f tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:13.940961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24b53a92-4e19-41f0-9a53-1c5a0ad9355f tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:13.943210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24b53a92-4e19-41f0-9a53-1c5a0ad9355f tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:13.948192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24b53a92-4e19-41f0-9a53-1c5a0ad9355f tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:14.746426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-24b53a92-4e19-41f0-9a53-1c5a0ad9355f tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:14.760822 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-24b53a92-4e19-41f0-9a53-1c5a0ad9355f tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1665 microversion: 2.1 time: 0.904825 Mar 05 20:58:14.762275 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1338/2713] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:13 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1665 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:14.776775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9fa9da45-837b-468f-b5bc-4281033ecc84 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:14.777408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9fa9da45-837b-468f-b5bc-4281033ecc84 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:14.798858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9fa9da45-837b-468f-b5bc-4281033ecc84 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:14.800535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9fa9da45-837b-468f-b5bc-4281033ecc84 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:14.803504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9fa9da45-837b-468f-b5bc-4281033ecc84 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:14.806513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9fa9da45-837b-468f-b5bc-4281033ecc84 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:15.414176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9fa9da45-837b-468f-b5bc-4281033ecc84 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:15.428378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9fa9da45-837b-468f-b5bc-4281033ecc84 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:15.436196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9fa9da45-837b-468f-b5bc-4281033ecc84 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:15.437603 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9fa9da45-837b-468f-b5bc-4281033ecc84 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 2907 microversion: 2.32 time: 0.671577 Mar 05 20:58:15.438204 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1339/2714] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:14 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 2907 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:15.446125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7037222d-d06f-4035-885f-868cccda6c77 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:15.450919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7037222d-d06f-4035-885f-868cccda6c77 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:15.463757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7037222d-d06f-4035-885f-868cccda6c77 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:15.465951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7037222d-d06f-4035-885f-868cccda6c77 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:15.467244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7037222d-d06f-4035-885f-868cccda6c77 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:15.470942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7037222d-d06f-4035-885f-868cccda6c77 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:15.670674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7037222d-d06f-4035-885f-868cccda6c77 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:15.682298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7037222d-d06f-4035-885f-868cccda6c77 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:15.683888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7037222d-d06f-4035-885f-868cccda6c77 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:15.685103 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7037222d-d06f-4035-885f-868cccda6c77 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.245965 Mar 05 20:58:15.695829 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1340/2715] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:15 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:15.701501 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-743c046d-e31b-486c-a51d-3cbd356885b2 req-a438460f-e48a-4eb1-a0d5-3cd1d4544445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-unplugged", "status": "completed", "tag": "5866fc79-fac2-4bd2-978f-c689c32b9c03"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:15.730248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-743c046d-e31b-486c-a51d-3cbd356885b2 req-a438460f-e48a-4eb1-a0d5-3cd1d4544445 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:15.732388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-743c046d-e31b-486c-a51d-3cbd356885b2 req-a438460f-e48a-4eb1-a0d5-3cd1d4544445 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:15.777236 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-743c046d-e31b-486c-a51d-3cbd356885b2 req-a438460f-e48a-4eb1-a0d5-3cd1d4544445 service nova] Creating event network-vif-unplugged:5866fc79-fac2-4bd2-978f-c689c32b9c03 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:58:15.799775 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-743c046d-e31b-486c-a51d-3cbd356885b2 req-a438460f-e48a-4eb1-a0d5-3cd1d4544445 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102445 Mar 05 20:58:15.801283 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1341/2716] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:15.810500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-51eb307b-5e57-41c6-a517-d99ac7f677bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:15.811425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-51eb307b-5e57-41c6-a517-d99ac7f677bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:15.824194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-51eb307b-5e57-41c6-a517-d99ac7f677bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:15.828332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-51eb307b-5e57-41c6-a517-d99ac7f677bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:15.829193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-51eb307b-5e57-41c6-a517-d99ac7f677bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:15.829641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-51eb307b-5e57-41c6-a517-d99ac7f677bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:16.617855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-51eb307b-5e57-41c6-a517-d99ac7f677bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:16.630595 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-51eb307b-5e57-41c6-a517-d99ac7f677bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 200 len: 1449 microversion: 2.1 time: 0.827809 Mar 05 20:58:16.631341 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1342/2717] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:15 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 1449 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:16.653471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-824fd708-ac23-49c2-840e-10db99e03206 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:16.654375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-824fd708-ac23-49c2-840e-10db99e03206 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:16.671337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-824fd708-ac23-49c2-840e-10db99e03206 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:16.672500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-824fd708-ac23-49c2-840e-10db99e03206 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:16.673755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-824fd708-ac23-49c2-840e-10db99e03206 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:16.674502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-824fd708-ac23-49c2-840e-10db99e03206 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:17.333297 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b5662f02-4b99-4575-995f-228880b83da6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050/action" status: 202 len: 0 microversion: 2.1 time: 4.994205 Mar 05 20:58:17.333923 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1376/2718] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:58:12 2022] POST /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050/action => generated 0 bytes in 4995 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:58:17.345150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a02aa984-994d-4c3b-a84c-36108a812486 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:17.345792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a02aa984-994d-4c3b-a84c-36108a812486 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:17.387298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-824fd708-ac23-49c2-840e-10db99e03206 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:17.402081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a02aa984-994d-4c3b-a84c-36108a812486 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:17.402547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a02aa984-994d-4c3b-a84c-36108a812486 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:17.406907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a02aa984-994d-4c3b-a84c-36108a812486 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:17.407921 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-824fd708-ac23-49c2-840e-10db99e03206 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1322 microversion: 2.1 time: 0.767869 Mar 05 20:58:17.408913 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1343/2719] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:16 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1322 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:17.409649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a02aa984-994d-4c3b-a84c-36108a812486 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:17.421128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-50a13f70-637a-46e1-be48-27f6abfb19a9 req-c3ad2a36-f5ae-4397-a73c-e6550bfd0a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-deleted", "tag": "b782a7da-f012-4816-a7bc-b15194cb2996"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:17.447565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-50a13f70-637a-46e1-be48-27f6abfb19a9 req-c3ad2a36-f5ae-4397-a73c-e6550bfd0a78 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:17.448932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-50a13f70-637a-46e1-be48-27f6abfb19a9 req-c3ad2a36-f5ae-4397-a73c-e6550bfd0a78 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:17.468379 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-50a13f70-637a-46e1-be48-27f6abfb19a9 req-c3ad2a36-f5ae-4397-a73c-e6550bfd0a78 service nova] Creating event network-vif-deleted:b782a7da-f012-4816-a7bc-b15194cb2996 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:58:17.476911 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-50a13f70-637a-46e1-be48-27f6abfb19a9 req-c3ad2a36-f5ae-4397-a73c-e6550bfd0a78 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066139 Mar 05 20:58:17.478309 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1344/2720] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:17.485310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ae625a0f-dfd6-432f-9cda-f33f79f7db2e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:17.487161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ae625a0f-dfd6-432f-9cda-f33f79f7db2e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:17.498617 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae625a0f-dfd6-432f-9cda-f33f79f7db2e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:17.500474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae625a0f-dfd6-432f-9cda-f33f79f7db2e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:17.501690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae625a0f-dfd6-432f-9cda-f33f79f7db2e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:17.502494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae625a0f-dfd6-432f-9cda-f33f79f7db2e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:17.704049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a02aa984-994d-4c3b-a84c-36108a812486 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7510851e9a44fba867de9245a59391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bfa48c6cd94b69aa05b9cfd60c4bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:17.724924 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a02aa984-994d-4c3b-a84c-36108a812486 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 200 len: 1597 microversion: 2.1 time: 0.386902 Mar 05 20:58:17.743850 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1377/2721] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:17 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 1597 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:17.751624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:17.755402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:17.773346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:17.774796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:17.777497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:17.778249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:17.828196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:58:17.837199 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.compute.api [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Working on deleting snapshot 94384023-e7b8-4a9a-a10f-3ac0bdf0fe0b from shelved instance... Mar 05 20:58:18.421091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ae625a0f-dfd6-432f-9cda-f33f79f7db2e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:18.431888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ae625a0f-dfd6-432f-9cda-f33f79f7db2e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:18.445761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ae625a0f-dfd6-432f-9cda-f33f79f7db2e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:18.447077 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ae625a0f-dfd6-432f-9cda-f33f79f7db2e tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 2861 microversion: 2.32 time: 0.967357 Mar 05 20:58:18.447698 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1345/2722] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:17 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 2861 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:18.459578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3da94980-e3ee-4dde-803b-8a51a42b136a tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:18.460252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3da94980-e3ee-4dde-803b-8a51a42b136a tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:18.482793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3da94980-e3ee-4dde-803b-8a51a42b136a tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:18.483263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3da94980-e3ee-4dde-803b-8a51a42b136a tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:18.496272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3da94980-e3ee-4dde-803b-8a51a42b136a tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:18.496784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3da94980-e3ee-4dde-803b-8a51a42b136a tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:18.625304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3da94980-e3ee-4dde-803b-8a51a42b136a tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:18.634760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3da94980-e3ee-4dde-803b-8a51a42b136a tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:18.644010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3da94980-e3ee-4dde-803b-8a51a42b136a tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:18.656675 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3da94980-e3ee-4dde-803b-8a51a42b136a tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.207921 Mar 05 20:58:18.657289 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1346/2723] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:18 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:18.677510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-36e5a995-cd6b-4a04-8332-e1c03605b96b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:18.678214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-36e5a995-cd6b-4a04-8332-e1c03605b96b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:18.684760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36e5a995-cd6b-4a04-8332-e1c03605b96b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:18.685588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36e5a995-cd6b-4a04-8332-e1c03605b96b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:18.686874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36e5a995-cd6b-4a04-8332-e1c03605b96b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:18.687847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36e5a995-cd6b-4a04-8332-e1c03605b96b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:18.862001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Doing local delete in cell 591cc087-7d9b-4967-a4cd-9c96e8077593(cell1) {{(pid=141479) _delete /opt/stack/nova/nova/compute/api.py:2489}} Mar 05 20:58:18.863090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:18.863713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:18.864390 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.compute.api [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Mar 05 20:58:18.871028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] deallocate_for_instance() {{(pid=141479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Mar 05 20:58:19.260225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-36e5a995-cd6b-4a04-8332-e1c03605b96b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:19.268258 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-36e5a995-cd6b-4a04-8332-e1c03605b96b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1548 microversion: 2.1 time: 0.597355 Mar 05 20:58:19.277405 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1347/2724] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:18 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1548 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:19.285691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-ee7e8a6b-f380-41ca-b4dd-f29926235c64 req-5cf6ef37-413c-40e9-9ae6-51850d50b1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-unplugged", "status": "completed", "tag": "3cb0d38e-d7d1-417d-8eb1-bc1f3f7cf239"}, {"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-unplugged", "status": "completed", "tag": "b9701cfb-119e-4040-a711-f90621bd7b80"}, {"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-unplugged", "status": "completed", "tag": "2c1807e8-ead9-44e9-ab65-390e42b1ded8"}, {"server_uuid": "af3b961b-384e-4246-8bee-f44c06d45447", "name": "network-vif-unplugged", "status": "completed", "tag": "bce80fbd-c4e1-4382-be80-b1be28c5138e"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:19.303169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ee7e8a6b-f380-41ca-b4dd-f29926235c64 req-5cf6ef37-413c-40e9-9ae6-51850d50b1c1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:19.303541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ee7e8a6b-f380-41ca-b4dd-f29926235c64 req-5cf6ef37-413c-40e9-9ae6-51850d50b1c1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:19.332734 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ee7e8a6b-f380-41ca-b4dd-f29926235c64 req-5cf6ef37-413c-40e9-9ae6-51850d50b1c1 service nova] Creating event network-vif-unplugged:3cb0d38e-d7d1-417d-8eb1-bc1f3f7cf239 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:58:19.333549 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ee7e8a6b-f380-41ca-b4dd-f29926235c64 req-5cf6ef37-413c-40e9-9ae6-51850d50b1c1 service nova] Creating event network-vif-unplugged:b9701cfb-119e-4040-a711-f90621bd7b80 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:58:19.334215 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ee7e8a6b-f380-41ca-b4dd-f29926235c64 req-5cf6ef37-413c-40e9-9ae6-51850d50b1c1 service nova] Creating event network-vif-unplugged:2c1807e8-ead9-44e9-ab65-390e42b1ded8 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:58:19.334892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.compute.server_external_events [req-ee7e8a6b-f380-41ca-b4dd-f29926235c64 req-5cf6ef37-413c-40e9-9ae6-51850d50b1c1 service nova] Unable to find a host for instance af3b961b-384e-4246-8bee-f44c06d45447. Dropping event network-vif-unplugged {{(pid=141478) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 05 20:58:19.350793 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-ee7e8a6b-f380-41ca-b4dd-f29926235c64 req-5cf6ef37-413c-40e9-9ae6-51850d50b1c1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 701 microversion: 2.1 time: 0.071795 Mar 05 20:58:19.352743 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1348/2725] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 701 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 05 20:58:19.359265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-40054a2c-cd9b-4a34-9343-2896e0b7e4f5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:19.361853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-40054a2c-cd9b-4a34-9343-2896e0b7e4f5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:19.377458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-40054a2c-cd9b-4a34-9343-2896e0b7e4f5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:19.380130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-40054a2c-cd9b-4a34-9343-2896e0b7e4f5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:19.381130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-40054a2c-cd9b-4a34-9343-2896e0b7e4f5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:19.382090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-40054a2c-cd9b-4a34-9343-2896e0b7e4f5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:19.850252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-40054a2c-cd9b-4a34-9343-2896e0b7e4f5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:19.864980 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-40054a2c-cd9b-4a34-9343-2896e0b7e4f5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1322 microversion: 2.1 time: 0.509710 Mar 05 20:58:19.866164 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1349/2726] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:19 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:19.870986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f0a3fee-16dd-4770-8e77-9f159c0dda4d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:19.880044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5f0a3fee-16dd-4770-8e77-9f159c0dda4d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] [instance: 6207958f-00b7-4d0e-b1a7-e17e3ddf371c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:19.895575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f0a3fee-16dd-4770-8e77-9f159c0dda4d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:19.896072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f0a3fee-16dd-4770-8e77-9f159c0dda4d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:19.900657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f0a3fee-16dd-4770-8e77-9f159c0dda4d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:19.901123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f0a3fee-16dd-4770-8e77-9f159c0dda4d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:19.931650 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-5f0a3fee-16dd-4770-8e77-9f159c0dda4d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] HTTP exception thrown: Instance 6207958f-00b7-4d0e-b1a7-e17e3ddf371c could not be found. Mar 05 20:58:19.933231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f0a3fee-16dd-4770-8e77-9f159c0dda4d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Returning 404 to user: Instance 6207958f-00b7-4d0e-b1a7-e17e3ddf371c could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:19.934093 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5f0a3fee-16dd-4770-8e77-9f159c0dda4d tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c" status: 404 len: 111 microversion: 2.1 time: 0.066828 Mar 05 20:58:19.939027 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1350/2727] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:19 2022] GET /compute/v2.1/servers/6207958f-00b7-4d0e-b1a7-e17e3ddf371c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:58:19.950978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9f3a6046-27f9-450b-a9f8-66d9c7837d38 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:19.953049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9f3a6046-27f9-450b-a9f8-66d9c7837d38 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:19.962639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f3a6046-27f9-450b-a9f8-66d9c7837d38 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:19.964007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f3a6046-27f9-450b-a9f8-66d9c7837d38 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:19.964959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f3a6046-27f9-450b-a9f8-66d9c7837d38 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:19.965540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f3a6046-27f9-450b-a9f8-66d9c7837d38 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:20.672598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9f3a6046-27f9-450b-a9f8-66d9c7837d38 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:20.683748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9f3a6046-27f9-450b-a9f8-66d9c7837d38 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:20.685250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9f3a6046-27f9-450b-a9f8-66d9c7837d38 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:20.686497 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9f3a6046-27f9-450b-a9f8-66d9c7837d38 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 2655 microversion: 2.32 time: 0.746167 Mar 05 20:58:20.692692 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1351/2728] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:19 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 2655 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:20.704337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-64ec5953-49ac-4994-a5db-3b8926257d44 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:20.705743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-64ec5953-49ac-4994-a5db-3b8926257d44 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:20.720977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64ec5953-49ac-4994-a5db-3b8926257d44 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:20.722465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64ec5953-49ac-4994-a5db-3b8926257d44 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:20.724291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64ec5953-49ac-4994-a5db-3b8926257d44 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:20.727938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64ec5953-49ac-4994-a5db-3b8926257d44 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:20.877796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-64ec5953-49ac-4994-a5db-3b8926257d44 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:20.887897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-64ec5953-49ac-4994-a5db-3b8926257d44 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:20.895387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-64ec5953-49ac-4994-a5db-3b8926257d44 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:20.904249 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-64ec5953-49ac-4994-a5db-3b8926257d44 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.202662 Mar 05 20:58:20.906309 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1352/2729] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:20 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:20.920778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f010b998-555d-4241-bf5d-e03ea7d13b49 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] Calling method '.version_select at 0x7fed61b40040>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:20.965304 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f010b998-555d-4241-bf5d-e03ea7d13b49 tempest-ServersTestFqdnHostnames-1459141065 tempest-ServersTestFqdnHostnames-1459141065-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-369340614" status: 202 len: 0 microversion: 2.1 time: 0.049745 Mar 05 20:58:20.966691 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1353/2730] 10.222.0.15 () {58 vars in 1217 bytes} [Sat Mar 5 20:58:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-369340614 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:58:20.974876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-44f7ab85-cb42-43e7-aba8-9ba7c16e8adf req-885b55ab-c83c-4957-92c6-d43164d0f55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-deleted", "tag": "2c1807e8-ead9-44e9-ab65-390e42b1ded8"}, {"server_uuid": "6207958f-00b7-4d0e-b1a7-e17e3ddf371c", "name": "network-vif-deleted", "tag": "b7562f27-5f06-4bcc-a8b8-962b8a5a7750"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:20.995976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-44f7ab85-cb42-43e7-aba8-9ba7c16e8adf req-885b55ab-c83c-4957-92c6-d43164d0f55a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:20.996482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-44f7ab85-cb42-43e7-aba8-9ba7c16e8adf req-885b55ab-c83c-4957-92c6-d43164d0f55a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:21.045120 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-44f7ab85-cb42-43e7-aba8-9ba7c16e8adf req-885b55ab-c83c-4957-92c6-d43164d0f55a service nova] Creating event network-vif-deleted:2c1807e8-ead9-44e9-ab65-390e42b1ded8 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:58:21.045746 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-44f7ab85-cb42-43e7-aba8-9ba7c16e8adf req-885b55ab-c83c-4957-92c6-d43164d0f55a service nova] Creating event network-vif-deleted:b7562f27-5f06-4bcc-a8b8-962b8a5a7750 for instance 6207958f-00b7-4d0e-b1a7-e17e3ddf371c on nch2-master-1 Mar 05 20:58:21.059592 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-44f7ab85-cb42-43e7-aba8-9ba7c16e8adf req-885b55ab-c83c-4957-92c6-d43164d0f55a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091270 Mar 05 20:58:21.061811 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1354/2731] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:21.070660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a139c590-61cb-4bae-b7f3-82b5aff51618 req-f04f0370-508b-4c7f-99f3-3037dd1f0653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23279b59-495b-4264-8d6c-33d6143418ce", "tag": "8fc25781-cd23-40fb-843d-506a3fbd00cf"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:21.083247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a139c590-61cb-4bae-b7f3-82b5aff51618 req-f04f0370-508b-4c7f-99f3-3037dd1f0653 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:21.084185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a139c590-61cb-4bae-b7f3-82b5aff51618 req-f04f0370-508b-4c7f-99f3-3037dd1f0653 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:21.100431 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a139c590-61cb-4bae-b7f3-82b5aff51618 req-f04f0370-508b-4c7f-99f3-3037dd1f0653 service nova] Creating event network-changed:8fc25781-cd23-40fb-843d-506a3fbd00cf for instance 23279b59-495b-4264-8d6c-33d6143418ce on nch2-master-1 Mar 05 20:58:21.109074 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a139c590-61cb-4bae-b7f3-82b5aff51618 req-f04f0370-508b-4c7f-99f3-3037dd1f0653 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045045 Mar 05 20:58:21.111360 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1355/2732] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:21.120685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5b1c1fb3-4622-47a8-8647-dacf18b85738 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:21.121783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5b1c1fb3-4622-47a8-8647-dacf18b85738 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:21.132413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b1c1fb3-4622-47a8-8647-dacf18b85738 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:21.132793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b1c1fb3-4622-47a8-8647-dacf18b85738 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:21.134110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b1c1fb3-4622-47a8-8647-dacf18b85738 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:21.134691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b1c1fb3-4622-47a8-8647-dacf18b85738 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:21.446001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5b1c1fb3-4622-47a8-8647-dacf18b85738 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:21.458513 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5b1c1fb3-4622-47a8-8647-dacf18b85738 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1548 microversion: 2.1 time: 0.343179 Mar 05 20:58:21.460440 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1356/2733] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:21 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1548 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:21.466772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-edc371bc-db99-4759-ab6e-894aeea28b37 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:21.467357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-edc371bc-db99-4759-ab6e-894aeea28b37 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:21.476869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edc371bc-db99-4759-ab6e-894aeea28b37 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:21.477547 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edc371bc-db99-4759-ab6e-894aeea28b37 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:21.478476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edc371bc-db99-4759-ab6e-894aeea28b37 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:21.479058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edc371bc-db99-4759-ab6e-894aeea28b37 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:21.902525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-edc371bc-db99-4759-ab6e-894aeea28b37 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:21.918130 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-edc371bc-db99-4759-ab6e-894aeea28b37 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1322 microversion: 2.1 time: 0.456346 Mar 05 20:58:21.918952 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1357/2734] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:21 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:21.934447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Updating instance_info_cache with network_info: [] {{(pid=141479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 05 20:58:22.295551 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f573166c-de76-440a-96c4-c1a556f56a16 tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] 10.222.0.15 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.375031 Mar 05 20:58:22.296475 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1358/2735] 10.222.0.15 () {58 vars in 1127 bytes} [Sat Mar 5 20:58:21 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 05 20:58:22.309329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-27e595d1-82ad-4a23-bdfa-485363b44826 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:22.324599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-27e595d1-82ad-4a23-bdfa-485363b44826 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:22.342910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27e595d1-82ad-4a23-bdfa-485363b44826 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:22.344978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27e595d1-82ad-4a23-bdfa-485363b44826 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:22.348525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27e595d1-82ad-4a23-bdfa-485363b44826 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:22.349210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27e595d1-82ad-4a23-bdfa-485363b44826 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:22.517099 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0113be34-3a20-45c3-acac-fb99e56f2019 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 204 len: 0 microversion: 2.1 time: 4.771008 Mar 05 20:58:22.517711 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1378/2736] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:58:17 2022] DELETE /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 0 bytes in 4773 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:58:22.523996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ec7ead9b-9ad9-435c-91e6-d7c3608f0653 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:22.524937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ec7ead9b-9ad9-435c-91e6-d7c3608f0653 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:22.531886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec7ead9b-9ad9-435c-91e6-d7c3608f0653 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:22.532345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec7ead9b-9ad9-435c-91e6-d7c3608f0653 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:22.533122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec7ead9b-9ad9-435c-91e6-d7c3608f0653 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:22.533801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec7ead9b-9ad9-435c-91e6-d7c3608f0653 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:22.627747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ec7ead9b-9ad9-435c-91e6-d7c3608f0653 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:22.639180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ec7ead9b-9ad9-435c-91e6-d7c3608f0653 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:22.641761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ec7ead9b-9ad9-435c-91e6-d7c3608f0653 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:22.643163 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ec7ead9b-9ad9-435c-91e6-d7c3608f0653 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.124204 Mar 05 20:58:22.644812 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1379/2737] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:22 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:22.652700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f5e539bc-6d4a-446a-90a6-a9779b5390ac tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] Calling method '.version_select at 0x7fed4f89bee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:22.679334 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-f5e539bc-6d4a-446a-90a6-a9779b5390ac tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] HTTP exception thrown: Image not found. Mar 05 20:58:22.680230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f5e539bc-6d4a-446a-90a6-a9779b5390ac tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] Returning 404 to user: Image not found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:22.681309 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f5e539bc-6d4a-446a-90a6-a9779b5390ac tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] 10.222.0.15 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.034634 Mar 05 20:58:22.687501 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1380/2738] 10.222.0.15 () {58 vars in 1133 bytes} [Sat Mar 5 20:58:22 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:58:22.693775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-34dafe0c-4157-4817-9804-a925c6b88f12 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:22.694652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-34dafe0c-4157-4817-9804-a925c6b88f12 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:22.702131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34dafe0c-4157-4817-9804-a925c6b88f12 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:22.702591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34dafe0c-4157-4817-9804-a925c6b88f12 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:22.703551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34dafe0c-4157-4817-9804-a925c6b88f12 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:22.704051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34dafe0c-4157-4817-9804-a925c6b88f12 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:23.107224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-34dafe0c-4157-4817-9804-a925c6b88f12 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:23.116054 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-34dafe0c-4157-4817-9804-a925c6b88f12 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1548 microversion: 2.1 time: 0.427074 Mar 05 20:58:23.116651 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1381/2739] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:22 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1548 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:23.132021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c45db33b-5c92-4b6d-9c0c-50fccc0b9ab7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:23.132962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c45db33b-5c92-4b6d-9c0c-50fccc0b9ab7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:23.146439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c45db33b-5c92-4b6d-9c0c-50fccc0b9ab7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:23.147286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c45db33b-5c92-4b6d-9c0c-50fccc0b9ab7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:23.148556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c45db33b-5c92-4b6d-9c0c-50fccc0b9ab7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:23.154014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c45db33b-5c92-4b6d-9c0c-50fccc0b9ab7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:23.179334 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-c45db33b-5c92-4b6d-9c0c-50fccc0b9ab7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance af3b961b-384e-4246-8bee-f44c06d45447 could not be found. Mar 05 20:58:23.190865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c45db33b-5c92-4b6d-9c0c-50fccc0b9ab7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance af3b961b-384e-4246-8bee-f44c06d45447 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:23.192565 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c45db33b-5c92-4b6d-9c0c-50fccc0b9ab7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 404 len: 111 microversion: 2.1 time: 0.070681 Mar 05 20:58:23.193824 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1382/2740] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:23 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:58:23.198501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b6afc7bb-ad8d-47ee-9a63-7c2fe799afd6 tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] Calling method '.version_select at 0x7fed4f89b790>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:23.233001 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-b6afc7bb-ad8d-47ee-9a63-7c2fe799afd6 tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] HTTP exception thrown: Image not found. Mar 05 20:58:23.233708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b6afc7bb-ad8d-47ee-9a63-7c2fe799afd6 tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] Returning 404 to user: Image not found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:23.235015 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b6afc7bb-ad8d-47ee-9a63-7c2fe799afd6 tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] 10.222.0.15 "DELETE /compute/v2.1/images/673104c3-150f-42e9-b94b-2048d000655j" status: 404 len: 62 microversion: 2.1 time: 0.039888 Mar 05 20:58:23.236158 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1383/2741] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:23 2022] DELETE /compute/v2.1/images/673104c3-150f-42e9-b94b-2048d000655j => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:58:23.244151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cfb46b76-a7e8-4b64-aa1d-3037cd76ae43 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:23.244987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cfb46b76-a7e8-4b64-aa1d-3037cd76ae43 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:23.249987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-27e595d1-82ad-4a23-bdfa-485363b44826 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:23.263320 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfb46b76-a7e8-4b64-aa1d-3037cd76ae43 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:23.263815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfb46b76-a7e8-4b64-aa1d-3037cd76ae43 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:23.264829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfb46b76-a7e8-4b64-aa1d-3037cd76ae43 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:23.265487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfb46b76-a7e8-4b64-aa1d-3037cd76ae43 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:23.288807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-27e595d1-82ad-4a23-bdfa-485363b44826 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:23.292770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-27e595d1-82ad-4a23-bdfa-485363b44826 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:23.298252 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-27e595d1-82ad-4a23-bdfa-485363b44826 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 2495 microversion: 2.32 time: 0.995348 Mar 05 20:58:23.300084 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1359/2742] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:22 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 2495 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:23.307233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7976fe3b-cac6-4cb4-bdeb-b39737bdd173 req-44ce644f-43f5-43ad-8bc2-e0789c9470d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-deleted", "tag": "b9701cfb-119e-4040-a711-f90621bd7b80"}, {"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-deleted", "tag": "3cb0d38e-d7d1-417d-8eb1-bc1f3f7cf239"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:23.317776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7976fe3b-cac6-4cb4-bdeb-b39737bdd173 req-44ce644f-43f5-43ad-8bc2-e0789c9470d6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:23.318481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7976fe3b-cac6-4cb4-bdeb-b39737bdd173 req-44ce644f-43f5-43ad-8bc2-e0789c9470d6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:23.337123 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7976fe3b-cac6-4cb4-bdeb-b39737bdd173 req-44ce644f-43f5-43ad-8bc2-e0789c9470d6 service nova] Creating event network-vif-deleted:b9701cfb-119e-4040-a711-f90621bd7b80 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:58:23.337942 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7976fe3b-cac6-4cb4-bdeb-b39737bdd173 req-44ce644f-43f5-43ad-8bc2-e0789c9470d6 service nova] Creating event network-vif-deleted:3cb0d38e-d7d1-417d-8eb1-bc1f3f7cf239 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:58:23.348785 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7976fe3b-cac6-4cb4-bdeb-b39737bdd173 req-44ce644f-43f5-43ad-8bc2-e0789c9470d6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046637 Mar 05 20:58:23.351711 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1360/2743] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:23.369815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e427ab79-1e27-4f91-a274-9a7b8f7eed53 tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] Calling method '.version_select at 0x7fed61b40f70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:23.402505 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-e427ab79-1e27-4f91-a274-9a7b8f7eed53 tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] HTTP exception thrown: Image not found. Mar 05 20:58:23.403243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e427ab79-1e27-4f91-a274-9a7b8f7eed53 tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] Returning 404 to user: Image not found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:23.404263 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e427ab79-1e27-4f91-a274-9a7b8f7eed53 tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] 10.222.0.15 "DELETE /compute/v2.1/images/70dc86cd-809c-4c22-ae4d-40be9bddd9d41" status: 404 len: 62 microversion: 2.1 time: 0.050330 Mar 05 20:58:23.405200 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1361/2744] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:58:23 2022] DELETE /compute/v2.1/images/70dc86cd-809c-4c22-ae4d-40be9bddd9d41 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:58:23.410850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5b8b67dc-eb35-413d-a424-6c6fb4c8c952 req-99404736-f6d1-43a4-9a09-ddb5c2413e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3b961b-384e-4246-8bee-f44c06d45447", "name": "network-vif-deleted", "tag": "bce80fbd-c4e1-4382-be80-b1be28c5138e"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:23.425065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5b8b67dc-eb35-413d-a424-6c6fb4c8c952 req-99404736-f6d1-43a4-9a09-ddb5c2413e25 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:23.426332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5b8b67dc-eb35-413d-a424-6c6fb4c8c952 req-99404736-f6d1-43a4-9a09-ddb5c2413e25 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:23.439445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.compute.server_external_events [req-5b8b67dc-eb35-413d-a424-6c6fb4c8c952 req-99404736-f6d1-43a4-9a09-ddb5c2413e25 service nova] Unable to find a host for instance af3b961b-384e-4246-8bee-f44c06d45447. Dropping event network-vif-deleted {{(pid=141478) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 05 20:58:23.440772 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5b8b67dc-eb35-413d-a424-6c6fb4c8c952 req-99404736-f6d1-43a4-9a09-ddb5c2413e25 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.034446 Mar 05 20:58:23.442069 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1362/2745] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 05 20:58:23.447635 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-494759832", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "72f55423-ea6d-4438-a149-d5df19f9ecdd"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:23.514990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] validate_networks() for [('72f55423-ea6d-4438-a149-d5df19f9ecdd', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:58:23.665562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cfb46b76-a7e8-4b64-aa1d-3037cd76ae43 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:23.676590 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cfb46b76-a7e8-4b64-aa1d-3037cd76ae43 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1322 microversion: 2.1 time: 0.438849 Mar 05 20:58:23.677743 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1384/2746] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:23 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:23.683701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cdac00e1-c199-4091-8dea-717a2ea4cc34 tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] Calling method '.version_select at 0x7fed5c46fdc0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:23.714047 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-cdac00e1-c199-4091-8dea-717a2ea4cc34 tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] HTTP exception thrown: Image not found. Mar 05 20:58:23.715037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cdac00e1-c199-4091-8dea-717a2ea4cc34 tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] Returning 404 to user: Image not found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:23.716354 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cdac00e1-c199-4091-8dea-717a2ea4cc34 tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] 10.222.0.15 "DELETE /compute/v2.1/images/tempest-invalid-1123526336" status: 404 len: 62 microversion: 2.1 time: 0.037301 Mar 05 20:58:23.718086 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1385/2747] 10.222.0.15 () {58 vars in 1205 bytes} [Sat Mar 5 20:58:23 2022] DELETE /compute/v2.1/images/tempest-invalid-1123526336 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:58:23.725437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fb8e1fe5-7089-4a87-a36f-ed5c29e47f58 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:23.726354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fb8e1fe5-7089-4a87-a36f-ed5c29e47f58 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:23.735923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb8e1fe5-7089-4a87-a36f-ed5c29e47f58 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:23.736380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb8e1fe5-7089-4a87-a36f-ed5c29e47f58 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:23.737316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb8e1fe5-7089-4a87-a36f-ed5c29e47f58 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:23.739128 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb8e1fe5-7089-4a87-a36f-ed5c29e47f58 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:23.868103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fb8e1fe5-7089-4a87-a36f-ed5c29e47f58 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:23.879152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fb8e1fe5-7089-4a87-a36f-ed5c29e47f58 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:23.881550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fb8e1fe5-7089-4a87-a36f-ed5c29e47f58 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:23.883185 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fb8e1fe5-7089-4a87-a36f-ed5c29e47f58 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.163514 Mar 05 20:58:23.895498 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1386/2748] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:23 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:23.902342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-133edf04-bf68-4777-9a16-e9bec481578b tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] Calling method '.version_select at 0x7fed4f877280>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:23.940186 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-133edf04-bf68-4777-9a16-e9bec481578b tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] HTTP exception thrown: Image not found. Mar 05 20:58:23.941916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-133edf04-bf68-4777-9a16-e9bec481578b tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] Returning 404 to user: Image not found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:23.942860 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-133edf04-bf68-4777-9a16-e9bec481578b tempest-ImagesDeleteNegativeTestJSON-1387542814 tempest-ImagesDeleteNegativeTestJSON-1387542814-project] 10.222.0.15 "DELETE /compute/v2.1/images/1598f3cf-2e6c-4d36-84b8-496dc8cfaca1" status: 404 len: 62 microversion: 2.1 time: 0.046000 Mar 05 20:58:23.944720 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1387/2749] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:23 2022] DELETE /compute/v2.1/images/1598f3cf-2e6c-4d36-84b8-496dc8cfaca1 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 20:58:24.134692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6da1a02b-8bb4-4c4c-80be-1ef95f2032c9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:24.136288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6da1a02b-8bb4-4c4c-80be-1ef95f2032c9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:24.151052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6da1a02b-8bb4-4c4c-80be-1ef95f2032c9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:24.153386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6da1a02b-8bb4-4c4c-80be-1ef95f2032c9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:24.155247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6da1a02b-8bb4-4c4c-80be-1ef95f2032c9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:24.155773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6da1a02b-8bb4-4c4c-80be-1ef95f2032c9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:24.506706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6da1a02b-8bb4-4c4c-80be-1ef95f2032c9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:24.516660 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6da1a02b-8bb4-4c4c-80be-1ef95f2032c9 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1548 microversion: 2.1 time: 0.386371 Mar 05 20:58:24.521253 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1388/2750] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:24 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1548 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:24.531330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e135f681-6131-45e4-860e-690318137607 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:24.532351 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e135f681-6131-45e4-860e-690318137607 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:24.555302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e135f681-6131-45e4-860e-690318137607 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:24.556027 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e135f681-6131-45e4-860e-690318137607 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:24.557004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e135f681-6131-45e4-860e-690318137607 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:24.557595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e135f681-6131-45e4-860e-690318137607 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:24.648427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:58:24.649464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:58:24.650350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:58:24.651064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:58:24.652075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:58:24.666602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e135f681-6131-45e4-860e-690318137607 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:24.683561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e135f681-6131-45e4-860e-690318137607 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:24.684459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:24.685126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e135f681-6131-45e4-860e-690318137607 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:24.686329 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e135f681-6131-45e4-860e-690318137607 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1604 microversion: 2.32 time: 0.163744 Mar 05 20:58:24.686543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:24.688226 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1389/2751] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:24 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1604 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:24.689577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:24.690633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:24.701868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a3d5a2f5-c220-46ef-977f-46ea7824cd62 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:24.702489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a3d5a2f5-c220-46ef-977f-46ea7824cd62 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:24.711572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3d5a2f5-c220-46ef-977f-46ea7824cd62 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:24.712219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3d5a2f5-c220-46ef-977f-46ea7824cd62 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:24.713185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3d5a2f5-c220-46ef-977f-46ea7824cd62 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:24.719813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3d5a2f5-c220-46ef-977f-46ea7824cd62 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:24.756589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:58:24.773057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for user e8b67d8bbe9a44898a889826e12ffb0b and project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:58:24.843790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:58:24.853642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:58:24.985311 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-77e8c992-b113-4b56-8eba-116ef4e80be8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541950 Mar 05 20:58:24.985977 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1363/2752] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:58:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:58:25.006732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3647e893-d0b7-42ea-8cc4-134cdc0298a1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:25.007782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3647e893-d0b7-42ea-8cc4-134cdc0298a1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:25.016514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3647e893-d0b7-42ea-8cc4-134cdc0298a1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:25.020296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3647e893-d0b7-42ea-8cc4-134cdc0298a1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:25.021448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3647e893-d0b7-42ea-8cc4-134cdc0298a1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:25.023203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3647e893-d0b7-42ea-8cc4-134cdc0298a1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:25.174641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a3d5a2f5-c220-46ef-977f-46ea7824cd62 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:25.186591 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a3d5a2f5-c220-46ef-977f-46ea7824cd62 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1322 microversion: 2.1 time: 0.497285 Mar 05 20:58:25.187194 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1390/2753] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:24 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:25.201516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3647e893-d0b7-42ea-8cc4-134cdc0298a1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:25.209960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3647e893-d0b7-42ea-8cc4-134cdc0298a1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:25.211471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3647e893-d0b7-42ea-8cc4-134cdc0298a1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:25.214637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f1221957-bdee-4285-aac5-110d3e086b67 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:25.216405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f1221957-bdee-4285-aac5-110d3e086b67 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:25.221537 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3647e893-d0b7-42ea-8cc4-134cdc0298a1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1365 microversion: 2.57 time: 0.218715 Mar 05 20:58:25.230428 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1364/2754] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:24 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:25.357241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f1221957-bdee-4285-aac5-110d3e086b67 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:25.364557 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f1221957-bdee-4285-aac5-110d3e086b67 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1214 microversion: 2.1 time: 0.176217 Mar 05 20:58:25.374991 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1391/2755] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:25 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:25.460382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-15117ef3-b440-4140-99d3-e99f4955f8f9 req-b9f4f06e-00ee-4df3-922d-b8da8023f65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97c5a8d-7d31-43dc-a2e2-0227ff5b4050", "name": "network-vif-unplugged", "status": "completed", "tag": "7705d2a3-c4f0-4f14-82f2-b7d4a3c2ab9f"}, {"name": "network-changed", "server_uuid": "e97c5a8d-7d31-43dc-a2e2-0227ff5b4050", "tag": "7705d2a3-c4f0-4f14-82f2-b7d4a3c2ab9f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:25.478494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-15117ef3-b440-4140-99d3-e99f4955f8f9 req-b9f4f06e-00ee-4df3-922d-b8da8023f65f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:25.491332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-15117ef3-b440-4140-99d3-e99f4955f8f9 req-b9f4f06e-00ee-4df3-922d-b8da8023f65f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:25.516309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-bbb4b5b7-bd0d-4048-96f8-c57beda32103 req-32d8ba61-2b7a-43ba-a36d-975aea642b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71219f1b-5ca1-454a-9250-6b17cbd4ef77", "name": "network-vif-deleted", "tag": "5866fc79-fac2-4bd2-978f-c689c32b9c03"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:25.527714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-bbb4b5b7-bd0d-4048-96f8-c57beda32103 req-32d8ba61-2b7a-43ba-a36d-975aea642b0a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:25.528168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-bbb4b5b7-bd0d-4048-96f8-c57beda32103 req-32d8ba61-2b7a-43ba-a36d-975aea642b0a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:25.529933 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-15117ef3-b440-4140-99d3-e99f4955f8f9 req-b9f4f06e-00ee-4df3-922d-b8da8023f65f service nova] Creating event network-vif-unplugged:7705d2a3-c4f0-4f14-82f2-b7d4a3c2ab9f for instance e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 on nch1-master-1 Mar 05 20:58:25.531084 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-15117ef3-b440-4140-99d3-e99f4955f8f9 req-b9f4f06e-00ee-4df3-922d-b8da8023f65f service nova] Creating event network-changed:7705d2a3-c4f0-4f14-82f2-b7d4a3c2ab9f for instance e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 on nch1-master-1 Mar 05 20:58:25.543556 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-15117ef3-b440-4140-99d3-e99f4955f8f9 req-b9f4f06e-00ee-4df3-922d-b8da8023f65f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.089223 Mar 05 20:58:25.546156 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1365/2756] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:25.558185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-00d10fc9-ed5f-44b7-a797-fca14053912a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:25.562568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-00d10fc9-ed5f-44b7-a797-fca14053912a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:25.575277 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00d10fc9-ed5f-44b7-a797-fca14053912a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:25.576097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00d10fc9-ed5f-44b7-a797-fca14053912a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:25.578510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00d10fc9-ed5f-44b7-a797-fca14053912a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:25.578977 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-bbb4b5b7-bd0d-4048-96f8-c57beda32103 req-32d8ba61-2b7a-43ba-a36d-975aea642b0a service nova] Creating event network-vif-deleted:5866fc79-fac2-4bd2-978f-c689c32b9c03 for instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 on nch1-master-1 Mar 05 20:58:25.582992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00d10fc9-ed5f-44b7-a797-fca14053912a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:25.602217 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-bbb4b5b7-bd0d-4048-96f8-c57beda32103 req-32d8ba61-2b7a-43ba-a36d-975aea642b0a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089834 Mar 05 20:58:25.604606 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1392/2757] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:25.706215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-92c84c37-c764-4354-8ab4-eda08f39c0a1 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:25.707551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-92c84c37-c764-4354-8ab4-eda08f39c0a1 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:25.729138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92c84c37-c764-4354-8ab4-eda08f39c0a1 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:25.729624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92c84c37-c764-4354-8ab4-eda08f39c0a1 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:25.732888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92c84c37-c764-4354-8ab4-eda08f39c0a1 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:25.733330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92c84c37-c764-4354-8ab4-eda08f39c0a1 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:25.848217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92c84c37-c764-4354-8ab4-eda08f39c0a1 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:25.852406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-92c84c37-c764-4354-8ab4-eda08f39c0a1 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:25.853119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-92c84c37-c764-4354-8ab4-eda08f39c0a1 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lazy-loading 'fault' on Instance uuid 71219f1b-5ca1-454a-9250-6b17cbd4ef77 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:58:25.921139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-92c84c37-c764-4354-8ab4-eda08f39c0a1 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:25.935659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-92c84c37-c764-4354-8ab4-eda08f39c0a1 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:25.937419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-92c84c37-c764-4354-8ab4-eda08f39c0a1 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4028a85798ff4ea88a0aa32b944010a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15a5d639338454c90a7ce959e996284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:25.939620 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-92c84c37-c764-4354-8ab4-eda08f39c0a1 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 200 len: 1609 microversion: 2.32 time: 0.237553 Mar 05 20:58:25.941395 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1393/2758] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:25 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 1609 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:26.206003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-504481b4-45f7-4991-b715-ac6b71c6a164 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:26.211174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-504481b4-45f7-4991-b715-ac6b71c6a164 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:26.221512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-00d10fc9-ed5f-44b7-a797-fca14053912a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:26.224117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-504481b4-45f7-4991-b715-ac6b71c6a164 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:26.225367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-504481b4-45f7-4991-b715-ac6b71c6a164 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:26.226608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-504481b4-45f7-4991-b715-ac6b71c6a164 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:26.227373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-504481b4-45f7-4991-b715-ac6b71c6a164 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:26.232480 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-00d10fc9-ed5f-44b7-a797-fca14053912a tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1548 microversion: 2.1 time: 0.683933 Mar 05 20:58:26.234666 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1366/2759] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:25 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1548 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:26.254958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d7f5677b-d80d-4646-98ad-16d26e20d2dc tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:26.255604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d7f5677b-d80d-4646-98ad-16d26e20d2dc tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:26.272552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7f5677b-d80d-4646-98ad-16d26e20d2dc tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:26.286238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7f5677b-d80d-4646-98ad-16d26e20d2dc tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:26.293134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7f5677b-d80d-4646-98ad-16d26e20d2dc tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:26.296354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7f5677b-d80d-4646-98ad-16d26e20d2dc tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:26.514938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-504481b4-45f7-4991-b715-ac6b71c6a164 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:26.518931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d7f5677b-d80d-4646-98ad-16d26e20d2dc tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:26.529026 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-504481b4-45f7-4991-b715-ac6b71c6a164 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1322 microversion: 2.1 time: 0.327446 Mar 05 20:58:26.531638 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1394/2760] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:26 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:26.534875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d7f5677b-d80d-4646-98ad-16d26e20d2dc tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:26.539610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d7f5677b-d80d-4646-98ad-16d26e20d2dc tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:26.545252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0b0752d1-99ac-4fdc-8854-d7249c25e07f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:26.546810 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d7f5677b-d80d-4646-98ad-16d26e20d2dc tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1383 microversion: 2.57 time: 0.301846 Mar 05 20:58:26.547192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0b0752d1-99ac-4fdc-8854-d7249c25e07f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:26.548723 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1367/2761] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:26 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1383 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:26.569138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b0752d1-99ac-4fdc-8854-d7249c25e07f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:26.569643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b0752d1-99ac-4fdc-8854-d7249c25e07f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:26.570440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b0752d1-99ac-4fdc-8854-d7249c25e07f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:26.570880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b0752d1-99ac-4fdc-8854-d7249c25e07f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:26.705952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0b0752d1-99ac-4fdc-8854-d7249c25e07f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:26.718277 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0b0752d1-99ac-4fdc-8854-d7249c25e07f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1266 microversion: 2.1 time: 0.183677 Mar 05 20:58:26.720322 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1395/2762] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:26 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:26.963159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fb4974c0-2928-4c11-b6ff-3740fd18f760 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:26.964174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fb4974c0-2928-4c11-b6ff-3740fd18f760 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:26.983463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb4974c0-2928-4c11-b6ff-3740fd18f760 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:26.983969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb4974c0-2928-4c11-b6ff-3740fd18f760 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:26.986846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb4974c0-2928-4c11-b6ff-3740fd18f760 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:26.990204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb4974c0-2928-4c11-b6ff-3740fd18f760 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:27.016333 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-fb4974c0-2928-4c11-b6ff-3740fd18f760 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] HTTP exception thrown: Instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 could not be found. Mar 05 20:58:27.017161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fb4974c0-2928-4c11-b6ff-3740fd18f760 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Returning 404 to user: Instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:27.018719 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fb4974c0-2928-4c11-b6ff-3740fd18f760 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 404 len: 111 microversion: 2.32 time: 0.061744 Mar 05 20:58:27.020704 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1368/2763] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:26 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:58:27.030526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f82b2433-e0c4-414d-a1ce-978f3bc9fbf4 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '.version_select at 0x7fed4f89bb80>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:27.078360 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f82b2433-e0c4-414d-a1ce-978f3bc9fbf4 tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1100974734" status: 204 len: 0 microversion: 2.32 time: 0.052661 Mar 05 20:58:27.079044 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1396/2764] 10.222.0.15 () {60 vars in 1261 bytes} [Sat Mar 5 20:58:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1100974734 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:58:27.250601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3de3c833-1ad5-4069-86b3-e066b5ab5cc4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:27.251235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3de3c833-1ad5-4069-86b3-e066b5ab5cc4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:27.262134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3de3c833-1ad5-4069-86b3-e066b5ab5cc4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:27.262604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3de3c833-1ad5-4069-86b3-e066b5ab5cc4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:27.263418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3de3c833-1ad5-4069-86b3-e066b5ab5cc4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:27.265821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3de3c833-1ad5-4069-86b3-e066b5ab5cc4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:27.567451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cb969ba4-d702-41d4-aa71-8a06dda78425 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:27.569196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cb969ba4-d702-41d4-aa71-8a06dda78425 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:27.579516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb969ba4-d702-41d4-aa71-8a06dda78425 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:27.580916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb969ba4-d702-41d4-aa71-8a06dda78425 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:27.585025 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb969ba4-d702-41d4-aa71-8a06dda78425 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:27.586001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb969ba4-d702-41d4-aa71-8a06dda78425 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:27.727856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3de3c833-1ad5-4069-86b3-e066b5ab5cc4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:27.741528 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3de3c833-1ad5-4069-86b3-e066b5ab5cc4 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1548 microversion: 2.1 time: 0.494671 Mar 05 20:58:27.742625 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1369/2765] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:27 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1548 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:27.752669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c7bb9bfa-cbdb-44ee-bdc9-6c04ba95fef8 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:27.753642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c7bb9bfa-cbdb-44ee-bdc9-6c04ba95fef8 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:27.761155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7bb9bfa-cbdb-44ee-bdc9-6c04ba95fef8 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:27.761810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7bb9bfa-cbdb-44ee-bdc9-6c04ba95fef8 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:27.763218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7bb9bfa-cbdb-44ee-bdc9-6c04ba95fef8 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:27.763835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7bb9bfa-cbdb-44ee-bdc9-6c04ba95fef8 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:27.861577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c7bb9bfa-cbdb-44ee-bdc9-6c04ba95fef8 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:27.874401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c7bb9bfa-cbdb-44ee-bdc9-6c04ba95fef8 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:27.876367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c7bb9bfa-cbdb-44ee-bdc9-6c04ba95fef8 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:27.878585 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c7bb9bfa-cbdb-44ee-bdc9-6c04ba95fef8 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1371 microversion: 2.57 time: 0.132501 Mar 05 20:58:27.891941 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1370/2766] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:27 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:27.900367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-36c9dc44-e580-43f2-94d6-4f28a545a4f5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:27.901751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-36c9dc44-e580-43f2-94d6-4f28a545a4f5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:27.911351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36c9dc44-e580-43f2-94d6-4f28a545a4f5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:27.912085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36c9dc44-e580-43f2-94d6-4f28a545a4f5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:27.913750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36c9dc44-e580-43f2-94d6-4f28a545a4f5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:27.914390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36c9dc44-e580-43f2-94d6-4f28a545a4f5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:28.031204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-36c9dc44-e580-43f2-94d6-4f28a545a4f5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:28.040409 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-36c9dc44-e580-43f2-94d6-4f28a545a4f5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1272 microversion: 2.1 time: 0.145257 Mar 05 20:58:28.051121 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1371/2767] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:27 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:28.356049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cb969ba4-d702-41d4-aa71-8a06dda78425 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:28.376173 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cb969ba4-d702-41d4-aa71-8a06dda78425 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1322 microversion: 2.1 time: 0.825799 Mar 05 20:58:28.377607 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1397/2768] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:27 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1322 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:28.448315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-31388e93-c894-4afa-a565-073bb5e89956 req-65c98e1d-844d-49ae-ae30-94ccac8093bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23279b59-495b-4264-8d6c-33d6143418ce", "name": "network-vif-plugged", "status": "completed", "tag": "8fc25781-cd23-40fb-843d-506a3fbd00cf"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:28.463264 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-31388e93-c894-4afa-a565-073bb5e89956 req-65c98e1d-844d-49ae-ae30-94ccac8093bc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:28.466489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-31388e93-c894-4afa-a565-073bb5e89956 req-65c98e1d-844d-49ae-ae30-94ccac8093bc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:28.531000 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-31388e93-c894-4afa-a565-073bb5e89956 req-65c98e1d-844d-49ae-ae30-94ccac8093bc service nova] Creating event network-vif-plugged:8fc25781-cd23-40fb-843d-506a3fbd00cf for instance 23279b59-495b-4264-8d6c-33d6143418ce on nch2-master-1 Mar 05 20:58:28.564983 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-31388e93-c894-4afa-a565-073bb5e89956 req-65c98e1d-844d-49ae-ae30-94ccac8093bc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103881 Mar 05 20:58:28.571079 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1372/2769] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:28.760544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5f07df68-bf96-4ea7-a7b4-3440f0d73ea1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:28.762130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5f07df68-bf96-4ea7-a7b4-3440f0d73ea1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:28.775044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f07df68-bf96-4ea7-a7b4-3440f0d73ea1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:28.777520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f07df68-bf96-4ea7-a7b4-3440f0d73ea1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:28.782189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f07df68-bf96-4ea7-a7b4-3440f0d73ea1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:28.783366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f07df68-bf96-4ea7-a7b4-3440f0d73ea1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:28.901237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-075e81ea-a113-43da-8211-08e3382abf42 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:28.903959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-075e81ea-a113-43da-8211-08e3382abf42 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:28.917622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-075e81ea-a113-43da-8211-08e3382abf42 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:28.919307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-075e81ea-a113-43da-8211-08e3382abf42 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:28.920447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-075e81ea-a113-43da-8211-08e3382abf42 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:28.921104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-075e81ea-a113-43da-8211-08e3382abf42 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:29.198769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-075e81ea-a113-43da-8211-08e3382abf42 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:29.207493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-075e81ea-a113-43da-8211-08e3382abf42 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:29.209279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-075e81ea-a113-43da-8211-08e3382abf42 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:29.210455 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-075e81ea-a113-43da-8211-08e3382abf42 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1356 microversion: 2.57 time: 0.317180 Mar 05 20:58:29.217722 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1373/2770] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:28 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1356 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:29.232190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cdf6a00f-31c5-412d-bab0-cfa33f35e70f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:29.232979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cdf6a00f-31c5-412d-bab0-cfa33f35e70f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:29.245388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cdf6a00f-31c5-412d-bab0-cfa33f35e70f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:29.246070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cdf6a00f-31c5-412d-bab0-cfa33f35e70f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:29.246999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cdf6a00f-31c5-412d-bab0-cfa33f35e70f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:29.247579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cdf6a00f-31c5-412d-bab0-cfa33f35e70f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:29.471629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5f07df68-bf96-4ea7-a7b4-3440f0d73ea1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:29.477851 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5f07df68-bf96-4ea7-a7b4-3440f0d73ea1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1548 microversion: 2.1 time: 0.722048 Mar 05 20:58:29.480704 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1398/2771] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:28 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1548 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:29.502228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c0c43310-9cc3-46b1-ade3-661b460cf1ae tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f792c10>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:29.560496 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c0c43310-9cc3-46b1-ade3-661b460cf1ae tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/4d62b868-d107-4689-82ac-667e5ba16b41" status: 200 len: 662 microversion: 2.1 time: 0.077297 Mar 05 20:58:29.563794 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1399/2772] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:58:29 2022] GET /compute/v2.1/images/4d62b868-d107-4689-82ac-667e5ba16b41 => generated 662 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:29.574382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9e6866d1-1bae-4d29-a23c-1996fe374288 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:29.575124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9e6866d1-1bae-4d29-a23c-1996fe374288 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:29.584926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e6866d1-1bae-4d29-a23c-1996fe374288 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:29.587227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e6866d1-1bae-4d29-a23c-1996fe374288 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:29.589620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e6866d1-1bae-4d29-a23c-1996fe374288 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:29.590092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e6866d1-1bae-4d29-a23c-1996fe374288 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:29.633799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9e6866d1-1bae-4d29-a23c-1996fe374288 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:58:29.771759 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9e6866d1-1bae-4d29-a23c-1996fe374288 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "DELETE /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 204 len: 0 microversion: 2.57 time: 0.205810 Mar 05 20:58:29.773221 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1400/2773] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 20:58:29 2022] DELETE /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:58:29.781769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5d917de1-d0b8-4c38-816d-3d66cf40901d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:29.793392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5d917de1-d0b8-4c38-816d-3d66cf40901d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:29.803367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d917de1-d0b8-4c38-816d-3d66cf40901d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:29.804189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d917de1-d0b8-4c38-816d-3d66cf40901d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:29.805707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d917de1-d0b8-4c38-816d-3d66cf40901d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:29.806370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d917de1-d0b8-4c38-816d-3d66cf40901d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:29.931233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cdf6a00f-31c5-412d-bab0-cfa33f35e70f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:29.943186 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cdf6a00f-31c5-412d-bab0-cfa33f35e70f tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1314 microversion: 2.1 time: 0.719951 Mar 05 20:58:29.952581 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1374/2774] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:29 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:29.956658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ae79f317-e164-48df-911e-d2ff336a631a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61b24ee0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:30.010342 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ae79f317-e164-48df-911e-d2ff336a631a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/4d62b868-d107-4689-82ac-667e5ba16b41" status: 200 len: 662 microversion: 2.1 time: 0.065105 Mar 05 20:58:30.011244 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1375/2775] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:58:29 2022] GET /compute/v2.1/images/4d62b868-d107-4689-82ac-667e5ba16b41 => generated 662 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:30.015955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9c9bf4aa-0e28-456a-836d-25cd966b920f tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:30.016571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9c9bf4aa-0e28-456a-836d-25cd966b920f tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:30.031296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c9bf4aa-0e28-456a-836d-25cd966b920f tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:30.031778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c9bf4aa-0e28-456a-836d-25cd966b920f tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:30.034091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c9bf4aa-0e28-456a-836d-25cd966b920f tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:30.035388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c9bf4aa-0e28-456a-836d-25cd966b920f tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:30.184525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9c9bf4aa-0e28-456a-836d-25cd966b920f tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:30.197914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9c9bf4aa-0e28-456a-836d-25cd966b920f tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:30.199428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9c9bf4aa-0e28-456a-836d-25cd966b920f tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:30.200658 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9c9bf4aa-0e28-456a-836d-25cd966b920f tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1362 microversion: 2.57 time: 0.188466 Mar 05 20:58:30.213876 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1376/2776] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:30 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:30.319392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5d917de1-d0b8-4c38-816d-3d66cf40901d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:30.340344 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5d917de1-d0b8-4c38-816d-3d66cf40901d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1322 microversion: 2.1 time: 0.564999 Mar 05 20:58:30.341483 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1401/2777] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:29 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:30.501633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dd4753e0-ea46-4a64-993d-dd9110fa90da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:30.504469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dd4753e0-ea46-4a64-993d-dd9110fa90da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:30.521466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd4753e0-ea46-4a64-993d-dd9110fa90da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:30.522494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd4753e0-ea46-4a64-993d-dd9110fa90da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:30.527242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd4753e0-ea46-4a64-993d-dd9110fa90da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:30.527926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd4753e0-ea46-4a64-993d-dd9110fa90da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:30.932001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-849cdec1-4c0e-4b2a-b770-efd6ce33da73 req-d54d9ee8-88f6-402b-ad06-89cdb83c2b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76292b20-5af3-4714-8d54-0207aa49129a", "tag": "9b6d6349-6293-4bf5-9386-7898bb2e8382"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:30.964630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-849cdec1-4c0e-4b2a-b770-efd6ce33da73 req-d54d9ee8-88f6-402b-ad06-89cdb83c2b9f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:30.966813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-849cdec1-4c0e-4b2a-b770-efd6ce33da73 req-d54d9ee8-88f6-402b-ad06-89cdb83c2b9f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:31.002930 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-849cdec1-4c0e-4b2a-b770-efd6ce33da73 req-d54d9ee8-88f6-402b-ad06-89cdb83c2b9f service nova] Creating event network-changed:9b6d6349-6293-4bf5-9386-7898bb2e8382 for instance 76292b20-5af3-4714-8d54-0207aa49129a on nch1-master-1 Mar 05 20:58:31.010707 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-849cdec1-4c0e-4b2a-b770-efd6ce33da73 req-d54d9ee8-88f6-402b-ad06-89cdb83c2b9f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083997 Mar 05 20:58:31.011329 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1402/2778] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:58:31.016661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-edd0e5aa-5fc5-4843-a24f-d56e104cef51 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:31.017346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-edd0e5aa-5fc5-4843-a24f-d56e104cef51 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:31.026883 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-edd0e5aa-5fc5-4843-a24f-d56e104cef51 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:31.027346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-edd0e5aa-5fc5-4843-a24f-d56e104cef51 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:31.028206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-edd0e5aa-5fc5-4843-a24f-d56e104cef51 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:31.028647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-edd0e5aa-5fc5-4843-a24f-d56e104cef51 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:31.244572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dd4753e0-ea46-4a64-993d-dd9110fa90da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:31.261112 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dd4753e0-ea46-4a64-993d-dd9110fa90da tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1548 microversion: 2.1 time: 0.766715 Mar 05 20:58:31.261854 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1377/2779] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:30 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1548 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:31.266828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45e9eb2a-a38f-4809-b318-8864cc44eb73 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:31.267451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-45e9eb2a-a38f-4809-b318-8864cc44eb73 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:31.291403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45e9eb2a-a38f-4809-b318-8864cc44eb73 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:31.291894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45e9eb2a-a38f-4809-b318-8864cc44eb73 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:31.292685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45e9eb2a-a38f-4809-b318-8864cc44eb73 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:31.293183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45e9eb2a-a38f-4809-b318-8864cc44eb73 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:31.451171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-45e9eb2a-a38f-4809-b318-8864cc44eb73 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:31.464019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-45e9eb2a-a38f-4809-b318-8864cc44eb73 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:31.474152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-45e9eb2a-a38f-4809-b318-8864cc44eb73 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '101d571886ab4901be96f849865a2cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87102c8d550443778df9ee34facca0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:31.476182 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45e9eb2a-a38f-4809-b318-8864cc44eb73 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 200 len: 1362 microversion: 2.57 time: 0.213264 Mar 05 20:58:31.477119 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1378/2780] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:31 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:58:31.482814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-787158a5-78f6-4587-98ed-35bbf3ab54a5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:31.484341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-787158a5-78f6-4587-98ed-35bbf3ab54a5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:31.499954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-787158a5-78f6-4587-98ed-35bbf3ab54a5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:31.505528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-787158a5-78f6-4587-98ed-35bbf3ab54a5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:31.506577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-787158a5-78f6-4587-98ed-35bbf3ab54a5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:31.507172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-787158a5-78f6-4587-98ed-35bbf3ab54a5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:31.780254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-edd0e5aa-5fc5-4843-a24f-d56e104cef51 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:31.787637 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-edd0e5aa-5fc5-4843-a24f-d56e104cef51 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1314 microversion: 2.1 time: 0.775095 Mar 05 20:58:31.801030 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1403/2781] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:31 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:31.807374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7843c23d-a695-4d1a-bba7-c2ef9584fd1f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed5cdba280>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:31.889144 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7843c23d-a695-4d1a-bba7-c2ef9584fd1f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/b65d57be-c098-4f42-b566-f5503ee9295f" status: 200 len: 662 microversion: 2.1 time: 0.086757 Mar 05 20:58:31.889799 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1404/2782] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:58:31 2022] GET /compute/v2.1/images/b65d57be-c098-4f42-b566-f5503ee9295f => generated 662 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:31.903440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-05695bf5-9d6b-4158-a087-9eea0e290b82 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed5c6608b0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:31.968686 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-05695bf5-9d6b-4158-a087-9eea0e290b82 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/b65d57be-c098-4f42-b566-f5503ee9295f" status: 200 len: 662 microversion: 2.1 time: 0.069729 Mar 05 20:58:31.969351 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1405/2783] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:58:31 2022] GET /compute/v2.1/images/b65d57be-c098-4f42-b566-f5503ee9295f => generated 662 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:58:32.086015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-787158a5-78f6-4587-98ed-35bbf3ab54a5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:32.102984 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-787158a5-78f6-4587-98ed-35bbf3ab54a5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1518 microversion: 2.1 time: 0.624159 Mar 05 20:58:32.104279 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1379/2784] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:31 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1518 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:32.126907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-660c620b-38fc-4898-b5d3-3f8524e03261 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:32.128293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-660c620b-38fc-4898-b5d3-3f8524e03261 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:32.143021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-660c620b-38fc-4898-b5d3-3f8524e03261 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:32.143592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-660c620b-38fc-4898-b5d3-3f8524e03261 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:32.144542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-660c620b-38fc-4898-b5d3-3f8524e03261 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:32.144990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-660c620b-38fc-4898-b5d3-3f8524e03261 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:32.217836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-660c620b-38fc-4898-b5d3-3f8524e03261 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lazy-loading 'flavor' on Instance uuid 23279b59-495b-4264-8d6c-33d6143418ce {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:58:32.282939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-61692236-3090-41b3-9cb0-4e4cb6f76963 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:32.285347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-61692236-3090-41b3-9cb0-4e4cb6f76963 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:32.306951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61692236-3090-41b3-9cb0-4e4cb6f76963 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:32.309048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61692236-3090-41b3-9cb0-4e4cb6f76963 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:32.311552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61692236-3090-41b3-9cb0-4e4cb6f76963 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:32.312546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61692236-3090-41b3-9cb0-4e4cb6f76963 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:32.333792 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-660c620b-38fc-4898-b5d3-3f8524e03261 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "POST /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce/action" status: 200 len: 32 microversion: 2.1 time: 0.208948 Mar 05 20:58:32.349735 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1406/2785] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:58:32 2022] POST /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce/action => generated 32 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 05 20:58:32.365160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-44b1b61d-7de7-425b-9b12-6a10f07db3a6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:32.366360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-44b1b61d-7de7-425b-9b12-6a10f07db3a6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:32.382151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44b1b61d-7de7-425b-9b12-6a10f07db3a6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:32.382881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44b1b61d-7de7-425b-9b12-6a10f07db3a6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:32.384904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44b1b61d-7de7-425b-9b12-6a10f07db3a6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:32.386163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44b1b61d-7de7-425b-9b12-6a10f07db3a6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:32.681209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-61692236-3090-41b3-9cb0-4e4cb6f76963 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:32.691639 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-61692236-3090-41b3-9cb0-4e4cb6f76963 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1548 microversion: 2.1 time: 0.414429 Mar 05 20:58:32.702898 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1380/2786] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:32 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1548 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:32.710805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-523954ac-4ac6-4595-8049-3d239d8049e1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:32.712100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-523954ac-4ac6-4595-8049-3d239d8049e1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] [instance: cc1e6a60-d5d5-4c0b-949d-43170a0d1751] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:32.720130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-523954ac-4ac6-4595-8049-3d239d8049e1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:32.721060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-523954ac-4ac6-4595-8049-3d239d8049e1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:32.723381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-523954ac-4ac6-4595-8049-3d239d8049e1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:32.724141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-523954ac-4ac6-4595-8049-3d239d8049e1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:32.745926 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-523954ac-4ac6-4595-8049-3d239d8049e1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] HTTP exception thrown: Instance cc1e6a60-d5d5-4c0b-949d-43170a0d1751 could not be found. Mar 05 20:58:32.746720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-523954ac-4ac6-4595-8049-3d239d8049e1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] Returning 404 to user: Instance cc1e6a60-d5d5-4c0b-949d-43170a0d1751 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:32.747844 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-523954ac-4ac6-4595-8049-3d239d8049e1 tempest-ServerShowV257Test-173499711 tempest-ServerShowV257Test-173499711-project] 10.222.0.15 "GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751" status: 404 len: 111 microversion: 2.57 time: 0.043336 Mar 05 20:58:32.748697 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1381/2787] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:32 2022] GET /compute/v2.1/servers/cc1e6a60-d5d5-4c0b-949d-43170a0d1751 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:58:32.819068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-99fd788e-9d4c-460d-9a72-8b8c8d66d3a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:32.819995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-99fd788e-9d4c-460d-9a72-8b8c8d66d3a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:32.829397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99fd788e-9d4c-460d-9a72-8b8c8d66d3a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:32.832515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99fd788e-9d4c-460d-9a72-8b8c8d66d3a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:32.833477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99fd788e-9d4c-460d-9a72-8b8c8d66d3a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:32.834377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99fd788e-9d4c-460d-9a72-8b8c8d66d3a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:33.184655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-44b1b61d-7de7-425b-9b12-6a10f07db3a6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:33.195157 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-44b1b61d-7de7-425b-9b12-6a10f07db3a6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.840449 Mar 05 20:58:33.207476 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1407/2788] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:32 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:33.510042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-99fd788e-9d4c-460d-9a72-8b8c8d66d3a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:33.521211 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-99fd788e-9d4c-460d-9a72-8b8c8d66d3a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1314 microversion: 2.1 time: 0.704214 Mar 05 20:58:33.522206 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1382/2789] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:32 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:33.713103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-933f2384-79da-4ae0-8ec2-df9605512b13 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:33.713800 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-933f2384-79da-4ae0-8ec2-df9605512b13 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:33.725436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-933f2384-79da-4ae0-8ec2-df9605512b13 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:33.725887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-933f2384-79da-4ae0-8ec2-df9605512b13 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:33.726695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-933f2384-79da-4ae0-8ec2-df9605512b13 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:33.734646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-933f2384-79da-4ae0-8ec2-df9605512b13 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:33.935887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a695d07d-ef9d-45ea-a3cb-08235f42abd6 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61b768b0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:33.986305 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a695d07d-ef9d-45ea-a3cb-08235f42abd6 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/b0dcb3a4-4374-4ab0-a564-6992943d2596" status: 200 len: 662 microversion: 2.1 time: 0.056738 Mar 05 20:58:33.993743 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1383/2790] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:58:33 2022] GET /compute/v2.1/images/b0dcb3a4-4374-4ab0-a564-6992943d2596 => generated 662 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:58:34.005163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fb5ed8bb-8581-4880-9d66-a1d51bce56e8 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61b90c10>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:34.069775 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fb5ed8bb-8581-4880-9d66-a1d51bce56e8 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/b0dcb3a4-4374-4ab0-a564-6992943d2596" status: 200 len: 662 microversion: 2.1 time: 0.068628 Mar 05 20:58:34.070370 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1384/2791] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:58:33 2022] GET /compute/v2.1/images/b0dcb3a4-4374-4ab0-a564-6992943d2596 => generated 662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:58:34.215806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-86ec4e0e-6831-4bb3-aeb5-f49c4fb27f70 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:34.216711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-86ec4e0e-6831-4bb3-aeb5-f49c4fb27f70 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:34.225050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86ec4e0e-6831-4bb3-aeb5-f49c4fb27f70 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:34.227718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86ec4e0e-6831-4bb3-aeb5-f49c4fb27f70 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:34.230306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86ec4e0e-6831-4bb3-aeb5-f49c4fb27f70 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:34.232197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86ec4e0e-6831-4bb3-aeb5-f49c4fb27f70 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:34.491285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-86ec4e0e-6831-4bb3-aeb5-f49c4fb27f70 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:34.499334 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-86ec4e0e-6831-4bb3-aeb5-f49c4fb27f70 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.288794 Mar 05 20:58:34.500260 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1385/2792] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:34 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:34.514175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1859158153", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:34.596168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:58:34.668634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-933f2384-79da-4ae0-8ec2-df9605512b13 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:34.679369 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-933f2384-79da-4ae0-8ec2-df9605512b13 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1548 microversion: 2.1 time: 0.975173 Mar 05 20:58:34.686774 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1408/2793] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:33 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1548 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:34.704852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5fd7fe22-4b01-4a95-8c0d-f7bfe0a0f4cb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:34.706850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5fd7fe22-4b01-4a95-8c0d-f7bfe0a0f4cb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:34.731805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5fd7fe22-4b01-4a95-8c0d-f7bfe0a0f4cb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:34.734426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5fd7fe22-4b01-4a95-8c0d-f7bfe0a0f4cb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:34.739821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5fd7fe22-4b01-4a95-8c0d-f7bfe0a0f4cb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:34.741410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5fd7fe22-4b01-4a95-8c0d-f7bfe0a0f4cb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:34.964526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:58:34.964986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:58:34.967555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:58:34.969654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:58:34.971517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:58:35.012025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:35.012771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:35.034227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:35.035906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:35.085932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Getting quotas for project 6554e19485bf42f3b2e5fb14472dea2b. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:58:35.104829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Getting quotas for user db3573e76c384af7b2e32db359b7231e and project 6554e19485bf42f3b2e5fb14472dea2b. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:58:35.126337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:58:35.129640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: 00a6114e-7710-4ccf-b462-bb8c98001725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:58:35.193569 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a477d9a5-7788-416a-8654-8ca5e3ad6f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690337 Mar 05 20:58:35.194267 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1386/2794] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:58:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:58:35.410747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2026054583", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:35.457046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5fd7fe22-4b01-4a95-8c0d-f7bfe0a0f4cb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:35.469356 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5fd7fe22-4b01-4a95-8c0d-f7bfe0a0f4cb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1314 microversion: 2.1 time: 0.779519 Mar 05 20:58:35.469970 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1409/2795] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:34 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1314 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:35.510541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:58:35.517597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-129220d7-bf64-429d-b37e-fbf432b35f1d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:35.518339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-129220d7-bf64-429d-b37e-fbf432b35f1d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:35.530982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-129220d7-bf64-429d-b37e-fbf432b35f1d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:35.531458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-129220d7-bf64-429d-b37e-fbf432b35f1d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:35.532561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-129220d7-bf64-429d-b37e-fbf432b35f1d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:35.533014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-129220d7-bf64-429d-b37e-fbf432b35f1d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:36.145243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:58:36.146073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:58:36.146247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:58:36.146972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:58:36.147615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:58:36.177962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:36.178529 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:36.186381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:36.187222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:36.214724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Getting quotas for project 6554e19485bf42f3b2e5fb14472dea2b. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:58:36.220850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Getting quotas for user db3573e76c384af7b2e32db359b7231e and project 6554e19485bf42f3b2e5fb14472dea2b. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:58:36.236161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:58:36.239487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:58:36.306165 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900777 Mar 05 20:58:36.307446 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1387/2796] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:58:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:58:36.308591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:36.309745 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45c1a1a6-e192-4876-87ab-69203821c31b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001318 Mar 05 20:58:36.310349 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1388/2797] 10.222.0.15 () {56 vars in 885 bytes} [Sat Mar 5 20:58:36 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 05 20:58:36.317126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8ee2757d-1425-4b75-b9c4-376fbe5f26d5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:36.318082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8ee2757d-1425-4b75-b9c4-376fbe5f26d5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:36.328027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8ee2757d-1425-4b75-b9c4-376fbe5f26d5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:36.328549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8ee2757d-1425-4b75-b9c4-376fbe5f26d5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:36.329608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8ee2757d-1425-4b75-b9c4-376fbe5f26d5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:36.330270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8ee2757d-1425-4b75-b9c4-376fbe5f26d5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:36.366830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-129220d7-bf64-429d-b37e-fbf432b35f1d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:36.395332 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-129220d7-bf64-429d-b37e-fbf432b35f1d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.881857 Mar 05 20:58:36.402062 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1410/2798] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:35 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:36.419969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c51689f9-bbb4-49f2-8459-6cb6c85f098b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:36.426148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c51689f9-bbb4-49f2-8459-6cb6c85f098b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:36.592096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c51689f9-bbb4-49f2-8459-6cb6c85f098b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:36.610047 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c51689f9-bbb4-49f2-8459-6cb6c85f098b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1218 microversion: 2.1 time: 0.203511 Mar 05 20:58:36.611965 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1411/2799] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:36 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1218 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:36.634571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-90fa72ff-eecd-4be4-a830-dfa4cc85284c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:36.636697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-90fa72ff-eecd-4be4-a830-dfa4cc85284c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:36.652222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90fa72ff-eecd-4be4-a830-dfa4cc85284c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:36.652860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90fa72ff-eecd-4be4-a830-dfa4cc85284c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:36.656315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90fa72ff-eecd-4be4-a830-dfa4cc85284c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:36.657080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90fa72ff-eecd-4be4-a830-dfa4cc85284c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:36.849388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8ee2757d-1425-4b75-b9c4-376fbe5f26d5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:36.863976 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8ee2757d-1425-4b75-b9c4-376fbe5f26d5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1538 microversion: 2.1 time: 0.552446 Mar 05 20:58:36.868133 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1389/2800] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:36 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1538 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:36.919914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-94df5061-5db0-4e47-b446-f97fcaf45f8d tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '.version_select at 0x7fed61b56280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:36.933170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94df5061-5db0-4e47-b446-f97fcaf45f8d tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:36.936896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94df5061-5db0-4e47-b446-f97fcaf45f8d tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:36.963847 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-94df5061-5db0-4e47-b446-f97fcaf45f8d tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/os-migrations" status: 200 len: 1170 microversion: 2.1 time: 0.081797 Mar 05 20:58:36.965782 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1390/2801] 10.222.0.15 () {58 vars in 1142 bytes} [Sat Mar 5 20:58:36 2022] GET /compute/v2.1/os-migrations => generated 1170 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:36.979375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b6f1904c-3dd7-4035-956c-a130c6e85664 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:36.980096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b6f1904c-3dd7-4035-956c-a130c6e85664 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:36.996859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6f1904c-3dd7-4035-956c-a130c6e85664 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:36.998711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6f1904c-3dd7-4035-956c-a130c6e85664 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:37.001485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6f1904c-3dd7-4035-956c-a130c6e85664 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:37.002877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6f1904c-3dd7-4035-956c-a130c6e85664 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:37.517975 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b6f1904c-3dd7-4035-956c-a130c6e85664 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1689 microversion: 2.1 time: 0.543090 Mar 05 20:58:37.531856 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1391/2802] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:36 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1689 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:37.558796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-beb070a6-32e0-491b-b547-c7e430019f3d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:37.559548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-beb070a6-32e0-491b-b547-c7e430019f3d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:37.579763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-beb070a6-32e0-491b-b547-c7e430019f3d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:37.580231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-beb070a6-32e0-491b-b547-c7e430019f3d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:37.588167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-beb070a6-32e0-491b-b547-c7e430019f3d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:37.588869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-beb070a6-32e0-491b-b547-c7e430019f3d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:37.873374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-90fa72ff-eecd-4be4-a830-dfa4cc85284c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:37.875584 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-90fa72ff-eecd-4be4-a830-dfa4cc85284c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1314 microversion: 2.1 time: 1.257281 Mar 05 20:58:37.884826 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1412/2803] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:36 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1314 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:37.893393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6a1b6491-ae8d-4071-8e85-d1bf40b4bfd8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:37.895280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6a1b6491-ae8d-4071-8e85-d1bf40b4bfd8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:37.907069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a1b6491-ae8d-4071-8e85-d1bf40b4bfd8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:37.918768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a1b6491-ae8d-4071-8e85-d1bf40b4bfd8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:37.919980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a1b6491-ae8d-4071-8e85-d1bf40b4bfd8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:37.921749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a1b6491-ae8d-4071-8e85-d1bf40b4bfd8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:37.954946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-beb070a6-32e0-491b-b547-c7e430019f3d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:37.969830 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-beb070a6-32e0-491b-b547-c7e430019f3d tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.436649 Mar 05 20:58:37.986857 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1392/2804] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:37 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:38.002753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ab591a6b-aba7-4984-9dad-73b3ccc30097 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:38.003792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ab591a6b-aba7-4984-9dad-73b3ccc30097 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:38.010626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab591a6b-aba7-4984-9dad-73b3ccc30097 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:38.011423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab591a6b-aba7-4984-9dad-73b3ccc30097 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:38.012961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab591a6b-aba7-4984-9dad-73b3ccc30097 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:38.014495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab591a6b-aba7-4984-9dad-73b3ccc30097 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:38.154139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ab591a6b-aba7-4984-9dad-73b3ccc30097 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:38.165892 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ab591a6b-aba7-4984-9dad-73b3ccc30097 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1270 microversion: 2.1 time: 0.177094 Mar 05 20:58:38.166735 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1393/2805] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:37 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:38.177288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7838d2f5-e1c7-472a-9a1c-ba82e6ef831b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:38.178012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7838d2f5-e1c7-472a-9a1c-ba82e6ef831b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:38.193273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7838d2f5-e1c7-472a-9a1c-ba82e6ef831b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:38.194608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7838d2f5-e1c7-472a-9a1c-ba82e6ef831b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:38.196440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7838d2f5-e1c7-472a-9a1c-ba82e6ef831b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:38.197045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7838d2f5-e1c7-472a-9a1c-ba82e6ef831b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:38.218350 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-7838d2f5-e1c7-472a-9a1c-ba82e6ef831b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] HTTP exception thrown: Instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 could not be found. Mar 05 20:58:38.220258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7838d2f5-e1c7-472a-9a1c-ba82e6ef831b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Returning 404 to user: Instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:38.221291 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7838d2f5-e1c7-472a-9a1c-ba82e6ef831b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "DELETE /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 404 len: 111 microversion: 2.32 time: 0.053499 Mar 05 20:58:38.225865 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1394/2806] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 20:58:38 2022] DELETE /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:58:38.234043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74632465-7508-4246-901c-dd5b83e5729b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:38.234685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-74632465-7508-4246-901c-dd5b83e5729b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] [instance: 71219f1b-5ca1-454a-9250-6b17cbd4ef77] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:38.245723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74632465-7508-4246-901c-dd5b83e5729b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:38.247344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74632465-7508-4246-901c-dd5b83e5729b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:38.248455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74632465-7508-4246-901c-dd5b83e5729b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:38.249696 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74632465-7508-4246-901c-dd5b83e5729b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:38.270981 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-74632465-7508-4246-901c-dd5b83e5729b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] HTTP exception thrown: Instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 could not be found. Mar 05 20:58:38.271925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74632465-7508-4246-901c-dd5b83e5729b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] Returning 404 to user: Instance 71219f1b-5ca1-454a-9250-6b17cbd4ef77 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:38.273136 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-74632465-7508-4246-901c-dd5b83e5729b tempest-TaggedBootDevicesTest-602522751 tempest-TaggedBootDevicesTest-602522751-project] 10.222.0.15 "GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77" status: 404 len: 111 microversion: 2.32 time: 0.045826 Mar 05 20:58:38.277384 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1395/2807] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:58:38 2022] GET /compute/v2.1/servers/71219f1b-5ca1-454a-9250-6b17cbd4ef77 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:58:38.309873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8cc9abd6-d5e5-4b92-85c7-d4ed5ee73429 req-487d4078-4314-4b51-9532-d7421e5e9798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76292b20-5af3-4714-8d54-0207aa49129a", "name": "network-vif-plugged", "status": "completed", "tag": "9b6d6349-6293-4bf5-9386-7898bb2e8382"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:38.349132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8cc9abd6-d5e5-4b92-85c7-d4ed5ee73429 req-487d4078-4314-4b51-9532-d7421e5e9798 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:38.350170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8cc9abd6-d5e5-4b92-85c7-d4ed5ee73429 req-487d4078-4314-4b51-9532-d7421e5e9798 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:38.377793 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8cc9abd6-d5e5-4b92-85c7-d4ed5ee73429 req-487d4078-4314-4b51-9532-d7421e5e9798 service nova] Creating event network-vif-plugged:9b6d6349-6293-4bf5-9386-7898bb2e8382 for instance 76292b20-5af3-4714-8d54-0207aa49129a on nch1-master-1 Mar 05 20:58:38.387178 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-8cc9abd6-d5e5-4b92-85c7-d4ed5ee73429 req-487d4078-4314-4b51-9532-d7421e5e9798 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088501 Mar 05 20:58:38.389863 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1396/2808] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:38.590570 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6a1b6491-ae8d-4071-8e85-d1bf40b4bfd8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1689 microversion: 2.1 time: 0.702867 Mar 05 20:58:38.592044 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1413/2809] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:37 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1689 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:38.760528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-86ead924-bb7b-45df-bdc7-c514cc45afb8 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:38.761787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-86ead924-bb7b-45df-bdc7-c514cc45afb8 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:38.780898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86ead924-bb7b-45df-bdc7-c514cc45afb8 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:38.781368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86ead924-bb7b-45df-bdc7-c514cc45afb8 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:38.785339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86ead924-bb7b-45df-bdc7-c514cc45afb8 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:38.786069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86ead924-bb7b-45df-bdc7-c514cc45afb8 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:38.901679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-685a3540-cc54-4352-8ab3-10f9841ced6e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:38.902311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-685a3540-cc54-4352-8ab3-10f9841ced6e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:38.913544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-685a3540-cc54-4352-8ab3-10f9841ced6e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:38.914338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-685a3540-cc54-4352-8ab3-10f9841ced6e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:38.915458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-685a3540-cc54-4352-8ab3-10f9841ced6e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:38.916583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-685a3540-cc54-4352-8ab3-10f9841ced6e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:38.934135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-86ead924-bb7b-45df-bdc7-c514cc45afb8 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lazy-loading 'services' on Instance uuid e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:58:39.072696 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-86ead924-bb7b-45df-bdc7-c514cc45afb8 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050/os-volume_attachments/b4d17444-3aa0-4844-b95f-1594f1c1b9ec" status: 202 len: 0 microversion: 2.1 time: 0.319861 Mar 05 20:58:39.073565 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1397/2810] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 20:58:38 2022] DELETE /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050/os-volume_attachments/b4d17444-3aa0-4844-b95f-1594f1c1b9ec => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:58:39.083732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-30c44cb8-5df3-4667-a183-0ed365d9a3d6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:39.084504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-30c44cb8-5df3-4667-a183-0ed365d9a3d6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:39.101707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30c44cb8-5df3-4667-a183-0ed365d9a3d6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:39.102359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30c44cb8-5df3-4667-a183-0ed365d9a3d6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:39.103315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30c44cb8-5df3-4667-a183-0ed365d9a3d6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:39.103980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30c44cb8-5df3-4667-a183-0ed365d9a3d6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:39.437902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-30c44cb8-5df3-4667-a183-0ed365d9a3d6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:39.448616 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-30c44cb8-5df3-4667-a183-0ed365d9a3d6 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.373446 Mar 05 20:58:39.449402 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1398/2811] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:39 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:39.466145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-79117db8-4d6c-4777-8eab-146c6bd11558 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:39.467451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-79117db8-4d6c-4777-8eab-146c6bd11558 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:39.476180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79117db8-4d6c-4777-8eab-146c6bd11558 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:39.476731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79117db8-4d6c-4777-8eab-146c6bd11558 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:39.477670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79117db8-4d6c-4777-8eab-146c6bd11558 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:39.478252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79117db8-4d6c-4777-8eab-146c6bd11558 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:39.518582 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-79117db8-4d6c-4777-8eab-146c6bd11558 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063504 Mar 05 20:58:39.519799 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1399/2812] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 20:58:39 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:39.528056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-71d64446-822d-4055-a3d7-a82f372de1f0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:39.528685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-71d64446-822d-4055-a3d7-a82f372de1f0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:39.535317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71d64446-822d-4055-a3d7-a82f372de1f0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:39.535816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71d64446-822d-4055-a3d7-a82f372de1f0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:39.537036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71d64446-822d-4055-a3d7-a82f372de1f0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:39.537762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71d64446-822d-4055-a3d7-a82f372de1f0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:39.626150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-71d64446-822d-4055-a3d7-a82f372de1f0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:39.638662 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-71d64446-822d-4055-a3d7-a82f372de1f0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1276 microversion: 2.1 time: 0.114118 Mar 05 20:58:39.650598 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1400/2813] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:39 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:39.872941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-685a3540-cc54-4352-8ab3-10f9841ced6e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:39.894418 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-685a3540-cc54-4352-8ab3-10f9841ced6e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1314 microversion: 2.1 time: 0.996430 Mar 05 20:58:39.896186 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1414/2814] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:38 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1314 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:40.090089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3e1cfd32-8894-4f6d-a580-588bcee92e70 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Action: 'create', calling method: .version_select at 0x7fed61b763a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1639695050"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:40.466593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c072dffc-066e-4920-ba8b-11cba4e0df13 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:40.468142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c072dffc-066e-4920-ba8b-11cba4e0df13 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:40.485310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c072dffc-066e-4920-ba8b-11cba4e0df13 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:40.496577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c072dffc-066e-4920-ba8b-11cba4e0df13 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:40.498662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c072dffc-066e-4920-ba8b-11cba4e0df13 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:40.500478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c072dffc-066e-4920-ba8b-11cba4e0df13 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:40.534194 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3e1cfd32-8894-4f6d-a580-588bcee92e70 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.679315 Mar 05 20:58:40.535291 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1401/2815] 10.222.0.15 () {60 vars in 1154 bytes} [Sat Mar 5 20:58:39 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 681 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 05 20:58:40.546790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9ec244ef-0a72-48d8-98c0-a5a171d1da86 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:40.552796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9ec244ef-0a72-48d8-98c0-a5a171d1da86 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:40.566329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ec244ef-0a72-48d8-98c0-a5a171d1da86 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:40.567131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ec244ef-0a72-48d8-98c0-a5a171d1da86 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:40.570066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ec244ef-0a72-48d8-98c0-a5a171d1da86 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:40.570943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ec244ef-0a72-48d8-98c0-a5a171d1da86 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:40.641861 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9ec244ef-0a72-48d8-98c0-a5a171d1da86 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103924 Mar 05 20:58:40.647309 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1402/2816] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 20:58:40 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 20:58:40.655753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-42e415b0-c811-4916-a77d-c644a3c06fca tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed61b90a60>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:40.726139 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-42e415b0-c811-4916-a77d-c644a3c06fca tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252" status: 200 len: 338 microversion: 2.1 time: 0.077461 Mar 05 20:58:40.727288 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1403/2817] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:58:40 2022] GET /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252 => generated 338 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:40.732503 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ce1aedc4-96c1-4420-b35a-775740056b04 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:40.733345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ce1aedc4-96c1-4420-b35a-775740056b04 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:40.760544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce1aedc4-96c1-4420-b35a-775740056b04 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:40.761101 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce1aedc4-96c1-4420-b35a-775740056b04 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:40.762090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce1aedc4-96c1-4420-b35a-775740056b04 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:40.772183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce1aedc4-96c1-4420-b35a-775740056b04 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:40.898814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ce1aedc4-96c1-4420-b35a-775740056b04 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:40.908597 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ce1aedc4-96c1-4420-b35a-775740056b04 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1276 microversion: 2.1 time: 0.179934 Mar 05 20:58:40.911848 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1404/2818] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:40 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1276 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:40.918428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e72b2134-ad7b-4639-9fc1-762ef77f95ea tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:40.922282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e72b2134-ad7b-4639-9fc1-762ef77f95ea tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:40.940347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e72b2134-ad7b-4639-9fc1-762ef77f95ea tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:40.941474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e72b2134-ad7b-4639-9fc1-762ef77f95ea tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:40.943045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e72b2134-ad7b-4639-9fc1-762ef77f95ea tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:40.944311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e72b2134-ad7b-4639-9fc1-762ef77f95ea tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:41.194992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e72b2134-ad7b-4639-9fc1-762ef77f95ea tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:41.205792 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e72b2134-ad7b-4639-9fc1-762ef77f95ea tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1502 microversion: 2.1 time: 0.289244 Mar 05 20:58:41.207402 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1405/2819] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:40 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:41.223655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f60a27b1-da43-4837-b8d1-a83ad9c6bed9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:41.241897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f60a27b1-da43-4837-b8d1-a83ad9c6bed9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:41.243161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f60a27b1-da43-4837-b8d1-a83ad9c6bed9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:41.338468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f60a27b1-da43-4837-b8d1-a83ad9c6bed9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Going to try to stop instance {{(pid=141478) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 05 20:58:41.429705 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f60a27b1-da43-4837-b8d1-a83ad9c6bed9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "POST /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a/action" status: 202 len: 0 microversion: 2.1 time: 0.208909 Mar 05 20:58:41.451087 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1406/2820] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:58:41 2022] POST /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:58:41.462683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ad6a3928-a3b9-4c44-a3e7-a7f6f538028c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:41.463394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ad6a3928-a3b9-4c44-a3e7-a7f6f538028c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:41.474060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad6a3928-a3b9-4c44-a3e7-a7f6f538028c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:41.474900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad6a3928-a3b9-4c44-a3e7-a7f6f538028c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:41.487598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad6a3928-a3b9-4c44-a3e7-a7f6f538028c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:41.488126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c072dffc-066e-4920-ba8b-11cba4e0df13 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:41.489337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad6a3928-a3b9-4c44-a3e7-a7f6f538028c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:41.531965 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c072dffc-066e-4920-ba8b-11cba4e0df13 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 1.068063 Mar 05 20:58:41.533342 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1415/2821] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:40 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:41.742960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91bb014f-0cee-40c4-8098-9d6c40cedc1c tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed4f7af550>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:41.765793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad6a3928-a3b9-4c44-a3e7-a7f6f538028c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:41.779125 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ad6a3928-a3b9-4c44-a3e7-a7f6f538028c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.326619 Mar 05 20:58:41.779818 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1407/2822] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:41 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:41.816321 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91bb014f-0cee-40c4-8098-9d6c40cedc1c tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252" status: 200 len: 339 microversion: 2.1 time: 0.080653 Mar 05 20:58:41.816915 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1416/2823] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:58:41 2022] GET /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252 => generated 339 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:41.830063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e2c68a71-eb3d-4f3e-806e-dbcbf02800c4 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Action: 'create', calling method: .version_select at 0x7fed61b90820>, body: {"snapshot": {"volume_id": "555a5c26-7277-41de-bd15-f5dccc052252", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1007467272"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:41.929837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-95364f75-8a70-451e-8240-381ad7e18cd1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:41.930582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-95364f75-8a70-451e-8240-381ad7e18cd1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:41.937011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95364f75-8a70-451e-8240-381ad7e18cd1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:41.939100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95364f75-8a70-451e-8240-381ad7e18cd1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:41.943871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95364f75-8a70-451e-8240-381ad7e18cd1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:41.944688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95364f75-8a70-451e-8240-381ad7e18cd1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:42.094787 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e2c68a71-eb3d-4f3e-806e-dbcbf02800c4 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.269943 Mar 05 20:58:42.100925 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1408/2824] 10.222.0.15 () {60 vars in 1161 bytes} [Sat Mar 5 20:58:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:42.103411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-95364f75-8a70-451e-8240-381ad7e18cd1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:42.113994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a81aab8d-7ba8-4008-9fff-0b17e35f7540 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed61b3df70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:42.120665 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-95364f75-8a70-451e-8240-381ad7e18cd1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1276 microversion: 2.1 time: 0.195764 Mar 05 20:58:42.121170 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1417/2825] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:41 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1276 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:42.161483 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a81aab8d-7ba8-4008-9fff-0b17e35f7540 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31" status: 200 len: 287 microversion: 2.1 time: 0.056512 Mar 05 20:58:42.162204 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1409/2826] 10.222.0.15 () {58 vars in 1250 bytes} [Sat Mar 5 20:58:42 2022] GET /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:42.179112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e7e418b9-38dc-44d0-9032-e4fcf02bb7ed tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed4f7b84c0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:42.214199 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e7e418b9-38dc-44d0-9032-e4fcf02bb7ed tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.046217 Mar 05 20:58:42.214881 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1418/2827] 10.222.0.15 () {58 vars in 1139 bytes} [Sat Mar 5 20:58:42 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:42.225419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23b43acf-7031-4a0b-a9ea-cad024a3e038 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed61b54670>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:42.305122 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-23b43acf-7031-4a0b-a9ea-cad024a3e038 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31" status: 200 len: 287 microversion: 2.1 time: 0.083900 Mar 05 20:58:42.305935 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1410/2828] 10.222.0.15 () {58 vars in 1250 bytes} [Sat Mar 5 20:58:42 2022] GET /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:42.553237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-44cc6ad4-078f-4c17-8fc7-5e69d81e930e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:42.553886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-44cc6ad4-078f-4c17-8fc7-5e69d81e930e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:42.560873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44cc6ad4-078f-4c17-8fc7-5e69d81e930e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:42.561334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44cc6ad4-078f-4c17-8fc7-5e69d81e930e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:42.562105 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44cc6ad4-078f-4c17-8fc7-5e69d81e930e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:42.562541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44cc6ad4-078f-4c17-8fc7-5e69d81e930e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:42.797739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1be428ac-b98d-4234-818e-f62639530f74 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:42.798505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1be428ac-b98d-4234-818e-f62639530f74 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:42.805396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1be428ac-b98d-4234-818e-f62639530f74 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:42.805855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1be428ac-b98d-4234-818e-f62639530f74 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:42.806690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1be428ac-b98d-4234-818e-f62639530f74 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:42.807213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1be428ac-b98d-4234-818e-f62639530f74 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:42.963463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1be428ac-b98d-4234-818e-f62639530f74 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:42.971139 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1be428ac-b98d-4234-818e-f62639530f74 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.177993 Mar 05 20:58:42.972357 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1411/2829] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:42 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:43.088831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-44cc6ad4-078f-4c17-8fc7-5e69d81e930e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:43.096164 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-44cc6ad4-078f-4c17-8fc7-5e69d81e930e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.548122 Mar 05 20:58:43.096816 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1419/2830] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:42 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:43.137655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b58c8d73-9d20-4164-8970-09e758d81c06 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:43.138398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b58c8d73-9d20-4164-8970-09e758d81c06 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:43.145609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b58c8d73-9d20-4164-8970-09e758d81c06 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:43.146098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b58c8d73-9d20-4164-8970-09e758d81c06 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:43.146908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b58c8d73-9d20-4164-8970-09e758d81c06 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:43.147398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b58c8d73-9d20-4164-8970-09e758d81c06 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:43.318195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7f67e967-ad84-4ec9-8f47-c2b1b522f3b2 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed4f7b8a60>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:43.345083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b58c8d73-9d20-4164-8970-09e758d81c06 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:43.354978 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b58c8d73-9d20-4164-8970-09e758d81c06 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1318 microversion: 2.1 time: 0.221223 Mar 05 20:58:43.368484 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7f67e967-ad84-4ec9-8f47-c2b1b522f3b2 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31" status: 200 len: 287 microversion: 2.1 time: 0.055148 Mar 05 20:58:43.369275 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1420/2831] 10.222.0.15 () {58 vars in 1250 bytes} [Sat Mar 5 20:58:43 2022] GET /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:43.369787 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1412/2832] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:43 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:43.989825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1c19491f-a4ab-460e-a1ef-3af5e00b93e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:43.990442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1c19491f-a4ab-460e-a1ef-3af5e00b93e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:44.013168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c19491f-a4ab-460e-a1ef-3af5e00b93e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:44.014627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c19491f-a4ab-460e-a1ef-3af5e00b93e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:44.018730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c19491f-a4ab-460e-a1ef-3af5e00b93e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:44.023043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c19491f-a4ab-460e-a1ef-3af5e00b93e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:44.115600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aa0c3485-0fdd-49f8-bbc5-87caca1e8d2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:44.116608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aa0c3485-0fdd-49f8-bbc5-87caca1e8d2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:44.130417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa0c3485-0fdd-49f8-bbc5-87caca1e8d2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:44.130417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa0c3485-0fdd-49f8-bbc5-87caca1e8d2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:44.131208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa0c3485-0fdd-49f8-bbc5-87caca1e8d2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:44.131644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa0c3485-0fdd-49f8-bbc5-87caca1e8d2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:44.695881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1c19491f-a4ab-460e-a1ef-3af5e00b93e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:44.704745 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1c19491f-a4ab-460e-a1ef-3af5e00b93e9 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.719586 Mar 05 20:58:44.712030 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1421/2833] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:43 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:44.727296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-f229fc0b-98df-4de6-a2d0-8759e7e98943 req-d0c08334-df9d-498d-8916-7b9463a94d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a6114e-7710-4ccf-b462-bb8c98001725", "tag": "f3d55e8e-71fd-427a-9669-f45552929be7"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:44.754873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f229fc0b-98df-4de6-a2d0-8759e7e98943 req-d0c08334-df9d-498d-8916-7b9463a94d03 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:44.755327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f229fc0b-98df-4de6-a2d0-8759e7e98943 req-d0c08334-df9d-498d-8916-7b9463a94d03 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:44.772904 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-f229fc0b-98df-4de6-a2d0-8759e7e98943 req-d0c08334-df9d-498d-8916-7b9463a94d03 service nova] Creating event network-changed:f3d55e8e-71fd-427a-9669-f45552929be7 for instance 00a6114e-7710-4ccf-b462-bb8c98001725 on nch1-master-1 Mar 05 20:58:44.802344 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-f229fc0b-98df-4de6-a2d0-8759e7e98943 req-d0c08334-df9d-498d-8916-7b9463a94d03 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088824 Mar 05 20:58:44.802979 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1422/2834] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:44.808428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-386ea4d4-a6ed-4ba2-98ff-1d0cc0622c28 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:44.809448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-386ea4d4-a6ed-4ba2-98ff-1d0cc0622c28 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:44.824999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-386ea4d4-a6ed-4ba2-98ff-1d0cc0622c28 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:44.825846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-386ea4d4-a6ed-4ba2-98ff-1d0cc0622c28 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:44.826826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-386ea4d4-a6ed-4ba2-98ff-1d0cc0622c28 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:44.827452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-386ea4d4-a6ed-4ba2-98ff-1d0cc0622c28 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:45.037633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aa0c3485-0fdd-49f8-bbc5-87caca1e8d2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:45.051473 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aa0c3485-0fdd-49f8-bbc5-87caca1e8d2f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.941219 Mar 05 20:58:45.052310 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1413/2835] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:44 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:45.068998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cbd405ec-fc64-4f0a-88d9-71a681dc8ebf tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed61b21ee0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:45.138217 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cbd405ec-fc64-4f0a-88d9-71a681dc8ebf tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31" status: 200 len: 288 microversion: 2.1 time: 0.083851 Mar 05 20:58:45.140584 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1414/2836] 10.222.0.15 () {58 vars in 1250 bytes} [Sat Mar 5 20:58:45 2022] GET /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31 => generated 288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:45.148289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1446266208", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "93578ff8-1ca6-4e6e-b4ae-025cd8c9d397"}], "block_device_mapping_v2": [{"uuid": "343d02d7-1904-4f02-a9f0-6e1deab8d765", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:45.305539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] validate_networks() for [('93578ff8-1ca6-4e6e-b4ae-025cd8c9d397', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:58:45.371278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-386ea4d4-a6ed-4ba2-98ff-1d0cc0622c28 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:45.396560 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-386ea4d4-a6ed-4ba2-98ff-1d0cc0622c28 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1318 microversion: 2.1 time: 0.591682 Mar 05 20:58:45.406309 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1423/2837] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:44 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1318 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:45.411544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2064bdbf-ae6e-4eab-bf1b-052b3b1caa41 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed4f7e4ee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:45.506056 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2064bdbf-ae6e-4eab-bf1b-052b3b1caa41 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31" status: 202 len: 0 microversion: 2.1 time: 0.098420 Mar 05 20:58:45.506643 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1424/2838] 10.222.0.15 () {58 vars in 1253 bytes} [Sat Mar 5 20:58:45 2022] DELETE /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:58:45.514491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9f8de386-e8f6-4193-a7fa-afa570be043b tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed4f7e4700>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:45.570753 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9f8de386-e8f6-4193-a7fa-afa570be043b tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31" status: 200 len: 287 microversion: 2.1 time: 0.059889 Mar 05 20:58:45.571576 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1425/2839] 10.222.0.15 () {58 vars in 1250 bytes} [Sat Mar 5 20:58:45 2022] GET /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:45.728962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af3f0ea2-7d46-4452-bc78-8670a7291334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:45.729736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-af3f0ea2-7d46-4452-bc78-8670a7291334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:45.739550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af3f0ea2-7d46-4452-bc78-8670a7291334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:45.741948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af3f0ea2-7d46-4452-bc78-8670a7291334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:45.742748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af3f0ea2-7d46-4452-bc78-8670a7291334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:45.748905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af3f0ea2-7d46-4452-bc78-8670a7291334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:46.271481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-af3f0ea2-7d46-4452-bc78-8670a7291334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:46.281857 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-af3f0ea2-7d46-4452-bc78-8670a7291334 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.556999 Mar 05 20:58:46.282467 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1426/2840] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:45 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:46.305768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e4254f73-eac3-4909-9df8-48e2293aaed8 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:46.306389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e4254f73-eac3-4909-9df8-48e2293aaed8 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:46.328920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4254f73-eac3-4909-9df8-48e2293aaed8 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:46.329387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4254f73-eac3-4909-9df8-48e2293aaed8 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:46.330251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4254f73-eac3-4909-9df8-48e2293aaed8 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:46.330646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4254f73-eac3-4909-9df8-48e2293aaed8 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:46.721134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e4254f73-eac3-4909-9df8-48e2293aaed8 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:46.731197 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e4254f73-eac3-4909-9df8-48e2293aaed8 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.446614 Mar 05 20:58:46.744542 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1427/2841] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:46 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:46.750276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c08c4488-7950-4f95-8dd6-f9081bd357f7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:46.751119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c08c4488-7950-4f95-8dd6-f9081bd357f7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:46.759109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c08c4488-7950-4f95-8dd6-f9081bd357f7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:46.759936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c08c4488-7950-4f95-8dd6-f9081bd357f7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:46.760872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c08c4488-7950-4f95-8dd6-f9081bd357f7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:46.761578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c08c4488-7950-4f95-8dd6-f9081bd357f7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:46.899217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:58:46.900325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:58:46.912632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:58:46.914868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:58:46.916608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:58:46.936600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:46.937344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:46.938707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:46.939804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:46.969084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Getting quotas for project 77c35382c7454a51ab1fbd37f9157ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:58:46.977430 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Getting quotas for user 4ff43fd6998d454887c5aae39464ab72 and project 77c35382c7454a51ab1fbd37f9157ef4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:58:47.008292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c08c4488-7950-4f95-8dd6-f9081bd357f7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:47.019685 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c08c4488-7950-4f95-8dd6-f9081bd357f7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1318 microversion: 2.1 time: 0.273714 Mar 05 20:58:47.022181 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1428/2842] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:46 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:47.027460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d8e7169-a7d3-47f3-a7d2-b1082cb84867 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed4f78ad30>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:47.064000 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-7d8e7169-a7d3-47f3-a7d2-b1082cb84867 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] HTTP exception thrown: Snapshot 4ab774c1-2d19-4e7d-a95c-e9ebd6094b31 could not be found. Mar 05 20:58:47.064790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d8e7169-a7d3-47f3-a7d2-b1082cb84867 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Returning 404 to user: Snapshot 4ab774c1-2d19-4e7d-a95c-e9ebd6094b31 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:47.066583 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7d8e7169-a7d3-47f3-a7d2-b1082cb84867 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31" status: 404 len: 111 microversion: 2.1 time: 0.043250 Mar 05 20:58:47.067162 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1429/2843] 10.222.0.15 () {58 vars in 1250 bytes} [Sat Mar 5 20:58:47 2022] GET /compute/v2.1/os-snapshots/4ab774c1-2d19-4e7d-a95c-e9ebd6094b31 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:58:47.071128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:58:47.073873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='343d02d7-1904-4f02-a9f0-6e1deab8d765',volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:58:47.087254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e2a5e111-7239-4ec2-9310-c27f90173227 req-7d5cd73b-a7e3-428e-8df0-95062d44fcc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc23752-0101-4c2b-a90f-6ccad692e3f3", "tag": "d89b87d8-65fa-4882-ac07-f0f70c7ec7eb"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:47.103660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e2a5e111-7239-4ec2-9310-c27f90173227 req-7d5cd73b-a7e3-428e-8df0-95062d44fcc3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:47.104640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e2a5e111-7239-4ec2-9310-c27f90173227 req-7d5cd73b-a7e3-428e-8df0-95062d44fcc3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:47.120351 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e2a5e111-7239-4ec2-9310-c27f90173227 req-7d5cd73b-a7e3-428e-8df0-95062d44fcc3 service nova] Creating event network-changed:d89b87d8-65fa-4882-ac07-f0f70c7ec7eb for instance dbc23752-0101-4c2b-a90f-6ccad692e3f3 on nch2-master-1 Mar 05 20:58:47.130742 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e2a5e111-7239-4ec2-9310-c27f90173227 req-7d5cd73b-a7e3-428e-8df0-95062d44fcc3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061983 Mar 05 20:58:47.132036 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1430/2844] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:47.143473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d65400fe-4aca-42c9-a278-c656945769f6 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed4f89b8b0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:47.284999 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d65400fe-4aca-42c9-a278-c656945769f6 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252" status: 202 len: 0 microversion: 2.1 time: 0.145396 Mar 05 20:58:47.288313 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1431/2845] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 20:58:47 2022] DELETE /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:58:47.298259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-50486505-eda7-4342-a50f-82e43113f8ab tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed4f78a790>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:47.350283 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7852c66a-e10c-4299-89f7-72107f5a6815 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.208108 Mar 05 20:58:47.351454 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1415/2846] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:58:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:58:47.357755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45397a71-5cb3-4f37-a0e7-770badc96b80 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:47.359115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-45397a71-5cb3-4f37-a0e7-770badc96b80 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:47.366236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45397a71-5cb3-4f37-a0e7-770badc96b80 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:47.366992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45397a71-5cb3-4f37-a0e7-770badc96b80 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:47.368791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45397a71-5cb3-4f37-a0e7-770badc96b80 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:47.369426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45397a71-5cb3-4f37-a0e7-770badc96b80 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:47.432489 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-50486505-eda7-4342-a50f-82e43113f8ab tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252" status: 200 len: 338 microversion: 2.1 time: 0.139852 Mar 05 20:58:47.433062 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1432/2847] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:58:47 2022] GET /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252 => generated 338 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:58:47.437684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aa1b350c-fc6a-4a53-9d62-6c6e98108718 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:47.438632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-aa1b350c-fc6a-4a53-9d62-6c6e98108718 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:47.550875 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-aa1b350c-fc6a-4a53-9d62-6c6e98108718 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:47.577622 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aa1b350c-fc6a-4a53-9d62-6c6e98108718 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1053 microversion: 2.1 time: 0.136612 Mar 05 20:58:47.578622 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1433/2848] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:47 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1053 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:47.750778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6c30d790-4c66-4d51-bf81-34cb1900b52c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:47.751536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6c30d790-4c66-4d51-bf81-34cb1900b52c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:47.762564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c30d790-4c66-4d51-bf81-34cb1900b52c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:47.763219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c30d790-4c66-4d51-bf81-34cb1900b52c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:47.764741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c30d790-4c66-4d51-bf81-34cb1900b52c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:47.765510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c30d790-4c66-4d51-bf81-34cb1900b52c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:47.942243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-45397a71-5cb3-4f37-a0e7-770badc96b80 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:47.951243 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45397a71-5cb3-4f37-a0e7-770badc96b80 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.598490 Mar 05 20:58:47.959477 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1416/2849] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:47 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:48.038667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d34bc67e-8f80-4571-b278-a3bac73c34bc tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:48.039295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d34bc67e-8f80-4571-b278-a3bac73c34bc tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:48.048653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d34bc67e-8f80-4571-b278-a3bac73c34bc tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:48.052726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d34bc67e-8f80-4571-b278-a3bac73c34bc tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:48.053769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d34bc67e-8f80-4571-b278-a3bac73c34bc tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:48.054362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d34bc67e-8f80-4571-b278-a3bac73c34bc tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:48.295115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6c30d790-4c66-4d51-bf81-34cb1900b52c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:48.304060 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6c30d790-4c66-4d51-bf81-34cb1900b52c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.558988 Mar 05 20:58:48.304653 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1434/2850] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:47 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:48.449200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b2a3415d-4279-4c01-8849-7d7478c1bb2a tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed4f78a670>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:48.494707 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-b2a3415d-4279-4c01-8849-7d7478c1bb2a tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] HTTP exception thrown: Volume 555a5c26-7277-41de-bd15-f5dccc052252 could not be found. Mar 05 20:58:48.495393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b2a3415d-4279-4c01-8849-7d7478c1bb2a tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Returning 404 to user: Volume 555a5c26-7277-41de-bd15-f5dccc052252 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:48.496360 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b2a3415d-4279-4c01-8849-7d7478c1bb2a tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252" status: 404 len: 109 microversion: 2.1 time: 0.056134 Mar 05 20:58:48.515763 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1435/2851] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:58:48 2022] GET /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:58:48.524853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af247e09-4a81-405e-bd03-6dfe8ccb6dfc tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed4f7b84c0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:48.578530 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-af247e09-4a81-405e-bd03-6dfe8ccb6dfc tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] HTTP exception thrown: Volume 555a5c26-7277-41de-bd15-f5dccc052252 could not be found. Mar 05 20:58:48.579322 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af247e09-4a81-405e-bd03-6dfe8ccb6dfc tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Returning 404 to user: Volume 555a5c26-7277-41de-bd15-f5dccc052252 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:48.580360 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-af247e09-4a81-405e-bd03-6dfe8ccb6dfc tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252" status: 404 len: 109 microversion: 2.1 time: 0.063561 Mar 05 20:58:48.584401 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1436/2852] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 20:58:48 2022] DELETE /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:58:48.590031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-906909e1-6b1c-4fe4-9781-03926bb992f6 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Calling method '.version_select at 0x7fed4f78a670>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:48.640392 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-906909e1-6b1c-4fe4-9781-03926bb992f6 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] HTTP exception thrown: Volume 555a5c26-7277-41de-bd15-f5dccc052252 could not be found. Mar 05 20:58:48.641195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-906909e1-6b1c-4fe4-9781-03926bb992f6 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] Returning 404 to user: Volume 555a5c26-7277-41de-bd15-f5dccc052252 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:48.642207 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-906909e1-6b1c-4fe4-9781-03926bb992f6 tempest-VolumesSnapshotsTestJSON-1459184426 tempest-VolumesSnapshotsTestJSON-1459184426-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252" status: 404 len: 109 microversion: 2.1 time: 0.056665 Mar 05 20:58:48.646131 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1437/2853] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:58:48 2022] GET /compute/v2.1/os-volumes/555a5c26-7277-41de-bd15-f5dccc052252 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:58:48.653381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fd52ed71-068f-4063-97bc-ddcb6cf44a50 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:48.654109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fd52ed71-068f-4063-97bc-ddcb6cf44a50 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:48.793866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fd52ed71-068f-4063-97bc-ddcb6cf44a50 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:48.812690 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fd52ed71-068f-4063-97bc-ddcb6cf44a50 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1053 microversion: 2.1 time: 0.164099 Mar 05 20:58:48.816070 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1438/2854] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:48 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1053 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:48.976460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e89e11cb-fc2f-4e7d-bfd1-71d0545f5c59 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:48.977094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e89e11cb-fc2f-4e7d-bfd1-71d0545f5c59 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:48.986531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e89e11cb-fc2f-4e7d-bfd1-71d0545f5c59 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:48.987002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e89e11cb-fc2f-4e7d-bfd1-71d0545f5c59 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:48.991134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e89e11cb-fc2f-4e7d-bfd1-71d0545f5c59 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:48.993698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e89e11cb-fc2f-4e7d-bfd1-71d0545f5c59 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:49.023583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d34bc67e-8f80-4571-b278-a3bac73c34bc tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:49.035398 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d34bc67e-8f80-4571-b278-a3bac73c34bc tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1318 microversion: 2.1 time: 1.000690 Mar 05 20:58:49.058732 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1417/2855] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:48 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1318 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:49.321989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-da998297-b054-4700-9952-34e6c5ed243a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:49.322828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-da998297-b054-4700-9952-34e6c5ed243a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:49.329821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e89e11cb-fc2f-4e7d-bfd1-71d0545f5c59 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:49.337208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-da998297-b054-4700-9952-34e6c5ed243a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:49.338215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-da998297-b054-4700-9952-34e6c5ed243a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:49.339387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-da998297-b054-4700-9952-34e6c5ed243a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:49.342743 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e89e11cb-fc2f-4e7d-bfd1-71d0545f5c59 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.369884 Mar 05 20:58:49.343135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-da998297-b054-4700-9952-34e6c5ed243a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:49.348935 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1439/2856] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:48 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:49.834201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5d9467f6-b0bb-4776-8a9b-cceb1a1237e2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:49.835702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5d9467f6-b0bb-4776-8a9b-cceb1a1237e2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:49.848235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d9467f6-b0bb-4776-8a9b-cceb1a1237e2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:49.849769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d9467f6-b0bb-4776-8a9b-cceb1a1237e2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:49.851076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d9467f6-b0bb-4776-8a9b-cceb1a1237e2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:49.851791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d9467f6-b0bb-4776-8a9b-cceb1a1237e2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:49.966313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5d9467f6-b0bb-4776-8a9b-cceb1a1237e2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:49.980168 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5d9467f6-b0bb-4776-8a9b-cceb1a1237e2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1169 microversion: 2.1 time: 0.152040 Mar 05 20:58:49.981477 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1440/2857] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:49 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1169 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:50.016859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-da998297-b054-4700-9952-34e6c5ed243a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:50.025494 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-da998297-b054-4700-9952-34e6c5ed243a tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.707793 Mar 05 20:58:50.036357 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1418/2858] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:49 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:50.071553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-de4b3546-7bae-49ef-981f-7f6e765871e1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:50.072217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-de4b3546-7bae-49ef-981f-7f6e765871e1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:50.080508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de4b3546-7bae-49ef-981f-7f6e765871e1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:50.087468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de4b3546-7bae-49ef-981f-7f6e765871e1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:50.088602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de4b3546-7bae-49ef-981f-7f6e765871e1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:50.090168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de4b3546-7bae-49ef-981f-7f6e765871e1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:50.366722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-98d5f5ad-4761-432b-99ef-250d12556a7a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:50.367588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-98d5f5ad-4761-432b-99ef-250d12556a7a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:50.386423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98d5f5ad-4761-432b-99ef-250d12556a7a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:50.387051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98d5f5ad-4761-432b-99ef-250d12556a7a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:50.388049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98d5f5ad-4761-432b-99ef-250d12556a7a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:50.388750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98d5f5ad-4761-432b-99ef-250d12556a7a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:50.479926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-de4b3546-7bae-49ef-981f-7f6e765871e1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:50.491043 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-de4b3546-7bae-49ef-981f-7f6e765871e1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1318 microversion: 2.1 time: 0.423374 Mar 05 20:58:50.501562 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1441/2859] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:50 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:51.566915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d15936dc-4a9e-4380-b9eb-bbcf5aab58a0 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Action: 'create', calling method: .version_select at 0x7fed4f7be1f0>, body: {"keypair": {"name": "tempest-keypair-1859380118"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:51.613642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d15936dc-4a9e-4380-b9eb-bbcf5aab58a0 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Getting quotas for project 4629462cb9c24128921119298bb0655c. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:58:51.623415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-98d5f5ad-4761-432b-99ef-250d12556a7a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:51.636948 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-98d5f5ad-4761-432b-99ef-250d12556a7a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 1.275093 Mar 05 20:58:51.643231 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1419/2860] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:50 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:51.645709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d15936dc-4a9e-4380-b9eb-bbcf5aab58a0 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Getting quotas for user 9443ac1e9d174c70a22e40d844dcae27 and project 4629462cb9c24128921119298bb0655c. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:58:51.658349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-57ece032-b821-4108-8078-9b1df56ecc62 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:51.664605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-57ece032-b821-4108-8078-9b1df56ecc62 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:51.699389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-57ece032-b821-4108-8078-9b1df56ecc62 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:51.700206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-57ece032-b821-4108-8078-9b1df56ecc62 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:51.701890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-57ece032-b821-4108-8078-9b1df56ecc62 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:51.704534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-57ece032-b821-4108-8078-9b1df56ecc62 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:52.163395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d15936dc-4a9e-4380-b9eb-bbcf5aab58a0 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Getting quotas for project 4629462cb9c24128921119298bb0655c. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:58:52.181720 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d15936dc-4a9e-4380-b9eb-bbcf5aab58a0 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Getting quotas for user 9443ac1e9d174c70a22e40d844dcae27 and project 4629462cb9c24128921119298bb0655c. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:58:52.203403 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d15936dc-4a9e-4380-b9eb-bbcf5aab58a0 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.377946 Mar 05 20:58:52.209155 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1442/2861] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 20:58:50 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:52.210619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c3471642-d63c-4e1a-9bf8-aa48084b8935 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:52.211698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c3471642-d63c-4e1a-9bf8-aa48084b8935 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:52.221351 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3471642-d63c-4e1a-9bf8-aa48084b8935 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:52.222490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3471642-d63c-4e1a-9bf8-aa48084b8935 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:52.223343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3471642-d63c-4e1a-9bf8-aa48084b8935 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:52.223823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3471642-d63c-4e1a-9bf8-aa48084b8935 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:52.330622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-57ece032-b821-4108-8078-9b1df56ecc62 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:52.351694 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-57ece032-b821-4108-8078-9b1df56ecc62 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1199 microversion: 2.1 time: 0.703333 Mar 05 20:58:52.361282 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1420/2862] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:51 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1199 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:52.361282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-623cc116-3d76-4417-9333-941e756e668d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:52.361282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-623cc116-3d76-4417-9333-941e756e668d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:52.370163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-623cc116-3d76-4417-9333-941e756e668d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:52.371037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-623cc116-3d76-4417-9333-941e756e668d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:52.372543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-623cc116-3d76-4417-9333-941e756e668d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:52.375492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-623cc116-3d76-4417-9333-941e756e668d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:52.591572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c3471642-d63c-4e1a-9bf8-aa48084b8935 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:52.607871 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c3471642-d63c-4e1a-9bf8-aa48084b8935 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.401324 Mar 05 20:58:52.617501 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1443/2863] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:52 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:52.935261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ac628f21-70a9-4fd1-afc4-2fd179b34efe tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] Action: 'create', calling method: .version_select at 0x7fed4f7a8f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-602581320", "metadata": {"Type": "work"}}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:53.400623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-623cc116-3d76-4417-9333-941e756e668d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:53.414151 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-623cc116-3d76-4417-9333-941e756e668d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1318 microversion: 2.1 time: 1.056509 Mar 05 20:58:53.415353 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1421/2864] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:52 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1318 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:53.428838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e80fb72e-a50d-4823-a808-3cd92e02acc8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:53.429724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e80fb72e-a50d-4823-a808-3cd92e02acc8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:53.442100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e80fb72e-a50d-4823-a808-3cd92e02acc8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:53.442756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e80fb72e-a50d-4823-a808-3cd92e02acc8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:53.443877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e80fb72e-a50d-4823-a808-3cd92e02acc8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:53.444565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e80fb72e-a50d-4823-a808-3cd92e02acc8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:53.663893 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ac628f21-70a9-4fd1-afc4-2fd179b34efe tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.054244 Mar 05 20:58:53.676421 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1444/2865] 10.222.0.15 () {60 vars in 1155 bytes} [Sat Mar 5 20:58:52 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1065 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 05 20:58:53.682272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-effda02f-ade1-4a27-a360-9520337dc904 req-927abfff-eb00-49d8-b8b2-2fec0b70a668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0", "tag": "45250c7d-a9c6-48f1-8ae6-302bb7ba938d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:53.702609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-effda02f-ade1-4a27-a360-9520337dc904 req-927abfff-eb00-49d8-b8b2-2fec0b70a668 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:53.703400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-effda02f-ade1-4a27-a360-9520337dc904 req-927abfff-eb00-49d8-b8b2-2fec0b70a668 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:53.730440 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-effda02f-ade1-4a27-a360-9520337dc904 req-927abfff-eb00-49d8-b8b2-2fec0b70a668 service nova] Creating event network-changed:45250c7d-a9c6-48f1-8ae6-302bb7ba938d for instance 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 on nch1-master-1 Mar 05 20:58:53.743311 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-effda02f-ade1-4a27-a360-9520337dc904 req-927abfff-eb00-49d8-b8b2-2fec0b70a668 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064910 Mar 05 20:58:53.747532 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1445/2866] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:53.760503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9293984d-63e2-4cb1-8e96-5c7ce3561846 req-823fd81a-0086-4dcf-aa56-7275fb5b410f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a6114e-7710-4ccf-b462-bb8c98001725", "name": "network-vif-plugged", "status": "completed", "tag": "f3d55e8e-71fd-427a-9669-f45552929be7"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:53.783523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9293984d-63e2-4cb1-8e96-5c7ce3561846 req-823fd81a-0086-4dcf-aa56-7275fb5b410f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:53.784814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9293984d-63e2-4cb1-8e96-5c7ce3561846 req-823fd81a-0086-4dcf-aa56-7275fb5b410f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:53.819281 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9293984d-63e2-4cb1-8e96-5c7ce3561846 req-823fd81a-0086-4dcf-aa56-7275fb5b410f service nova] Creating event network-vif-plugged:f3d55e8e-71fd-427a-9669-f45552929be7 for instance 00a6114e-7710-4ccf-b462-bb8c98001725 on nch1-master-1 Mar 05 20:58:53.830739 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9293984d-63e2-4cb1-8e96-5c7ce3561846 req-823fd81a-0086-4dcf-aa56-7275fb5b410f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081429 Mar 05 20:58:53.834494 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1446/2867] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:53.843259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a385bc7b-23a6-4b2f-9721-7924caff4ea2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:53.844683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a385bc7b-23a6-4b2f-9721-7924caff4ea2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:53.853400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a385bc7b-23a6-4b2f-9721-7924caff4ea2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:53.864235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a385bc7b-23a6-4b2f-9721-7924caff4ea2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:53.864235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a385bc7b-23a6-4b2f-9721-7924caff4ea2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:53.864235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a385bc7b-23a6-4b2f-9721-7924caff4ea2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:54.592688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a385bc7b-23a6-4b2f-9721-7924caff4ea2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:54.606830 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a385bc7b-23a6-4b2f-9721-7924caff4ea2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1199 microversion: 2.1 time: 0.770637 Mar 05 20:58:54.611808 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1447/2868] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:53 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1199 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:54.625431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7ca193f0-2d41-405b-b31e-fdef55de05d3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:54.632083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7ca193f0-2d41-405b-b31e-fdef55de05d3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:54.646223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e80fb72e-a50d-4823-a808-3cd92e02acc8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:54.669211 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e80fb72e-a50d-4823-a808-3cd92e02acc8 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 1.251163 Mar 05 20:58:54.672319 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1422/2869] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:53 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:54.672706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ca193f0-2d41-405b-b31e-fdef55de05d3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:54.673263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ca193f0-2d41-405b-b31e-fdef55de05d3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:54.676301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ca193f0-2d41-405b-b31e-fdef55de05d3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:54.676775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ca193f0-2d41-405b-b31e-fdef55de05d3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:54.687369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-198b335d-2d42-4327-bf69-496693eefde2 tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] Calling method '.version_select at 0x7fed61b21c10>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:54.849957 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-198b335d-2d42-4327-bf69-496693eefde2 tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e31a6df1-b1e1-425b-a125-603d8f627046" status: 200 len: 346 microversion: 2.1 time: 0.175316 Mar 05 20:58:54.851027 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1423/2870] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:58:54 2022] GET /compute/v2.1/os-volumes/e31a6df1-b1e1-425b-a125-603d8f627046 => generated 346 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:54.856309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6f6dbbd-eef9-440e-bc7e-cb966e0d7e0f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:54.857218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c6f6dbbd-eef9-440e-bc7e-cb966e0d7e0f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:54.879652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6f6dbbd-eef9-440e-bc7e-cb966e0d7e0f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:54.881483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6f6dbbd-eef9-440e-bc7e-cb966e0d7e0f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:54.892474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6f6dbbd-eef9-440e-bc7e-cb966e0d7e0f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:54.893011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6f6dbbd-eef9-440e-bc7e-cb966e0d7e0f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:55.064714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7ca193f0-2d41-405b-b31e-fdef55de05d3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:55.077913 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7ca193f0-2d41-405b-b31e-fdef55de05d3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.462100 Mar 05 20:58:55.078730 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1448/2871] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:54 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:55.099458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-31bfca5e-ecd6-4443-ac57-979f7eefc2a7 tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] Calling method '.version_select at 0x7fed5cdba280>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:55.223281 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-31bfca5e-ecd6-4443-ac57-979f7eefc2a7 tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e31a6df1-b1e1-425b-a125-603d8f627046" status: 200 len: 346 microversion: 2.1 time: 0.143384 Mar 05 20:58:55.223932 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1449/2872] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:58:55 2022] GET /compute/v2.1/os-volumes/e31a6df1-b1e1-425b-a125-603d8f627046 => generated 346 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:55.236035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-83a35718-a0cc-4259-9a4e-b025aedce914 tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] Calling method '.version_select at 0x7fed4f7e4f70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:55.384516 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-83a35718-a0cc-4259-9a4e-b025aedce914 tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/e31a6df1-b1e1-425b-a125-603d8f627046" status: 202 len: 0 microversion: 2.1 time: 0.151779 Mar 05 20:58:55.385129 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1450/2873] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 20:58:55 2022] DELETE /compute/v2.1/os-volumes/e31a6df1-b1e1-425b-a125-603d8f627046 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 20:58:55.394292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e8997701-4e8a-4a57-8194-494ef7588835 tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] Calling method '.version_select at 0x7fed4f7a8e50>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:55.437882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c6f6dbbd-eef9-440e-bc7e-cb966e0d7e0f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:55.445575 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c6f6dbbd-eef9-440e-bc7e-cb966e0d7e0f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1318 microversion: 2.1 time: 0.593244 Mar 05 20:58:55.446172 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1424/2874] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:54 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1318 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:55.490004 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e8997701-4e8a-4a57-8194-494ef7588835 tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e31a6df1-b1e1-425b-a125-603d8f627046" status: 200 len: 345 microversion: 2.1 time: 0.100441 Mar 05 20:58:55.490891 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1451/2875] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:58:55 2022] GET /compute/v2.1/os-volumes/e31a6df1-b1e1-425b-a125-603d8f627046 => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:58:55.628821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7792e20a-842e-4ce5-ac88-3f141cc4a06f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:55.630165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7792e20a-842e-4ce5-ac88-3f141cc4a06f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:55.643056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7792e20a-842e-4ce5-ac88-3f141cc4a06f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:55.644069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7792e20a-842e-4ce5-ac88-3f141cc4a06f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:55.644863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7792e20a-842e-4ce5-ac88-3f141cc4a06f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:55.645299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7792e20a-842e-4ce5-ac88-3f141cc4a06f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:55.695609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3b30f41a-12ad-44c0-bff3-d585625a6f69 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:55.696871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3b30f41a-12ad-44c0-bff3-d585625a6f69 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:55.705213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b30f41a-12ad-44c0-bff3-d585625a6f69 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:55.707411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b30f41a-12ad-44c0-bff3-d585625a6f69 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:55.709947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b30f41a-12ad-44c0-bff3-d585625a6f69 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:55.710706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b30f41a-12ad-44c0-bff3-d585625a6f69 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:56.064119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3b30f41a-12ad-44c0-bff3-d585625a6f69 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:56.075230 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3b30f41a-12ad-44c0-bff3-d585625a6f69 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.389265 Mar 05 20:58:56.081576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7792e20a-842e-4ce5-ac88-3f141cc4a06f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:56.085423 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1452/2876] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:55 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:56.092724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-5f2b6a96-61c7-46de-b968-8ae08c9cb6d6 req-6550cddc-0c2e-476a-a2e9-d702ca7f0688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc23752-0101-4c2b-a90f-6ccad692e3f3", "name": "network-vif-plugged", "status": "completed", "tag": "d89b87d8-65fa-4882-ac07-f0f70c7ec7eb"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:56.093219 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7792e20a-842e-4ce5-ac88-3f141cc4a06f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1199 microversion: 2.1 time: 0.469321 Mar 05 20:58:56.093925 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1425/2877] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:55 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1199 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:56.102599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5f2b6a96-61c7-46de-b968-8ae08c9cb6d6 req-6550cddc-0c2e-476a-a2e9-d702ca7f0688 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:56.103246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5f2b6a96-61c7-46de-b968-8ae08c9cb6d6 req-6550cddc-0c2e-476a-a2e9-d702ca7f0688 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:56.113009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2e17ab0a-b8fe-4a01-a77b-e4e390845f3b tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:56.114932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2e17ab0a-b8fe-4a01-a77b-e4e390845f3b tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:56.127299 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-5f2b6a96-61c7-46de-b968-8ae08c9cb6d6 req-6550cddc-0c2e-476a-a2e9-d702ca7f0688 service nova] Creating event network-vif-plugged:d89b87d8-65fa-4882-ac07-f0f70c7ec7eb for instance dbc23752-0101-4c2b-a90f-6ccad692e3f3 on nch2-master-1 Mar 05 20:58:56.128973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e17ab0a-b8fe-4a01-a77b-e4e390845f3b tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:56.129768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e17ab0a-b8fe-4a01-a77b-e4e390845f3b tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:56.130662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e17ab0a-b8fe-4a01-a77b-e4e390845f3b tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:56.131208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e17ab0a-b8fe-4a01-a77b-e4e390845f3b tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:56.137872 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-5f2b6a96-61c7-46de-b968-8ae08c9cb6d6 req-6550cddc-0c2e-476a-a2e9-d702ca7f0688 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050559 Mar 05 20:58:56.142787 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1453/2878] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:58:56.412985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2e17ab0a-b8fe-4a01-a77b-e4e390845f3b tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:56.425486 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2e17ab0a-b8fe-4a01-a77b-e4e390845f3b tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.325297 Mar 05 20:58:56.435291 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1426/2879] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:56 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:56.465824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-55a4c507-c808-4683-a732-b485fe41034f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:56.466547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-55a4c507-c808-4683-a732-b485fe41034f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:56.473860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55a4c507-c808-4683-a732-b485fe41034f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:56.474633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55a4c507-c808-4683-a732-b485fe41034f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:56.475632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55a4c507-c808-4683-a732-b485fe41034f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:56.476284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55a4c507-c808-4683-a732-b485fe41034f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:56.502502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2b640971-a227-4e1c-91f4-b4401dff4c89 tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] Calling method '.version_select at 0x7fed61b3d4c0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:56.532070 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-2b640971-a227-4e1c-91f4-b4401dff4c89 tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] HTTP exception thrown: Volume e31a6df1-b1e1-425b-a125-603d8f627046 could not be found. Mar 05 20:58:56.532675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2b640971-a227-4e1c-91f4-b4401dff4c89 tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] Returning 404 to user: Volume e31a6df1-b1e1-425b-a125-603d8f627046 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:58:56.533700 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2b640971-a227-4e1c-91f4-b4401dff4c89 tempest-VolumesGetTestJSON-1870238009 tempest-VolumesGetTestJSON-1870238009-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e31a6df1-b1e1-425b-a125-603d8f627046" status: 404 len: 109 microversion: 2.1 time: 0.035305 Mar 05 20:58:56.534291 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1427/2880] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 20:58:56 2022] GET /compute/v2.1/os-volumes/e31a6df1-b1e1-425b-a125-603d8f627046 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:58:56.751902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-55a4c507-c808-4683-a732-b485fe41034f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:56.764816 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-55a4c507-c808-4683-a732-b485fe41034f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1318 microversion: 2.1 time: 0.304477 Mar 05 20:58:56.765486 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1454/2881] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:56 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:56.998069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1474863401", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2fc8a084-d4e7-4698-a078-6f62861cb3e4"}], "security_groups": [{"name": "tempest-securitygroup--1850533364"}], "key_name": "tempest-keypair-1859380118", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:57.092846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e70c111c-660d-4dc8-8dbe-8d2f0e174561 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:57.093957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e70c111c-660d-4dc8-8dbe-8d2f0e174561 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:57.106960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e70c111c-660d-4dc8-8dbe-8d2f0e174561 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:57.108769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e70c111c-660d-4dc8-8dbe-8d2f0e174561 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:57.110795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e70c111c-660d-4dc8-8dbe-8d2f0e174561 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:57.111243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e70c111c-660d-4dc8-8dbe-8d2f0e174561 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:57.178701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] validate_networks() for [('2fc8a084-d4e7-4698-a078-6f62861cb3e4', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:58:57.418830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e70c111c-660d-4dc8-8dbe-8d2f0e174561 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:57.429649 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e70c111c-660d-4dc8-8dbe-8d2f0e174561 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.340785 Mar 05 20:58:57.430899 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1455/2882] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:57 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:57.436315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5a2a3f71-8422-485e-9ba0-39805446b0e7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:57.437230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5a2a3f71-8422-485e-9ba0-39805446b0e7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:57.444649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a2a3f71-8422-485e-9ba0-39805446b0e7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:57.445444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a2a3f71-8422-485e-9ba0-39805446b0e7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:57.446569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a2a3f71-8422-485e-9ba0-39805446b0e7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:57.447343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a2a3f71-8422-485e-9ba0-39805446b0e7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:57.751141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Getting quotas for project 4629462cb9c24128921119298bb0655c. Resources: dict_keys(['metadata_items']) {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:58:57.759936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Getting quotas for user 9443ac1e9d174c70a22e40d844dcae27 and project 4629462cb9c24128921119298bb0655c. Resources: dict_keys(['metadata_items']) {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:58:57.765491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5a2a3f71-8422-485e-9ba0-39805446b0e7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:57.774956 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5a2a3f71-8422-485e-9ba0-39805446b0e7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1199 microversion: 2.1 time: 0.341687 Mar 05 20:58:57.783770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:58:57.784975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:58:57.785920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:58:57.787129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:58:57.787782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:58:57.788164 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1456/2883] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:57 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1199 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:57.794901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0c673bbd-d579-4fbf-808d-15f26f2c853f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:57.796240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0c673bbd-d579-4fbf-808d-15f26f2c853f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:57.806089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c673bbd-d579-4fbf-808d-15f26f2c853f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:57.807158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c673bbd-d579-4fbf-808d-15f26f2c853f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:57.808122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c673bbd-d579-4fbf-808d-15f26f2c853f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:57.808816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c673bbd-d579-4fbf-808d-15f26f2c853f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:57.818592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:57.821294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:57.824318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:57.825044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:57.870076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Getting quotas for project 4629462cb9c24128921119298bb0655c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:58:57.877748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Getting quotas for user 9443ac1e9d174c70a22e40d844dcae27 and project 4629462cb9c24128921119298bb0655c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:58:57.901832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:58:57.913416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:58:57.974628 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b3c57c8b-0324-4dc4-94c3-dbba22ff982e tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.981956 Mar 05 20:58:57.975817 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1428/2884] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:58:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:58:57.980874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b302270f-5a3b-407a-aa0a-c84ff60544a9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:57.982998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b302270f-5a3b-407a-aa0a-c84ff60544a9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:57.990853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b302270f-5a3b-407a-aa0a-c84ff60544a9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:57.991361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b302270f-5a3b-407a-aa0a-c84ff60544a9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:57.992366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b302270f-5a3b-407a-aa0a-c84ff60544a9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:57.994310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b302270f-5a3b-407a-aa0a-c84ff60544a9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:58.162853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0c673bbd-d579-4fbf-808d-15f26f2c853f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:58.173049 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0c673bbd-d579-4fbf-808d-15f26f2c853f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.382393 Mar 05 20:58:58.175262 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1457/2885] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:57 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:58.175899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b302270f-5a3b-407a-aa0a-c84ff60544a9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:58.184994 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b302270f-5a3b-407a-aa0a-c84ff60544a9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1467 microversion: 2.1 time: 0.207859 Mar 05 20:58:58.186002 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1429/2886] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:57 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1467 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:58.201824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1a5e964d-3278-42c4-bdb1-3823a273c101 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:58.203353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-be6dc839-a453-4587-bbcf-aee1a45f5fef tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:58.203969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-be6dc839-a453-4587-bbcf-aee1a45f5fef tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: 00a6114e-7710-4ccf-b462-bb8c98001725] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:58.204763 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1a5e964d-3278-42c4-bdb1-3823a273c101 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:58.218603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be6dc839-a453-4587-bbcf-aee1a45f5fef tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:58.218898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be6dc839-a453-4587-bbcf-aee1a45f5fef tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:58.219712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be6dc839-a453-4587-bbcf-aee1a45f5fef tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:58.220154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be6dc839-a453-4587-bbcf-aee1a45f5fef tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:58.465260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-be6dc839-a453-4587-bbcf-aee1a45f5fef tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:58.479453 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-be6dc839-a453-4587-bbcf-aee1a45f5fef tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725" status: 200 len: 1468 microversion: 2.1 time: 0.279918 Mar 05 20:58:58.480698 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1430/2887] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:58 2022] GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725 => generated 1468 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:58:58.503380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3e061969-fd28-4ebb-897b-fc3f4d1119bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:58.508189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3e061969-fd28-4ebb-897b-fc3f4d1119bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:58.531173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e061969-fd28-4ebb-897b-fc3f4d1119bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:58.531965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e061969-fd28-4ebb-897b-fc3f4d1119bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:58.533039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e061969-fd28-4ebb-897b-fc3f4d1119bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:58.534387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e061969-fd28-4ebb-897b-fc3f4d1119bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:58.753671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3e061969-fd28-4ebb-897b-fc3f4d1119bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:58.764328 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3e061969-fd28-4ebb-897b-fc3f4d1119bb tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.282331 Mar 05 20:58:58.765405 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1431/2888] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:58 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:58.771360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-54c3818b-e54f-473a-bd0d-c962e42f4bb5 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1181824736"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:58:58.772820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-54c3818b-e54f-473a-bd0d-c962e42f4bb5 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: 00a6114e-7710-4ccf-b462-bb8c98001725] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:58.779491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54c3818b-e54f-473a-bd0d-c962e42f4bb5 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:58.780711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54c3818b-e54f-473a-bd0d-c962e42f4bb5 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:58.781618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54c3818b-e54f-473a-bd0d-c962e42f4bb5 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:58.782130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54c3818b-e54f-473a-bd0d-c962e42f4bb5 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:58.873606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1a5e964d-3278-42c4-bdb1-3823a273c101 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:58.883346 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1a5e964d-3278-42c4-bdb1-3823a273c101 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1278 microversion: 2.1 time: 0.706217 Mar 05 20:58:58.884270 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1458/2889] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:58 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1278 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:58.898505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3fae8ad4-7dcf-4729-86fb-46f031baa333 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:58.901381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3fae8ad4-7dcf-4729-86fb-46f031baa333 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:58.918137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fae8ad4-7dcf-4729-86fb-46f031baa333 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:58.918772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fae8ad4-7dcf-4729-86fb-46f031baa333 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:58.919765 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fae8ad4-7dcf-4729-86fb-46f031baa333 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:58.920346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fae8ad4-7dcf-4729-86fb-46f031baa333 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:59.126356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3fae8ad4-7dcf-4729-86fb-46f031baa333 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:59.137153 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3fae8ad4-7dcf-4729-86fb-46f031baa333 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1199 microversion: 2.1 time: 0.245027 Mar 05 20:58:59.148781 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1459/2890] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:58 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1199 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:59.194452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cbe6fa45-2bdb-4ba2-ac4b-4ead1cddf680 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:59.197363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cbe6fa45-2bdb-4ba2-ac4b-4ead1cddf680 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:59.203379 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-54c3818b-e54f-473a-bd0d-c962e42f4bb5 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "POST /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725/action" status: 202 len: 0 microversion: 2.1 time: 0.433025 Mar 05 20:58:59.206785 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1432/2891] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:58:58 2022] POST /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 20:58:59.217950 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cbe6fa45-2bdb-4ba2-ac4b-4ead1cddf680 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:59.219079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cbe6fa45-2bdb-4ba2-ac4b-4ead1cddf680 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:59.224206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8d57f3c2-7803-4a1f-b57b-0afcdbfe77dc tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4ff43790>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:59.235023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cbe6fa45-2bdb-4ba2-ac4b-4ead1cddf680 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:59.237106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cbe6fa45-2bdb-4ba2-ac4b-4ead1cddf680 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:59.320081 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8d57f3c2-7803-4a1f-b57b-0afcdbfe77dc tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.107292 Mar 05 20:58:59.328166 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1433/2892] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:58:59 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:59.551744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cbe6fa45-2bdb-4ba2-ac4b-4ead1cddf680 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:58:59.561502 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cbe6fa45-2bdb-4ba2-ac4b-4ead1cddf680 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.374560 Mar 05 20:58:59.572264 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1460/2893] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:59 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:58:59.789639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8bf9d400-f5b2-49b2-b20f-f18396effdd3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:59.790407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8bf9d400-f5b2-49b2-b20f-f18396effdd3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:59.801858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bf9d400-f5b2-49b2-b20f-f18396effdd3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:59.807622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bf9d400-f5b2-49b2-b20f-f18396effdd3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:59.808968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bf9d400-f5b2-49b2-b20f-f18396effdd3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:59.813587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bf9d400-f5b2-49b2-b20f-f18396effdd3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:59.903830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-09861de8-f87a-41a4-b24c-830171cbb115 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:58:59.904578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-09861de8-f87a-41a4-b24c-830171cbb115 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:58:59.927874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09861de8-f87a-41a4-b24c-830171cbb115 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:59.928560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09861de8-f87a-41a4-b24c-830171cbb115 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:58:59.929538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09861de8-f87a-41a4-b24c-830171cbb115 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:58:59.931374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09861de8-f87a-41a4-b24c-830171cbb115 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:00.083302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-09861de8-f87a-41a4-b24c-830171cbb115 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:00.098620 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-09861de8-f87a-41a4-b24c-830171cbb115 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1336 microversion: 2.1 time: 0.201385 Mar 05 20:59:00.099167 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1461/2894] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:59 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1336 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:00.135767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-911fff8d-2cf7-4554-beb9-f167c6391a85 req-8eaf69df-4543-4b4a-99f7-2afb7f271353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0", "name": "network-vif-plugged", "status": "completed", "tag": "45250c7d-a9c6-48f1-8ae6-302bb7ba938d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:00.165100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-911fff8d-2cf7-4554-beb9-f167c6391a85 req-8eaf69df-4543-4b4a-99f7-2afb7f271353 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:00.167039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-911fff8d-2cf7-4554-beb9-f167c6391a85 req-8eaf69df-4543-4b4a-99f7-2afb7f271353 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:00.200060 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-911fff8d-2cf7-4554-beb9-f167c6391a85 req-8eaf69df-4543-4b4a-99f7-2afb7f271353 service nova] Creating event network-vif-plugged:45250c7d-a9c6-48f1-8ae6-302bb7ba938d for instance 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 on nch1-master-1 Mar 05 20:59:00.216687 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-911fff8d-2cf7-4554-beb9-f167c6391a85 req-8eaf69df-4543-4b4a-99f7-2afb7f271353 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084781 Mar 05 20:59:00.219943 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1462/2895] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:00.234048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-009fe029-a792-42da-9d4f-64123503ff23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:00.239264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-009fe029-a792-42da-9d4f-64123503ff23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:00.255421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-009fe029-a792-42da-9d4f-64123503ff23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:00.258939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-009fe029-a792-42da-9d4f-64123503ff23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:00.265048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-009fe029-a792-42da-9d4f-64123503ff23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:00.265945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-009fe029-a792-42da-9d4f-64123503ff23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:00.614865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-009fe029-a792-42da-9d4f-64123503ff23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:00.636835 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-009fe029-a792-42da-9d4f-64123503ff23 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1199 microversion: 2.1 time: 0.415399 Mar 05 20:59:00.639996 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1463/2896] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:00 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1199 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:00.653746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-da2d2a66-05d9-4ae4-acdd-3c5d8869a029 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f78a430>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:00.774581 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-da2d2a66-05d9-4ae4-acdd-3c5d8869a029 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.126376 Mar 05 20:59:00.780459 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1464/2897] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:00 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:00.809713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-228138b1-e1b4-4215-aa5b-deba25cf1785 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:00.810774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-228138b1-e1b4-4215-aa5b-deba25cf1785 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:00.826015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-228138b1-e1b4-4215-aa5b-deba25cf1785 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:00.828657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-228138b1-e1b4-4215-aa5b-deba25cf1785 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:00.829530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-228138b1-e1b4-4215-aa5b-deba25cf1785 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:00.829987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-228138b1-e1b4-4215-aa5b-deba25cf1785 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:00.991067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8bf9d400-f5b2-49b2-b20f-f18396effdd3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:01.000745 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8bf9d400-f5b2-49b2-b20f-f18396effdd3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 1.220875 Mar 05 20:59:01.001375 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1434/2898] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:58:59 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:01.117785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8752b982-7bdf-48a0-b68f-6f03ab11efbb tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:01.118695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8752b982-7bdf-48a0-b68f-6f03ab11efbb tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:01.132461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8752b982-7bdf-48a0-b68f-6f03ab11efbb tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:01.139811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8752b982-7bdf-48a0-b68f-6f03ab11efbb tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:01.140808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8752b982-7bdf-48a0-b68f-6f03ab11efbb tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:01.141367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8752b982-7bdf-48a0-b68f-6f03ab11efbb tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:01.566958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8752b982-7bdf-48a0-b68f-6f03ab11efbb tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:01.575279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-228138b1-e1b4-4215-aa5b-deba25cf1785 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:01.586352 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8752b982-7bdf-48a0-b68f-6f03ab11efbb tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1404 microversion: 2.1 time: 0.471825 Mar 05 20:59:01.589834 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1435/2899] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:01 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:01.603975 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-228138b1-e1b4-4215-aa5b-deba25cf1785 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1524 microversion: 2.1 time: 0.811998 Mar 05 20:59:01.605710 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1465/2900] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:00 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1524 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:01.658204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4f55b22f-98cc-44a9-b6b2-e203f2d40ef7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:01.659901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4f55b22f-98cc-44a9-b6b2-e203f2d40ef7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:01.673424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f55b22f-98cc-44a9-b6b2-e203f2d40ef7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:01.674968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f55b22f-98cc-44a9-b6b2-e203f2d40ef7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:01.675930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f55b22f-98cc-44a9-b6b2-e203f2d40ef7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:01.676374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f55b22f-98cc-44a9-b6b2-e203f2d40ef7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:01.793886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5ac997d2-c421-4718-9285-6499d8717a59 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f7be160>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:01.862152 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5ac997d2-c421-4718-9285-6499d8717a59 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.072279 Mar 05 20:59:01.863374 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1466/2901] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:01 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:01.924531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4f55b22f-98cc-44a9-b6b2-e203f2d40ef7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:01.932572 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4f55b22f-98cc-44a9-b6b2-e203f2d40ef7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1199 microversion: 2.1 time: 0.279178 Mar 05 20:59:01.933522 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1436/2902] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:01 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1199 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:02.018636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5923b3bc-f1af-4ae9-8de3-56b9f666ceb0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:02.019265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5923b3bc-f1af-4ae9-8de3-56b9f666ceb0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:02.025789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5923b3bc-f1af-4ae9-8de3-56b9f666ceb0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:02.026501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5923b3bc-f1af-4ae9-8de3-56b9f666ceb0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:02.027287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5923b3bc-f1af-4ae9-8de3-56b9f666ceb0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:02.027753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5923b3bc-f1af-4ae9-8de3-56b9f666ceb0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:02.607766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7d9767c2-dc10-445d-9260-54bde555fc98 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:02.609413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7d9767c2-dc10-445d-9260-54bde555fc98 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:02.628492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d9767c2-dc10-445d-9260-54bde555fc98 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:02.629330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d9767c2-dc10-445d-9260-54bde555fc98 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:02.631260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d9767c2-dc10-445d-9260-54bde555fc98 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:02.634862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d9767c2-dc10-445d-9260-54bde555fc98 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:02.765156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5923b3bc-f1af-4ae9-8de3-56b9f666ceb0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:02.776178 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5923b3bc-f1af-4ae9-8de3-56b9f666ceb0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.761478 Mar 05 20:59:02.788024 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1467/2903] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:02 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:02.800978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bb3745da-c1d9-40d0-9a0c-6a46fac87308 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:02.801644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bb3745da-c1d9-40d0-9a0c-6a46fac87308 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:02.815360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb3745da-c1d9-40d0-9a0c-6a46fac87308 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:02.817294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb3745da-c1d9-40d0-9a0c-6a46fac87308 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:02.824685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb3745da-c1d9-40d0-9a0c-6a46fac87308 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:02.825306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb3745da-c1d9-40d0-9a0c-6a46fac87308 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:02.941556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7d9767c2-dc10-445d-9260-54bde555fc98 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:02.954662 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7d9767c2-dc10-445d-9260-54bde555fc98 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1404 microversion: 2.1 time: 0.352389 Mar 05 20:59:02.956255 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1437/2904] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:02 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1404 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:59:02.967107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-37e9d262-e98c-49dc-84dc-96e170503a55 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a5fd30>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:03.021638 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-37e9d262-e98c-49dc-84dc-96e170503a55 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.063827 Mar 05 20:59:03.022235 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1438/2905] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:02 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:03.033344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d30dac8c-243f-4c1c-b7d3-31119c93f711 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:03.034204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d30dac8c-243f-4c1c-b7d3-31119c93f711 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:03.041428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d30dac8c-243f-4c1c-b7d3-31119c93f711 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:03.042146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d30dac8c-243f-4c1c-b7d3-31119c93f711 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:03.043310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d30dac8c-243f-4c1c-b7d3-31119c93f711 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:03.044457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d30dac8c-243f-4c1c-b7d3-31119c93f711 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:03.241264 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d30dac8c-243f-4c1c-b7d3-31119c93f711 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:03.251175 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d30dac8c-243f-4c1c-b7d3-31119c93f711 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1382 microversion: 2.1 time: 0.221768 Mar 05 20:59:03.253229 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1439/2906] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:03 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1382 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:03.276476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0242aab2-9cb2-490f-a89c-0f2177524ef6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:03.277126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0242aab2-9cb2-490f-a89c-0f2177524ef6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:03.285355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0242aab2-9cb2-490f-a89c-0f2177524ef6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:03.286574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0242aab2-9cb2-490f-a89c-0f2177524ef6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:03.287644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0242aab2-9cb2-490f-a89c-0f2177524ef6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:03.288563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0242aab2-9cb2-490f-a89c-0f2177524ef6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:03.368274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb3745da-c1d9-40d0-9a0c-6a46fac87308 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:03.379762 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bb3745da-c1d9-40d0-9a0c-6a46fac87308 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1504 microversion: 2.1 time: 0.590481 Mar 05 20:59:03.380385 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1468/2907] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:02 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1504 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:03.397813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-96d57d48-2986-472d-a5e8-1ce725cc1672 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Action: 'create', calling method: .version_select at 0x7fed4f7b8940>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-829011814", "description": "tempest-description-26324071"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:03.497973 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0242aab2-9cb2-490f-a89c-0f2177524ef6 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1533 microversion: 2.1 time: 0.228439 Mar 05 20:59:03.498930 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1440/2908] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:03 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1533 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:03.522016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4da29d94-44d5-48bf-b61b-879f2462235d tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:03.523223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4da29d94-44d5-48bf-b61b-879f2462235d tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:03.531711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4da29d94-44d5-48bf-b61b-879f2462235d tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:03.532565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4da29d94-44d5-48bf-b61b-879f2462235d tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:03.534007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4da29d94-44d5-48bf-b61b-879f2462235d tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:03.534791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4da29d94-44d5-48bf-b61b-879f2462235d tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:03.830916 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4da29d94-44d5-48bf-b61b-879f2462235d tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1533 microversion: 2.1 time: 0.318166 Mar 05 20:59:03.845712 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1441/2909] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:03 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1533 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:59:03.864205 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-96d57d48-2986-472d-a5e8-1ce725cc1672 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.470774 Mar 05 20:59:03.872492 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1469/2910] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 20:59:03 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:03.879370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-009c383f-eb22-4db0-a58a-1a20dc1b5546 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:03.880171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-009c383f-eb22-4db0-a58a-1a20dc1b5546 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:03.897635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-009c383f-eb22-4db0-a58a-1a20dc1b5546 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:03.901300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-009c383f-eb22-4db0-a58a-1a20dc1b5546 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:03.903125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-009c383f-eb22-4db0-a58a-1a20dc1b5546 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:03.905305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-009c383f-eb22-4db0-a58a-1a20dc1b5546 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:04.253088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-3da5e547-ecaf-41ff-810d-699a0b6927aa req-064e6137-e01c-4dae-8e6d-6a9d842c1b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "827e53bd-cd06-4f93-8232-243003d885f4", "tag": "d8af58c4-4388-479a-9490-64f82575af6b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:04.267357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3da5e547-ecaf-41ff-810d-699a0b6927aa req-064e6137-e01c-4dae-8e6d-6a9d842c1b5a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:04.271013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3da5e547-ecaf-41ff-810d-699a0b6927aa req-064e6137-e01c-4dae-8e6d-6a9d842c1b5a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:04.304660 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-3da5e547-ecaf-41ff-810d-699a0b6927aa req-064e6137-e01c-4dae-8e6d-6a9d842c1b5a service nova] Creating event network-changed:d8af58c4-4388-479a-9490-64f82575af6b for instance 827e53bd-cd06-4f93-8232-243003d885f4 on nch2-master-1 Mar 05 20:59:04.313162 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-3da5e547-ecaf-41ff-810d-699a0b6927aa req-064e6137-e01c-4dae-8e6d-6a9d842c1b5a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.464982 Mar 05 20:59:04.314197 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1442/2911] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:04.326230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9ec68a0c-2830-4e31-b223-b5ed90da9bbb tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:04.330094 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 20:59:04.330094 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 20:59:04.334462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ec68a0c-2830-4e31-b223-b5ed90da9bbb tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:04.335217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ec68a0c-2830-4e31-b223-b5ed90da9bbb tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:04.336587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ec68a0c-2830-4e31-b223-b5ed90da9bbb tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:04.337929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ec68a0c-2830-4e31-b223-b5ed90da9bbb tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:04.403016 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9ec68a0c-2830-4e31-b223-b5ed90da9bbb tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.085016 Mar 05 20:59:04.404559 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1443/2912] 10.222.0.15 () {58 vars in 1175 bytes} [Sat Mar 5 20:59:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:04.415260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-287f57de-469e-4fb4-8531-26c41f5242bc tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-829011814"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:04.417318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-287f57de-469e-4fb4-8531-26c41f5242bc tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:04.421036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-009c383f-eb22-4db0-a58a-1a20dc1b5546 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:04.431226 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-009c383f-eb22-4db0-a58a-1a20dc1b5546 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.557495 Mar 05 20:59:04.435632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-287f57de-469e-4fb4-8531-26c41f5242bc tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:04.436391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-287f57de-469e-4fb4-8531-26c41f5242bc tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:04.437293 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1470/2913] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:03 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:04.442196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-287f57de-469e-4fb4-8531-26c41f5242bc tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:04.442667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-287f57de-469e-4fb4-8531-26c41f5242bc tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:04.459933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e6b1c998-f90d-4a67-b772-1daa5209d3aa tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:04.460573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e6b1c998-f90d-4a67-b772-1daa5209d3aa tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:04.480670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6b1c998-f90d-4a67-b772-1daa5209d3aa tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:04.481129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6b1c998-f90d-4a67-b772-1daa5209d3aa tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:04.481919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6b1c998-f90d-4a67-b772-1daa5209d3aa tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:04.482362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6b1c998-f90d-4a67-b772-1daa5209d3aa tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:04.885870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e6b1c998-f90d-4a67-b772-1daa5209d3aa tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:04.907290 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e6b1c998-f90d-4a67-b772-1daa5209d3aa tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1404 microversion: 2.1 time: 0.464411 Mar 05 20:59:04.908852 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1471/2914] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:04 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:04.917975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-38c4b224-09d2-4814-a0a6-df19a05fa9a4 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f89b8b0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:04.965507 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.network.security_group_api [None req-287f57de-469e-4fb4-8531-26c41f5242bc tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Adding security group e85ca656-444f-41fd-9e38-4812df95ceb5 to port 8fc25781-cd23-40fb-843d-506a3fbd00cf Mar 05 20:59:05.031971 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-38c4b224-09d2-4814-a0a6-df19a05fa9a4 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.120787 Mar 05 20:59:05.043507 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1472/2915] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:04 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:05.233757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b5ecd205-78be-4ed8-9c5f-64d282aa9907 req-265b9ad2-2afd-4373-be02-98da03ce6b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a6114e-7710-4ccf-b462-bb8c98001725", "name": "network-vif-plugged", "status": "completed", "tag": "f3d55e8e-71fd-427a-9669-f45552929be7"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:05.252185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b5ecd205-78be-4ed8-9c5f-64d282aa9907 req-265b9ad2-2afd-4373-be02-98da03ce6b4a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:05.253714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b5ecd205-78be-4ed8-9c5f-64d282aa9907 req-265b9ad2-2afd-4373-be02-98da03ce6b4a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:05.286293 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b5ecd205-78be-4ed8-9c5f-64d282aa9907 req-265b9ad2-2afd-4373-be02-98da03ce6b4a service nova] Creating event network-vif-plugged:f3d55e8e-71fd-427a-9669-f45552929be7 for instance 00a6114e-7710-4ccf-b462-bb8c98001725 on nch1-master-1 Mar 05 20:59:05.302246 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b5ecd205-78be-4ed8-9c5f-64d282aa9907 req-265b9ad2-2afd-4373-be02-98da03ce6b4a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256367 Mar 05 20:59:05.303200 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1473/2916] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:05.316787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a112856c-94c2-41ab-a071-ff3ca50138df tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:05.318098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a112856c-94c2-41ab-a071-ff3ca50138df tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:05.333665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a112856c-94c2-41ab-a071-ff3ca50138df tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:05.338373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a112856c-94c2-41ab-a071-ff3ca50138df tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:05.339628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a112856c-94c2-41ab-a071-ff3ca50138df tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:05.340270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a112856c-94c2-41ab-a071-ff3ca50138df tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:05.386997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-a112856c-94c2-41ab-a071-ff3ca50138df tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lazy-loading 'flavor' on Instance uuid 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:59:05.413520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a112856c-94c2-41ab-a071-ff3ca50138df tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Going to try to live migrate instance to nch2-master-1 {{(pid=141479) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 05 20:59:05.768708 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-287f57de-469e-4fb4-8531-26c41f5242bc tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "POST /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce/action" status: 202 len: 0 microversion: 2.1 time: 1.360202 Mar 05 20:59:05.772340 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1444/2917] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:59:04 2022] POST /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce/action => generated 0 bytes in 1363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:59:05.777074 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-90f4e7f4-fa5a-4ae8-a451-fc5a808ff2c7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:05.778477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-90f4e7f4-fa5a-4ae8-a451-fc5a808ff2c7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:05.798813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90f4e7f4-fa5a-4ae8-a451-fc5a808ff2c7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:05.803939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90f4e7f4-fa5a-4ae8-a451-fc5a808ff2c7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:05.805546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90f4e7f4-fa5a-4ae8-a451-fc5a808ff2c7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:05.806186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90f4e7f4-fa5a-4ae8-a451-fc5a808ff2c7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:06.084873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-90f4e7f4-fa5a-4ae8-a451-fc5a808ff2c7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:06.094800 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-90f4e7f4-fa5a-4ae8-a451-fc5a808ff2c7 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.323745 Mar 05 20:59:06.107322 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1445/2918] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:05 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:06.114548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9b3ca959-875d-4ca8-b1c1-2c7cfce94edb tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-829011814"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:06.115534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9b3ca959-875d-4ca8-b1c1-2c7cfce94edb tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:06.126783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b3ca959-875d-4ca8-b1c1-2c7cfce94edb tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:06.127943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b3ca959-875d-4ca8-b1c1-2c7cfce94edb tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:06.128945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b3ca959-875d-4ca8-b1c1-2c7cfce94edb tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:06.129843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b3ca959-875d-4ca8-b1c1-2c7cfce94edb tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:06.415220 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.network.security_group_api [None req-9b3ca959-875d-4ca8-b1c1-2c7cfce94edb tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Removing security group e85ca656-444f-41fd-9e38-4812df95ceb5 from port 8fc25781-cd23-40fb-843d-506a3fbd00cf Mar 05 20:59:07.330677 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9b3ca959-875d-4ca8-b1c1-2c7cfce94edb tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "POST /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce/action" status: 202 len: 0 microversion: 2.1 time: 1.220573 Mar 05 20:59:07.331401 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1446/2919] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:59:06 2022] POST /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce/action => generated 0 bytes in 1223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:59:07.664704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-adf629ec-3191-4698-844f-91e52a7c701d req-a9eff83a-9f43-49d5-9640-e7f161d87cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23279b59-495b-4264-8d6c-33d6143418ce", "tag": "8fc25781-cd23-40fb-843d-506a3fbd00cf"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:07.689058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-adf629ec-3191-4698-844f-91e52a7c701d req-a9eff83a-9f43-49d5-9640-e7f161d87cbd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:07.694474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-adf629ec-3191-4698-844f-91e52a7c701d req-a9eff83a-9f43-49d5-9640-e7f161d87cbd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:07.734419 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-adf629ec-3191-4698-844f-91e52a7c701d req-a9eff83a-9f43-49d5-9640-e7f161d87cbd service nova] Creating event network-changed:8fc25781-cd23-40fb-843d-506a3fbd00cf for instance 23279b59-495b-4264-8d6c-33d6143418ce on nch2-master-1 Mar 05 20:59:07.742067 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-adf629ec-3191-4698-844f-91e52a7c701d req-a9eff83a-9f43-49d5-9640-e7f161d87cbd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.404924 Mar 05 20:59:07.742897 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1447/2920] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:07.750011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-13dd203a-f9c8-4b56-a0a6-889f9700d914 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:07.751176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-13dd203a-f9c8-4b56-a0a6-889f9700d914 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:07.758923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13dd203a-f9c8-4b56-a0a6-889f9700d914 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:07.759798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13dd203a-f9c8-4b56-a0a6-889f9700d914 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:07.760841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13dd203a-f9c8-4b56-a0a6-889f9700d914 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:07.761553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13dd203a-f9c8-4b56-a0a6-889f9700d914 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:08.161184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-13dd203a-f9c8-4b56-a0a6-889f9700d914 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:08.171264 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-13dd203a-f9c8-4b56-a0a6-889f9700d914 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1404 microversion: 2.1 time: 0.425080 Mar 05 20:59:08.172220 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1448/2921] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:07 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:08.177100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ffde15df-ce09-4626-af2e-395a7396a122 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61b54e50>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:08.260664 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ffde15df-ce09-4626-af2e-395a7396a122 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.087218 Mar 05 20:59:08.261263 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1449/2922] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:08 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:08.269303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b2982d52-0bcb-4594-afff-f9ad01e7c520 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:08.269917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b2982d52-0bcb-4594-afff-f9ad01e7c520 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:08.278434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2982d52-0bcb-4594-afff-f9ad01e7c520 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:08.290694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2982d52-0bcb-4594-afff-f9ad01e7c520 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:08.292791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2982d52-0bcb-4594-afff-f9ad01e7c520 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:08.294044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2982d52-0bcb-4594-afff-f9ad01e7c520 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:08.317757 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a112856c-94c2-41ab-a071-ff3ca50138df tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0/action" status: 202 len: 0 microversion: 2.1 time: 3.013011 Mar 05 20:59:08.318998 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1474/2923] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:59:05 2022] POST /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0/action => generated 0 bytes in 3015 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:59:08.324571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-27a06734-a185-4f59-aef9-f7f52fe3046f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Action: 'create', calling method: .version_select at 0x7fed4f74b3a0>, body: {"pool": null} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:08.664473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b2982d52-0bcb-4594-afff-f9ad01e7c520 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:08.678786 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b2982d52-0bcb-4594-afff-f9ad01e7c520 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.416190 Mar 05 20:59:08.681576 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1450/2924] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:08 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:08.696227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-65f64549-db12-4008-b1f3-55b9783bbb94 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:08.697833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-65f64549-db12-4008-b1f3-55b9783bbb94 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:08.710664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65f64549-db12-4008-b1f3-55b9783bbb94 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:08.715339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65f64549-db12-4008-b1f3-55b9783bbb94 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:08.719963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65f64549-db12-4008-b1f3-55b9783bbb94 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:08.722292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65f64549-db12-4008-b1f3-55b9783bbb94 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:09.123154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-65f64549-db12-4008-b1f3-55b9783bbb94 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:09.132474 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-65f64549-db12-4008-b1f3-55b9783bbb94 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1392 microversion: 2.1 time: 0.448949 Mar 05 20:59:09.133073 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1451/2925] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:08 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1392 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:09.191397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-988168eb-0b8f-4e40-beeb-ac774f030e8d tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:09.192571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-988168eb-0b8f-4e40-beeb-ac774f030e8d tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:09.206763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-988168eb-0b8f-4e40-beeb-ac774f030e8d tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:09.208942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-988168eb-0b8f-4e40-beeb-ac774f030e8d tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:09.211662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-988168eb-0b8f-4e40-beeb-ac774f030e8d tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:09.213005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-988168eb-0b8f-4e40-beeb-ac774f030e8d tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:09.729955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-988168eb-0b8f-4e40-beeb-ac774f030e8d tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:09.743460 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-988168eb-0b8f-4e40-beeb-ac774f030e8d tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1404 microversion: 2.1 time: 0.558447 Mar 05 20:59:09.754325 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1452/2926] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:09 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1404 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:59:09.763799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-69621bf3-1e66-4154-a29f-f34d42e074f3 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61ab33a0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:09.869567 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-69621bf3-1e66-4154-a29f-f34d42e074f3 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.113421 Mar 05 20:59:09.870251 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1453/2927] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:09 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:09.885143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0e373fdb-c5ff-4c16-9e0f-e1b6c339a10d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:09.886058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0e373fdb-c5ff-4c16-9e0f-e1b6c339a10d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:09.894402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e373fdb-c5ff-4c16-9e0f-e1b6c339a10d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:09.895888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e373fdb-c5ff-4c16-9e0f-e1b6c339a10d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:09.897138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e373fdb-c5ff-4c16-9e0f-e1b6c339a10d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:09.897821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e373fdb-c5ff-4c16-9e0f-e1b6c339a10d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:10.217466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0e373fdb-c5ff-4c16-9e0f-e1b6c339a10d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:10.232203 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0e373fdb-c5ff-4c16-9e0f-e1b6c339a10d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.360523 Mar 05 20:59:10.244468 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1454/2928] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:09 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:10.262772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-0513bd01-a7f4-4f90-9469-5c309c4634c5 req-bb14d208-2483-4404-ad0b-691cb80af822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23279b59-495b-4264-8d6c-33d6143418ce", "tag": "8fc25781-cd23-40fb-843d-506a3fbd00cf"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:10.295035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-0513bd01-a7f4-4f90-9469-5c309c4634c5 req-bb14d208-2483-4404-ad0b-691cb80af822 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:10.295924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-0513bd01-a7f4-4f90-9469-5c309c4634c5 req-bb14d208-2483-4404-ad0b-691cb80af822 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:10.334747 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-0513bd01-a7f4-4f90-9469-5c309c4634c5 req-bb14d208-2483-4404-ad0b-691cb80af822 service nova] Creating event network-changed:8fc25781-cd23-40fb-843d-506a3fbd00cf for instance 23279b59-495b-4264-8d6c-33d6143418ce on nch2-master-1 Mar 05 20:59:10.351702 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-0513bd01-a7f4-4f90-9469-5c309c4634c5 req-bb14d208-2483-4404-ad0b-691cb80af822 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105360 Mar 05 20:59:10.352764 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1455/2929] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:10.392799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7b329905-ff1b-4ff7-a2e2-ba9b332a5e2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:10.396057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7b329905-ff1b-4ff7-a2e2-ba9b332a5e2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:10.412537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b329905-ff1b-4ff7-a2e2-ba9b332a5e2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:10.413484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b329905-ff1b-4ff7-a2e2-ba9b332a5e2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:10.414424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b329905-ff1b-4ff7-a2e2-ba9b332a5e2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:10.414998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b329905-ff1b-4ff7-a2e2-ba9b332a5e2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:11.090069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7b329905-ff1b-4ff7-a2e2-ba9b332a5e2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:11.106435 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7b329905-ff1b-4ff7-a2e2-ba9b332a5e2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1392 microversion: 2.1 time: 0.748522 Mar 05 20:59:11.107211 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1456/2930] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:10 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1392 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:11.113168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-fb373d35-e8bc-4904-b9cc-f6dd4b252ace req-e3a56406-6dce-4cf7-9e23-45f09b8dccfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827e53bd-cd06-4f93-8232-243003d885f4", "name": "network-vif-plugged", "status": "completed", "tag": "d8af58c4-4388-479a-9490-64f82575af6b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:11.129542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-fb373d35-e8bc-4904-b9cc-f6dd4b252ace req-e3a56406-6dce-4cf7-9e23-45f09b8dccfd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:11.132237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-fb373d35-e8bc-4904-b9cc-f6dd4b252ace req-e3a56406-6dce-4cf7-9e23-45f09b8dccfd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:11.165676 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-fb373d35-e8bc-4904-b9cc-f6dd4b252ace req-e3a56406-6dce-4cf7-9e23-45f09b8dccfd service nova] Creating event network-vif-plugged:d8af58c4-4388-479a-9490-64f82575af6b for instance 827e53bd-cd06-4f93-8232-243003d885f4 on nch2-master-1 Mar 05 20:59:11.186831 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-fb373d35-e8bc-4904-b9cc-f6dd4b252ace req-e3a56406-6dce-4cf7-9e23-45f09b8dccfd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072761 Mar 05 20:59:11.187927 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1457/2931] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:11.208175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f12631ad-c836-4308-8aee-75678dac47b1 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:11.210515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f12631ad-c836-4308-8aee-75678dac47b1 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:11.232505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f12631ad-c836-4308-8aee-75678dac47b1 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:11.239825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f12631ad-c836-4308-8aee-75678dac47b1 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:11.247323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f12631ad-c836-4308-8aee-75678dac47b1 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:11.250923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f12631ad-c836-4308-8aee-75678dac47b1 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:11.581513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f12631ad-c836-4308-8aee-75678dac47b1 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:11.597442 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f12631ad-c836-4308-8aee-75678dac47b1 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1404 microversion: 2.1 time: 0.406332 Mar 05 20:59:11.599183 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1458/2932] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:11 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:11.613737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dd9d6ffa-eea9-4865-b66c-db618de7d3bd tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61b90280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:11.696818 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dd9d6ffa-eea9-4865-b66c-db618de7d3bd tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.096063 Mar 05 20:59:11.697758 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1459/2933] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:11 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:11.706837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8eb69708-6222-476e-babe-caf1c363dee3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:11.708198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8eb69708-6222-476e-babe-caf1c363dee3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:11.718426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8eb69708-6222-476e-babe-caf1c363dee3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:11.718896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8eb69708-6222-476e-babe-caf1c363dee3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:11.720246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8eb69708-6222-476e-babe-caf1c363dee3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:11.720860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8eb69708-6222-476e-babe-caf1c363dee3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:11.994158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8eb69708-6222-476e-babe-caf1c363dee3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:12.003734 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8eb69708-6222-476e-babe-caf1c363dee3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1512 microversion: 2.1 time: 0.302971 Mar 05 20:59:12.004757 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1460/2934] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:11 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:12.306761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ed6cbbcb-2e53-4760-9273-64fa960ee6b2 tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] Action: 'create', calling method: .version_select at 0x7fed61b301f0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:12.350746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ed6cbbcb-2e53-4760-9273-64fa960ee6b2 tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] Getting quotas for project 3637b3fbb8b14825a26f86beb406b93f. Resources: {'server_groups'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:59:12.363482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ed6cbbcb-2e53-4760-9273-64fa960ee6b2 tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] Getting quotas for user 8865d7c1481044789cbdb593341d3562 and project 3637b3fbb8b14825a26f86beb406b93f. Resources: {'server_groups'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:59:12.427068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ed6cbbcb-2e53-4760-9273-64fa960ee6b2 tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] Getting quotas for project 3637b3fbb8b14825a26f86beb406b93f. Resources: {'server_groups'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:59:12.433173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ed6cbbcb-2e53-4760-9273-64fa960ee6b2 tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] Getting quotas for user 8865d7c1481044789cbdb593341d3562 and project 3637b3fbb8b14825a26f86beb406b93f. Resources: {'server_groups'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:59:12.448905 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ed6cbbcb-2e53-4760-9273-64fa960ee6b2 tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] 10.222.0.15 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.442918 Mar 05 20:59:12.455140 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1461/2935] 10.222.0.15 () {62 vars in 1213 bytes} [Sat Mar 5 20:59:12 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:59:12.460555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-35fd7d7b-0d6c-4f78-9d7e-ebe563034a2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:12.461370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-35fd7d7b-0d6c-4f78-9d7e-ebe563034a2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:12.468335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35fd7d7b-0d6c-4f78-9d7e-ebe563034a2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:12.468991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35fd7d7b-0d6c-4f78-9d7e-ebe563034a2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:12.469967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35fd7d7b-0d6c-4f78-9d7e-ebe563034a2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:12.470419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35fd7d7b-0d6c-4f78-9d7e-ebe563034a2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:12.672089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-35fd7d7b-0d6c-4f78-9d7e-ebe563034a2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:12.682118 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-35fd7d7b-0d6c-4f78-9d7e-ebe563034a2d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1392 microversion: 2.1 time: 0.225462 Mar 05 20:59:12.683222 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1462/2936] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:12 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1392 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:12.689456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-475eadc7-f0fc-49cf-8f09-39dec9d97161 tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:12.700352 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-475eadc7-f0fc-49cf-8f09-39dec9d97161 tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] 10.222.0.15 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.015584 Mar 05 20:59:12.701976 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1463/2937] 10.222.0.15 () {60 vars in 1192 bytes} [Sat Mar 5 20:59:12 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:59:12.714019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7189454d-c657-43a0-a5bc-72faabcb11ce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:12.715290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7189454d-c657-43a0-a5bc-72faabcb11ce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:12.723306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7189454d-c657-43a0-a5bc-72faabcb11ce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:12.724904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7189454d-c657-43a0-a5bc-72faabcb11ce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:12.725891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7189454d-c657-43a0-a5bc-72faabcb11ce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:12.727100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7189454d-c657-43a0-a5bc-72faabcb11ce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:13.112710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7189454d-c657-43a0-a5bc-72faabcb11ce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:13.121655 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7189454d-c657-43a0-a5bc-72faabcb11ce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1404 microversion: 2.1 time: 0.412176 Mar 05 20:59:13.124241 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1464/2938] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:12 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:13.134988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ef1edc5c-baff-436b-b02f-03552e7c91b1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a9d940>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:13.217653 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ef1edc5c-baff-436b-b02f-03552e7c91b1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.086749 Mar 05 20:59:13.229723 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1465/2939] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:13 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:13.255308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1f8dda82-9b9e-42b1-a718-cec62cd7d57f tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:13.280155 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1f8dda82-9b9e-42b1-a718-cec62cd7d57f tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] 10.222.0.15 "GET /compute/v2.1/os-server-groups/b7a584c8-fac5-44ab-8b9d-3f805b09d000" status: 200 len: 235 microversion: 2.64 time: 0.047327 Mar 05 20:59:13.282540 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1466/2940] 10.222.0.15 () {60 vars in 1303 bytes} [Sat Mar 5 20:59:13 2022] GET /compute/v2.1/os-server-groups/b7a584c8-fac5-44ab-8b9d-3f805b09d000 => generated 235 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 20:59:13.294273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fe055f69-9d2d-4784-8ea9-cc54d8c17ca5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:13.296171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fe055f69-9d2d-4784-8ea9-cc54d8c17ca5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:13.309981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe055f69-9d2d-4784-8ea9-cc54d8c17ca5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:13.311116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe055f69-9d2d-4784-8ea9-cc54d8c17ca5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:13.312323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe055f69-9d2d-4784-8ea9-cc54d8c17ca5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:13.313000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe055f69-9d2d-4784-8ea9-cc54d8c17ca5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:13.675652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fe055f69-9d2d-4784-8ea9-cc54d8c17ca5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:13.683562 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fe055f69-9d2d-4784-8ea9-cc54d8c17ca5 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1489 microversion: 2.1 time: 0.398926 Mar 05 20:59:13.688470 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1467/2941] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:13 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1489 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:13.704015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d2acd151-0e4a-4a57-b126-beaabcc9731e tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:13.752345 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d2acd151-0e4a-4a57-b126-beaabcc9731e tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] 10.222.0.15 "DELETE /compute/v2.1/os-server-groups/b7a584c8-fac5-44ab-8b9d-3f805b09d000" status: 204 len: 0 microversion: 2.64 time: 0.062198 Mar 05 20:59:13.753896 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1468/2942] 10.222.0.15 () {60 vars in 1306 bytes} [Sat Mar 5 20:59:13 2022] DELETE /compute/v2.1/os-server-groups/b7a584c8-fac5-44ab-8b9d-3f805b09d000 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 20:59:13.762446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-097a0323-f260-4d73-be4d-accda97893e3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:13.763845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-097a0323-f260-4d73-be4d-accda97893e3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:13.775054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-097a0323-f260-4d73-be4d-accda97893e3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:13.776383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-097a0323-f260-4d73-be4d-accda97893e3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:13.777417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-097a0323-f260-4d73-be4d-accda97893e3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:13.778037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-097a0323-f260-4d73-be4d-accda97893e3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:13.911204 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-27a06734-a185-4f59-aef9-f7f52fe3046f tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.591079 Mar 05 20:59:13.912360 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1475/2943] 10.222.0.15 () {60 vars in 1169 bytes} [Sat Mar 5 20:59:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:13.922437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0b110022-bc34-4649-bdfd-811e1bfb3774 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:13.923003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0b110022-bc34-4649-bdfd-811e1bfb3774 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:13.941427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b110022-bc34-4649-bdfd-811e1bfb3774 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:13.941896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b110022-bc34-4649-bdfd-811e1bfb3774 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:13.942692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b110022-bc34-4649-bdfd-811e1bfb3774 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:13.943143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b110022-bc34-4649-bdfd-811e1bfb3774 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:13.987573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0b110022-bc34-4649-bdfd-811e1bfb3774 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:59:14.003706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-097a0323-f260-4d73-be4d-accda97893e3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:14.012631 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-097a0323-f260-4d73-be4d-accda97893e3 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1392 microversion: 2.1 time: 0.257529 Mar 05 20:59:14.013660 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1469/2944] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:13 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1392 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:14.029512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-adca1639-3437-4454-946e-5c96f4de3955 tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:14.037778 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-adca1639-3437-4454-946e-5c96f4de3955 tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] HTTP exception thrown: Instance group b7a584c8-fac5-44ab-8b9d-3f805b09d000 could not be found. Mar 05 20:59:14.038417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-adca1639-3437-4454-946e-5c96f4de3955 tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] Returning 404 to user: Instance group b7a584c8-fac5-44ab-8b9d-3f805b09d000 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:14.039702 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-adca1639-3437-4454-946e-5c96f4de3955 tempest-ServerGroup264TestJSON-1976389637 tempest-ServerGroup264TestJSON-1976389637-project] 10.222.0.15 "DELETE /compute/v2.1/os-server-groups/b7a584c8-fac5-44ab-8b9d-3f805b09d000" status: 404 len: 117 microversion: 2.64 time: 0.024783 Mar 05 20:59:14.040337 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1470/2945] 10.222.0.15 () {60 vars in 1306 bytes} [Sat Mar 5 20:59:14 2022] DELETE /compute/v2.1/os-server-groups/b7a584c8-fac5-44ab-8b9d-3f805b09d000 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:59:14.046445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1548146d-1998-4d94-9b1f-fbbe283f83a1 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.254"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:14.047987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1548146d-1998-4d94-9b1f-fbbe283f83a1 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:14.057993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1548146d-1998-4d94-9b1f-fbbe283f83a1 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:14.058458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1548146d-1998-4d94-9b1f-fbbe283f83a1 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:14.059255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1548146d-1998-4d94-9b1f-fbbe283f83a1 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:14.060212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1548146d-1998-4d94-9b1f-fbbe283f83a1 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:14.099755 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0b110022-bc34-4649-bdfd-811e1bfb3774 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 204 len: 0 microversion: 2.1 time: 0.185063 Mar 05 20:59:14.101036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1548146d-1998-4d94-9b1f-fbbe283f83a1 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Acquired lock "refresh_cache-23279b59-495b-4264-8d6c-33d6143418ce" {{(pid=141478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 20:59:14.101826 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1476/2946] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:13 2022] DELETE /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:59:14.114191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ac5fb459-ee6e-469a-85fe-9e6c242b4b2e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:14.115336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ac5fb459-ee6e-469a-85fe-9e6c242b4b2e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:14.124400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac5fb459-ee6e-469a-85fe-9e6c242b4b2e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:14.125172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac5fb459-ee6e-469a-85fe-9e6c242b4b2e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:14.126482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac5fb459-ee6e-469a-85fe-9e6c242b4b2e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:14.128254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac5fb459-ee6e-469a-85fe-9e6c242b4b2e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:14.586447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ac5fb459-ee6e-469a-85fe-9e6c242b4b2e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:14.602694 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ac5fb459-ee6e-469a-85fe-9e6c242b4b2e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1495 microversion: 2.1 time: 0.493937 Mar 05 20:59:14.606089 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1477/2947] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:14 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1495 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:14.620317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e7ccc056-cd5a-427c-90aa-83baaf2b76b8 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:14.620917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e7ccc056-cd5a-427c-90aa-83baaf2b76b8 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:14.637488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7ccc056-cd5a-427c-90aa-83baaf2b76b8 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:14.637959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7ccc056-cd5a-427c-90aa-83baaf2b76b8 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:14.638787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7ccc056-cd5a-427c-90aa-83baaf2b76b8 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:14.639215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7ccc056-cd5a-427c-90aa-83baaf2b76b8 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:15.179161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e7ccc056-cd5a-427c-90aa-83baaf2b76b8 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:15.190861 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e7ccc056-cd5a-427c-90aa-83baaf2b76b8 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1592 microversion: 2.1 time: 0.583637 Mar 05 20:59:15.196265 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1478/2948] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:14 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1592 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:15.208947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0e6ae956-97a9-4a68-ba1b-f9ba2fbda750 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f8774c0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:15.289773 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0e6ae956-97a9-4a68-ba1b-f9ba2fbda750 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.092041 Mar 05 20:59:15.290722 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1479/2949] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:15 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:15.301728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8cf9dc0b-6eab-44f9-868c-946ebbf2815e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:15.303871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8cf9dc0b-6eab-44f9-868c-946ebbf2815e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:15.315727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cf9dc0b-6eab-44f9-868c-946ebbf2815e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:15.316726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cf9dc0b-6eab-44f9-868c-946ebbf2815e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:15.320854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cf9dc0b-6eab-44f9-868c-946ebbf2815e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:15.323799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cf9dc0b-6eab-44f9-868c-946ebbf2815e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:15.790406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8cf9dc0b-6eab-44f9-868c-946ebbf2815e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:15.798302 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8cf9dc0b-6eab-44f9-868c-946ebbf2815e tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1392 microversion: 2.1 time: 0.506270 Mar 05 20:59:15.805107 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1480/2950] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:15 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1392 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:15.824655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4f084b85-f08b-4023-baee-f249a85e8251 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:15.827590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4f084b85-f08b-4023-baee-f249a85e8251 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:15.848375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f084b85-f08b-4023-baee-f249a85e8251 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:15.851757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f084b85-f08b-4023-baee-f249a85e8251 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:15.854061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f084b85-f08b-4023-baee-f249a85e8251 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:15.854802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f084b85-f08b-4023-baee-f249a85e8251 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:16.327600 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4f084b85-f08b-4023-baee-f249a85e8251 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.520361 Mar 05 20:59:16.330425 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1481/2951] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 20:59:15 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4/os-interface => generated 285 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:16.343063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1d45c9dc-fe97-49ee-bb55-cd029c3119f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:16.348863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1d45c9dc-fe97-49ee-bb55-cd029c3119f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:16.368334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d45c9dc-fe97-49ee-bb55-cd029c3119f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:16.371290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d45c9dc-fe97-49ee-bb55-cd029c3119f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:16.373628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d45c9dc-fe97-49ee-bb55-cd029c3119f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:16.374376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d45c9dc-fe97-49ee-bb55-cd029c3119f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:17.330052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-1548146d-1998-4d94-9b1f-fbbe283f83a1 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Building network info cache for instance {{(pid=141478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 05 20:59:18.876932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1d45c9dc-fe97-49ee-bb55-cd029c3119f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:18.886199 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1d45c9dc-fe97-49ee-bb55-cd029c3119f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 200 len: 1495 microversion: 2.1 time: 2.554281 Mar 05 20:59:18.894171 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1482/2952] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:16 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 1495 bytes in 2563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:18.914652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-94761b1b-0cda-4d18-a80e-5df3bddbde1c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f7739d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:19.259554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-1548146d-1998-4d94-9b1f-fbbe283f83a1 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Updating instance_info_cache with network_info: [{"id": "8fc25781-cd23-40fb-843d-506a3fbd00cf", "address": "fa:16:3e:aa:e7:37", "network": {"id": "dd3faab4-7d75-49f7-880e-c7d935436cb4", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2088568947-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "99fe3e49fc5e47c3bd99ee3debc420ee", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8fc25781-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 05 20:59:19.274035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1548146d-1998-4d94-9b1f-fbbe283f83a1 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Releasing lock "refresh_cache-23279b59-495b-4264-8d6c-33d6143418ce" {{(pid=141478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 20:59:19.274918 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1548146d-1998-4d94-9b1f-fbbe283f83a1 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "POST /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce/action" status: 202 len: 0 microversion: 2.1 time: 5.233460 Mar 05 20:59:19.277690 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1471/2953] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:59:14 2022] POST /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce/action => generated 0 bytes in 5237 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 05 20:59:19.289523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7835e573-13f7-4105-b1fe-d7bd160a2d49 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:19.293785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7835e573-13f7-4105-b1fe-d7bd160a2d49 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:19.322956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7835e573-13f7-4105-b1fe-d7bd160a2d49 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:19.323509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7835e573-13f7-4105-b1fe-d7bd160a2d49 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:19.327850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7835e573-13f7-4105-b1fe-d7bd160a2d49 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:19.328307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7835e573-13f7-4105-b1fe-d7bd160a2d49 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:19.404734 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-94761b1b-0cda-4d18-a80e-5df3bddbde1c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.506899 Mar 05 20:59:19.405593 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1483/2954] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:18 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:19.413334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9f183cc7-4dd2-4ddb-b05f-bb97377d22e2 req-40dd9a44-724b-421d-a02a-d75f284b579d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0", "name": "network-vif-unplugged", "status": "completed", "tag": "45250c7d-a9c6-48f1-8ae6-302bb7ba938d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:19.428392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9f183cc7-4dd2-4ddb-b05f-bb97377d22e2 req-40dd9a44-724b-421d-a02a-d75f284b579d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:19.429036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9f183cc7-4dd2-4ddb-b05f-bb97377d22e2 req-40dd9a44-724b-421d-a02a-d75f284b579d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:19.441390 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9f183cc7-4dd2-4ddb-b05f-bb97377d22e2 req-40dd9a44-724b-421d-a02a-d75f284b579d service nova] Creating event network-vif-unplugged:45250c7d-a9c6-48f1-8ae6-302bb7ba938d for instance 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 on nch1-master-1 Mar 05 20:59:19.448246 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9f183cc7-4dd2-4ddb-b05f-bb97377d22e2 req-40dd9a44-724b-421d-a02a-d75f284b579d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041265 Mar 05 20:59:19.449443 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1484/2955] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:19.455902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-58c71625-f712-4d4d-b055-56ca6feae846 req-66508e37-743d-4431-a74b-eb7fbc7721e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23279b59-495b-4264-8d6c-33d6143418ce", "tag": "8fc25781-cd23-40fb-843d-506a3fbd00cf"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:19.477406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-58c71625-f712-4d4d-b055-56ca6feae846 req-66508e37-743d-4431-a74b-eb7fbc7721e3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:19.478144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-58c71625-f712-4d4d-b055-56ca6feae846 req-66508e37-743d-4431-a74b-eb7fbc7721e3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:19.504159 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-58c71625-f712-4d4d-b055-56ca6feae846 req-66508e37-743d-4431-a74b-eb7fbc7721e3 service nova] Creating event network-changed:8fc25781-cd23-40fb-843d-506a3fbd00cf for instance 23279b59-495b-4264-8d6c-33d6143418ce on nch2-master-1 Mar 05 20:59:19.516725 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-58c71625-f712-4d4d-b055-56ca6feae846 req-66508e37-743d-4431-a74b-eb7fbc7721e3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065692 Mar 05 20:59:19.520541 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1485/2956] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:19.532222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1fd3cf25-bf09-4e98-9a0a-1eb61be99006 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.254"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:19.661642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7835e573-13f7-4105-b1fe-d7bd160a2d49 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:19.670018 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7835e573-13f7-4105-b1fe-d7bd160a2d49 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1392 microversion: 2.1 time: 0.390035 Mar 05 20:59:19.676778 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1472/2957] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:19 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1392 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:19.817179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1fd3cf25-bf09-4e98-9a0a-1eb61be99006 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:19.823985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fd3cf25-bf09-4e98-9a0a-1eb61be99006 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:19.824694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fd3cf25-bf09-4e98-9a0a-1eb61be99006 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:19.825659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fd3cf25-bf09-4e98-9a0a-1eb61be99006 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:19.828230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fd3cf25-bf09-4e98-9a0a-1eb61be99006 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:19.910787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cb2b14ac-0593-4170-830d-05cf1d1fb9c1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:19.911424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cb2b14ac-0593-4170-830d-05cf1d1fb9c1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:19.918893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb2b14ac-0593-4170-830d-05cf1d1fb9c1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:19.919350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb2b14ac-0593-4170-830d-05cf1d1fb9c1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:19.920165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb2b14ac-0593-4170-830d-05cf1d1fb9c1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:19.920604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb2b14ac-0593-4170-830d-05cf1d1fb9c1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:19.953919 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-cb2b14ac-0593-4170-830d-05cf1d1fb9c1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance 76292b20-5af3-4714-8d54-0207aa49129a could not be found. Mar 05 20:59:19.960162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cb2b14ac-0593-4170-830d-05cf1d1fb9c1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance 76292b20-5af3-4714-8d54-0207aa49129a could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:19.961091 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cb2b14ac-0593-4170-830d-05cf1d1fb9c1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 404 len: 111 microversion: 2.1 time: 0.054339 Mar 05 20:59:19.961988 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1473/2958] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:19 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:59:20.250426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1329328087", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "72f55423-ea6d-4438-a149-d5df19f9ecdd"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:20.376648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] validate_networks() for [('72f55423-ea6d-4438-a149-d5df19f9ecdd', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:59:20.826584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fd3cf25-bf09-4e98-9a0a-1eb61be99006 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Acquired lock "refresh_cache-23279b59-495b-4264-8d6c-33d6143418ce" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 20:59:21.524957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:59:21.526322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:59:21.527025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:59:21.527656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:59:21.528389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:59:21.543731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:21.544488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:21.545634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:21.548797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:21.584141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:59:21.594829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Getting quotas for user e8b67d8bbe9a44898a889826e12ffb0b and project a02c2521498e48a3a5650f7b6f81d5ce. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:59:21.647641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:59:21.650305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:59:21.765270 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-82a17cb4-ff18-4917-b801-3a2b1f176be4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520050 Mar 05 20:59:21.773320 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1474/2959] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 20:59:21.790466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2638783d-33ed-444c-9786-8076c62f131a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a85d30>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:21.868992 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2638783d-33ed-444c-9786-8076c62f131a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.089417 Mar 05 20:59:21.876509 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1475/2960] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:21 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:21.882698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-966ac51b-5530-43fe-80b3-10e41f39b801 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:21.883415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-966ac51b-5530-43fe-80b3-10e41f39b801 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:21.902633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-966ac51b-5530-43fe-80b3-10e41f39b801 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:21.912282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-966ac51b-5530-43fe-80b3-10e41f39b801 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:21.913630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-966ac51b-5530-43fe-80b3-10e41f39b801 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:21.914290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-966ac51b-5530-43fe-80b3-10e41f39b801 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:22.226699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-966ac51b-5530-43fe-80b3-10e41f39b801 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:22.235852 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-966ac51b-5530-43fe-80b3-10e41f39b801 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1392 microversion: 2.1 time: 0.357546 Mar 05 20:59:22.239424 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1476/2961] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:21 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1392 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:22.245005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-9fe76b55-8410-4a00-a242-77c128994c7b req-cbaf1eec-7537-409a-817f-407779ee38f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0", "tag": "45250c7d-a9c6-48f1-8ae6-302bb7ba938d"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:22.277325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9fe76b55-8410-4a00-a242-77c128994c7b req-cbaf1eec-7537-409a-817f-407779ee38f3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:22.278211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9fe76b55-8410-4a00-a242-77c128994c7b req-cbaf1eec-7537-409a-817f-407779ee38f3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:22.304887 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-9fe76b55-8410-4a00-a242-77c128994c7b req-cbaf1eec-7537-409a-817f-407779ee38f3 service nova] Creating event network-changed:45250c7d-a9c6-48f1-8ae6-302bb7ba938d for instance 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 on nch1-master-1 Mar 05 20:59:22.317004 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-9fe76b55-8410-4a00-a242-77c128994c7b req-cbaf1eec-7537-409a-817f-407779ee38f3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075055 Mar 05 20:59:22.318296 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1477/2962] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:22.325849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f574080c-e40c-4ee7-bef1-be4462477414 req-9e54e3a8-5ef2-4b5b-ba3f-c1038979b57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76292b20-5af3-4714-8d54-0207aa49129a", "name": "network-vif-deleted", "tag": "9b6d6349-6293-4bf5-9386-7898bb2e8382"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:22.339384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f574080c-e40c-4ee7-bef1-be4462477414 req-9e54e3a8-5ef2-4b5b-ba3f-c1038979b57f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:22.354948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f574080c-e40c-4ee7-bef1-be4462477414 req-9e54e3a8-5ef2-4b5b-ba3f-c1038979b57f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:22.398010 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f574080c-e40c-4ee7-bef1-be4462477414 req-9e54e3a8-5ef2-4b5b-ba3f-c1038979b57f service nova] Creating event network-vif-deleted:9b6d6349-6293-4bf5-9386-7898bb2e8382 for instance 76292b20-5af3-4714-8d54-0207aa49129a on nch1-master-1 Mar 05 20:59:22.425877 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f574080c-e40c-4ee7-bef1-be4462477414 req-9e54e3a8-5ef2-4b5b-ba3f-c1038979b57f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100080 Mar 05 20:59:22.429197 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1478/2963] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:22.442649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ba778a0e-c0b7-4303-af10-bb6b75b13480 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:22.443412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ba778a0e-c0b7-4303-af10-bb6b75b13480 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:22.601698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ba778a0e-c0b7-4303-af10-bb6b75b13480 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:22.613774 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ba778a0e-c0b7-4303-af10-bb6b75b13480 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1215 microversion: 2.1 time: 0.181074 Mar 05 20:59:22.629903 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1479/2964] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:22 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:22.886375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4bbc9988-1908-4350-a5e8-38ece1619703 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a5f9d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:22.995918 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4bbc9988-1908-4350-a5e8-38ece1619703 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.115966 Mar 05 20:59:22.996595 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1480/2965] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:22 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:23.021226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c28021c0-a87d-4aa3-8e11-d02e00affc86 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:23.031915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c28021c0-a87d-4aa3-8e11-d02e00affc86 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:23.058859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c28021c0-a87d-4aa3-8e11-d02e00affc86 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:23.061709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c28021c0-a87d-4aa3-8e11-d02e00affc86 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:23.072661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c28021c0-a87d-4aa3-8e11-d02e00affc86 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:23.073453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c28021c0-a87d-4aa3-8e11-d02e00affc86 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:24.156134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c28021c0-a87d-4aa3-8e11-d02e00affc86 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:24.175505 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c28021c0-a87d-4aa3-8e11-d02e00affc86 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1592 microversion: 2.1 time: 1.162662 Mar 05 20:59:24.176916 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1481/2966] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:23 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1592 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:59:24.183384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4fd8f445-7f1e-41a7-996d-101ca3bda20f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:24.184379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4fd8f445-7f1e-41a7-996d-101ca3bda20f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:24.194657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4fd8f445-7f1e-41a7-996d-101ca3bda20f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:24.195733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4fd8f445-7f1e-41a7-996d-101ca3bda20f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:24.196817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4fd8f445-7f1e-41a7-996d-101ca3bda20f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:24.197729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4fd8f445-7f1e-41a7-996d-101ca3bda20f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:24.441531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-1fd3cf25-bf09-4e98-9a0a-1eb61be99006 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Building network info cache for instance {{(pid=141479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 05 20:59:24.797918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4fd8f445-7f1e-41a7-996d-101ca3bda20f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:24.812445 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4fd8f445-7f1e-41a7-996d-101ca3bda20f tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1392 microversion: 2.1 time: 0.634072 Mar 05 20:59:24.819199 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1482/2967] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:24 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1392 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:24.830821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-049b3736-6627-4ed4-9e87-b4143541b866 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:24.832392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-049b3736-6627-4ed4-9e87-b4143541b866 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:24.849178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-049b3736-6627-4ed4-9e87-b4143541b866 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:24.854555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-049b3736-6627-4ed4-9e87-b4143541b866 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:24.855512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-049b3736-6627-4ed4-9e87-b4143541b866 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:24.858614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-049b3736-6627-4ed4-9e87-b4143541b866 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:24.988828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-049b3736-6627-4ed4-9e87-b4143541b866 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:25.000924 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-049b3736-6627-4ed4-9e87-b4143541b866 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1273 microversion: 2.1 time: 0.176695 Mar 05 20:59:25.001582 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1483/2968] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:24 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:25.009022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74756b9b-542b-451f-aeb7-323858d418e4 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61b47820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:25.097337 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-74756b9b-542b-451f-aeb7-323858d418e4 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.092814 Mar 05 20:59:25.098448 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1484/2969] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:25 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:25.204030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-3833b91c-1eeb-4f51-a529-7d45d6595512 req-90e372e2-8921-4e39-9f03-86cf2c0ccf7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "827e53bd-cd06-4f93-8232-243003d885f4", "tag": "d8af58c4-4388-479a-9490-64f82575af6b"}, {"name": "network-changed", "server_uuid": "23279b59-495b-4264-8d6c-33d6143418ce", "tag": "8fc25781-cd23-40fb-843d-506a3fbd00cf"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:25.231362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3833b91c-1eeb-4f51-a529-7d45d6595512 req-90e372e2-8921-4e39-9f03-86cf2c0ccf7c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:25.232145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3833b91c-1eeb-4f51-a529-7d45d6595512 req-90e372e2-8921-4e39-9f03-86cf2c0ccf7c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:25.273041 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-3833b91c-1eeb-4f51-a529-7d45d6595512 req-90e372e2-8921-4e39-9f03-86cf2c0ccf7c service nova] Creating event network-changed:d8af58c4-4388-479a-9490-64f82575af6b for instance 827e53bd-cd06-4f93-8232-243003d885f4 on nch2-master-1 Mar 05 20:59:25.274788 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-3833b91c-1eeb-4f51-a529-7d45d6595512 req-90e372e2-8921-4e39-9f03-86cf2c0ccf7c service nova] Creating event network-changed:8fc25781-cd23-40fb-843d-506a3fbd00cf for instance 23279b59-495b-4264-8d6c-33d6143418ce on nch2-master-1 Mar 05 20:59:25.296089 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-3833b91c-1eeb-4f51-a529-7d45d6595512 req-90e372e2-8921-4e39-9f03-86cf2c0ccf7c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.117934 Mar 05 20:59:25.296723 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1485/2970] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:26.336507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-425547913", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "80991bdd-20f7-442c-b102-d548a4c4ffc3"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:26.461203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] validate_networks() for [('80991bdd-20f7-442c-b102-d548a4c4ffc3', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:59:27.774031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-1fd3cf25-bf09-4e98-9a0a-1eb61be99006 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Updating instance_info_cache with network_info: [{"id": "8fc25781-cd23-40fb-843d-506a3fbd00cf", "address": "fa:16:3e:aa:e7:37", "network": {"id": "dd3faab4-7d75-49f7-880e-c7d935436cb4", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2088568947-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "99fe3e49fc5e47c3bd99ee3debc420ee", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8fc25781-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 05 20:59:27.796349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fd3cf25-bf09-4e98-9a0a-1eb61be99006 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Releasing lock "refresh_cache-23279b59-495b-4264-8d6c-33d6143418ce" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 20:59:27.797323 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1fd3cf25-bf09-4e98-9a0a-1eb61be99006 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "POST /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce/action" status: 202 len: 0 microversion: 2.1 time: 8.275331 Mar 05 20:59:27.797957 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1486/2971] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:59:19 2022] POST /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce/action => generated 0 bytes in 8277 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 05 20:59:27.806091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d41fb89e-6a4b-443e-b3fd-e14bada91b8d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:27.807101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d41fb89e-6a4b-443e-b3fd-e14bada91b8d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:27.821906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d41fb89e-6a4b-443e-b3fd-e14bada91b8d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:27.823357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d41fb89e-6a4b-443e-b3fd-e14bada91b8d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:27.825520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d41fb89e-6a4b-443e-b3fd-e14bada91b8d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:27.827464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d41fb89e-6a4b-443e-b3fd-e14bada91b8d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:28.425450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:59:28.426052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:59:28.426336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:59:28.426935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:59:28.427515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:59:28.442575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:28.443293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:28.444322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:28.444936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:28.498460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Getting quotas for project daf06b3ce3f3408ab9463644907a62ba. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:59:28.510804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Getting quotas for user 03d6a3cd79b24cf79fda0f40c3407806 and project daf06b3ce3f3408ab9463644907a62ba. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:59:28.543542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d41fb89e-6a4b-443e-b3fd-e14bada91b8d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:28.551296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:59:28.561309 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d41fb89e-6a4b-443e-b3fd-e14bada91b8d tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1392 microversion: 2.1 time: 0.760896 Mar 05 20:59:28.562088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:59:28.563073 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1487/2972] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:27 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1392 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:28.575849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c243aac-60a9-4b29-897c-21d4866aa64d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:28.578567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9c243aac-60a9-4b29-897c-21d4866aa64d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:28.599749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c243aac-60a9-4b29-897c-21d4866aa64d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:28.601076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c243aac-60a9-4b29-897c-21d4866aa64d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:28.604786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c243aac-60a9-4b29-897c-21d4866aa64d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:28.605684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c243aac-60a9-4b29-897c-21d4866aa64d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:28.728434 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ff7e7973-01f3-4194-a7ba-50d8775b36a2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.171639 Mar 05 20:59:28.737412 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1486/2973] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:59:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 20:59:28.750662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd2b2de7-f3c0-44a6-8c4c-5c21c18d7bce tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a5f4c0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:28.846815 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd2b2de7-f3c0-44a6-8c4c-5c21c18d7bce tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1455 microversion: 2.1 time: 0.104263 Mar 05 20:59:28.853951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1487/2974] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:28 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:28.870932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-32bf3aaf-e3c1-422e-89e4-442e2b1a6471 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '.version_select at 0x7fed61a21430>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:29.336398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9c243aac-60a9-4b29-897c-21d4866aa64d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:29.354217 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c243aac-60a9-4b29-897c-21d4866aa64d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1315 microversion: 2.1 time: 0.787798 Mar 05 20:59:29.354940 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1488/2975] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:28 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1315 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:29.359909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ac78645f-9daf-4775-9143-0a4150f67c47 req-b0d2c379-058e-440a-aed8-9a6744f5066c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d447e8-00c9-45b3-b624-964a6336bbe3", "tag": "621cdb97-85f7-40ba-b6d8-0cbf88212647"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:29.382822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ac78645f-9daf-4775-9143-0a4150f67c47 req-b0d2c379-058e-440a-aed8-9a6744f5066c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:29.383788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ac78645f-9daf-4775-9143-0a4150f67c47 req-b0d2c379-058e-440a-aed8-9a6744f5066c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:29.396525 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ac78645f-9daf-4775-9143-0a4150f67c47 req-b0d2c379-058e-440a-aed8-9a6744f5066c service nova] Creating event network-changed:621cdb97-85f7-40ba-b6d8-0cbf88212647 for instance 14d447e8-00c9-45b3-b624-964a6336bbe3 on nch1-master-1 Mar 05 20:59:29.413214 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ac78645f-9daf-4775-9143-0a4150f67c47 req-b0d2c379-058e-440a-aed8-9a6744f5066c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056719 Mar 05 20:59:29.413952 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1489/2976] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:29.432252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3e135f94-2f9f-4cf7-9a4a-eb5cc5fe8a55 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:29.433255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3e135f94-2f9f-4cf7-9a4a-eb5cc5fe8a55 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:29.529432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3e135f94-2f9f-4cf7-9a4a-eb5cc5fe8a55 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d6a3cd79b24cf79fda0f40c3407806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf06b3ce3f3408ab9463644907a62ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:29.536775 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3e135f94-2f9f-4cf7-9a4a-eb5cc5fe8a55 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 200 len: 1223 microversion: 2.1 time: 0.117233 Mar 05 20:59:29.538340 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1490/2977] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:29 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 1223 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:29.580859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c4b89aa-b4b5-46dd-ab86-77c743aa0b6b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:29.581863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9c4b89aa-b4b5-46dd-ab86-77c743aa0b6b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:29.594201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c4b89aa-b4b5-46dd-ab86-77c743aa0b6b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:29.595313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c4b89aa-b4b5-46dd-ab86-77c743aa0b6b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:29.596604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c4b89aa-b4b5-46dd-ab86-77c743aa0b6b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:29.600362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c4b89aa-b4b5-46dd-ab86-77c743aa0b6b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:30.860315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9c4b89aa-b4b5-46dd-ab86-77c743aa0b6b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:30.872136 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c4b89aa-b4b5-46dd-ab86-77c743aa0b6b tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1392 microversion: 2.1 time: 1.295489 Mar 05 20:59:30.873032 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1491/2978] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:29 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1392 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:59:30.880684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-82eadd6f-b77f-46d4-a5c8-92276060438e tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f7049d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:30.981429 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-82eadd6f-b77f-46d4-a5c8-92276060438e tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1464 microversion: 2.1 time: 0.107142 Mar 05 20:59:30.983244 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1492/2979] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:30 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1464 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:30.999530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0de4ee2-0f12-4a88-aae4-60b2c3d73555 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:31.000459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e0de4ee2-0f12-4a88-aae4-60b2c3d73555 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:31.009953 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0de4ee2-0f12-4a88-aae4-60b2c3d73555 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:31.010622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0de4ee2-0f12-4a88-aae4-60b2c3d73555 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:31.011866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0de4ee2-0f12-4a88-aae4-60b2c3d73555 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:31.012715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0de4ee2-0f12-4a88-aae4-60b2c3d73555 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:31.275647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e0de4ee2-0f12-4a88-aae4-60b2c3d73555 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:31.286660 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0de4ee2-0f12-4a88-aae4-60b2c3d73555 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1315 microversion: 2.1 time: 0.292536 Mar 05 20:59:31.287812 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1493/2980] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:30 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:31.294174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-de9f0f12-82a9-4bc0-94cf-08eed79cd335 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:31.295432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-de9f0f12-82a9-4bc0-94cf-08eed79cd335 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:31.304980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de9f0f12-82a9-4bc0-94cf-08eed79cd335 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:31.306022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de9f0f12-82a9-4bc0-94cf-08eed79cd335 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:31.307435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de9f0f12-82a9-4bc0-94cf-08eed79cd335 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:31.307821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de9f0f12-82a9-4bc0-94cf-08eed79cd335 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:31.406164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-de9f0f12-82a9-4bc0-94cf-08eed79cd335 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d6a3cd79b24cf79fda0f40c3407806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf06b3ce3f3408ab9463644907a62ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:31.418712 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-de9f0f12-82a9-4bc0-94cf-08eed79cd335 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 200 len: 1281 microversion: 2.1 time: 0.129537 Mar 05 20:59:31.420594 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1494/2981] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:31 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 1281 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:31.428092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-888d85b0-c189-411d-b39e-bede62ecd4ff tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed5c5f7160>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:31.497567 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-888d85b0-c189-411d-b39e-bede62ecd4ff tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 200 len: 1464 microversion: 2.1 time: 0.075626 Mar 05 20:59:31.500093 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1495/2982] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:31 2022] GET /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 1464 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:31.521274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-289678fd-d45f-4685-be0e-639f3b6fdd74 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:31.522043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-289678fd-d45f-4685-be0e-639f3b6fdd74 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: 00a6114e-7710-4ccf-b462-bb8c98001725] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:31.531376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-289678fd-d45f-4685-be0e-639f3b6fdd74 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:31.532233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-289678fd-d45f-4685-be0e-639f3b6fdd74 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:31.534007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-289678fd-d45f-4685-be0e-639f3b6fdd74 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:31.534609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-289678fd-d45f-4685-be0e-639f3b6fdd74 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:31.786070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-289678fd-d45f-4685-be0e-639f3b6fdd74 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:31.796415 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-289678fd-d45f-4685-be0e-639f3b6fdd74 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725" status: 200 len: 1468 microversion: 2.1 time: 0.287062 Mar 05 20:59:31.799388 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1496/2983] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:31 2022] GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725 => generated 1468 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:31.819932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-293bd96f-3e41-49c7-977b-892456f4e480 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-603708342"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:31.832002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-293bd96f-3e41-49c7-977b-892456f4e480 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:31.841172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-293bd96f-3e41-49c7-977b-892456f4e480 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:31.841919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-293bd96f-3e41-49c7-977b-892456f4e480 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:31.847028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-293bd96f-3e41-49c7-977b-892456f4e480 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:31.847870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-293bd96f-3e41-49c7-977b-892456f4e480 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:32.126902 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-32bf3aaf-e3c1-422e-89e4-442e2b1a6471 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "DELETE /compute/v2.1/os-floating-ips/16b5ba17-b501-4c94-9ef6-79e883e49b14" status: 202 len: 0 microversion: 2.1 time: 3.270211 Mar 05 20:59:32.127506 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1488/2984] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:59:28 2022] DELETE /compute/v2.1/os-floating-ips/16b5ba17-b501-4c94-9ef6-79e883e49b14 => generated 0 bytes in 3273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:59:32.132691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e4c19b49-35d3-4ea8-9321-ac57e8e51ab5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:32.133571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e4c19b49-35d3-4ea8-9321-ac57e8e51ab5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:32.140374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e4c19b49-35d3-4ea8-9321-ac57e8e51ab5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:32.141080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e4c19b49-35d3-4ea8-9321-ac57e8e51ab5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:32.142020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e4c19b49-35d3-4ea8-9321-ac57e8e51ab5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:32.142910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e4c19b49-35d3-4ea8-9321-ac57e8e51ab5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:32.372525 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-293bd96f-3e41-49c7-977b-892456f4e480 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "POST /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3/action" status: 202 len: 0 microversion: 2.1 time: 0.555736 Mar 05 20:59:32.381012 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1497/2985] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:59:31 2022] POST /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 20:59:32.389831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-303d82ee-0c6c-4cf0-801e-77cd12630805 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '.version_select at 0x7fed4f704310>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:32.545036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e4c19b49-35d3-4ea8-9321-ac57e8e51ab5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:32.558304 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e4c19b49-35d3-4ea8-9321-ac57e8e51ab5 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1382 microversion: 2.1 time: 0.429514 Mar 05 20:59:32.559031 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1489/2986] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:32 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1382 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:32.594122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c4f53f33-1f90-4c38-96f3-58826d0b9a90 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:32.597920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c4f53f33-1f90-4c38-96f3-58826d0b9a90 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:32.609800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4f53f33-1f90-4c38-96f3-58826d0b9a90 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:32.613175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4f53f33-1f90-4c38-96f3-58826d0b9a90 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:32.614528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4f53f33-1f90-4c38-96f3-58826d0b9a90 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:32.615522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4f53f33-1f90-4c38-96f3-58826d0b9a90 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:32.780310 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-303d82ee-0c6c-4cf0-801e-77cd12630805 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/e85ca656-444f-41fd-9e38-4812df95ceb5" status: 202 len: 0 microversion: 2.1 time: 0.397240 Mar 05 20:59:32.780925 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1498/2987] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 20:59:32 2022] DELETE /compute/v2.1/os-security-groups/e85ca656-444f-41fd-9e38-4812df95ceb5 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:59:32.786680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7279ca9b-91b9-45d9-b241-e23d34704ea0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f7609d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:32.844529 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7279ca9b-91b9-45d9-b241-e23d34704ea0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.062320 Mar 05 20:59:32.846718 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1499/2988] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:32 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:32.852478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-008b5573-8b5f-4bbc-bda7-42308b3daeb6 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:32.853257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-008b5573-8b5f-4bbc-bda7-42308b3daeb6 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:32.860472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-008b5573-8b5f-4bbc-bda7-42308b3daeb6 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:32.862200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-008b5573-8b5f-4bbc-bda7-42308b3daeb6 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:32.863356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-008b5573-8b5f-4bbc-bda7-42308b3daeb6 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:32.864047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-008b5573-8b5f-4bbc-bda7-42308b3daeb6 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:33.061391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-008b5573-8b5f-4bbc-bda7-42308b3daeb6 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d6a3cd79b24cf79fda0f40c3407806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf06b3ce3f3408ab9463644907a62ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:33.075863 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-008b5573-8b5f-4bbc-bda7-42308b3daeb6 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 200 len: 1323 microversion: 2.1 time: 0.227619 Mar 05 20:59:33.076939 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1500/2989] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:32 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 1323 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:33.094910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-51c22510-0a94-4089-a24b-0bf18c2f44cb tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '.version_select at 0x7fed4f7af670>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:33.099151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51c22510-0a94-4089-a24b-0bf18c2f44cb tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:33.099722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51c22510-0a94-4089-a24b-0bf18c2f44cb tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:33.103037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c4f53f33-1f90-4c38-96f3-58826d0b9a90 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:33.112178 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-51c22510-0a94-4089-a24b-0bf18c2f44cb tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/os-migrations" status: 200 len: 1555 microversion: 2.1 time: 0.028025 Mar 05 20:59:33.113378 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1501/2990] 10.222.0.15 () {58 vars in 1142 bytes} [Sat Mar 5 20:59:33 2022] GET /compute/v2.1/os-migrations => generated 1555 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:33.118382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-283ebdc1-423c-411d-8f55-6751ec1bf1bd tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:33.118958 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c4f53f33-1f90-4c38-96f3-58826d0b9a90 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1315 microversion: 2.1 time: 0.542609 Mar 05 20:59:33.119091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-283ebdc1-423c-411d-8f55-6751ec1bf1bd tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:33.119790 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1490/2991] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:32 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:33.126750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-283ebdc1-423c-411d-8f55-6751ec1bf1bd tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:33.127853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-283ebdc1-423c-411d-8f55-6751ec1bf1bd tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:33.128939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-283ebdc1-423c-411d-8f55-6751ec1bf1bd tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:33.129613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-283ebdc1-423c-411d-8f55-6751ec1bf1bd tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:33.135621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-64a0c36d-d637-45ba-930f-975c1f4b3fa8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:33.136267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-64a0c36d-d637-45ba-930f-975c1f4b3fa8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:33.155383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64a0c36d-d637-45ba-930f-975c1f4b3fa8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:33.158675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64a0c36d-d637-45ba-930f-975c1f4b3fa8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:33.160212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64a0c36d-d637-45ba-930f-975c1f4b3fa8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:33.160847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64a0c36d-d637-45ba-930f-975c1f4b3fa8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:33.167258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-283ebdc1-423c-411d-8f55-6751ec1bf1bd tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:59:33.282180 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-283ebdc1-423c-411d-8f55-6751ec1bf1bd tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "DELETE /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 204 len: 0 microversion: 2.1 time: 0.166973 Mar 05 20:59:33.283519 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1502/2992] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:33 2022] DELETE /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:59:33.296823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ff11711e-6e52-4746-8081-b0b949b80e3c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:33.298197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ff11711e-6e52-4746-8081-b0b949b80e3c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:33.310395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff11711e-6e52-4746-8081-b0b949b80e3c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:33.310919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff11711e-6e52-4746-8081-b0b949b80e3c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:33.311734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff11711e-6e52-4746-8081-b0b949b80e3c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:33.312365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff11711e-6e52-4746-8081-b0b949b80e3c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:33.515508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ff11711e-6e52-4746-8081-b0b949b80e3c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:33.528844 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ff11711e-6e52-4746-8081-b0b949b80e3c tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1510 microversion: 2.1 time: 0.237415 Mar 05 20:59:33.530134 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1503/2993] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:33 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:33.536096 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-64a0c36d-d637-45ba-930f-975c1f4b3fa8 tempest-LiveMigrationTest-747499185 tempest-LiveMigrationTest-747499185-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1533 microversion: 2.1 time: 0.410891 Mar 05 20:59:33.539273 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1491/2994] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:33 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1533 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:33.560816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:33.561379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:33.569654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:33.570195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:33.571280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:33.571999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:33.616492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:59:33.634492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-86d27b04-7d45-48ff-b71d-c0c19992532a req-1f02320d-5010-42d3-bfd9-b9058eaa6e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632", "tag": "13f94710-cc92-4672-8982-8cd80e18ede8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:33.647862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-86d27b04-7d45-48ff-b71d-c0c19992532a req-1f02320d-5010-42d3-bfd9-b9058eaa6e8c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:33.648523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-86d27b04-7d45-48ff-b71d-c0c19992532a req-1f02320d-5010-42d3-bfd9-b9058eaa6e8c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:33.665594 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-86d27b04-7d45-48ff-b71d-c0c19992532a req-1f02320d-5010-42d3-bfd9-b9058eaa6e8c service nova] Creating event network-changed:13f94710-cc92-4672-8982-8cd80e18ede8 for instance 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 on nch2-master-1 Mar 05 20:59:33.672522 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-86d27b04-7d45-48ff-b71d-c0c19992532a req-1f02320d-5010-42d3-bfd9-b9058eaa6e8c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046960 Mar 05 20:59:33.675384 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1492/2995] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:33.763456 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4cac9bc0-8aa1-44a9-b851-fca947fb1158 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 204 len: 0 microversion: 2.1 time: 0.207638 Mar 05 20:59:33.764806 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1504/2996] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:33 2022] DELETE /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:59:33.773884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6ce2f80-a3e1-4b18-a4c5-4f8a0b54a4cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:33.774652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6ce2f80-a3e1-4b18-a4c5-4f8a0b54a4cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:33.782819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6ce2f80-a3e1-4b18-a4c5-4f8a0b54a4cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:33.783982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6ce2f80-a3e1-4b18-a4c5-4f8a0b54a4cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:33.785238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6ce2f80-a3e1-4b18-a4c5-4f8a0b54a4cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:33.785656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6ce2f80-a3e1-4b18-a4c5-4f8a0b54a4cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:33.860538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c6145a3d-aeac-48be-9d94-b5f515e7e78b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f7be790>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:33.934084 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c6145a3d-aeac-48be-9d94-b5f515e7e78b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.078302 Mar 05 20:59:33.936782 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1505/2997] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:33 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:34.099565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1940e17b-68a2-4f21-bf45-b0c1c963c798 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:34.101371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6ce2f80-a3e1-4b18-a4c5-4f8a0b54a4cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:34.101712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1940e17b-68a2-4f21-bf45-b0c1c963c798 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:34.109136 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6ce2f80-a3e1-4b18-a4c5-4f8a0b54a4cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1388 microversion: 2.1 time: 0.339770 Mar 05 20:59:34.119412 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1493/2998] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:33 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1388 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:34.122724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1940e17b-68a2-4f21-bf45-b0c1c963c798 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:34.123478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1940e17b-68a2-4f21-bf45-b0c1c963c798 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:34.124706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1940e17b-68a2-4f21-bf45-b0c1c963c798 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:34.124793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1940e17b-68a2-4f21-bf45-b0c1c963c798 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:34.137380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0438a7b6-cbbe-4d9f-90e2-efaf7a432e61 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:34.138045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0438a7b6-cbbe-4d9f-90e2-efaf7a432e61 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:34.145341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0438a7b6-cbbe-4d9f-90e2-efaf7a432e61 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:34.145803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0438a7b6-cbbe-4d9f-90e2-efaf7a432e61 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:34.146593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0438a7b6-cbbe-4d9f-90e2-efaf7a432e61 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:34.147096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0438a7b6-cbbe-4d9f-90e2-efaf7a432e61 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:34.354808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1940e17b-68a2-4f21-bf45-b0c1c963c798 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d6a3cd79b24cf79fda0f40c3407806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf06b3ce3f3408ab9463644907a62ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:34.369395 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1940e17b-68a2-4f21-bf45-b0c1c963c798 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 200 len: 1323 microversion: 2.1 time: 0.278779 Mar 05 20:59:34.370574 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1506/2999] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:34 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 1323 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:59:34.422543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0438a7b6-cbbe-4d9f-90e2-efaf7a432e61 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:34.434926 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0438a7b6-cbbe-4d9f-90e2-efaf7a432e61 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1315 microversion: 2.1 time: 0.302084 Mar 05 20:59:34.445292 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1494/3000] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:34 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:59:34.549102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b867844d-d4b0-4762-9769-596a2d18516e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:34.550443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b867844d-d4b0-4762-9769-596a2d18516e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:34.557120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b867844d-d4b0-4762-9769-596a2d18516e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:34.557844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b867844d-d4b0-4762-9769-596a2d18516e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:34.558632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b867844d-d4b0-4762-9769-596a2d18516e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:34.559234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b867844d-d4b0-4762-9769-596a2d18516e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:34.777545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b867844d-d4b0-4762-9769-596a2d18516e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:34.791475 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b867844d-d4b0-4762-9769-596a2d18516e tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1510 microversion: 2.1 time: 0.246020 Mar 05 20:59:34.793218 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1507/3001] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:34 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:34.950095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0fb98eb8-a7d1-4514-ab0d-f962c8bc9e45 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a858b0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:35.018447 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0fb98eb8-a7d1-4514-ab0d-f962c8bc9e45 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.072121 Mar 05 20:59:35.022251 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1495/3002] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:34 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:35.127425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f2d7fda3-4c54-49b9-8dbf-6bab0cbe6905 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:35.128133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f2d7fda3-4c54-49b9-8dbf-6bab0cbe6905 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:35.134348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d7fda3-4c54-49b9-8dbf-6bab0cbe6905 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:35.135028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d7fda3-4c54-49b9-8dbf-6bab0cbe6905 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:35.135869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d7fda3-4c54-49b9-8dbf-6bab0cbe6905 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:35.136317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d7fda3-4c54-49b9-8dbf-6bab0cbe6905 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:35.389030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e9797847-762c-4349-ad5d-61f11cd51194 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:35.389651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e9797847-762c-4349-ad5d-61f11cd51194 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:35.402090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9797847-762c-4349-ad5d-61f11cd51194 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:35.405897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9797847-762c-4349-ad5d-61f11cd51194 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:35.408153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9797847-762c-4349-ad5d-61f11cd51194 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:35.409891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9797847-762c-4349-ad5d-61f11cd51194 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:35.436540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f2d7fda3-4c54-49b9-8dbf-6bab0cbe6905 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:35.453719 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f2d7fda3-4c54-49b9-8dbf-6bab0cbe6905 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 200 len: 1388 microversion: 2.1 time: 0.330719 Mar 05 20:59:35.455327 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1508/3003] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:35 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 1388 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:35.461787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f6f0aff7-49b8-423f-9c98-60fe491e3e91 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:35.462592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f6f0aff7-49b8-423f-9c98-60fe491e3e91 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:35.491497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f6f0aff7-49b8-423f-9c98-60fe491e3e91 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:35.491998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f6f0aff7-49b8-423f-9c98-60fe491e3e91 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:35.492940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f6f0aff7-49b8-423f-9c98-60fe491e3e91 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:35.493869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f6f0aff7-49b8-423f-9c98-60fe491e3e91 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:35.784893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f6f0aff7-49b8-423f-9c98-60fe491e3e91 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:35.796861 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f6f0aff7-49b8-423f-9c98-60fe491e3e91 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1315 microversion: 2.1 time: 0.338147 Mar 05 20:59:35.797926 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1509/3004] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:35 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:35.823457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-084ff87e-5426-47ce-82c2-1a06e75e848c req-cd0dbbdf-c979-4ab7-9275-3951cbef66ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0", "name": "network-vif-deleted", "tag": "45250c7d-a9c6-48f1-8ae6-302bb7ba938d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:35.841915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-084ff87e-5426-47ce-82c2-1a06e75e848c req-cd0dbbdf-c979-4ab7-9275-3951cbef66ae service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:35.842789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-084ff87e-5426-47ce-82c2-1a06e75e848c req-cd0dbbdf-c979-4ab7-9275-3951cbef66ae service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:35.855871 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-084ff87e-5426-47ce-82c2-1a06e75e848c req-cd0dbbdf-c979-4ab7-9275-3951cbef66ae service nova] Creating event network-vif-deleted:45250c7d-a9c6-48f1-8ae6-302bb7ba938d for instance 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 on nch2-master-1 Mar 05 20:59:35.863074 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-084ff87e-5426-47ce-82c2-1a06e75e848c req-cd0dbbdf-c979-4ab7-9275-3951cbef66ae service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048227 Mar 05 20:59:35.864146 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1510/3005] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:35.871028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c3c24900-14af-4896-b40c-9315caf2b6f3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:35.871965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c3c24900-14af-4896-b40c-9315caf2b6f3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:35.879645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3c24900-14af-4896-b40c-9315caf2b6f3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:35.880212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3c24900-14af-4896-b40c-9315caf2b6f3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:35.881111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3c24900-14af-4896-b40c-9315caf2b6f3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:35.881794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3c24900-14af-4896-b40c-9315caf2b6f3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:36.063059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e9797847-762c-4349-ad5d-61f11cd51194 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d6a3cd79b24cf79fda0f40c3407806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf06b3ce3f3408ab9463644907a62ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:36.074517 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e9797847-762c-4349-ad5d-61f11cd51194 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 200 len: 1323 microversion: 2.1 time: 0.690720 Mar 05 20:59:36.078384 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1496/3006] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:35 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 1323 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:59:36.092116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7c2d72ac-a40d-4009-8db7-154d832966e3 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61b21ee0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:36.161998 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7c2d72ac-a40d-4009-8db7-154d832966e3 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.078452 Mar 05 20:59:36.168438 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1497/3007] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:36 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:36.209899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c3c24900-14af-4896-b40c-9315caf2b6f3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:36.221887 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c3c24900-14af-4896-b40c-9315caf2b6f3 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1510 microversion: 2.1 time: 0.353900 Mar 05 20:59:36.223068 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1511/3008] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:35 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1510 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:36.264835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-808d20ad-5a3d-4019-96ef-f375640c1431 req-01574f50-b1f4-4202-a914-0c18a7c01fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d447e8-00c9-45b3-b624-964a6336bbe3", "name": "network-vif-plugged", "status": "completed", "tag": "621cdb97-85f7-40ba-b6d8-0cbf88212647"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:36.280508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-808d20ad-5a3d-4019-96ef-f375640c1431 req-01574f50-b1f4-4202-a914-0c18a7c01fb1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:36.280923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-808d20ad-5a3d-4019-96ef-f375640c1431 req-01574f50-b1f4-4202-a914-0c18a7c01fb1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:36.298103 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-808d20ad-5a3d-4019-96ef-f375640c1431 req-01574f50-b1f4-4202-a914-0c18a7c01fb1 service nova] Creating event network-vif-plugged:621cdb97-85f7-40ba-b6d8-0cbf88212647 for instance 14d447e8-00c9-45b3-b624-964a6336bbe3 on nch1-master-1 Mar 05 20:59:36.306017 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-808d20ad-5a3d-4019-96ef-f375640c1431 req-01574f50-b1f4-4202-a914-0c18a7c01fb1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044962 Mar 05 20:59:36.307419 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1498/3009] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:36.475002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f5931818-0dad-471a-b545-07bf32e2ad34 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:36.476160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f5931818-0dad-471a-b545-07bf32e2ad34 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:36.489904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f5931818-0dad-471a-b545-07bf32e2ad34 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:36.492586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f5931818-0dad-471a-b545-07bf32e2ad34 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:36.493849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f5931818-0dad-471a-b545-07bf32e2ad34 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:36.494851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f5931818-0dad-471a-b545-07bf32e2ad34 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:36.525291 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-f5931818-0dad-471a-b545-07bf32e2ad34 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] HTTP exception thrown: Instance 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 could not be found. Mar 05 20:59:36.526192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f5931818-0dad-471a-b545-07bf32e2ad34 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Returning 404 to user: Instance 5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:36.527100 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f5931818-0dad-471a-b545-07bf32e2ad34 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0" status: 404 len: 111 microversion: 2.1 time: 0.058867 Mar 05 20:59:36.531096 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1512/3010] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:36 2022] GET /compute/v2.1/servers/5d3b78cb-cf6e-420d-b49d-5f9e85b8f6e0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:36.815911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6f2788c9-0c9d-4379-a842-af8aea97d40a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:36.817190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6f2788c9-0c9d-4379-a842-af8aea97d40a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:36.832133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2788c9-0c9d-4379-a842-af8aea97d40a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:36.832765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2788c9-0c9d-4379-a842-af8aea97d40a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:36.833745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2788c9-0c9d-4379-a842-af8aea97d40a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:36.834502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2788c9-0c9d-4379-a842-af8aea97d40a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:37.097075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b58f2d33-7300-487a-a512-130b242b660a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:37.097785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b58f2d33-7300-487a-a512-130b242b660a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:37.119190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b58f2d33-7300-487a-a512-130b242b660a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:37.119999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b58f2d33-7300-487a-a512-130b242b660a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:37.123416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b58f2d33-7300-487a-a512-130b242b660a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:37.124448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b58f2d33-7300-487a-a512-130b242b660a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:37.201262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6f2788c9-0c9d-4379-a842-af8aea97d40a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:37.229393 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6f2788c9-0c9d-4379-a842-af8aea97d40a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1315 microversion: 2.1 time: 0.418536 Mar 05 20:59:37.239006 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1499/3011] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:36 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:37.253725 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6932878a-e20e-480c-a468-1a4b5bd561c1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61b30f70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:37.380810 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6932878a-e20e-480c-a468-1a4b5bd561c1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.139665 Mar 05 20:59:37.382617 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1500/3012] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:37 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:37.419526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2a63320e-ca90-4e98-95bf-009338e74ee5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:37.421586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2a63320e-ca90-4e98-95bf-009338e74ee5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:37.455997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a63320e-ca90-4e98-95bf-009338e74ee5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:37.458651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a63320e-ca90-4e98-95bf-009338e74ee5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:37.461272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a63320e-ca90-4e98-95bf-009338e74ee5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:37.464326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a63320e-ca90-4e98-95bf-009338e74ee5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:37.804769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2a63320e-ca90-4e98-95bf-009338e74ee5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4bbe0a5d6524aae9838cc663f70caa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fe3e49fc5e47c3bd99ee3debc420ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:37.815482 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2a63320e-ca90-4e98-95bf-009338e74ee5 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 200 len: 1510 microversion: 2.1 time: 0.431633 Mar 05 20:59:37.816134 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1501/3013] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:37 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 1510 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:37.823935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-819eab22-dbc1-402d-b252-e7ff04d22320 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:37.824454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-819eab22-dbc1-402d-b252-e7ff04d22320 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:37.832787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-819eab22-dbc1-402d-b252-e7ff04d22320 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:37.833063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-819eab22-dbc1-402d-b252-e7ff04d22320 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:37.834511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-819eab22-dbc1-402d-b252-e7ff04d22320 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:37.834958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-819eab22-dbc1-402d-b252-e7ff04d22320 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:37.848931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b58f2d33-7300-487a-a512-130b242b660a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d6a3cd79b24cf79fda0f40c3407806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf06b3ce3f3408ab9463644907a62ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:37.863895 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b58f2d33-7300-487a-a512-130b242b660a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 200 len: 1323 microversion: 2.1 time: 0.770297 Mar 05 20:59:37.864993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-819eab22-dbc1-402d-b252-e7ff04d22320 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:59:37.866407 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1513/3014] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:37 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 1323 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:38.039109 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-819eab22-dbc1-402d-b252-e7ff04d22320 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 204 len: 0 microversion: 2.1 time: 0.220963 Mar 05 20:59:38.040148 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1502/3015] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:37 2022] DELETE /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:59:38.050829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cbe0f911-ca7e-451f-955b-672ab31d55c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:38.051545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cbe0f911-ca7e-451f-955b-672ab31d55c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:38.059833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cbe0f911-ca7e-451f-955b-672ab31d55c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:38.060313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cbe0f911-ca7e-451f-955b-672ab31d55c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:38.061111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cbe0f911-ca7e-451f-955b-672ab31d55c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:38.065398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cbe0f911-ca7e-451f-955b-672ab31d55c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:38.090611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-fc6a3f4a-a35c-4457-b300-9505be52a1e0 req-905d1b29-5947-40ff-9f49-090a039bc7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23279b59-495b-4264-8d6c-33d6143418ce", "name": "network-vif-deleted", "tag": "8fc25781-cd23-40fb-843d-506a3fbd00cf"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:38.105707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-fc6a3f4a-a35c-4457-b300-9505be52a1e0 req-905d1b29-5947-40ff-9f49-090a039bc7d4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:38.106410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-fc6a3f4a-a35c-4457-b300-9505be52a1e0 req-905d1b29-5947-40ff-9f49-090a039bc7d4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:38.121821 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-fc6a3f4a-a35c-4457-b300-9505be52a1e0 req-905d1b29-5947-40ff-9f49-090a039bc7d4 service nova] Creating event network-vif-deleted:8fc25781-cd23-40fb-843d-506a3fbd00cf for instance 23279b59-495b-4264-8d6c-33d6143418ce on nch2-master-1 Mar 05 20:59:38.128848 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-fc6a3f4a-a35c-4457-b300-9505be52a1e0 req-905d1b29-5947-40ff-9f49-090a039bc7d4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052293 Mar 05 20:59:38.130306 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1503/3016] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:38.257014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3d9fe0af-f994-4e26-8cca-611271a8f59c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:38.257964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3d9fe0af-f994-4e26-8cca-611271a8f59c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:38.270467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3d9fe0af-f994-4e26-8cca-611271a8f59c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:38.271074 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3d9fe0af-f994-4e26-8cca-611271a8f59c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:38.273955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3d9fe0af-f994-4e26-8cca-611271a8f59c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:38.274421 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3d9fe0af-f994-4e26-8cca-611271a8f59c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:38.350551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cbe0f911-ca7e-451f-955b-672ab31d55c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:38.364264 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cbe0f911-ca7e-451f-955b-672ab31d55c7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1498 microversion: 2.1 time: 0.320181 Mar 05 20:59:38.369394 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1514/3017] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:38 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1498 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:38.374147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ea352a62-2daf-42fb-856c-583c9313c68f req-ba0e7bd5-030a-459a-b4e2-98b2db5ba22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a6114e-7710-4ccf-b462-bb8c98001725", "name": "network-vif-unplugged", "status": "completed", "tag": "f3d55e8e-71fd-427a-9669-f45552929be7"}, {"server_uuid": "dbc23752-0101-4c2b-a90f-6ccad692e3f3", "name": "network-vif-plugged", "status": "completed", "tag": "d89b87d8-65fa-4882-ac07-f0f70c7ec7eb"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:38.383648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ea352a62-2daf-42fb-856c-583c9313c68f req-ba0e7bd5-030a-459a-b4e2-98b2db5ba22b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:38.386092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ea352a62-2daf-42fb-856c-583c9313c68f req-ba0e7bd5-030a-459a-b4e2-98b2db5ba22b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:38.422713 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ea352a62-2daf-42fb-856c-583c9313c68f req-ba0e7bd5-030a-459a-b4e2-98b2db5ba22b service nova] Creating event network-vif-unplugged:f3d55e8e-71fd-427a-9669-f45552929be7 for instance 00a6114e-7710-4ccf-b462-bb8c98001725 on nch1-master-1 Mar 05 20:59:38.423252 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ea352a62-2daf-42fb-856c-583c9313c68f req-ba0e7bd5-030a-459a-b4e2-98b2db5ba22b service nova] Creating event network-vif-plugged:d89b87d8-65fa-4882-ac07-f0f70c7ec7eb for instance dbc23752-0101-4c2b-a90f-6ccad692e3f3 on nch2-master-1 Mar 05 20:59:38.452604 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ea352a62-2daf-42fb-856c-583c9313c68f req-ba0e7bd5-030a-459a-b4e2-98b2db5ba22b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.079682 Mar 05 20:59:38.455209 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1515/3018] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:38.466756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-58df20a4-e379-406c-8314-ae7b48bac5ca tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f719040>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:38.569059 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-58df20a4-e379-406c-8314-ae7b48bac5ca tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.112190 Mar 05 20:59:38.575306 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1516/3019] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:38 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:38.623097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3d9fe0af-f994-4e26-8cca-611271a8f59c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:38.633979 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3d9fe0af-f994-4e26-8cca-611271a8f59c tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1503 microversion: 2.1 time: 0.382470 Mar 05 20:59:38.647386 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1504/3020] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:38 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1503 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:38.653818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b93f03c8-d27b-4e71-b576-81ca1936c135 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:38.654647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b93f03c8-d27b-4e71-b576-81ca1936c135 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:38.684141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b93f03c8-d27b-4e71-b576-81ca1936c135 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:38.685570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b93f03c8-d27b-4e71-b576-81ca1936c135 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:38.686752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b93f03c8-d27b-4e71-b576-81ca1936c135 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:38.693646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b93f03c8-d27b-4e71-b576-81ca1936c135 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:38.758873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-b93f03c8-d27b-4e71-b576-81ca1936c135 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lazy-loading 'flavor' on Instance uuid 14d447e8-00c9-45b3-b624-964a6336bbe3 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:59:38.839530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2bfd846a-d6da-4c4e-a1e4-2861a3816b95 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:38.840472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2bfd846a-d6da-4c4e-a1e4-2861a3816b95 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] [instance: 23279b59-495b-4264-8d6c-33d6143418ce] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:38.859596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2bfd846a-d6da-4c4e-a1e4-2861a3816b95 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:38.862611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2bfd846a-d6da-4c4e-a1e4-2861a3816b95 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:38.864868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2bfd846a-d6da-4c4e-a1e4-2861a3816b95 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:38.868707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2bfd846a-d6da-4c4e-a1e4-2861a3816b95 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:38.920887 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-2bfd846a-d6da-4c4e-a1e4-2861a3816b95 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] HTTP exception thrown: Instance 23279b59-495b-4264-8d6c-33d6143418ce could not be found. Mar 05 20:59:38.924614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2bfd846a-d6da-4c4e-a1e4-2861a3816b95 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] Returning 404 to user: Instance 23279b59-495b-4264-8d6c-33d6143418ce could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:38.925645 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2bfd846a-d6da-4c4e-a1e4-2861a3816b95 tempest-ServerRescueTestJSONUnderV235-1883044730 tempest-ServerRescueTestJSONUnderV235-1883044730-project] 10.222.0.15 "GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce" status: 404 len: 111 microversion: 2.1 time: 0.096720 Mar 05 20:59:38.926223 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1505/3021] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:38 2022] GET /compute/v2.1/servers/23279b59-495b-4264-8d6c-33d6143418ce => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:38.955377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-39e618f4-3e6c-4d3d-9903-72526c6f5e51 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:38.956081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-39e618f4-3e6c-4d3d-9903-72526c6f5e51 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:38.976922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39e618f4-3e6c-4d3d-9903-72526c6f5e51 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:38.977452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39e618f4-3e6c-4d3d-9903-72526c6f5e51 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:38.978121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39e618f4-3e6c-4d3d-9903-72526c6f5e51 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:38.980695 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b93f03c8-d27b-4e71-b576-81ca1936c135 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "POST /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3/action" status: 202 len: 0 microversion: 2.1 time: 0.331179 Mar 05 20:59:38.983210 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1517/3022] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 20:59:38 2022] POST /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 20:59:38.984644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39e618f4-3e6c-4d3d-9903-72526c6f5e51 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:39.008040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0437e707-9e23-408d-8737-62c75b466c36 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:39.012846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0437e707-9e23-408d-8737-62c75b466c36 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:39.025826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0437e707-9e23-408d-8737-62c75b466c36 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:39.028994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0437e707-9e23-408d-8737-62c75b466c36 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:39.031074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0437e707-9e23-408d-8737-62c75b466c36 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:39.032012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0437e707-9e23-408d-8737-62c75b466c36 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:39.405918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-39e618f4-3e6c-4d3d-9903-72526c6f5e51 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d6a3cd79b24cf79fda0f40c3407806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf06b3ce3f3408ab9463644907a62ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:39.432318 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-39e618f4-3e6c-4d3d-9903-72526c6f5e51 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 200 len: 1323 microversion: 2.1 time: 0.493397 Mar 05 20:59:39.433520 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1506/3023] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:38 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 1323 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:39.445900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9bf38f5e-d61e-4570-8efe-a30ed750d177 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:39.447291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9bf38f5e-d61e-4570-8efe-a30ed750d177 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:39.468806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9bf38f5e-d61e-4570-8efe-a30ed750d177 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:39.471479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9bf38f5e-d61e-4570-8efe-a30ed750d177 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:39.472807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9bf38f5e-d61e-4570-8efe-a30ed750d177 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:39.474248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9bf38f5e-d61e-4570-8efe-a30ed750d177 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:39.619341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0437e707-9e23-408d-8737-62c75b466c36 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:39.632142 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0437e707-9e23-408d-8737-62c75b466c36 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1511 microversion: 2.1 time: 0.641276 Mar 05 20:59:39.636452 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1518/3024] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:38 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1511 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:39.644886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b0aaf1bd-9c39-4d3a-9237-2823684659dd tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f7b8a60>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:39.759312 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b0aaf1bd-9c39-4d3a-9237-2823684659dd tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.119038 Mar 05 20:59:39.764661 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1519/3025] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:39 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:39.949111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9bf38f5e-d61e-4570-8efe-a30ed750d177 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:39.959660 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9bf38f5e-d61e-4570-8efe-a30ed750d177 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 200 len: 1498 microversion: 2.1 time: 0.523493 Mar 05 20:59:39.963270 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1507/3026] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:39 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 1498 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:40.152165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-d5b31d77-1ec6-4ea5-9822-c27542d785e2 req-3ca23c09-35d7-43f4-b748-cb9d63436c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97c5a8d-7d31-43dc-a2e2-0227ff5b4050", "name": "network-vif-deleted", "tag": "7705d2a3-c4f0-4f14-82f2-b7d4a3c2ab9f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:40.177224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d5b31d77-1ec6-4ea5-9822-c27542d785e2 req-3ca23c09-35d7-43f4-b748-cb9d63436c17 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:40.178091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d5b31d77-1ec6-4ea5-9822-c27542d785e2 req-3ca23c09-35d7-43f4-b748-cb9d63436c17 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:40.208064 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-d5b31d77-1ec6-4ea5-9822-c27542d785e2 req-3ca23c09-35d7-43f4-b748-cb9d63436c17 service nova] Creating event network-vif-deleted:7705d2a3-c4f0-4f14-82f2-b7d4a3c2ab9f for instance e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 on nch2-master-1 Mar 05 20:59:40.224693 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-d5b31d77-1ec6-4ea5-9822-c27542d785e2 req-3ca23c09-35d7-43f4-b748-cb9d63436c17 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077438 Mar 05 20:59:40.225336 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1520/3027] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:40.452094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-280d8354-2b80-43ef-a7a0-ff56ec956931 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:40.453019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-280d8354-2b80-43ef-a7a0-ff56ec956931 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:40.465146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-280d8354-2b80-43ef-a7a0-ff56ec956931 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:40.467140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-280d8354-2b80-43ef-a7a0-ff56ec956931 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:40.468536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-280d8354-2b80-43ef-a7a0-ff56ec956931 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:40.471141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-280d8354-2b80-43ef-a7a0-ff56ec956931 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:40.654350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c679072c-5511-4c4f-accc-3f448d0196a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:40.665720 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c679072c-5511-4c4f-accc-3f448d0196a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:40.697617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c679072c-5511-4c4f-accc-3f448d0196a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:40.698806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c679072c-5511-4c4f-accc-3f448d0196a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:40.701078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c679072c-5511-4c4f-accc-3f448d0196a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:40.701984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c679072c-5511-4c4f-accc-3f448d0196a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:41.071941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c679072c-5511-4c4f-accc-3f448d0196a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:41.080735 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c679072c-5511-4c4f-accc-3f448d0196a4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1494 microversion: 2.1 time: 0.432714 Mar 05 20:59:41.094039 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1521/3028] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:40 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1494 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:41.100400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-42c338f1-5bb2-4823-9acc-cf028a128754 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f707310>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:41.169697 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-42c338f1-5bb2-4823-9acc-cf028a128754 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.072853 Mar 05 20:59:41.170670 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1522/3029] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:41 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:41.181660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c7a1ddf2-2488-4172-b552-78e22ea16d74 req-fe8bed04-1529-4faa-abd4-74706c6dc578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632", "name": "network-vif-plugged", "status": "completed", "tag": "13f94710-cc92-4672-8982-8cd80e18ede8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:41.192771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c7a1ddf2-2488-4172-b552-78e22ea16d74 req-fe8bed04-1529-4faa-abd4-74706c6dc578 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:41.193237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c7a1ddf2-2488-4172-b552-78e22ea16d74 req-fe8bed04-1529-4faa-abd4-74706c6dc578 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:41.206670 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c7a1ddf2-2488-4172-b552-78e22ea16d74 req-fe8bed04-1529-4faa-abd4-74706c6dc578 service nova] Creating event network-vif-plugged:13f94710-cc92-4672-8982-8cd80e18ede8 for instance 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 on nch2-master-1 Mar 05 20:59:41.211998 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c7a1ddf2-2488-4172-b552-78e22ea16d74 req-fe8bed04-1529-4faa-abd4-74706c6dc578 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040029 Mar 05 20:59:41.212788 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1523/3030] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:41.219528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-15621781-8777-4394-8fbd-9001469542dc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:41.220979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-15621781-8777-4394-8fbd-9001469542dc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: e97c5a8d-7d31-43dc-a2e2-0227ff5b4050] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:41.233757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-15621781-8777-4394-8fbd-9001469542dc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:41.234304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-15621781-8777-4394-8fbd-9001469542dc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:41.235128 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-15621781-8777-4394-8fbd-9001469542dc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:41.235569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-15621781-8777-4394-8fbd-9001469542dc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:41.240159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-280d8354-2b80-43ef-a7a0-ff56ec956931 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d6a3cd79b24cf79fda0f40c3407806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf06b3ce3f3408ab9463644907a62ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:41.261720 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-280d8354-2b80-43ef-a7a0-ff56ec956931 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 200 len: 1323 microversion: 2.1 time: 0.812181 Mar 05 20:59:41.266045 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1508/3031] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:40 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 1323 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:41.284709 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-15621781-8777-4394-8fbd-9001469542dc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] HTTP exception thrown: Instance e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 could not be found. Mar 05 20:59:41.285595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-15621781-8777-4394-8fbd-9001469542dc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Returning 404 to user: Instance e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:41.290154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-89098b81-fdb3-4567-b5c1-7045506bf55d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:41.294562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-89098b81-fdb3-4567-b5c1-7045506bf55d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:41.301162 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-15621781-8777-4394-8fbd-9001469542dc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050" status: 404 len: 111 microversion: 2.1 time: 0.072262 Mar 05 20:59:41.303527 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1524/3032] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:41 2022] GET /compute/v2.1/servers/e97c5a8d-7d31-43dc-a2e2-0227ff5b4050 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:41.310651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89098b81-fdb3-4567-b5c1-7045506bf55d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:41.318498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89098b81-fdb3-4567-b5c1-7045506bf55d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:41.319486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89098b81-fdb3-4567-b5c1-7045506bf55d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:41.320059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89098b81-fdb3-4567-b5c1-7045506bf55d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:41.332162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-31d81835-5935-4ff9-9ea3-b0415168a4b2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:41.333109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-31d81835-5935-4ff9-9ea3-b0415168a4b2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:41.361300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31d81835-5935-4ff9-9ea3-b0415168a4b2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:41.361940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31d81835-5935-4ff9-9ea3-b0415168a4b2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:41.363127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31d81835-5935-4ff9-9ea3-b0415168a4b2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:41.363813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31d81835-5935-4ff9-9ea3-b0415168a4b2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:41.367187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-89098b81-fdb3-4567-b5c1-7045506bf55d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:59:41.468559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-31d81835-5935-4ff9-9ea3-b0415168a4b2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:59:41.544146 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-89098b81-fdb3-4567-b5c1-7045506bf55d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 204 len: 0 microversion: 2.1 time: 0.273363 Mar 05 20:59:41.547575 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1509/3033] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:41 2022] DELETE /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:59:41.566464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-779abd1b-7e80-4ca9-9674-5f1f1bf293cf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:41.570594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-779abd1b-7e80-4ca9-9674-5f1f1bf293cf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:41.597293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-779abd1b-7e80-4ca9-9674-5f1f1bf293cf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:41.597749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-779abd1b-7e80-4ca9-9674-5f1f1bf293cf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:41.598546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-779abd1b-7e80-4ca9-9674-5f1f1bf293cf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:41.598983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-779abd1b-7e80-4ca9-9674-5f1f1bf293cf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:41.668934 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-31d81835-5935-4ff9-9ea3-b0415168a4b2 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 204 len: 0 microversion: 2.1 time: 0.360195 Mar 05 20:59:41.672170 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1525/3034] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:41 2022] DELETE /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:59:41.684053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-497c9a6c-51f6-44c0-b1e1-1c99096247dd tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:41.685145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-497c9a6c-51f6-44c0-b1e1-1c99096247dd tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:41.696821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-497c9a6c-51f6-44c0-b1e1-1c99096247dd tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:41.697696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-497c9a6c-51f6-44c0-b1e1-1c99096247dd tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:41.699342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-497c9a6c-51f6-44c0-b1e1-1c99096247dd tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:41.700912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-497c9a6c-51f6-44c0-b1e1-1c99096247dd tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:42.033921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-497c9a6c-51f6-44c0-b1e1-1c99096247dd tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:42.041855 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-497c9a6c-51f6-44c0-b1e1-1c99096247dd tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1485 microversion: 2.1 time: 0.363561 Mar 05 20:59:42.042370 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1526/3035] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:41 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1485 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:42.136385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-779abd1b-7e80-4ca9-9674-5f1f1bf293cf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:42.146222 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-779abd1b-7e80-4ca9-9674-5f1f1bf293cf tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1500 microversion: 2.1 time: 0.591173 Mar 05 20:59:42.147547 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1510/3036] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:41 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1500 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:42.184056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-627ad9d7-536d-4dac-a776-a27ddd3b7276 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f7b81f0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:42.273126 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-627ad9d7-536d-4dac-a776-a27ddd3b7276 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.094552 Mar 05 20:59:42.285423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-67240485-c611-4b25-bb89-56b984a0548b tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:42.286039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-67240485-c611-4b25-bb89-56b984a0548b tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:42.291776 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1527/3037] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:42 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:42.300109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-67240485-c611-4b25-bb89-56b984a0548b tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:42.300571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-67240485-c611-4b25-bb89-56b984a0548b tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:42.301365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-67240485-c611-4b25-bb89-56b984a0548b tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:42.301808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-67240485-c611-4b25-bb89-56b984a0548b tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:42.699713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-67240485-c611-4b25-bb89-56b984a0548b tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d6a3cd79b24cf79fda0f40c3407806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf06b3ce3f3408ab9463644907a62ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:42.708869 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-67240485-c611-4b25-bb89-56b984a0548b tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 200 len: 1323 microversion: 2.1 time: 0.427337 Mar 05 20:59:42.710619 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1511/3038] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:42 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:43.060451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6a4c192e-dabb-4ef0-b0c2-fc2dfdcecdca tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:43.061440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6a4c192e-dabb-4ef0-b0c2-fc2dfdcecdca tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:43.076736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a4c192e-dabb-4ef0-b0c2-fc2dfdcecdca tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:43.076736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a4c192e-dabb-4ef0-b0c2-fc2dfdcecdca tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:43.085863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a4c192e-dabb-4ef0-b0c2-fc2dfdcecdca tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:43.088960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a4c192e-dabb-4ef0-b0c2-fc2dfdcecdca tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:43.171027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cc642e60-b74b-47fc-a1f3-646b1af262f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:43.171781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cc642e60-b74b-47fc-a1f3-646b1af262f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:43.185352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc642e60-b74b-47fc-a1f3-646b1af262f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:43.188845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc642e60-b74b-47fc-a1f3-646b1af262f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:43.190658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc642e60-b74b-47fc-a1f3-646b1af262f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:43.191309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc642e60-b74b-47fc-a1f3-646b1af262f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:43.761292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cc642e60-b74b-47fc-a1f3-646b1af262f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:43.770359 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cc642e60-b74b-47fc-a1f3-646b1af262f4 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1500 microversion: 2.1 time: 0.603441 Mar 05 20:59:43.770959 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1512/3039] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:43 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1500 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:43.785024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5b86a2ee-797b-47a0-b715-436e43c9f26c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a85b80>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:43.855086 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5b86a2ee-797b-47a0-b715-436e43c9f26c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.083089 Mar 05 20:59:43.858611 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1513/3040] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:43 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:43.872283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3cf4ca3c-0bce-475c-9add-34a81756c024 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:43.882827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3cf4ca3c-0bce-475c-9add-34a81756c024 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:43.911206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3cf4ca3c-0bce-475c-9add-34a81756c024 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:43.916759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3cf4ca3c-0bce-475c-9add-34a81756c024 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:43.921187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3cf4ca3c-0bce-475c-9add-34a81756c024 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:43.924320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3cf4ca3c-0bce-475c-9add-34a81756c024 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:44.331575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6a4c192e-dabb-4ef0-b0c2-fc2dfdcecdca tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:44.340573 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6a4c192e-dabb-4ef0-b0c2-fc2dfdcecdca tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1485 microversion: 2.1 time: 1.284175 Mar 05 20:59:44.347424 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1528/3041] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:43 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1485 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:44.602806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e78743b0-aa59-4712-bc85-fdc5d4037b7b req-d9dda91e-8c20-41cf-ab9b-e299366df234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d447e8-00c9-45b3-b624-964a6336bbe3", "name": "network-vif-deleted", "tag": "621cdb97-85f7-40ba-b6d8-0cbf88212647"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:44.613670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3cf4ca3c-0bce-475c-9add-34a81756c024 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d6a3cd79b24cf79fda0f40c3407806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf06b3ce3f3408ab9463644907a62ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:44.625243 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3cf4ca3c-0bce-475c-9add-34a81756c024 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 200 len: 1517 microversion: 2.1 time: 0.762853 Mar 05 20:59:44.630264 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1514/3042] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:43 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 1517 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:44.634299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e78743b0-aa59-4712-bc85-fdc5d4037b7b req-d9dda91e-8c20-41cf-ab9b-e299366df234 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:44.634981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e78743b0-aa59-4712-bc85-fdc5d4037b7b req-d9dda91e-8c20-41cf-ab9b-e299366df234 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:44.655214 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e78743b0-aa59-4712-bc85-fdc5d4037b7b req-d9dda91e-8c20-41cf-ab9b-e299366df234 service nova] Creating event network-vif-deleted:621cdb97-85f7-40ba-b6d8-0cbf88212647 for instance 14d447e8-00c9-45b3-b624-964a6336bbe3 on nch1-master-1 Mar 05 20:59:44.679079 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e78743b0-aa59-4712-bc85-fdc5d4037b7b req-d9dda91e-8c20-41cf-ab9b-e299366df234 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080168 Mar 05 20:59:44.686492 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1529/3043] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:44.789287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1045aa46-b8bd-43de-b662-f4f2e24df5ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:44.792604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1045aa46-b8bd-43de-b662-f4f2e24df5ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:44.795008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e1cf1eca-cd0d-4574-bb3b-825dbd92bbbc tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1719669372", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "80991bdd-20f7-442c-b102-d548a4c4ffc3"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:44.796539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e1cf1eca-cd0d-4574-bb3b-825dbd92bbbc tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:44.797358 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e1cf1eca-cd0d-4574-bb3b-825dbd92bbbc tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.006582 Mar 05 20:59:44.805948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1045aa46-b8bd-43de-b662-f4f2e24df5ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:44.806780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1045aa46-b8bd-43de-b662-f4f2e24df5ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:44.808254 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1530/3044] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:59:44 2022] POST /compute/v2.1/servers => generated 175 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:59:44.809876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1045aa46-b8bd-43de-b662-f4f2e24df5ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:44.810416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1045aa46-b8bd-43de-b662-f4f2e24df5ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:44.817868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c3fcb6a6-bc1e-40c3-b1fc-d405a83c1a88 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:44.819756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c3fcb6a6-bc1e-40c3-b1fc-d405a83c1a88 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 7b9b062b-8e6a-461e-8579-d1471322a36d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:44.833038 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-c3fcb6a6-bc1e-40c3-b1fc-d405a83c1a88 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] HTTP exception thrown: Instance 7b9b062b-8e6a-461e-8579-d1471322a36d could not be found. Mar 05 20:59:44.834329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c3fcb6a6-bc1e-40c3-b1fc-d405a83c1a88 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Returning 404 to user: Instance 7b9b062b-8e6a-461e-8579-d1471322a36d could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:44.835518 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c3fcb6a6-bc1e-40c3-b1fc-d405a83c1a88 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/7b9b062b-8e6a-461e-8579-d1471322a36d/metadata" status: 404 len: 111 microversion: 2.1 time: 0.025361 Mar 05 20:59:44.850150 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1531/3045] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 20:59:44 2022] GET /compute/v2.1/servers/7b9b062b-8e6a-461e-8579-d1471322a36d/metadata => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:44.888573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eb93d973-c85a-482b-9cd2-b2b903ea5ba0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f7151f0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:44.921598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1045aa46-b8bd-43de-b662-f4f2e24df5ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:44.928267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1045aa46-b8bd-43de-b662-f4f2e24df5ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:44.928771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-1045aa46-b8bd-43de-b662-f4f2e24df5ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lazy-loading 'fault' on Instance uuid 14d447e8-00c9-45b3-b624-964a6336bbe3 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 20:59:44.973426 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eb93d973-c85a-482b-9cd2-b2b903ea5ba0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.105829 Mar 05 20:59:44.974957 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1532/3046] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:44 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:44.987178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-139e69a6-4cfa-49d7-8647-69c9b622ab9f tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-915123318", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "80991bdd-20f7-442c-b102-d548a4c4ffc3"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:44.989387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-139e69a6-4cfa-49d7-8647-69c9b622ab9f tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:44.990615 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-139e69a6-4cfa-49d7-8647-69c9b622ab9f tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.014341 Mar 05 20:59:44.992580 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1533/3047] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:59:44 2022] POST /compute/v2.1/servers => generated 687 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:59:45.006249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1045aa46-b8bd-43de-b662-f4f2e24df5ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b67d8bbe9a44898a889826e12ffb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02c2521498e48a3a5650f7b6f81d5ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:45.024667 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1045aa46-b8bd-43de-b662-f4f2e24df5ed tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 200 len: 1305 microversion: 2.1 time: 0.237417 Mar 05 20:59:45.035731 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1515/3048] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:44 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 1305 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:45.202546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-709594b9-4e9c-4562-b457-1f21036798d2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2088272992", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "80991bdd-20f7-442c-b102-d548a4c4ffc3"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:45.204111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-709594b9-4e9c-4562-b457-1f21036798d2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:45.204990 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-709594b9-4e9c-4562-b457-1f21036798d2 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.007878 Mar 05 20:59:45.205538 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1534/3049] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:59:45 2022] POST /compute/v2.1/servers => generated 689 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 20:59:45.288041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3868db62-52f0-4255-8759-a99305bf010d tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1606067687", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "80991bdd-20f7-442c-b102-d548a4c4ffc3"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:45.289592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3868db62-52f0-4255-8759-a99305bf010d tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:45.290414 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3868db62-52f0-4255-8759-a99305bf010d tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.006917 Mar 05 20:59:45.291441 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1516/3050] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:59:45 2022] POST /compute/v2.1/servers => generated 1197 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Mar 05 20:59:45.384349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aa4966f2-ade3-4b3d-ad04-0b460d7a5299 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1150915734", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "80991bdd-20f7-442c-b102-d548a4c4ffc3"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:45.385494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c71a42ef-1a3c-414c-9b94-1eac3fd9f258 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:45.386491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c71a42ef-1a3c-414c-9b94-1eac3fd9f258 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:45.389220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aa4966f2-ade3-4b3d-ad04-0b460d7a5299 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:45.393024 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aa4966f2-ade3-4b3d-ad04-0b460d7a5299 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.019312 Mar 05 20:59:45.396775 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1535/3051] 10.222.0.15 () {60 vars in 1147 bytes} [Sat Mar 5 20:59:45 2022] POST /compute/v2.1/servers => generated 2221 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Mar 05 20:59:45.406500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c71a42ef-1a3c-414c-9b94-1eac3fd9f258 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:45.407346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c71a42ef-1a3c-414c-9b94-1eac3fd9f258 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:45.409419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c71a42ef-1a3c-414c-9b94-1eac3fd9f258 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:45.410121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c71a42ef-1a3c-414c-9b94-1eac3fd9f258 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:45.417165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9728eb64-45ae-4e29-ac1c-47cfafcd5a49 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:45.418054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9728eb64-45ae-4e29-ac1c-47cfafcd5a49 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: e403302e-454f-4d01-9d68-d59463a46419] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:45.437712 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-9728eb64-45ae-4e29-ac1c-47cfafcd5a49 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] HTTP exception thrown: Instance e403302e-454f-4d01-9d68-d59463a46419 could not be found. Mar 05 20:59:45.438908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9728eb64-45ae-4e29-ac1c-47cfafcd5a49 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Returning 404 to user: Instance e403302e-454f-4d01-9d68-d59463a46419 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:45.440928 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9728eb64-45ae-4e29-ac1c-47cfafcd5a49 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/e403302e-454f-4d01-9d68-d59463a46419/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.027594 Mar 05 20:59:45.442295 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1536/3052] 10.222.0.15 () {58 vars in 1280 bytes} [Sat Mar 5 20:59:45 2022] GET /compute/v2.1/servers/e403302e-454f-4d01-9d68-d59463a46419/metadata/test2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:59:45.486664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b2da70d1-eb07-45da-b66c-3b1a9dda1def tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:45.491744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b2da70d1-eb07-45da-b66c-3b1a9dda1def tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:45.508764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2da70d1-eb07-45da-b66c-3b1a9dda1def tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:45.509981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2da70d1-eb07-45da-b66c-3b1a9dda1def tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:45.514671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2da70d1-eb07-45da-b66c-3b1a9dda1def tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:45.525930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2da70d1-eb07-45da-b66c-3b1a9dda1def tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:45.572392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b2da70d1-eb07-45da-b66c-3b1a9dda1def tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:59:45.620540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c71a42ef-1a3c-414c-9b94-1eac3fd9f258 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:45.632788 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c71a42ef-1a3c-414c-9b94-1eac3fd9f258 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 200 len: 1443 microversion: 2.1 time: 0.252807 Mar 05 20:59:45.635256 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1517/3053] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:45 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 1443 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:45.746728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-787ddcf4-9fad-41a2-8db1-3b56e6420ea7 req-6c2e11d0-ab64-49d5-a97c-552dda548960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eefc9ca-6a02-4bf8-8239-ad67aaab69b0", "name": "network-vif-deleted", "tag": "66b1650a-3e82-4d7d-b60f-82261d656e4c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:45.766729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-787ddcf4-9fad-41a2-8db1-3b56e6420ea7 req-6c2e11d0-ab64-49d5-a97c-552dda548960 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:45.769115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-787ddcf4-9fad-41a2-8db1-3b56e6420ea7 req-6c2e11d0-ab64-49d5-a97c-552dda548960 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:45.771380 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b2da70d1-eb07-45da-b66c-3b1a9dda1def tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 204 len: 0 microversion: 2.1 time: 0.305570 Mar 05 20:59:45.772493 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1537/3054] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:45 2022] DELETE /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:59:45.796109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-96b697cf-b680-41b8-a3f3-4b9d3b277c46 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:45.801741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-96b697cf-b680-41b8-a3f3-4b9d3b277c46 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:45.815486 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-787ddcf4-9fad-41a2-8db1-3b56e6420ea7 req-6c2e11d0-ab64-49d5-a97c-552dda548960 service nova] Creating event network-vif-deleted:66b1650a-3e82-4d7d-b60f-82261d656e4c for instance 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 on nch2-master-1 Mar 05 20:59:45.823344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b697cf-b680-41b8-a3f3-4b9d3b277c46 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:45.824589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b697cf-b680-41b8-a3f3-4b9d3b277c46 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:45.829091 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-787ddcf4-9fad-41a2-8db1-3b56e6420ea7 req-6c2e11d0-ab64-49d5-a97c-552dda548960 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089910 Mar 05 20:59:45.829361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b697cf-b680-41b8-a3f3-4b9d3b277c46 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:45.830387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b697cf-b680-41b8-a3f3-4b9d3b277c46 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:45.834851 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1518/3055] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:59:45.987987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cadca598-d578-4f45-a39f-a9292df8de9f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed5d31a040>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.060586 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cadca598-d578-4f45-a39f-a9292df8de9f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.077551 Mar 05 20:59:46.061191 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1519/3056] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:45 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:59:46.072543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c7837c5-a467-4777-a885-7ceeb14d9b7b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.073528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4c7837c5-a467-4777-a885-7ceeb14d9b7b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:46.096452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c7837c5-a467-4777-a885-7ceeb14d9b7b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.102545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c7837c5-a467-4777-a885-7ceeb14d9b7b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.104005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c7837c5-a467-4777-a885-7ceeb14d9b7b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.104631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c7837c5-a467-4777-a885-7ceeb14d9b7b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.143311 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4c7837c5-a467-4777-a885-7ceeb14d9b7b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance 14d447e8-00c9-45b3-b624-964a6336bbe3 could not be found. Mar 05 20:59:46.149783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c7837c5-a467-4777-a885-7ceeb14d9b7b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance 14d447e8-00c9-45b3-b624-964a6336bbe3 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:46.153176 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4c7837c5-a467-4777-a885-7ceeb14d9b7b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 404 len: 111 microversion: 2.1 time: 0.089735 Mar 05 20:59:46.157397 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1520/3057] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:46 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:46.168783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74d9812a-6a88-4dbf-82d0-dae9a0129047 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.169522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-74d9812a-6a88-4dbf-82d0-dae9a0129047 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:46.177058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74d9812a-6a88-4dbf-82d0-dae9a0129047 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.177766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74d9812a-6a88-4dbf-82d0-dae9a0129047 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.178701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74d9812a-6a88-4dbf-82d0-dae9a0129047 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.179296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74d9812a-6a88-4dbf-82d0-dae9a0129047 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.202458 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-74d9812a-6a88-4dbf-82d0-dae9a0129047 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance 14d447e8-00c9-45b3-b624-964a6336bbe3 could not be found. Mar 05 20:59:46.203525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74d9812a-6a88-4dbf-82d0-dae9a0129047 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance 14d447e8-00c9-45b3-b624-964a6336bbe3 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:46.204640 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-74d9812a-6a88-4dbf-82d0-dae9a0129047 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 404 len: 111 microversion: 2.1 time: 0.040214 Mar 05 20:59:46.206139 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1521/3058] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:46 2022] DELETE /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:46.226111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0caadf73-07ba-423a-8177-c7b6e1eecaf3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.229168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0caadf73-07ba-423a-8177-c7b6e1eecaf3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 14d447e8-00c9-45b3-b624-964a6336bbe3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:46.252125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0caadf73-07ba-423a-8177-c7b6e1eecaf3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.254525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0caadf73-07ba-423a-8177-c7b6e1eecaf3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.256571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0caadf73-07ba-423a-8177-c7b6e1eecaf3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.258335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0caadf73-07ba-423a-8177-c7b6e1eecaf3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.287629 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-0caadf73-07ba-423a-8177-c7b6e1eecaf3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance 14d447e8-00c9-45b3-b624-964a6336bbe3 could not be found. Mar 05 20:59:46.288982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0caadf73-07ba-423a-8177-c7b6e1eecaf3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance 14d447e8-00c9-45b3-b624-964a6336bbe3 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:46.290260 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0caadf73-07ba-423a-8177-c7b6e1eecaf3 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3" status: 404 len: 111 microversion: 2.1 time: 0.080003 Mar 05 20:59:46.291440 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1522/3059] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:46 2022] GET /compute/v2.1/servers/14d447e8-00c9-45b3-b624-964a6336bbe3 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:46.303976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5ee4bbd1-5a93-4fc5-8730-d4441d3876f0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.307023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5ee4bbd1-5a93-4fc5-8730-d4441d3876f0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:46.333567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5ee4bbd1-5a93-4fc5-8730-d4441d3876f0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.335100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5ee4bbd1-5a93-4fc5-8730-d4441d3876f0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.336020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5ee4bbd1-5a93-4fc5-8730-d4441d3876f0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.338794 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5ee4bbd1-5a93-4fc5-8730-d4441d3876f0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.377789 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-5ee4bbd1-5a93-4fc5-8730-d4441d3876f0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance 76292b20-5af3-4714-8d54-0207aa49129a could not be found. Mar 05 20:59:46.379475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5ee4bbd1-5a93-4fc5-8730-d4441d3876f0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance 76292b20-5af3-4714-8d54-0207aa49129a could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:46.382891 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5ee4bbd1-5a93-4fc5-8730-d4441d3876f0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 404 len: 111 microversion: 2.1 time: 0.084025 Mar 05 20:59:46.385221 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1523/3060] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:46 2022] DELETE /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:46.398717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9879684e-d22f-43a1-baa4-6084627175bc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.403491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9879684e-d22f-43a1-baa4-6084627175bc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 76292b20-5af3-4714-8d54-0207aa49129a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:46.438036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9879684e-d22f-43a1-baa4-6084627175bc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.440123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9879684e-d22f-43a1-baa4-6084627175bc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.449999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9879684e-d22f-43a1-baa4-6084627175bc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.451888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9879684e-d22f-43a1-baa4-6084627175bc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.475015 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-9879684e-d22f-43a1-baa4-6084627175bc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance 76292b20-5af3-4714-8d54-0207aa49129a could not be found. Mar 05 20:59:46.476029 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9879684e-d22f-43a1-baa4-6084627175bc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance 76292b20-5af3-4714-8d54-0207aa49129a could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:46.479430 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9879684e-d22f-43a1-baa4-6084627175bc tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a" status: 404 len: 111 microversion: 2.1 time: 0.089922 Mar 05 20:59:46.480667 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1524/3061] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:46 2022] GET /compute/v2.1/servers/76292b20-5af3-4714-8d54-0207aa49129a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:46.497669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-81157e92-daaa-480b-b802-6ddd86f7cb9e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.499131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-81157e92-daaa-480b-b802-6ddd86f7cb9e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:46.509872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81157e92-daaa-480b-b802-6ddd86f7cb9e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.510607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81157e92-daaa-480b-b802-6ddd86f7cb9e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.511784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81157e92-daaa-480b-b802-6ddd86f7cb9e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.512723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81157e92-daaa-480b-b802-6ddd86f7cb9e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.539331 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-81157e92-daaa-480b-b802-6ddd86f7cb9e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance af3b961b-384e-4246-8bee-f44c06d45447 could not be found. Mar 05 20:59:46.540833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-81157e92-daaa-480b-b802-6ddd86f7cb9e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance af3b961b-384e-4246-8bee-f44c06d45447 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:46.541890 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-81157e92-daaa-480b-b802-6ddd86f7cb9e tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 404 len: 111 microversion: 2.1 time: 0.051571 Mar 05 20:59:46.543048 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1525/3062] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:46 2022] DELETE /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:46.554818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ca0f84c4-181b-457e-b431-93dae92baa38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.557625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ca0f84c4-181b-457e-b431-93dae92baa38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: af3b961b-384e-4246-8bee-f44c06d45447] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:46.575113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-96b697cf-b680-41b8-a3f3-4b9d3b277c46 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d6a3cd79b24cf79fda0f40c3407806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf06b3ce3f3408ab9463644907a62ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:46.586238 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-96b697cf-b680-41b8-a3f3-4b9d3b277c46 tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 200 len: 1523 microversion: 2.1 time: 0.807461 Mar 05 20:59:46.590961 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1538/3063] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:45 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 1523 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:46.603298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca0f84c4-181b-457e-b431-93dae92baa38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.604739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca0f84c4-181b-457e-b431-93dae92baa38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.607737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca0f84c4-181b-457e-b431-93dae92baa38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.608365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca0f84c4-181b-457e-b431-93dae92baa38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.637492 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-ca0f84c4-181b-457e-b431-93dae92baa38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance af3b961b-384e-4246-8bee-f44c06d45447 could not be found. Mar 05 20:59:46.638435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ca0f84c4-181b-457e-b431-93dae92baa38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance af3b961b-384e-4246-8bee-f44c06d45447 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:46.641179 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ca0f84c4-181b-457e-b431-93dae92baa38 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447" status: 404 len: 111 microversion: 2.1 time: 0.094031 Mar 05 20:59:46.658138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ccb162b-c4a4-454a-8e3f-ce64fb8fd853 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.658784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ccb162b-c4a4-454a-8e3f-ce64fb8fd853 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:46.666860 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1526/3064] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:46 2022] GET /compute/v2.1/servers/af3b961b-384e-4246-8bee-f44c06d45447 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:46.674013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ccb162b-c4a4-454a-8e3f-ce64fb8fd853 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.675206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ccb162b-c4a4-454a-8e3f-ce64fb8fd853 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.677159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-944f6a4e-9b7d-4804-8759-f17cad84aab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.677846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ccb162b-c4a4-454a-8e3f-ce64fb8fd853 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.678464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ccb162b-c4a4-454a-8e3f-ce64fb8fd853 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.680163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-944f6a4e-9b7d-4804-8759-f17cad84aab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:46.695163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-944f6a4e-9b7d-4804-8759-f17cad84aab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.695914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-944f6a4e-9b7d-4804-8759-f17cad84aab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.696927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-944f6a4e-9b7d-4804-8759-f17cad84aab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.698718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-944f6a4e-9b7d-4804-8759-f17cad84aab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.719190 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-9ccb162b-c4a4-454a-8e3f-ce64fb8fd853 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] HTTP exception thrown: Instance 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 could not be found. Mar 05 20:59:46.720118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ccb162b-c4a4-454a-8e3f-ce64fb8fd853 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Returning 404 to user: Instance 6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:46.721135 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ccb162b-c4a4-454a-8e3f-ce64fb8fd853 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0" status: 404 len: 111 microversion: 2.1 time: 0.072629 Mar 05 20:59:46.723826 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1539/3065] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:46 2022] GET /compute/v2.1/servers/6eefc9ca-6a02-4bf8-8239-ad67aaab69b0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:59:46.731583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4f9ab2f0-c334-4365-a955-2b5a3765f8f7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.732430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4f9ab2f0-c334-4365-a955-2b5a3765f8f7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:46.746428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f9ab2f0-c334-4365-a955-2b5a3765f8f7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.747506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f9ab2f0-c334-4365-a955-2b5a3765f8f7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.748640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f9ab2f0-c334-4365-a955-2b5a3765f8f7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.749237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f9ab2f0-c334-4365-a955-2b5a3765f8f7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.752642 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-944f6a4e-9b7d-4804-8759-f17cad84aab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance b8a6900c-db11-4225-b22d-a9ce4efe4ce0 could not be found. Mar 05 20:59:46.755825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-944f6a4e-9b7d-4804-8759-f17cad84aab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance b8a6900c-db11-4225-b22d-a9ce4efe4ce0 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:46.758477 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-944f6a4e-9b7d-4804-8759-f17cad84aab1 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 404 len: 111 microversion: 2.1 time: 0.089625 Mar 05 20:59:46.770017 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1527/3066] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:46 2022] DELETE /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:46.785087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9345e610-4809-474a-974b-4a1aab1cbe55 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.785844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9345e610-4809-474a-974b-4a1aab1cbe55 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: b8a6900c-db11-4225-b22d-a9ce4efe4ce0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:46.794975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9345e610-4809-474a-974b-4a1aab1cbe55 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.797338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9345e610-4809-474a-974b-4a1aab1cbe55 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.803661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9345e610-4809-474a-974b-4a1aab1cbe55 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.804309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9345e610-4809-474a-974b-4a1aab1cbe55 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.825633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4f9ab2f0-c334-4365-a955-2b5a3765f8f7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 20:59:46.831481 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-9345e610-4809-474a-974b-4a1aab1cbe55 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance b8a6900c-db11-4225-b22d-a9ce4efe4ce0 could not be found. Mar 05 20:59:46.837931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9345e610-4809-474a-974b-4a1aab1cbe55 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance b8a6900c-db11-4225-b22d-a9ce4efe4ce0 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:46.840088 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9345e610-4809-474a-974b-4a1aab1cbe55 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0" status: 404 len: 111 microversion: 2.1 time: 0.068098 Mar 05 20:59:46.842951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1528/3067] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:46 2022] GET /compute/v2.1/servers/b8a6900c-db11-4225-b22d-a9ce4efe4ce0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:46.851498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ef256a18-f36b-4daa-b1a5-c5cca274555d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.852102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ef256a18-f36b-4daa-b1a5-c5cca274555d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: dd7ff36e-aca6-461f-9905-214d5b79f9bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:46.859935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef256a18-f36b-4daa-b1a5-c5cca274555d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.861180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef256a18-f36b-4daa-b1a5-c5cca274555d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.862163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef256a18-f36b-4daa-b1a5-c5cca274555d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.862757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef256a18-f36b-4daa-b1a5-c5cca274555d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.894579 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-ef256a18-f36b-4daa-b1a5-c5cca274555d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance dd7ff36e-aca6-461f-9905-214d5b79f9bb could not be found. Mar 05 20:59:46.895818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ef256a18-f36b-4daa-b1a5-c5cca274555d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance dd7ff36e-aca6-461f-9905-214d5b79f9bb could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:46.897381 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ef256a18-f36b-4daa-b1a5-c5cca274555d tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb" status: 404 len: 111 microversion: 2.1 time: 0.049768 Mar 05 20:59:46.898875 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1529/3068] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:46 2022] DELETE /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:46.914309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4657dac7-a2d3-4b85-b0b1-705096e11f4b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:46.915370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4657dac7-a2d3-4b85-b0b1-705096e11f4b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: dd7ff36e-aca6-461f-9905-214d5b79f9bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:46.931288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4657dac7-a2d3-4b85-b0b1-705096e11f4b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.932349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4657dac7-a2d3-4b85-b0b1-705096e11f4b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.933708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4657dac7-a2d3-4b85-b0b1-705096e11f4b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:46.934249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4657dac7-a2d3-4b85-b0b1-705096e11f4b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:46.955206 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4657dac7-a2d3-4b85-b0b1-705096e11f4b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance dd7ff36e-aca6-461f-9905-214d5b79f9bb could not be found. Mar 05 20:59:46.957002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4657dac7-a2d3-4b85-b0b1-705096e11f4b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance dd7ff36e-aca6-461f-9905-214d5b79f9bb could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:46.959249 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4657dac7-a2d3-4b85-b0b1-705096e11f4b tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb" status: 404 len: 111 microversion: 2.1 time: 0.048141 Mar 05 20:59:46.960241 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1530/3069] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:46 2022] GET /compute/v2.1/servers/dd7ff36e-aca6-461f-9905-214d5b79f9bb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:59:47.050089 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4f9ab2f0-c334-4365-a955-2b5a3765f8f7 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 204 len: 0 microversion: 2.1 time: 0.319948 Mar 05 20:59:47.055832 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1540/3070] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:46 2022] DELETE /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 20:59:47.064588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7027505f-2b5d-4e7d-b226-3141e8f6e1cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:47.065426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7027505f-2b5d-4e7d-b226-3141e8f6e1cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:47.077686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7027505f-2b5d-4e7d-b226-3141e8f6e1cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:47.079267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7027505f-2b5d-4e7d-b226-3141e8f6e1cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:47.081754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-56521a00-14d1-4703-8e93-269dd0c9a183 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f73b5e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:47.082378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7027505f-2b5d-4e7d-b226-3141e8f6e1cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:47.083393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7027505f-2b5d-4e7d-b226-3141e8f6e1cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:47.192444 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-56521a00-14d1-4703-8e93-269dd0c9a183 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.120101 Mar 05 20:59:47.195944 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1541/3071] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:47 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:59:47.472388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7027505f-2b5d-4e7d-b226-3141e8f6e1cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:47.489012 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7027505f-2b5d-4e7d-b226-3141e8f6e1cc tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1499 microversion: 2.1 time: 0.430346 Mar 05 20:59:47.490666 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1531/3072] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:47 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1499 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:47.637414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-90ff17d7-5d79-4c8c-a4af-6a14ce417b7a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:47.640627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-90ff17d7-5d79-4c8c-a4af-6a14ce417b7a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:47.663804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90ff17d7-5d79-4c8c-a4af-6a14ce417b7a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:47.664422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90ff17d7-5d79-4c8c-a4af-6a14ce417b7a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:47.667593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90ff17d7-5d79-4c8c-a4af-6a14ce417b7a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:47.668639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90ff17d7-5d79-4c8c-a4af-6a14ce417b7a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:48.210871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-044785a2-4319-4aea-a2e0-b57fc3e06ceb tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a8bf70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:48.341859 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-044785a2-4319-4aea-a2e0-b57fc3e06ceb tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.136749 Mar 05 20:59:48.349796 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1532/3073] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:48 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:48.364116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-72bb7f47-0469-4870-8fa2-f1fd5165fb3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:48.364116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-72bb7f47-0469-4870-8fa2-f1fd5165fb3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:48.365084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-90ff17d7-5d79-4c8c-a4af-6a14ce417b7a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d6a3cd79b24cf79fda0f40c3407806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf06b3ce3f3408ab9463644907a62ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:48.374161 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-90ff17d7-5d79-4c8c-a4af-6a14ce417b7a tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 200 len: 1523 microversion: 2.1 time: 0.764485 Mar 05 20:59:48.392963 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1542/3074] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:47 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 1523 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:48.401843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72bb7f47-0469-4870-8fa2-f1fd5165fb3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:48.402333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72bb7f47-0469-4870-8fa2-f1fd5165fb3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:48.403157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72bb7f47-0469-4870-8fa2-f1fd5165fb3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:48.403603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72bb7f47-0469-4870-8fa2-f1fd5165fb3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:48.438426 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-72bb7f47-0469-4870-8fa2-f1fd5165fb3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance e1527592-5a69-44bf-ac58-d019d5ee71ac could not be found. Mar 05 20:59:48.439245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-72bb7f47-0469-4870-8fa2-f1fd5165fb3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance e1527592-5a69-44bf-ac58-d019d5ee71ac could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:48.440221 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-72bb7f47-0469-4870-8fa2-f1fd5165fb3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 404 len: 111 microversion: 2.1 time: 0.093890 Mar 05 20:59:48.453238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1a84e951-937a-4df0-af8e-9d20f1697d3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:48.459059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1a84e951-937a-4df0-af8e-9d20f1697d3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: e1527592-5a69-44bf-ac58-d019d5ee71ac] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:48.466123 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1533/3075] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:48 2022] DELETE /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:48.478904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1a84e951-937a-4df0-af8e-9d20f1697d3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:48.489706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1a84e951-937a-4df0-af8e-9d20f1697d3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:48.490639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1a84e951-937a-4df0-af8e-9d20f1697d3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:48.491100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1a84e951-937a-4df0-af8e-9d20f1697d3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:48.509134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-06451567-795a-4ae5-a2f4-8bb71b0ef562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:48.510522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-06451567-795a-4ae5-a2f4-8bb71b0ef562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:48.530078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-06451567-795a-4ae5-a2f4-8bb71b0ef562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:48.530658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-06451567-795a-4ae5-a2f4-8bb71b0ef562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:48.532655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-06451567-795a-4ae5-a2f4-8bb71b0ef562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:48.535098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-06451567-795a-4ae5-a2f4-8bb71b0ef562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:48.536162 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-1a84e951-937a-4df0-af8e-9d20f1697d3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance e1527592-5a69-44bf-ac58-d019d5ee71ac could not be found. Mar 05 20:59:48.537979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1a84e951-937a-4df0-af8e-9d20f1697d3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance e1527592-5a69-44bf-ac58-d019d5ee71ac could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:48.542421 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1a84e951-937a-4df0-af8e-9d20f1697d3a tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac" status: 404 len: 111 microversion: 2.1 time: 0.089599 Mar 05 20:59:48.544643 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1543/3076] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:48 2022] GET /compute/v2.1/servers/e1527592-5a69-44bf-ac58-d019d5ee71ac => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:48.555649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cd5ee628-19cd-45d1-acaa-a80a43bd21e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:48.557068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cd5ee628-19cd-45d1-acaa-a80a43bd21e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:48.575559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd5ee628-19cd-45d1-acaa-a80a43bd21e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:48.576202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd5ee628-19cd-45d1-acaa-a80a43bd21e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:48.577021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd5ee628-19cd-45d1-acaa-a80a43bd21e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:48.577467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd5ee628-19cd-45d1-acaa-a80a43bd21e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:48.623961 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-cd5ee628-19cd-45d1-acaa-a80a43bd21e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance 28b49a93-adf5-4a9e-8359-60d106b3433f could not be found. Mar 05 20:59:48.624586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cd5ee628-19cd-45d1-acaa-a80a43bd21e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance 28b49a93-adf5-4a9e-8359-60d106b3433f could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:48.625438 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cd5ee628-19cd-45d1-acaa-a80a43bd21e2 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "DELETE /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 404 len: 111 microversion: 2.1 time: 0.075905 Mar 05 20:59:48.629472 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1544/3077] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 20:59:48 2022] DELETE /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:48.639335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-582ff661-050e-40d3-b4cd-f49ade8afab0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:48.648110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-582ff661-050e-40d3-b4cd-f49ade8afab0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] [instance: 28b49a93-adf5-4a9e-8359-60d106b3433f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:48.659251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-582ff661-050e-40d3-b4cd-f49ade8afab0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:48.659741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-582ff661-050e-40d3-b4cd-f49ade8afab0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:48.660719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-582ff661-050e-40d3-b4cd-f49ade8afab0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:48.664889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-582ff661-050e-40d3-b4cd-f49ade8afab0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:48.701529 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-582ff661-050e-40d3-b4cd-f49ade8afab0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] HTTP exception thrown: Instance 28b49a93-adf5-4a9e-8359-60d106b3433f could not be found. Mar 05 20:59:48.704938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-582ff661-050e-40d3-b4cd-f49ade8afab0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] Returning 404 to user: Instance 28b49a93-adf5-4a9e-8359-60d106b3433f could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:48.706290 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-582ff661-050e-40d3-b4cd-f49ade8afab0 tempest-DeleteServersTestJSON-1599485420 tempest-DeleteServersTestJSON-1599485420-project] 10.222.0.15 "GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f" status: 404 len: 111 microversion: 2.1 time: 0.075073 Mar 05 20:59:48.708834 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1545/3078] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:48 2022] GET /compute/v2.1/servers/28b49a93-adf5-4a9e-8359-60d106b3433f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 20:59:48.819285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-06451567-795a-4ae5-a2f4-8bb71b0ef562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ff43fd6998d454887c5aae39464ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c35382c7454a51ab1fbd37f9157ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:48.828737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-896b7646-9428-4935-bc5e-04a2b4a486c4 req-f164ed2f-69b1-413f-ba1c-cc804cfa09c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81ff1cf-7bf9-40ae-a814-4465e0f3783e", "name": "network-vif-deleted", "tag": "a1950e50-9c39-44c3-af17-454a8fc9713b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:48.832090 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-06451567-795a-4ae5-a2f4-8bb71b0ef562 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 200 len: 1457 microversion: 2.1 time: 0.328020 Mar 05 20:59:48.833203 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1534/3079] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:48 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 1457 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:59:48.849672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-896b7646-9428-4935-bc5e-04a2b4a486c4 req-f164ed2f-69b1-413f-ba1c-cc804cfa09c8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:48.850376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-896b7646-9428-4935-bc5e-04a2b4a486c4 req-f164ed2f-69b1-413f-ba1c-cc804cfa09c8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:48.868385 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-896b7646-9428-4935-bc5e-04a2b4a486c4 req-f164ed2f-69b1-413f-ba1c-cc804cfa09c8 service nova] Creating event network-vif-deleted:a1950e50-9c39-44c3-af17-454a8fc9713b for instance d81ff1cf-7bf9-40ae-a814-4465e0f3783e on nch2-master-1 Mar 05 20:59:48.877158 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-896b7646-9428-4935-bc5e-04a2b4a486c4 req-f164ed2f-69b1-413f-ba1c-cc804cfa09c8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062929 Mar 05 20:59:48.879010 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1546/3080] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 20:59:49.349545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5c04cad2-3cfc-4e3b-92fa-b7ec68371cbc req-1033a378-b03f-44e9-8739-81e0285aaaf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632", "name": "network-vif-deleted", "tag": "13f94710-cc92-4672-8982-8cd80e18ede8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:49.360556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1ba919f3-c7eb-40a6-9a25-2679a650af7c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f707b80>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:49.364710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5c04cad2-3cfc-4e3b-92fa-b7ec68371cbc req-1033a378-b03f-44e9-8739-81e0285aaaf2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:49.365250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5c04cad2-3cfc-4e3b-92fa-b7ec68371cbc req-1033a378-b03f-44e9-8739-81e0285aaaf2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:49.380624 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-5c04cad2-3cfc-4e3b-92fa-b7ec68371cbc req-1033a378-b03f-44e9-8739-81e0285aaaf2 service nova] Creating event network-vif-deleted:13f94710-cc92-4672-8982-8cd80e18ede8 for instance 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 on nch2-master-1 Mar 05 20:59:49.387354 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5c04cad2-3cfc-4e3b-92fa-b7ec68371cbc req-1033a378-b03f-44e9-8739-81e0285aaaf2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047485 Mar 05 20:59:49.393612 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1535/3081] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 20:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 20:59:49.401723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1d3da228-1021-493c-b662-b645291a8bfd tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:49.402719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1d3da228-1021-493c-b662-b645291a8bfd tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:49.409579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d3da228-1021-493c-b662-b645291a8bfd tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:49.410481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d3da228-1021-493c-b662-b645291a8bfd tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:49.411530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d3da228-1021-493c-b662-b645291a8bfd tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:49.412212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d3da228-1021-493c-b662-b645291a8bfd tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:49.449604 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1ba919f3-c7eb-40a6-9a25-2679a650af7c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.095342 Mar 05 20:59:49.452505 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1547/3082] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:49 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:49.636812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1d3da228-1021-493c-b662-b645291a8bfd tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d6a3cd79b24cf79fda0f40c3407806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf06b3ce3f3408ab9463644907a62ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:49.648181 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1d3da228-1021-493c-b662-b645291a8bfd tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 200 len: 1481 microversion: 2.1 time: 0.249931 Mar 05 20:59:49.649536 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1536/3083] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:49 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 1481 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:49.860507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-85f5fc05-c9cf-45e8-a12d-4490946a20e1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:49.863343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-85f5fc05-c9cf-45e8-a12d-4490946a20e1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] [instance: d81ff1cf-7bf9-40ae-a814-4465e0f3783e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:49.872232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-85f5fc05-c9cf-45e8-a12d-4490946a20e1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:49.873866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-85f5fc05-c9cf-45e8-a12d-4490946a20e1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:49.877186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-85f5fc05-c9cf-45e8-a12d-4490946a20e1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:49.878724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-85f5fc05-c9cf-45e8-a12d-4490946a20e1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:49.898699 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-85f5fc05-c9cf-45e8-a12d-4490946a20e1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] HTTP exception thrown: Instance d81ff1cf-7bf9-40ae-a814-4465e0f3783e could not be found. Mar 05 20:59:49.898699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-85f5fc05-c9cf-45e8-a12d-4490946a20e1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] Returning 404 to user: Instance d81ff1cf-7bf9-40ae-a814-4465e0f3783e could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:49.899487 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-85f5fc05-c9cf-45e8-a12d-4490946a20e1 tempest-LiveMigrationTest-958104892 tempest-LiveMigrationTest-958104892-project] 10.222.0.15 "GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e" status: 404 len: 111 microversion: 2.1 time: 0.052845 Mar 05 20:59:49.903910 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1548/3084] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:49 2022] GET /compute/v2.1/servers/d81ff1cf-7bf9-40ae-a814-4465e0f3783e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:50.466171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e550f55e-236e-4e24-b2aa-d87712ccc806 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a22670>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:50.550097 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e550f55e-236e-4e24-b2aa-d87712ccc806 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.087926 Mar 05 20:59:50.550908 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1537/3085] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:50 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:50.667039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3be0bbc3-dc10-4176-93f3-800d61c4665d tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:50.668488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3be0bbc3-dc10-4176-93f3-800d61c4665d tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] [instance: 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:50.695700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3be0bbc3-dc10-4176-93f3-800d61c4665d tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:50.696268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3be0bbc3-dc10-4176-93f3-800d61c4665d tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:50.697066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3be0bbc3-dc10-4176-93f3-800d61c4665d tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:50.702994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3be0bbc3-dc10-4176-93f3-800d61c4665d tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:50.755574 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-3be0bbc3-dc10-4176-93f3-800d61c4665d tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] HTTP exception thrown: Instance 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 could not be found. Mar 05 20:59:50.756592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3be0bbc3-dc10-4176-93f3-800d61c4665d tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] Returning 404 to user: Instance 1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 20:59:50.758446 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3be0bbc3-dc10-4176-93f3-800d61c4665d tempest-ServerMetadataNegativeTestJSON-869115227 tempest-ServerMetadataNegativeTestJSON-869115227-project] 10.222.0.15 "GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632" status: 404 len: 111 microversion: 2.1 time: 0.095907 Mar 05 20:59:50.768802 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1549/3086] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 20:59:50 2022] GET /compute/v2.1/servers/1b8dcce0-5bb4-4d2e-b4ca-9cf646ddd632 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 20:59:51.565208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-64409369-7069-48e2-874e-dd9768970052 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a81b80>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:51.631793 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-64409369-7069-48e2-874e-dd9768970052 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.071468 Mar 05 20:59:51.635905 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1538/3087] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:51 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:52.685826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-644b01f4-ad2f-49e5-890e-e7241242d037 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f7b8820>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:52.750154 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-644b01f4-ad2f-49e5-890e-e7241242d037 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.072236 Mar 05 20:59:52.752180 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1550/3088] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:52 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:53.766521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5c07e2c6-7764-4406-b7a3-205ad1e7b65e tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a9d940>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:53.850721 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5c07e2c6-7764-4406-b7a3-205ad1e7b65e tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.090056 Mar 05 20:59:53.853192 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1539/3089] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:53 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:54.441287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1514918009", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "77296972-6de3-43b0-bed8-714cdd201eac"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:54.539503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] validate_networks() for [('77296972-6de3-43b0-bed8-714cdd201eac', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:59:54.865248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6031c521-03cf-4cd9-ae40-a475fed1a1e9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a81dc0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:54.949315 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6031c521-03cf-4cd9-ae40-a475fed1a1e9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.089459 Mar 05 20:59:54.950353 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1540/3090] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:54 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 20:59:55.191008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:59:55.191556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:59:55.192689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:59:55.193585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:59:55.194396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:59:55.214534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:55.215001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:55.220405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:55.220862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:55.249907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Getting quotas for project c883b952145b45f1aaf4b0d244ff60f9. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 20:59:55.256098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Getting quotas for user 8867c9e115844488b679f53829a9d46f and project c883b952145b45f1aaf4b0d244ff60f9. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 20:59:55.274216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 20:59:55.277151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 20:59:55.383661 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-adff71b9-d463-45dc-84ca-f4fdf2c0d3c3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.323927 Mar 05 20:59:55.403906 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1551/3091] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 20:59:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 05 20:59:55.414085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b5c9e50-19c8-4095-a1ed-43280c6f444e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:55.414945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4b5c9e50-19c8-4095-a1ed-43280c6f444e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:55.533953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4b5c9e50-19c8-4095-a1ed-43280c6f444e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:55.541813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4b5c9e50-19c8-4095-a1ed-43280c6f444e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:55.554136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4b5c9e50-19c8-4095-a1ed-43280c6f444e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:55.555365 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4b5c9e50-19c8-4095-a1ed-43280c6f444e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 200 len: 1262 microversion: 2.26 time: 0.145425 Mar 05 20:59:55.577266 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1541/3092] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:59:55 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 1262 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:59:55.965221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cd84f1be-0fa3-4802-b937-7d56986e7bdd tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f6d0790>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:56.047220 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cd84f1be-0fa3-4802-b937-7d56986e7bdd tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.087763 Mar 05 20:59:56.053536 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1552/3093] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:55 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:56.573470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f5a0edcc-a62b-4ebf-a432-f495ded78a09 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:56.574007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f5a0edcc-a62b-4ebf-a432-f495ded78a09 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:56.598354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5a0edcc-a62b-4ebf-a432-f495ded78a09 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:56.599090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5a0edcc-a62b-4ebf-a432-f495ded78a09 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:56.600099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5a0edcc-a62b-4ebf-a432-f495ded78a09 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:56.600693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5a0edcc-a62b-4ebf-a432-f495ded78a09 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:56.809627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f5a0edcc-a62b-4ebf-a432-f495ded78a09 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:56.819433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f5a0edcc-a62b-4ebf-a432-f495ded78a09 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:56.820996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f5a0edcc-a62b-4ebf-a432-f495ded78a09 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:56.822148 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f5a0edcc-a62b-4ebf-a432-f495ded78a09 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 200 len: 1258 microversion: 2.26 time: 0.252690 Mar 05 20:59:56.822723 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1542/3094] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:59:56 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 1258 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:59:57.062789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e8470f7f-372e-4c9a-b485-413eb0863b25 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f7b8dc0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:57.179302 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e8470f7f-372e-4c9a-b485-413eb0863b25 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.121732 Mar 05 20:59:57.180317 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1553/3095] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:57 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:57.851522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2a08227f-dea1-4aaf-9323-eeb5e6c5b7fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:57.855083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2a08227f-dea1-4aaf-9323-eeb5e6c5b7fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:57.909634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a08227f-dea1-4aaf-9323-eeb5e6c5b7fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:57.911598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a08227f-dea1-4aaf-9323-eeb5e6c5b7fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:57.916306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a08227f-dea1-4aaf-9323-eeb5e6c5b7fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:57.924144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a08227f-dea1-4aaf-9323-eeb5e6c5b7fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:58.177148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1895217842", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "d74d376a-0a45-4915-b0da-56d17c1f19d7"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 20:59:58.203010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2a08227f-dea1-4aaf-9323-eeb5e6c5b7fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:58.213427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2a08227f-dea1-4aaf-9323-eeb5e6c5b7fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:58.223443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2a08227f-dea1-4aaf-9323-eeb5e6c5b7fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:58.225496 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2a08227f-dea1-4aaf-9323-eeb5e6c5b7fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 200 len: 1320 microversion: 2.26 time: 0.382793 Mar 05 20:59:58.239943 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1554/3096] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:59:57 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 1320 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:59:58.245925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a136bbd2-7873-46ab-a6ff-ae03efa46afa tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f73b700>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:58.307960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] validate_networks() for [('d74d376a-0a45-4915-b0da-56d17c1f19d7', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 20:59:58.330651 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a136bbd2-7873-46ab-a6ff-ae03efa46afa tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.089559 Mar 05 20:59:58.331631 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1555/3097] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:58 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:59.254524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-266fa172-9055-417f-b69e-12731adc1bdb tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:59.254524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-266fa172-9055-417f-b69e-12731adc1bdb tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 20:59:59.264353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-266fa172-9055-417f-b69e-12731adc1bdb tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:59.264819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-266fa172-9055-417f-b69e-12731adc1bdb tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:59.265758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-266fa172-9055-417f-b69e-12731adc1bdb tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:59.284381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-266fa172-9055-417f-b69e-12731adc1bdb tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:59.553145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-266fa172-9055-417f-b69e-12731adc1bdb tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:59.570219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-266fa172-9055-417f-b69e-12731adc1bdb tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:59.574981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-266fa172-9055-417f-b69e-12731adc1bdb tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 20:59:59.576294 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-266fa172-9055-417f-b69e-12731adc1bdb tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 200 len: 1362 microversion: 2.26 time: 0.333204 Mar 05 20:59:59.586819 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1556/3098] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 20:59:59 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 20:59:59.593523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7413437d-2eb8-4c53-bf88-c7a1f852e373 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f6d0a60>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 20:59:59.687958 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7413437d-2eb8-4c53-bf88-c7a1f852e373 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.109535 Mar 05 20:59:59.688679 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1557/3099] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 20:59:59 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 20:59:59.947832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 20:59:59.948366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 20:59:59.948755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 20:59:59.949168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 20:59:59.949583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 20:59:59.966754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:59.967212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 20:59:59.971867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 20:59:59.972375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:00.060627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Getting quotas for project fa686c12d54e49ceaa2ce991119294e4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:00:00.080619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Getting quotas for user fc62e97c4f024cd183c380c0be7b4a0d and project fa686c12d54e49ceaa2ce991119294e4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:00:00.080794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bc72bf13-a8cd-4837-978c-4f95fe94275f tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:00.086500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bc72bf13-a8cd-4837-978c-4f95fe94275f tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:00.095563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bc72bf13-a8cd-4837-978c-4f95fe94275f tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Searching by: {'deleted': False, 'project_id': '4629462cb9c24128921119298bb0655c'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 21:00:00.114299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc72bf13-a8cd-4837-978c-4f95fe94275f tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:00.114770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc72bf13-a8cd-4837-978c-4f95fe94275f tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:00.123951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc72bf13-a8cd-4837-978c-4f95fe94275f tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:00.124434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc72bf13-a8cd-4837-978c-4f95fe94275f tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:00.130556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:00:00.138694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:00:00.213747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-bc72bf13-a8cd-4837-978c-4f95fe94275f tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 21:00:00.228617 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d2d9213a-aad7-4507-b5b2-9eb2f8a9d527 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.721721 Mar 05 21:00:00.230939 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1543/3100] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 20:59:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:00:00.249837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-54b2ceaf-70b8-45a4-bbb7-ed02f05e91f4 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:00.253224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-54b2ceaf-70b8-45a4-bbb7-ed02f05e91f4 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:00.382622 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bc72bf13-a8cd-4837-978c-4f95fe94275f tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.306490 Mar 05 21:00:00.398316 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1558/3101] 10.222.0.15 () {58 vars in 1124 bytes} [Sat Mar 5 21:00:00 2022] GET /compute/v2.1/servers => generated 340 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:00.424502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-54b2ceaf-70b8-45a4-bbb7-ed02f05e91f4 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:00.430850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ae9be249-6ea3-4b55-aed7-85ea60c05ed7 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:00.433365 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-54b2ceaf-70b8-45a4-bbb7-ed02f05e91f4 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1218 microversion: 2.1 time: 0.194400 Mar 05 21:00:00.436481 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1544/3102] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:00 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1218 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:00.451046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ae9be249-6ea3-4b55-aed7-85ea60c05ed7 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:00.452240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ae9be249-6ea3-4b55-aed7-85ea60c05ed7 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Searching by: {'deleted': False, 'project_id': '4629462cb9c24128921119298bb0655c'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 21:00:00.477012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae9be249-6ea3-4b55-aed7-85ea60c05ed7 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:00.477474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae9be249-6ea3-4b55-aed7-85ea60c05ed7 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:00.478282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae9be249-6ea3-4b55-aed7-85ea60c05ed7 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:00.478718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae9be249-6ea3-4b55-aed7-85ea60c05ed7 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:00.555636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-ae9be249-6ea3-4b55-aed7-85ea60c05ed7 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 21:00:00.597782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2d7f1fd6-d7ba-4b4d-afdf-0582e4446345 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:00.598681 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2d7f1fd6-d7ba-4b4d-afdf-0582e4446345 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:00.632665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d7f1fd6-d7ba-4b4d-afdf-0582e4446345 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:00.633129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d7f1fd6-d7ba-4b4d-afdf-0582e4446345 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:00.634641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d7f1fd6-d7ba-4b4d-afdf-0582e4446345 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:00.635586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d7f1fd6-d7ba-4b4d-afdf-0582e4446345 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:00.655420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ae9be249-6ea3-4b55-aed7-85ea60c05ed7 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:00.680523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae9be249-6ea3-4b55-aed7-85ea60c05ed7 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:00.684545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae9be249-6ea3-4b55-aed7-85ea60c05ed7 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:00.932932 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ae9be249-6ea3-4b55-aed7-85ea60c05ed7 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.533494 Mar 05 21:00:00.933696 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1559/3103] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 21:00:00 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:00.939963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-15fba1ab-d663-4636-8262-b7071b6cc68a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f736670>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:00.990153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d7f1fd6-d7ba-4b4d-afdf-0582e4446345 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:00.999607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d7f1fd6-d7ba-4b4d-afdf-0582e4446345 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:01.014679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d7f1fd6-d7ba-4b4d-afdf-0582e4446345 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:01.015954 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2d7f1fd6-d7ba-4b4d-afdf-0582e4446345 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 200 len: 1362 microversion: 2.26 time: 0.425411 Mar 05 21:00:01.016603 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1545/3104] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:00:00 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 1362 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:00:01.040064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1579cb2f-ad1b-4688-917f-d2bd43b56cc3 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:01.041382 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-15fba1ab-d663-4636-8262-b7071b6cc68a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1454 microversion: 2.1 time: 0.106323 Mar 05 21:00:01.042058 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1560/3105] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:00 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:01.060462 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1579cb2f-ad1b-4688-917f-d2bd43b56cc3 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028103 Mar 05 21:00:01.062223 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1546/3106] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 21:00:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:01.124751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-800b4820-ada8-4c06-b907-0601c6244c6e req-c56207b5-05e0-46ab-b457-4a6f63caaf77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ce4c56-73a5-49a1-900b-0e76692a4365", "tag": "7c055f59-15ed-4a63-957d-f6ef57627bab"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:01.141781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-800b4820-ada8-4c06-b907-0601c6244c6e req-c56207b5-05e0-46ab-b457-4a6f63caaf77 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:01.142659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-800b4820-ada8-4c06-b907-0601c6244c6e req-c56207b5-05e0-46ab-b457-4a6f63caaf77 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:01.156796 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-800b4820-ada8-4c06-b907-0601c6244c6e req-c56207b5-05e0-46ab-b457-4a6f63caaf77 service nova] Creating event network-changed:7c055f59-15ed-4a63-957d-f6ef57627bab for instance 60ce4c56-73a5-49a1-900b-0e76692a4365 on nch1-master-1 Mar 05 21:00:01.163315 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-800b4820-ada8-4c06-b907-0601c6244c6e req-c56207b5-05e0-46ab-b457-4a6f63caaf77 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059552 Mar 05 21:00:01.163981 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1561/3107] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:01.407263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f79e22e8-b82a-4a45-b3cb-5ac11c3acfe6 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:01.410522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f79e22e8-b82a-4a45-b3cb-5ac11c3acfe6 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:01.421371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f79e22e8-b82a-4a45-b3cb-5ac11c3acfe6 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:01.423443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f79e22e8-b82a-4a45-b3cb-5ac11c3acfe6 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:01.426934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f79e22e8-b82a-4a45-b3cb-5ac11c3acfe6 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:01.427616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f79e22e8-b82a-4a45-b3cb-5ac11c3acfe6 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:01.467237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-be1fa6e3-494b-4de8-8c49-744f9efd0c58 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:01.467992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-be1fa6e3-494b-4de8-8c49-744f9efd0c58 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:01.485181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be1fa6e3-494b-4de8-8c49-744f9efd0c58 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:01.488245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be1fa6e3-494b-4de8-8c49-744f9efd0c58 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:01.489471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be1fa6e3-494b-4de8-8c49-744f9efd0c58 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:01.490783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be1fa6e3-494b-4de8-8c49-744f9efd0c58 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:01.519067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f79e22e8-b82a-4a45-b3cb-5ac11c3acfe6 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:00:01.622369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-be1fa6e3-494b-4de8-8c49-744f9efd0c58 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:01.632477 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-be1fa6e3-494b-4de8-8c49-744f9efd0c58 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1270 microversion: 2.1 time: 0.181844 Mar 05 21:00:01.643087 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1562/3108] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:01 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1270 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:00:01.692842 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f79e22e8-b82a-4a45-b3cb-5ac11c3acfe6 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "DELETE /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 204 len: 0 microversion: 2.1 time: 0.292860 Mar 05 21:00:01.693828 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1547/3109] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:00:01 2022] DELETE /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:00:01.706078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7dd2466a-c076-4b25-8c56-baccb77c4548 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:01.707197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7dd2466a-c076-4b25-8c56-baccb77c4548 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:01.714947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7dd2466a-c076-4b25-8c56-baccb77c4548 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:01.716231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7dd2466a-c076-4b25-8c56-baccb77c4548 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:01.717977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7dd2466a-c076-4b25-8c56-baccb77c4548 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:01.718801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7dd2466a-c076-4b25-8c56-baccb77c4548 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:02.154276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1ffa6ee9-c8bb-4741-a660-465dc8370bf0 tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Action: 'update', calling method: .version_select at 0x7fed4f73bb80>, body: {"quota_set": {"ram": "5120"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:02.180796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7dd2466a-c076-4b25-8c56-baccb77c4548 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:02.189635 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7dd2466a-c076-4b25-8c56-baccb77c4548 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1716 microversion: 2.1 time: 0.491808 Mar 05 21:00:02.208546 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1548/3110] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:01 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1716 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:02.218589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8a1c1200-fdf5-4ad9-b487-8def3fe19f60 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:02.226377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8a1c1200-fdf5-4ad9-b487-8def3fe19f60 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:02.248025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8a1c1200-fdf5-4ad9-b487-8def3fe19f60 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:02.249604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8a1c1200-fdf5-4ad9-b487-8def3fe19f60 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:02.251958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8a1c1200-fdf5-4ad9-b487-8def3fe19f60 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:02.252825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8a1c1200-fdf5-4ad9-b487-8def3fe19f60 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:02.564481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ffa6ee9-c8bb-4741-a660-465dc8370bf0 tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:02.565813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ffa6ee9-c8bb-4741-a660-465dc8370bf0 tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:02.566786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ffa6ee9-c8bb-4741-a660-465dc8370bf0 tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:02.567397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ffa6ee9-c8bb-4741-a660-465dc8370bf0 tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:02.643445 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1ffa6ee9-c8bb-4741-a660-465dc8370bf0 tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/83e719d28d5f457689661c5ee1561216" status: 200 len: 240 microversion: 2.36 time: 0.998919 Mar 05 21:00:02.644237 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1563/3111] 10.222.0.15 () {62 vars in 1302 bytes} [Sat Mar 5 21:00:01 2022] PUT /compute/v2.1/os-quota-sets/83e719d28d5f457689661c5ee1561216 => generated 240 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:00:02.649503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-18e9494d-36c8-45cf-beca-72b4dfed2e2c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f6e7040>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:02.713534 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-18e9494d-36c8-45cf-beca-72b4dfed2e2c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1463 microversion: 2.1 time: 0.068055 Mar 05 21:00:02.723531 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1564/3112] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:02 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1463 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:02.728785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a4d690a0-efdf-4481-b336-dfbdd7cbfc09 tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Calling method '.version_select at 0x7fed4f6d60d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:02.743004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8a1c1200-fdf5-4ad9-b487-8def3fe19f60 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:02.756632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8a1c1200-fdf5-4ad9-b487-8def3fe19f60 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:02.758250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8a1c1200-fdf5-4ad9-b487-8def3fe19f60 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:02.759434 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8a1c1200-fdf5-4ad9-b487-8def3fe19f60 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 200 len: 1362 microversion: 2.26 time: 0.549464 Mar 05 21:00:02.772041 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1549/3113] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:00:02 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 1362 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:00:02.777141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4ded6af3-2108-4303-9039-2f4a74810088 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:02.777777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4ded6af3-2108-4303-9039-2f4a74810088 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:02.806386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ded6af3-2108-4303-9039-2f4a74810088 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:02.806849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ded6af3-2108-4303-9039-2f4a74810088 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:02.808153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ded6af3-2108-4303-9039-2f4a74810088 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:02.808609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ded6af3-2108-4303-9039-2f4a74810088 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:03.121101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4d690a0-efdf-4481-b336-dfbdd7cbfc09 tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:03.121653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4d690a0-efdf-4481-b336-dfbdd7cbfc09 tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:03.122521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4d690a0-efdf-4481-b336-dfbdd7cbfc09 tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:03.123182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4d690a0-efdf-4481-b336-dfbdd7cbfc09 tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:03.145971 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a4d690a0-efdf-4481-b336-dfbdd7cbfc09 tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/83e719d28d5f457689661c5ee1561216/detail" status: 200 len: 672 microversion: 2.36 time: 0.420925 Mar 05 21:00:03.154250 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1565/3114] 10.222.0.15 () {60 vars in 1303 bytes} [Sat Mar 5 21:00:02 2022] GET /compute/v2.1/os-quota-sets/83e719d28d5f457689661c5ee1561216/detail => generated 672 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:00:03.154250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-66a0be2b-f913-4561-acad-1ec0291038ef tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f74b040>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:03.227436 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-66a0be2b-f913-4561-acad-1ec0291038ef tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 200 len: 1463 microversion: 2.1 time: 0.079342 Mar 05 21:00:03.231074 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1566/3115] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:03 2022] GET /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 1463 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:03.237469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9b180b7f-2db6-4729-8a28-9a322aa2c5cc tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:03.243108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9b180b7f-2db6-4729-8a28-9a322aa2c5cc tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:03.263893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9b180b7f-2db6-4729-8a28-9a322aa2c5cc tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:03.264364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9b180b7f-2db6-4729-8a28-9a322aa2c5cc tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:03.265153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9b180b7f-2db6-4729-8a28-9a322aa2c5cc tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:03.265784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9b180b7f-2db6-4729-8a28-9a322aa2c5cc tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:03.447427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4ded6af3-2108-4303-9039-2f4a74810088 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:03.458958 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4ded6af3-2108-4303-9039-2f4a74810088 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1318 microversion: 2.1 time: 0.685706 Mar 05 21:00:03.459700 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1550/3116] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:02 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1318 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:03.495113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5814380f-8e9d-474f-b511-f7bca01a2aa0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:03.498913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5814380f-8e9d-474f-b511-f7bca01a2aa0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:03.514627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5814380f-8e9d-474f-b511-f7bca01a2aa0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:03.515227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5814380f-8e9d-474f-b511-f7bca01a2aa0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:03.518508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5814380f-8e9d-474f-b511-f7bca01a2aa0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:03.519734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5814380f-8e9d-474f-b511-f7bca01a2aa0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:03.926080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9b180b7f-2db6-4729-8a28-9a322aa2c5cc tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:03.936797 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9b180b7f-2db6-4729-8a28-9a322aa2c5cc tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1716 microversion: 2.1 time: 0.703696 Mar 05 21:00:03.939722 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1567/3117] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:03 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1716 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:03.944688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1c11f7bc-e963-4d5e-b6c3-0a7f2857437b tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Action: 'update', calling method: .version_select at 0x7fed4f74b820>, body: {"quota_set": {"ram": "2048"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:04.400131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5814380f-8e9d-474f-b511-f7bca01a2aa0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:04.408632 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5814380f-8e9d-474f-b511-f7bca01a2aa0 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1467 microversion: 2.1 time: 0.930927 Mar 05 21:00:04.409206 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1551/3118] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:03 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1467 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:04.420032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1ac2f321-d755-42a8-9a96-a86f63d448fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:04.420032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1ac2f321-d755-42a8-9a96-a86f63d448fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:04.434513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ac2f321-d755-42a8-9a96-a86f63d448fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:04.434965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ac2f321-d755-42a8-9a96-a86f63d448fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:04.435858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ac2f321-d755-42a8-9a96-a86f63d448fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:04.436300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ac2f321-d755-42a8-9a96-a86f63d448fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:04.497004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c11f7bc-e963-4d5e-b6c3-0a7f2857437b tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:04.497460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c11f7bc-e963-4d5e-b6c3-0a7f2857437b tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:04.498261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c11f7bc-e963-4d5e-b6c3-0a7f2857437b tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:04.498703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c11f7bc-e963-4d5e-b6c3-0a7f2857437b tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:04.599390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c11f7bc-e963-4d5e-b6c3-0a7f2857437b tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:04.599878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c11f7bc-e963-4d5e-b6c3-0a7f2857437b tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:04.600735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c11f7bc-e963-4d5e-b6c3-0a7f2857437b tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:04.601178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c11f7bc-e963-4d5e-b6c3-0a7f2857437b tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:04.724251 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1c11f7bc-e963-4d5e-b6c3-0a7f2857437b tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-quota-sets/83e719d28d5f457689661c5ee1561216?user_id=4554c1cd95c04330a546927a835f210e" status: 200 len: 240 microversion: 2.36 time: 0.783079 Mar 05 21:00:04.737981 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1568/3119] 10.222.0.15 () {62 vars in 1383 bytes} [Sat Mar 5 21:00:03 2022] PUT /compute/v2.1/os-quota-sets/83e719d28d5f457689661c5ee1561216?user_id=4554c1cd95c04330a546927a835f210e => generated 240 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:00:04.750874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8bca23ee-a445-4c57-a190-df79684da892 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-475942001"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:04.753478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8bca23ee-a445-4c57-a190-df79684da892 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: 00a6114e-7710-4ccf-b462-bb8c98001725] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:04.771457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bca23ee-a445-4c57-a190-df79684da892 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:04.774284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bca23ee-a445-4c57-a190-df79684da892 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:04.777028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bca23ee-a445-4c57-a190-df79684da892 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:04.777703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bca23ee-a445-4c57-a190-df79684da892 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:04.917908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1ac2f321-d755-42a8-9a96-a86f63d448fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:04.933333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1ac2f321-d755-42a8-9a96-a86f63d448fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:04.936498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1ac2f321-d755-42a8-9a96-a86f63d448fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:04.941661 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1ac2f321-d755-42a8-9a96-a86f63d448fc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 200 len: 1362 microversion: 2.26 time: 0.531414 Mar 05 21:00:04.942573 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1552/3120] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:00:04 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 1362 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:00:04.952151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f4daf88a-099e-41e7-932a-6b2d7deb833c req-5d1d0706-0cc1-447f-9fa5-ac0658e67f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f0ba2b9-85e8-4b78-91be-461650cff33f", "tag": "55bf9cc0-eea1-4e21-b8d6-e730f4a85fe8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:04.972028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f4daf88a-099e-41e7-932a-6b2d7deb833c req-5d1d0706-0cc1-447f-9fa5-ac0658e67f56 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:04.972925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f4daf88a-099e-41e7-932a-6b2d7deb833c req-5d1d0706-0cc1-447f-9fa5-ac0658e67f56 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:05.009163 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f4daf88a-099e-41e7-932a-6b2d7deb833c req-5d1d0706-0cc1-447f-9fa5-ac0658e67f56 service nova] Creating event network-changed:55bf9cc0-eea1-4e21-b8d6-e730f4a85fe8 for instance 9f0ba2b9-85e8-4b78-91be-461650cff33f on nch2-master-1 Mar 05 21:00:05.035219 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f4daf88a-099e-41e7-932a-6b2d7deb833c req-5d1d0706-0cc1-447f-9fa5-ac0658e67f56 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088805 Mar 05 21:00:05.035883 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1553/3121] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:05.048372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-43b755f9-3082-457e-9fb5-8e47d8ebc6b2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:05.049122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-43b755f9-3082-457e-9fb5-8e47d8ebc6b2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:05.084007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43b755f9-3082-457e-9fb5-8e47d8ebc6b2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:05.085038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43b755f9-3082-457e-9fb5-8e47d8ebc6b2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:05.086109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43b755f9-3082-457e-9fb5-8e47d8ebc6b2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:05.088108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43b755f9-3082-457e-9fb5-8e47d8ebc6b2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:05.464578 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8bca23ee-a445-4c57-a190-df79684da892 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "POST /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725/action" status: 202 len: 0 microversion: 2.1 time: 0.724222 Mar 05 21:00:05.466784 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1569/3122] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:00:04 2022] POST /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725/action => generated 0 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 21:00:05.478576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-84249fbd-4d0f-4f17-9a15-e39169fac0ca tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] Calling method '.version_select at 0x7fed5c5f7160>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:05.529510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-43b755f9-3082-457e-9fb5-8e47d8ebc6b2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:05.539835 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-43b755f9-3082-457e-9fb5-8e47d8ebc6b2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1318 microversion: 2.1 time: 0.502687 Mar 05 21:00:05.540771 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1554/3123] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:05 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:05.556732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-63730353-1af4-457e-9091-13e1801697c5 req-54f57b8d-2a4c-420b-be5d-60d82cd0eaa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827e53bd-cd06-4f93-8232-243003d885f4", "name": "network-vif-unplugged", "status": "completed", "tag": "d8af58c4-4388-479a-9490-64f82575af6b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:05.572829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-63730353-1af4-457e-9091-13e1801697c5 req-54f57b8d-2a4c-420b-be5d-60d82cd0eaa9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:05.575080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-63730353-1af4-457e-9091-13e1801697c5 req-54f57b8d-2a4c-420b-be5d-60d82cd0eaa9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:05.602785 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-63730353-1af4-457e-9091-13e1801697c5 req-54f57b8d-2a4c-420b-be5d-60d82cd0eaa9 service nova] Creating event network-vif-unplugged:d8af58c4-4388-479a-9490-64f82575af6b for instance 827e53bd-cd06-4f93-8232-243003d885f4 on nch2-master-1 Mar 05 21:00:05.609813 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-63730353-1af4-457e-9091-13e1801697c5 req-54f57b8d-2a4c-420b-be5d-60d82cd0eaa9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067713 Mar 05 21:00:05.611121 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1555/3124] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:05.619156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e3db1d61-4ab7-44d1-a57e-27f5873d1b40 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:05.621105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e3db1d61-4ab7-44d1-a57e-27f5873d1b40 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:05.629423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3db1d61-4ab7-44d1-a57e-27f5873d1b40 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:05.630086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3db1d61-4ab7-44d1-a57e-27f5873d1b40 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:05.631408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3db1d61-4ab7-44d1-a57e-27f5873d1b40 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:05.632135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3db1d61-4ab7-44d1-a57e-27f5873d1b40 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:05.753710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e3db1d61-4ab7-44d1-a57e-27f5873d1b40 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9443ac1e9d174c70a22e40d844dcae27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4629462cb9c24128921119298bb0655c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:05.772215 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e3db1d61-4ab7-44d1-a57e-27f5873d1b40 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 200 len: 1648 microversion: 2.1 time: 0.159528 Mar 05 21:00:05.773383 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1556/3125] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:05 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 1648 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:05.936178 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-84249fbd-4d0f-4f17-9a15-e39169fac0ca tempest-QuotasAdminTestV236-1392898519 tempest-QuotasAdminTestV236-1392898519-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/83e719d28d5f457689661c5ee1561216?user_id=4554c1cd95c04330a546927a835f210e" status: 200 len: 282 microversion: 2.36 time: 0.467779 Mar 05 21:00:05.943899 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1570/3126] 10.222.0.15 () {60 vars in 1363 bytes} [Sat Mar 5 21:00:05 2022] GET /compute/v2.1/os-quota-sets/83e719d28d5f457689661c5ee1561216?user_id=4554c1cd95c04330a546927a835f210e => generated 282 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:00:05.969229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4177631e-89d2-458f-9baa-a6cef0f358c1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f7369d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:06.066255 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4177631e-89d2-458f-9baa-a6cef0f358c1 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.121129 Mar 05 21:00:06.067244 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1571/3127] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:05 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:06.072840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-71f7ca6d-5dd0-47cf-a68f-58746c8d037e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:06.074051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-71f7ca6d-5dd0-47cf-a68f-58746c8d037e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:06.082604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71f7ca6d-5dd0-47cf-a68f-58746c8d037e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:06.083412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71f7ca6d-5dd0-47cf-a68f-58746c8d037e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:06.084919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71f7ca6d-5dd0-47cf-a68f-58746c8d037e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:06.086132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71f7ca6d-5dd0-47cf-a68f-58746c8d037e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:06.300126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-439369107", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "264b845f-29b5-449f-8fc8-89fd683fcf0e"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:06.417868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] validate_networks() for [('264b845f-29b5-449f-8fc8-89fd683fcf0e', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:00:06.700772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-71f7ca6d-5dd0-47cf-a68f-58746c8d037e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:06.717877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-71f7ca6d-5dd0-47cf-a68f-58746c8d037e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:06.723504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-71f7ca6d-5dd0-47cf-a68f-58746c8d037e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:06.725869 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-71f7ca6d-5dd0-47cf-a68f-58746c8d037e tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 200 len: 1362 microversion: 2.26 time: 0.657348 Mar 05 21:00:06.729148 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1572/3128] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:00:06 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 1362 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:00:06.745666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-26820c9f-aad5-4c67-97e0-ddcaa42593e4 req-bb91d2cf-0374-4eeb-8791-68ce12c1fba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827e53bd-cd06-4f93-8232-243003d885f4", "name": "network-vif-deleted", "tag": "d8af58c4-4388-479a-9490-64f82575af6b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:06.768467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-26820c9f-aad5-4c67-97e0-ddcaa42593e4 req-bb91d2cf-0374-4eeb-8791-68ce12c1fba1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:06.768931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-26820c9f-aad5-4c67-97e0-ddcaa42593e4 req-bb91d2cf-0374-4eeb-8791-68ce12c1fba1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:06.801277 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-26820c9f-aad5-4c67-97e0-ddcaa42593e4 req-bb91d2cf-0374-4eeb-8791-68ce12c1fba1 service nova] Creating event network-vif-deleted:d8af58c4-4388-479a-9490-64f82575af6b for instance 827e53bd-cd06-4f93-8232-243003d885f4 on nch2-master-1 Mar 05 21:00:06.814437 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-26820c9f-aad5-4c67-97e0-ddcaa42593e4 req-bb91d2cf-0374-4eeb-8791-68ce12c1fba1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081605 Mar 05 21:00:06.815358 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1573/3129] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:06.821656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6bdf8436-9429-482d-b577-a45a01998391 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:06.822531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6bdf8436-9429-482d-b577-a45a01998391 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:06.831155 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bdf8436-9429-482d-b577-a45a01998391 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:06.831923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bdf8436-9429-482d-b577-a45a01998391 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:06.833261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bdf8436-9429-482d-b577-a45a01998391 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:06.833914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bdf8436-9429-482d-b577-a45a01998391 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:07.295364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:00:07.295830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:00:07.296733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:00:07.298729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:00:07.299361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:00:07.315208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:07.317064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:07.319063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:07.323149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:07.376498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Getting quotas for project 2fe78275333a4f76b61435e6afaf7a53. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:00:07.389360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Getting quotas for user 709aeb5f8ccb49b38e4971bb5c8f53f9 and project 2fe78275333a4f76b61435e6afaf7a53. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:00:07.427843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:00:07.430457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:00:07.483917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6bdf8436-9429-482d-b577-a45a01998391 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:07.504390 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6bdf8436-9429-482d-b577-a45a01998391 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1318 microversion: 2.1 time: 0.687370 Mar 05 21:00:07.504989 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1574/3130] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:06 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1318 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:07.521350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9e9c6281-63fe-45f9-a7e5-c774f1771bce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:07.522165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9e9c6281-63fe-45f9-a7e5-c774f1771bce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] [instance: 827e53bd-cd06-4f93-8232-243003d885f4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:07.537640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e9c6281-63fe-45f9-a7e5-c774f1771bce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:07.539414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e9c6281-63fe-45f9-a7e5-c774f1771bce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:07.543276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e9c6281-63fe-45f9-a7e5-c774f1771bce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:07.543988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e9c6281-63fe-45f9-a7e5-c774f1771bce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:07.557669 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f919b3e8-9524-45fe-aebe-6f8cce7c984a tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.783062 Mar 05 21:00:07.559694 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1557/3131] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:00:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:00:07.573964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1a981af8-e70f-4032-9179-3440b5c70e76 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61ab3310>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:07.578334 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-9e9c6281-63fe-45f9-a7e5-c774f1771bce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] HTTP exception thrown: Instance 827e53bd-cd06-4f93-8232-243003d885f4 could not be found. Mar 05 21:00:07.578334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9e9c6281-63fe-45f9-a7e5-c774f1771bce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Returning 404 to user: Instance 827e53bd-cd06-4f93-8232-243003d885f4 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:00:07.579661 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9e9c6281-63fe-45f9-a7e5-c774f1771bce tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4" status: 404 len: 111 microversion: 2.1 time: 0.071262 Mar 05 21:00:07.584201 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1575/3132] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:07 2022] GET /compute/v2.1/servers/827e53bd-cd06-4f93-8232-243003d885f4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:00:07.599216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eac78e0f-4aa6-468d-b6f4-c1f677017c3c tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:07.600882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eac78e0f-4aa6-468d-b6f4-c1f677017c3c tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:07.696929 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1a981af8-e70f-4032-9179-3440b5c70e76 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.135877 Mar 05 21:00:07.699062 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1558/3133] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:07 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:07.711114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fbbe55db-d454-48df-aa53-453693123ed0 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] Calling method '.version_select at 0x7fed61a8e3a0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:07.723899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eac78e0f-4aa6-468d-b6f4-c1f677017c3c tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:07.731936 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eac78e0f-4aa6-468d-b6f4-c1f677017c3c tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1227 microversion: 2.1 time: 0.146918 Mar 05 21:00:07.736245 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1576/3134] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:07 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1227 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:07.741697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ec3d0e0a-88a3-46a0-bf3b-b315a3ef0f76 req-7054eef5-3527-4bd7-9049-8cf2f87066a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc23752-0101-4c2b-a90f-6ccad692e3f3", "name": "network-vif-unplugged", "status": "completed", "tag": "d89b87d8-65fa-4882-ac07-f0f70c7ec7eb"}, {"server_uuid": "60ce4c56-73a5-49a1-900b-0e76692a4365", "name": "network-vif-plugged", "status": "completed", "tag": "7c055f59-15ed-4a63-957d-f6ef57627bab"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:07.756320 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fbbe55db-d454-48df-aa53-453693123ed0 tempest-ServersTestManualDisk-720887850 tempest-ServersTestManualDisk-720887850-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859380118" status: 202 len: 0 microversion: 2.1 time: 0.054868 Mar 05 21:00:07.761806 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1559/3135] 10.222.0.15 () {58 vars in 1220 bytes} [Sat Mar 5 21:00:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859380118 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:00:07.769036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ec3d0e0a-88a3-46a0-bf3b-b315a3ef0f76 req-7054eef5-3527-4bd7-9049-8cf2f87066a4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:07.769394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-75a4f449-ea9f-4fc5-a9c2-d7c60c0e168b tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:07.770030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-75a4f449-ea9f-4fc5-a9c2-d7c60c0e168b tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:07.770703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ec3d0e0a-88a3-46a0-bf3b-b315a3ef0f76 req-7054eef5-3527-4bd7-9049-8cf2f87066a4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:07.779981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75a4f449-ea9f-4fc5-a9c2-d7c60c0e168b tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:07.780738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75a4f449-ea9f-4fc5-a9c2-d7c60c0e168b tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:07.781757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75a4f449-ea9f-4fc5-a9c2-d7c60c0e168b tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:07.783366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75a4f449-ea9f-4fc5-a9c2-d7c60c0e168b tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:07.796767 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ec3d0e0a-88a3-46a0-bf3b-b315a3ef0f76 req-7054eef5-3527-4bd7-9049-8cf2f87066a4 service nova] Creating event network-vif-unplugged:d89b87d8-65fa-4882-ac07-f0f70c7ec7eb for instance dbc23752-0101-4c2b-a90f-6ccad692e3f3 on nch2-master-1 Mar 05 21:00:07.797293 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ec3d0e0a-88a3-46a0-bf3b-b315a3ef0f76 req-7054eef5-3527-4bd7-9049-8cf2f87066a4 service nova] Creating event network-vif-plugged:7c055f59-15ed-4a63-957d-f6ef57627bab for instance 60ce4c56-73a5-49a1-900b-0e76692a4365 on nch1-master-1 Mar 05 21:00:07.842003 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ec3d0e0a-88a3-46a0-bf3b-b315a3ef0f76 req-7054eef5-3527-4bd7-9049-8cf2f87066a4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.104187 Mar 05 21:00:07.843783 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1577/3136] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:08.323875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-75a4f449-ea9f-4fc5-a9c2-d7c60c0e168b tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:08.335834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-75a4f449-ea9f-4fc5-a9c2-d7c60c0e168b tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:08.339783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-75a4f449-ea9f-4fc5-a9c2-d7c60c0e168b tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:08.340993 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-75a4f449-ea9f-4fc5-a9c2-d7c60c0e168b tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 200 len: 1362 microversion: 2.26 time: 0.577994 Mar 05 21:00:08.341584 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1560/3137] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:00:07 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 1362 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:00:08.522937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-05dac7cf-c123-4543-92f2-3eb716876bad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:08.523600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-05dac7cf-c123-4543-92f2-3eb716876bad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:08.539936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05dac7cf-c123-4543-92f2-3eb716876bad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:08.540677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05dac7cf-c123-4543-92f2-3eb716876bad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:08.542818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05dac7cf-c123-4543-92f2-3eb716876bad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:08.547098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05dac7cf-c123-4543-92f2-3eb716876bad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:08.824558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-267878327", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "8ab2e26a-32ab-44a2-a446-4460222e659b"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:08.888322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-05dac7cf-c123-4543-92f2-3eb716876bad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:08.918901 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-05dac7cf-c123-4543-92f2-3eb716876bad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1318 microversion: 2.1 time: 0.400376 Mar 05 21:00:08.920991 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1561/3138] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:08 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:00:08.936508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a3e14bbd-e1f4-43c1-9dcd-3938966ecb11 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a1dca0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:08.942095 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] validate_networks() for [('8ab2e26a-32ab-44a2-a446-4460222e659b', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:00:09.015379 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a3e14bbd-e1f4-43c1-9dcd-3938966ecb11 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.090768 Mar 05 21:00:09.017962 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1562/3139] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:08 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:09.031206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-75f1031f-93ef-4060-8e37-27ade9691c04 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:09.033627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-75f1031f-93ef-4060-8e37-27ade9691c04 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:09.045098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75f1031f-93ef-4060-8e37-27ade9691c04 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:09.045924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75f1031f-93ef-4060-8e37-27ade9691c04 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:09.046742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75f1031f-93ef-4060-8e37-27ade9691c04 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:09.047186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75f1031f-93ef-4060-8e37-27ade9691c04 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:09.175745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-75f1031f-93ef-4060-8e37-27ade9691c04 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:09.187229 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-75f1031f-93ef-4060-8e37-27ade9691c04 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1279 microversion: 2.1 time: 0.167945 Mar 05 21:00:09.190373 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1563/3140] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:09 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:09.358346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e71cf24d-d8b4-46c5-acdb-308b0bf4626f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:09.359005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e71cf24d-d8b4-46c5-acdb-308b0bf4626f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:09.376946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e71cf24d-d8b4-46c5-acdb-308b0bf4626f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:09.377422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e71cf24d-d8b4-46c5-acdb-308b0bf4626f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:09.383120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e71cf24d-d8b4-46c5-acdb-308b0bf4626f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:09.383636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e71cf24d-d8b4-46c5-acdb-308b0bf4626f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:09.921315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e71cf24d-d8b4-46c5-acdb-308b0bf4626f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:09.932356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e71cf24d-d8b4-46c5-acdb-308b0bf4626f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:09.934254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e71cf24d-d8b4-46c5-acdb-308b0bf4626f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:09.935460 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e71cf24d-d8b4-46c5-acdb-308b0bf4626f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 200 len: 1362 microversion: 2.26 time: 0.580959 Mar 05 21:00:09.936475 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1564/3141] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:00:09 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 1362 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:00:09.946830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-21967b6b-7070-4258-a9bd-28fdcb4a9cf5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:09.953505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-21967b6b-7070-4258-a9bd-28fdcb4a9cf5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:09.970001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21967b6b-7070-4258-a9bd-28fdcb4a9cf5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:09.971283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21967b6b-7070-4258-a9bd-28fdcb4a9cf5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:09.974192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21967b6b-7070-4258-a9bd-28fdcb4a9cf5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:09.975598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21967b6b-7070-4258-a9bd-28fdcb4a9cf5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:09.995443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:00:09.996197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:00:09.996913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:00:09.998439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:00:09.999030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:00:10.040687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:10.041633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:10.043471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:10.044226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:10.101549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Getting quotas for project 21ab0f35161b4fd9857a3cd95cc89063. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:00:10.126152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Getting quotas for user f3424e705cfb4372897157ff324c5179 and project 21ab0f35161b4fd9857a3cd95cc89063. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:00:10.176177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:00:10.179648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:00:10.354382 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4ad37e52-ab9a-4234-b41d-379b9836e23b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.109442 Mar 05 21:00:10.364358 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1578/3142] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:00:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:00:10.381931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-50082518-35d5-4cd0-b422-dd3808137163 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f6f23a0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:10.496637 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-50082518-35d5-4cd0-b422-dd3808137163 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.130327 Mar 05 21:00:10.498255 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1579/3143] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:10 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:10.517385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0bf66b2-270e-44a1-bd74-53a23810b737 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:10.518014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a0bf66b2-270e-44a1-bd74-53a23810b737 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:10.542401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0bf66b2-270e-44a1-bd74-53a23810b737 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:10.542883 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0bf66b2-270e-44a1-bd74-53a23810b737 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:10.544015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0bf66b2-270e-44a1-bd74-53a23810b737 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:10.544475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0bf66b2-270e-44a1-bd74-53a23810b737 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:10.569039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-21967b6b-7070-4258-a9bd-28fdcb4a9cf5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:10.591218 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-21967b6b-7070-4258-a9bd-28fdcb4a9cf5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1318 microversion: 2.1 time: 0.648588 Mar 05 21:00:10.591693 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1565/3144] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:09 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:10.607214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9b06a8ec-7c87-467a-9a6d-cdf3ac0242dd tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:10.618471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9b06a8ec-7c87-467a-9a6d-cdf3ac0242dd tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:10.752856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9b06a8ec-7c87-467a-9a6d-cdf3ac0242dd tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:10.765286 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9b06a8ec-7c87-467a-9a6d-cdf3ac0242dd tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1214 microversion: 2.1 time: 0.161791 Mar 05 21:00:10.765833 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1566/3145] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:10 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:10.819841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a0bf66b2-270e-44a1-bd74-53a23810b737 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:10.830894 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0bf66b2-270e-44a1-bd74-53a23810b737 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1285 microversion: 2.1 time: 0.331481 Mar 05 21:00:10.844031 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1580/3146] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:10 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1285 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:10.905401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e61fdf44-d8bd-40fb-b446-d744228d7b0d req-084221b4-bbe6-408a-acaa-8b0665aeba0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a6114e-7710-4ccf-b462-bb8c98001725", "name": "network-vif-plugged", "status": "completed", "tag": "f3d55e8e-71fd-427a-9669-f45552929be7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:10.925595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e61fdf44-d8bd-40fb-b446-d744228d7b0d req-084221b4-bbe6-408a-acaa-8b0665aeba0b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:10.930396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e61fdf44-d8bd-40fb-b446-d744228d7b0d req-084221b4-bbe6-408a-acaa-8b0665aeba0b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:10.955482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d7ea68d8-31f5-494b-a56d-8b96d07f8127 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:10.957069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d7ea68d8-31f5-494b-a56d-8b96d07f8127 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:10.970371 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e61fdf44-d8bd-40fb-b446-d744228d7b0d req-084221b4-bbe6-408a-acaa-8b0665aeba0b service nova] Creating event network-vif-plugged:f3d55e8e-71fd-427a-9669-f45552929be7 for instance 00a6114e-7710-4ccf-b462-bb8c98001725 on nch1-master-1 Mar 05 21:00:10.978397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7ea68d8-31f5-494b-a56d-8b96d07f8127 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:10.981238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7ea68d8-31f5-494b-a56d-8b96d07f8127 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:10.984608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7ea68d8-31f5-494b-a56d-8b96d07f8127 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:10.986583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7ea68d8-31f5-494b-a56d-8b96d07f8127 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:10.988469 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e61fdf44-d8bd-40fb-b446-d744228d7b0d req-084221b4-bbe6-408a-acaa-8b0665aeba0b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101032 Mar 05 21:00:10.992234 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1567/3147] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:00:11.515686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6955001c-0ccb-4ed2-b43f-016c2557e382 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a22940>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:11.579427 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6955001c-0ccb-4ed2-b43f-016c2557e382 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.071199 Mar 05 21:00:11.581798 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1568/3148] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:11 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:11.618163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9f887cfa-c719-4976-9a87-d498b66fcb17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:11.620911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9f887cfa-c719-4976-9a87-d498b66fcb17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:11.638738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f887cfa-c719-4976-9a87-d498b66fcb17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:11.639222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f887cfa-c719-4976-9a87-d498b66fcb17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:11.640631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f887cfa-c719-4976-9a87-d498b66fcb17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:11.641082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f887cfa-c719-4976-9a87-d498b66fcb17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:12.045419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9f887cfa-c719-4976-9a87-d498b66fcb17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:12.069167 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9f887cfa-c719-4976-9a87-d498b66fcb17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1318 microversion: 2.1 time: 0.449156 Mar 05 21:00:12.069167 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1569/3149] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:11 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:00:12.079849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-823f9ba7-e70f-4f5a-87c4-4494afa563d9 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:12.080497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-823f9ba7-e70f-4f5a-87c4-4494afa563d9 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:12.092972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-823f9ba7-e70f-4f5a-87c4-4494afa563d9 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:12.092972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-823f9ba7-e70f-4f5a-87c4-4494afa563d9 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:12.093719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-823f9ba7-e70f-4f5a-87c4-4494afa563d9 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:12.094177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-823f9ba7-e70f-4f5a-87c4-4494afa563d9 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:12.202664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-823f9ba7-e70f-4f5a-87c4-4494afa563d9 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:12.214031 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-823f9ba7-e70f-4f5a-87c4-4494afa563d9 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1266 microversion: 2.1 time: 0.153451 Mar 05 21:00:12.218330 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1570/3150] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:12 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:12.233043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6fcc747-84b7-4273-aad2-2fabc1e8de91 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:12.234014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6fcc747-84b7-4273-aad2-2fabc1e8de91 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:12.247437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6fcc747-84b7-4273-aad2-2fabc1e8de91 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:12.249025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6fcc747-84b7-4273-aad2-2fabc1e8de91 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:12.251992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6fcc747-84b7-4273-aad2-2fabc1e8de91 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:12.252867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6fcc747-84b7-4273-aad2-2fabc1e8de91 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:12.781353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d7ea68d8-31f5-494b-a56d-8b96d07f8127 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:12.794744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d7ea68d8-31f5-494b-a56d-8b96d07f8127 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:12.796875 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d7ea68d8-31f5-494b-a56d-8b96d07f8127 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:12.802197 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d7ea68d8-31f5-494b-a56d-8b96d07f8127 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 200 len: 1545 microversion: 2.26 time: 1.852102 Mar 05 21:00:12.806883 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1581/3151] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:00:10 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 1545 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:00:12.817712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d82219d-8861-46bc-8843-4fa66cfedd9a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f6fc0d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:12.897565 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7d82219d-8861-46bc-8843-4fa66cfedd9a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.088909 Mar 05 21:00:12.934205 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1582/3152] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:12 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:12.944426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed4f736310>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:12.977662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:12.992480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:12.993291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:12.999728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.000463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.001311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.001750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.047884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.048661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.068398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.069300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.118577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6fcc747-84b7-4273-aad2-2fabc1e8de91 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:13.132016 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6fcc747-84b7-4273-aad2-2fabc1e8de91 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1327 microversion: 2.1 time: 0.911442 Mar 05 21:00:13.141015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lazy-loading 'flavor' on Instance uuid 60ce4c56-73a5-49a1-900b-0e76692a4365 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:13.142000 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1571/3153] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:12 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1327 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:13.156441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-dad8d742-f1c9-4cdf-abe2-1657804eec75 req-0c8761a0-15d5-4a1b-ae3a-cf3271b4c29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0ba2b9-85e8-4b78-91be-461650cff33f", "name": "network-vif-plugged", "status": "completed", "tag": "55bf9cc0-eea1-4e21-b8d6-e730f4a85fe8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:13.169706 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6f999203-9c34-4526-841a-c52e2e8cd012 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-1276263682" status: 201 len: 0 microversion: 2.26 time: 0.231317 Mar 05 21:00:13.177310 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1583/3154] 10.222.0.15 () {62 vars in 1379 bytes} [Sat Mar 5 21:00:12 2022] PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-1276263682 => generated 0 bytes in 240 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Mar 05 21:00:13.183116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-dad8d742-f1c9-4cdf-abe2-1657804eec75 req-0c8761a0-15d5-4a1b-ae3a-cf3271b4c29c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.184984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f3cdcfd5-33f6-4328-bfb7-6d88017387f5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:13.185609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-dad8d742-f1c9-4cdf-abe2-1657804eec75 req-0c8761a0-15d5-4a1b-ae3a-cf3271b4c29c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.185992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f3cdcfd5-33f6-4328-bfb7-6d88017387f5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:13.195319 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3cdcfd5-33f6-4328-bfb7-6d88017387f5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.196524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3cdcfd5-33f6-4328-bfb7-6d88017387f5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.198587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3cdcfd5-33f6-4328-bfb7-6d88017387f5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.200081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3cdcfd5-33f6-4328-bfb7-6d88017387f5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.234209 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-dad8d742-f1c9-4cdf-abe2-1657804eec75 req-0c8761a0-15d5-4a1b-ae3a-cf3271b4c29c service nova] Creating event network-vif-plugged:55bf9cc0-eea1-4e21-b8d6-e730f4a85fe8 for instance 9f0ba2b9-85e8-4b78-91be-461650cff33f on nch2-master-1 Mar 05 21:00:13.252371 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-dad8d742-f1c9-4cdf-abe2-1657804eec75 req-0c8761a0-15d5-4a1b-ae3a-cf3271b4c29c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111706 Mar 05 21:00:13.252992 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1572/3155] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:13.258220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eee4e45e-8d7b-4dd7-bce8-b4156f60b1c1 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed61a21d30>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:13.287018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eee4e45e-8d7b-4dd7-bce8-b4156f60b1c1 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.287472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eee4e45e-8d7b-4dd7-bce8-b4156f60b1c1 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.337102 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eee4e45e-8d7b-4dd7-bce8-b4156f60b1c1 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-1276263682" status: 204 len: 0 microversion: 2.26 time: 0.082864 Mar 05 21:00:13.341319 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1573/3156] 10.222.0.15 () {60 vars in 1360 bytes} [Sat Mar 5 21:00:13 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-1276263682 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:00:13.361960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dad53f49-96f0-4556-9fbe-00ff58b268ae tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:13.362597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dad53f49-96f0-4556-9fbe-00ff58b268ae tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:13.386827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dad53f49-96f0-4556-9fbe-00ff58b268ae tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.398061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dad53f49-96f0-4556-9fbe-00ff58b268ae tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.402511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dad53f49-96f0-4556-9fbe-00ff58b268ae tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.409418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dad53f49-96f0-4556-9fbe-00ff58b268ae tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.660078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dad53f49-96f0-4556-9fbe-00ff58b268ae tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:13.669136 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dad53f49-96f0-4556-9fbe-00ff58b268ae tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1272 microversion: 2.1 time: 0.330358 Mar 05 21:00:13.674010 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1574/3157] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:13 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1272 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:13.689151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-89689a1d-60b1-403c-8837-86e4208f5882 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed61a22670>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:13.706668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89689a1d-60b1-403c-8837-86e4208f5882 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.707481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89689a1d-60b1-403c-8837-86e4208f5882 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.708712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-89689a1d-60b1-403c-8837-86e4208f5882 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:13.730082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89689a1d-60b1-403c-8837-86e4208f5882 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.730808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89689a1d-60b1-403c-8837-86e4208f5882 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.732505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89689a1d-60b1-403c-8837-86e4208f5882 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.733474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89689a1d-60b1-403c-8837-86e4208f5882 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.779630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89689a1d-60b1-403c-8837-86e4208f5882 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.780666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89689a1d-60b1-403c-8837-86e4208f5882 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.833288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f3cdcfd5-33f6-4328-bfb7-6d88017387f5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:13.841043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-89689a1d-60b1-403c-8837-86e4208f5882 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lazy-loading 'flavor' on Instance uuid 60ce4c56-73a5-49a1-900b-0e76692a4365 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:13.852884 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f3cdcfd5-33f6-4328-bfb7-6d88017387f5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1318 microversion: 2.1 time: 0.663645 Mar 05 21:00:13.852884 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1584/3158] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:13 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1318 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:13.856417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c1a4eb7a-3497-4721-907b-562f692c7344 req-bcc59555-6af3-408e-a925-6c60cdc1f0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a94cca9-061c-4b5b-9e77-e7695750da06", "tag": "e6ab9b49-2cdd-4131-b322-0ea6ac0003dd"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:13.879000 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-89689a1d-60b1-403c-8837-86e4208f5882 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags" status: 204 len: 0 microversion: 2.26 time: 0.203310 Mar 05 21:00:13.881271 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1575/3159] 10.222.0.15 () {60 vars in 1294 bytes} [Sat Mar 5 21:00:13 2022] DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:00:13.899506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f0518b3-1a40-4f55-b8b5-69f86b442539 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed61a22d30>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:13.914220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c1a4eb7a-3497-4721-907b-562f692c7344 req-bcc59555-6af3-408e-a925-6c60cdc1f0e6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.914731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f0518b3-1a40-4f55-b8b5-69f86b442539 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:13.917337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f0518b3-1a40-4f55-b8b5-69f86b442539 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.918609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c1a4eb7a-3497-4721-907b-562f692c7344 req-bcc59555-6af3-408e-a925-6c60cdc1f0e6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:13.989485 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5f0518b3-1a40-4f55-b8b5-69f86b442539 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags" status: 200 len: 12 microversion: 2.26 time: 0.098999 Mar 05 21:00:13.993950 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c1a4eb7a-3497-4721-907b-562f692c7344 req-bcc59555-6af3-408e-a925-6c60cdc1f0e6 service nova] Creating event network-changed:e6ab9b49-2cdd-4131-b322-0ea6ac0003dd for instance 2a94cca9-061c-4b5b-9e77-e7695750da06 on nch1-master-1 Mar 05 21:00:13.995742 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1576/3160] 10.222.0.15 () {60 vars in 1291 bytes} [Sat Mar 5 21:00:13 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags => generated 12 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:14.007282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e16a0e8a-0a91-4b5d-8954-a991dcf22e1d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a45790>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:14.017534 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c1a4eb7a-3497-4721-907b-562f692c7344 req-bcc59555-6af3-408e-a925-6c60cdc1f0e6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168023 Mar 05 21:00:14.025792 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1585/3161] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:14.061241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed4f6d05e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:14.103240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.109538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:14.112983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:14.133350 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e16a0e8a-0a91-4b5d-8954-a991dcf22e1d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.132562 Mar 05 21:00:14.140883 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1577/3162] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:13 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:14.160567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.162223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-879d5f11-2abd-45b9-8317-19efc119488c tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:14.163219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:14.164889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.165862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:14.166029 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-879d5f11-2abd-45b9-8317-19efc119488c tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:14.183791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-879d5f11-2abd-45b9-8317-19efc119488c tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.184423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-879d5f11-2abd-45b9-8317-19efc119488c tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:14.187458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-879d5f11-2abd-45b9-8317-19efc119488c tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.188588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-879d5f11-2abd-45b9-8317-19efc119488c tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:14.226606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.229845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:14.254299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.254921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:14.316444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lazy-loading 'flavor' on Instance uuid 60ce4c56-73a5-49a1-900b-0e76692a4365 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:14.346585 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f2d09375-3225-4a5b-9271-fb817ae939f5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-2141648677" status: 201 len: 0 microversion: 2.26 time: 0.316109 Mar 05 21:00:14.347566 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1586/3163] 10.222.0.15 () {62 vars in 1379 bytes} [Sat Mar 5 21:00:14 2022] PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-2141648677 => generated 0 bytes in 320 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Mar 05 21:00:14.497507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-568575209", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:14.576291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:00:14.658673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-879d5f11-2abd-45b9-8317-19efc119488c tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:14.672122 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-879d5f11-2abd-45b9-8317-19efc119488c tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1327 microversion: 2.1 time: 0.526472 Mar 05 21:00:14.673156 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1578/3164] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:14 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1327 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:14.678124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6795d604-6c91-4661-a44f-247ba892f03c tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed61a45790>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:14.696951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6795d604-6c91-4661-a44f-247ba892f03c tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.697405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6795d604-6c91-4661-a44f-247ba892f03c tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:14.714515 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6795d604-6c91-4661-a44f-247ba892f03c tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags" status: 200 len: 36 microversion: 2.26 time: 0.040267 Mar 05 21:00:14.720601 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1579/3165] 10.222.0.15 () {60 vars in 1291 bytes} [Sat Mar 5 21:00:14 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags => generated 36 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:14.736944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bfae79eb-bb0a-407c-a62d-a124b986aff5 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:14.738283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bfae79eb-bb0a-407c-a62d-a124b986aff5 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:14.746327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfae79eb-bb0a-407c-a62d-a124b986aff5 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.747069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfae79eb-bb0a-407c-a62d-a124b986aff5 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:14.748317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfae79eb-bb0a-407c-a62d-a124b986aff5 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.748910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfae79eb-bb0a-407c-a62d-a124b986aff5 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:14.842471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bfae79eb-bb0a-407c-a62d-a124b986aff5 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:14.850466 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bfae79eb-bb0a-407c-a62d-a124b986aff5 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1272 microversion: 2.1 time: 0.122760 Mar 05 21:00:14.858254 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1580/3166] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:14 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:14.873375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-77edb7a1-c77f-4c2a-a79e-3f1d54f8164f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed4f9cc700>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:14.898166 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77edb7a1-c77f-4c2a-a79e-3f1d54f8164f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.900951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77edb7a1-c77f-4c2a-a79e-3f1d54f8164f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:14.901650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-77edb7a1-c77f-4c2a-a79e-3f1d54f8164f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:14.923548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77edb7a1-c77f-4c2a-a79e-3f1d54f8164f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.926555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77edb7a1-c77f-4c2a-a79e-3f1d54f8164f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:14.927553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77edb7a1-c77f-4c2a-a79e-3f1d54f8164f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.930318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77edb7a1-c77f-4c2a-a79e-3f1d54f8164f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:14.973034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77edb7a1-c77f-4c2a-a79e-3f1d54f8164f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:14.979325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77edb7a1-c77f-4c2a-a79e-3f1d54f8164f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:15.026772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-77edb7a1-c77f-4c2a-a79e-3f1d54f8164f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lazy-loading 'flavor' on Instance uuid 60ce4c56-73a5-49a1-900b-0e76692a4365 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:15.057512 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-77edb7a1-c77f-4c2a-a79e-3f1d54f8164f tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-2141648677" status: 204 len: 0 microversion: 2.26 time: 0.197742 Mar 05 21:00:15.068052 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1581/3167] 10.222.0.15 () {60 vars in 1363 bytes} [Sat Mar 5 21:00:14 2022] DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-2141648677 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:00:15.075242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b40c6ddf-73b6-45fd-aa3c-338527b83935 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:15.077734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b40c6ddf-73b6-45fd-aa3c-338527b83935 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:15.091244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b40c6ddf-73b6-45fd-aa3c-338527b83935 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:15.095970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b40c6ddf-73b6-45fd-aa3c-338527b83935 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:15.101468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b40c6ddf-73b6-45fd-aa3c-338527b83935 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:15.102210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b40c6ddf-73b6-45fd-aa3c-338527b83935 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:15.363157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:00:15.363706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:00:15.364519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:00:15.364940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:00:15.365358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:00:15.383069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:15.383526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:15.385846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:15.386864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:15.419344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Getting quotas for project a8a73148186e46d78a10218811c8ba53. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:00:15.426872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Getting quotas for user 8c224262fd83477483a2a0db9295417a and project a8a73148186e46d78a10218811c8ba53. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:00:15.443508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:00:15.446935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:00:15.507811 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b8227f40-bd26-4f1d-9fbd-b2885535a7c5 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.158909 Mar 05 21:00:15.513186 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1587/3168] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:00:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:00:15.526391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4557fa3c-d0e0-4e07-b7f1-0cc6e1ecef88 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed4f6f11f0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:15.540014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4557fa3c-d0e0-4e07-b7f1-0cc6e1ecef88 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:15.540475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4557fa3c-d0e0-4e07-b7f1-0cc6e1ecef88 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:15.553233 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4557fa3c-d0e0-4e07-b7f1-0cc6e1ecef88 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags" status: 200 len: 12 microversion: 2.26 time: 0.043306 Mar 05 21:00:15.554076 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1588/3169] 10.222.0.15 () {60 vars in 1291 bytes} [Sat Mar 5 21:00:15 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags => generated 12 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:15.559435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3a354696-0c68-4701-a4a4-23eaa1a985ed tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f74b790>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:15.608646 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3a354696-0c68-4701-a4a4-23eaa1a985ed tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.053587 Mar 05 21:00:15.609740 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1589/3170] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:15 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:15.619146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c5dc38d9-afe1-4ed5-8232-f0feca0932cb tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:15.620051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c5dc38d9-afe1-4ed5-8232-f0feca0932cb tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:15.649163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b40c6ddf-73b6-45fd-aa3c-338527b83935 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:15.660717 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b40c6ddf-73b6-45fd-aa3c-338527b83935 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1508 microversion: 2.1 time: 0.590717 Mar 05 21:00:15.662838 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1582/3171] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:15 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1508 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:15.669604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8e1304ee-86f5-4cfc-8f6f-3da5a6c3c90d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed61a22700>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:15.682535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e1304ee-86f5-4cfc-8f6f-3da5a6c3c90d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:15.683235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e1304ee-86f5-4cfc-8f6f-3da5a6c3c90d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:15.683914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8e1304ee-86f5-4cfc-8f6f-3da5a6c3c90d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:15.696845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e1304ee-86f5-4cfc-8f6f-3da5a6c3c90d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:15.697692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e1304ee-86f5-4cfc-8f6f-3da5a6c3c90d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:15.699969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e1304ee-86f5-4cfc-8f6f-3da5a6c3c90d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:15.701056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e1304ee-86f5-4cfc-8f6f-3da5a6c3c90d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:15.702453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c5dc38d9-afe1-4ed5-8232-f0feca0932cb tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c224262fd83477483a2a0db9295417a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a73148186e46d78a10218811c8ba53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:15.714815 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c5dc38d9-afe1-4ed5-8232-f0feca0932cb tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 200 len: 1213 microversion: 2.1 time: 0.099440 Mar 05 21:00:15.725889 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1590/3172] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:15 2022] GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:15.743461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2d1dbcb5-9aab-4127-bd35-41d62209fe44 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:15.744585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2d1dbcb5-9aab-4127-bd35-41d62209fe44 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:15.757466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d1dbcb5-9aab-4127-bd35-41d62209fe44 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:15.761683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d1dbcb5-9aab-4127-bd35-41d62209fe44 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:15.762676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e1304ee-86f5-4cfc-8f6f-3da5a6c3c90d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:15.762942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d1dbcb5-9aab-4127-bd35-41d62209fe44 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:15.763132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e1304ee-86f5-4cfc-8f6f-3da5a6c3c90d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:15.763761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d1dbcb5-9aab-4127-bd35-41d62209fe44 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:15.786575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-8e1304ee-86f5-4cfc-8f6f-3da5a6c3c90d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lazy-loading 'flavor' on Instance uuid 60ce4c56-73a5-49a1-900b-0e76692a4365 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:15.824985 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8e1304ee-86f5-4cfc-8f6f-3da5a6c3c90d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags" status: 204 len: 0 microversion: 2.26 time: 0.160804 Mar 05 21:00:15.827733 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1583/3173] 10.222.0.15 () {60 vars in 1294 bytes} [Sat Mar 5 21:00:15 2022] DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:00:15.841484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-79e6c788-ada9-478a-bd84-8457ada21791 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:15.848128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-79e6c788-ada9-478a-bd84-8457ada21791 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:15.863514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79e6c788-ada9-478a-bd84-8457ada21791 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:15.865461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79e6c788-ada9-478a-bd84-8457ada21791 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:15.868618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79e6c788-ada9-478a-bd84-8457ada21791 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:15.869845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79e6c788-ada9-478a-bd84-8457ada21791 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:16.934865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-79e6c788-ada9-478a-bd84-8457ada21791 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:16.951712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2d1dbcb5-9aab-4127-bd35-41d62209fe44 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:16.954580 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-79e6c788-ada9-478a-bd84-8457ada21791 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1327 microversion: 2.1 time: 1.116922 Mar 05 21:00:16.955588 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1584/3174] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:15 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1327 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:16.965402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed4f9e40d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:16.966028 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2d1dbcb5-9aab-4127-bd35-41d62209fe44 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1508 microversion: 2.1 time: 1.239341 Mar 05 21:00:16.966646 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1591/3175] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:15 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1508 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:16.985516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b204e074-6309-4581-8b16-e2da6deaa314 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:16.986195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b204e074-6309-4581-8b16-e2da6deaa314 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:16.988169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:16.989200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:16.990152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:16.997241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:16.998024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:16.999006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:16.999872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.005084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b204e074-6309-4581-8b16-e2da6deaa314 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.005807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b204e074-6309-4581-8b16-e2da6deaa314 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.006806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b204e074-6309-4581-8b16-e2da6deaa314 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.007426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b204e074-6309-4581-8b16-e2da6deaa314 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.028814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.029932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.040892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.041709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.073352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lazy-loading 'flavor' on Instance uuid 60ce4c56-73a5-49a1-900b-0e76692a4365 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:17.093197 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3f177147-5e99-4842-8d7d-000e688484f3 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-399489681" status: 201 len: 0 microversion: 2.26 time: 0.136403 Mar 05 21:00:17.094588 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1585/3176] 10.222.0.15 () {62 vars in 1376 bytes} [Sat Mar 5 21:00:16 2022] PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-399489681 => generated 0 bytes in 138 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Mar 05 21:00:17.101393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6a85444f-0d9c-4e8e-8fa0-ddd96aaa31bf tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a219d0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:17.181064 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6a85444f-0d9c-4e8e-8fa0-ddd96aaa31bf tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.084757 Mar 05 21:00:17.183039 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1586/3177] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:17 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:17.189759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-295e83e4-c897-4198-b548-5b25b9ef0094 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:17.190871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-295e83e4-c897-4198-b548-5b25b9ef0094 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:17.198808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-295e83e4-c897-4198-b548-5b25b9ef0094 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.199258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-295e83e4-c897-4198-b548-5b25b9ef0094 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.200101 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-295e83e4-c897-4198-b548-5b25b9ef0094 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.200993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-295e83e4-c897-4198-b548-5b25b9ef0094 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.292491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-295e83e4-c897-4198-b548-5b25b9ef0094 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c224262fd83477483a2a0db9295417a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a73148186e46d78a10218811c8ba53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:17.308529 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-295e83e4-c897-4198-b548-5b25b9ef0094 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 200 len: 1265 microversion: 2.1 time: 0.121556 Mar 05 21:00:17.309601 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1587/3178] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:17 2022] GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:17.323856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "OS-DCF:diskConfig": "AUTO"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:17.326969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:17.341691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.343573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.345258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.345778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.480605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:00:17.481324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:00:17.489037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:00:17.489986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:00:17.490566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:00:17.685068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:17.700510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.701470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.704979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.706238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.784212 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-91560f0a-8ea0-4493-98f1-fc52d9c09a51 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "POST /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f/action" status: 202 len: 1110 microversion: 2.1 time: 0.470685 Mar 05 21:00:17.791712 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1588/3179] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:00:17 2022] POST /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f/action => generated 1110 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 05 21:00:17.805813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed4f9e4700>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:17.826079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.826531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.827009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:17.834950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.835401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.836290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.837568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.864678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.865129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.886321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.886724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.936620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lazy-loading 'flavor' on Instance uuid 60ce4c56-73a5-49a1-900b-0e76692a4365 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:17.956565 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2f41b525-48f5-427a-be7b-e341d44cc47d tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-1455471010" status: 201 len: 0 microversion: 2.26 time: 0.162223 Mar 05 21:00:17.957853 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1589/3180] 10.222.0.15 () {62 vars in 1379 bytes} [Sat Mar 5 21:00:17 2022] PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-1455471010 => generated 0 bytes in 164 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Mar 05 21:00:17.967023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8e7be637-bf10-4ce5-8628-c0ed15b530b9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:17.968721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8e7be637-bf10-4ce5-8628-c0ed15b530b9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:17.988860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e7be637-bf10-4ce5-8628-c0ed15b530b9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.991125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e7be637-bf10-4ce5-8628-c0ed15b530b9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:17.993434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e7be637-bf10-4ce5-8628-c0ed15b530b9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:17.997383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e7be637-bf10-4ce5-8628-c0ed15b530b9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:18.117261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b204e074-6309-4581-8b16-e2da6deaa314 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:18.143107 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b204e074-6309-4581-8b16-e2da6deaa314 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1314 microversion: 2.1 time: 1.175345 Mar 05 21:00:18.151428 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1592/3181] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:16 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1314 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:18.191855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8145346f-fad4-4b4f-944e-b65758a86fba tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed4f6fc4c0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:18.230935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8145346f-fad4-4b4f-944e-b65758a86fba tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:18.239152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8145346f-fad4-4b4f-944e-b65758a86fba tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:18.240094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8145346f-fad4-4b4f-944e-b65758a86fba tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:18.267998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8145346f-fad4-4b4f-944e-b65758a86fba tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:18.273701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8145346f-fad4-4b4f-944e-b65758a86fba tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:18.280422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8145346f-fad4-4b4f-944e-b65758a86fba tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:18.281047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8145346f-fad4-4b4f-944e-b65758a86fba tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:18.316628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8145346f-fad4-4b4f-944e-b65758a86fba tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:18.317347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8145346f-fad4-4b4f-944e-b65758a86fba tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:18.347127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-8145346f-fad4-4b4f-944e-b65758a86fba tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lazy-loading 'flavor' on Instance uuid 60ce4c56-73a5-49a1-900b-0e76692a4365 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:18.379253 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8145346f-fad4-4b4f-944e-b65758a86fba tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags" status: 204 len: 0 microversion: 2.26 time: 0.223050 Mar 05 21:00:18.383895 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1593/3182] 10.222.0.15 () {60 vars in 1294 bytes} [Sat Mar 5 21:00:18 2022] DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:00:18.390523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2ca24db9-ec25-4e00-952b-49b005ec2ea9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:18.392394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2ca24db9-ec25-4e00-952b-49b005ec2ea9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:18.415555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ca24db9-ec25-4e00-952b-49b005ec2ea9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:18.416508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ca24db9-ec25-4e00-952b-49b005ec2ea9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:18.417564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ca24db9-ec25-4e00-952b-49b005ec2ea9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:18.418200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2ca24db9-ec25-4e00-952b-49b005ec2ea9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:18.755360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8e7be637-bf10-4ce5-8628-c0ed15b530b9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:18.767299 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8e7be637-bf10-4ce5-8628-c0ed15b530b9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 0.806001 Mar 05 21:00:18.776069 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1590/3183] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:17 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:18.790374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cc0c10c7-39d0-4d71-a54b-1ae995631e3c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a8bf70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:18.894696 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cc0c10c7-39d0-4d71-a54b-1ae995631e3c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.117341 Mar 05 21:00:18.896030 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1591/3184] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:18 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:18.907934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-395cbf8c-e476-4b72-a9dc-c326336c0f89 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:18.916788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-395cbf8c-e476-4b72-a9dc-c326336c0f89 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:18.956505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-395cbf8c-e476-4b72-a9dc-c326336c0f89 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:18.957804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-395cbf8c-e476-4b72-a9dc-c326336c0f89 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:18.958613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-395cbf8c-e476-4b72-a9dc-c326336c0f89 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:18.959054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-395cbf8c-e476-4b72-a9dc-c326336c0f89 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:19.118148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2ca24db9-ec25-4e00-952b-49b005ec2ea9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:19.129362 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2ca24db9-ec25-4e00-952b-49b005ec2ea9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1327 microversion: 2.1 time: 0.742953 Mar 05 21:00:19.132157 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1594/3185] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:18 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1327 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:19.143349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ed4a867-3dee-440b-8f0e-626ac01f9c58 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed4f6de160>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:19.153851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ed4a867-3dee-440b-8f0e-626ac01f9c58 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:19.154578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ed4a867-3dee-440b-8f0e-626ac01f9c58 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:19.174135 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ed4a867-3dee-440b-8f0e-626ac01f9c58 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags" status: 200 len: 12 microversion: 2.26 time: 0.040420 Mar 05 21:00:19.182300 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1595/3186] 10.222.0.15 () {60 vars in 1291 bytes} [Sat Mar 5 21:00:19 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags => generated 12 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:19.203030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-66c31e95-3980-47b3-88ef-0fae6ee2b569 req-92cc4da9-76e4-4c20-9ea6-922dad3b8386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38", "tag": "850a46e3-1e9e-41e7-9170-0648694ef580"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:19.214727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-66c31e95-3980-47b3-88ef-0fae6ee2b569 req-92cc4da9-76e4-4c20-9ea6-922dad3b8386 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:19.215642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-66c31e95-3980-47b3-88ef-0fae6ee2b569 req-92cc4da9-76e4-4c20-9ea6-922dad3b8386 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:19.229514 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-66c31e95-3980-47b3-88ef-0fae6ee2b569 req-92cc4da9-76e4-4c20-9ea6-922dad3b8386 service nova] Creating event network-changed:850a46e3-1e9e-41e7-9170-0648694ef580 for instance dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 on nch2-master-1 Mar 05 21:00:19.235894 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-66c31e95-3980-47b3-88ef-0fae6ee2b569 req-92cc4da9-76e4-4c20-9ea6-922dad3b8386 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048558 Mar 05 21:00:19.237182 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1596/3187] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:19.243723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c83e9097-ca25-4a4d-b72e-57f5115946e7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:19.244834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c83e9097-ca25-4a4d-b72e-57f5115946e7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:19.251983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c83e9097-ca25-4a4d-b72e-57f5115946e7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:19.252745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c83e9097-ca25-4a4d-b72e-57f5115946e7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:19.254972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c83e9097-ca25-4a4d-b72e-57f5115946e7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:19.255706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c83e9097-ca25-4a4d-b72e-57f5115946e7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:19.610537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-395cbf8c-e476-4b72-a9dc-c326336c0f89 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c224262fd83477483a2a0db9295417a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a73148186e46d78a10218811c8ba53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:19.621674 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-395cbf8c-e476-4b72-a9dc-c326336c0f89 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 200 len: 1313 microversion: 2.1 time: 0.724599 Mar 05 21:00:19.631142 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1592/3188] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:18 2022] GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 1313 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:19.636540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ec6c48ae-fcdb-471d-90eb-3715be48c7e7 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed61a21dc0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:19.650843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec6c48ae-fcdb-471d-90eb-3715be48c7e7 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:19.651225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec6c48ae-fcdb-471d-90eb-3715be48c7e7 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:19.651721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ec6c48ae-fcdb-471d-90eb-3715be48c7e7 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:19.670134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec6c48ae-fcdb-471d-90eb-3715be48c7e7 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:19.670873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec6c48ae-fcdb-471d-90eb-3715be48c7e7 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:19.671912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec6c48ae-fcdb-471d-90eb-3715be48c7e7 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:19.680402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec6c48ae-fcdb-471d-90eb-3715be48c7e7 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:19.718522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec6c48ae-fcdb-471d-90eb-3715be48c7e7 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:19.722025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec6c48ae-fcdb-471d-90eb-3715be48c7e7 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:19.749668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-ec6c48ae-fcdb-471d-90eb-3715be48c7e7 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lazy-loading 'flavor' on Instance uuid 60ce4c56-73a5-49a1-900b-0e76692a4365 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:19.787288 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ec6c48ae-fcdb-471d-90eb-3715be48c7e7 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags" status: 204 len: 0 microversion: 2.26 time: 0.154710 Mar 05 21:00:19.789897 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1593/3189] 10.222.0.15 () {60 vars in 1294 bytes} [Sat Mar 5 21:00:19 2022] DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:00:19.804393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aef81bf2-feed-4f14-bb4f-69b1f35ce6f9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:19.805310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aef81bf2-feed-4f14-bb4f-69b1f35ce6f9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:19.827471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aef81bf2-feed-4f14-bb4f-69b1f35ce6f9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:19.829308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aef81bf2-feed-4f14-bb4f-69b1f35ce6f9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:19.831941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aef81bf2-feed-4f14-bb4f-69b1f35ce6f9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:19.834810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aef81bf2-feed-4f14-bb4f-69b1f35ce6f9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.276457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aef81bf2-feed-4f14-bb4f-69b1f35ce6f9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:20.285488 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aef81bf2-feed-4f14-bb4f-69b1f35ce6f9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 0.494081 Mar 05 21:00:20.308108 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1594/3190] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:19 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:20.313755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed61a21430>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:20.330522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.331266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.331979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:20.345066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.348271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.349513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.350153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.414407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.415044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.435885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.436630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.484280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lazy-loading 'flavor' on Instance uuid 60ce4c56-73a5-49a1-900b-0e76692a4365 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:20.508133 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-798d61dc-e137-47d8-8c95-441eab16c069 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-1034619866" status: 201 len: 0 microversion: 2.26 time: 0.198012 Mar 05 21:00:20.509635 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1595/3191] 10.222.0.15 () {62 vars in 1379 bytes} [Sat Mar 5 21:00:20 2022] PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-1034619866 => generated 0 bytes in 201 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Mar 05 21:00:20.515827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e1639acf-3ca1-4892-9471-8b08ac911253 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a22e50>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:20.567973 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e1639acf-3ca1-4892-9471-8b08ac911253 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.057067 Mar 05 21:00:20.568782 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1596/3192] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:20 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:20.574459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-689b7dc4-9de5-4b8a-919a-43b866b8233b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:20.575331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-689b7dc4-9de5-4b8a-919a-43b866b8233b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:20.583432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-689b7dc4-9de5-4b8a-919a-43b866b8233b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.584038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-689b7dc4-9de5-4b8a-919a-43b866b8233b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.584896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-689b7dc4-9de5-4b8a-919a-43b866b8233b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.585405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-689b7dc4-9de5-4b8a-919a-43b866b8233b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.637422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c83e9097-ca25-4a4d-b72e-57f5115946e7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:20.651000 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c83e9097-ca25-4a4d-b72e-57f5115946e7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1314 microversion: 2.1 time: 1.412171 Mar 05 21:00:20.654634 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1597/3193] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:19 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1314 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:20.660315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e839d2a7-374e-4837-92fd-f130a764ef34 req-256737f2-cee8-4b89-a072-a294b6809f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a94cca9-061c-4b5b-9e77-e7695750da06", "name": "network-vif-plugged", "status": "completed", "tag": "e6ab9b49-2cdd-4131-b322-0ea6ac0003dd"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:20.671335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e839d2a7-374e-4837-92fd-f130a764ef34 req-256737f2-cee8-4b89-a072-a294b6809f2d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.672138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e839d2a7-374e-4837-92fd-f130a764ef34 req-256737f2-cee8-4b89-a072-a294b6809f2d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.694743 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e839d2a7-374e-4837-92fd-f130a764ef34 req-256737f2-cee8-4b89-a072-a294b6809f2d service nova] Creating event network-vif-plugged:e6ab9b49-2cdd-4131-b322-0ea6ac0003dd for instance 2a94cca9-061c-4b5b-9e77-e7695750da06 on nch1-master-1 Mar 05 21:00:20.703792 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e839d2a7-374e-4837-92fd-f130a764ef34 req-256737f2-cee8-4b89-a072-a294b6809f2d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046669 Mar 05 21:00:20.705294 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1598/3194] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:20.742835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed4f6fc310>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:20.765289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.768094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.768943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:20.783621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.786437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.789955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.790616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.831499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.832272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.848262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.849765 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.901625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lazy-loading 'flavor' on Instance uuid 60ce4c56-73a5-49a1-900b-0e76692a4365 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:20.933351 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4acaf04d-cbb0-4e75-963d-a65a9f705446 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-1617280113" status: 201 len: 0 microversion: 2.26 time: 0.226550 Mar 05 21:00:20.934200 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1599/3195] 10.222.0.15 () {62 vars in 1379 bytes} [Sat Mar 5 21:00:20 2022] PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags/tempest-tag-1617280113 => generated 0 bytes in 228 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Mar 05 21:00:20.949595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f22b7394-6d44-4aa2-b100-ed57abbad294 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:20.950502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f22b7394-6d44-4aa2-b100-ed57abbad294 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:20.958844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f22b7394-6d44-4aa2-b100-ed57abbad294 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.960500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f22b7394-6d44-4aa2-b100-ed57abbad294 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:20.964020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f22b7394-6d44-4aa2-b100-ed57abbad294 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:20.964764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f22b7394-6d44-4aa2-b100-ed57abbad294 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:21.544870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f22b7394-6d44-4aa2-b100-ed57abbad294 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c224262fd83477483a2a0db9295417a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a73148186e46d78a10218811c8ba53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:21.563766 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f22b7394-6d44-4aa2-b100-ed57abbad294 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 200 len: 1313 microversion: 2.1 time: 0.621528 Mar 05 21:00:21.565006 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1600/3196] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:20 2022] GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:21.574373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-06a85a8d-da21-4e87-a7d5-2d97721a76d9 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Action: 'update_all', calling method: .version_select at 0x7fed4f6de1f0>, body: {"tags": ["tempest-tag-881265625", "tempest-tag-1602955461"]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:21.577459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-689b7dc4-9de5-4b8a-919a-43b866b8233b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:21.590272 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-689b7dc4-9de5-4b8a-919a-43b866b8233b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1327 microversion: 2.1 time: 1.020204 Mar 05 21:00:21.591361 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1597/3197] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:20 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1327 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:21.595161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-da21-4e87-a7d5-2d97721a76d9 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:21.598638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-44e1b0fe-b3f6-4c5d-8243-5aa6717daade tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:21.598988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-da21-4e87-a7d5-2d97721a76d9 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:21.600234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-06a85a8d-da21-4e87-a7d5-2d97721a76d9 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:21.604242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-44e1b0fe-b3f6-4c5d-8243-5aa6717daade tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:21.612084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-da21-4e87-a7d5-2d97721a76d9 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:21.612904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-da21-4e87-a7d5-2d97721a76d9 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:21.614566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44e1b0fe-b3f6-4c5d-8243-5aa6717daade tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:21.615217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-da21-4e87-a7d5-2d97721a76d9 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:21.615618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44e1b0fe-b3f6-4c5d-8243-5aa6717daade tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:21.616007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-da21-4e87-a7d5-2d97721a76d9 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:21.616765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44e1b0fe-b3f6-4c5d-8243-5aa6717daade tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:21.617842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44e1b0fe-b3f6-4c5d-8243-5aa6717daade tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:21.677714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-da21-4e87-a7d5-2d97721a76d9 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:21.678769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-da21-4e87-a7d5-2d97721a76d9 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:21.714073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-06a85a8d-da21-4e87-a7d5-2d97721a76d9 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lazy-loading 'flavor' on Instance uuid 60ce4c56-73a5-49a1-900b-0e76692a4365 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:21.755633 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-06a85a8d-da21-4e87-a7d5-2d97721a76d9 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags" status: 200 len: 61 microversion: 2.26 time: 0.189275 Mar 05 21:00:21.758350 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1601/3198] 10.222.0.15 () {62 vars in 1311 bytes} [Sat Mar 5 21:00:21 2022] PUT /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags => generated 61 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:21.769759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-52de5f53-2161-4142-accf-cd7b9ef0dc05 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed5c660430>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:22.054089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-44e1b0fe-b3f6-4c5d-8243-5aa6717daade tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:22.065206 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-44e1b0fe-b3f6-4c5d-8243-5aa6717daade tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 0.472258 Mar 05 21:00:22.066949 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1598/3199] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:21 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:22.074553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5dc6a059-45be-4404-bbfb-80d82dd6b0c7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:22.075652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5dc6a059-45be-4404-bbfb-80d82dd6b0c7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:22.085420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5dc6a059-45be-4404-bbfb-80d82dd6b0c7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:22.086928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5dc6a059-45be-4404-bbfb-80d82dd6b0c7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:22.088272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5dc6a059-45be-4404-bbfb-80d82dd6b0c7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:22.089409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5dc6a059-45be-4404-bbfb-80d82dd6b0c7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:22.271289 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-52de5f53-2161-4142-accf-cd7b9ef0dc05 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.505615 Mar 05 21:00:22.278014 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1602/3200] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:21 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:22.285016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a975d602-820d-4180-9381-358f39189ed5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed4f6f2a60>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:22.306336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a975d602-820d-4180-9381-358f39189ed5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:22.314783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a975d602-820d-4180-9381-358f39189ed5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:22.332419 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a975d602-820d-4180-9381-358f39189ed5 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags" status: 200 len: 61 microversion: 2.26 time: 0.052965 Mar 05 21:00:22.337976 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1603/3201] 10.222.0.15 () {60 vars in 1291 bytes} [Sat Mar 5 21:00:22 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags => generated 61 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:22.345655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-13ce09fc-3e2c-489d-9b27-bfde394e5f8d req-3f0dab30-d531-479d-a7d8-d81f35725a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9126c2-8660-405c-a372-7083f5368bb4", "tag": "4ddb96a1-6319-42f4-b30a-01be12098ece"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:22.368831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-13ce09fc-3e2c-489d-9b27-bfde394e5f8d req-3f0dab30-d531-479d-a7d8-d81f35725a8e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:22.370970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-13ce09fc-3e2c-489d-9b27-bfde394e5f8d req-3f0dab30-d531-479d-a7d8-d81f35725a8e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:22.398686 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-13ce09fc-3e2c-489d-9b27-bfde394e5f8d req-3f0dab30-d531-479d-a7d8-d81f35725a8e service nova] Creating event network-changed:4ddb96a1-6319-42f4-b30a-01be12098ece for instance dd9126c2-8660-405c-a372-7083f5368bb4 on nch1-master-1 Mar 05 21:00:22.410728 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-13ce09fc-3e2c-489d-9b27-bfde394e5f8d req-3f0dab30-d531-479d-a7d8-d81f35725a8e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071227 Mar 05 21:00:22.412060 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1604/3202] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:22.423778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b0d5d785-82fb-4391-9e3e-d4fe2f79b9bc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '.version_select at 0x7fed4f7b8dc0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:22.449920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0d5d785-82fb-4391-9e3e-d4fe2f79b9bc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:22.450655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0d5d785-82fb-4391-9e3e-d4fe2f79b9bc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:22.452181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b0d5d785-82fb-4391-9e3e-d4fe2f79b9bc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:22.464904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0d5d785-82fb-4391-9e3e-d4fe2f79b9bc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:22.467681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0d5d785-82fb-4391-9e3e-d4fe2f79b9bc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:22.468735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0d5d785-82fb-4391-9e3e-d4fe2f79b9bc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:22.470356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0d5d785-82fb-4391-9e3e-d4fe2f79b9bc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:22.532037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0d5d785-82fb-4391-9e3e-d4fe2f79b9bc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:22.534000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b0d5d785-82fb-4391-9e3e-d4fe2f79b9bc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:22.565007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-b0d5d785-82fb-4391-9e3e-d4fe2f79b9bc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lazy-loading 'flavor' on Instance uuid 60ce4c56-73a5-49a1-900b-0e76692a4365 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:22.583637 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b0d5d785-82fb-4391-9e3e-d4fe2f79b9bc tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags" status: 204 len: 0 microversion: 2.26 time: 0.170113 Mar 05 21:00:22.585105 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1605/3203] 10.222.0.15 () {60 vars in 1294 bytes} [Sat Mar 5 21:00:22 2022] DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365/tags => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:00:22.591638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-415c1fa5-3bc1-4c0c-ab91-802c22eee4fe tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:22.593107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-415c1fa5-3bc1-4c0c-ab91-802c22eee4fe tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:22.601830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-415c1fa5-3bc1-4c0c-ab91-802c22eee4fe tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:22.602672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-415c1fa5-3bc1-4c0c-ab91-802c22eee4fe tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:22.603941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-415c1fa5-3bc1-4c0c-ab91-802c22eee4fe tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:22.604770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-415c1fa5-3bc1-4c0c-ab91-802c22eee4fe tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:22.653258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5dc6a059-45be-4404-bbfb-80d82dd6b0c7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:22.678743 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5dc6a059-45be-4404-bbfb-80d82dd6b0c7 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1314 microversion: 2.1 time: 0.601649 Mar 05 21:00:22.683694 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1599/3204] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:22 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:22.713979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-027e746b-d6fd-43b0-940d-5fe912b5e297 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:22.714609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-027e746b-d6fd-43b0-940d-5fe912b5e297 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:22.754468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-027e746b-d6fd-43b0-940d-5fe912b5e297 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:22.754953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-027e746b-d6fd-43b0-940d-5fe912b5e297 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:22.759352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-027e746b-d6fd-43b0-940d-5fe912b5e297 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:22.763028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-027e746b-d6fd-43b0-940d-5fe912b5e297 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:22.902373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-027e746b-d6fd-43b0-940d-5fe912b5e297 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:00:23.023698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-415c1fa5-3bc1-4c0c-ab91-802c22eee4fe tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c224262fd83477483a2a0db9295417a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a73148186e46d78a10218811c8ba53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:23.070321 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-415c1fa5-3bc1-4c0c-ab91-802c22eee4fe tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 200 len: 1313 microversion: 2.1 time: 0.476635 Mar 05 21:00:23.073498 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-027e746b-d6fd-43b0-940d-5fe912b5e297 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 204 len: 0 microversion: 2.26 time: 0.385897 Mar 05 21:00:23.077461 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1606/3205] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:22 2022] GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:23.081301 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1600/3206] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:00:22 2022] DELETE /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:00:23.088956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2b5cf4dc-1f1e-4022-a9db-796354b69ad8 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:23.092285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2b5cf4dc-1f1e-4022-a9db-796354b69ad8 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:23.100904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8f5fad83-a62b-4d8e-bcab-6b4f775de46d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:23.103633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8f5fad83-a62b-4d8e-bcab-6b4f775de46d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:23.108784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b5cf4dc-1f1e-4022-a9db-796354b69ad8 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:23.113762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b5cf4dc-1f1e-4022-a9db-796354b69ad8 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:23.114964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b5cf4dc-1f1e-4022-a9db-796354b69ad8 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:23.115626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b5cf4dc-1f1e-4022-a9db-796354b69ad8 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:23.124849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f5fad83-a62b-4d8e-bcab-6b4f775de46d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:23.131864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f5fad83-a62b-4d8e-bcab-6b4f775de46d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:23.135964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f5fad83-a62b-4d8e-bcab-6b4f775de46d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:23.138164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f5fad83-a62b-4d8e-bcab-6b4f775de46d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:23.586183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8f5fad83-a62b-4d8e-bcab-6b4f775de46d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:23.605215 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8f5fad83-a62b-4d8e-bcab-6b4f775de46d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 0.522340 Mar 05 21:00:23.607496 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1601/3207] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:23 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:23.621781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-678638a5-84ea-428c-a2f6-800a5d52dc51 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:23.622839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-678638a5-84ea-428c-a2f6-800a5d52dc51 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:23.648347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-678638a5-84ea-428c-a2f6-800a5d52dc51 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:23.649604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-678638a5-84ea-428c-a2f6-800a5d52dc51 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:23.653859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-678638a5-84ea-428c-a2f6-800a5d52dc51 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:23.655417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-678638a5-84ea-428c-a2f6-800a5d52dc51 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:23.687232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2b5cf4dc-1f1e-4022-a9db-796354b69ad8 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:23.707712 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2b5cf4dc-1f1e-4022-a9db-796354b69ad8 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1327 microversion: 2.1 time: 0.628519 Mar 05 21:00:23.708560 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1607/3208] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:23 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1327 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:23.720950 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-13144558-08b4-4f73-9d8b-20495ff94830 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f7b8430>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:23.794486 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-13144558-08b4-4f73-9d8b-20495ff94830 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.083708 Mar 05 21:00:23.795722 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1608/3209] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:23 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:23.806858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bdfc07ec-04c5-4da5-bd05-40e2c6ea2287 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:23.807735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bdfc07ec-04c5-4da5-bd05-40e2c6ea2287 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:23.814916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bdfc07ec-04c5-4da5-bd05-40e2c6ea2287 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:23.816071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bdfc07ec-04c5-4da5-bd05-40e2c6ea2287 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:23.817120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bdfc07ec-04c5-4da5-bd05-40e2c6ea2287 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:23.817790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bdfc07ec-04c5-4da5-bd05-40e2c6ea2287 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:24.176014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-678638a5-84ea-428c-a2f6-800a5d52dc51 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:24.190140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-678638a5-84ea-428c-a2f6-800a5d52dc51 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:24.195406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-678638a5-84ea-428c-a2f6-800a5d52dc51 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:24.196952 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-678638a5-84ea-428c-a2f6-800a5d52dc51 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 200 len: 1551 microversion: 2.26 time: 0.588272 Mar 05 21:00:24.199706 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1602/3210] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:00:23 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 1551 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:00:24.204495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-81db929b-9d44-4874-83e9-2e43f0569ed0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:24.212550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-81db929b-9d44-4874-83e9-2e43f0569ed0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:24.222712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81db929b-9d44-4874-83e9-2e43f0569ed0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:24.223167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81db929b-9d44-4874-83e9-2e43f0569ed0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:24.224010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81db929b-9d44-4874-83e9-2e43f0569ed0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:24.224460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81db929b-9d44-4874-83e9-2e43f0569ed0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:24.305424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bdfc07ec-04c5-4da5-bd05-40e2c6ea2287 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:24.320475 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bdfc07ec-04c5-4da5-bd05-40e2c6ea2287 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1314 microversion: 2.1 time: 0.520388 Mar 05 21:00:24.321394 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1609/3211] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:23 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:24.628967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1e9a52f4-777c-4da1-9303-52101d93b6e9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:24.629606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1e9a52f4-777c-4da1-9303-52101d93b6e9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:24.648035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e9a52f4-777c-4da1-9303-52101d93b6e9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:24.648778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e9a52f4-777c-4da1-9303-52101d93b6e9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:24.653940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e9a52f4-777c-4da1-9303-52101d93b6e9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:24.655153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e9a52f4-777c-4da1-9303-52101d93b6e9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:24.799483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-81db929b-9d44-4874-83e9-2e43f0569ed0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c224262fd83477483a2a0db9295417a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a73148186e46d78a10218811c8ba53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:24.812256 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-81db929b-9d44-4874-83e9-2e43f0569ed0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 200 len: 1313 microversion: 2.1 time: 0.609244 Mar 05 21:00:24.825270 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1603/3212] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:24 2022] GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:24.830749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0d122ad0-c372-4f98-a5a0-2e64a82c3651 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:24.831414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0d122ad0-c372-4f98-a5a0-2e64a82c3651 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:24.872183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d122ad0-c372-4f98-a5a0-2e64a82c3651 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:24.877531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d122ad0-c372-4f98-a5a0-2e64a82c3651 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:24.882588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d122ad0-c372-4f98-a5a0-2e64a82c3651 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:24.884656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d122ad0-c372-4f98-a5a0-2e64a82c3651 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:25.234526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1e9a52f4-777c-4da1-9303-52101d93b6e9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:25.264536 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1e9a52f4-777c-4da1-9303-52101d93b6e9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 0.644416 Mar 05 21:00:25.265145 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1610/3213] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:24 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:00:25.287730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fbe446f7-40cc-4b9c-8955-251d68c50dfe tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f736ee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:25.441093 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fbe446f7-40cc-4b9c-8955-251d68c50dfe tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.163813 Mar 05 21:00:25.442166 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1611/3214] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:25 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:25.455622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2a14edb5-e664-46d0-bddf-a216291f2d0a tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:25.456512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2a14edb5-e664-46d0-bddf-a216291f2d0a tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:25.477930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a14edb5-e664-46d0-bddf-a216291f2d0a tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:25.480896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a14edb5-e664-46d0-bddf-a216291f2d0a tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:25.485846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a14edb5-e664-46d0-bddf-a216291f2d0a tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:25.489028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a14edb5-e664-46d0-bddf-a216291f2d0a tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:25.893146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2a14edb5-e664-46d0-bddf-a216291f2d0a tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:25.903777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2a14edb5-e664-46d0-bddf-a216291f2d0a tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:25.913020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2a14edb5-e664-46d0-bddf-a216291f2d0a tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8867c9e115844488b679f53829a9d46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c883b952145b45f1aaf4b0d244ff60f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:25.929396 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2a14edb5-e664-46d0-bddf-a216291f2d0a tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 200 len: 1551 microversion: 2.26 time: 0.471211 Mar 05 21:00:25.929396 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1612/3215] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:00:25 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 1551 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:00:25.929396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d1bc6363-1f6f-4286-9685-2c9b64ba2b24 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:25.929396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d1bc6363-1f6f-4286-9685-2c9b64ba2b24 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:25.941520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0d122ad0-c372-4f98-a5a0-2e64a82c3651 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:25.951873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1bc6363-1f6f-4286-9685-2c9b64ba2b24 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:25.952884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1bc6363-1f6f-4286-9685-2c9b64ba2b24 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:25.953257 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0d122ad0-c372-4f98-a5a0-2e64a82c3651 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1528 microversion: 2.1 time: 1.133803 Mar 05 21:00:25.964743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1bc6363-1f6f-4286-9685-2c9b64ba2b24 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:25.964743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1bc6363-1f6f-4286-9685-2c9b64ba2b24 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:25.964920 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1604/3216] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:24 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1528 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:25.967955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7c29daa5-98cc-44fe-b16d-1ce5242045c6 req-ae83eb1a-f70d-4963-8203-7b42fb4c613a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38", "name": "network-vif-plugged", "status": "completed", "tag": "850a46e3-1e9e-41e7-9170-0648694ef580"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:26.004257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7c29daa5-98cc-44fe-b16d-1ce5242045c6 req-ae83eb1a-f70d-4963-8203-7b42fb4c613a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:26.004713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7c29daa5-98cc-44fe-b16d-1ce5242045c6 req-ae83eb1a-f70d-4963-8203-7b42fb4c613a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:26.046900 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7c29daa5-98cc-44fe-b16d-1ce5242045c6 req-ae83eb1a-f70d-4963-8203-7b42fb4c613a service nova] Creating event network-vif-plugged:850a46e3-1e9e-41e7-9170-0648694ef580 for instance dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 on nch2-master-1 Mar 05 21:00:26.061466 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7c29daa5-98cc-44fe-b16d-1ce5242045c6 req-ae83eb1a-f70d-4963-8203-7b42fb4c613a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096835 Mar 05 21:00:26.063374 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1605/3217] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:26.085652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7d037305-2b72-4977-988d-0ecedbe4bdd3 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:26.096758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7d037305-2b72-4977-988d-0ecedbe4bdd3 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:26.103501 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d037305-2b72-4977-988d-0ecedbe4bdd3 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:26.104353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d037305-2b72-4977-988d-0ecedbe4bdd3 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:26.105374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d037305-2b72-4977-988d-0ecedbe4bdd3 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:26.110563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d037305-2b72-4977-988d-0ecedbe4bdd3 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:26.336377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7d037305-2b72-4977-988d-0ecedbe4bdd3 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c224262fd83477483a2a0db9295417a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a73148186e46d78a10218811c8ba53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:26.346243 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7d037305-2b72-4977-988d-0ecedbe4bdd3 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 200 len: 1313 microversion: 2.1 time: 0.281115 Mar 05 21:00:26.349309 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1606/3218] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:26 2022] GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:26.366470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-92d2e62c-7151-48cb-8b69-623d4ab91ca0 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:26.369994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-92d2e62c-7151-48cb-8b69-623d4ab91ca0 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:26.408847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92d2e62c-7151-48cb-8b69-623d4ab91ca0 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:26.413480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92d2e62c-7151-48cb-8b69-623d4ab91ca0 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:26.417066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92d2e62c-7151-48cb-8b69-623d4ab91ca0 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:26.420273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92d2e62c-7151-48cb-8b69-623d4ab91ca0 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:26.624631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d1bc6363-1f6f-4286-9685-2c9b64ba2b24 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:26.636335 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d1bc6363-1f6f-4286-9685-2c9b64ba2b24 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1314 microversion: 2.1 time: 0.719956 Mar 05 21:00:26.647001 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1613/3219] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:25 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:26.653045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a9b4861f-8433-4a00-b5d7-b4e5446c0d3f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:26.653909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a9b4861f-8433-4a00-b5d7-b4e5446c0d3f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:26.660267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9b4861f-8433-4a00-b5d7-b4e5446c0d3f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:26.660979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9b4861f-8433-4a00-b5d7-b4e5446c0d3f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:26.661941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9b4861f-8433-4a00-b5d7-b4e5446c0d3f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:26.662572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9b4861f-8433-4a00-b5d7-b4e5446c0d3f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:26.847635 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-92d2e62c-7151-48cb-8b69-623d4ab91ca0 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:26.857819 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-92d2e62c-7151-48cb-8b69-623d4ab91ca0 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1528 microversion: 2.1 time: 0.504370 Mar 05 21:00:26.860685 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1607/3220] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:26 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1528 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:26.870846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b4d00e52-ec37-435b-9b9c-5ddd2a751ce9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a59d30>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:26.965694 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b4d00e52-ec37-435b-9b9c-5ddd2a751ce9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.103548 Mar 05 21:00:26.967451 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1608/3221] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:26 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:26.972934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e711973a-f5b7-41c3-abef-e9361a14f18e req-3ce82a64-5fd8-4162-8dfa-d10878a62b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ce4c56-73a5-49a1-900b-0e76692a4365", "name": "network-vif-deleted", "tag": "7c055f59-15ed-4a63-957d-f6ef57627bab"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:26.981833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e711973a-f5b7-41c3-abef-e9361a14f18e req-3ce82a64-5fd8-4162-8dfa-d10878a62b91 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:26.982562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e711973a-f5b7-41c3-abef-e9361a14f18e req-3ce82a64-5fd8-4162-8dfa-d10878a62b91 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:27.001988 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e711973a-f5b7-41c3-abef-e9361a14f18e req-3ce82a64-5fd8-4162-8dfa-d10878a62b91 service nova] Creating event network-vif-deleted:7c055f59-15ed-4a63-957d-f6ef57627bab for instance 60ce4c56-73a5-49a1-900b-0e76692a4365 on nch1-master-1 Mar 05 21:00:27.010834 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e711973a-f5b7-41c3-abef-e9361a14f18e req-3ce82a64-5fd8-4162-8dfa-d10878a62b91 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041850 Mar 05 21:00:27.012205 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1609/3222] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:27.489015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-43970557-61c0-444f-9922-166418258652 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:27.489806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-43970557-61c0-444f-9922-166418258652 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:27.500102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43970557-61c0-444f-9922-166418258652 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:27.501679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43970557-61c0-444f-9922-166418258652 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:27.502837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43970557-61c0-444f-9922-166418258652 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:27.503578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43970557-61c0-444f-9922-166418258652 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:27.523479 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-43970557-61c0-444f-9922-166418258652 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] HTTP exception thrown: Instance 2a94cca9-061c-4b5b-9e77-e7695750da06 could not be found. Mar 05 21:00:27.524128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-43970557-61c0-444f-9922-166418258652 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] Returning 404 to user: Instance 2a94cca9-061c-4b5b-9e77-e7695750da06 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:00:27.525638 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-43970557-61c0-444f-9922-166418258652 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 404 len: 111 microversion: 2.1 time: 0.511778 Mar 05 21:00:27.533095 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1610/3223] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:00:27 2022] DELETE /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 111 bytes in 520 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:00:27.538206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8180a12c-543c-4548-bc87-d408e7223946 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:27.539032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8180a12c-543c-4548-bc87-d408e7223946 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] [instance: 60ce4c56-73a5-49a1-900b-0e76692a4365] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:27.551811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8180a12c-543c-4548-bc87-d408e7223946 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:27.552589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8180a12c-543c-4548-bc87-d408e7223946 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:27.554148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8180a12c-543c-4548-bc87-d408e7223946 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:27.554748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8180a12c-543c-4548-bc87-d408e7223946 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:27.576142 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-8180a12c-543c-4548-bc87-d408e7223946 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] HTTP exception thrown: Instance 60ce4c56-73a5-49a1-900b-0e76692a4365 could not be found. Mar 05 21:00:27.576763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8180a12c-543c-4548-bc87-d408e7223946 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] Returning 404 to user: Instance 60ce4c56-73a5-49a1-900b-0e76692a4365 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:00:27.577810 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8180a12c-543c-4548-bc87-d408e7223946 tempest-ServerTagsTestJSON-1207894868 tempest-ServerTagsTestJSON-1207894868-project] 10.222.0.15 "GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365" status: 404 len: 111 microversion: 2.26 time: 0.043483 Mar 05 21:00:27.580028 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1611/3224] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:00:27 2022] GET /compute/v2.1/servers/60ce4c56-73a5-49a1-900b-0e76692a4365 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:00:27.600084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b2c5fb55-42c1-42ee-bd23-542c11a7fd22 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:27.602253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b2c5fb55-42c1-42ee-bd23-542c11a7fd22 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:27.616677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb55-42c1-42ee-bd23-542c11a7fd22 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:27.619305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb55-42c1-42ee-bd23-542c11a7fd22 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:27.620337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb55-42c1-42ee-bd23-542c11a7fd22 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:27.627708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb55-42c1-42ee-bd23-542c11a7fd22 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:27.660470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a9b4861f-8433-4a00-b5d7-b4e5446c0d3f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:27.685310 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a9b4861f-8433-4a00-b5d7-b4e5446c0d3f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 1.031147 Mar 05 21:00:27.690454 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1614/3225] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:26 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:27.701626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-04cbb24f-4052-4341-a287-432d48dd3f49 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:27.702273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-04cbb24f-4052-4341-a287-432d48dd3f49 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:27.719474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04cbb24f-4052-4341-a287-432d48dd3f49 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:27.720243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04cbb24f-4052-4341-a287-432d48dd3f49 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:27.722247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04cbb24f-4052-4341-a287-432d48dd3f49 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:27.722881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04cbb24f-4052-4341-a287-432d48dd3f49 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:28.263490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b2c5fb55-42c1-42ee-bd23-542c11a7fd22 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c224262fd83477483a2a0db9295417a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a73148186e46d78a10218811c8ba53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:28.280501 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b2c5fb55-42c1-42ee-bd23-542c11a7fd22 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 200 len: 1313 microversion: 2.1 time: 0.698499 Mar 05 21:00:28.296056 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1612/3226] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:27 2022] GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 1313 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:28.315621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4f8c162b-f906-4193-8dd9-dcd1669fef4b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:28.323344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4f8c162b-f906-4193-8dd9-dcd1669fef4b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:28.333589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f8c162b-f906-4193-8dd9-dcd1669fef4b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:28.336955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f8c162b-f906-4193-8dd9-dcd1669fef4b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:28.338034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f8c162b-f906-4193-8dd9-dcd1669fef4b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:28.341419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f8c162b-f906-4193-8dd9-dcd1669fef4b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:28.952372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-04cbb24f-4052-4341-a287-432d48dd3f49 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:28.967882 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-04cbb24f-4052-4341-a287-432d48dd3f49 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1528 microversion: 2.1 time: 1.274420 Mar 05 21:00:28.968704 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1615/3227] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:27 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1528 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:28.986148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-798637f5-646f-423d-9af1-8ee77b0f4279 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f6f2e50>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:29.003221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4f8c162b-f906-4193-8dd9-dcd1669fef4b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:29.027362 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4f8c162b-f906-4193-8dd9-dcd1669fef4b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1314 microversion: 2.1 time: 0.727463 Mar 05 21:00:29.028017 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1613/3228] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:28 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:29.033871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5f689e12-5853-4d0c-b6f2-2f6f6adc686a req-238786a9-72de-44c8-a1ab-a125ccf17305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9126c2-8660-405c-a372-7083f5368bb4", "name": "network-vif-plugged", "status": "completed", "tag": "4ddb96a1-6319-42f4-b30a-01be12098ece"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:29.087875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5f689e12-5853-4d0c-b6f2-2f6f6adc686a req-238786a9-72de-44c8-a1ab-a125ccf17305 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:29.088338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5f689e12-5853-4d0c-b6f2-2f6f6adc686a req-238786a9-72de-44c8-a1ab-a125ccf17305 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:29.108237 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-798637f5-646f-423d-9af1-8ee77b0f4279 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.136544 Mar 05 21:00:29.110651 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1616/3229] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:28 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:29.112132 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-5f689e12-5853-4d0c-b6f2-2f6f6adc686a req-238786a9-72de-44c8-a1ab-a125ccf17305 service nova] Creating event network-vif-plugged:4ddb96a1-6319-42f4-b30a-01be12098ece for instance dd9126c2-8660-405c-a372-7083f5368bb4 on nch1-master-1 Mar 05 21:00:29.118376 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5f689e12-5853-4d0c-b6f2-2f6f6adc686a req-238786a9-72de-44c8-a1ab-a125ccf17305 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088010 Mar 05 21:00:29.122848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1d4e510b-57ed-4d31-938b-334fb4573c90 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:29.124054 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1614/3230] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:29.127222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1d4e510b-57ed-4d31-938b-334fb4573c90 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:29.135622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6b790169-1913-4226-a072-578a8756e3d4 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] Action: 'update', calling method: >, body: {"server": {"name": "2a94cca9-061c-4b5b-9e77-e7695750da06_new"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:29.139256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6b790169-1913-4226-a072-578a8756e3d4 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:29.142227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d4e510b-57ed-4d31-938b-334fb4573c90 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:29.146638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d4e510b-57ed-4d31-938b-334fb4573c90 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:29.150504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d4e510b-57ed-4d31-938b-334fb4573c90 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:29.151260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d4e510b-57ed-4d31-938b-334fb4573c90 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:29.162968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b790169-1913-4226-a072-578a8756e3d4 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:29.163915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b790169-1913-4226-a072-578a8756e3d4 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:29.165000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b790169-1913-4226-a072-578a8756e3d4 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:29.171350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b790169-1913-4226-a072-578a8756e3d4 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:29.216193 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-6b790169-1913-4226-a072-578a8756e3d4 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] HTTP exception thrown: Instance 2a94cca9-061c-4b5b-9e77-e7695750da06 could not be found. Mar 05 21:00:29.228537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6b790169-1913-4226-a072-578a8756e3d4 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] Returning 404 to user: Instance 2a94cca9-061c-4b5b-9e77-e7695750da06 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:00:29.229578 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6b790169-1913-4226-a072-578a8756e3d4 tempest-ServersNegativeTestMultiTenantJSON-333783405 tempest-ServersNegativeTestMultiTenantJSON-333783405-project] 10.222.0.15 "PUT /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 404 len: 111 microversion: 2.1 time: 0.104219 Mar 05 21:00:29.230596 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1615/3231] 10.222.0.15 () {60 vars in 1255 bytes} [Sat Mar 5 21:00:29 2022] PUT /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:00:29.246605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c2dc7bdb-8629-42af-99a0-57a297b7e746 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:29.253277 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c2dc7bdb-8629-42af-99a0-57a297b7e746 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:29.262685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2dc7bdb-8629-42af-99a0-57a297b7e746 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:29.264050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2dc7bdb-8629-42af-99a0-57a297b7e746 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:29.266229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2dc7bdb-8629-42af-99a0-57a297b7e746 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:29.266678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2dc7bdb-8629-42af-99a0-57a297b7e746 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:29.324346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c2dc7bdb-8629-42af-99a0-57a297b7e746 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:00:29.492840 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c2dc7bdb-8629-42af-99a0-57a297b7e746 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 204 len: 0 microversion: 2.1 time: 0.256338 Mar 05 21:00:29.496873 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1616/3232] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:00:29 2022] DELETE /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:00:29.505802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9d18b847-4006-4af5-804d-79e70f0c099f tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:29.509375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9d18b847-4006-4af5-804d-79e70f0c099f tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:29.521907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d18b847-4006-4af5-804d-79e70f0c099f tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:29.524440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d18b847-4006-4af5-804d-79e70f0c099f tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:29.528629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d18b847-4006-4af5-804d-79e70f0c099f tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:29.529350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d18b847-4006-4af5-804d-79e70f0c099f tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:29.950079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9d18b847-4006-4af5-804d-79e70f0c099f tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c224262fd83477483a2a0db9295417a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a73148186e46d78a10218811c8ba53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:29.965308 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9d18b847-4006-4af5-804d-79e70f0c099f tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 200 len: 1313 microversion: 2.1 time: 0.466737 Mar 05 21:00:29.975341 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1617/3233] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:29 2022] GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:29.975341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aa4b2e81-4a9e-4e39-8b38-5bb3e2daceaf tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:29.976456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aa4b2e81-4a9e-4e39-8b38-5bb3e2daceaf tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:29.987235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa4b2e81-4a9e-4e39-8b38-5bb3e2daceaf tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:29.996408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa4b2e81-4a9e-4e39-8b38-5bb3e2daceaf tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:29.997294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa4b2e81-4a9e-4e39-8b38-5bb3e2daceaf tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:29.997751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa4b2e81-4a9e-4e39-8b38-5bb3e2daceaf tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:30.161364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1d4e510b-57ed-4d31-938b-334fb4573c90 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:30.175349 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1d4e510b-57ed-4d31-938b-334fb4573c90 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 1.062492 Mar 05 21:00:30.190140 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1617/3234] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:29 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:30.193085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c7332fb3-7bc9-4599-8a7f-e1933917084d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:30.193815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c7332fb3-7bc9-4599-8a7f-e1933917084d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:30.206738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7332fb3-7bc9-4599-8a7f-e1933917084d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:30.207211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7332fb3-7bc9-4599-8a7f-e1933917084d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:30.208055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7332fb3-7bc9-4599-8a7f-e1933917084d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:30.208495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7332fb3-7bc9-4599-8a7f-e1933917084d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:30.369365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aa4b2e81-4a9e-4e39-8b38-5bb3e2daceaf tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:30.385525 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aa4b2e81-4a9e-4e39-8b38-5bb3e2daceaf tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1534 microversion: 2.1 time: 0.417946 Mar 05 21:00:30.389930 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1618/3235] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:29 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1534 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:30.402201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5eab9744-86ee-46cd-aad5-813cdce963c9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f9cc700>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:30.536089 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5eab9744-86ee-46cd-aad5-813cdce963c9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.144125 Mar 05 21:00:30.537937 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1619/3236] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:30 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:30.730707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c7332fb3-7bc9-4599-8a7f-e1933917084d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:30.748340 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c7332fb3-7bc9-4599-8a7f-e1933917084d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1501 microversion: 2.1 time: 0.565555 Mar 05 21:00:30.749900 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1618/3237] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:30 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1501 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:30.769148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-554d41d6-d84e-4a46-9d0f-0f3308fc5191 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:30.769787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-554d41d6-d84e-4a46-9d0f-0f3308fc5191 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:30.783798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-554d41d6-d84e-4a46-9d0f-0f3308fc5191 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:30.786210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-554d41d6-d84e-4a46-9d0f-0f3308fc5191 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:30.788303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-554d41d6-d84e-4a46-9d0f-0f3308fc5191 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:30.788903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-554d41d6-d84e-4a46-9d0f-0f3308fc5191 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:30.984132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-83a3453d-450d-4c39-9de0-8fefd209e195 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:30.985736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-83a3453d-450d-4c39-9de0-8fefd209e195 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:31.010770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a3453d-450d-4c39-9de0-8fefd209e195 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:31.012250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a3453d-450d-4c39-9de0-8fefd209e195 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:31.014651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a3453d-450d-4c39-9de0-8fefd209e195 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:31.016622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a3453d-450d-4c39-9de0-8fefd209e195 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:31.066456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-554d41d6-d84e-4a46-9d0f-0f3308fc5191 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:31.085223 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-554d41d6-d84e-4a46-9d0f-0f3308fc5191 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1501 microversion: 2.1 time: 0.321728 Mar 05 21:00:31.086181 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1620/3238] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:30 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1501 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:31.117108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3c9b7099-67b2-4d5c-b74d-37e3b78ca1e6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:31.117961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3c9b7099-67b2-4d5c-b74d-37e3b78ca1e6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:31.143875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c9b7099-67b2-4d5c-b74d-37e3b78ca1e6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:31.148814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c9b7099-67b2-4d5c-b74d-37e3b78ca1e6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:31.150272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c9b7099-67b2-4d5c-b74d-37e3b78ca1e6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:31.150954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c9b7099-67b2-4d5c-b74d-37e3b78ca1e6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:31.224088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-3c9b7099-67b2-4d5c-b74d-37e3b78ca1e6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lazy-loading 'flavor' on Instance uuid dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:31.412717 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3c9b7099-67b2-4d5c-b74d-37e3b78ca1e6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "POST /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38/action" status: 202 len: 0 microversion: 2.1 time: 0.312092 Mar 05 21:00:31.429361 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1621/3239] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:00:31 2022] POST /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:00:31.438047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7dc5c878-1432-48b2-a308-e6944acb48b6 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:31.442790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7dc5c878-1432-48b2-a308-e6944acb48b6 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:31.451510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7dc5c878-1432-48b2-a308-e6944acb48b6 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:31.452148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7dc5c878-1432-48b2-a308-e6944acb48b6 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:31.455884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7dc5c878-1432-48b2-a308-e6944acb48b6 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:31.455884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7dc5c878-1432-48b2-a308-e6944acb48b6 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:31.694601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-83a3453d-450d-4c39-9de0-8fefd209e195 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c224262fd83477483a2a0db9295417a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a73148186e46d78a10218811c8ba53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:31.711367 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-83a3453d-450d-4c39-9de0-8fefd209e195 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 200 len: 1462 microversion: 2.1 time: 0.732831 Mar 05 21:00:31.716008 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1619/3240] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:30 2022] GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 1462 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:00:31.723819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a02637b2-241a-408b-92e5-13acf981027b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:31.725327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a02637b2-241a-408b-92e5-13acf981027b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:31.733367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a02637b2-241a-408b-92e5-13acf981027b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:31.734104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a02637b2-241a-408b-92e5-13acf981027b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:31.735260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a02637b2-241a-408b-92e5-13acf981027b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:31.736451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a02637b2-241a-408b-92e5-13acf981027b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:31.974172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7dc5c878-1432-48b2-a308-e6944acb48b6 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:31.985719 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7dc5c878-1432-48b2-a308-e6944acb48b6 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 0.552950 Mar 05 21:00:31.989432 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1622/3241] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:31 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:31.994202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9597b207-1aeb-411b-a23e-fef12e711d3e tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:31.994826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9597b207-1aeb-411b-a23e-fef12e711d3e tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:32.011061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9597b207-1aeb-411b-a23e-fef12e711d3e tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:32.011517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9597b207-1aeb-411b-a23e-fef12e711d3e tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:32.020227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9597b207-1aeb-411b-a23e-fef12e711d3e tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:32.020691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9597b207-1aeb-411b-a23e-fef12e711d3e tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:32.234683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a02637b2-241a-408b-92e5-13acf981027b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:32.245273 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a02637b2-241a-408b-92e5-13acf981027b tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1534 microversion: 2.1 time: 0.527974 Mar 05 21:00:32.248423 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1620/3242] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:31 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1534 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:32.255254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f21d1834-abdd-4703-a84e-7fe3237e6916 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f6d0940>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:32.311994 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f21d1834-abdd-4703-a84e-7fe3237e6916 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.062094 Mar 05 21:00:32.313923 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1621/3243] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:32 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:32.374334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9597b207-1aeb-411b-a23e-fef12e711d3e tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:32.389165 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9597b207-1aeb-411b-a23e-fef12e711d3e tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1509 microversion: 2.1 time: 0.398176 Mar 05 21:00:32.393073 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1623/3244] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:31 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1509 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:32.730179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e3c45cc9-1008-4654-b71c-b608739eda0d req-57dc1938-ec14-4cbb-8c19-df4527b652ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a94cca9-061c-4b5b-9e77-e7695750da06", "name": "network-vif-deleted", "tag": "e6ab9b49-2cdd-4131-b322-0ea6ac0003dd"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:32.755236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e3c45cc9-1008-4654-b71c-b608739eda0d req-57dc1938-ec14-4cbb-8c19-df4527b652ca service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:32.758618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e3c45cc9-1008-4654-b71c-b608739eda0d req-57dc1938-ec14-4cbb-8c19-df4527b652ca service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:32.799216 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e3c45cc9-1008-4654-b71c-b608739eda0d req-57dc1938-ec14-4cbb-8c19-df4527b652ca service nova] Creating event network-vif-deleted:e6ab9b49-2cdd-4131-b322-0ea6ac0003dd for instance 2a94cca9-061c-4b5b-9e77-e7695750da06 on nch1-master-1 Mar 05 21:00:32.813908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67ed6f60-0fae-4d62-9cfc-51c50d9797f2 tempest-TenantUsagesTestJSON-1820868936 tempest-TenantUsagesTestJSON-1820868936-project-admin] Calling method '.version_select at 0x7fed4f6aa430>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:32.817504 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e3c45cc9-1008-4654-b71c-b608739eda0d req-57dc1938-ec14-4cbb-8c19-df4527b652ca service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089192 Mar 05 21:00:32.822282 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1624/3245] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:00:32.835398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67ed6f60-0fae-4d62-9cfc-51c50d9797f2 tempest-TenantUsagesTestJSON-1820868936 tempest-TenantUsagesTestJSON-1820868936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:32.835947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67ed6f60-0fae-4d62-9cfc-51c50d9797f2 tempest-TenantUsagesTestJSON-1820868936 tempest-TenantUsagesTestJSON-1820868936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:32.882711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67ed6f60-0fae-4d62-9cfc-51c50d9797f2 tempest-TenantUsagesTestJSON-1820868936 tempest-TenantUsagesTestJSON-1820868936-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:32.883708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67ed6f60-0fae-4d62-9cfc-51c50d9797f2 tempest-TenantUsagesTestJSON-1820868936 tempest-TenantUsagesTestJSON-1820868936-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:32.920194 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67ed6f60-0fae-4d62-9cfc-51c50d9797f2 tempest-TenantUsagesTestJSON-1820868936 tempest-TenantUsagesTestJSON-1820868936-project-admin] 10.222.0.15 "GET /compute/v2.1/os-simple-tenant-usage/a8a73148186e46d78a10218811c8ba53?start=2022-03-04T21%3A00%3A31.725740&end=2022-03-06T21%3A00%3A31.725740" status: 200 len: 694 microversion: 2.1 time: 0.604824 Mar 05 21:00:32.934887 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1622/3246] 10.222.0.15 () {58 vars in 1411 bytes} [Sat Mar 5 21:00:32 2022] GET /compute/v2.1/os-simple-tenant-usage/a8a73148186e46d78a10218811c8ba53?start=2022-03-04T21%3A00%3A31.725740&end=2022-03-06T21%3A00%3A31.725740 => generated 694 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:32.967354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45e870bf-9c72-4b01-9fa6-f825be26e0ae tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '.version_select at 0x7fed4f9e41f0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:32.991370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45e870bf-9c72-4b01-9fa6-f825be26e0ae tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:32.992167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45e870bf-9c72-4b01-9fa6-f825be26e0ae tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:33.004746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bfd1dfbc-3ea5-4bfa-8e8f-bc33052dfba9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:33.006196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bfd1dfbc-3ea5-4bfa-8e8f-bc33052dfba9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:33.023880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bfd1dfbc-3ea5-4bfa-8e8f-bc33052dfba9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:33.024677 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bfd1dfbc-3ea5-4bfa-8e8f-bc33052dfba9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:33.024831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45e870bf-9c72-4b01-9fa6-f825be26e0ae tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:33.025934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45e870bf-9c72-4b01-9fa6-f825be26e0ae tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:33.027211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bfd1dfbc-3ea5-4bfa-8e8f-bc33052dfba9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:33.029349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bfd1dfbc-3ea5-4bfa-8e8f-bc33052dfba9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:33.060263 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45e870bf-9c72-4b01-9fa6-f825be26e0ae tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/os-simple-tenant-usage/a8a73148186e46d78a10218811c8ba53?start=2022-03-04T21%3A00%3A31.725740&end=2022-03-06T21%3A00%3A31.725740" status: 200 len: 690 microversion: 2.1 time: 0.114857 Mar 05 21:00:33.064133 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1625/3247] 10.222.0.15 () {58 vars in 1411 bytes} [Sat Mar 5 21:00:32 2022] GET /compute/v2.1/os-simple-tenant-usage/a8a73148186e46d78a10218811c8ba53?start=2022-03-04T21%3A00%3A31.725740&end=2022-03-06T21%3A00%3A31.725740 => generated 690 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:33.079622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-156cb68f-afbc-48dc-8634-75eb85c0cad4 tempest-TenantUsagesTestJSON-1820868936 tempest-TenantUsagesTestJSON-1820868936-project-admin] Calling method '.version_select at 0x7fed61a358b0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:33.101799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-156cb68f-afbc-48dc-8634-75eb85c0cad4 tempest-TenantUsagesTestJSON-1820868936 tempest-TenantUsagesTestJSON-1820868936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:33.102694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-156cb68f-afbc-48dc-8634-75eb85c0cad4 tempest-TenantUsagesTestJSON-1820868936 tempest-TenantUsagesTestJSON-1820868936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:33.127073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-156cb68f-afbc-48dc-8634-75eb85c0cad4 tempest-TenantUsagesTestJSON-1820868936 tempest-TenantUsagesTestJSON-1820868936-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:33.127855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-156cb68f-afbc-48dc-8634-75eb85c0cad4 tempest-TenantUsagesTestJSON-1820868936 tempest-TenantUsagesTestJSON-1820868936-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:33.365419 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-156cb68f-afbc-48dc-8634-75eb85c0cad4 tempest-TenantUsagesTestJSON-1820868936 tempest-TenantUsagesTestJSON-1820868936-project-admin] 10.222.0.15 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-04T21%3A00%3A31.725740&end=2022-03-06T21%3A00%3A31.725740&detailed=1" status: 200 len: 45834 microversion: 2.1 time: 0.294075 Mar 05 21:00:33.366901 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1626/3248] 10.222.0.15 () {58 vars in 1334 bytes} [Sat Mar 5 21:00:33 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-04T21%3A00%3A31.725740&end=2022-03-06T21%3A00%3A31.725740&detailed=1 => generated 45834 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:00:33.372006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-438155db-9f5c-440e-82e2-5d8ccfa66dd9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:33.372957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-438155db-9f5c-440e-82e2-5d8ccfa66dd9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:33.404957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-438155db-9f5c-440e-82e2-5d8ccfa66dd9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:33.405792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-438155db-9f5c-440e-82e2-5d8ccfa66dd9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:33.407425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-438155db-9f5c-440e-82e2-5d8ccfa66dd9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:33.408339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-438155db-9f5c-440e-82e2-5d8ccfa66dd9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:33.459850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-438155db-9f5c-440e-82e2-5d8ccfa66dd9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:33.460692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-438155db-9f5c-440e-82e2-5d8ccfa66dd9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:33.461718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-438155db-9f5c-440e-82e2-5d8ccfa66dd9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lazy-loading 'fault' on Instance uuid 2a94cca9-061c-4b5b-9e77-e7695750da06 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:33.529986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-438155db-9f5c-440e-82e2-5d8ccfa66dd9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '709aeb5f8ccb49b38e4971bb5c8f53f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe78275333a4f76b61435e6afaf7a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:33.540917 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-438155db-9f5c-440e-82e2-5d8ccfa66dd9 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 200 len: 1317 microversion: 2.1 time: 0.169837 Mar 05 21:00:33.543043 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1627/3249] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:33 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:33.550610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c8533dbd-e30c-45a4-bbc0-a18df607df91 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f9fcee0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:33.622642 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c8533dbd-e30c-45a4-bbc0-a18df607df91 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1454 microversion: 2.1 time: 0.076886 Mar 05 21:00:33.623492 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1628/3250] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:33 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:33.637890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fdc3d717-1d72-422d-80c4-f490bb442596 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:33.638415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fdc3d717-1d72-422d-80c4-f490bb442596 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:33.655250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc3d717-1d72-422d-80c4-f490bb442596 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:33.675953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc3d717-1d72-422d-80c4-f490bb442596 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:33.678552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc3d717-1d72-422d-80c4-f490bb442596 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:33.679282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc3d717-1d72-422d-80c4-f490bb442596 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:33.721728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fdc3d717-1d72-422d-80c4-f490bb442596 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:00:33.946730 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fdc3d717-1d72-422d-80c4-f490bb442596 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 204 len: 0 microversion: 2.1 time: 0.321508 Mar 05 21:00:33.948127 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1629/3251] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:00:33 2022] DELETE /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:00:33.954694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5a42c427-5a22-45af-895a-54b6720b70eb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:33.956682 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5a42c427-5a22-45af-895a-54b6720b70eb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:33.965570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a42c427-5a22-45af-895a-54b6720b70eb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:33.966109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a42c427-5a22-45af-895a-54b6720b70eb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:33.966929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a42c427-5a22-45af-895a-54b6720b70eb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:33.967460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a42c427-5a22-45af-895a-54b6720b70eb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:33.996176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bfd1dfbc-3ea5-4bfa-8e8f-bc33052dfba9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:34.005406 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bfd1dfbc-3ea5-4bfa-8e8f-bc33052dfba9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 1.006240 Mar 05 21:00:34.008516 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1623/3252] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:32 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:00:34.019914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f4540de0-eb87-4079-82a5-5658dfd782a0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:34.020849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f4540de0-eb87-4079-82a5-5658dfd782a0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:34.037298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f4540de0-eb87-4079-82a5-5658dfd782a0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:34.037911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f4540de0-eb87-4079-82a5-5658dfd782a0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:34.039419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f4540de0-eb87-4079-82a5-5658dfd782a0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:34.040124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f4540de0-eb87-4079-82a5-5658dfd782a0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:34.180836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5a42c427-5a22-45af-895a-54b6720b70eb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:34.189603 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5a42c427-5a22-45af-895a-54b6720b70eb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1492 microversion: 2.1 time: 0.240576 Mar 05 21:00:34.190469 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1630/3253] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:33 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1492 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:34.208240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5ca07f02-8ce5-4100-9d89-7982ead6d8f3 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:34.208935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5ca07f02-8ce5-4100-9d89-7982ead6d8f3 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:34.215653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5ca07f02-8ce5-4100-9d89-7982ead6d8f3 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:34.216151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5ca07f02-8ce5-4100-9d89-7982ead6d8f3 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:34.217128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5ca07f02-8ce5-4100-9d89-7982ead6d8f3 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:34.217571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5ca07f02-8ce5-4100-9d89-7982ead6d8f3 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:34.309720 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5ca07f02-8ce5-4100-9d89-7982ead6d8f3 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "POST /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38/action" status: 202 len: 0 microversion: 2.1 time: 0.106323 Mar 05 21:00:34.315340 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1631/3254] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:00:34 2022] POST /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:00:34.327799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e26af419-4ca1-454a-8a38-c136b50ce40d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:34.329846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e26af419-4ca1-454a-8a38-c136b50ce40d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:34.350140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e26af419-4ca1-454a-8a38-c136b50ce40d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:34.350830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e26af419-4ca1-454a-8a38-c136b50ce40d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:34.351766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e26af419-4ca1-454a-8a38-c136b50ce40d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:34.352221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e26af419-4ca1-454a-8a38-c136b50ce40d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:34.517659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e26af419-4ca1-454a-8a38-c136b50ce40d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:34.526001 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e26af419-4ca1-454a-8a38-c136b50ce40d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1498 microversion: 2.1 time: 0.204115 Mar 05 21:00:34.535873 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1632/3255] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:34 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1498 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:34.558904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5176fb0e-19e6-4234-946a-683c4614dc82 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:34.559530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5176fb0e-19e6-4234-946a-683c4614dc82 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] [instance: 2a94cca9-061c-4b5b-9e77-e7695750da06] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:34.566281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5176fb0e-19e6-4234-946a-683c4614dc82 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:34.566733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5176fb0e-19e6-4234-946a-683c4614dc82 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:34.567544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5176fb0e-19e6-4234-946a-683c4614dc82 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:34.568869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5176fb0e-19e6-4234-946a-683c4614dc82 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:34.583790 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-5176fb0e-19e6-4234-946a-683c4614dc82 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] HTTP exception thrown: Instance 2a94cca9-061c-4b5b-9e77-e7695750da06 could not be found. Mar 05 21:00:34.584558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5176fb0e-19e6-4234-946a-683c4614dc82 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] Returning 404 to user: Instance 2a94cca9-061c-4b5b-9e77-e7695750da06 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:00:34.585404 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5176fb0e-19e6-4234-946a-683c4614dc82 tempest-ServersNegativeTestMultiTenantJSON-444601859 tempest-ServersNegativeTestMultiTenantJSON-444601859-project] 10.222.0.15 "GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06" status: 404 len: 111 microversion: 2.1 time: 0.030832 Mar 05 21:00:34.585968 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1633/3256] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:34 2022] GET /compute/v2.1/servers/2a94cca9-061c-4b5b-9e77-e7695750da06 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:00:34.640152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5fbf67c0-9977-45c2-9e0b-fc0adda5bd48 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f996e50>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:34.745405 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5fbf67c0-9977-45c2-9e0b-fc0adda5bd48 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1463 microversion: 2.1 time: 0.112594 Mar 05 21:00:34.753990 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1634/3257] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:34 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1463 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:00:34.759917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c198f027-94e9-4176-ac7c-81f34e8c7b2c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a8bf70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:34.823841 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c198f027-94e9-4176-ac7c-81f34e8c7b2c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 200 len: 1463 microversion: 2.1 time: 0.068063 Mar 05 21:00:34.825597 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1635/3258] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:34 2022] GET /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 1463 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:34.838921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7930a179-7076-4f3f-86f9-50fb90fafd47 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:34.839901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7930a179-7076-4f3f-86f9-50fb90fafd47 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: 00a6114e-7710-4ccf-b462-bb8c98001725] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:34.848331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7930a179-7076-4f3f-86f9-50fb90fafd47 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:34.848984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7930a179-7076-4f3f-86f9-50fb90fafd47 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:34.850013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7930a179-7076-4f3f-86f9-50fb90fafd47 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:34.850531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7930a179-7076-4f3f-86f9-50fb90fafd47 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:35.088854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f4540de0-eb87-4079-82a5-5658dfd782a0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c224262fd83477483a2a0db9295417a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a73148186e46d78a10218811c8ba53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:35.104207 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f4540de0-eb87-4079-82a5-5658dfd782a0 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 200 len: 1468 microversion: 2.1 time: 1.094218 Mar 05 21:00:35.104819 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1624/3259] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:34 2022] GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 1468 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:35.110135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cb17c490-1640-4f37-8ca1-0a738adbafb2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:35.110772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cb17c490-1640-4f37-8ca1-0a738adbafb2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:35.125091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb17c490-1640-4f37-8ca1-0a738adbafb2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:35.125825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb17c490-1640-4f37-8ca1-0a738adbafb2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:35.126809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb17c490-1640-4f37-8ca1-0a738adbafb2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:35.127405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb17c490-1640-4f37-8ca1-0a738adbafb2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:35.222286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7930a179-7076-4f3f-86f9-50fb90fafd47 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:35.230091 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7930a179-7076-4f3f-86f9-50fb90fafd47 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725" status: 200 len: 1468 microversion: 2.1 time: 0.396111 Mar 05 21:00:35.230860 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1636/3260] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:34 2022] GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725 => generated 1468 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:35.250717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-00ea1bfe-b7af-472a-befd-325f3c6e36c8 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a21b80>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:35.403688 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-00ea1bfe-b7af-472a-befd-325f3c6e36c8 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images?changes-since=2022-03-05T20%3A58%3A32Z" status: 200 len: 2375 microversion: 2.1 time: 0.158662 Mar 05 21:00:35.404993 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1637/3261] 10.222.0.15 () {58 vars in 1198 bytes} [Sat Mar 5 21:00:35 2022] GET /compute/v2.1/images?changes-since=2022-03-05T20%3A58%3A32Z => generated 2375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:35.420938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-93bb4459-51c8-40a2-b279-0fe883dd2272 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a22af0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:35.509963 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-93bb4459-51c8-40a2-b279-0fe883dd2272 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1084371851" status: 200 len: 485 microversion: 2.1 time: 0.092991 Mar 05 21:00:35.511721 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1638/3262] 10.222.0.15 () {58 vars in 1230 bytes} [Sat Mar 5 21:00:35 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1084371851 => generated 485 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:35.527299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5293447d-e8b7-4641-98b7-1bcc684137e4 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a21dc0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:35.768698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cb17c490-1640-4f37-8ca1-0a738adbafb2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:35.794357 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cb17c490-1640-4f37-8ca1-0a738adbafb2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 0.688448 Mar 05 21:00:35.794965 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1625/3263] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:35 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:35.800425 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5293447d-e8b7-4641-98b7-1bcc684137e4 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images?server=00a6114e-7710-4ccf-b462-bb8c98001725" status: 200 len: 957 microversion: 2.1 time: 0.278418 Mar 05 21:00:35.810134 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1639/3264] 10.222.0.15 () {58 vars in 1208 bytes} [Sat Mar 5 21:00:35 2022] GET /compute/v2.1/images?server=00a6114e-7710-4ccf-b462-bb8c98001725 => generated 957 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:35.816861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ab668fc4-4d00-495a-854d-1499f532a189 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:35.819548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ab668fc4-4d00-495a-854d-1499f532a189 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:35.822714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd352dea-a524-4256-a4e5-10bc9a63756f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a8bdc0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:35.834045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab668fc4-4d00-495a-854d-1499f532a189 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:35.834510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab668fc4-4d00-495a-854d-1499f532a189 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:35.835303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab668fc4-4d00-495a-854d-1499f532a189 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:35.835789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab668fc4-4d00-495a-854d-1499f532a189 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:35.944590 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd352dea-a524-4256-a4e5-10bc9a63756f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.15%2Fcompute%2Fv2.1%2Fservers%2Fdbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 484 microversion: 2.1 time: 0.124216 Mar 05 21:00:35.944590 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1640/3265] 10.222.0.15 () {58 vars in 1316 bytes} [Sat Mar 5 21:00:35 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.15%2Fcompute%2Fv2.1%2Fservers%2Fdbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 484 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:35.969706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f66675b2-c3c4-42eb-9ca9-1f8e6e6e9c4b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f91b700>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:36.066090 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f66675b2-c3c4-42eb-9ca9-1f8e6e6e9c4b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.15%2Fcompute%2Fservers%2Fdbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 484 microversion: 2.1 time: 0.120538 Mar 05 21:00:36.072746 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1641/3266] 10.222.0.15 () {58 vars in 1302 bytes} [Sat Mar 5 21:00:35 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.15%2Fcompute%2Fservers%2Fdbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 484 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:36.086699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-adfae848-b984-4b9d-b75b-dce408f84edd tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f91b940>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:36.250583 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-adfae848-b984-4b9d-b75b-dce408f84edd tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.169751 Mar 05 21:00:36.251611 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1642/3267] 10.222.0.15 () {58 vars in 1148 bytes} [Sat Mar 5 21:00:36 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:36.256795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ede21429-cdfa-47e2-b46b-49ffce07df3c tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:36.257414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ede21429-cdfa-47e2-b46b-49ffce07df3c tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:36.268496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ede21429-cdfa-47e2-b46b-49ffce07df3c tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:36.269584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ede21429-cdfa-47e2-b46b-49ffce07df3c tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:36.270591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ede21429-cdfa-47e2-b46b-49ffce07df3c tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:36.271227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ede21429-cdfa-47e2-b46b-49ffce07df3c tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:36.571161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ede21429-cdfa-47e2-b46b-49ffce07df3c tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c224262fd83477483a2a0db9295417a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a73148186e46d78a10218811c8ba53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:36.583017 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ede21429-cdfa-47e2-b46b-49ffce07df3c tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 200 len: 1468 microversion: 2.1 time: 0.329767 Mar 05 21:00:36.593072 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1643/3268] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:36 2022] GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 1468 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:36.612550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ab668fc4-4d00-495a-854d-1499f532a189 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:36.620943 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ab668fc4-4d00-495a-854d-1499f532a189 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1498 microversion: 2.1 time: 0.822477 Mar 05 21:00:36.621669 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1626/3269] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:35 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1498 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:36.647364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b585f916-3e71-4ca2-84f6-78c68f539f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f6fc040>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:36.777221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-131969350", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "5345ca04-bcd0-4ca9-94fb-fa648ce6d989"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:36.780206 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b585f916-3e71-4ca2-84f6-78c68f539f87 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.129410 Mar 05 21:00:36.780893 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1627/3270] 10.222.0.15 () {58 vars in 1148 bytes} [Sat Mar 5 21:00:36 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:36.794962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-adfee725-fc8e-41ad-a9dc-2397f0ee9705 req-8452944b-1d9a-454c-9f18-46dfb3ec7e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a6114e-7710-4ccf-b462-bb8c98001725", "name": "network-vif-unplugged", "status": "completed", "tag": "f3d55e8e-71fd-427a-9669-f45552929be7"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:36.821797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-adfee725-fc8e-41ad-a9dc-2397f0ee9705 req-8452944b-1d9a-454c-9f18-46dfb3ec7e84 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:36.822263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-adfee725-fc8e-41ad-a9dc-2397f0ee9705 req-8452944b-1d9a-454c-9f18-46dfb3ec7e84 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:36.860112 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-adfee725-fc8e-41ad-a9dc-2397f0ee9705 req-8452944b-1d9a-454c-9f18-46dfb3ec7e84 service nova] Creating event network-vif-unplugged:f3d55e8e-71fd-427a-9669-f45552929be7 for instance 00a6114e-7710-4ccf-b462-bb8c98001725 on nch1-master-1 Mar 05 21:00:36.873471 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-adfee725-fc8e-41ad-a9dc-2397f0ee9705 req-8452944b-1d9a-454c-9f18-46dfb3ec7e84 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090796 Mar 05 21:00:36.876243 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1628/3271] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:36.880790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] validate_networks() for [('5345ca04-bcd0-4ca9-94fb-fa648ce6d989', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:00:36.887999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3b711839-29a6-4a62-a8cf-bc48ce1cdc6d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f655700>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:36.998532 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3b711839-29a6-4a62-a8cf-bc48ce1cdc6d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.120769 Mar 05 21:00:37.002237 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1629/3272] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 21:00:36 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:37.007291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e1760e9f-4eeb-486d-88d7-60c67a71842c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:37.008422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e1760e9f-4eeb-486d-88d7-60c67a71842c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:37.019983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1760e9f-4eeb-486d-88d7-60c67a71842c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:37.025836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1760e9f-4eeb-486d-88d7-60c67a71842c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:37.027143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1760e9f-4eeb-486d-88d7-60c67a71842c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:37.028122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1760e9f-4eeb-486d-88d7-60c67a71842c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:37.376737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e1760e9f-4eeb-486d-88d7-60c67a71842c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:37.388339 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e1760e9f-4eeb-486d-88d7-60c67a71842c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 0.384757 Mar 05 21:00:37.389577 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1630/3273] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:37 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:37.395655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-7fea7a82-d8b2-48d5-9d6f-2607ede9ec9d req-8e1f2545-0853-4d9e-af31-0167141fce2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9126c2-8660-405c-a372-7083f5368bb4", "name": "network-vif-deleted", "tag": "4ddb96a1-6319-42f4-b30a-01be12098ece"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:37.415894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7fea7a82-d8b2-48d5-9d6f-2607ede9ec9d req-8e1f2545-0853-4d9e-af31-0167141fce2e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:37.416530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7fea7a82-d8b2-48d5-9d6f-2607ede9ec9d req-8e1f2545-0853-4d9e-af31-0167141fce2e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:37.441666 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-7fea7a82-d8b2-48d5-9d6f-2607ede9ec9d req-8e1f2545-0853-4d9e-af31-0167141fce2e service nova] Creating event network-vif-deleted:4ddb96a1-6319-42f4-b30a-01be12098ece for instance dd9126c2-8660-405c-a372-7083f5368bb4 on nch1-master-1 Mar 05 21:00:37.454545 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-7fea7a82-d8b2-48d5-9d6f-2607ede9ec9d req-8e1f2545-0853-4d9e-af31-0167141fce2e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062344 Mar 05 21:00:37.457195 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1631/3274] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:37.463590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-86c40bf2-80bc-45e1-8d80-e983e3967673 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f6558b0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:37.626146 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-86c40bf2-80bc-45e1-8d80-e983e3967673 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/detail?changes-since=2022-03-05T20%3A58%3A27Z" status: 200 len: 6334 microversion: 2.1 time: 0.166366 Mar 05 21:00:37.633674 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1632/3275] 10.222.0.15 () {58 vars in 1219 bytes} [Sat Mar 5 21:00:37 2022] GET /compute/v2.1/images/detail?changes-since=2022-03-05T20%3A58%3A27Z => generated 6334 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:37.639145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2037ce0c-e379-4c3c-b825-230f7560cc16 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:37.642420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2037ce0c-e379-4c3c-b825-230f7560cc16 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] [instance: dd9126c2-8660-405c-a372-7083f5368bb4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:37.661503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2037ce0c-e379-4c3c-b825-230f7560cc16 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:37.661956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2037ce0c-e379-4c3c-b825-230f7560cc16 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:37.662928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2037ce0c-e379-4c3c-b825-230f7560cc16 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:37.663526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2037ce0c-e379-4c3c-b825-230f7560cc16 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:37.691030 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-2037ce0c-e379-4c3c-b825-230f7560cc16 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] HTTP exception thrown: Instance dd9126c2-8660-405c-a372-7083f5368bb4 could not be found. Mar 05 21:00:37.691953 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2037ce0c-e379-4c3c-b825-230f7560cc16 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] Returning 404 to user: Instance dd9126c2-8660-405c-a372-7083f5368bb4 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:00:37.693018 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2037ce0c-e379-4c3c-b825-230f7560cc16 tempest-TenantUsagesTestJSON-1520273454 tempest-TenantUsagesTestJSON-1520273454-project] 10.222.0.15 "GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4" status: 404 len: 111 microversion: 2.1 time: 0.058170 Mar 05 21:00:37.693783 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1633/3276] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:37 2022] GET /compute/v2.1/servers/dd9126c2-8660-405c-a372-7083f5368bb4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:00:37.704667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b636b1c1-d42c-46c6-a997-3c9371305add tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:37.705386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b636b1c1-d42c-46c6-a997-3c9371305add tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:37.712023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b636b1c1-d42c-46c6-a997-3c9371305add tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:37.712599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b636b1c1-d42c-46c6-a997-3c9371305add tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:37.713577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b636b1c1-d42c-46c6-a997-3c9371305add tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:37.714095 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b636b1c1-d42c-46c6-a997-3c9371305add tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:38.027037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:00:38.027524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:00:38.028159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:00:38.028581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:00:38.029004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:00:38.048206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:38.049236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:38.050052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:38.050489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:38.091290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:00:38.097788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for user cfbceb7c8c104af89e7d21ba411e32a8 and project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:00:38.113460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:00:38.116179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:00:38.189921 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-439d9241-00a4-4f3a-b63d-eba40acd6102 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590953 Mar 05 21:00:38.191048 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1644/3277] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:00:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:00:38.202030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d68b0255-2b06-4afd-8471-ac22dd50c02d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f961e50>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:38.264614 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d68b0255-2b06-4afd-8471-ac22dd50c02d tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1084371851" status: 200 len: 665 microversion: 2.1 time: 0.070915 Mar 05 21:00:38.266393 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1645/3278] 10.222.0.15 () {58 vars in 1251 bytes} [Sat Mar 5 21:00:38 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1084371851 => generated 665 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:38.271950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6e997ddf-b829-49a2-8c3a-e03af8dda907 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:38.272786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6e997ddf-b829-49a2-8c3a-e03af8dda907 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:38.370137 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6e997ddf-b829-49a2-8c3a-e03af8dda907 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:38.382054 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6e997ddf-b829-49a2-8c3a-e03af8dda907 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1192 microversion: 2.1 time: 0.114348 Mar 05 21:00:38.382957 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1646/3279] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:38 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1192 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:38.389275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-570780f6-177f-4ddd-b386-dfb803688f01 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61b76430>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:38.399556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b636b1c1-d42c-46c6-a997-3c9371305add tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:38.410268 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b636b1c1-d42c-46c6-a997-3c9371305add tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1501 microversion: 2.1 time: 0.715250 Mar 05 21:00:38.414000 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1634/3280] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:37 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1501 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:38.428747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-80cc9e9f-02fc-449f-80b7-7b7b79a6c591 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:38.429286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-80cc9e9f-02fc-449f-80b7-7b7b79a6c591 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:38.456042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80cc9e9f-02fc-449f-80b7-7b7b79a6c591 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:38.456543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80cc9e9f-02fc-449f-80b7-7b7b79a6c591 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:38.460351 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80cc9e9f-02fc-449f-80b7-7b7b79a6c591 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:38.462208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80cc9e9f-02fc-449f-80b7-7b7b79a6c591 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:38.479246 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-570780f6-177f-4ddd-b386-dfb803688f01 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.15%2Fcompute%2Fv2.1%2Fservers%2Fdbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1466 microversion: 2.1 time: 0.094784 Mar 05 21:00:38.481091 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1647/3281] 10.222.0.15 () {58 vars in 1337 bytes} [Sat Mar 5 21:00:38 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.15%2Fcompute%2Fv2.1%2Fservers%2Fdbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1466 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:38.513922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9a8a71e4-8852-4da1-be0f-ec158cf5dc94 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:38.517454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9a8a71e4-8852-4da1-be0f-ec158cf5dc94 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:38.530588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a8a71e4-8852-4da1-be0f-ec158cf5dc94 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:38.531515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a8a71e4-8852-4da1-be0f-ec158cf5dc94 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:38.532683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a8a71e4-8852-4da1-be0f-ec158cf5dc94 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:38.533378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a8a71e4-8852-4da1-be0f-ec158cf5dc94 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:38.575765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-9a8a71e4-8852-4da1-be0f-ec158cf5dc94 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lazy-loading 'flavor' on Instance uuid dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:38.740708 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9a8a71e4-8852-4da1-be0f-ec158cf5dc94 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "POST /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38/action" status: 202 len: 0 microversion: 2.1 time: 0.257597 Mar 05 21:00:38.742150 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1648/3282] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:00:38 2022] POST /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:00:38.749827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-13dcb1d2-c23c-49cd-b085-52f640f2062f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f9693a0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:38.969235 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-13dcb1d2-c23c-49cd-b085-52f640f2062f tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.15%2Fcompute%2Fservers%2Fdbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1466 microversion: 2.1 time: 0.224454 Mar 05 21:00:38.977979 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1649/3283] 10.222.0.15 () {58 vars in 1323 bytes} [Sat Mar 5 21:00:38 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.15%2Fcompute%2Fservers%2Fdbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1466 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:38.988849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-91186cef-9278-4db4-80c4-e8f644142cde tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:38.990412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-91186cef-9278-4db4-80c4-e8f644142cde tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:39.004576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91186cef-9278-4db4-80c4-e8f644142cde tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:39.005040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91186cef-9278-4db4-80c4-e8f644142cde tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:39.005840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91186cef-9278-4db4-80c4-e8f644142cde tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:39.006287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91186cef-9278-4db4-80c4-e8f644142cde tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:39.616051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-91186cef-9278-4db4-80c4-e8f644142cde tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:39.628831 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-91186cef-9278-4db4-80c4-e8f644142cde tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1509 microversion: 2.1 time: 0.654859 Mar 05 21:00:39.629425 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1650/3284] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:38 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1509 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:39.644942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0ac778f5-13ed-4c5a-adee-ef6424f0e792 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f9f1820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:39.952304 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0ac778f5-13ed-4c5a-adee-ef6424f0e792 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.318888 Mar 05 21:00:39.953932 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1651/3285] 10.222.0.15 () {58 vars in 1169 bytes} [Sat Mar 5 21:00:39 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:39.959085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-523f99a6-c713-4e4f-8a75-60a88b55c3ce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:39.960235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-523f99a6-c713-4e4f-8a75-60a88b55c3ce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:39.974963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-523f99a6-c713-4e4f-8a75-60a88b55c3ce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:39.976078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-523f99a6-c713-4e4f-8a75-60a88b55c3ce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:39.977291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-523f99a6-c713-4e4f-8a75-60a88b55c3ce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:39.979482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-523f99a6-c713-4e4f-8a75-60a88b55c3ce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:40.123208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-80cc9e9f-02fc-449f-80b7-7b7b79a6c591 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:40.131772 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-80cc9e9f-02fc-449f-80b7-7b7b79a6c591 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 1.714297 Mar 05 21:00:40.135589 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1635/3286] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:38 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:40.146985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f2e03fc0-ce3c-48df-af6b-8658c7783731 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f655ca0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:40.159409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-523f99a6-c713-4e4f-8a75-60a88b55c3ce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:40.182038 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-523f99a6-c713-4e4f-8a75-60a88b55c3ce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1244 microversion: 2.1 time: 0.226737 Mar 05 21:00:40.200053 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1652/3287] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:39 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1244 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:40.259072 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f2e03fc0-ce3c-48df-af6b-8658c7783731 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.119986 Mar 05 21:00:40.260632 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1636/3288] 10.222.0.15 () {58 vars in 1169 bytes} [Sat Mar 5 21:00:40 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:40.276963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e70670a0-0d29-4819-8a08-2a4a7862eebd tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f91b940>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:40.337808 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e70670a0-0d29-4819-8a08-2a4a7862eebd tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80" status: 200 len: 784 microversion: 2.1 time: 0.065984 Mar 05 21:00:40.338983 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1653/3289] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:00:40 2022] GET /compute/v2.1/images/81837c2f-28ec-46e4-b5d6-afa9c9233d80 => generated 784 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:40.352539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-45e56858-3eff-452d-8e58-0ccd7afadffa tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f6d0700>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:40.437087 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-45e56858-3eff-452d-8e58-0ccd7afadffa tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.088255 Mar 05 21:00:40.437842 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1637/3290] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 21:00:40 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:00:40.451694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a874d6cf-f718-4aa4-8767-bcb978856c6c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f9f5820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:40.647917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-36aa7a3e-37d4-4d06-bd24-039debb6fb0b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:40.650184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-36aa7a3e-37d4-4d06-bd24-039debb6fb0b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:40.667347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36aa7a3e-37d4-4d06-bd24-039debb6fb0b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:40.669034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36aa7a3e-37d4-4d06-bd24-039debb6fb0b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:40.669881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36aa7a3e-37d4-4d06-bd24-039debb6fb0b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:40.672963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36aa7a3e-37d4-4d06-bd24-039debb6fb0b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:41.644860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-36aa7a3e-37d4-4d06-bd24-039debb6fb0b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:41.656959 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-36aa7a3e-37d4-4d06-bd24-039debb6fb0b tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1492 microversion: 2.1 time: 1.012880 Mar 05 21:00:41.670394 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1638/3291] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:40 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1492 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:41.690430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c6f92476-a2ac-461c-8390-977ff463db17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:41.691101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c6f92476-a2ac-461c-8390-977ff463db17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:41.705040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6f92476-a2ac-461c-8390-977ff463db17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:41.708636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6f92476-a2ac-461c-8390-977ff463db17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:41.709698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6f92476-a2ac-461c-8390-977ff463db17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:41.710463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6f92476-a2ac-461c-8390-977ff463db17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:42.016399 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a874d6cf-f718-4aa4-8767-bcb978856c6c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "DELETE /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7" status: 204 len: 0 microversion: 2.1 time: 1.568281 Mar 05 21:00:42.035305 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1654/3292] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:40 2022] DELETE /compute/v2.1/images/7bcdd77b-e78e-4c7c-a8fb-9fa2288e95e7 => generated 0 bytes in 1580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:00:42.049757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0ee40893-608b-450d-8f01-5eac984406b8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:42.051911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0ee40893-608b-450d-8f01-5eac984406b8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:42.080184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ee40893-608b-450d-8f01-5eac984406b8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:42.080872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ee40893-608b-450d-8f01-5eac984406b8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:42.082162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ee40893-608b-450d-8f01-5eac984406b8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:42.082964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ee40893-608b-450d-8f01-5eac984406b8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:42.351352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c6f92476-a2ac-461c-8390-977ff463db17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:42.364488 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c6f92476-a2ac-461c-8390-977ff463db17 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 0.692804 Mar 05 21:00:42.365198 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1639/3293] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:41 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:42.381221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-da1c6aeb-ca49-41a7-a5c7-66031f7cc2d1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:42.381794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-da1c6aeb-ca49-41a7-a5c7-66031f7cc2d1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:42.403603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da1c6aeb-ca49-41a7-a5c7-66031f7cc2d1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:42.404123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da1c6aeb-ca49-41a7-a5c7-66031f7cc2d1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:42.405007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da1c6aeb-ca49-41a7-a5c7-66031f7cc2d1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:42.405458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da1c6aeb-ca49-41a7-a5c7-66031f7cc2d1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:42.532660 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-da1c6aeb-ca49-41a7-a5c7-66031f7cc2d1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "POST /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38/action" status: 202 len: 0 microversion: 2.1 time: 0.153414 Mar 05 21:00:42.534761 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1640/3294] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:00:42 2022] POST /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:00:42.572582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b672c137-330c-4237-9c84-8a6636212567 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f6aa310>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:42.806386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0ee40893-608b-450d-8f01-5eac984406b8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:42.821628 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0ee40893-608b-450d-8f01-5eac984406b8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1250 microversion: 2.1 time: 0.782701 Mar 05 21:00:42.834785 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1655/3295] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:42 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1250 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:42.846420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-84c4be33-9fea-457c-b011-95ed0c103253 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:42.848011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-84c4be33-9fea-457c-b011-95ed0c103253 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:42.854364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84c4be33-9fea-457c-b011-95ed0c103253 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:42.856185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84c4be33-9fea-457c-b011-95ed0c103253 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:42.857278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84c4be33-9fea-457c-b011-95ed0c103253 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:42.857933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84c4be33-9fea-457c-b011-95ed0c103253 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:43.595889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-84c4be33-9fea-457c-b011-95ed0c103253 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:43.607940 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-84c4be33-9fea-457c-b011-95ed0c103253 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1498 microversion: 2.1 time: 0.771391 Mar 05 21:00:43.608541 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1656/3296] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:42 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1498 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:43.921332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-227bf34a-26b4-49a4-b29f-c56195a5b5f2 tempest-FlavorsV2NegativeTest-1021438507 tempest-FlavorsV2NegativeTest-1021438507-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:43.950202 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-227bf34a-26b4-49a4-b29f-c56195a5b5f2 tempest-FlavorsV2NegativeTest-1021438507 tempest-FlavorsV2NegativeTest-1021438507-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.333089 Mar 05 21:00:43.952706 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1657/3297] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 21:00:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:43.969017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-16949f69-f8b8-4f83-a8c8-2f5f3af2e0c2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:43.969796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-16949f69-f8b8-4f83-a8c8-2f5f3af2e0c2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:43.981673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16949f69-f8b8-4f83-a8c8-2f5f3af2e0c2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:43.982827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16949f69-f8b8-4f83-a8c8-2f5f3af2e0c2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:43.983975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16949f69-f8b8-4f83-a8c8-2f5f3af2e0c2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:43.984613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16949f69-f8b8-4f83-a8c8-2f5f3af2e0c2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:43.997185 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b672c137-330c-4237-9c84-8a6636212567 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "DELETE /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6" status: 204 len: 0 microversion: 2.1 time: 1.458701 Mar 05 21:00:43.998350 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1641/3298] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:42 2022] DELETE /compute/v2.1/images/26a5fa33-5732-4373-8032-5ddb6e880ab6 => generated 0 bytes in 1462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:00:44.006589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-35d0cd2b-f547-49ac-a2d4-dbad3c529612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:44.007735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-35d0cd2b-f547-49ac-a2d4-dbad3c529612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:44.538976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35d0cd2b-f547-49ac-a2d4-dbad3c529612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:44.539622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35d0cd2b-f547-49ac-a2d4-dbad3c529612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:44.541125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35d0cd2b-f547-49ac-a2d4-dbad3c529612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:44.542023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35d0cd2b-f547-49ac-a2d4-dbad3c529612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:44.684056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-16949f69-f8b8-4f83-a8c8-2f5f3af2e0c2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:44.694206 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-16949f69-f8b8-4f83-a8c8-2f5f3af2e0c2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1515 microversion: 2.1 time: 0.740111 Mar 05 21:00:44.697700 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1658/3299] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:43 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1515 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:44.702495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fbd4fed5-0999-40e7-954f-d07fd523ac17 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f9af040>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:45.171468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-35d0cd2b-f547-49ac-a2d4-dbad3c529612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:45.186999 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-35d0cd2b-f547-49ac-a2d4-dbad3c529612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1292 microversion: 2.1 time: 1.187184 Mar 05 21:00:45.188754 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1642/3300] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:43 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1292 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:45.194353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f76be6e2-5955-40b1-9475-7efb36a4e29f tempest-FlavorsV2NegativeTest-1021438507 tempest-FlavorsV2NegativeTest-1021438507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1685286158", "imageRef": "09dfe685-6c6f-4913-bdfd-8ad527938e76", "flavorRef": "452"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:45.282661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-f76be6e2-5955-40b1-9475-7efb36a4e29f tempest-FlavorsV2NegativeTest-1021438507 tempest-FlavorsV2NegativeTest-1021438507-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:00:45.443485 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fbd4fed5-0999-40e7-954f-d07fd523ac17 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "DELETE /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5" status: 204 len: 0 microversion: 2.1 time: 0.744516 Mar 05 21:00:45.444223 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1659/3301] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:44 2022] DELETE /compute/v2.1/images/dca16b96-3836-4a76-9278-ccf141a837d5 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:00:45.448813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9ca76958-f943-4b33-a853-cafe553b092d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:45.449435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9ca76958-f943-4b33-a853-cafe553b092d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:45.458607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ca76958-f943-4b33-a853-cafe553b092d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:45.459276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ca76958-f943-4b33-a853-cafe553b092d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:45.460305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ca76958-f943-4b33-a853-cafe553b092d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:45.460913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ca76958-f943-4b33-a853-cafe553b092d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:46.058964 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-f76be6e2-5955-40b1-9475-7efb36a4e29f tempest-FlavorsV2NegativeTest-1021438507 tempest-FlavorsV2NegativeTest-1021438507-project] HTTP exception thrown: Flavor's memory is too small for requested image. Mar 05 21:00:46.060051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f76be6e2-5955-40b1-9475-7efb36a4e29f tempest-FlavorsV2NegativeTest-1021438507 tempest-FlavorsV2NegativeTest-1021438507-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:00:46.061082 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f76be6e2-5955-40b1-9475-7efb36a4e29f tempest-FlavorsV2NegativeTest-1021438507 tempest-FlavorsV2NegativeTest-1021438507-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.871183 Mar 05 21:00:46.064424 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1643/3302] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:00:45 2022] POST /compute/v2.1/servers => generated 93 bytes in 875 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 05 21:00:46.072058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9d4e41b9-d4db-4a3f-beaa-8669d63afe51 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:46.083030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9d4e41b9-d4db-4a3f-beaa-8669d63afe51 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:46.095082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d4e41b9-d4db-4a3f-beaa-8669d63afe51 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:46.095789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d4e41b9-d4db-4a3f-beaa-8669d63afe51 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:46.097824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d4e41b9-d4db-4a3f-beaa-8669d63afe51 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:46.098447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d4e41b9-d4db-4a3f-beaa-8669d63afe51 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:46.193770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9d4e41b9-d4db-4a3f-beaa-8669d63afe51 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:00:46.382508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9ca76958-f943-4b33-a853-cafe553b092d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:46.410954 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9ca76958-f943-4b33-a853-cafe553b092d tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1498 microversion: 2.1 time: 0.964916 Mar 05 21:00:46.413059 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1660/3303] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:45 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1498 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:46.428394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-49099755-8645-41fd-bbe9-1d2f93be9b6c req-b08e4c96-5eeb-4364-a475-8c49238a7a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583f8cd2-5dd5-4afb-973c-8029c917a627", "tag": "13e30f1f-3efa-4b94-9aa8-e3fa05224e82"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:46.446016 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9d4e41b9-d4db-4a3f-beaa-8669d63afe51 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 204 len: 0 microversion: 2.1 time: 0.377256 Mar 05 21:00:46.446654 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1644/3304] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:00:46 2022] DELETE /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:00:46.464905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-49099755-8645-41fd-bbe9-1d2f93be9b6c req-b08e4c96-5eeb-4364-a475-8c49238a7a98 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:46.467804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-49099755-8645-41fd-bbe9-1d2f93be9b6c req-b08e4c96-5eeb-4364-a475-8c49238a7a98 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:46.470303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ecced813-6ebd-48bd-8730-dcfe24c9d730 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:46.475782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ecced813-6ebd-48bd-8730-dcfe24c9d730 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:46.517666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ecced813-6ebd-48bd-8730-dcfe24c9d730 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:46.518336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ecced813-6ebd-48bd-8730-dcfe24c9d730 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:46.528058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ecced813-6ebd-48bd-8730-dcfe24c9d730 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:46.528706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ecced813-6ebd-48bd-8730-dcfe24c9d730 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:46.541441 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-49099755-8645-41fd-bbe9-1d2f93be9b6c req-b08e4c96-5eeb-4364-a475-8c49238a7a98 service nova] Creating event network-changed:13e30f1f-3efa-4b94-9aa8-e3fa05224e82 for instance 583f8cd2-5dd5-4afb-973c-8029c917a627 on nch1-master-1 Mar 05 21:00:46.570660 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-49099755-8645-41fd-bbe9-1d2f93be9b6c req-b08e4c96-5eeb-4364-a475-8c49238a7a98 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150694 Mar 05 21:00:46.571384 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1661/3305] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:46.598741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1c5420b2-a635-4c6f-863a-927aec816bab tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:46.599467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1c5420b2-a635-4c6f-863a-927aec816bab tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:46.662480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c5420b2-a635-4c6f-863a-927aec816bab tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:46.663057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c5420b2-a635-4c6f-863a-927aec816bab tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:46.663947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c5420b2-a635-4c6f-863a-927aec816bab tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:46.664385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c5420b2-a635-4c6f-863a-927aec816bab tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:47.042154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ecced813-6ebd-48bd-8730-dcfe24c9d730 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:47.054562 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ecced813-6ebd-48bd-8730-dcfe24c9d730 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1521 microversion: 2.1 time: 0.602495 Mar 05 21:00:47.067420 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1645/3306] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:46 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:47.073820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0f41d520-1af8-429c-a682-1e12eb363b8a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:47.074457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0f41d520-1af8-429c-a682-1e12eb363b8a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:47.097467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f41d520-1af8-429c-a682-1e12eb363b8a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:47.099186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f41d520-1af8-429c-a682-1e12eb363b8a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:47.100317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f41d520-1af8-429c-a682-1e12eb363b8a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:47.105375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f41d520-1af8-429c-a682-1e12eb363b8a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:47.248280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1c5420b2-a635-4c6f-863a-927aec816bab tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:47.259113 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1c5420b2-a635-4c6f-863a-927aec816bab tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1292 microversion: 2.1 time: 0.681486 Mar 05 21:00:47.260816 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1662/3307] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:46 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1292 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:47.266727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-337641014", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "c34535e3-e400-4c55-a1a3-ed7a1b0771fd"}, {"uuid": "8cd4a347-d767-466b-a1b2-31d8566918a4"}, {"uuid": "c34535e3-e400-4c55-a1a3-ed7a1b0771fd"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:47.353930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] validate_networks() for [('c34535e3-e400-4c55-a1a3-ed7a1b0771fd', None, None, None, None, None), ('8cd4a347-d767-466b-a1b2-31d8566918a4', None, None, None, None, None), ('c34535e3-e400-4c55-a1a3-ed7a1b0771fd', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:00:47.916136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0f41d520-1af8-429c-a682-1e12eb363b8a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:47.929285 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0f41d520-1af8-429c-a682-1e12eb363b8a tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1473 microversion: 2.1 time: 0.860541 Mar 05 21:00:47.930478 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1646/3308] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:47 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1473 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:47.939579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cb4cd1f1-73b6-4eea-b31f-5fcd55945df8 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:47.940385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cb4cd1f1-73b6-4eea-b31f-5fcd55945df8 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:47.953602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb4cd1f1-73b6-4eea-b31f-5fcd55945df8 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:47.954252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb4cd1f1-73b6-4eea-b31f-5fcd55945df8 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:47.958822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb4cd1f1-73b6-4eea-b31f-5fcd55945df8 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:47.959520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb4cd1f1-73b6-4eea-b31f-5fcd55945df8 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:48.544693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cb4cd1f1-73b6-4eea-b31f-5fcd55945df8 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:48.558121 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cb4cd1f1-73b6-4eea-b31f-5fcd55945df8 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1501 microversion: 2.1 time: 0.626365 Mar 05 21:00:48.558743 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1647/3309] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:47 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1501 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:48.571225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6919b773-a550-4b86-b347-c36689c22173 req-81cacfb2-c1bf-46b9-b1f3-673e1d274c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0ba2b9-85e8-4b78-91be-461650cff33f", "name": "network-vif-unplugged", "status": "completed", "tag": "55bf9cc0-eea1-4e21-b8d6-e730f4a85fe8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:48.609923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6919b773-a550-4b86-b347-c36689c22173 req-81cacfb2-c1bf-46b9-b1f3-673e1d274c11 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:48.610685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6919b773-a550-4b86-b347-c36689c22173 req-81cacfb2-c1bf-46b9-b1f3-673e1d274c11 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:48.634599 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6919b773-a550-4b86-b347-c36689c22173 req-81cacfb2-c1bf-46b9-b1f3-673e1d274c11 service nova] Creating event network-vif-unplugged:55bf9cc0-eea1-4e21-b8d6-e730f4a85fe8 for instance 9f0ba2b9-85e8-4b78-91be-461650cff33f on nch2-master-1 Mar 05 21:00:48.641363 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6919b773-a550-4b86-b347-c36689c22173 req-81cacfb2-c1bf-46b9-b1f3-673e1d274c11 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079371 Mar 05 21:00:48.643572 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1648/3310] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:48.653099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-048c1ee3-72a8-43c4-b910-84f34b5570c5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:48.654164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-048c1ee3-72a8-43c4-b910-84f34b5570c5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:48.667163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-048c1ee3-72a8-43c4-b910-84f34b5570c5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:48.668585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-048c1ee3-72a8-43c4-b910-84f34b5570c5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:48.669707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-048c1ee3-72a8-43c4-b910-84f34b5570c5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:48.674879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-048c1ee3-72a8-43c4-b910-84f34b5570c5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:49.387908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-048c1ee3-72a8-43c4-b910-84f34b5570c5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:49.401259 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-048c1ee3-72a8-43c4-b910-84f34b5570c5 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1521 microversion: 2.1 time: 0.753692 Mar 05 21:00:49.401973 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1649/3311] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:48 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1521 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:49.420774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c0c00b94-f492-4922-afc7-67db8ed643eb tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:49.421752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c0c00b94-f492-4922-afc7-67db8ed643eb tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:49.444690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c0c00b94-f492-4922-afc7-67db8ed643eb tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:49.446622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c0c00b94-f492-4922-afc7-67db8ed643eb tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:49.447804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c0c00b94-f492-4922-afc7-67db8ed643eb tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:49.460492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c0c00b94-f492-4922-afc7-67db8ed643eb tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:50.017744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c0c00b94-f492-4922-afc7-67db8ed643eb tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:50.028701 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c0c00b94-f492-4922-afc7-67db8ed643eb tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1292 microversion: 2.1 time: 0.624579 Mar 05 21:00:50.029973 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1650/3312] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:49 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1292 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:50.041332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8a855300-a72d-447a-9818-6957825218fc tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:50.042628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8a855300-a72d-447a-9818-6957825218fc tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:50.058189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a855300-a72d-447a-9818-6957825218fc tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:50.058900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a855300-a72d-447a-9818-6957825218fc tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:50.059849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a855300-a72d-447a-9818-6957825218fc tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:50.060401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a855300-a72d-447a-9818-6957825218fc tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:50.126849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8a855300-a72d-447a-9818-6957825218fc tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:00:50.348555 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8a855300-a72d-447a-9818-6957825218fc tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 204 len: 0 microversion: 2.1 time: 0.316667 Mar 05 21:00:50.349712 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1651/3313] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:00:50 2022] DELETE /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:00:50.355587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-53878693-28fa-4240-a473-d56cef88c7f9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:50.360954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-53878693-28fa-4240-a473-d56cef88c7f9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:50.391092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53878693-28fa-4240-a473-d56cef88c7f9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:50.394907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53878693-28fa-4240-a473-d56cef88c7f9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:50.396382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:00:50.396917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:00:50.397296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:00:50.398024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:00:50.398598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:00:50.400697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53878693-28fa-4240-a473-d56cef88c7f9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:50.401250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53878693-28fa-4240-a473-d56cef88c7f9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:50.410265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:50.410709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:50.411520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:50.411996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:50.465273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Getting quotas for project 7cdb6564d9b940f4b35211e858ba1bb2. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:00:50.471980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Getting quotas for user 5654ba611fb14b5ba8ead5c3b331522a and project 7cdb6564d9b940f4b35211e858ba1bb2. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:00:50.487315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:00:50.490225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:00:50.568077 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-05738292-7582-4c64-9852-17a89ff8eb7c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.303887 Mar 05 21:00:50.570293 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1663/3314] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:00:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:00:50.584684 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8f84a8f4-5566-4f7d-a114-74289e7b7866 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:50.587092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8f84a8f4-5566-4f7d-a114-74289e7b7866 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:50.616256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f84a8f4-5566-4f7d-a114-74289e7b7866 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:50.616945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f84a8f4-5566-4f7d-a114-74289e7b7866 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:50.618828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f84a8f4-5566-4f7d-a114-74289e7b7866 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:50.619681 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f84a8f4-5566-4f7d-a114-74289e7b7866 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:50.709381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-53878693-28fa-4240-a473-d56cef88c7f9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:50.727715 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-53878693-28fa-4240-a473-d56cef88c7f9 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 200 len: 1431 microversion: 2.1 time: 0.376514 Mar 05 21:00:50.746908 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1652/3315] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:50 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 1431 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:50.762484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-26d5f6e7-47ee-4cf3-b5fe-e85dc6e6c2ba req-6d9d1b12-ddc2-4c56-bbdf-9e72291c74e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc23752-0101-4c2b-a90f-6ccad692e3f3", "name": "network-vif-deleted", "tag": "d89b87d8-65fa-4882-ac07-f0f70c7ec7eb"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:50.790263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-26d5f6e7-47ee-4cf3-b5fe-e85dc6e6c2ba req-6d9d1b12-ddc2-4c56-bbdf-9e72291c74e9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:50.793560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-26d5f6e7-47ee-4cf3-b5fe-e85dc6e6c2ba req-6d9d1b12-ddc2-4c56-bbdf-9e72291c74e9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:50.829026 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-26d5f6e7-47ee-4cf3-b5fe-e85dc6e6c2ba req-6d9d1b12-ddc2-4c56-bbdf-9e72291c74e9 service nova] Creating event network-vif-deleted:d89b87d8-65fa-4882-ac07-f0f70c7ec7eb for instance dbc23752-0101-4c2b-a90f-6ccad692e3f3 on nch2-master-1 Mar 05 21:00:50.844351 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-26d5f6e7-47ee-4cf3-b5fe-e85dc6e6c2ba req-6d9d1b12-ddc2-4c56-bbdf-9e72291c74e9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090534 Mar 05 21:00:50.845726 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1653/3316] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:50.868120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e6848e25-095d-46d0-b535-7ac50de122a9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:50.869179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e6848e25-095d-46d0-b535-7ac50de122a9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:50.888369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6848e25-095d-46d0-b535-7ac50de122a9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:50.888948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6848e25-095d-46d0-b535-7ac50de122a9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:50.889894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6848e25-095d-46d0-b535-7ac50de122a9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:50.894266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6848e25-095d-46d0-b535-7ac50de122a9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:51.252428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8f84a8f4-5566-4f7d-a114-74289e7b7866 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:51.263312 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8f84a8f4-5566-4f7d-a114-74289e7b7866 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1507 microversion: 2.1 time: 0.691707 Mar 05 21:00:51.266679 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1664/3317] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:50 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1507 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:51.271645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-536f1924-a60b-4b8d-92f0-8c21beda3dc7 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:51.280237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-536f1924-a60b-4b8d-92f0-8c21beda3dc7 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:51.349155 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e6848e25-095d-46d0-b535-7ac50de122a9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:51.374338 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e6848e25-095d-46d0-b535-7ac50de122a9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1521 microversion: 2.1 time: 0.522183 Mar 05 21:00:51.377269 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1654/3318] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:50 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1521 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:51.385327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c3ecdcc4-fd58-4ae1-a53f-e5b4099490b6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:51.389768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c3ecdcc4-fd58-4ae1-a53f-e5b4099490b6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:51.415383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3ecdcc4-fd58-4ae1-a53f-e5b4099490b6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:51.416110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3ecdcc4-fd58-4ae1-a53f-e5b4099490b6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:51.416672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3ecdcc4-fd58-4ae1-a53f-e5b4099490b6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:51.417106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3ecdcc4-fd58-4ae1-a53f-e5b4099490b6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:51.491346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-536f1924-a60b-4b8d-92f0-8c21beda3dc7 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:51.516227 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-536f1924-a60b-4b8d-92f0-8c21beda3dc7 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1212 microversion: 2.1 time: 0.247043 Mar 05 21:00:51.529752 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1665/3319] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:51 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1212 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:51.758118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ed939d1d-b158-4da5-b277-f453ce5593cb tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:51.760154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ed939d1d-b158-4da5-b277-f453ce5593cb tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: dbc23752-0101-4c2b-a90f-6ccad692e3f3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:51.783110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed939d1d-b158-4da5-b277-f453ce5593cb tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:51.787511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed939d1d-b158-4da5-b277-f453ce5593cb tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:51.788911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed939d1d-b158-4da5-b277-f453ce5593cb tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:51.790119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed939d1d-b158-4da5-b277-f453ce5593cb tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:51.823210 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-ed939d1d-b158-4da5-b277-f453ce5593cb tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] HTTP exception thrown: Instance dbc23752-0101-4c2b-a90f-6ccad692e3f3 could not be found. Mar 05 21:00:51.823889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ed939d1d-b158-4da5-b277-f453ce5593cb tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Returning 404 to user: Instance dbc23752-0101-4c2b-a90f-6ccad692e3f3 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:00:51.824748 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ed939d1d-b158-4da5-b277-f453ce5593cb tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3" status: 404 len: 111 microversion: 2.1 time: 0.076995 Mar 05 21:00:51.834284 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1666/3320] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:51 2022] GET /compute/v2.1/servers/dbc23752-0101-4c2b-a90f-6ccad692e3f3 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:00:51.857104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2d2b3be5-8834-4ed0-b9e3-3276c17c00e7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:51.857939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2d2b3be5-8834-4ed0-b9e3-3276c17c00e7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: 00a6114e-7710-4ccf-b462-bb8c98001725] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:51.875997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d2b3be5-8834-4ed0-b9e3-3276c17c00e7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:51.878636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d2b3be5-8834-4ed0-b9e3-3276c17c00e7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:51.881104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d2b3be5-8834-4ed0-b9e3-3276c17c00e7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:51.890924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d2b3be5-8834-4ed0-b9e3-3276c17c00e7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:51.935510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c3ecdcc4-fd58-4ae1-a53f-e5b4099490b6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:51.942552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2d2b3be5-8834-4ed0-b9e3-3276c17c00e7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: 00a6114e-7710-4ccf-b462-bb8c98001725] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:00:51.944701 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c3ecdcc4-fd58-4ae1-a53f-e5b4099490b6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1292 microversion: 2.1 time: 0.565941 Mar 05 21:00:51.945514 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1655/3321] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:51 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1292 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:52.005364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-a9ca3851-6498-496b-abb9-6b489670757a req-3b867a0a-e0c0-4334-90c3-e794d651bbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0ba2b9-85e8-4b78-91be-461650cff33f", "name": "network-vif-plugged", "status": "completed", "tag": "55bf9cc0-eea1-4e21-b8d6-e730f4a85fe8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:52.014106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a9ca3851-6498-496b-abb9-6b489670757a req-3b867a0a-e0c0-4334-90c3-e794d651bbb1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:52.014919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a9ca3851-6498-496b-abb9-6b489670757a req-3b867a0a-e0c0-4334-90c3-e794d651bbb1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:52.037560 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-a9ca3851-6498-496b-abb9-6b489670757a req-3b867a0a-e0c0-4334-90c3-e794d651bbb1 service nova] Creating event network-vif-plugged:55bf9cc0-eea1-4e21-b8d6-e730f4a85fe8 for instance 9f0ba2b9-85e8-4b78-91be-461650cff33f on nch2-master-1 Mar 05 21:00:52.045902 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-a9ca3851-6498-496b-abb9-6b489670757a req-3b867a0a-e0c0-4334-90c3-e794d651bbb1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044392 Mar 05 21:00:52.046858 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1656/3322] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:00:52.110729 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2d2b3be5-8834-4ed0-b9e3-3276c17c00e7 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "DELETE /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725" status: 204 len: 0 microversion: 2.1 time: 0.271605 Mar 05 21:00:52.112075 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1667/3323] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:00:51 2022] DELETE /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:00:52.120413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0131f835-23c3-413d-a9b5-0b12746c27ca tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:52.121122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0131f835-23c3-413d-a9b5-0b12746c27ca tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: 00a6114e-7710-4ccf-b462-bb8c98001725] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:52.135068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0131f835-23c3-413d-a9b5-0b12746c27ca tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:52.135453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0131f835-23c3-413d-a9b5-0b12746c27ca tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:52.136287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0131f835-23c3-413d-a9b5-0b12746c27ca tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:52.136731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0131f835-23c3-413d-a9b5-0b12746c27ca tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:52.284135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6feaf5ab-c568-482b-a374-3dea03a3046f tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:52.284864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6feaf5ab-c568-482b-a374-3dea03a3046f tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:52.298444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6feaf5ab-c568-482b-a374-3dea03a3046f tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:52.299106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6feaf5ab-c568-482b-a374-3dea03a3046f tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:52.300096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6feaf5ab-c568-482b-a374-3dea03a3046f tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:52.304259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6feaf5ab-c568-482b-a374-3dea03a3046f tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:52.733728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0131f835-23c3-413d-a9b5-0b12746c27ca tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:52.742596 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0131f835-23c3-413d-a9b5-0b12746c27ca tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725" status: 200 len: 1474 microversion: 2.1 time: 0.626041 Mar 05 21:00:52.754450 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1657/3324] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:52 2022] GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725 => generated 1474 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:52.762144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b7f76f63-0dc1-4198-9a29-6a1936815012 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:52.763368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b7f76f63-0dc1-4198-9a29-6a1936815012 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:52.772951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b7f76f63-0dc1-4198-9a29-6a1936815012 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:52.773874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b7f76f63-0dc1-4198-9a29-6a1936815012 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:52.775713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b7f76f63-0dc1-4198-9a29-6a1936815012 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:52.776713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b7f76f63-0dc1-4198-9a29-6a1936815012 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:52.988672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6feaf5ab-c568-482b-a374-3dea03a3046f tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:52.997258 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6feaf5ab-c568-482b-a374-3dea03a3046f tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1507 microversion: 2.1 time: 0.719101 Mar 05 21:00:53.003237 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1668/3325] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:52 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1507 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:53.008250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fc3f6ab9-93c6-4ef8-8da1-3c086dac1da7 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:53.014946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fc3f6ab9-93c6-4ef8-8da1-3c086dac1da7 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:53.029067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fc3f6ab9-93c6-4ef8-8da1-3c086dac1da7 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:53.029835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fc3f6ab9-93c6-4ef8-8da1-3c086dac1da7 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:53.030901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fc3f6ab9-93c6-4ef8-8da1-3c086dac1da7 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:53.038601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fc3f6ab9-93c6-4ef8-8da1-3c086dac1da7 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:53.082917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b7f76f63-0dc1-4198-9a29-6a1936815012 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:53.098566 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b7f76f63-0dc1-4198-9a29-6a1936815012 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1521 microversion: 2.1 time: 0.341758 Mar 05 21:00:53.100035 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1658/3326] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:52 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:53.104651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-25f5b5ae-93ca-4222-86f1-e2ad6f3eda74 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:53.105259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-25f5b5ae-93ca-4222-86f1-e2ad6f3eda74 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:53.111575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-25f5b5ae-93ca-4222-86f1-e2ad6f3eda74 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:53.112241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-25f5b5ae-93ca-4222-86f1-e2ad6f3eda74 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:53.112930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-25f5b5ae-93ca-4222-86f1-e2ad6f3eda74 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:53.113966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-25f5b5ae-93ca-4222-86f1-e2ad6f3eda74 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:53.145570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fc3f6ab9-93c6-4ef8-8da1-3c086dac1da7 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:53.153736 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fc3f6ab9-93c6-4ef8-8da1-3c086dac1da7 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1270 microversion: 2.1 time: 0.149074 Mar 05 21:00:53.156689 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1669/3327] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:53 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:53.769646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-32059738-562e-4e84-8e0f-701747779c13 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:53.774103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-32059738-562e-4e84-8e0f-701747779c13 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: 00a6114e-7710-4ccf-b462-bb8c98001725] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:53.806175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32059738-562e-4e84-8e0f-701747779c13 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:53.808672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32059738-562e-4e84-8e0f-701747779c13 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:53.813402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32059738-562e-4e84-8e0f-701747779c13 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:53.814534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32059738-562e-4e84-8e0f-701747779c13 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:53.847633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-25f5b5ae-93ca-4222-86f1-e2ad6f3eda74 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:53.855508 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-25f5b5ae-93ca-4222-86f1-e2ad6f3eda74 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1292 microversion: 2.1 time: 0.754382 Mar 05 21:00:53.858219 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1659/3328] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:53 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1292 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:54.018270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-da2a2646-bce3-46f8-98d4-aae43a9ff7f6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:54.018913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-da2a2646-bce3-46f8-98d4-aae43a9ff7f6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:54.034840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da2a2646-bce3-46f8-98d4-aae43a9ff7f6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:54.037359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da2a2646-bce3-46f8-98d4-aae43a9ff7f6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:54.038750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da2a2646-bce3-46f8-98d4-aae43a9ff7f6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:54.041663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da2a2646-bce3-46f8-98d4-aae43a9ff7f6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:54.353669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-da2a2646-bce3-46f8-98d4-aae43a9ff7f6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:54.367065 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-da2a2646-bce3-46f8-98d4-aae43a9ff7f6 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1507 microversion: 2.1 time: 0.353530 Mar 05 21:00:54.368667 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1660/3329] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:54 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1507 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:00:54.374333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-97f60bdd-3e29-48e5-a85f-44ecabe8f917 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:54.375875 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-97f60bdd-3e29-48e5-a85f-44ecabe8f917 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:54.382868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97f60bdd-3e29-48e5-a85f-44ecabe8f917 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:54.383733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97f60bdd-3e29-48e5-a85f-44ecabe8f917 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:54.384762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97f60bdd-3e29-48e5-a85f-44ecabe8f917 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:54.385756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97f60bdd-3e29-48e5-a85f-44ecabe8f917 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:54.652572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-97f60bdd-3e29-48e5-a85f-44ecabe8f917 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:54.661501 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-97f60bdd-3e29-48e5-a85f-44ecabe8f917 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1506 microversion: 2.1 time: 0.291615 Mar 05 21:00:54.662108 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1661/3330] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:54 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:54.674613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-943e0678-76fb-4181-91f4-a6032ce6843b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:54.675512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-943e0678-76fb-4181-91f4-a6032ce6843b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:54.681392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-943e0678-76fb-4181-91f4-a6032ce6843b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:54.682060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-943e0678-76fb-4181-91f4-a6032ce6843b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:54.682579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-32059738-562e-4e84-8e0f-701747779c13 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:54.683542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-943e0678-76fb-4181-91f4-a6032ce6843b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:54.684165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-943e0678-76fb-4181-91f4-a6032ce6843b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:54.694500 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-32059738-562e-4e84-8e0f-701747779c13 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725" status: 200 len: 1474 microversion: 2.1 time: 0.934637 Mar 05 21:00:54.698023 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1670/3331] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:53 2022] GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725 => generated 1474 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:54.711135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-589a14d9-9e34-476c-9272-e7406b3eca78 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:54.711970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-589a14d9-9e34-476c-9272-e7406b3eca78 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:54.725682 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-589a14d9-9e34-476c-9272-e7406b3eca78 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:54.726145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-589a14d9-9e34-476c-9272-e7406b3eca78 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:54.726943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-589a14d9-9e34-476c-9272-e7406b3eca78 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:54.727388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-589a14d9-9e34-476c-9272-e7406b3eca78 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:54.821824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-943e0678-76fb-4181-91f4-a6032ce6843b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:54.837329 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-943e0678-76fb-4181-91f4-a6032ce6843b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1270 microversion: 2.1 time: 0.166563 Mar 05 21:00:54.839170 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1662/3332] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:54 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:54.874848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-32dd292e-7a1c-440c-bffb-4d8ff9eb09fd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:54.875586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-32dd292e-7a1c-440c-bffb-4d8ff9eb09fd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:54.882596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32dd292e-7a1c-440c-bffb-4d8ff9eb09fd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:54.883059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32dd292e-7a1c-440c-bffb-4d8ff9eb09fd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:54.884487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32dd292e-7a1c-440c-bffb-4d8ff9eb09fd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:54.884487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32dd292e-7a1c-440c-bffb-4d8ff9eb09fd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:55.204677 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-32dd292e-7a1c-440c-bffb-4d8ff9eb09fd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:55.215601 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-32dd292e-7a1c-440c-bffb-4d8ff9eb09fd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1292 microversion: 2.1 time: 0.344816 Mar 05 21:00:55.220125 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1663/3333] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:54 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1292 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:55.385997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9cb9958a-4fcd-498c-80e3-fbcf8dfdc5a1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:55.386920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9cb9958a-4fcd-498c-80e3-fbcf8dfdc5a1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:55.393757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9cb9958a-4fcd-498c-80e3-fbcf8dfdc5a1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:55.394491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9cb9958a-4fcd-498c-80e3-fbcf8dfdc5a1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:55.395450 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9cb9958a-4fcd-498c-80e3-fbcf8dfdc5a1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:55.396080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9cb9958a-4fcd-498c-80e3-fbcf8dfdc5a1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:55.476156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9cb9958a-4fcd-498c-80e3-fbcf8dfdc5a1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3424e705cfb4372897157ff324c5179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ab0f35161b4fd9857a3cd95cc89063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:55.484354 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9cb9958a-4fcd-498c-80e3-fbcf8dfdc5a1 tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 200 len: 1465 microversion: 2.1 time: 0.102171 Mar 05 21:00:55.484946 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1664/3334] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:55 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 1465 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:00:55.490118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9707e511-20cc-4dc8-a707-baadaf753949 req-9cf25dae-a246-432e-8fc2-fac35f667db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38", "name": "network-vif-deleted", "tag": "850a46e3-1e9e-41e7-9170-0648694ef580"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:55.499193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9707e511-20cc-4dc8-a707-baadaf753949 req-9cf25dae-a246-432e-8fc2-fac35f667db2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:55.500528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9707e511-20cc-4dc8-a707-baadaf753949 req-9cf25dae-a246-432e-8fc2-fac35f667db2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:55.528756 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9707e511-20cc-4dc8-a707-baadaf753949 req-9cf25dae-a246-432e-8fc2-fac35f667db2 service nova] Creating event network-vif-deleted:850a46e3-1e9e-41e7-9170-0648694ef580 for instance dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 on nch2-master-1 Mar 05 21:00:55.535400 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9707e511-20cc-4dc8-a707-baadaf753949 req-9cf25dae-a246-432e-8fc2-fac35f667db2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048431 Mar 05 21:00:55.536312 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1665/3335] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:55.598057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-589a14d9-9e34-476c-9272-e7406b3eca78 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:55.611638 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-589a14d9-9e34-476c-9272-e7406b3eca78 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 200 len: 1506 microversion: 2.1 time: 0.912096 Mar 05 21:00:55.617730 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1671/3336] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:54 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 1506 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:55.637010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1f357f9a-b4ba-4921-b8ed-1e27efad4702 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:55.637989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1f357f9a-b4ba-4921-b8ed-1e27efad4702 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:55.648502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f357f9a-b4ba-4921-b8ed-1e27efad4702 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:55.650446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f357f9a-b4ba-4921-b8ed-1e27efad4702 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:55.651368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f357f9a-b4ba-4921-b8ed-1e27efad4702 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:55.652172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f357f9a-b4ba-4921-b8ed-1e27efad4702 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:55.700508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1f357f9a-b4ba-4921-b8ed-1e27efad4702 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:00:55.904802 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1f357f9a-b4ba-4921-b8ed-1e27efad4702 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 204 len: 0 microversion: 2.1 time: 0.272389 Mar 05 21:00:55.908166 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1666/3337] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:00:55 2022] DELETE /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:00:55.929475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-93282cb5-e30b-4941-b66a-50a154296f1c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:55.931149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-93282cb5-e30b-4941-b66a-50a154296f1c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: 00a6114e-7710-4ccf-b462-bb8c98001725] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:55.952233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-108f1a18-1a84-4714-b1c6-d836d72702b6 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Action: 'create', calling method: .version_select at 0x7fed61a453a0>, body: {"keypair": {"name": "tempest-keypair-1752220655"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:55.963266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93282cb5-e30b-4941-b66a-50a154296f1c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:55.963862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93282cb5-e30b-4941-b66a-50a154296f1c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:55.966824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93282cb5-e30b-4941-b66a-50a154296f1c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:55.968027 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93282cb5-e30b-4941-b66a-50a154296f1c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:55.998031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-108f1a18-1a84-4714-b1c6-d836d72702b6 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Getting quotas for project f59b6cf41e6d4308819eb264dcaa320e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:00:56.034984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-108f1a18-1a84-4714-b1c6-d836d72702b6 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Getting quotas for user 352a9d7250c742638d90f17006f12c13 and project f59b6cf41e6d4308819eb264dcaa320e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:00:56.365196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-93282cb5-e30b-4941-b66a-50a154296f1c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:56.382840 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-93282cb5-e30b-4941-b66a-50a154296f1c tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725" status: 200 len: 1474 microversion: 2.1 time: 0.469996 Mar 05 21:00:56.393047 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1667/3338] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:55 2022] GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725 => generated 1474 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:56.405247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-93799a1d-b1c9-4da7-9948-8acd41652e39 req-c53d94ba-2133-4358-9eb9-26493229e760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583f8cd2-5dd5-4afb-973c-8029c917a627", "name": "network-vif-plugged", "status": "completed", "tag": "13e30f1f-3efa-4b94-9aa8-e3fa05224e82"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:56.442024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-108f1a18-1a84-4714-b1c6-d836d72702b6 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Getting quotas for project f59b6cf41e6d4308819eb264dcaa320e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:00:56.448456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-93799a1d-b1c9-4da7-9948-8acd41652e39 req-c53d94ba-2133-4358-9eb9-26493229e760 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:56.448910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-93799a1d-b1c9-4da7-9948-8acd41652e39 req-c53d94ba-2133-4358-9eb9-26493229e760 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:56.464721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-108f1a18-1a84-4714-b1c6-d836d72702b6 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Getting quotas for user 352a9d7250c742638d90f17006f12c13 and project f59b6cf41e6d4308819eb264dcaa320e. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:00:56.476915 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-93799a1d-b1c9-4da7-9948-8acd41652e39 req-c53d94ba-2133-4358-9eb9-26493229e760 service nova] Creating event network-vif-plugged:13e30f1f-3efa-4b94-9aa8-e3fa05224e82 for instance 583f8cd2-5dd5-4afb-973c-8029c917a627 on nch1-master-1 Mar 05 21:00:56.482128 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-93799a1d-b1c9-4da7-9948-8acd41652e39 req-c53d94ba-2133-4358-9eb9-26493229e760 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087772 Mar 05 21:00:56.483043 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1668/3339] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:56.495287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6a8770fe-62dd-48a3-9319-ef5e793b4c9d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:56.497041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6a8770fe-62dd-48a3-9319-ef5e793b4c9d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:56.505603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a8770fe-62dd-48a3-9319-ef5e793b4c9d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:56.506075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a8770fe-62dd-48a3-9319-ef5e793b4c9d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:56.506987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a8770fe-62dd-48a3-9319-ef5e793b4c9d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:56.507433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a8770fe-62dd-48a3-9319-ef5e793b4c9d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:56.519296 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-108f1a18-1a84-4714-b1c6-d836d72702b6 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.855284 Mar 05 21:00:56.520464 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1672/3340] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:00:55 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:56.533329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1222872434", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "d74d376a-0a45-4915-b0da-56d17c1f19d7"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:56.657686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] validate_networks() for [('d74d376a-0a45-4915-b0da-56d17c1f19d7', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:00:57.321572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6a8770fe-62dd-48a3-9319-ef5e793b4c9d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:57.334743 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6a8770fe-62dd-48a3-9319-ef5e793b4c9d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1312 microversion: 2.1 time: 0.844318 Mar 05 21:00:57.337940 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1669/3341] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:56 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1312 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:57.353533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4e9f882b-dce4-4040-82a8-f77329641612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:57.356681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4e9f882b-dce4-4040-82a8-f77329641612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:57.382122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e9f882b-dce4-4040-82a8-f77329641612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:57.382630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e9f882b-dce4-4040-82a8-f77329641612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:57.387638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e9f882b-dce4-4040-82a8-f77329641612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:57.388187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e9f882b-dce4-4040-82a8-f77329641612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:58.050681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4e9f882b-dce4-4040-82a8-f77329641612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:58.103917 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4e9f882b-dce4-4040-82a8-f77329641612 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1292 microversion: 2.1 time: 0.757548 Mar 05 21:00:58.107358 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1670/3342] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:57 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1292 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:58.134020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-949f451b-9377-465b-9d54-79dafe042afb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:58.135502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-949f451b-9377-465b-9d54-79dafe042afb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] [instance: dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:58.158391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-949f451b-9377-465b-9d54-79dafe042afb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:58.163907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-949f451b-9377-465b-9d54-79dafe042afb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:58.165917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-949f451b-9377-465b-9d54-79dafe042afb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:58.166673 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-949f451b-9377-465b-9d54-79dafe042afb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:58.193215 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-949f451b-9377-465b-9d54-79dafe042afb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] HTTP exception thrown: Instance dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 could not be found. Mar 05 21:00:58.194417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-949f451b-9377-465b-9d54-79dafe042afb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] Returning 404 to user: Instance dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:00:58.195452 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-949f451b-9377-465b-9d54-79dafe042afb tempest-TestServerAdvancedOps-1878112642 tempest-TestServerAdvancedOps-1878112642-project] 10.222.0.15 "GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38" status: 404 len: 111 microversion: 2.1 time: 0.083766 Mar 05 21:00:58.199864 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1671/3343] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:58 2022] GET /compute/v2.1/servers/dcae9f4f-0b12-4b37-b8e2-6c20de6a3f38 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:00:58.205992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a533c788-a86d-4515-91f0-49e88e6d79ff tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:58.206814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a533c788-a86d-4515-91f0-49e88e6d79ff tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: 00a6114e-7710-4ccf-b462-bb8c98001725] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:58.213850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a533c788-a86d-4515-91f0-49e88e6d79ff tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:58.214770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a533c788-a86d-4515-91f0-49e88e6d79ff tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:58.215825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a533c788-a86d-4515-91f0-49e88e6d79ff tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:58.216475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a533c788-a86d-4515-91f0-49e88e6d79ff tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:58.257647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a533c788-a86d-4515-91f0-49e88e6d79ff tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:58.258383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a533c788-a86d-4515-91f0-49e88e6d79ff tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:58.259481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-a533c788-a86d-4515-91f0-49e88e6d79ff tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lazy-loading 'fault' on Instance uuid 00a6114e-7710-4ccf-b462-bb8c98001725 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:00:58.422797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a533c788-a86d-4515-91f0-49e88e6d79ff tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3573e76c384af7b2e32db359b7231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554e19485bf42f3b2e5fb14472dea2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:58.431378 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a533c788-a86d-4515-91f0-49e88e6d79ff tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725" status: 200 len: 1308 microversion: 2.1 time: 0.230118 Mar 05 21:00:58.432478 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1672/3344] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:58 2022] GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725 => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:58.459304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-8efc8b76-dc5d-4a4d-aad9-297b82406090 req-d865c2fb-c0a3-484f-b733-78bc9a8987f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a6114e-7710-4ccf-b462-bb8c98001725", "name": "network-vif-deleted", "tag": "f3d55e8e-71fd-427a-9669-f45552929be7"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:00:58.470702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8efc8b76-dc5d-4a4d-aad9-297b82406090 req-d865c2fb-c0a3-484f-b733-78bc9a8987f7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:58.474268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8efc8b76-dc5d-4a4d-aad9-297b82406090 req-d865c2fb-c0a3-484f-b733-78bc9a8987f7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:58.492049 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-8efc8b76-dc5d-4a4d-aad9-297b82406090 req-d865c2fb-c0a3-484f-b733-78bc9a8987f7 service nova] Creating event network-vif-deleted:f3d55e8e-71fd-427a-9669-f45552929be7 for instance 00a6114e-7710-4ccf-b462-bb8c98001725 on nch1-master-1 Mar 05 21:00:58.498608 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-8efc8b76-dc5d-4a4d-aad9-297b82406090 req-d865c2fb-c0a3-484f-b733-78bc9a8987f7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044395 Mar 05 21:00:58.500726 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1673/3345] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:00:58.507751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-202cb80a-bac6-49e9-9073-0e251cb2d95c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:58.508949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-202cb80a-bac6-49e9-9073-0e251cb2d95c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:58.516722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-202cb80a-bac6-49e9-9073-0e251cb2d95c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:58.517682 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-202cb80a-bac6-49e9-9073-0e251cb2d95c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:58.519076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-202cb80a-bac6-49e9-9073-0e251cb2d95c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:58.519892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-202cb80a-bac6-49e9-9073-0e251cb2d95c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:59.208098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-202cb80a-bac6-49e9-9073-0e251cb2d95c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:59.220813 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-202cb80a-bac6-49e9-9073-0e251cb2d95c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1333 microversion: 2.1 time: 0.718587 Mar 05 21:00:59.224364 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1674/3346] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:58 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1333 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:59.239957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e660a916-ab74-4d7b-b97f-f97df148b12f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:59.240714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e660a916-ab74-4d7b-b97f-f97df148b12f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:59.246394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:00:59.246879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:00:59.247288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:00:59.247920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:00:59.248496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:00:59.255977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e660a916-ab74-4d7b-b97f-f97df148b12f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:59.255977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e660a916-ab74-4d7b-b97f-f97df148b12f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:59.256608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e660a916-ab74-4d7b-b97f-f97df148b12f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:59.257051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e660a916-ab74-4d7b-b97f-f97df148b12f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:59.268091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:59.268549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:59.269360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:59.269800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:59.310257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Getting quotas for project fa686c12d54e49ceaa2ce991119294e4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:00:59.319096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Getting quotas for user fc62e97c4f024cd183c380c0be7b4a0d and project fa686c12d54e49ceaa2ce991119294e4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:00:59.335870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:00:59.338759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:00:59.454593 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fa9c896a-04bb-4f28-8e58-9c114b358aa8 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.929452 Mar 05 21:00:59.456670 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1673/3347] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:00:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:00:59.476378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b92021b-16de-4bbb-b0df-6482a73bda73 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:59.477383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4b92021b-16de-4bbb-b0df-6482a73bda73 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] [instance: 00a6114e-7710-4ccf-b462-bb8c98001725] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:59.492107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b92021b-16de-4bbb-b0df-6482a73bda73 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:59.492993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b92021b-16de-4bbb-b0df-6482a73bda73 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:59.494294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b92021b-16de-4bbb-b0df-6482a73bda73 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:00:59.494954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b92021b-16de-4bbb-b0df-6482a73bda73 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:00:59.540125 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4b92021b-16de-4bbb-b0df-6482a73bda73 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] HTTP exception thrown: Instance 00a6114e-7710-4ccf-b462-bb8c98001725 could not be found. Mar 05 21:00:59.540910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b92021b-16de-4bbb-b0df-6482a73bda73 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Returning 404 to user: Instance 00a6114e-7710-4ccf-b462-bb8c98001725 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:00:59.541854 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4b92021b-16de-4bbb-b0df-6482a73bda73 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725" status: 404 len: 111 microversion: 2.1 time: 0.082669 Mar 05 21:00:59.543363 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1674/3348] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:59 2022] GET /compute/v2.1/servers/00a6114e-7710-4ccf-b462-bb8c98001725 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:00:59.549945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ce74b747-16ff-49a1-8a94-8b8576a7f2ba tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:00:59.551036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ce74b747-16ff-49a1-8a94-8b8576a7f2ba tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:00:59.795070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ce74b747-16ff-49a1-8a94-8b8576a7f2ba tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:00:59.804873 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ce74b747-16ff-49a1-8a94-8b8576a7f2ba tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1218 microversion: 2.1 time: 0.260092 Mar 05 21:00:59.806548 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1675/3349] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:59 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1218 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:00:59.811230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-de314121-355d-4f3e-bde4-22dccb1a8729 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed61a83670>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:00.179420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e660a916-ab74-4d7b-b97f-f97df148b12f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:00.194348 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e660a916-ab74-4d7b-b97f-f97df148b12f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1472 microversion: 2.1 time: 0.968668 Mar 05 21:01:00.195354 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1675/3350] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:59 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1472 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:00.241589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-718ed21c-72a0-47c8-8ad4-e40bc3b0f172 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:00.242212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-718ed21c-72a0-47c8-8ad4-e40bc3b0f172 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:00.260740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-718ed21c-72a0-47c8-8ad4-e40bc3b0f172 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:00.261194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-718ed21c-72a0-47c8-8ad4-e40bc3b0f172 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:00.262196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-718ed21c-72a0-47c8-8ad4-e40bc3b0f172 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:00.262825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-718ed21c-72a0-47c8-8ad4-e40bc3b0f172 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:00.574213 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-de314121-355d-4f3e-bde4-22dccb1a8729 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "DELETE /compute/v2.1/images/b0dcb3a4-4374-4ab0-a564-6992943d2596" status: 204 len: 0 microversion: 2.1 time: 0.766382 Mar 05 21:01:00.574930 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1676/3351] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:00:59 2022] DELETE /compute/v2.1/images/b0dcb3a4-4374-4ab0-a564-6992943d2596 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:01:00.581397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-494586593", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:00.674989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] validate_networks() for [('5345ca04-bcd0-4ca9-94fb-fa648ce6d989', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:01:00.776539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-718ed21c-72a0-47c8-8ad4-e40bc3b0f172 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:00.790625 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-718ed21c-72a0-47c8-8ad4-e40bc3b0f172 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1333 microversion: 2.1 time: 0.550736 Mar 05 21:01:00.793035 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1676/3352] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:00 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1333 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:01:00.801342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2fc8746d-9955-491d-b2f2-ed9a5e7b6054 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f7a8160>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:01.192967 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2fc8746d-9955-491d-b2f2-ed9a5e7b6054 tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "DELETE /compute/v2.1/images/b65d57be-c098-4f42-b566-f5503ee9295f" status: 204 len: 0 microversion: 2.1 time: 0.396261 Mar 05 21:01:01.194371 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1677/3353] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:00 2022] DELETE /compute/v2.1/images/b65d57be-c098-4f42-b566-f5503ee9295f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:01:01.202899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-1418dc3f-946f-47ab-b68e-ceb2352fbca1 req-bfcad3ee-f315-4d5b-a978-83150aea3bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0ba2b9-85e8-4b78-91be-461650cff33f", "name": "network-vif-deleted", "tag": "55bf9cc0-eea1-4e21-b8d6-e730f4a85fe8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:01.214669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1418dc3f-946f-47ab-b68e-ceb2352fbca1 req-bfcad3ee-f315-4d5b-a978-83150aea3bb6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:01.215547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1418dc3f-946f-47ab-b68e-ceb2352fbca1 req-bfcad3ee-f315-4d5b-a978-83150aea3bb6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:01.235618 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-1418dc3f-946f-47ab-b68e-ceb2352fbca1 req-bfcad3ee-f315-4d5b-a978-83150aea3bb6 service nova] Creating event network-vif-deleted:55bf9cc0-eea1-4e21-b8d6-e730f4a85fe8 for instance 9f0ba2b9-85e8-4b78-91be-461650cff33f on nch2-master-1 Mar 05 21:01:01.242976 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-1418dc3f-946f-47ab-b68e-ceb2352fbca1 req-bfcad3ee-f315-4d5b-a978-83150aea3bb6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046113 Mar 05 21:01:01.244704 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1678/3354] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:01.256308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-69435602-a99c-487f-a1ad-3b978027e62d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:01.257336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-69435602-a99c-487f-a1ad-3b978027e62d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:01.267959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69435602-a99c-487f-a1ad-3b978027e62d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:01.269262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69435602-a99c-487f-a1ad-3b978027e62d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:01.270657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69435602-a99c-487f-a1ad-3b978027e62d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:01.271701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69435602-a99c-487f-a1ad-3b978027e62d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:01.491247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-69435602-a99c-487f-a1ad-3b978027e62d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:01.501389 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-69435602-a99c-487f-a1ad-3b978027e62d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1278 microversion: 2.1 time: 0.255189 Mar 05 21:01:01.507888 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1679/3355] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:01 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1278 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:01.517718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cca7dca9-aa13-44c6-8592-c387d78ad35b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] Calling method '.version_select at 0x7fed4f6aadc0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:01.950664 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cca7dca9-aa13-44c6-8592-c387d78ad35b tempest-ListImageFiltersTestJSON-2026819219 tempest-ListImageFiltersTestJSON-2026819219-project] 10.222.0.15 "DELETE /compute/v2.1/images/4d62b868-d107-4689-82ac-667e5ba16b41" status: 204 len: 0 microversion: 2.1 time: 0.439728 Mar 05 21:01:01.952582 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1680/3356] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:01 2022] DELETE /compute/v2.1/images/4d62b868-d107-4689-82ac-667e5ba16b41 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:01:01.958024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2139c5fb-910b-4dd7-baaa-7258af7b8892 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:01.958580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2139c5fb-910b-4dd7-baaa-7258af7b8892 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:01.982864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2139c5fb-910b-4dd7-baaa-7258af7b8892 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:01.983314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2139c5fb-910b-4dd7-baaa-7258af7b8892 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:01.984292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2139c5fb-910b-4dd7-baaa-7258af7b8892 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:01.984918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2139c5fb-910b-4dd7-baaa-7258af7b8892 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:02.703735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2139c5fb-910b-4dd7-baaa-7258af7b8892 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:02.716216 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2139c5fb-910b-4dd7-baaa-7258af7b8892 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1333 microversion: 2.1 time: 0.762275 Mar 05 21:01:02.728674 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1681/3357] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:01 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1333 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:02.734461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-410447ad-a567-45af-ace6-5a03d99e958e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:02.734758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-410447ad-a567-45af-ace6-5a03d99e958e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:02.753426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-410447ad-a567-45af-ace6-5a03d99e958e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:02.754094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-410447ad-a567-45af-ace6-5a03d99e958e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:02.755980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-410447ad-a567-45af-ace6-5a03d99e958e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:02.756680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-410447ad-a567-45af-ace6-5a03d99e958e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:03.002868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-410447ad-a567-45af-ace6-5a03d99e958e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:03.020346 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-410447ad-a567-45af-ace6-5a03d99e958e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1276 microversion: 2.1 time: 0.290423 Mar 05 21:01:03.023325 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1682/3358] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:02 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1276 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:03.385926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-961860989", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb152f6f-c57d-4619-b0c4-9bec5538183b"}], "security_groups": [{"name": "tempest-securitygroup--318069686"}], "key_name": "tempest-keypair-1752220655", "user_data": "}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:03.678372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] validate_networks() for [('eb152f6f-c57d-4619-b0c4-9bec5538183b', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:01:04.246092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:01:04.246574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:01:04.246998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:01:04.247415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:01:04.247866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:01:04.266865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:04.273130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:04.274333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:04.275587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:04.316447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:01:04.332498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for user cfbceb7c8c104af89e7d21ba411e32a8 and project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:01:04.359804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:01:04.361999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:01:04.449650 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f0eea996-4cef-4c6e-b70e-3adf9cef6f0a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.873398 Mar 05 21:01:04.455907 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1677/3359] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:01:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:01:04.460819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fa015392-4c7d-4b44-a328-545b8aa09671 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:04.461437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fa015392-4c7d-4b44-a328-545b8aa09671 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:04.476590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa015392-4c7d-4b44-a328-545b8aa09671 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:04.477156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa015392-4c7d-4b44-a328-545b8aa09671 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:04.477930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa015392-4c7d-4b44-a328-545b8aa09671 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:04.478246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa015392-4c7d-4b44-a328-545b8aa09671 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:04.883113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fa015392-4c7d-4b44-a328-545b8aa09671 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:04.900688 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fa015392-4c7d-4b44-a328-545b8aa09671 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 0.443521 Mar 05 21:01:04.901189 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1678/3360] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:04 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:04.927599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f1bed2b8-6ec3-447c-b852-4ac89e9f31ae tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:04.928536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f1bed2b8-6ec3-447c-b852-4ac89e9f31ae tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:04.937862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1bed2b8-6ec3-447c-b852-4ac89e9f31ae tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:04.944461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1bed2b8-6ec3-447c-b852-4ac89e9f31ae tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:04.956071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1bed2b8-6ec3-447c-b852-4ac89e9f31ae tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:04.956967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1bed2b8-6ec3-447c-b852-4ac89e9f31ae tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:05.533608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f1bed2b8-6ec3-447c-b852-4ac89e9f31ae tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:05.542289 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f1bed2b8-6ec3-447c-b852-4ac89e9f31ae tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1318 microversion: 2.1 time: 0.618394 Mar 05 21:01:05.547788 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1679/3361] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:04 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:05.568230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1f285496-1d12-4270-8f67-f086b4075cce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:05.569002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1f285496-1d12-4270-8f67-f086b4075cce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:05.575128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f285496-1d12-4270-8f67-f086b4075cce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:05.575890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f285496-1d12-4270-8f67-f086b4075cce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:05.576973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f285496-1d12-4270-8f67-f086b4075cce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:05.577637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f285496-1d12-4270-8f67-f086b4075cce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:05.641465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1f285496-1d12-4270-8f67-f086b4075cce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:01:05.790899 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1f285496-1d12-4270-8f67-f086b4075cce tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2" status: 204 len: 0 microversion: 2.1 time: 0.241483 Mar 05 21:01:05.791527 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1680/3362] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:01:05 2022] DELETE /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:01:05.812184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a8f28c0a-7de1-4698-8871-d87170b309f4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:05.818322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a8f28c0a-7de1-4698-8871-d87170b309f4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:05.826781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a8f28c0a-7de1-4698-8871-d87170b309f4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:05.828162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a8f28c0a-7de1-4698-8871-d87170b309f4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:05.829184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a8f28c0a-7de1-4698-8871-d87170b309f4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:05.829985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a8f28c0a-7de1-4698-8871-d87170b309f4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:05.954977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:01:05.956370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:01:05.983187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:01:05.987605 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:01:05.988939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:01:06.016631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:06.017637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:06.022639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:06.023574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:06.056001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Getting quotas for project f59b6cf41e6d4308819eb264dcaa320e. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:01:06.070511 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Getting quotas for user 352a9d7250c742638d90f17006f12c13 and project f59b6cf41e6d4308819eb264dcaa320e. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:01:06.103546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:01:06.106423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:01:06.159331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a8f28c0a-7de1-4698-8871-d87170b309f4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:06.182155 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7066bda5-5996-413e-8ef8-8988701b7d5c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.811329 Mar 05 21:01:06.183562 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1683/3363] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:01:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 2814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:01:06.186116 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a8f28c0a-7de1-4698-8871-d87170b309f4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2" status: 200 len: 1266 microversion: 2.1 time: 0.383909 Mar 05 21:01:06.191157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-947bdeca-5f8f-46b8-9a74-d281570c6f29 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:06.192238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-947bdeca-5f8f-46b8-9a74-d281570c6f29 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:06.192692 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1681/3364] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:05 2022] GET /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2 => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:06.202107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-947bdeca-5f8f-46b8-9a74-d281570c6f29 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:06.202970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-947bdeca-5f8f-46b8-9a74-d281570c6f29 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:06.204476 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-947bdeca-5f8f-46b8-9a74-d281570c6f29 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:06.205437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-947bdeca-5f8f-46b8-9a74-d281570c6f29 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:06.209934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-830774be-97b7-43a1-a668-198474b36fec req-406bb678-d04c-4c5a-b9ea-41c1b13d15ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b602fb95-a1a4-41e9-8f4b-04adfe669f0f", "tag": "3e8d3d1b-32fc-4875-8745-15e76c70ee14"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:06.244535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-830774be-97b7-43a1-a668-198474b36fec req-406bb678-d04c-4c5a-b9ea-41c1b13d15ae service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:06.245018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-830774be-97b7-43a1-a668-198474b36fec req-406bb678-d04c-4c5a-b9ea-41c1b13d15ae service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:06.268839 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-830774be-97b7-43a1-a668-198474b36fec req-406bb678-d04c-4c5a-b9ea-41c1b13d15ae service nova] Creating event network-changed:3e8d3d1b-32fc-4875-8745-15e76c70ee14 for instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f on nch1-master-1 Mar 05 21:01:06.274601 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-830774be-97b7-43a1-a668-198474b36fec req-406bb678-d04c-4c5a-b9ea-41c1b13d15ae service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079114 Mar 05 21:01:06.277163 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1682/3365] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:06.284671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ac812044-e61c-4ff5-b834-4a02fef74177 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:06.285573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ac812044-e61c-4ff5-b834-4a02fef74177 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:06.536630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ac812044-e61c-4ff5-b834-4a02fef74177 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:06.544815 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ac812044-e61c-4ff5-b834-4a02fef74177 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1237 microversion: 2.1 time: 0.266029 Mar 05 21:01:06.549426 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1683/3366] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:06 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1237 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:06.574172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-532a5977-2df3-4c19-a2f8-0759b03c83da tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:06.575193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-532a5977-2df3-4c19-a2f8-0759b03c83da tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:06.584059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-532a5977-2df3-4c19-a2f8-0759b03c83da tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:06.584891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-532a5977-2df3-4c19-a2f8-0759b03c83da tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:06.585913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-532a5977-2df3-4c19-a2f8-0759b03c83da tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:06.586593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-532a5977-2df3-4c19-a2f8-0759b03c83da tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:07.739476 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-947bdeca-5f8f-46b8-9a74-d281570c6f29 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:07.750225 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-947bdeca-5f8f-46b8-9a74-d281570c6f29 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 1.563543 Mar 05 21:01:07.751197 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1684/3367] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:06 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:07.757589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c4c17518-9110-4f4e-9aff-e1993550fb01 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:07.758682 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c4c17518-9110-4f4e-9aff-e1993550fb01 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:07.766079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4c17518-9110-4f4e-9aff-e1993550fb01 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:07.766977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4c17518-9110-4f4e-9aff-e1993550fb01 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:07.768519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4c17518-9110-4f4e-9aff-e1993550fb01 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:07.769037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4c17518-9110-4f4e-9aff-e1993550fb01 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:07.820777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-532a5977-2df3-4c19-a2f8-0759b03c83da tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:07.829867 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-532a5977-2df3-4c19-a2f8-0759b03c83da tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1318 microversion: 2.1 time: 1.264364 Mar 05 21:01:07.831006 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1684/3368] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:06 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1318 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:07.836065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8d54d02f-970f-435e-80cf-3298036819ff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:07.836777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8d54d02f-970f-435e-80cf-3298036819ff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:07.842973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d54d02f-970f-435e-80cf-3298036819ff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:07.843408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d54d02f-970f-435e-80cf-3298036819ff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:07.844464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d54d02f-970f-435e-80cf-3298036819ff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:07.844972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d54d02f-970f-435e-80cf-3298036819ff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:07.938729 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c4c17518-9110-4f4e-9aff-e1993550fb01 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:07.949649 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c4c17518-9110-4f4e-9aff-e1993550fb01 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2" status: 200 len: 1210 microversion: 2.1 time: 0.196799 Mar 05 21:01:07.950794 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1685/3369] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:07 2022] GET /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2 => generated 1210 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:08.014378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8d54d02f-970f-435e-80cf-3298036819ff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:08.029249 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8d54d02f-970f-435e-80cf-3298036819ff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1295 microversion: 2.1 time: 0.197069 Mar 05 21:01:08.030090 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1685/3370] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:07 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1295 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:08.701122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-486c802c-e2be-4902-b6c7-79a63d391670 req-4a660273-2cbd-489c-9710-6f98eec3b927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407e6bab-ea50-48db-a853-4190fadf8e50", "tag": "1e6ee596-a668-4236-aab0-7cf7ebed5d1d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:08.711459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-486c802c-e2be-4902-b6c7-79a63d391670 req-4a660273-2cbd-489c-9710-6f98eec3b927 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:08.711956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-486c802c-e2be-4902-b6c7-79a63d391670 req-4a660273-2cbd-489c-9710-6f98eec3b927 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:08.739289 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-486c802c-e2be-4902-b6c7-79a63d391670 req-4a660273-2cbd-489c-9710-6f98eec3b927 service nova] Creating event network-changed:1e6ee596-a668-4236-aab0-7cf7ebed5d1d for instance 407e6bab-ea50-48db-a853-4190fadf8e50 on nch2-master-1 Mar 05 21:01:08.757886 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-486c802c-e2be-4902-b6c7-79a63d391670 req-4a660273-2cbd-489c-9710-6f98eec3b927 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063441 Mar 05 21:01:08.759878 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1686/3371] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:08.771954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fab7501a-1c12-473e-bf44-a536bdbc2829 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:08.773057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fab7501a-1c12-473e-bf44-a536bdbc2829 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:08.787790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fab7501a-1c12-473e-bf44-a536bdbc2829 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:08.788637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fab7501a-1c12-473e-bf44-a536bdbc2829 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:08.789694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fab7501a-1c12-473e-bf44-a536bdbc2829 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:08.790303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fab7501a-1c12-473e-bf44-a536bdbc2829 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:08.859630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4c35fc75-c7b0-46cb-8f71-ee1165e385e7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:08.861588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4c35fc75-c7b0-46cb-8f71-ee1165e385e7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:08.878464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c35fc75-c7b0-46cb-8f71-ee1165e385e7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:08.879060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c35fc75-c7b0-46cb-8f71-ee1165e385e7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:08.881582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c35fc75-c7b0-46cb-8f71-ee1165e385e7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:08.885198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c35fc75-c7b0-46cb-8f71-ee1165e385e7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:09.502597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fab7501a-1c12-473e-bf44-a536bdbc2829 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:09.521683 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fab7501a-1c12-473e-bf44-a536bdbc2829 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 0.755199 Mar 05 21:01:09.524850 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1686/3372] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:08 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:09.533721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-663d0584-5e36-4bf9-bc18-09494b46df04 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:09.535004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-663d0584-5e36-4bf9-bc18-09494b46df04 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:09.542462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-663d0584-5e36-4bf9-bc18-09494b46df04 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:09.544182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-663d0584-5e36-4bf9-bc18-09494b46df04 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:09.545403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-663d0584-5e36-4bf9-bc18-09494b46df04 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:09.546625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-663d0584-5e36-4bf9-bc18-09494b46df04 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:09.667859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4c35fc75-c7b0-46cb-8f71-ee1165e385e7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:09.675596 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4c35fc75-c7b0-46cb-8f71-ee1165e385e7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1318 microversion: 2.1 time: 0.827292 Mar 05 21:01:09.676238 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1687/3373] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:08 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1318 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:09.689634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-47b4f41a-0f23-4d64-9c0d-ad8968eeb792 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:09.692099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-47b4f41a-0f23-4d64-9c0d-ad8968eeb792 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:09.706877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47b4f41a-0f23-4d64-9c0d-ad8968eeb792 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:09.707347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47b4f41a-0f23-4d64-9c0d-ad8968eeb792 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:09.720469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47b4f41a-0f23-4d64-9c0d-ad8968eeb792 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:09.721247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47b4f41a-0f23-4d64-9c0d-ad8968eeb792 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:09.743532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-663d0584-5e36-4bf9-bc18-09494b46df04 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:09.799644 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-663d0584-5e36-4bf9-bc18-09494b46df04 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2" status: 200 len: 1212 microversion: 2.1 time: 0.273088 Mar 05 21:01:09.804041 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1687/3374] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:09 2022] GET /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2 => generated 1212 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:09.948216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-47b4f41a-0f23-4d64-9c0d-ad8968eeb792 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:09.960872 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-47b4f41a-0f23-4d64-9c0d-ad8968eeb792 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1295 microversion: 2.1 time: 0.280355 Mar 05 21:01:09.962960 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1688/3375] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:09 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1295 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:10.430280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1127744666", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "ee58eab6-001c-4f6b-a506-c17484517cc8"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:10.512516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] validate_networks() for [('ee58eab6-001c-4f6b-a506-c17484517cc8', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:01:10.542113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7e920adf-e390-4242-b78d-91b3c2f4b935 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:10.542730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7e920adf-e390-4242-b78d-91b3c2f4b935 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:10.555117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e920adf-e390-4242-b78d-91b3c2f4b935 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:10.555582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e920adf-e390-4242-b78d-91b3c2f4b935 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:10.556410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e920adf-e390-4242-b78d-91b3c2f4b935 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:10.556858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e920adf-e390-4242-b78d-91b3c2f4b935 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:11.149393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7e920adf-e390-4242-b78d-91b3c2f4b935 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:11.168253 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7e920adf-e390-4242-b78d-91b3c2f4b935 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 0.630049 Mar 05 21:01:11.169637 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1689/3376] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:10 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:11.186381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ba348041-9543-4ae8-82bb-d0297be6117f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:11.187886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ba348041-9543-4ae8-82bb-d0297be6117f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:11.209725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba348041-9543-4ae8-82bb-d0297be6117f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:11.210457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba348041-9543-4ae8-82bb-d0297be6117f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:11.212716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba348041-9543-4ae8-82bb-d0297be6117f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:11.213523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba348041-9543-4ae8-82bb-d0297be6117f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:12.109025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:01:12.110899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:01:12.112221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:01:12.113167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:01:12.114367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:01:12.145281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:12.146388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:12.148059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:12.149237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:12.186264 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Getting quotas for project d804e9e8cf8844cb8020ce064341f839. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:01:12.199352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Getting quotas for user 81f12b6188d4419396a0394bb2c013a3 and project d804e9e8cf8844cb8020ce064341f839. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:01:12.209571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ba348041-9543-4ae8-82bb-d0297be6117f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:12.229731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:01:12.235258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:01:12.297686 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ba348041-9543-4ae8-82bb-d0297be6117f tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1318 microversion: 2.1 time: 1.124508 Mar 05 21:01:12.302648 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1690/3377] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:11 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1318 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:12.316285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-993d088f-c779-413a-81f9-8c11d2ccd44c req-1fd3ae74-4c84-478e-b221-743f41989bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b602fb95-a1a4-41e9-8f4b-04adfe669f0f", "tag": "72e25e7d-18ab-47fe-93ef-08f3073a56c7"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:12.352382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-993d088f-c779-413a-81f9-8c11d2ccd44c req-1fd3ae74-4c84-478e-b221-743f41989bce service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:12.354650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-993d088f-c779-413a-81f9-8c11d2ccd44c req-1fd3ae74-4c84-478e-b221-743f41989bce service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:12.390632 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-993d088f-c779-413a-81f9-8c11d2ccd44c req-1fd3ae74-4c84-478e-b221-743f41989bce service nova] Creating event network-changed:72e25e7d-18ab-47fe-93ef-08f3073a56c7 for instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f on nch1-master-1 Mar 05 21:01:12.409473 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-61c43ece-d307-420f-abfa-3357bc758e7d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.150517 Mar 05 21:01:12.412793 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1688/3378] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:01:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:01:12.434590 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-993d088f-c779-413a-81f9-8c11d2ccd44c req-1fd3ae74-4c84-478e-b221-743f41989bce service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127642 Mar 05 21:01:12.436331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c90b6dd5-505b-4506-b576-2f6dcc9c01e0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:12.437197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c90b6dd5-505b-4506-b576-2f6dcc9c01e0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:12.447822 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1691/3379] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:12.452483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c90b6dd5-505b-4506-b576-2f6dcc9c01e0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:12.453041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c90b6dd5-505b-4506-b576-2f6dcc9c01e0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:12.453917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c90b6dd5-505b-4506-b576-2f6dcc9c01e0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:12.454438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c90b6dd5-505b-4506-b576-2f6dcc9c01e0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:12.493289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-54d261a0-975f-48b3-84c1-3dfe8ad32cff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:12.501263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-54d261a0-975f-48b3-84c1-3dfe8ad32cff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:12.522128 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-c90b6dd5-505b-4506-b576-2f6dcc9c01e0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2 could not be found. Mar 05 21:01:12.523729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c90b6dd5-505b-4506-b576-2f6dcc9c01e0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:01:12.525663 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c90b6dd5-505b-4506-b576-2f6dcc9c01e0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2" status: 404 len: 111 microversion: 2.1 time: 0.109347 Mar 05 21:01:12.536309 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1689/3380] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:12 2022] GET /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:01:12.558524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eb7adcb1-3180-4c79-9bee-d0409c13a053 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:12.567146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eb7adcb1-3180-4c79-9bee-d0409c13a053 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:12.581911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-54d261a0-975f-48b3-84c1-3dfe8ad32cff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:12.586811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-54d261a0-975f-48b3-84c1-3dfe8ad32cff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:12.591349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-54d261a0-975f-48b3-84c1-3dfe8ad32cff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:12.601026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-54d261a0-975f-48b3-84c1-3dfe8ad32cff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:12.642808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb7adcb1-3180-4c79-9bee-d0409c13a053 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:12.643604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb7adcb1-3180-4c79-9bee-d0409c13a053 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:12.659523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb7adcb1-3180-4c79-9bee-d0409c13a053 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:12.662482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb7adcb1-3180-4c79-9bee-d0409c13a053 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:13.594936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-54d261a0-975f-48b3-84c1-3dfe8ad32cff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:13.607964 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-54d261a0-975f-48b3-84c1-3dfe8ad32cff tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1362 microversion: 2.1 time: 1.153955 Mar 05 21:01:13.611569 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1692/3381] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:12 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1362 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:13.621017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b76ba0bf-76e4-4e0d-8666-808cecd2593f tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:13.629325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b76ba0bf-76e4-4e0d-8666-808cecd2593f tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:13.645334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eb7adcb1-3180-4c79-9bee-d0409c13a053 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:13.658746 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eb7adcb1-3180-4c79-9bee-d0409c13a053 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 1.120619 Mar 05 21:01:13.668421 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1690/3382] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:12 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:13.786769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b76ba0bf-76e4-4e0d-8666-808cecd2593f tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:13.800254 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b76ba0bf-76e4-4e0d-8666-808cecd2593f tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1217 microversion: 2.1 time: 0.186036 Mar 05 21:01:13.802755 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1693/3383] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:13 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1217 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:13.823026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1244767250", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "5345ca04-bcd0-4ca9-94fb-fa648ce6d989"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:13.837798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-329203930", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "50e47084-22c1-4505-b650-54af5bab66ac"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:13.937247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] validate_networks() for [('50e47084-22c1-4505-b650-54af5bab66ac', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:01:13.946905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] validate_networks() for [('5345ca04-bcd0-4ca9-94fb-fa648ce6d989', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:01:14.795343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:01:14.798548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:01:14.799905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:01:14.801760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:01:14.802388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:01:14.824999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:14.825779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:14.829468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:14.832089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:14.913707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:01:14.923138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for user cfbceb7c8c104af89e7d21ba411e32a8 and project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:01:14.941759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:01:14.945135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:01:15.022743 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-76169b2a-293c-41fd-9236-5c108865ef3d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.218321 Mar 05 21:01:15.024159 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1694/3384] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:01:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:01:15.050000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e2b18934-6287-4aef-8032-3119ea495259 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:15.051127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e2b18934-6287-4aef-8032-3119ea495259 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:15.080482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2b18934-6287-4aef-8032-3119ea495259 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:15.081440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2b18934-6287-4aef-8032-3119ea495259 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:15.082445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2b18934-6287-4aef-8032-3119ea495259 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:15.083023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2b18934-6287-4aef-8032-3119ea495259 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:15.417990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e2b18934-6287-4aef-8032-3119ea495259 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:15.431150 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e2b18934-6287-4aef-8032-3119ea495259 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1318 microversion: 2.1 time: 0.405092 Mar 05 21:01:15.431777 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1695/3385] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:15 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:15.460896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ee0cc4de-7b88-4572-bf40-d34361785b54 req-dd7a821b-a2d4-4a58-b4bb-7eb7fe8f380d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a84920d-9932-4cd1-975b-9a28dc682e45", "tag": "fe8c874c-29b6-4154-bd1d-0bdf845e26a3"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:15.490019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ee0cc4de-7b88-4572-bf40-d34361785b54 req-dd7a821b-a2d4-4a58-b4bb-7eb7fe8f380d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:15.491639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ee0cc4de-7b88-4572-bf40-d34361785b54 req-dd7a821b-a2d4-4a58-b4bb-7eb7fe8f380d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:15.544041 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ee0cc4de-7b88-4572-bf40-d34361785b54 req-dd7a821b-a2d4-4a58-b4bb-7eb7fe8f380d service nova] Creating event network-changed:fe8c874c-29b6-4154-bd1d-0bdf845e26a3 for instance 2a84920d-9932-4cd1-975b-9a28dc682e45 on nch2-master-1 Mar 05 21:01:15.564855 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ee0cc4de-7b88-4572-bf40-d34361785b54 req-dd7a821b-a2d4-4a58-b4bb-7eb7fe8f380d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124294 Mar 05 21:01:15.569388 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1696/3386] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:15.588514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-efa48db5-33ba-46f3-b39b-605af3939a33 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:15.589300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-efa48db5-33ba-46f3-b39b-605af3939a33 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:15.606724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efa48db5-33ba-46f3-b39b-605af3939a33 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:15.608137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efa48db5-33ba-46f3-b39b-605af3939a33 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:15.610169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efa48db5-33ba-46f3-b39b-605af3939a33 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:15.610654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efa48db5-33ba-46f3-b39b-605af3939a33 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:15.826454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:01:15.828045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:01:15.828709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:01:15.829281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:01:15.829846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:01:15.847182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:15.847939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:15.849125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:15.854578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:15.899217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Getting quotas for project 92ce8974b7c140b6b12a24cd251d1d95. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:01:15.913881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Getting quotas for user 7e28f4cb6d6640daaba3da28b0b8b2f6 and project 92ce8974b7c140b6b12a24cd251d1d95. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:01:15.960174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:01:15.962349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:01:16.085960 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5eb13654-dca3-424c-bd34-5ad2bc3cf911 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.414565 Mar 05 21:01:16.086573 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1691/3387] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:01:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:01:16.107520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6539e4b8-7dbc-4c7b-b52f-b653581db546 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:16.110318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6539e4b8-7dbc-4c7b-b52f-b653581db546 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:16.134810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6539e4b8-7dbc-4c7b-b52f-b653581db546 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:16.135281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6539e4b8-7dbc-4c7b-b52f-b653581db546 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:16.136126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6539e4b8-7dbc-4c7b-b52f-b653581db546 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:16.136572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6539e4b8-7dbc-4c7b-b52f-b653581db546 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:16.408009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-efa48db5-33ba-46f3-b39b-605af3939a33 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:16.428292 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-efa48db5-33ba-46f3-b39b-605af3939a33 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1362 microversion: 2.1 time: 0.857613 Mar 05 21:01:16.442455 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1697/3388] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:15 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1362 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:16.469426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ae54861-35d5-4ff3-832c-5654571c08b1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:16.469426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ae54861-35d5-4ff3-832c-5654571c08b1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:16.500990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ae54861-35d5-4ff3-832c-5654571c08b1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:16.501642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ae54861-35d5-4ff3-832c-5654571c08b1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:16.502559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ae54861-35d5-4ff3-832c-5654571c08b1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:16.503126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ae54861-35d5-4ff3-832c-5654571c08b1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:16.757002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4ae54861-35d5-4ff3-832c-5654571c08b1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:16.769975 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4ae54861-35d5-4ff3-832c-5654571c08b1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1275 microversion: 2.1 time: 0.326210 Mar 05 21:01:16.776949 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1698/3389] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:16 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1275 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:16.798989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-daa2ca7f-2475-42e7-b8a6-a9b8c5f492c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:16.799634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-daa2ca7f-2475-42e7-b8a6-a9b8c5f492c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:16.845876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-daa2ca7f-2475-42e7-b8a6-a9b8c5f492c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:16.846382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-daa2ca7f-2475-42e7-b8a6-a9b8c5f492c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:16.848834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-daa2ca7f-2475-42e7-b8a6-a9b8c5f492c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:16.850563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-daa2ca7f-2475-42e7-b8a6-a9b8c5f492c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:17.126354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-daa2ca7f-2475-42e7-b8a6-a9b8c5f492c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:17.136753 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-daa2ca7f-2475-42e7-b8a6-a9b8c5f492c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1281 microversion: 2.1 time: 0.358230 Mar 05 21:01:17.152272 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1699/3390] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:16 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1281 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:17.165829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b2985ff8-fc91-4ff4-ae15-7a2c9961fd9a req-bb5d7f4a-24a7-417d-9a6d-0eb165bf80fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b602fb95-a1a4-41e9-8f4b-04adfe669f0f", "tag": "1b3e0510-7554-46df-85e7-0d1bd3573aeb"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:17.203461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b2985ff8-fc91-4ff4-ae15-7a2c9961fd9a req-bb5d7f4a-24a7-417d-9a6d-0eb165bf80fe service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:17.206567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b2985ff8-fc91-4ff4-ae15-7a2c9961fd9a req-bb5d7f4a-24a7-417d-9a6d-0eb165bf80fe service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:17.224502 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b2985ff8-fc91-4ff4-ae15-7a2c9961fd9a req-bb5d7f4a-24a7-417d-9a6d-0eb165bf80fe service nova] Creating event network-changed:1b3e0510-7554-46df-85e7-0d1bd3573aeb for instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f on nch1-master-1 Mar 05 21:01:17.233817 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b2985ff8-fc91-4ff4-ae15-7a2c9961fd9a req-bb5d7f4a-24a7-417d-9a6d-0eb165bf80fe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078433 Mar 05 21:01:17.235135 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1700/3391] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:17.243159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1fa5edf3-67a6-420d-80a2-67b38de1113a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:17.244394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1fa5edf3-67a6-420d-80a2-67b38de1113a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:17.258612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fa5edf3-67a6-420d-80a2-67b38de1113a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:17.259985 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fa5edf3-67a6-420d-80a2-67b38de1113a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:17.262396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fa5edf3-67a6-420d-80a2-67b38de1113a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:17.263031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fa5edf3-67a6-420d-80a2-67b38de1113a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:17.509193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1fa5edf3-67a6-420d-80a2-67b38de1113a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:17.526621 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1fa5edf3-67a6-420d-80a2-67b38de1113a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1235 microversion: 2.1 time: 0.289970 Mar 05 21:01:17.532265 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1701/3392] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:17 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1235 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:17.548915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-a8be8ed7-07d3-4c71-8d51-bf30214acd72 req-3ddbf974-fed1-41fb-a581-61ab9e64e8ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407e6bab-ea50-48db-a853-4190fadf8e50", "name": "network-vif-plugged", "status": "completed", "tag": "1e6ee596-a668-4236-aab0-7cf7ebed5d1d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:17.573348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a8be8ed7-07d3-4c71-8d51-bf30214acd72 req-3ddbf974-fed1-41fb-a581-61ab9e64e8ea service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:17.573857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a8be8ed7-07d3-4c71-8d51-bf30214acd72 req-3ddbf974-fed1-41fb-a581-61ab9e64e8ea service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:17.610926 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-a8be8ed7-07d3-4c71-8d51-bf30214acd72 req-3ddbf974-fed1-41fb-a581-61ab9e64e8ea service nova] Creating event network-vif-plugged:1e6ee596-a668-4236-aab0-7cf7ebed5d1d for instance 407e6bab-ea50-48db-a853-4190fadf8e50 on nch2-master-1 Mar 05 21:01:17.627133 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-a8be8ed7-07d3-4c71-8d51-bf30214acd72 req-3ddbf974-fed1-41fb-a581-61ab9e64e8ea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093300 Mar 05 21:01:17.629081 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1702/3393] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:17.662247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8c14e555-a2fa-4c21-86ff-262bd6ecfc4b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:17.662975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8c14e555-a2fa-4c21-86ff-262bd6ecfc4b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:17.688033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c14e555-a2fa-4c21-86ff-262bd6ecfc4b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:17.697837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c14e555-a2fa-4c21-86ff-262bd6ecfc4b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:17.700216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c14e555-a2fa-4c21-86ff-262bd6ecfc4b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:17.700667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c14e555-a2fa-4c21-86ff-262bd6ecfc4b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:18.212840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8c14e555-a2fa-4c21-86ff-262bd6ecfc4b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:18.222742 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8c14e555-a2fa-4c21-86ff-262bd6ecfc4b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1318 microversion: 2.1 time: 0.591013 Mar 05 21:01:18.227955 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1703/3394] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:17 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1318 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:18.238649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-db505909-9b36-41c2-83e8-437085eb2bdb tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:18.239618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-db505909-9b36-41c2-83e8-437085eb2bdb tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:18.251509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-db505909-9b36-41c2-83e8-437085eb2bdb tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:18.256254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-db505909-9b36-41c2-83e8-437085eb2bdb tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:18.257394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-db505909-9b36-41c2-83e8-437085eb2bdb tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:18.265085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-db505909-9b36-41c2-83e8-437085eb2bdb tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:18.594006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6539e4b8-7dbc-4c7b-b52f-b653581db546 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:18.610381 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6539e4b8-7dbc-4c7b-b52f-b653581db546 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 2.518881 Mar 05 21:01:18.612234 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1692/3395] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:16 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 2523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:18.627041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-09c40ca2-b029-46fc-bb20-2b8dafb9a5ff tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:18.628722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-09c40ca2-b029-46fc-bb20-2b8dafb9a5ff tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:18.641840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09c40ca2-b029-46fc-bb20-2b8dafb9a5ff tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:18.642693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09c40ca2-b029-46fc-bb20-2b8dafb9a5ff tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:18.645446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09c40ca2-b029-46fc-bb20-2b8dafb9a5ff tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:18.647192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09c40ca2-b029-46fc-bb20-2b8dafb9a5ff tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:18.755421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-db505909-9b36-41c2-83e8-437085eb2bdb tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:18.766169 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-db505909-9b36-41c2-83e8-437085eb2bdb tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1362 microversion: 2.1 time: 0.536616 Mar 05 21:01:18.766775 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1704/3396] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:18 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:18.774126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0e875359-2042-4089-a0c2-be57652b2207 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:18.779556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0e875359-2042-4089-a0c2-be57652b2207 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:18.786676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e875359-2042-4089-a0c2-be57652b2207 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:18.789387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e875359-2042-4089-a0c2-be57652b2207 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:18.790380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e875359-2042-4089-a0c2-be57652b2207 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:18.790835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e875359-2042-4089-a0c2-be57652b2207 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:18.872911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0e875359-2042-4089-a0c2-be57652b2207 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:18.880824 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0e875359-2042-4089-a0c2-be57652b2207 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1279 microversion: 2.1 time: 0.112835 Mar 05 21:01:18.881964 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1705/3397] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:18 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1279 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:18.898401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-09deb228-cfbd-42fb-a009-32b0f41a55cf tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:18.899273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-09deb228-cfbd-42fb-a009-32b0f41a55cf tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:18.905147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-09c40ca2-b029-46fc-bb20-2b8dafb9a5ff tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:18.913036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09deb228-cfbd-42fb-a009-32b0f41a55cf tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:18.913842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09deb228-cfbd-42fb-a009-32b0f41a55cf tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:18.914948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09deb228-cfbd-42fb-a009-32b0f41a55cf tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:18.916016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-09deb228-cfbd-42fb-a009-32b0f41a55cf tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:18.922887 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-09c40ca2-b029-46fc-bb20-2b8dafb9a5ff tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1275 microversion: 2.1 time: 0.307630 Mar 05 21:01:18.926872 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1693/3398] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:18 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1275 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:19.012741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-09deb228-cfbd-42fb-a009-32b0f41a55cf tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:19.021941 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-09deb228-cfbd-42fb-a009-32b0f41a55cf tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1289 microversion: 2.1 time: 0.138624 Mar 05 21:01:19.023081 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1706/3399] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:18 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1289 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:19.260446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-76ce168e-64fb-4386-8bf9-490df8ef61fd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:19.264192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-76ce168e-64fb-4386-8bf9-490df8ef61fd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:19.280979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76ce168e-64fb-4386-8bf9-490df8ef61fd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:19.287250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76ce168e-64fb-4386-8bf9-490df8ef61fd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:19.288500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76ce168e-64fb-4386-8bf9-490df8ef61fd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:19.289095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76ce168e-64fb-4386-8bf9-490df8ef61fd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:19.635033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9508e4b9-2777-428a-bcc8-f1af875c1227 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:19.635999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9508e4b9-2777-428a-bcc8-f1af875c1227 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:19.648730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9508e4b9-2777-428a-bcc8-f1af875c1227 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:19.649452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9508e4b9-2777-428a-bcc8-f1af875c1227 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:19.650804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9508e4b9-2777-428a-bcc8-f1af875c1227 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:19.651511 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9508e4b9-2777-428a-bcc8-f1af875c1227 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:19.949760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9508e4b9-2777-428a-bcc8-f1af875c1227 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:19.959316 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9508e4b9-2777-428a-bcc8-f1af875c1227 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 0.333899 Mar 05 21:01:19.969653 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1707/3400] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:19 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:19.974618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-17df9314-3157-4ce0-b9b4-ef72c6b8b813 req-cbb9a4b4-21a3-4c79-a042-38445b63e4ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a84920d-9932-4cd1-975b-9a28dc682e45", "name": "network-vif-plugged", "status": "completed", "tag": "fe8c874c-29b6-4154-bd1d-0bdf845e26a3"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:19.982689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-17df9314-3157-4ce0-b9b4-ef72c6b8b813 req-cbb9a4b4-21a3-4c79-a042-38445b63e4ff service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:19.983443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-17df9314-3157-4ce0-b9b4-ef72c6b8b813 req-cbb9a4b4-21a3-4c79-a042-38445b63e4ff service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:19.996191 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-17df9314-3157-4ce0-b9b4-ef72c6b8b813 req-cbb9a4b4-21a3-4c79-a042-38445b63e4ff service nova] Creating event network-vif-plugged:fe8c874c-29b6-4154-bd1d-0bdf845e26a3 for instance 2a84920d-9932-4cd1-975b-9a28dc682e45 on nch2-master-1 Mar 05 21:01:20.002014 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-17df9314-3157-4ce0-b9b4-ef72c6b8b813 req-cbb9a4b4-21a3-4c79-a042-38445b63e4ff service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030965 Mar 05 21:01:20.003138 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1708/3401] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:20.010415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c3d30143-ed63-4459-81ab-ed4051bf315f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:20.011690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c3d30143-ed63-4459-81ab-ed4051bf315f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:20.018904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3d30143-ed63-4459-81ab-ed4051bf315f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:20.019612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3d30143-ed63-4459-81ab-ed4051bf315f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:20.020686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3d30143-ed63-4459-81ab-ed4051bf315f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:20.021357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3d30143-ed63-4459-81ab-ed4051bf315f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:20.275015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-76ce168e-64fb-4386-8bf9-490df8ef61fd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:20.283732 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-76ce168e-64fb-4386-8bf9-490df8ef61fd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1508 microversion: 2.1 time: 1.042321 Mar 05 21:01:20.284337 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1694/3402] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:19 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1508 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:20.301843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8131cf5a-6fda-4934-92ce-7b869f4ebdea tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:20.302646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8131cf5a-6fda-4934-92ce-7b869f4ebdea tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:20.309706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8131cf5a-6fda-4934-92ce-7b869f4ebdea tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:20.311138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8131cf5a-6fda-4934-92ce-7b869f4ebdea tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:20.313003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8131cf5a-6fda-4934-92ce-7b869f4ebdea tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:20.313667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8131cf5a-6fda-4934-92ce-7b869f4ebdea tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:20.433505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8131cf5a-6fda-4934-92ce-7b869f4ebdea tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:20.441992 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8131cf5a-6fda-4934-92ce-7b869f4ebdea tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1279 microversion: 2.1 time: 0.146435 Mar 05 21:01:20.451557 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1695/3403] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:20 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1279 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:20.451557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-969d219b-cef2-49a8-b838-27d0c32b846d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:20.451557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-969d219b-cef2-49a8-b838-27d0c32b846d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:20.458438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-969d219b-cef2-49a8-b838-27d0c32b846d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:20.459087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-969d219b-cef2-49a8-b838-27d0c32b846d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:20.460023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-969d219b-cef2-49a8-b838-27d0c32b846d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:20.460710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-969d219b-cef2-49a8-b838-27d0c32b846d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:20.741482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c3d30143-ed63-4459-81ab-ed4051bf315f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:20.751860 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c3d30143-ed63-4459-81ab-ed4051bf315f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1362 microversion: 2.1 time: 0.746508 Mar 05 21:01:20.752472 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1709/3404] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:20 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1362 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:20.766318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-37cb3b18-6d88-439b-9f26-faf0729bde95 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:20.767006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-37cb3b18-6d88-439b-9f26-faf0729bde95 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:20.777887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-37cb3b18-6d88-439b-9f26-faf0729bde95 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:20.778605 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-37cb3b18-6d88-439b-9f26-faf0729bde95 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:20.779632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-37cb3b18-6d88-439b-9f26-faf0729bde95 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:20.780544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-37cb3b18-6d88-439b-9f26-faf0729bde95 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:21.037839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-37cb3b18-6d88-439b-9f26-faf0729bde95 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:21.054043 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-37cb3b18-6d88-439b-9f26-faf0729bde95 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1331 microversion: 2.1 time: 0.298851 Mar 05 21:01:21.055702 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1710/3405] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:20 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1331 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:21.069065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b65f2fa9-d703-4ec0-b07c-3beb707341d0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:21.073485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b65f2fa9-d703-4ec0-b07c-3beb707341d0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:21.087291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b65f2fa9-d703-4ec0-b07c-3beb707341d0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:21.090423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b65f2fa9-d703-4ec0-b07c-3beb707341d0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:21.091471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b65f2fa9-d703-4ec0-b07c-3beb707341d0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:21.103842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b65f2fa9-d703-4ec0-b07c-3beb707341d0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:21.382970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b65f2fa9-d703-4ec0-b07c-3beb707341d0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:21.391306 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b65f2fa9-d703-4ec0-b07c-3beb707341d0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1508 microversion: 2.1 time: 0.334292 Mar 05 21:01:21.392085 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1711/3406] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:21 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1508 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:21.407994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-674bd2c8-5e85-406d-9783-5e29b4e2d874 req-b952b992-8feb-451a-86c1-2958c0bd32a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c823028-9831-4a07-9622-4c0649617902", "tag": "85d8eddd-cd0d-4454-936e-fd94b927f82a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:21.417222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-674bd2c8-5e85-406d-9783-5e29b4e2d874 req-b952b992-8feb-451a-86c1-2958c0bd32a5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:21.417819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-674bd2c8-5e85-406d-9783-5e29b4e2d874 req-b952b992-8feb-451a-86c1-2958c0bd32a5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:21.430465 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-674bd2c8-5e85-406d-9783-5e29b4e2d874 req-b952b992-8feb-451a-86c1-2958c0bd32a5 service nova] Creating event network-changed:85d8eddd-cd0d-4454-936e-fd94b927f82a for instance 0c823028-9831-4a07-9622-4c0649617902 on nch1-master-1 Mar 05 21:01:21.435629 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-674bd2c8-5e85-406d-9783-5e29b4e2d874 req-b952b992-8feb-451a-86c1-2958c0bd32a5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042311 Mar 05 21:01:21.437035 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1712/3407] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:21.443917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9e1ab79b-b0af-487d-b524-bb14b0196f33 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:21.444941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9e1ab79b-b0af-487d-b524-bb14b0196f33 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:21.457081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e1ab79b-b0af-487d-b524-bb14b0196f33 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:21.457865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e1ab79b-b0af-487d-b524-bb14b0196f33 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:21.459539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e1ab79b-b0af-487d-b524-bb14b0196f33 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:21.460473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e1ab79b-b0af-487d-b524-bb14b0196f33 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:21.727269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-969d219b-cef2-49a8-b838-27d0c32b846d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:21.739555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9e1ab79b-b0af-487d-b524-bb14b0196f33 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:21.746575 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-969d219b-cef2-49a8-b838-27d0c32b846d tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1317 microversion: 2.1 time: 1.302158 Mar 05 21:01:21.752384 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1696/3408] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:20 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1317 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:21.756232 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9e1ab79b-b0af-487d-b524-bb14b0196f33 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 0.314592 Mar 05 21:01:21.757055 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1713/3409] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:21 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:21.773797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5433d9d6-1892-411a-ad5e-9b12e670df45 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:21.775559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0cd8a543-04ac-4134-b3dd-3d3ffaa21ec7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:21.776695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5433d9d6-1892-411a-ad5e-9b12e670df45 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:21.782895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0cd8a543-04ac-4134-b3dd-3d3ffaa21ec7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:21.798422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5433d9d6-1892-411a-ad5e-9b12e670df45 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:21.804628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cd8a543-04ac-4134-b3dd-3d3ffaa21ec7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:21.807857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5433d9d6-1892-411a-ad5e-9b12e670df45 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:21.808919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5433d9d6-1892-411a-ad5e-9b12e670df45 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:21.811707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cd8a543-04ac-4134-b3dd-3d3ffaa21ec7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:21.813362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5433d9d6-1892-411a-ad5e-9b12e670df45 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:21.813908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cd8a543-04ac-4134-b3dd-3d3ffaa21ec7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:21.817776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cd8a543-04ac-4134-b3dd-3d3ffaa21ec7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:21.969989 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5433d9d6-1892-411a-ad5e-9b12e670df45 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "PUT /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1080 microversion: 2.1 time: 0.214401 Mar 05 21:01:21.970725 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1697/3410] 10.222.0.15 () {60 vars in 1255 bytes} [Sat Mar 5 21:01:21 2022] PUT /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1080 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:21.991311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c73225ef-6fdb-4736-b405-427f8f6d4700 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:21.992267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c73225ef-6fdb-4736-b405-427f8f6d4700 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:21.998518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c73225ef-6fdb-4736-b405-427f8f6d4700 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:21.999812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c73225ef-6fdb-4736-b405-427f8f6d4700 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:22.000781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c73225ef-6fdb-4736-b405-427f8f6d4700 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:22.001387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c73225ef-6fdb-4736-b405-427f8f6d4700 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:22.177486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0cd8a543-04ac-4134-b3dd-3d3ffaa21ec7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:22.185532 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0cd8a543-04ac-4134-b3dd-3d3ffaa21ec7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1321 microversion: 2.1 time: 0.426748 Mar 05 21:01:22.191807 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1714/3411] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:21 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:22.208189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5c6e0057-6d36-47d3-b542-29615138ff88 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:22.209127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5c6e0057-6d36-47d3-b542-29615138ff88 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:22.221430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c6e0057-6d36-47d3-b542-29615138ff88 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:22.222312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c6e0057-6d36-47d3-b542-29615138ff88 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:22.224825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c6e0057-6d36-47d3-b542-29615138ff88 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:22.225297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c6e0057-6d36-47d3-b542-29615138ff88 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:22.471557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5c6e0057-6d36-47d3-b542-29615138ff88 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:22.488773 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5c6e0057-6d36-47d3-b542-29615138ff88 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1506 microversion: 2.1 time: 0.295287 Mar 05 21:01:22.501391 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1715/3412] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:22 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:22.501391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bcceb3f9-206d-4365-ba34-6b601e3bb2d0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:22.501391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bcceb3f9-206d-4365-ba34-6b601e3bb2d0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:22.508278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bcceb3f9-206d-4365-ba34-6b601e3bb2d0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:22.508744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bcceb3f9-206d-4365-ba34-6b601e3bb2d0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:22.509542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bcceb3f9-206d-4365-ba34-6b601e3bb2d0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:22.510024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bcceb3f9-206d-4365-ba34-6b601e3bb2d0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:22.687227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bcceb3f9-206d-4365-ba34-6b601e3bb2d0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:22.703033 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bcceb3f9-206d-4365-ba34-6b601e3bb2d0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1331 microversion: 2.1 time: 0.204751 Mar 05 21:01:22.704398 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1716/3413] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:22 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1331 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:22.716679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-19837500-7a2e-46ab-8249-8e588889ebad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:22.717762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-19837500-7a2e-46ab-8249-8e588889ebad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:22.725969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19837500-7a2e-46ab-8249-8e588889ebad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:22.726928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19837500-7a2e-46ab-8249-8e588889ebad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:22.727896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19837500-7a2e-46ab-8249-8e588889ebad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:22.728439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19837500-7a2e-46ab-8249-8e588889ebad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:22.988210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-19837500-7a2e-46ab-8249-8e588889ebad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:22.992973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c73225ef-6fdb-4736-b405-427f8f6d4700 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:23.011377 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c73225ef-6fdb-4736-b405-427f8f6d4700 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1546 microversion: 2.1 time: 1.039328 Mar 05 21:01:23.014541 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-19837500-7a2e-46ab-8249-8e588889ebad tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1506 microversion: 2.1 time: 0.308655 Mar 05 21:01:23.016047 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1717/3414] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:22 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:23.016529 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1698/3415] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:21 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1546 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:23.023467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-19008263-8637-4703-9aa7-d78bbe69dffe tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:23.027654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0eb6452c-8fa5-47d9-8705-b83d5da67004 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:23.028648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-19008263-8637-4703-9aa7-d78bbe69dffe tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:23.029490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0eb6452c-8fa5-47d9-8705-b83d5da67004 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:23.042864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0eb6452c-8fa5-47d9-8705-b83d5da67004 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:23.046271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19008263-8637-4703-9aa7-d78bbe69dffe tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:23.048265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0eb6452c-8fa5-47d9-8705-b83d5da67004 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:23.049310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0eb6452c-8fa5-47d9-8705-b83d5da67004 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:23.050473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0eb6452c-8fa5-47d9-8705-b83d5da67004 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:23.053928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19008263-8637-4703-9aa7-d78bbe69dffe tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:23.056612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19008263-8637-4703-9aa7-d78bbe69dffe tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:23.057695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-19008263-8637-4703-9aa7-d78bbe69dffe tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:23.261535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-19008263-8637-4703-9aa7-d78bbe69dffe tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:23.271015 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-19008263-8637-4703-9aa7-d78bbe69dffe tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 0.251152 Mar 05 21:01:23.271629 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1718/3416] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:23 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:23.283132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9bf77630-a5d9-4f49-b576-c5f71dcbaecf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:23.284082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9bf77630-a5d9-4f49-b576-c5f71dcbaecf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:23.296994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9bf77630-a5d9-4f49-b576-c5f71dcbaecf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:23.297868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9bf77630-a5d9-4f49-b576-c5f71dcbaecf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:23.298941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9bf77630-a5d9-4f49-b576-c5f71dcbaecf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:23.300436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9bf77630-a5d9-4f49-b576-c5f71dcbaecf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:23.399866 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9bf77630-a5d9-4f49-b576-c5f71dcbaecf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126472 Mar 05 21:01:23.400725 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1719/3417] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 21:01:23 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:23.409735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:23.411847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:23.421840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:23.422361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:23.423210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:23.423705 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:23.543179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:01:23.543621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:01:23.555906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:01:23.556487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:01:23.556933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:01:23.661084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:23.674159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:23.674938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:23.675957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:23.676649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:23.734761 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-21e5116b-b87c-4d76-bbb5-f6a0cdab5a04 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "POST /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50/action" status: 202 len: 1112 microversion: 2.1 time: 0.332500 Mar 05 21:01:23.735446 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1720/3418] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:01:23 2022] POST /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50/action => generated 1112 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 05 21:01:23.747924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d989b37b-49ae-4302-95fc-c76692ff1f51 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:23.747924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d989b37b-49ae-4302-95fc-c76692ff1f51 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:23.759812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d989b37b-49ae-4302-95fc-c76692ff1f51 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:23.760356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d989b37b-49ae-4302-95fc-c76692ff1f51 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:23.761566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d989b37b-49ae-4302-95fc-c76692ff1f51 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:23.761932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d989b37b-49ae-4302-95fc-c76692ff1f51 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:24.234881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d989b37b-49ae-4302-95fc-c76692ff1f51 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:24.242583 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d989b37b-49ae-4302-95fc-c76692ff1f51 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1321 microversion: 2.1 time: 0.504488 Mar 05 21:01:24.252725 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1721/3419] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:23 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:24.258021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7ebbf966-bd88-415b-a62f-c34aa1e4de62 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:24.258902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7ebbf966-bd88-415b-a62f-c34aa1e4de62 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:24.266120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ebbf966-bd88-415b-a62f-c34aa1e4de62 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:24.267284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ebbf966-bd88-415b-a62f-c34aa1e4de62 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:24.268358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ebbf966-bd88-415b-a62f-c34aa1e4de62 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:24.269604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ebbf966-bd88-415b-a62f-c34aa1e4de62 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:24.558966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7ebbf966-bd88-415b-a62f-c34aa1e4de62 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:24.567469 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7ebbf966-bd88-415b-a62f-c34aa1e4de62 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1331 microversion: 2.1 time: 0.313313 Mar 05 21:01:24.570173 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1722/3420] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:24 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1331 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:24.589611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b85fd67d-4760-4cb1-b1d5-dceadf5d6b63 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:24.590821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b85fd67d-4760-4cb1-b1d5-dceadf5d6b63 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:24.601233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b85fd67d-4760-4cb1-b1d5-dceadf5d6b63 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:24.601954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b85fd67d-4760-4cb1-b1d5-dceadf5d6b63 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:24.602962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b85fd67d-4760-4cb1-b1d5-dceadf5d6b63 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:24.603556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b85fd67d-4760-4cb1-b1d5-dceadf5d6b63 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:24.684049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0eb6452c-8fa5-47d9-8705-b83d5da67004 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:24.717049 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0eb6452c-8fa5-47d9-8705-b83d5da67004 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1317 microversion: 2.1 time: 1.699013 Mar 05 21:01:24.718512 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1699/3421] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:23 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1317 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:24.749387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f4439486-4053-46e6-95cd-5c7afd052b38 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:24.750140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f4439486-4053-46e6-95cd-5c7afd052b38 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:24.790271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4439486-4053-46e6-95cd-5c7afd052b38 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:24.796109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4439486-4053-46e6-95cd-5c7afd052b38 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:24.797335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4439486-4053-46e6-95cd-5c7afd052b38 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:24.799049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4439486-4053-46e6-95cd-5c7afd052b38 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:25.126208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b85fd67d-4760-4cb1-b1d5-dceadf5d6b63 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:25.143082 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b85fd67d-4760-4cb1-b1d5-dceadf5d6b63 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.568560 Mar 05 21:01:25.155886 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1723/3422] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:24 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:25.161218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-270f12ec-57a4-4c95-bd2d-451e374c749a req-2b9d7a15-9629-48da-99e1-6041dbb2dda4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d76bdf23-9bbf-442e-aace-748bd854313b", "tag": "7ce0566c-b8c7-44ba-96cc-c04b6c770e05"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:25.174923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-270f12ec-57a4-4c95-bd2d-451e374c749a req-2b9d7a15-9629-48da-99e1-6041dbb2dda4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:25.180122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-270f12ec-57a4-4c95-bd2d-451e374c749a req-2b9d7a15-9629-48da-99e1-6041dbb2dda4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:25.206791 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-270f12ec-57a4-4c95-bd2d-451e374c749a req-2b9d7a15-9629-48da-99e1-6041dbb2dda4 service nova] Creating event network-changed:7ce0566c-b8c7-44ba-96cc-c04b6c770e05 for instance d76bdf23-9bbf-442e-aace-748bd854313b on nch2-master-1 Mar 05 21:01:25.222856 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-270f12ec-57a4-4c95-bd2d-451e374c749a req-2b9d7a15-9629-48da-99e1-6041dbb2dda4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064383 Mar 05 21:01:25.226186 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1724/3423] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:25.262594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c2cc26b7-61f3-49fe-9ce1-2d2546074aa0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:25.270036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c2cc26b7-61f3-49fe-9ce1-2d2546074aa0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:25.287534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2cc26b7-61f3-49fe-9ce1-2d2546074aa0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:25.288020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2cc26b7-61f3-49fe-9ce1-2d2546074aa0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:25.293998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2cc26b7-61f3-49fe-9ce1-2d2546074aa0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:25.294637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2cc26b7-61f3-49fe-9ce1-2d2546074aa0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:25.580834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c2cc26b7-61f3-49fe-9ce1-2d2546074aa0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:25.591833 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c2cc26b7-61f3-49fe-9ce1-2d2546074aa0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1321 microversion: 2.1 time: 0.334509 Mar 05 21:01:25.593362 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1725/3424] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:25 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:01:25.599836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-3cd099db-5f2b-424d-a0aa-c24f1590de45 req-f7214023-33bb-42e6-afd3-d089440906bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a84920d-9932-4cd1-975b-9a28dc682e45", "tag": "fe8c874c-29b6-4154-bd1d-0bdf845e26a3"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:25.613767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3cd099db-5f2b-424d-a0aa-c24f1590de45 req-f7214023-33bb-42e6-afd3-d089440906bb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:25.614091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3cd099db-5f2b-424d-a0aa-c24f1590de45 req-f7214023-33bb-42e6-afd3-d089440906bb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:25.632169 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-3cd099db-5f2b-424d-a0aa-c24f1590de45 req-f7214023-33bb-42e6-afd3-d089440906bb service nova] Creating event network-changed:fe8c874c-29b6-4154-bd1d-0bdf845e26a3 for instance 2a84920d-9932-4cd1-975b-9a28dc682e45 on nch2-master-1 Mar 05 21:01:25.642824 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-3cd099db-5f2b-424d-a0aa-c24f1590de45 req-f7214023-33bb-42e6-afd3-d089440906bb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047986 Mar 05 21:01:25.659848 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1726/3425] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:25.670829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67a865a6-6090-4cff-bb44-c308feaec5b7 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:25.671919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-67a865a6-6090-4cff-bb44-c308feaec5b7 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:25.684259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67a865a6-6090-4cff-bb44-c308feaec5b7 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:25.688767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67a865a6-6090-4cff-bb44-c308feaec5b7 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:25.690536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67a865a6-6090-4cff-bb44-c308feaec5b7 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:25.692567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67a865a6-6090-4cff-bb44-c308feaec5b7 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:25.786728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f4439486-4053-46e6-95cd-5c7afd052b38 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:25.800480 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f4439486-4053-46e6-95cd-5c7afd052b38 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 1.080819 Mar 05 21:01:25.806352 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1700/3426] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:24 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:25.818134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dce4d84b-e1c4-4d38-850d-bc441df9317b tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:25.819161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dce4d84b-e1c4-4d38-850d-bc441df9317b tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:25.826880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dce4d84b-e1c4-4d38-850d-bc441df9317b tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:25.828033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dce4d84b-e1c4-4d38-850d-bc441df9317b tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:25.829221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dce4d84b-e1c4-4d38-850d-bc441df9317b tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:25.829986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dce4d84b-e1c4-4d38-850d-bc441df9317b tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:26.336986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-67a865a6-6090-4cff-bb44-c308feaec5b7 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:26.348028 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67a865a6-6090-4cff-bb44-c308feaec5b7 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1331 microversion: 2.1 time: 0.682157 Mar 05 21:01:26.348638 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1727/3427] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:25 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1331 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:26.357536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-55a0a7e9-0c5c-43ef-a62a-2ad69382fa31 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:26.357536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-55a0a7e9-0c5c-43ef-a62a-2ad69382fa31 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:26.383445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55a0a7e9-0c5c-43ef-a62a-2ad69382fa31 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:26.385523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55a0a7e9-0c5c-43ef-a62a-2ad69382fa31 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:26.386396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55a0a7e9-0c5c-43ef-a62a-2ad69382fa31 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:26.388096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55a0a7e9-0c5c-43ef-a62a-2ad69382fa31 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:26.911321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-55a0a7e9-0c5c-43ef-a62a-2ad69382fa31 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:26.940220 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-55a0a7e9-0c5c-43ef-a62a-2ad69382fa31 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.584805 Mar 05 21:01:26.940894 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1728/3428] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:26 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:26.952546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c846398-0191-497e-aeec-94ffd7e94217 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:26.953366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3c846398-0191-497e-aeec-94ffd7e94217 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:26.967875 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c846398-0191-497e-aeec-94ffd7e94217 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:26.968445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c846398-0191-497e-aeec-94ffd7e94217 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:26.971878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c846398-0191-497e-aeec-94ffd7e94217 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:26.972655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c846398-0191-497e-aeec-94ffd7e94217 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:27.288163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dce4d84b-e1c4-4d38-850d-bc441df9317b tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:27.296750 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dce4d84b-e1c4-4d38-850d-bc441df9317b tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1317 microversion: 2.1 time: 1.488362 Mar 05 21:01:27.297512 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1701/3429] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:25 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1317 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:27.302548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-805a3f23-31fb-4de7-934f-f7a83e6bf742 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:27.303338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-805a3f23-31fb-4de7-934f-f7a83e6bf742 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:27.309993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-805a3f23-31fb-4de7-934f-f7a83e6bf742 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:27.310767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-805a3f23-31fb-4de7-934f-f7a83e6bf742 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:27.311937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-805a3f23-31fb-4de7-934f-f7a83e6bf742 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:27.312595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-805a3f23-31fb-4de7-934f-f7a83e6bf742 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:27.412462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3c846398-0191-497e-aeec-94ffd7e94217 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:27.421817 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3c846398-0191-497e-aeec-94ffd7e94217 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1321 microversion: 2.1 time: 0.479812 Mar 05 21:01:27.422750 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1729/3430] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:26 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:27.427423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ab380028-7fdc-49b3-85b6-f296c0c29ec4 req-57e1b031-ba07-4e8d-b72a-6fa611d0cb62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fae69a3-c2ff-4129-b817-65fe16e6a526", "tag": "c5be3821-8a36-497a-857f-a32b6f507ef0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:27.436639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ab380028-7fdc-49b3-85b6-f296c0c29ec4 req-57e1b031-ba07-4e8d-b72a-6fa611d0cb62 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:27.437389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ab380028-7fdc-49b3-85b6-f296c0c29ec4 req-57e1b031-ba07-4e8d-b72a-6fa611d0cb62 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:27.456447 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ab380028-7fdc-49b3-85b6-f296c0c29ec4 req-57e1b031-ba07-4e8d-b72a-6fa611d0cb62 service nova] Creating event network-changed:c5be3821-8a36-497a-857f-a32b6f507ef0 for instance 2fae69a3-c2ff-4129-b817-65fe16e6a526 on nch1-master-1 Mar 05 21:01:27.470618 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ab380028-7fdc-49b3-85b6-f296c0c29ec4 req-57e1b031-ba07-4e8d-b72a-6fa611d0cb62 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046377 Mar 05 21:01:27.471743 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1730/3431] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:27.478049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-232385d6-2545-450b-aaa4-88375efa6fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:27.479457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-232385d6-2545-450b-aaa4-88375efa6fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:27.491249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-232385d6-2545-450b-aaa4-88375efa6fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:27.492055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-232385d6-2545-450b-aaa4-88375efa6fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:27.496645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-232385d6-2545-450b-aaa4-88375efa6fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:27.497310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-232385d6-2545-450b-aaa4-88375efa6fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:27.732353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-232385d6-2545-450b-aaa4-88375efa6fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:27.743305 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-232385d6-2545-450b-aaa4-88375efa6fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1331 microversion: 2.1 time: 0.270145 Mar 05 21:01:27.744385 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1731/3432] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:27 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1331 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:27.957971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8fc76ab7-44e6-4204-9a68-625c828d4f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:27.965157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8fc76ab7-44e6-4204-9a68-625c828d4f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:27.977031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fc76ab7-44e6-4204-9a68-625c828d4f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:27.977746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fc76ab7-44e6-4204-9a68-625c828d4f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:27.978829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fc76ab7-44e6-4204-9a68-625c828d4f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:27.979483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fc76ab7-44e6-4204-9a68-625c828d4f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:28.165840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8fc76ab7-44e6-4204-9a68-625c828d4f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:28.181359 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8fc76ab7-44e6-4204-9a68-625c828d4f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.227859 Mar 05 21:01:28.182395 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1732/3433] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:27 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:28.261606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-805a3f23-31fb-4de7-934f-f7a83e6bf742 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:28.274853 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-805a3f23-31fb-4de7-934f-f7a83e6bf742 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 0.975013 Mar 05 21:01:28.287864 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1702/3434] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:27 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:28.315468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1fcec530-83d6-4dd0-ab58-f838b1937fc3 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:28.316634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1fcec530-83d6-4dd0-ab58-f838b1937fc3 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:28.324177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fcec530-83d6-4dd0-ab58-f838b1937fc3 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:28.325153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fcec530-83d6-4dd0-ab58-f838b1937fc3 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:28.327780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fcec530-83d6-4dd0-ab58-f838b1937fc3 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:28.328676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1fcec530-83d6-4dd0-ab58-f838b1937fc3 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:28.440430 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c8c8b6cc-c360-4969-8422-8c22cbaaec95 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:28.441894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c8c8b6cc-c360-4969-8422-8c22cbaaec95 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:28.460063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8c8b6cc-c360-4969-8422-8c22cbaaec95 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:28.460523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8c8b6cc-c360-4969-8422-8c22cbaaec95 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:28.461324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8c8b6cc-c360-4969-8422-8c22cbaaec95 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:28.461768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8c8b6cc-c360-4969-8422-8c22cbaaec95 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:28.533002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1fcec530-83d6-4dd0-ab58-f838b1937fc3 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:28.543099 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1fcec530-83d6-4dd0-ab58-f838b1937fc3 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1317 microversion: 2.1 time: 0.233102 Mar 05 21:01:28.555452 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1733/3435] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:28 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:28.762855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-57fc6aa4-7ce3-4061-af08-1e522a634a33 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:28.763483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-57fc6aa4-7ce3-4061-af08-1e522a634a33 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:28.781889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57fc6aa4-7ce3-4061-af08-1e522a634a33 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:28.782628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57fc6aa4-7ce3-4061-af08-1e522a634a33 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:28.783639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57fc6aa4-7ce3-4061-af08-1e522a634a33 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:28.784691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57fc6aa4-7ce3-4061-af08-1e522a634a33 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:29.019498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-57fc6aa4-7ce3-4061-af08-1e522a634a33 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:29.037060 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-57fc6aa4-7ce3-4061-af08-1e522a634a33 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1331 microversion: 2.1 time: 0.278412 Mar 05 21:01:29.038224 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1734/3436] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:28 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1331 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:29.199479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b4a25880-67ef-4688-9e1f-5c059d9d0292 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:29.201102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b4a25880-67ef-4688-9e1f-5c059d9d0292 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:29.208716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4a25880-67ef-4688-9e1f-5c059d9d0292 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:29.209705 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4a25880-67ef-4688-9e1f-5c059d9d0292 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:29.210845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4a25880-67ef-4688-9e1f-5c059d9d0292 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:29.211514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4a25880-67ef-4688-9e1f-5c059d9d0292 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:29.244305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c8c8b6cc-c360-4969-8422-8c22cbaaec95 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:29.256466 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c8c8b6cc-c360-4969-8422-8c22cbaaec95 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1321 microversion: 2.1 time: 0.817775 Mar 05 21:01:29.257433 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1703/3437] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:28 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1321 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:29.295043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2f861d79-d431-4557-999a-8a6176da0fa1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:29.297221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2f861d79-d431-4557-999a-8a6176da0fa1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:29.307545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f861d79-d431-4557-999a-8a6176da0fa1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:29.315994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f861d79-d431-4557-999a-8a6176da0fa1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:29.318166 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f861d79-d431-4557-999a-8a6176da0fa1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:29.318861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f861d79-d431-4557-999a-8a6176da0fa1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:29.410552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b4a25880-67ef-4688-9e1f-5c059d9d0292 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:29.418751 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b4a25880-67ef-4688-9e1f-5c059d9d0292 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.224245 Mar 05 21:01:29.423735 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1735/3438] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:29 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:01:29.575543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b5c5add9-eed0-48b6-9a69-e69715d86af9 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:29.578221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b5c5add9-eed0-48b6-9a69-e69715d86af9 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:29.590114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5c5add9-eed0-48b6-9a69-e69715d86af9 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:29.592830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5c5add9-eed0-48b6-9a69-e69715d86af9 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:29.596370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5c5add9-eed0-48b6-9a69-e69715d86af9 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:29.598427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5c5add9-eed0-48b6-9a69-e69715d86af9 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:30.129283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2f861d79-d431-4557-999a-8a6176da0fa1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:30.141116 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2f861d79-d431-4557-999a-8a6176da0fa1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 0.849865 Mar 05 21:01:30.142447 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1704/3439] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:29 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:30.148627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f93bfaa6-3911-40a8-90bc-80024ca4475a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:30.149761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f93bfaa6-3911-40a8-90bc-80024ca4475a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:30.160561 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f93bfaa6-3911-40a8-90bc-80024ca4475a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:30.161885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f93bfaa6-3911-40a8-90bc-80024ca4475a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:30.162918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f93bfaa6-3911-40a8-90bc-80024ca4475a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:30.163799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f93bfaa6-3911-40a8-90bc-80024ca4475a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:30.269930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b5c5add9-eed0-48b6-9a69-e69715d86af9 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:30.284379 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b5c5add9-eed0-48b6-9a69-e69715d86af9 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1317 microversion: 2.1 time: 0.723111 Mar 05 21:01:30.296833 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1736/3440] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:29 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1317 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:30.303484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aa84b8f2-72f1-44c8-ba40-88d5090ce586 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:30.304149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-aa84b8f2-72f1-44c8-ba40-88d5090ce586 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:30.316402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa84b8f2-72f1-44c8-ba40-88d5090ce586 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:30.316977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa84b8f2-72f1-44c8-ba40-88d5090ce586 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:30.317858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa84b8f2-72f1-44c8-ba40-88d5090ce586 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:30.318548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa84b8f2-72f1-44c8-ba40-88d5090ce586 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:30.542787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f93bfaa6-3911-40a8-90bc-80024ca4475a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:30.557799 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f93bfaa6-3911-40a8-90bc-80024ca4475a tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1331 microversion: 2.1 time: 0.413448 Mar 05 21:01:30.570785 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1705/3441] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:30 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1331 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:30.577548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-15b4e944-4716-46ce-bb0e-c7bc2eebc05e req-64b267d2-7304-4be4-b511-73e8352048a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b602fb95-a1a4-41e9-8f4b-04adfe669f0f", "name": "network-vif-plugged", "status": "completed", "tag": "72e25e7d-18ab-47fe-93ef-08f3073a56c7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:30.589196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-15b4e944-4716-46ce-bb0e-c7bc2eebc05e req-64b267d2-7304-4be4-b511-73e8352048a3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:30.593001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-15b4e944-4716-46ce-bb0e-c7bc2eebc05e req-64b267d2-7304-4be4-b511-73e8352048a3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:30.610013 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-15b4e944-4716-46ce-bb0e-c7bc2eebc05e req-64b267d2-7304-4be4-b511-73e8352048a3 service nova] Creating event network-vif-plugged:72e25e7d-18ab-47fe-93ef-08f3073a56c7 for instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f on nch1-master-1 Mar 05 21:01:30.617948 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-15b4e944-4716-46ce-bb0e-c7bc2eebc05e req-64b267d2-7304-4be4-b511-73e8352048a3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045333 Mar 05 21:01:30.619229 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1706/3442] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:30.630426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-88ac1625-c498-4616-91fb-6f65b9758b34 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:30.631813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-88ac1625-c498-4616-91fb-6f65b9758b34 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:30.640256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-88ac1625-c498-4616-91fb-6f65b9758b34 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:30.641573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-88ac1625-c498-4616-91fb-6f65b9758b34 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:30.643289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-88ac1625-c498-4616-91fb-6f65b9758b34 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:30.643852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-88ac1625-c498-4616-91fb-6f65b9758b34 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:30.783899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-aa84b8f2-72f1-44c8-ba40-88d5090ce586 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:30.797300 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aa84b8f2-72f1-44c8-ba40-88d5090ce586 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1321 microversion: 2.1 time: 0.503355 Mar 05 21:01:30.797919 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1737/3443] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:30 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1321 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:30.929989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-88ac1625-c498-4616-91fb-6f65b9758b34 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:30.938166 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-88ac1625-c498-4616-91fb-6f65b9758b34 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.312885 Mar 05 21:01:30.948018 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1707/3444] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:30 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:31.159332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ec39f5ad-6cff-4219-8965-ca7a7f0f56b0 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:31.160643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ec39f5ad-6cff-4219-8965-ca7a7f0f56b0 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:31.174158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec39f5ad-6cff-4219-8965-ca7a7f0f56b0 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:31.178762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec39f5ad-6cff-4219-8965-ca7a7f0f56b0 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:31.180230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec39f5ad-6cff-4219-8965-ca7a7f0f56b0 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:31.182406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec39f5ad-6cff-4219-8965-ca7a7f0f56b0 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:31.308779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b1c43a97-063b-49d4-931e-360239c505b5 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:31.310161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b1c43a97-063b-49d4-931e-360239c505b5 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:31.318715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1c43a97-063b-49d4-931e-360239c505b5 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:31.319891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1c43a97-063b-49d4-931e-360239c505b5 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:31.330578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1c43a97-063b-49d4-931e-360239c505b5 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:31.331284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1c43a97-063b-49d4-931e-360239c505b5 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:31.416225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ec39f5ad-6cff-4219-8965-ca7a7f0f56b0 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:31.433557 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ec39f5ad-6cff-4219-8965-ca7a7f0f56b0 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 0.278463 Mar 05 21:01:31.434124 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1738/3445] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:31 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:31.576411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a33c7fa7-94b6-4997-9b9e-11db26e7d0f0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:31.577846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a33c7fa7-94b6-4997-9b9e-11db26e7d0f0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:31.589348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a33c7fa7-94b6-4997-9b9e-11db26e7d0f0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:31.589815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a33c7fa7-94b6-4997-9b9e-11db26e7d0f0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:31.590617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a33c7fa7-94b6-4997-9b9e-11db26e7d0f0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:31.591071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a33c7fa7-94b6-4997-9b9e-11db26e7d0f0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:31.691057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b1c43a97-063b-49d4-931e-360239c505b5 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:31.698542 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b1c43a97-063b-49d4-931e-360239c505b5 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1317 microversion: 2.1 time: 0.399774 Mar 05 21:01:31.699113 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1708/3446] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:31 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:01:31.813839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-92c0e794-09e4-4630-8f46-e90488f9abaf tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:31.814319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-92c0e794-09e4-4630-8f46-e90488f9abaf tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:31.829262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92c0e794-09e4-4630-8f46-e90488f9abaf tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:31.829989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92c0e794-09e4-4630-8f46-e90488f9abaf tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:31.831001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92c0e794-09e4-4630-8f46-e90488f9abaf tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:31.831609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92c0e794-09e4-4630-8f46-e90488f9abaf tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:31.863125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a33c7fa7-94b6-4997-9b9e-11db26e7d0f0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:31.874742 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a33c7fa7-94b6-4997-9b9e-11db26e7d0f0 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1331 microversion: 2.1 time: 0.300719 Mar 05 21:01:31.885694 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1739/3447] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:31 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1331 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:01:31.958472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b28e42ec-db5c-480f-b799-56955aa014df tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:31.959275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b28e42ec-db5c-480f-b799-56955aa014df tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:31.966537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b28e42ec-db5c-480f-b799-56955aa014df tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:31.967899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b28e42ec-db5c-480f-b799-56955aa014df tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:31.969709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b28e42ec-db5c-480f-b799-56955aa014df tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:31.970401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b28e42ec-db5c-480f-b799-56955aa014df tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:32.183740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b28e42ec-db5c-480f-b799-56955aa014df tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:32.201564 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b28e42ec-db5c-480f-b799-56955aa014df tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.247071 Mar 05 21:01:32.208299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-92c0e794-09e4-4630-8f46-e90488f9abaf tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:32.212796 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1740/3448] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:31 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:32.215777 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-92c0e794-09e4-4630-8f46-e90488f9abaf tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1321 microversion: 2.1 time: 0.406021 Mar 05 21:01:32.216366 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1709/3449] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:31 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:01:32.451089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dcd5b13c-6be2-48c3-ab9c-cbc6bd41d2e3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:32.453124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dcd5b13c-6be2-48c3-ab9c-cbc6bd41d2e3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:32.466297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcd5b13c-6be2-48c3-ab9c-cbc6bd41d2e3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:32.467300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcd5b13c-6be2-48c3-ab9c-cbc6bd41d2e3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:32.469113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcd5b13c-6be2-48c3-ab9c-cbc6bd41d2e3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:32.474883 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcd5b13c-6be2-48c3-ab9c-cbc6bd41d2e3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:32.650880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-12a19ab0-e384-4b6c-9e5a-8cee9421e733 req-827effe0-82e2-48de-a925-cff068fb8c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c823028-9831-4a07-9622-4c0649617902", "name": "network-vif-plugged", "status": "completed", "tag": "85d8eddd-cd0d-4454-936e-fd94b927f82a"}, {"server_uuid": "b602fb95-a1a4-41e9-8f4b-04adfe669f0f", "name": "network-vif-plugged", "status": "completed", "tag": "3e8d3d1b-32fc-4875-8745-15e76c70ee14"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:32.673846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-12a19ab0-e384-4b6c-9e5a-8cee9421e733 req-827effe0-82e2-48de-a925-cff068fb8c8b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:32.676482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-12a19ab0-e384-4b6c-9e5a-8cee9421e733 req-827effe0-82e2-48de-a925-cff068fb8c8b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:32.725410 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-12a19ab0-e384-4b6c-9e5a-8cee9421e733 req-827effe0-82e2-48de-a925-cff068fb8c8b service nova] Creating event network-vif-plugged:85d8eddd-cd0d-4454-936e-fd94b927f82a for instance 0c823028-9831-4a07-9622-4c0649617902 on nch1-master-1 Mar 05 21:01:32.730256 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-12a19ab0-e384-4b6c-9e5a-8cee9421e733 req-827effe0-82e2-48de-a925-cff068fb8c8b service nova] Creating event network-vif-plugged:3e8d3d1b-32fc-4875-8745-15e76c70ee14 for instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f on nch1-master-1 Mar 05 21:01:32.746205 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-12a19ab0-e384-4b6c-9e5a-8cee9421e733 req-827effe0-82e2-48de-a925-cff068fb8c8b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100862 Mar 05 21:01:32.751723 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1710/3450] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:32.764702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-13bf2dd5-d584-4311-9847-03dca45c2eb1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:32.769081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-13bf2dd5-d584-4311-9847-03dca45c2eb1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:32.778974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13bf2dd5-d584-4311-9847-03dca45c2eb1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:32.780202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13bf2dd5-d584-4311-9847-03dca45c2eb1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:32.781519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13bf2dd5-d584-4311-9847-03dca45c2eb1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:32.782135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13bf2dd5-d584-4311-9847-03dca45c2eb1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:33.160091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dcd5b13c-6be2-48c3-ab9c-cbc6bd41d2e3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:33.168472 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dcd5b13c-6be2-48c3-ab9c-cbc6bd41d2e3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 0.721786 Mar 05 21:01:33.174415 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1741/3451] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:32 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:33.183152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d42ca708-505f-4c7e-814f-97f9505eeaf9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:33.187116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d42ca708-505f-4c7e-814f-97f9505eeaf9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:33.205255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d42ca708-505f-4c7e-814f-97f9505eeaf9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:33.205869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d42ca708-505f-4c7e-814f-97f9505eeaf9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:33.206912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d42ca708-505f-4c7e-814f-97f9505eeaf9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:33.207753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d42ca708-505f-4c7e-814f-97f9505eeaf9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:33.462504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-13bf2dd5-d584-4311-9847-03dca45c2eb1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:33.475731 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-13bf2dd5-d584-4311-9847-03dca45c2eb1 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1317 microversion: 2.1 time: 0.720065 Mar 05 21:01:33.479161 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1711/3452] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:32 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1317 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:33.496609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bf9fe1d1-ab60-4487-af4b-3f19de4e1623 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:33.499832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bf9fe1d1-ab60-4487-af4b-3f19de4e1623 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:33.515575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bf9fe1d1-ab60-4487-af4b-3f19de4e1623 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:33.516298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bf9fe1d1-ab60-4487-af4b-3f19de4e1623 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:33.518297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bf9fe1d1-ab60-4487-af4b-3f19de4e1623 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:33.518764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bf9fe1d1-ab60-4487-af4b-3f19de4e1623 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:33.591938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d42ca708-505f-4c7e-814f-97f9505eeaf9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:33.610890 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d42ca708-505f-4c7e-814f-97f9505eeaf9 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1331 microversion: 2.1 time: 0.434854 Mar 05 21:01:33.612544 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1742/3453] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:33 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1331 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:33.628109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d41f3240-3b1b-450d-86ef-8eca2a1b0c59 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:33.630002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d41f3240-3b1b-450d-86ef-8eca2a1b0c59 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:33.657845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d41f3240-3b1b-450d-86ef-8eca2a1b0c59 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:33.658641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d41f3240-3b1b-450d-86ef-8eca2a1b0c59 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:33.659710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d41f3240-3b1b-450d-86ef-8eca2a1b0c59 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:33.660615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d41f3240-3b1b-450d-86ef-8eca2a1b0c59 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:33.935463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bf9fe1d1-ab60-4487-af4b-3f19de4e1623 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:33.971141 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bf9fe1d1-ab60-4487-af4b-3f19de4e1623 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.475368 Mar 05 21:01:33.972180 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1712/3454] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:33 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:34.089795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d41f3240-3b1b-450d-86ef-8eca2a1b0c59 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:34.099310 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d41f3240-3b1b-450d-86ef-8eca2a1b0c59 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1321 microversion: 2.1 time: 0.485160 Mar 05 21:01:34.101386 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1743/3455] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:33 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1321 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:34.198876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-49ac527d-5279-4b81-9955-b428c07d78b8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:34.206690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-49ac527d-5279-4b81-9955-b428c07d78b8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:34.221147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49ac527d-5279-4b81-9955-b428c07d78b8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:34.223865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49ac527d-5279-4b81-9955-b428c07d78b8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:34.230716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49ac527d-5279-4b81-9955-b428c07d78b8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:34.231626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49ac527d-5279-4b81-9955-b428c07d78b8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:34.431308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-49ac527d-5279-4b81-9955-b428c07d78b8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:34.443292 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-49ac527d-5279-4b81-9955-b428c07d78b8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 0.260815 Mar 05 21:01:34.454666 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1713/3456] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:34 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:34.499257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5bbc64d0-6edf-42ce-bd66-d1d9d1d833f4 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:34.502162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5bbc64d0-6edf-42ce-bd66-d1d9d1d833f4 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:34.523176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bbc64d0-6edf-42ce-bd66-d1d9d1d833f4 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:34.527079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bbc64d0-6edf-42ce-bd66-d1d9d1d833f4 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:34.529016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bbc64d0-6edf-42ce-bd66-d1d9d1d833f4 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:34.531040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bbc64d0-6edf-42ce-bd66-d1d9d1d833f4 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:34.628610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-00fae526-5e59-4db2-8333-15b472e5e3cc tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:34.629254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-00fae526-5e59-4db2-8333-15b472e5e3cc tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:34.635547 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00fae526-5e59-4db2-8333-15b472e5e3cc tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:34.636042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00fae526-5e59-4db2-8333-15b472e5e3cc tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:34.636851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00fae526-5e59-4db2-8333-15b472e5e3cc tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:34.637521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00fae526-5e59-4db2-8333-15b472e5e3cc tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:34.901157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-00fae526-5e59-4db2-8333-15b472e5e3cc tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:34.920581 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-00fae526-5e59-4db2-8333-15b472e5e3cc tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1535 microversion: 2.1 time: 0.294884 Mar 05 21:01:34.922019 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1714/3457] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:34 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1535 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:01:34.943872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f10cef1b-983c-4467-a8e3-353d4db10400 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Action: 'create', calling method: .version_select at 0x7fed61aad040>, body: {"pool": "8f09a79f-b6b0-4bcb-886e-948c40f55161"} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:34.975526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5bbc64d0-6edf-42ce-bd66-d1d9d1d833f4 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:34.996529 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5bbc64d0-6edf-42ce-bd66-d1d9d1d833f4 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1317 microversion: 2.1 time: 0.499868 Mar 05 21:01:34.999222 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1744/3458] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:34 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:35.023888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cafab049-c58e-4f67-a83b-a816fab7e7bc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:35.025964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cafab049-c58e-4f67-a83b-a816fab7e7bc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:35.042447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cafab049-c58e-4f67-a83b-a816fab7e7bc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:35.043936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cafab049-c58e-4f67-a83b-a816fab7e7bc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:35.046930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cafab049-c58e-4f67-a83b-a816fab7e7bc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:35.047868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cafab049-c58e-4f67-a83b-a816fab7e7bc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:35.457788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cafab049-c58e-4f67-a83b-a816fab7e7bc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:35.480121 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cafab049-c58e-4f67-a83b-a816fab7e7bc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.468962 Mar 05 21:01:35.491273 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1745/3459] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:35 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:35.496265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b3db8fe9-a97e-400e-807d-faaad190cdc7 req-c4684568-5e84-4608-8c41-359ddd4b078e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b602fb95-a1a4-41e9-8f4b-04adfe669f0f", "name": "network-vif-plugged", "status": "completed", "tag": "1b3e0510-7554-46df-85e7-0d1bd3573aeb"}, {"server_uuid": "d76bdf23-9bbf-442e-aace-748bd854313b", "name": "network-vif-plugged", "status": "completed", "tag": "7ce0566c-b8c7-44ba-96cc-c04b6c770e05"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:35.508578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b3db8fe9-a97e-400e-807d-faaad190cdc7 req-c4684568-5e84-4608-8c41-359ddd4b078e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:35.510234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b3db8fe9-a97e-400e-807d-faaad190cdc7 req-c4684568-5e84-4608-8c41-359ddd4b078e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:35.527958 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b3db8fe9-a97e-400e-807d-faaad190cdc7 req-c4684568-5e84-4608-8c41-359ddd4b078e service nova] Creating event network-vif-plugged:1b3e0510-7554-46df-85e7-0d1bd3573aeb for instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f on nch1-master-1 Mar 05 21:01:35.528829 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b3db8fe9-a97e-400e-807d-faaad190cdc7 req-c4684568-5e84-4608-8c41-359ddd4b078e service nova] Creating event network-vif-plugged:7ce0566c-b8c7-44ba-96cc-c04b6c770e05 for instance d76bdf23-9bbf-442e-aace-748bd854313b on nch2-master-1 Mar 05 21:01:35.539592 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b3db8fe9-a97e-400e-807d-faaad190cdc7 req-c4684568-5e84-4608-8c41-359ddd4b078e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046393 Mar 05 21:01:35.540984 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1746/3460] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:35.559399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a549d446-3c0b-4901-80e1-6a25c5e8121b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:35.566175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a549d446-3c0b-4901-80e1-6a25c5e8121b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:35.581299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a549d446-3c0b-4901-80e1-6a25c5e8121b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:35.584837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a549d446-3c0b-4901-80e1-6a25c5e8121b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:35.602608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a549d446-3c0b-4901-80e1-6a25c5e8121b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:35.604730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a549d446-3c0b-4901-80e1-6a25c5e8121b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:36.008826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a549d446-3c0b-4901-80e1-6a25c5e8121b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:36.018020 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a549d446-3c0b-4901-80e1-6a25c5e8121b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1321 microversion: 2.1 time: 0.474597 Mar 05 21:01:36.033822 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1747/3461] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:35 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1321 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:36.041113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4e1547e5-7b10-49dc-8d6e-e1a804781c89 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:36.042189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4e1547e5-7b10-49dc-8d6e-e1a804781c89 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:36.050899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e1547e5-7b10-49dc-8d6e-e1a804781c89 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:36.051776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e1547e5-7b10-49dc-8d6e-e1a804781c89 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:36.052834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e1547e5-7b10-49dc-8d6e-e1a804781c89 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:36.054029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e1547e5-7b10-49dc-8d6e-e1a804781c89 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:36.490403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4e1547e5-7b10-49dc-8d6e-e1a804781c89 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:36.525170 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4e1547e5-7b10-49dc-8d6e-e1a804781c89 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1354 microversion: 2.1 time: 0.488863 Mar 05 21:01:36.525829 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1748/3462] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:36 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1354 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:36.532006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ef19abdc-eda1-4caf-ad36-c8ffb5a89f6f tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:36.532705 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ef19abdc-eda1-4caf-ad36-c8ffb5a89f6f tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:36.539775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef19abdc-eda1-4caf-ad36-c8ffb5a89f6f tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:36.540298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef19abdc-eda1-4caf-ad36-c8ffb5a89f6f tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:36.541303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef19abdc-eda1-4caf-ad36-c8ffb5a89f6f tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:36.541817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef19abdc-eda1-4caf-ad36-c8ffb5a89f6f tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:37.196495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ef19abdc-eda1-4caf-ad36-c8ffb5a89f6f tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:37.212973 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ef19abdc-eda1-4caf-ad36-c8ffb5a89f6f tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1317 microversion: 2.1 time: 0.685860 Mar 05 21:01:37.213712 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1749/3463] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:36 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1317 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:37.232587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ac42eecd-e191-4c25-87ba-fe315fe91ad7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:37.234799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ac42eecd-e191-4c25-87ba-fe315fe91ad7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:37.246577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac42eecd-e191-4c25-87ba-fe315fe91ad7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:37.246820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac42eecd-e191-4c25-87ba-fe315fe91ad7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:37.249787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac42eecd-e191-4c25-87ba-fe315fe91ad7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:37.250279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac42eecd-e191-4c25-87ba-fe315fe91ad7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:37.864497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ac42eecd-e191-4c25-87ba-fe315fe91ad7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:37.874770 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ac42eecd-e191-4c25-87ba-fe315fe91ad7 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.657515 Mar 05 21:01:37.883217 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1750/3464] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:37 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:37.889422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ac80caf-ff9e-4f2a-b38f-f20def70a4f5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:37.891932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ac80caf-ff9e-4f2a-b38f-f20def70a4f5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:37.909408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ac80caf-ff9e-4f2a-b38f-f20def70a4f5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:37.912746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ac80caf-ff9e-4f2a-b38f-f20def70a4f5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:37.913795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ac80caf-ff9e-4f2a-b38f-f20def70a4f5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:37.917399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ac80caf-ff9e-4f2a-b38f-f20def70a4f5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:38.086479 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f10cef1b-983c-4467-a8e3-353d4db10400 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.147779 Mar 05 21:01:38.093594 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1715/3465] 10.222.0.15 () {60 vars in 1169 bytes} [Sat Mar 5 21:01:34 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:01:38.093594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3a98a6f3-1555-470a-b8c7-7c41b64fd287 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:38.093883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3a98a6f3-1555-470a-b8c7-7c41b64fd287 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:38.100513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a98a6f3-1555-470a-b8c7-7c41b64fd287 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:38.101233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a98a6f3-1555-470a-b8c7-7c41b64fd287 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:38.102292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a98a6f3-1555-470a-b8c7-7c41b64fd287 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:38.102897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a98a6f3-1555-470a-b8c7-7c41b64fd287 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:38.306560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4ac80caf-ff9e-4f2a-b38f-f20def70a4f5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:38.318479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3a98a6f3-1555-470a-b8c7-7c41b64fd287 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:38.321918 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4ac80caf-ff9e-4f2a-b38f-f20def70a4f5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1321 microversion: 2.1 time: 0.437144 Mar 05 21:01:38.323302 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1751/3466] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:37 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:38.329742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-f29391a8-0535-4436-8736-7a166d94cf49 req-cc0da3b8-60f7-4b43-a216-7384dc4e295c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fae69a3-c2ff-4129-b817-65fe16e6a526", "name": "network-vif-plugged", "status": "completed", "tag": "c5be3821-8a36-497a-857f-a32b6f507ef0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:38.341037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f29391a8-0535-4436-8736-7a166d94cf49 req-cc0da3b8-60f7-4b43-a216-7384dc4e295c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:38.341837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f29391a8-0535-4436-8736-7a166d94cf49 req-cc0da3b8-60f7-4b43-a216-7384dc4e295c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:38.345273 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3a98a6f3-1555-470a-b8c7-7c41b64fd287 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1805 microversion: 2.1 time: 0.256422 Mar 05 21:01:38.346201 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1716/3467] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:38 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1805 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:38.351721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a623f29f-4f0e-4dd4-ae16-86bbb2511f93 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.33"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:38.354344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a623f29f-4f0e-4dd4-ae16-86bbb2511f93 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:38.361558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a623f29f-4f0e-4dd4-ae16-86bbb2511f93 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:38.362531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a623f29f-4f0e-4dd4-ae16-86bbb2511f93 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:38.364230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a623f29f-4f0e-4dd4-ae16-86bbb2511f93 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:38.364987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a623f29f-4f0e-4dd4-ae16-86bbb2511f93 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:38.368861 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-f29391a8-0535-4436-8736-7a166d94cf49 req-cc0da3b8-60f7-4b43-a216-7384dc4e295c service nova] Creating event network-vif-plugged:c5be3821-8a36-497a-857f-a32b6f507ef0 for instance 2fae69a3-c2ff-4129-b817-65fe16e6a526 on nch1-master-1 Mar 05 21:01:38.374347 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-f29391a8-0535-4436-8736-7a166d94cf49 req-cc0da3b8-60f7-4b43-a216-7384dc4e295c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049208 Mar 05 21:01:38.375325 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1752/3468] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:38.381976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b622b296-d4f5-4000-b693-12eb3fc17cbd tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:38.382861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b622b296-d4f5-4000-b693-12eb3fc17cbd tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:38.400373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a623f29f-4f0e-4dd4-ae16-86bbb2511f93 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Acquired lock "refresh_cache-0c823028-9831-4a07-9622-4c0649617902" {{(pid=141478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 21:01:38.422203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b622b296-d4f5-4000-b693-12eb3fc17cbd tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:38.422724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b622b296-d4f5-4000-b693-12eb3fc17cbd tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:38.434844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b622b296-d4f5-4000-b693-12eb3fc17cbd tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:38.435561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b622b296-d4f5-4000-b693-12eb3fc17cbd tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:38.848941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b622b296-d4f5-4000-b693-12eb3fc17cbd tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:38.856934 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b622b296-d4f5-4000-b693-12eb3fc17cbd tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1506 microversion: 2.1 time: 0.480280 Mar 05 21:01:38.857533 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1753/3469] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:38 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:38.871663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8b41b8bc-4b05-46d7-9bb4-6dd06996beb5 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:38.872998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8b41b8bc-4b05-46d7-9bb4-6dd06996beb5 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:38.891574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b41b8bc-4b05-46d7-9bb4-6dd06996beb5 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:38.892104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b41b8bc-4b05-46d7-9bb4-6dd06996beb5 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:38.892924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b41b8bc-4b05-46d7-9bb4-6dd06996beb5 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:38.893376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b41b8bc-4b05-46d7-9bb4-6dd06996beb5 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:38.944259 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8b41b8bc-4b05-46d7-9bb4-6dd06996beb5 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f/ips" status: 200 len: 219 microversion: 2.1 time: 0.084916 Mar 05 21:01:38.945116 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1754/3470] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 21:01:38 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f/ips => generated 219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:38.973614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5eab2cd2-e9b7-4273-91ee-bc374cbb4388 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:38.973614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5eab2cd2-e9b7-4273-91ee-bc374cbb4388 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:38.980071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eab2cd2-e9b7-4273-91ee-bc374cbb4388 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:38.981285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eab2cd2-e9b7-4273-91ee-bc374cbb4388 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:38.983368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eab2cd2-e9b7-4273-91ee-bc374cbb4388 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:38.984024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eab2cd2-e9b7-4273-91ee-bc374cbb4388 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:39.030921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5eab2cd2-e9b7-4273-91ee-bc374cbb4388 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:39.032630 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5eab2cd2-e9b7-4273-91ee-bc374cbb4388 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b/os-instance-actions/req-61c43ece-d307-420f-abfa-3357bc758e7d" status: 200 len: 313 microversion: 2.1 time: 0.079310 Mar 05 21:01:39.043321 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1755/3471] 10.222.0.15 () {58 vars in 1418 bytes} [Sat Mar 5 21:01:38 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b/os-instance-actions/req-61c43ece-d307-420f-abfa-3357bc758e7d => generated 313 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:39.049381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bbfaaaa0-cc78-4811-a24a-2069e796d14a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:39.050511 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bbfaaaa0-cc78-4811-a24a-2069e796d14a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:39.057988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bbfaaaa0-cc78-4811-a24a-2069e796d14a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:39.058767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bbfaaaa0-cc78-4811-a24a-2069e796d14a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:39.060350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bbfaaaa0-cc78-4811-a24a-2069e796d14a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:39.061077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bbfaaaa0-cc78-4811-a24a-2069e796d14a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:39.491608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bbfaaaa0-cc78-4811-a24a-2069e796d14a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:39.512829 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bbfaaaa0-cc78-4811-a24a-2069e796d14a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.467976 Mar 05 21:01:39.517166 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1756/3472] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:39 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:39.526797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-27bb25c2-858f-48c3-b10a-943157c15c8c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:39.527310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-27bb25c2-858f-48c3-b10a-943157c15c8c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:39.559429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27bb25c2-858f-48c3-b10a-943157c15c8c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:39.562406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27bb25c2-858f-48c3-b10a-943157c15c8c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:39.563550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27bb25c2-858f-48c3-b10a-943157c15c8c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:39.567074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27bb25c2-858f-48c3-b10a-943157c15c8c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:39.643910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-27bb25c2-858f-48c3-b10a-943157c15c8c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:01:39.907974 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-27bb25c2-858f-48c3-b10a-943157c15c8c tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 204 len: 0 microversion: 2.1 time: 0.389684 Mar 05 21:01:39.908917 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1757/3473] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:01:39 2022] DELETE /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:01:39.928406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-96cb8d14-6d58-43e2-8a3b-b7dad0ac7938 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:39.929633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-96cb8d14-6d58-43e2-8a3b-b7dad0ac7938 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:39.940667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96cb8d14-6d58-43e2-8a3b-b7dad0ac7938 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:39.953412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96cb8d14-6d58-43e2-8a3b-b7dad0ac7938 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:39.954616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96cb8d14-6d58-43e2-8a3b-b7dad0ac7938 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:39.955187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96cb8d14-6d58-43e2-8a3b-b7dad0ac7938 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:40.086619 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-96cb8d14-6d58-43e2-8a3b-b7dad0ac7938 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "POST /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b/action" status: 202 len: 0 microversion: 2.1 time: 0.175816 Mar 05 21:01:40.094920 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1758/3474] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:01:39 2022] POST /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:01:40.110735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3d5f7804-5aaa-4f33-92dc-36876282f8c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:40.111926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3d5f7804-5aaa-4f33-92dc-36876282f8c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:40.126047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d5f7804-5aaa-4f33-92dc-36876282f8c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:40.126902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d5f7804-5aaa-4f33-92dc-36876282f8c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:40.127967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d5f7804-5aaa-4f33-92dc-36876282f8c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:40.128631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d5f7804-5aaa-4f33-92dc-36876282f8c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:40.450780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3d5f7804-5aaa-4f33-92dc-36876282f8c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:40.462390 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3d5f7804-5aaa-4f33-92dc-36876282f8c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1501 microversion: 2.1 time: 0.365723 Mar 05 21:01:40.463241 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1759/3475] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:40 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1501 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:40.475462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2b97cd55-0abd-426e-a8ad-4262598cfd2b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:40.476484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2b97cd55-0abd-426e-a8ad-4262598cfd2b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:40.483489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b97cd55-0abd-426e-a8ad-4262598cfd2b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:40.484359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b97cd55-0abd-426e-a8ad-4262598cfd2b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:40.485411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b97cd55-0abd-426e-a8ad-4262598cfd2b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:40.486089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b97cd55-0abd-426e-a8ad-4262598cfd2b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:40.806151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2b97cd55-0abd-426e-a8ad-4262598cfd2b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:40.815289 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2b97cd55-0abd-426e-a8ad-4262598cfd2b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1811 microversion: 2.1 time: 0.350571 Mar 05 21:01:40.815926 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1760/3476] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:40 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1811 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:40.832413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4420b139-7374-44d3-970f-3d0ad5f49692 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:40.833813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4420b139-7374-44d3-970f-3d0ad5f49692 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:40.841540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4420b139-7374-44d3-970f-3d0ad5f49692 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:40.842377 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4420b139-7374-44d3-970f-3d0ad5f49692 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:40.843415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4420b139-7374-44d3-970f-3d0ad5f49692 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:40.844129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4420b139-7374-44d3-970f-3d0ad5f49692 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:41.155701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4420b139-7374-44d3-970f-3d0ad5f49692 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:41.167236 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4420b139-7374-44d3-970f-3d0ad5f49692 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1508 microversion: 2.1 time: 0.349783 Mar 05 21:01:41.169839 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1761/3477] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:40 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1508 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:41.178956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b2edcdc2-df3c-47fa-99f7-8e69d30b7b55 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:41.180794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b2edcdc2-df3c-47fa-99f7-8e69d30b7b55 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:41.189844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2edcdc2-df3c-47fa-99f7-8e69d30b7b55 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:41.190640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2edcdc2-df3c-47fa-99f7-8e69d30b7b55 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:41.191636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2edcdc2-df3c-47fa-99f7-8e69d30b7b55 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:41.192280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2edcdc2-df3c-47fa-99f7-8e69d30b7b55 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:41.386794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b2edcdc2-df3c-47fa-99f7-8e69d30b7b55 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:41.397005 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b2edcdc2-df3c-47fa-99f7-8e69d30b7b55 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1501 microversion: 2.1 time: 0.225913 Mar 05 21:01:41.398542 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1762/3478] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:41 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:41.400968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-a623f29f-4f0e-4dd4-ae16-86bbb2511f93 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Building network info cache for instance {{(pid=141478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 05 21:01:41.409492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9a8953ed-acf2-4a4e-b40f-560ede442a27 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:41.411546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9a8953ed-acf2-4a4e-b40f-560ede442a27 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:41.426489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a8953ed-acf2-4a4e-b40f-560ede442a27 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:41.427337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a8953ed-acf2-4a4e-b40f-560ede442a27 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:41.428553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a8953ed-acf2-4a4e-b40f-560ede442a27 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:41.429418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a8953ed-acf2-4a4e-b40f-560ede442a27 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:41.697412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9a8953ed-acf2-4a4e-b40f-560ede442a27 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:41.705356 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9a8953ed-acf2-4a4e-b40f-560ede442a27 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.304953 Mar 05 21:01:41.706297 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1763/3479] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:41 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:42.030385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-147c6453-8b3d-4873-8497-1ed8b42edaa5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Action: 'create', calling method: .version_select at 0x7fed5c4ccb80>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1793312921"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:42.059463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-147c6453-8b3d-4873-8497-1ed8b42edaa5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Getting quotas for project 899872f9f3b243ef89011a53ba07e160. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:01:42.069066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-147c6453-8b3d-4873-8497-1ed8b42edaa5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Getting quotas for user 99a3e85dbbe7423893c25e7b45bda8f9 and project 899872f9f3b243ef89011a53ba07e160. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:01:42.361862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-147c6453-8b3d-4873-8497-1ed8b42edaa5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Getting quotas for project 899872f9f3b243ef89011a53ba07e160. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:01:42.368037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-147c6453-8b3d-4873-8497-1ed8b42edaa5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Getting quotas for user 99a3e85dbbe7423893c25e7b45bda8f9 and project 899872f9f3b243ef89011a53ba07e160. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:01:42.392809 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-147c6453-8b3d-4873-8497-1ed8b42edaa5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.685373 Mar 05 21:01:42.393491 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1764/3480] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:01:41 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:42.398128 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cfe2cf89-1ee9-4786-b758-fbebdf1983d5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:42.399088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cfe2cf89-1ee9-4786-b758-fbebdf1983d5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:42.405554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfe2cf89-1ee9-4786-b758-fbebdf1983d5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:42.406016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfe2cf89-1ee9-4786-b758-fbebdf1983d5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:42.406932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfe2cf89-1ee9-4786-b758-fbebdf1983d5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:42.407533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfe2cf89-1ee9-4786-b758-fbebdf1983d5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:42.461908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cfe2cf89-1ee9-4786-b758-fbebdf1983d5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:01:42.601629 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cfe2cf89-1ee9-4786-b758-fbebdf1983d5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 204 len: 0 microversion: 2.1 time: 0.206652 Mar 05 21:01:42.602496 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1765/3481] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:01:42 2022] DELETE /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:01:42.612694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c36671ff-f2ba-4492-9778-4496fc8dc6d4 req-893df28f-2507-4228-903f-0aa661ec0a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c823028-9831-4a07-9622-4c0649617902", "tag": "85d8eddd-cd0d-4454-936e-fd94b927f82a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:42.639104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c36671ff-f2ba-4492-9778-4496fc8dc6d4 req-893df28f-2507-4228-903f-0aa661ec0a6f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:42.646160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c36671ff-f2ba-4492-9778-4496fc8dc6d4 req-893df28f-2507-4228-903f-0aa661ec0a6f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:42.693813 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c36671ff-f2ba-4492-9778-4496fc8dc6d4 req-893df28f-2507-4228-903f-0aa661ec0a6f service nova] Creating event network-changed:85d8eddd-cd0d-4454-936e-fd94b927f82a for instance 0c823028-9831-4a07-9622-4c0649617902 on nch1-master-1 Mar 05 21:01:42.704844 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c36671ff-f2ba-4492-9778-4496fc8dc6d4 req-893df28f-2507-4228-903f-0aa661ec0a6f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099799 Mar 05 21:01:42.707133 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1766/3482] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:42.723496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-43c4c0e1-8141-4b6a-97c3-e50684ea2988 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:42.724654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-43c4c0e1-8141-4b6a-97c3-e50684ea2988 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:42.738433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43c4c0e1-8141-4b6a-97c3-e50684ea2988 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:42.768629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43c4c0e1-8141-4b6a-97c3-e50684ea2988 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:42.770672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43c4c0e1-8141-4b6a-97c3-e50684ea2988 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:42.771606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43c4c0e1-8141-4b6a-97c3-e50684ea2988 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:43.268347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-43c4c0e1-8141-4b6a-97c3-e50684ea2988 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:43.288738 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-43c4c0e1-8141-4b6a-97c3-e50684ea2988 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1811 microversion: 2.1 time: 0.579710 Mar 05 21:01:43.299750 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1767/3483] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:42 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1811 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:43.302710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-369650c5-75a4-4c76-85af-05ebf3f076fc tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:43.303543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-369650c5-75a4-4c76-85af-05ebf3f076fc tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:43.323695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-369650c5-75a4-4c76-85af-05ebf3f076fc tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:43.324418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-369650c5-75a4-4c76-85af-05ebf3f076fc tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:43.325438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-369650c5-75a4-4c76-85af-05ebf3f076fc tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:43.326051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-369650c5-75a4-4c76-85af-05ebf3f076fc tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:43.588037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-369650c5-75a4-4c76-85af-05ebf3f076fc tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:43.596182 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-369650c5-75a4-4c76-85af-05ebf3f076fc tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1506 microversion: 2.1 time: 0.305205 Mar 05 21:01:43.608798 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1768/3484] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:43 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:43.614849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aed7c9ba-786d-4bf6-915f-b665016355d0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:43.615901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-aed7c9ba-786d-4bf6-915f-b665016355d0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:43.625697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aed7c9ba-786d-4bf6-915f-b665016355d0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:43.626504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aed7c9ba-786d-4bf6-915f-b665016355d0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:43.627742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aed7c9ba-786d-4bf6-915f-b665016355d0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:43.628355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aed7c9ba-786d-4bf6-915f-b665016355d0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:43.874358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-aed7c9ba-786d-4bf6-915f-b665016355d0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:43.892657 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aed7c9ba-786d-4bf6-915f-b665016355d0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1507 microversion: 2.1 time: 0.281809 Mar 05 21:01:43.902415 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1769/3485] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:43 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:43.914527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d4c09123-1588-4c0b-a69a-0dbf40961a43 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:43.915435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d4c09123-1588-4c0b-a69a-0dbf40961a43 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:43.928750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4c09123-1588-4c0b-a69a-0dbf40961a43 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:43.929401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4c09123-1588-4c0b-a69a-0dbf40961a43 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:43.931037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4c09123-1588-4c0b-a69a-0dbf40961a43 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:43.931562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4c09123-1588-4c0b-a69a-0dbf40961a43 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:44.109497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-a623f29f-4f0e-4dd4-ae16-86bbb2511f93 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Updating instance_info_cache with network_info: [{"id": "85d8eddd-cd0d-4454-936e-fd94b927f82a", "address": "fa:16:3e:a0:0c:bc", "network": {"id": "50e47084-22c1-4505-b650-54af5bab66ac", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-245331082-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "92ce8974b7c140b6b12a24cd251d1d95", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap85d8eddd-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 05 21:01:44.127970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a623f29f-4f0e-4dd4-ae16-86bbb2511f93 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Releasing lock "refresh_cache-0c823028-9831-4a07-9622-4c0649617902" {{(pid=141478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 21:01:44.130509 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a623f29f-4f0e-4dd4-ae16-86bbb2511f93 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "POST /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902/action" status: 202 len: 0 microversion: 2.1 time: 5.782835 Mar 05 21:01:44.132666 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1717/3486] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:01:38 2022] POST /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902/action => generated 0 bytes in 5786 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 05 21:01:44.146362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d4429568-d19c-4525-b7d7-f969442149b8 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '.version_select at 0x7fed4f91b670>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:44.147550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d4429568-d19c-4525-b7d7-f969442149b8 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:44.160787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4429568-d19c-4525-b7d7-f969442149b8 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:44.161574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4429568-d19c-4525-b7d7-f969442149b8 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:44.162828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4429568-d19c-4525-b7d7-f969442149b8 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:44.164371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4429568-d19c-4525-b7d7-f969442149b8 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:44.208146 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d4429568-d19c-4525-b7d7-f969442149b8 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.073537 Mar 05 21:01:44.209135 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1718/3487] 10.222.0.15 () {58 vars in 1295 bytes} [Sat Mar 5 21:01:44 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b/os-instance-actions => generated 611 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:44.222671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e99ed1c3-434d-42cc-9c9d-9d07f85a386c tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Action: 'create', calling method: .version_select at 0x7fed61a43940>, body: {"pool": "8f09a79f-b6b0-4bcb-886e-948c40f55161"} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:44.956340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d4c09123-1588-4c0b-a69a-0dbf40961a43 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:44.964213 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d4c09123-1588-4c0b-a69a-0dbf40961a43 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 1.057235 Mar 05 21:01:44.967573 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1770/3488] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:43 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:44.988575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f0e64586-18fb-4af7-b309-a4249c7d6b69 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:44.989652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f0e64586-18fb-4af7-b309-a4249c7d6b69 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:45.006237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f0e64586-18fb-4af7-b309-a4249c7d6b69 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:45.007042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f0e64586-18fb-4af7-b309-a4249c7d6b69 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:45.008257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f0e64586-18fb-4af7-b309-a4249c7d6b69 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:45.009036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f0e64586-18fb-4af7-b309-a4249c7d6b69 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:45.049876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f0e64586-18fb-4af7-b309-a4249c7d6b69 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:01:45.210131 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f0e64586-18fb-4af7-b309-a4249c7d6b69 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 204 len: 0 microversion: 2.1 time: 0.230569 Mar 05 21:01:45.211173 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1771/3489] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:01:44 2022] DELETE /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:01:45.221508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9fcf9e5c-fc01-4c87-8fc2-7d45abac1c2f tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:45.222566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9fcf9e5c-fc01-4c87-8fc2-7d45abac1c2f tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:45.231576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fcf9e5c-fc01-4c87-8fc2-7d45abac1c2f tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:45.233075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fcf9e5c-fc01-4c87-8fc2-7d45abac1c2f tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:45.235115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fcf9e5c-fc01-4c87-8fc2-7d45abac1c2f tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:45.236062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fcf9e5c-fc01-4c87-8fc2-7d45abac1c2f tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:45.522533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9fcf9e5c-fc01-4c87-8fc2-7d45abac1c2f tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:45.539822 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9fcf9e5c-fc01-4c87-8fc2-7d45abac1c2f tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 200 len: 1790 microversion: 2.1 time: 0.324176 Mar 05 21:01:45.541004 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1772/3490] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:45 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 1790 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:45.546506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-60b9c47b-25d8-423d-a8b5-af0e0e73fff1 req-bd6d53d7-d405-4a8f-abc8-3519316a6cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b602fb95-a1a4-41e9-8f4b-04adfe669f0f", "name": "network-vif-deleted", "tag": "1b3e0510-7554-46df-85e7-0d1bd3573aeb"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:45.558064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-60b9c47b-25d8-423d-a8b5-af0e0e73fff1 req-bd6d53d7-d405-4a8f-abc8-3519316a6cdc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:45.558961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-60b9c47b-25d8-423d-a8b5-af0e0e73fff1 req-bd6d53d7-d405-4a8f-abc8-3519316a6cdc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:45.575565 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-60b9c47b-25d8-423d-a8b5-af0e0e73fff1 req-bd6d53d7-d405-4a8f-abc8-3519316a6cdc service nova] Creating event network-vif-deleted:1b3e0510-7554-46df-85e7-0d1bd3573aeb for instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f on nch1-master-1 Mar 05 21:01:45.583575 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-60b9c47b-25d8-423d-a8b5-af0e0e73fff1 req-bd6d53d7-d405-4a8f-abc8-3519316a6cdc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041078 Mar 05 21:01:45.584828 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1773/3491] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:45.591097 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cb72c04e-1a3c-4df9-8f01-c251ea0633c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:45.593194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cb72c04e-1a3c-4df9-8f01-c251ea0633c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:45.603025 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb72c04e-1a3c-4df9-8f01-c251ea0633c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:45.603997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb72c04e-1a3c-4df9-8f01-c251ea0633c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:45.605358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb72c04e-1a3c-4df9-8f01-c251ea0633c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:45.605954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb72c04e-1a3c-4df9-8f01-c251ea0633c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:45.654897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb72c04e-1a3c-4df9-8f01-c251ea0633c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:45.654897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb72c04e-1a3c-4df9-8f01-c251ea0633c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:45.656247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-cb72c04e-1a3c-4df9-8f01-c251ea0633c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lazy-loading 'fault' on Instance uuid 2fae69a3-c2ff-4129-b817-65fe16e6a526 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:01:45.725776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cb72c04e-1a3c-4df9-8f01-c251ea0633c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:45.741327 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cb72c04e-1a3c-4df9-8f01-c251ea0633c9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 200 len: 1311 microversion: 2.1 time: 0.152409 Mar 05 21:01:45.760586 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1774/3492] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:45 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 1311 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:45.767474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-77e8f6ca-986d-49d4-8389-445a23e4f538 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:45.771049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-77e8f6ca-986d-49d4-8389-445a23e4f538 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:45.795036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77e8f6ca-986d-49d4-8389-445a23e4f538 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:45.796943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77e8f6ca-986d-49d4-8389-445a23e4f538 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:45.797876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77e8f6ca-986d-49d4-8389-445a23e4f538 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:45.801437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77e8f6ca-986d-49d4-8389-445a23e4f538 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:46.215016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-77e8f6ca-986d-49d4-8389-445a23e4f538 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:46.231996 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-77e8f6ca-986d-49d4-8389-445a23e4f538 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1512 microversion: 2.1 time: 0.469440 Mar 05 21:01:46.249597 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1775/3493] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:45 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1512 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:46.262401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-23eb06f2-8641-4d1c-9281-b9eb9ce4316c req-562e176b-243c-4ea1-b316-6117da28c43b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fae69a3-c2ff-4129-b817-65fe16e6a526", "name": "network-vif-deleted", "tag": "c5be3821-8a36-497a-857f-a32b6f507ef0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:46.291818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-23eb06f2-8641-4d1c-9281-b9eb9ce4316c req-562e176b-243c-4ea1-b316-6117da28c43b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:46.293165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-23eb06f2-8641-4d1c-9281-b9eb9ce4316c req-562e176b-243c-4ea1-b316-6117da28c43b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:46.324767 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-23eb06f2-8641-4d1c-9281-b9eb9ce4316c req-562e176b-243c-4ea1-b316-6117da28c43b service nova] Creating event network-vif-deleted:c5be3821-8a36-497a-857f-a32b6f507ef0 for instance 2fae69a3-c2ff-4129-b817-65fe16e6a526 on nch1-master-1 Mar 05 21:01:46.336831 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-23eb06f2-8641-4d1c-9281-b9eb9ce4316c req-562e176b-243c-4ea1-b316-6117da28c43b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084627 Mar 05 21:01:46.339103 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1776/3494] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:46.353661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-70c80bcb-5e49-4d39-a791-d739445925f4 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:46.354637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-70c80bcb-5e49-4d39-a791-d739445925f4 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:46.370751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70c80bcb-5e49-4d39-a791-d739445925f4 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:46.374320 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70c80bcb-5e49-4d39-a791-d739445925f4 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:46.375350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70c80bcb-5e49-4d39-a791-d739445925f4 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:46.376127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70c80bcb-5e49-4d39-a791-d739445925f4 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:46.738217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-70c80bcb-5e49-4d39-a791-d739445925f4 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:46.772190 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-70c80bcb-5e49-4d39-a791-d739445925f4 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.431551 Mar 05 21:01:46.784692 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1777/3495] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:46 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:46.791150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-505979428", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1793312921", "security_groups": [{"name": "tempest-secgroup-smoke-1739973159"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "adc6ce26-0999-46fd-83e3-7feba14413c3"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:47.158523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] validate_networks() for [('adc6ce26-0999-46fd-83e3-7feba14413c3', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:01:48.411339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Getting quotas for project 899872f9f3b243ef89011a53ba07e160. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:01:48.423124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Getting quotas for user 99a3e85dbbe7423893c25e7b45bda8f9 and project 899872f9f3b243ef89011a53ba07e160. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:01:48.449912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:01:48.452978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:01:48.453615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:01:48.464440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:01:48.465262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:01:48.477021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:48.477651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:48.478562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:48.485986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:48.525598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Getting quotas for project 899872f9f3b243ef89011a53ba07e160. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:01:48.539040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Getting quotas for user 99a3e85dbbe7423893c25e7b45bda8f9 and project 899872f9f3b243ef89011a53ba07e160. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:01:48.566234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:01:48.569998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:01:48.645286 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f218af84-0307-4197-ac4e-0618745ec902 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.859150 Mar 05 21:01:48.658043 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1778/3496] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:01:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:01:48.663626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-a95c894e-2d35-44f3-9c61-a7ca7010108e req-2870b77d-b58f-4f62-b31d-4555450c19ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b602fb95-a1a4-41e9-8f4b-04adfe669f0f", "name": "network-vif-unplugged", "status": "completed", "tag": "3e8d3d1b-32fc-4875-8745-15e76c70ee14"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:48.692193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a95c894e-2d35-44f3-9c61-a7ca7010108e req-2870b77d-b58f-4f62-b31d-4555450c19ad service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:48.695103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a95c894e-2d35-44f3-9c61-a7ca7010108e req-2870b77d-b58f-4f62-b31d-4555450c19ad service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:48.725870 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-a95c894e-2d35-44f3-9c61-a7ca7010108e req-2870b77d-b58f-4f62-b31d-4555450c19ad service nova] Creating event network-vif-unplugged:3e8d3d1b-32fc-4875-8745-15e76c70ee14 for instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f on nch1-master-1 Mar 05 21:01:48.732810 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-a95c894e-2d35-44f3-9c61-a7ca7010108e req-2870b77d-b58f-4f62-b31d-4555450c19ad service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074086 Mar 05 21:01:48.735652 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1779/3497] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:48.752603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af36acb5-15dd-41c6-a647-9880980602d8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:48.755892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-af36acb5-15dd-41c6-a647-9880980602d8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:48.765602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af36acb5-15dd-41c6-a647-9880980602d8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:48.766490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af36acb5-15dd-41c6-a647-9880980602d8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:48.767834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af36acb5-15dd-41c6-a647-9880980602d8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:48.768375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af36acb5-15dd-41c6-a647-9880980602d8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:48.793353 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-af36acb5-15dd-41c6-a647-9880980602d8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] HTTP exception thrown: Instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f could not be found. Mar 05 21:01:48.794334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af36acb5-15dd-41c6-a647-9880980602d8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Returning 404 to user: Instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:01:48.796161 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-af36acb5-15dd-41c6-a647-9880980602d8 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 404 len: 111 microversion: 2.1 time: 0.058976 Mar 05 21:01:48.797249 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1780/3498] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:48 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:01:48.820338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f126b187-65b5-4c3c-a8ff-64073fbe8d00 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:48.821178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f126b187-65b5-4c3c-a8ff-64073fbe8d00 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:48.836756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f126b187-65b5-4c3c-a8ff-64073fbe8d00 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:48.843569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f126b187-65b5-4c3c-a8ff-64073fbe8d00 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:48.844484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f126b187-65b5-4c3c-a8ff-64073fbe8d00 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:48.847723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f126b187-65b5-4c3c-a8ff-64073fbe8d00 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:48.892734 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-f126b187-65b5-4c3c-a8ff-64073fbe8d00 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance 2fae69a3-c2ff-4129-b817-65fe16e6a526 could not be found. Mar 05 21:01:48.893395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f126b187-65b5-4c3c-a8ff-64073fbe8d00 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance 2fae69a3-c2ff-4129-b817-65fe16e6a526 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:01:48.894278 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f126b187-65b5-4c3c-a8ff-64073fbe8d00 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 404 len: 111 microversion: 2.1 time: 0.095744 Mar 05 21:01:48.899952 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1781/3499] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:48 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:01:48.915593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ccbd8edf-80b0-4662-becf-8883699570be tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:48.916328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ccbd8edf-80b0-4662-becf-8883699570be tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:48.938341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ccbd8edf-80b0-4662-becf-8883699570be tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:48.940983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ccbd8edf-80b0-4662-becf-8883699570be tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:48.942132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ccbd8edf-80b0-4662-becf-8883699570be tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:48.944342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ccbd8edf-80b0-4662-becf-8883699570be tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:49.041186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ccbd8edf-80b0-4662-becf-8883699570be tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:49.042674 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ccbd8edf-80b0-4662-becf-8883699570be tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:49.043353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-ccbd8edf-80b0-4662-becf-8883699570be tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lazy-loading 'fault' on Instance uuid d76bdf23-9bbf-442e-aace-748bd854313b {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:01:49.131234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ccbd8edf-80b0-4662-becf-8883699570be tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f12b6188d4419396a0394bb2c013a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd804e9e8cf8844cb8020ce064341f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:49.142539 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ccbd8edf-80b0-4662-becf-8883699570be tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 200 len: 1307 microversion: 2.1 time: 0.246049 Mar 05 21:01:49.144009 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1782/3500] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:48 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 1307 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:49.150327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-f922c57d-3ce7-409d-9ecb-7eafc39131dc req-e281ebb5-3194-4634-a09a-e03f69dfd89e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b602fb95-a1a4-41e9-8f4b-04adfe669f0f", "name": "network-vif-deleted", "tag": "72e25e7d-18ab-47fe-93ef-08f3073a56c7"}, {"server_uuid": "b602fb95-a1a4-41e9-8f4b-04adfe669f0f", "name": "network-vif-deleted", "tag": "3e8d3d1b-32fc-4875-8745-15e76c70ee14"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:49.162175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f922c57d-3ce7-409d-9ecb-7eafc39131dc req-e281ebb5-3194-4634-a09a-e03f69dfd89e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:49.163122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f922c57d-3ce7-409d-9ecb-7eafc39131dc req-e281ebb5-3194-4634-a09a-e03f69dfd89e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:49.189648 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-f922c57d-3ce7-409d-9ecb-7eafc39131dc req-e281ebb5-3194-4634-a09a-e03f69dfd89e service nova] Creating event network-vif-deleted:72e25e7d-18ab-47fe-93ef-08f3073a56c7 for instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f on nch1-master-1 Mar 05 21:01:49.190578 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-f922c57d-3ce7-409d-9ecb-7eafc39131dc req-e281ebb5-3194-4634-a09a-e03f69dfd89e service nova] Creating event network-vif-deleted:3e8d3d1b-32fc-4875-8745-15e76c70ee14 for instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f on nch1-master-1 Mar 05 21:01:49.209369 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-f922c57d-3ce7-409d-9ecb-7eafc39131dc req-e281ebb5-3194-4634-a09a-e03f69dfd89e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059609 Mar 05 21:01:49.211655 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1783/3501] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:49.220307 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e99ed1c3-434d-42cc-9c9d-9d07f85a386c tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.009731 Mar 05 21:01:49.221467 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1719/3502] 10.222.0.15 () {60 vars in 1169 bytes} [Sat Mar 5 21:01:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:49.225913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b3dd4b5b-cbf3-4591-b68b-1a2aa4e11271 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:49.226885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5c2c1901-4736-4ebd-a09c-3afd168c677f tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:49.227304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b3dd4b5b-cbf3-4591-b68b-1a2aa4e11271 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:49.227864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5c2c1901-4736-4ebd-a09c-3afd168c677f tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:49.237137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3dd4b5b-cbf3-4591-b68b-1a2aa4e11271 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:49.238207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3dd4b5b-cbf3-4591-b68b-1a2aa4e11271 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:49.240511 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3dd4b5b-cbf3-4591-b68b-1a2aa4e11271 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:49.241448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3dd4b5b-cbf3-4591-b68b-1a2aa4e11271 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:49.349752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5c2c1901-4736-4ebd-a09c-3afd168c677f tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:49.373674 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5c2c1901-4736-4ebd-a09c-3afd168c677f tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1302 microversion: 2.1 time: 0.151078 Mar 05 21:01:49.380625 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1720/3503] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:49 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1302 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:49.397365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1e7a262e-3bcd-45aa-bb7c-d0f675f1f25a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Action: 'create', calling method: .version_select at 0x7fed61a85700>, body: {"keypair": {"name": "tempest-key-1662754467"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:49.441042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-1e7a262e-3bcd-45aa-bb7c-d0f675f1f25a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for project 180462533c264596b5f243c2915b027c. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:01:49.455265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-1e7a262e-3bcd-45aa-bb7c-d0f675f1f25a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for user cfbceb7c8c104af89e7d21ba411e32a8 and project 180462533c264596b5f243c2915b027c. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:01:49.725967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b3dd4b5b-cbf3-4591-b68b-1a2aa4e11271 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:49.736047 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b3dd4b5b-cbf3-4591-b68b-1a2aa4e11271 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.522436 Mar 05 21:01:49.736863 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1784/3504] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:49 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:49.750117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8f17d010-69bb-4c87-ab2b-e81cfaf6b732 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.100"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:49.766312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8f17d010-69bb-4c87-ab2b-e81cfaf6b732 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:49.781687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f17d010-69bb-4c87-ab2b-e81cfaf6b732 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:49.782350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f17d010-69bb-4c87-ab2b-e81cfaf6b732 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:49.783329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f17d010-69bb-4c87-ab2b-e81cfaf6b732 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:49.784116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f17d010-69bb-4c87-ab2b-e81cfaf6b732 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:49.872561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f17d010-69bb-4c87-ab2b-e81cfaf6b732 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Acquired lock "refresh_cache-0c823028-9831-4a07-9622-4c0649617902" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 21:01:50.318082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-1e7a262e-3bcd-45aa-bb7c-d0f675f1f25a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for project 180462533c264596b5f243c2915b027c. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:01:50.323245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-1e7a262e-3bcd-45aa-bb7c-d0f675f1f25a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for user cfbceb7c8c104af89e7d21ba411e32a8 and project 180462533c264596b5f243c2915b027c. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:01:50.339557 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1e7a262e-3bcd-45aa-bb7c-d0f675f1f25a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.957806 Mar 05 21:01:50.344979 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1721/3505] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:01:49 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:50.350285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2dd835b4-c95e-45ac-898d-de0c554e4413 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:50.350928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2dd835b4-c95e-45ac-898d-de0c554e4413 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] [instance: d76bdf23-9bbf-442e-aace-748bd854313b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:50.357075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dd835b4-c95e-45ac-898d-de0c554e4413 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:50.358057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dd835b4-c95e-45ac-898d-de0c554e4413 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:50.358946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dd835b4-c95e-45ac-898d-de0c554e4413 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:50.359481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dd835b4-c95e-45ac-898d-de0c554e4413 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:50.374482 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-2dd835b4-c95e-45ac-898d-de0c554e4413 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] HTTP exception thrown: Instance d76bdf23-9bbf-442e-aace-748bd854313b could not be found. Mar 05 21:01:50.375098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2dd835b4-c95e-45ac-898d-de0c554e4413 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] Returning 404 to user: Instance d76bdf23-9bbf-442e-aace-748bd854313b could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:01:50.375974 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2dd835b4-c95e-45ac-898d-de0c554e4413 tempest-InstanceActionsTestJSON-726486215 tempest-InstanceActionsTestJSON-726486215-project] 10.222.0.15 "GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b" status: 404 len: 111 microversion: 2.1 time: 0.029939 Mar 05 21:01:50.376547 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1722/3506] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:50 2022] GET /compute/v2.1/servers/d76bdf23-9bbf-442e-aace-748bd854313b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:01:50.381142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-541f0665-7dd7-44ea-86e8-ca13352f3157 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '.version_select at 0x7fed4f9b1790>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:50.384660 ncdv-master-1 devstack@n-api.service[141478]: WARNING oslo_db.sqlalchemy.utils [None req-541f0665-7dd7-44ea-86e8-ca13352f3157 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 05 21:01:50.396859 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-541f0665-7dd7-44ea-86e8-ca13352f3157 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/os-keypairs" status: 200 len: 545 microversion: 2.1 time: 0.019264 Mar 05 21:01:50.403839 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1723/3507] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 21:01:50 2022] GET /compute/v2.1/os-keypairs => generated 545 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:50.411741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-12b302ea-6217-49b3-8f5e-7cdbdba5edc7 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:50.412422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-12b302ea-6217-49b3-8f5e-7cdbdba5edc7 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:50.422363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-12b302ea-6217-49b3-8f5e-7cdbdba5edc7 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:50.422838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-12b302ea-6217-49b3-8f5e-7cdbdba5edc7 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:50.424099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-12b302ea-6217-49b3-8f5e-7cdbdba5edc7 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:50.424551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-12b302ea-6217-49b3-8f5e-7cdbdba5edc7 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:50.613763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-12b302ea-6217-49b3-8f5e-7cdbdba5edc7 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:50.622550 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-12b302ea-6217-49b3-8f5e-7cdbdba5edc7 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1354 microversion: 2.1 time: 0.217339 Mar 05 21:01:50.629402 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1724/3508] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:50 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1354 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:50.635023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1709717162", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "key_name": "tempest-key-1662754467", "networks": [{"uuid": "5345ca04-bcd0-4ca9-94fb-fa648ce6d989"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:50.767693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG neutronclient.v2_0.client [None req-8f17d010-69bb-4c87-ab2b-e81cfaf6b732 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.0.100 (d90b5e04-49c7-4964-8db7-3b129af78933) with port 85d8eddd-cd0d-4454-936e-fd94b927f82a using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 8f09a79f-b6b0-4bcb-886e-948c40f55161.", "detail": ""}} {{(pid=141479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 21:01:50.768987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f17d010-69bb-4c87-ab2b-e81cfaf6b732 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Releasing lock "refresh_cache-0c823028-9831-4a07-9622-4c0649617902" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 21:01:50.769929 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-8f17d010-69bb-4c87-ab2b-e81cfaf6b732 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] HTTP exception thrown: Cannot associate floating IP 172.35.0.100 (d90b5e04-49c7-4964-8db7-3b129af78933) with port 85d8eddd-cd0d-4454-936e-fd94b927f82a using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 8f09a79f-b6b0-4bcb-886e-948c40f55161. Mar 05 21:01:50.769929 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-e4a85e7e-ae48-47dc-a33b-855d495b182e'] Mar 05 21:01:50.770203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] validate_networks() for [('5345ca04-bcd0-4ca9-94fb-fa648ce6d989', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:01:50.770980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8f17d010-69bb-4c87-ab2b-e81cfaf6b732 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Returning 400 to user: Cannot associate floating IP 172.35.0.100 (d90b5e04-49c7-4964-8db7-3b129af78933) with port 85d8eddd-cd0d-4454-936e-fd94b927f82a using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network 8f09a79f-b6b0-4bcb-886e-948c40f55161. Mar 05 21:01:50.770980 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-e4a85e7e-ae48-47dc-a33b-855d495b182e'] {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:01:50.772070 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8f17d010-69bb-4c87-ab2b-e81cfaf6b732 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "POST /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902/action" status: 400 len: 382 microversion: 2.1 time: 1.034460 Mar 05 21:01:50.772885 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1785/3509] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:01:49 2022] POST /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902/action => generated 382 bytes in 1036 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:01:50.782454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-61211921-d54e-4b2a-af80-0cedb8da6697 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:50.784052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-61211921-d54e-4b2a-af80-0cedb8da6697 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:50.790686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61211921-d54e-4b2a-af80-0cedb8da6697 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:50.791283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61211921-d54e-4b2a-af80-0cedb8da6697 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:50.792224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61211921-d54e-4b2a-af80-0cedb8da6697 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:50.792744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61211921-d54e-4b2a-af80-0cedb8da6697 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:51.066770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-61211921-d54e-4b2a-af80-0cedb8da6697 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:51.075735 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-61211921-d54e-4b2a-af80-0cedb8da6697 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.297801 Mar 05 21:01:51.077422 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1786/3510] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:50 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:51.082502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2867f29f-8478-4cdc-8566-e1550d5f1352 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '.version_select at 0x7fed5c4ccd30>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:52.580281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:01:52.586872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:01:52.588784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:01:52.589462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:01:52.590095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:01:52.634918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:52.634918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:52.635299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:52.635793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:52.684585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:01:52.693377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for user cfbceb7c8c104af89e7d21ba411e32a8 and project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:01:52.713111 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2867f29f-8478-4cdc-8566-e1550d5f1352 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "DELETE /compute/v2.1/os-floating-ips/d90b5e04-49c7-4964-8db7-3b129af78933" status: 202 len: 0 microversion: 2.1 time: 1.634356 Mar 05 21:01:52.714359 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1787/3511] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 21:01:51 2022] DELETE /compute/v2.1/os-floating-ips/d90b5e04-49c7-4964-8db7-3b129af78933 => generated 0 bytes in 1636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:01:52.721924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-3408a8ba-1605-4a0a-bd6b-f86c393bb605 req-9da54289-60aa-4b8c-b74a-99eaf508fd81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d76bdf23-9bbf-442e-aace-748bd854313b", "name": "network-vif-deleted", "tag": "7ce0566c-b8c7-44ba-96cc-c04b6c770e05"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:52.729241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:01:52.746895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:01:52.754163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3408a8ba-1605-4a0a-bd6b-f86c393bb605 req-9da54289-60aa-4b8c-b74a-99eaf508fd81 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:52.755992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3408a8ba-1605-4a0a-bd6b-f86c393bb605 req-9da54289-60aa-4b8c-b74a-99eaf508fd81 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:52.791527 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-3408a8ba-1605-4a0a-bd6b-f86c393bb605 req-9da54289-60aa-4b8c-b74a-99eaf508fd81 service nova] Creating event network-vif-deleted:7ce0566c-b8c7-44ba-96cc-c04b6c770e05 for instance d76bdf23-9bbf-442e-aace-748bd854313b on nch2-master-1 Mar 05 21:01:52.804905 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-3408a8ba-1605-4a0a-bd6b-f86c393bb605 req-9da54289-60aa-4b8c-b74a-99eaf508fd81 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087750 Mar 05 21:01:52.805837 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1788/3512] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:52.819149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-182d3196-d061-4224-ad0f-cab28db8fb99 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:52.820138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-182d3196-d061-4224-ad0f-cab28db8fb99 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:52.829629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-182d3196-d061-4224-ad0f-cab28db8fb99 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:52.830343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-182d3196-d061-4224-ad0f-cab28db8fb99 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:52.831453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-182d3196-d061-4224-ad0f-cab28db8fb99 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:52.832072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-182d3196-d061-4224-ad0f-cab28db8fb99 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:52.876109 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ff41ca27-0adc-444d-821d-e3642e0f0640 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.245311 Mar 05 21:01:52.876780 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1725/3513] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:01:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:01:52.904031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b41e3e71-3f84-4402-8a1c-f1a8d01ec0fa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:52.908274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b41e3e71-3f84-4402-8a1c-f1a8d01ec0fa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:52.927717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b41e3e71-3f84-4402-8a1c-f1a8d01ec0fa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:52.928189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b41e3e71-3f84-4402-8a1c-f1a8d01ec0fa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:52.938457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b41e3e71-3f84-4402-8a1c-f1a8d01ec0fa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:52.939139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b41e3e71-3f84-4402-8a1c-f1a8d01ec0fa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:53.034136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-182d3196-d061-4224-ad0f-cab28db8fb99 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:53.046194 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-182d3196-d061-4224-ad0f-cab28db8fb99 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1360 microversion: 2.1 time: 0.238820 Mar 05 21:01:53.052704 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1789/3514] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:52 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1360 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:53.064437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-74797465-5ef3-4d7e-a0ff-22f2b4922a34 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.33"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:53.429649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b41e3e71-3f84-4402-8a1c-f1a8d01ec0fa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:53.444006 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b41e3e71-3f84-4402-8a1c-f1a8d01ec0fa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.546355 Mar 05 21:01:53.448362 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1726/3515] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:52 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:53.468763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ee63e243-e38c-446a-ab2e-cebb11cb5d76 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:53.471202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ee63e243-e38c-446a-ab2e-cebb11cb5d76 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:53.475589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-74797465-5ef3-4d7e-a0ff-22f2b4922a34 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:53.483294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74797465-5ef3-4d7e-a0ff-22f2b4922a34 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:53.484038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74797465-5ef3-4d7e-a0ff-22f2b4922a34 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:53.485970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74797465-5ef3-4d7e-a0ff-22f2b4922a34 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:53.488516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74797465-5ef3-4d7e-a0ff-22f2b4922a34 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:53.582125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ee63e243-e38c-446a-ab2e-cebb11cb5d76 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:53.590690 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ee63e243-e38c-446a-ab2e-cebb11cb5d76 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1229 microversion: 2.1 time: 0.137206 Mar 05 21:01:53.591414 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1727/3516] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:53 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1229 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:54.035613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74797465-5ef3-4d7e-a0ff-22f2b4922a34 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Acquired lock "refresh_cache-0c823028-9831-4a07-9622-4c0649617902" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 21:01:54.070349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bef1f072-579e-4e01-b1f6-216c82d3b172 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:54.071263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bef1f072-579e-4e01-b1f6-216c82d3b172 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:54.087631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bef1f072-579e-4e01-b1f6-216c82d3b172 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:54.088120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bef1f072-579e-4e01-b1f6-216c82d3b172 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:54.089508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bef1f072-579e-4e01-b1f6-216c82d3b172 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:54.089964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bef1f072-579e-4e01-b1f6-216c82d3b172 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:54.870451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bef1f072-579e-4e01-b1f6-216c82d3b172 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:54.879626 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bef1f072-579e-4e01-b1f6-216c82d3b172 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1428 microversion: 2.1 time: 0.813838 Mar 05 21:01:54.895614 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1728/3517] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:54 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1428 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:54.911970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7cd270ef-5de4-4fd4-afb4-095aff9bebb3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:54.912900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7cd270ef-5de4-4fd4-afb4-095aff9bebb3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:54.928095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cd270ef-5de4-4fd4-afb4-095aff9bebb3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:54.929093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cd270ef-5de4-4fd4-afb4-095aff9bebb3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:54.932379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cd270ef-5de4-4fd4-afb4-095aff9bebb3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:54.933030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cd270ef-5de4-4fd4-afb4-095aff9bebb3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:55.408994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-74797465-5ef3-4d7e-a0ff-22f2b4922a34 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Building network info cache for instance {{(pid=141479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 05 21:01:55.599939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7cd270ef-5de4-4fd4-afb4-095aff9bebb3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:55.610265 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7cd270ef-5de4-4fd4-afb4-095aff9bebb3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1517 microversion: 2.1 time: 0.713213 Mar 05 21:01:55.616016 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1729/3518] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:54 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1517 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:55.621180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c05381aa-7257-4334-88f4-7d0e004c9281 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:55.635857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c05381aa-7257-4334-88f4-7d0e004c9281 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:55.644200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c05381aa-7257-4334-88f4-7d0e004c9281 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:55.644908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c05381aa-7257-4334-88f4-7d0e004c9281 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:55.645886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c05381aa-7257-4334-88f4-7d0e004c9281 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:55.648231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c05381aa-7257-4334-88f4-7d0e004c9281 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:55.827279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c05381aa-7257-4334-88f4-7d0e004c9281 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:55.838624 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c05381aa-7257-4334-88f4-7d0e004c9281 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1287 microversion: 2.1 time: 0.221152 Mar 05 21:01:55.840972 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1730/3519] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:55 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1287 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:55.854922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-9113ecb7-20c0-48f2-82ec-7f148b435476 req-ea49dd18-541e-4aa2-a629-72a0114b3162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c823028-9831-4a07-9622-4c0649617902", "tag": "85d8eddd-cd0d-4454-936e-fd94b927f82a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:55.865914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9113ecb7-20c0-48f2-82ec-7f148b435476 req-ea49dd18-541e-4aa2-a629-72a0114b3162 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:55.866583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9113ecb7-20c0-48f2-82ec-7f148b435476 req-ea49dd18-541e-4aa2-a629-72a0114b3162 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:55.880473 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-9113ecb7-20c0-48f2-82ec-7f148b435476 req-ea49dd18-541e-4aa2-a629-72a0114b3162 service nova] Creating event network-changed:85d8eddd-cd0d-4454-936e-fd94b927f82a for instance 0c823028-9831-4a07-9622-4c0649617902 on nch1-master-1 Mar 05 21:01:55.894587 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-9113ecb7-20c0-48f2-82ec-7f148b435476 req-ea49dd18-541e-4aa2-a629-72a0114b3162 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049480 Mar 05 21:01:55.895989 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1731/3520] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:55.902441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-12094187-d36f-47db-8d69-08026e592a61 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:55.909549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-12094187-d36f-47db-8d69-08026e592a61 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:55.917801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-12094187-d36f-47db-8d69-08026e592a61 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:55.918492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-12094187-d36f-47db-8d69-08026e592a61 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:55.920243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-12094187-d36f-47db-8d69-08026e592a61 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:55.920864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-12094187-d36f-47db-8d69-08026e592a61 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:57.205077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-12094187-d36f-47db-8d69-08026e592a61 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:57.214653 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-12094187-d36f-47db-8d69-08026e592a61 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1428 microversion: 2.1 time: 1.317196 Mar 05 21:01:57.216058 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1732/3521] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:55 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1428 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:57.222072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-36565c47-bf4a-41e1-9cec-f9b7544bd89d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:57.222931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-36565c47-bf4a-41e1-9cec-f9b7544bd89d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:57.230752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36565c47-bf4a-41e1-9cec-f9b7544bd89d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:57.231632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36565c47-bf4a-41e1-9cec-f9b7544bd89d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:57.234391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36565c47-bf4a-41e1-9cec-f9b7544bd89d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:57.235082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36565c47-bf4a-41e1-9cec-f9b7544bd89d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:57.239146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-74797465-5ef3-4d7e-a0ff-22f2b4922a34 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Updating instance_info_cache with network_info: [{"id": "85d8eddd-cd0d-4454-936e-fd94b927f82a", "address": "fa:16:3e:a0:0c:bc", "network": {"id": "50e47084-22c1-4505-b650-54af5bab66ac", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-245331082-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "92ce8974b7c140b6b12a24cd251d1d95", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap85d8eddd-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 05 21:01:57.261474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74797465-5ef3-4d7e-a0ff-22f2b4922a34 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Releasing lock "refresh_cache-0c823028-9831-4a07-9622-4c0649617902" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 21:01:57.262627 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-74797465-5ef3-4d7e-a0ff-22f2b4922a34 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "POST /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902/action" status: 202 len: 0 microversion: 2.1 time: 4.208802 Mar 05 21:01:57.263901 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1790/3522] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:01:53 2022] POST /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902/action => generated 0 bytes in 4211 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 05 21:01:57.272708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-94f5ba9f-b25e-46b3-a411-13c9a37fc4f7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:57.273431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-94f5ba9f-b25e-46b3-a411-13c9a37fc4f7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:57.293143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94f5ba9f-b25e-46b3-a411-13c9a37fc4f7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:57.293750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94f5ba9f-b25e-46b3-a411-13c9a37fc4f7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:57.298850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94f5ba9f-b25e-46b3-a411-13c9a37fc4f7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:57.300492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94f5ba9f-b25e-46b3-a411-13c9a37fc4f7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:57.673391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-94f5ba9f-b25e-46b3-a411-13c9a37fc4f7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:57.727548 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-94f5ba9f-b25e-46b3-a411-13c9a37fc4f7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1329 microversion: 2.1 time: 0.457669 Mar 05 21:01:57.758649 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1791/3523] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:57 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1329 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:57.773947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-23de562e-9195-46b7-a5b5-5f6334d372f7 req-b0d55ff0-af88-4439-9750-2f6f1f309240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd08295-9236-47d7-adfa-64e97d152d7e", "tag": "ebe41f7c-d3ac-4d67-a17b-c81e986cf55d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:01:57.797511 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-23de562e-9195-46b7-a5b5-5f6334d372f7 req-b0d55ff0-af88-4439-9750-2f6f1f309240 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:57.798232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-23de562e-9195-46b7-a5b5-5f6334d372f7 req-b0d55ff0-af88-4439-9750-2f6f1f309240 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:57.821128 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-23de562e-9195-46b7-a5b5-5f6334d372f7 req-b0d55ff0-af88-4439-9750-2f6f1f309240 service nova] Creating event network-changed:ebe41f7c-d3ac-4d67-a17b-c81e986cf55d for instance 5bd08295-9236-47d7-adfa-64e97d152d7e on nch1-master-1 Mar 05 21:01:57.836868 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-23de562e-9195-46b7-a5b5-5f6334d372f7 req-b0d55ff0-af88-4439-9750-2f6f1f309240 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074629 Mar 05 21:01:57.839938 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1792/3524] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:01:57.849741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dccb2a84-ec05-4ed3-bbbb-d1d0ccee5605 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '.version_select at 0x7fed4f89bee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:58.055350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-36565c47-bf4a-41e1-9cec-f9b7544bd89d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:58.087793 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-36565c47-bf4a-41e1-9cec-f9b7544bd89d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1523 microversion: 2.1 time: 0.864616 Mar 05 21:01:58.101883 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1733/3525] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:57 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1523 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:01:58.234580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6b92614d-c62b-4309-bb54-9a160641bb05 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:58.235210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6b92614d-c62b-4309-bb54-9a160641bb05 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:58.252091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b92614d-c62b-4309-bb54-9a160641bb05 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:58.252565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b92614d-c62b-4309-bb54-9a160641bb05 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:58.253390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b92614d-c62b-4309-bb54-9a160641bb05 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:58.253839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b92614d-c62b-4309-bb54-9a160641bb05 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:59.212304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6b92614d-c62b-4309-bb54-9a160641bb05 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:01:59.223104 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6b92614d-c62b-4309-bb54-9a160641bb05 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1428 microversion: 2.1 time: 0.994067 Mar 05 21:01:59.223750 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1734/3526] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:58 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1428 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:01:59.239282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f51b9974-77b1-4b94-bb8d-e72c46db563f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:01:59.239964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f51b9974-77b1-4b94-bb8d-e72c46db563f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:01:59.269959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f51b9974-77b1-4b94-bb8d-e72c46db563f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:59.278699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f51b9974-77b1-4b94-bb8d-e72c46db563f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:01:59.280543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f51b9974-77b1-4b94-bb8d-e72c46db563f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:01:59.285541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f51b9974-77b1-4b94-bb8d-e72c46db563f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:00.033362 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dccb2a84-ec05-4ed3-bbbb-d1d0ccee5605 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "DELETE /compute/v2.1/os-floating-ips/f6d1e6d1-fbdf-4c9f-afa7-4799e8525db9" status: 202 len: 0 microversion: 2.1 time: 2.191851 Mar 05 21:02:00.034535 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1793/3527] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 21:01:57 2022] DELETE /compute/v2.1/os-floating-ips/f6d1e6d1-fbdf-4c9f-afa7-4799e8525db9 => generated 0 bytes in 2194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:02:00.044085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f0a46597-f0aa-42c1-bb66-7ac78729078a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:00.045556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f0a46597-f0aa-42c1-bb66-7ac78729078a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:00.052768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f0a46597-f0aa-42c1-bb66-7ac78729078a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:00.053459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f0a46597-f0aa-42c1-bb66-7ac78729078a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:00.054244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f0a46597-f0aa-42c1-bb66-7ac78729078a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:00.054841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f0a46597-f0aa-42c1-bb66-7ac78729078a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:00.099839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f51b9974-77b1-4b94-bb8d-e72c46db563f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:00.107909 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f51b9974-77b1-4b94-bb8d-e72c46db563f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1329 microversion: 2.1 time: 0.881286 Mar 05 21:02:00.117470 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1735/3528] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:01:59 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1329 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:00.123195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1136014907", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "e3218138-bd9d-487e-b8c8-cf9a74dcb5b2"}, {"uuid": "2768f120-bd58-4ead-8479-a50bd634da41"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:00.196333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] validate_networks() for [('e3218138-bd9d-487e-b8c8-cf9a74dcb5b2', None, None, None, None, None), ('2768f120-bd58-4ead-8479-a50bd634da41', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:02:00.364863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f0a46597-f0aa-42c1-bb66-7ac78729078a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:00.380566 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f0a46597-f0aa-42c1-bb66-7ac78729078a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1523 microversion: 2.1 time: 0.339686 Mar 05 21:02:00.381465 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1794/3529] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:00 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1523 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:00.395928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cd3eaac4-940a-4bf4-943f-6d1cae87e412 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:00.397284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cd3eaac4-940a-4bf4-943f-6d1cae87e412 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:00.407501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd3eaac4-940a-4bf4-943f-6d1cae87e412 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:00.408355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd3eaac4-940a-4bf4-943f-6d1cae87e412 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:00.409440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd3eaac4-940a-4bf4-943f-6d1cae87e412 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:00.410118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd3eaac4-940a-4bf4-943f-6d1cae87e412 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:00.453478 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cd3eaac4-940a-4bf4-943f-6d1cae87e412 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/ips" status: 200 len: 144 microversion: 2.1 time: 0.069968 Mar 05 21:02:00.456596 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1795/3530] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 21:02:00 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/ips => generated 144 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:00.471966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6d55072d-e8e9-44e4-af95-b586d0c90060 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:00.473787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6d55072d-e8e9-44e4-af95-b586d0c90060 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:00.477308 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6d55072d-e8e9-44e4-af95-b586d0c90060 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "POST /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902/action" status: 400 len: 142 microversion: 2.1 time: 0.019143 Mar 05 21:02:00.478454 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1796/3531] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:02:00 2022] POST /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902/action => generated 142 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:02:00.485525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-96a9861f-433a-40e5-ac45-dc43e63e2a49 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:00.486549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-96a9861f-433a-40e5-ac45-dc43e63e2a49 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:00.502754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96a9861f-433a-40e5-ac45-dc43e63e2a49 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:00.503590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96a9861f-433a-40e5-ac45-dc43e63e2a49 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:00.504733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96a9861f-433a-40e5-ac45-dc43e63e2a49 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:00.505402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96a9861f-433a-40e5-ac45-dc43e63e2a49 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:00.843489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-96a9861f-433a-40e5-ac45-dc43e63e2a49 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:00.858997 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-96a9861f-433a-40e5-ac45-dc43e63e2a49 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1428 microversion: 2.1 time: 0.376505 Mar 05 21:02:00.859752 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1797/3532] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:00 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1428 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:00.871125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7654c2e6-2092-4ba2-99de-3aec5cee6e65 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:00.876611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7654c2e6-2092-4ba2-99de-3aec5cee6e65 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:00.894983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7654c2e6-2092-4ba2-99de-3aec5cee6e65 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:00.895798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7654c2e6-2092-4ba2-99de-3aec5cee6e65 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:00.897214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7654c2e6-2092-4ba2-99de-3aec5cee6e65 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:00.897900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7654c2e6-2092-4ba2-99de-3aec5cee6e65 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:00.946294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7654c2e6-2092-4ba2-99de-3aec5cee6e65 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Acquired lock "refresh_cache-0c823028-9831-4a07-9622-4c0649617902" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 21:02:01.263330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7654c2e6-2092-4ba2-99de-3aec5cee6e65 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Releasing lock "refresh_cache-0c823028-9831-4a07-9622-4c0649617902" {{(pid=141479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 21:02:01.270285 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-7654c2e6-2092-4ba2-99de-3aec5cee6e65 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] HTTP exception thrown: floating IP not found Mar 05 21:02:01.274518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7654c2e6-2092-4ba2-99de-3aec5cee6e65 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Returning 404 to user: floating IP not found {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:01.283039 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7654c2e6-2092-4ba2-99de-3aec5cee6e65 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "POST /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902/action" status: 404 len: 67 microversion: 2.1 time: 0.419304 Mar 05 21:02:01.287574 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1798/3533] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:02:00 2022] POST /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902/action => generated 67 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:02:01.302734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-3c8cea38-8490-41db-a844-09c440c18e12 req-6b044dd4-31d2-47d5-9abd-f79a8d640cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad9443f7-ccad-4db6-8a01-914f58f54436", "tag": "1717a280-f2d9-493e-aefc-211894280866"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:01.330293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3c8cea38-8490-41db-a844-09c440c18e12 req-6b044dd4-31d2-47d5-9abd-f79a8d640cd9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:01.330920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3c8cea38-8490-41db-a844-09c440c18e12 req-6b044dd4-31d2-47d5-9abd-f79a8d640cd9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:01.346595 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-3c8cea38-8490-41db-a844-09c440c18e12 req-6b044dd4-31d2-47d5-9abd-f79a8d640cd9 service nova] Creating event network-changed:1717a280-f2d9-493e-aefc-211894280866 for instance ad9443f7-ccad-4db6-8a01-914f58f54436 on nch2-master-1 Mar 05 21:02:01.355794 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-3c8cea38-8490-41db-a844-09c440c18e12 req-6b044dd4-31d2-47d5-9abd-f79a8d640cd9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065904 Mar 05 21:02:01.357148 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1799/3534] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:01.363257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-400157b1-61bb-49fb-9b98-003b0fbccbac tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:01.364698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-400157b1-61bb-49fb-9b98-003b0fbccbac tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:01.372170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-400157b1-61bb-49fb-9b98-003b0fbccbac tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:01.373513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-400157b1-61bb-49fb-9b98-003b0fbccbac tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:01.374984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-400157b1-61bb-49fb-9b98-003b0fbccbac tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:01.375841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-400157b1-61bb-49fb-9b98-003b0fbccbac tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:02.345206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-400157b1-61bb-49fb-9b98-003b0fbccbac tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:02.359471 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-400157b1-61bb-49fb-9b98-003b0fbccbac tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1329 microversion: 2.1 time: 0.997945 Mar 05 21:02:02.360704 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1800/3535] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:01 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1329 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:02.378609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e9475490-d8d1-49c8-af21-d1b973a1bc74 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:02.459346 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-e9475490-d8d1-49c8-af21-d1b973a1bc74 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Mar 05 21:02:02.460024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e9475490-d8d1-49c8-af21-d1b973a1bc74 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:02.460928 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e9475490-d8d1-49c8-af21-d1b973a1bc74 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "POST /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902/action" status: 404 len: 88 microversion: 2.1 time: 0.098995 Mar 05 21:02:02.461524 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1801/3536] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:02:02 2022] POST /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902/action => generated 88 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:02:02.468483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d5188ec8-3bd3-496e-bee7-e6fe36e3829d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:02.470750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d5188ec8-3bd3-496e-bee7-e6fe36e3829d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:02.486747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5188ec8-3bd3-496e-bee7-e6fe36e3829d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:02.489929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5188ec8-3bd3-496e-bee7-e6fe36e3829d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:02.491496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5188ec8-3bd3-496e-bee7-e6fe36e3829d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:02.500946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5188ec8-3bd3-496e-bee7-e6fe36e3829d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:02.760989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:02:02.761715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:02:02.762322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:02:02.762883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:02:02.764757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:02:02.787890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:02.789332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:02.796474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:02.797352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:02.840349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Getting quotas for project 7cdb6564d9b940f4b35211e858ba1bb2. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:02:02.849868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Getting quotas for user 5654ba611fb14b5ba8ead5c3b331522a and project 7cdb6564d9b940f4b35211e858ba1bb2. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:02:02.879483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:02:02.889995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:02:02.981414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d5188ec8-3bd3-496e-bee7-e6fe36e3829d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:02.991898 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d5188ec8-3bd3-496e-bee7-e6fe36e3829d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1523 microversion: 2.1 time: 0.528986 Mar 05 21:02:02.994744 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1802/3537] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:02 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1523 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:03.009219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1d5c6aa4-c0c5-4215-a81e-2b3c255cffaa tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:03.009848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1d5c6aa4-c0c5-4215-a81e-2b3c255cffaa tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:03.023485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d5c6aa4-c0c5-4215-a81e-2b3c255cffaa tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:03.024499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d5c6aa4-c0c5-4215-a81e-2b3c255cffaa tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:03.025525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d5c6aa4-c0c5-4215-a81e-2b3c255cffaa tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:03.026179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d5c6aa4-c0c5-4215-a81e-2b3c255cffaa tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:03.063002 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1c1a682c-4262-415c-97ff-d1ed2bda1a53 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.943944 Mar 05 21:02:03.064479 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1736/3538] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:02:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:02:03.075508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8b9df4eb-8571-47aa-ac50-d50ee80f90be tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:03.076127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8b9df4eb-8571-47aa-ac50-d50ee80f90be tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:03.087707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b9df4eb-8571-47aa-ac50-d50ee80f90be tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:03.091789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b9df4eb-8571-47aa-ac50-d50ee80f90be tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:03.092687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b9df4eb-8571-47aa-ac50-d50ee80f90be tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:03.093153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b9df4eb-8571-47aa-ac50-d50ee80f90be tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:03.151889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8b9df4eb-8571-47aa-ac50-d50ee80f90be tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:02:03.292196 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8b9df4eb-8571-47aa-ac50-d50ee80f90be tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 204 len: 0 microversion: 2.1 time: 0.226367 Mar 05 21:02:03.296913 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1737/3539] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:02:03 2022] DELETE /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:02:03.308854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-59451618-27ee-4696-b55d-f85fab1dcf51 req-f1c359c8-1268-4390-9539-360b4f5821d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407e6bab-ea50-48db-a853-4190fadf8e50", "name": "network-vif-plugged", "status": "completed", "tag": "1e6ee596-a668-4236-aab0-7cf7ebed5d1d"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:03.329424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-59451618-27ee-4696-b55d-f85fab1dcf51 req-f1c359c8-1268-4390-9539-360b4f5821d1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:03.334475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-59451618-27ee-4696-b55d-f85fab1dcf51 req-f1c359c8-1268-4390-9539-360b4f5821d1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:03.354964 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-59451618-27ee-4696-b55d-f85fab1dcf51 req-f1c359c8-1268-4390-9539-360b4f5821d1 service nova] Creating event network-vif-plugged:1e6ee596-a668-4236-aab0-7cf7ebed5d1d for instance 407e6bab-ea50-48db-a853-4190fadf8e50 on nch2-master-1 Mar 05 21:02:03.369228 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-59451618-27ee-4696-b55d-f85fab1dcf51 req-f1c359c8-1268-4390-9539-360b4f5821d1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070792 Mar 05 21:02:03.371978 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1738/3540] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:03.385047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c5842f33-bda1-46ee-8009-abbfc2229cd0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8607c3b6-20ea-47c0-9fee-9ac4fd535791"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:03.389440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c5842f33-bda1-46ee-8009-abbfc2229cd0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:03.404893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5842f33-bda1-46ee-8009-abbfc2229cd0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:03.405401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5842f33-bda1-46ee-8009-abbfc2229cd0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:03.406167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5842f33-bda1-46ee-8009-abbfc2229cd0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:03.409631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5842f33-bda1-46ee-8009-abbfc2229cd0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:03.814750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1d5c6aa4-c0c5-4215-a81e-2b3c255cffaa tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:03.831518 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c5842f33-bda1-46ee-8009-abbfc2229cd0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "POST /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457869 Mar 05 21:02:03.832160 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1d5c6aa4-c0c5-4215-a81e-2b3c255cffaa tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1428 microversion: 2.1 time: 0.835874 Mar 05 21:02:03.832450 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1803/3541] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:02 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1428 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:03.837320 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-68a9f6b3-d869-4061-87f2-72fe465c5fcf tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:03.844169 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1739/3542] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:02:03 2022] POST /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:03.849114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-68a9f6b3-d869-4061-87f2-72fe465c5fcf tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:03.860432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-50c86dba-dcaf-4b1e-812c-e82c33da9dbb tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:03.862824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-50c86dba-dcaf-4b1e-812c-e82c33da9dbb tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:03.870540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68a9f6b3-d869-4061-87f2-72fe465c5fcf tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:03.871002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68a9f6b3-d869-4061-87f2-72fe465c5fcf tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:03.871838 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68a9f6b3-d869-4061-87f2-72fe465c5fcf tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:03.873023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68a9f6b3-d869-4061-87f2-72fe465c5fcf tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:03.896500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50c86dba-dcaf-4b1e-812c-e82c33da9dbb tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:03.902128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50c86dba-dcaf-4b1e-812c-e82c33da9dbb tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:03.903058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50c86dba-dcaf-4b1e-812c-e82c33da9dbb tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:03.903518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50c86dba-dcaf-4b1e-812c-e82c33da9dbb tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:04.058555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-68a9f6b3-d869-4061-87f2-72fe465c5fcf tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:04.070231 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-68a9f6b3-d869-4061-87f2-72fe465c5fcf tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1217 microversion: 2.1 time: 0.234442 Mar 05 21:02:04.071484 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1804/3543] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:03 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1217 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:04.080621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-52b8cf22-7237-4a4e-900d-3ea40f01ae8e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:04.084053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-52b8cf22-7237-4a4e-900d-3ea40f01ae8e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:04.096105 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52b8cf22-7237-4a4e-900d-3ea40f01ae8e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:04.100188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52b8cf22-7237-4a4e-900d-3ea40f01ae8e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:04.101346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52b8cf22-7237-4a4e-900d-3ea40f01ae8e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:04.108203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52b8cf22-7237-4a4e-900d-3ea40f01ae8e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:04.269692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-50c86dba-dcaf-4b1e-812c-e82c33da9dbb tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:04.281875 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-50c86dba-dcaf-4b1e-812c-e82c33da9dbb tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1541 microversion: 2.1 time: 0.435464 Mar 05 21:02:04.282782 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1740/3544] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:03 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1541 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:04.294026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ca4e61c9-5b63-44cb-b107-d5c220c14442 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:04.297479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ca4e61c9-5b63-44cb-b107-d5c220c14442 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:04.309441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca4e61c9-5b63-44cb-b107-d5c220c14442 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:04.310663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca4e61c9-5b63-44cb-b107-d5c220c14442 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:04.312730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca4e61c9-5b63-44cb-b107-d5c220c14442 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:04.313389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca4e61c9-5b63-44cb-b107-d5c220c14442 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:04.564482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ca4e61c9-5b63-44cb-b107-d5c220c14442 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:04.589180 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ca4e61c9-5b63-44cb-b107-d5c220c14442 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1523 microversion: 2.1 time: 0.303613 Mar 05 21:02:04.590134 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1741/3545] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:04 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:04.724154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-52b8cf22-7237-4a4e-900d-3ea40f01ae8e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:04.738416 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-52b8cf22-7237-4a4e-900d-3ea40f01ae8e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1329 microversion: 2.1 time: 0.660000 Mar 05 21:02:04.740415 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1805/3546] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:04 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1329 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:04.851832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c45fe584-5b20-497b-b2cf-53a593be7e81 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:04.853055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c45fe584-5b20-497b-b2cf-53a593be7e81 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:04.865513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c45fe584-5b20-497b-b2cf-53a593be7e81 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:04.867490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c45fe584-5b20-497b-b2cf-53a593be7e81 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:04.873608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c45fe584-5b20-497b-b2cf-53a593be7e81 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:04.876591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c45fe584-5b20-497b-b2cf-53a593be7e81 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:05.089132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6da66103-2872-4e8e-933f-c313d310f38d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:05.089990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6da66103-2872-4e8e-933f-c313d310f38d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:05.104117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6da66103-2872-4e8e-933f-c313d310f38d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:05.108560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6da66103-2872-4e8e-933f-c313d310f38d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:05.110051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6da66103-2872-4e8e-933f-c313d310f38d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:05.113665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6da66103-2872-4e8e-933f-c313d310f38d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:05.277510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6da66103-2872-4e8e-933f-c313d310f38d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:05.286796 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6da66103-2872-4e8e-933f-c313d310f38d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1271 microversion: 2.1 time: 0.202792 Mar 05 21:02:05.291966 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1806/3547] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:05 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:05.300586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ad04fb3c-00dc-46b0-a3ba-8475a8a341a5 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:05.301447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ad04fb3c-00dc-46b0-a3ba-8475a8a341a5 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:05.309134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad04fb3c-00dc-46b0-a3ba-8475a8a341a5 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:05.310000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad04fb3c-00dc-46b0-a3ba-8475a8a341a5 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:05.311049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad04fb3c-00dc-46b0-a3ba-8475a8a341a5 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:05.312302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad04fb3c-00dc-46b0-a3ba-8475a8a341a5 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:05.528609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c45fe584-5b20-497b-b2cf-53a593be7e81 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:05.545577 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c45fe584-5b20-497b-b2cf-53a593be7e81 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1428 microversion: 2.1 time: 0.700401 Mar 05 21:02:05.546781 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1742/3548] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:04 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1428 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:05.609371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6e7b740-a3fd-430b-9ba1-3bcd28650030 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:05.610172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6e7b740-a3fd-430b-9ba1-3bcd28650030 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:05.626937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6e7b740-a3fd-430b-9ba1-3bcd28650030 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:05.627433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6e7b740-a3fd-430b-9ba1-3bcd28650030 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:05.628312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6e7b740-a3fd-430b-9ba1-3bcd28650030 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:05.628929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6e7b740-a3fd-430b-9ba1-3bcd28650030 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:05.877398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ad04fb3c-00dc-46b0-a3ba-8475a8a341a5 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e28f4cb6d6640daaba3da28b0b8b2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ce8974b7c140b6b12a24cd251d1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:05.899500 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ad04fb3c-00dc-46b0-a3ba-8475a8a341a5 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 200 len: 1541 microversion: 2.1 time: 0.601553 Mar 05 21:02:05.901847 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1807/3549] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:05 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 1541 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:05.922641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-810a609a-b78f-4836-92c5-fd32e2b4dd3f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:05.926646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-810a609a-b78f-4836-92c5-fd32e2b4dd3f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:05.938643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-810a609a-b78f-4836-92c5-fd32e2b4dd3f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:05.943653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-810a609a-b78f-4836-92c5-fd32e2b4dd3f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:05.944709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-810a609a-b78f-4836-92c5-fd32e2b4dd3f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:05.945330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-810a609a-b78f-4836-92c5-fd32e2b4dd3f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:06.071877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6e7b740-a3fd-430b-9ba1-3bcd28650030 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:06.080610 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6e7b740-a3fd-430b-9ba1-3bcd28650030 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1523 microversion: 2.1 time: 0.478072 Mar 05 21:02:06.084851 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1743/3550] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:05 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:06.308709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d816759f-b480-4e65-819d-45868af44c6c req-befe209d-c1e2-4a27-b9e9-98a82f593a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c823028-9831-4a07-9622-4c0649617902", "name": "network-vif-deleted", "tag": "85d8eddd-cd0d-4454-936e-fd94b927f82a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:06.339067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d816759f-b480-4e65-819d-45868af44c6c req-befe209d-c1e2-4a27-b9e9-98a82f593a8d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:06.340767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d816759f-b480-4e65-819d-45868af44c6c req-befe209d-c1e2-4a27-b9e9-98a82f593a8d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:06.344188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-810a609a-b78f-4836-92c5-fd32e2b4dd3f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:06.352586 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-810a609a-b78f-4836-92c5-fd32e2b4dd3f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1329 microversion: 2.1 time: 0.449492 Mar 05 21:02:06.365818 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1808/3551] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:05 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1329 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:06.381437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ba3d2fab-47dd-4f80-a96f-ea325ef5e606 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:06.382108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ba3d2fab-47dd-4f80-a96f-ea325ef5e606 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:06.398297 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d816759f-b480-4e65-819d-45868af44c6c req-befe209d-c1e2-4a27-b9e9-98a82f593a8d service nova] Creating event network-vif-deleted:85d8eddd-cd0d-4454-936e-fd94b927f82a for instance 0c823028-9831-4a07-9622-4c0649617902 on nch1-master-1 Mar 05 21:02:06.403132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba3d2fab-47dd-4f80-a96f-ea325ef5e606 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:06.403593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba3d2fab-47dd-4f80-a96f-ea325ef5e606 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:06.404512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba3d2fab-47dd-4f80-a96f-ea325ef5e606 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:06.404955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba3d2fab-47dd-4f80-a96f-ea325ef5e606 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:06.414326 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d816759f-b480-4e65-819d-45868af44c6c req-befe209d-c1e2-4a27-b9e9-98a82f593a8d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108565 Mar 05 21:02:06.423603 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1744/3552] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:02:06.556750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ba3d2fab-47dd-4f80-a96f-ea325ef5e606 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:06.563852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-13ba7662-8ed8-484f-9986-c12f63bcc1cc tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:06.566309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-13ba7662-8ed8-484f-9986-c12f63bcc1cc tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:06.567994 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ba3d2fab-47dd-4f80-a96f-ea325ef5e606 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1271 microversion: 2.1 time: 0.190405 Mar 05 21:02:06.572437 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1809/3553] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:06 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:06.592046 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13ba7662-8ed8-484f-9986-c12f63bcc1cc tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:06.593132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13ba7662-8ed8-484f-9986-c12f63bcc1cc tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:06.606419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13ba7662-8ed8-484f-9986-c12f63bcc1cc tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:06.607256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13ba7662-8ed8-484f-9986-c12f63bcc1cc tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:06.918447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ac004654-e9da-464c-958b-8b11a8ba3aec tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:06.919133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ac004654-e9da-464c-958b-8b11a8ba3aec tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] [instance: 0c823028-9831-4a07-9622-4c0649617902] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:06.934004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac004654-e9da-464c-958b-8b11a8ba3aec tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:06.934759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac004654-e9da-464c-958b-8b11a8ba3aec tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:06.940750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac004654-e9da-464c-958b-8b11a8ba3aec tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:06.941462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac004654-e9da-464c-958b-8b11a8ba3aec tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:06.974711 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-ac004654-e9da-464c-958b-8b11a8ba3aec tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] HTTP exception thrown: Instance 0c823028-9831-4a07-9622-4c0649617902 could not be found. Mar 05 21:02:06.975340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ac004654-e9da-464c-958b-8b11a8ba3aec tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] Returning 404 to user: Instance 0c823028-9831-4a07-9622-4c0649617902 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:06.981447 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ac004654-e9da-464c-958b-8b11a8ba3aec tempest-FloatingIPsAssociationNegativeTestJSON-1967163395 tempest-FloatingIPsAssociationNegativeTestJSON-1967163395-project] 10.222.0.15 "GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902" status: 404 len: 111 microversion: 2.1 time: 0.067050 Mar 05 21:02:06.982387 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1810/3554] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:06 2022] GET /compute/v2.1/servers/0c823028-9831-4a07-9622-4c0649617902 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:02:07.101870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-735e6eff-6768-47cf-9087-dc1cb656299b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:07.111283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-735e6eff-6768-47cf-9087-dc1cb656299b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:07.119999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-735e6eff-6768-47cf-9087-dc1cb656299b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:07.120730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-735e6eff-6768-47cf-9087-dc1cb656299b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:07.121698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-735e6eff-6768-47cf-9087-dc1cb656299b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:07.122303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-735e6eff-6768-47cf-9087-dc1cb656299b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:07.489416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-13ba7662-8ed8-484f-9986-c12f63bcc1cc tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:07.499801 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-13ba7662-8ed8-484f-9986-c12f63bcc1cc tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1428 microversion: 2.1 time: 0.941051 Mar 05 21:02:07.511828 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1745/3555] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:06 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1428 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:07.518193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6223afa6-8e03-492c-91fe-d71b99be700f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:07.527780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6223afa6-8e03-492c-91fe-d71b99be700f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:07.529226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6223afa6-8e03-492c-91fe-d71b99be700f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:07.563900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6223afa6-8e03-492c-91fe-d71b99be700f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Going to try to stop instance {{(pid=141478) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 05 21:02:07.627603 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6223afa6-8e03-492c-91fe-d71b99be700f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "POST /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/action" status: 202 len: 0 microversion: 2.1 time: 0.110945 Mar 05 21:02:07.629210 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1746/3556] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:02:07 2022] POST /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:02:07.635419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41b06890-277b-4d49-92d9-9aeaf509739d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:07.637265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-41b06890-277b-4d49-92d9-9aeaf509739d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:07.653400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41b06890-277b-4d49-92d9-9aeaf509739d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:07.655962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41b06890-277b-4d49-92d9-9aeaf509739d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:07.657544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41b06890-277b-4d49-92d9-9aeaf509739d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:07.658004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41b06890-277b-4d49-92d9-9aeaf509739d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:07.850959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-735e6eff-6768-47cf-9087-dc1cb656299b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:07.866696 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-735e6eff-6768-47cf-9087-dc1cb656299b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1508 microversion: 2.1 time: 0.768792 Mar 05 21:02:07.867633 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1811/3557] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:07 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1508 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:07.888846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8c3da08b-2609-445b-b7c6-d35cfa71a6fa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:07.889751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8c3da08b-2609-445b-b7c6-d35cfa71a6fa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:07.899983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c3da08b-2609-445b-b7c6-d35cfa71a6fa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:07.901013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c3da08b-2609-445b-b7c6-d35cfa71a6fa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:07.902194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c3da08b-2609-445b-b7c6-d35cfa71a6fa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:07.903535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c3da08b-2609-445b-b7c6-d35cfa71a6fa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:08.074982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-41b06890-277b-4d49-92d9-9aeaf509739d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:08.093961 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-41b06890-277b-4d49-92d9-9aeaf509739d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1329 microversion: 2.1 time: 0.463029 Mar 05 21:02:08.097351 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1747/3558] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:07 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1329 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:08.105201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-baf2aae1-174a-4a33-b0d2-9fdb00ee522a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:08.106191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-baf2aae1-174a-4a33-b0d2-9fdb00ee522a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:08.116498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-baf2aae1-174a-4a33-b0d2-9fdb00ee522a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:08.118037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-baf2aae1-174a-4a33-b0d2-9fdb00ee522a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:08.119519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-baf2aae1-174a-4a33-b0d2-9fdb00ee522a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:08.120372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-baf2aae1-174a-4a33-b0d2-9fdb00ee522a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:08.516084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-baf2aae1-174a-4a33-b0d2-9fdb00ee522a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:08.532769 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-baf2aae1-174a-4a33-b0d2-9fdb00ee522a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1721 microversion: 2.1 time: 0.433507 Mar 05 21:02:08.534109 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1748/3559] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:08 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1721 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:08.538859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c7e5e5b8-8c59-4f08-ac8c-35447cdfedba tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:08.539689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c7e5e5b8-8c59-4f08-ac8c-35447cdfedba tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:08.546677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7e5e5b8-8c59-4f08-ac8c-35447cdfedba tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:08.547392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7e5e5b8-8c59-4f08-ac8c-35447cdfedba tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:08.548377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7e5e5b8-8c59-4f08-ac8c-35447cdfedba tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:08.549020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7e5e5b8-8c59-4f08-ac8c-35447cdfedba tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:08.549572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8c3da08b-2609-445b-b7c6-d35cfa71a6fa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:08.568128 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8c3da08b-2609-445b-b7c6-d35cfa71a6fa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1313 microversion: 2.1 time: 0.680775 Mar 05 21:02:08.582922 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1812/3560] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:07 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1313 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:08.592415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6c1443fd-dabd-4043-a1a6-4b8d063c26f4 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:08.595628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6c1443fd-dabd-4043-a1a6-4b8d063c26f4 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:08.609531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c1443fd-dabd-4043-a1a6-4b8d063c26f4 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:08.612747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c1443fd-dabd-4043-a1a6-4b8d063c26f4 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:08.613726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c1443fd-dabd-4043-a1a6-4b8d063c26f4 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:08.615436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c1443fd-dabd-4043-a1a6-4b8d063c26f4 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:08.819882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c7e5e5b8-8c59-4f08-ac8c-35447cdfedba tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:08.833011 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c7e5e5b8-8c59-4f08-ac8c-35447cdfedba tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 200 len: 1508 microversion: 2.1 time: 0.297591 Mar 05 21:02:08.836096 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1749/3561] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:08 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:08.852334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f1ae3e21-47a3-4f6b-af20-596141e41a01 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:08.853131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f1ae3e21-47a3-4f6b-af20-596141e41a01 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:08.861938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1ae3e21-47a3-4f6b-af20-596141e41a01 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:08.862640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1ae3e21-47a3-4f6b-af20-596141e41a01 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:08.864133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1ae3e21-47a3-4f6b-af20-596141e41a01 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:08.864737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1ae3e21-47a3-4f6b-af20-596141e41a01 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:08.922300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f1ae3e21-47a3-4f6b-af20-596141e41a01 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:02:09.061844 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f1ae3e21-47a3-4f6b-af20-596141e41a01 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "DELETE /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 204 len: 0 microversion: 2.1 time: 0.213832 Mar 05 21:02:09.064313 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1750/3562] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:02:08 2022] DELETE /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:02:09.086262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8542ad58-c3d8-465b-8e1b-976c8f1d7e8b req-4ec30707-a082-4693-99d2-93235f9d3294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd08295-9236-47d7-adfa-64e97d152d7e", "name": "network-vif-plugged", "status": "completed", "tag": "ebe41f7c-d3ac-4d67-a17b-c81e986cf55d"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:09.100510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8542ad58-c3d8-465b-8e1b-976c8f1d7e8b req-4ec30707-a082-4693-99d2-93235f9d3294 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:09.101169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8542ad58-c3d8-465b-8e1b-976c8f1d7e8b req-4ec30707-a082-4693-99d2-93235f9d3294 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:09.118869 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8542ad58-c3d8-465b-8e1b-976c8f1d7e8b req-4ec30707-a082-4693-99d2-93235f9d3294 service nova] Creating event network-vif-plugged:ebe41f7c-d3ac-4d67-a17b-c81e986cf55d for instance 5bd08295-9236-47d7-adfa-64e97d152d7e on nch1-master-1 Mar 05 21:02:09.127314 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-8542ad58-c3d8-465b-8e1b-976c8f1d7e8b req-4ec30707-a082-4693-99d2-93235f9d3294 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045493 Mar 05 21:02:09.131381 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1751/3563] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:09.161869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-98c507f3-e5ab-454c-b800-82ca2a491846 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:09.163885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-98c507f3-e5ab-454c-b800-82ca2a491846 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:09.200391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98c507f3-e5ab-454c-b800-82ca2a491846 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:09.201813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98c507f3-e5ab-454c-b800-82ca2a491846 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:09.204640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98c507f3-e5ab-454c-b800-82ca2a491846 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:09.205933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98c507f3-e5ab-454c-b800-82ca2a491846 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:09.595603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6c1443fd-dabd-4043-a1a6-4b8d063c26f4 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:09.611228 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6c1443fd-dabd-4043-a1a6-4b8d063c26f4 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1428 microversion: 2.1 time: 1.026755 Mar 05 21:02:09.622689 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1813/3564] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:08 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1428 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:09.723090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-98c507f3-e5ab-454c-b800-82ca2a491846 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:09.735451 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-98c507f3-e5ab-454c-b800-82ca2a491846 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1329 microversion: 2.1 time: 0.602073 Mar 05 21:02:09.737604 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1752/3565] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:09 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1329 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:09.759609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-753334175", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "d74d376a-0a45-4915-b0da-56d17c1f19d7"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:09.847100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-06ba9f37-d667-419c-bfa0-62e377157d0b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'create', calling method: .version_select at 0x7fed5caff940>, body: {"keypair": {"name": "tempest-keypair-1507396363"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:09.871149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] validate_networks() for [('d74d376a-0a45-4915-b0da-56d17c1f19d7', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:02:09.895480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-06ba9f37-d667-419c-bfa0-62e377157d0b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:02:09.912002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-06ba9f37-d667-419c-bfa0-62e377157d0b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for user d2421fee8afc47ea822c5df54a095261 and project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:02:10.104545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-06ba9f37-d667-419c-bfa0-62e377157d0b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:02:10.111750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-06ba9f37-d667-419c-bfa0-62e377157d0b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for user d2421fee8afc47ea822c5df54a095261 and project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:02:10.159279 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-06ba9f37-d667-419c-bfa0-62e377157d0b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.535181 Mar 05 21:02:10.167586 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1814/3566] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:02:09 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:10.176419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-414dd3db-cd0f-47a5-8974-89bf3e45e43c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:10.178727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-414dd3db-cd0f-47a5-8974-89bf3e45e43c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:10.186937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-414dd3db-cd0f-47a5-8974-89bf3e45e43c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:10.187759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-414dd3db-cd0f-47a5-8974-89bf3e45e43c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:10.189158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-414dd3db-cd0f-47a5-8974-89bf3e45e43c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:10.189770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-414dd3db-cd0f-47a5-8974-89bf3e45e43c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:11.070366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-414dd3db-cd0f-47a5-8974-89bf3e45e43c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:11.083751 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-414dd3db-cd0f-47a5-8974-89bf3e45e43c tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1721 microversion: 2.1 time: 0.913344 Mar 05 21:02:11.087437 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1815/3567] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:10 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1721 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:11.109809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-571c401e-4520-483a-a9d5-9941e1d4a279 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:11.110398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-571c401e-4520-483a-a9d5-9941e1d4a279 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:11.129736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-571c401e-4520-483a-a9d5-9941e1d4a279 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:11.130200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-571c401e-4520-483a-a9d5-9941e1d4a279 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:11.130997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-571c401e-4520-483a-a9d5-9941e1d4a279 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:11.131435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-571c401e-4520-483a-a9d5-9941e1d4a279 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:11.376979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:02:11.378258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:02:11.379525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:02:11.380639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:02:11.381232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:02:11.398518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:11.399786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:11.400764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:11.401372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:11.431242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Getting quotas for project fa686c12d54e49ceaa2ce991119294e4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:02:11.452543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Getting quotas for user fc62e97c4f024cd183c380c0be7b4a0d and project fa686c12d54e49ceaa2ce991119294e4. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:02:11.490624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:02:11.494961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:02:11.584101 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c11db32f-e26b-44c9-a931-24c64d70a879 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.845327 Mar 05 21:02:11.585557 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1753/3568] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:02:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:02:11.593039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-136e052a-262b-4bf5-bfd0-223ddf3a5d42 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:11.594607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-136e052a-262b-4bf5-bfd0-223ddf3a5d42 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:11.608775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-136e052a-262b-4bf5-bfd0-223ddf3a5d42 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:11.608775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-136e052a-262b-4bf5-bfd0-223ddf3a5d42 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:11.609526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-136e052a-262b-4bf5-bfd0-223ddf3a5d42 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:11.610355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-136e052a-262b-4bf5-bfd0-223ddf3a5d42 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:11.906108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-571c401e-4520-483a-a9d5-9941e1d4a279 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:11.923494 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-571c401e-4520-483a-a9d5-9941e1d4a279 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1334 microversion: 2.1 time: 0.834625 Mar 05 21:02:11.937591 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1816/3569] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:11 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1334 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:11.948117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6e1bb011-7e25-4a0a-a9d3-2bcf5c9d8dec tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:11.949895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6e1bb011-7e25-4a0a-a9d3-2bcf5c9d8dec tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:11.965407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e1bb011-7e25-4a0a-a9d3-2bcf5c9d8dec tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:11.966547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e1bb011-7e25-4a0a-a9d3-2bcf5c9d8dec tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:11.970374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e1bb011-7e25-4a0a-a9d3-2bcf5c9d8dec tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:11.970837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e1bb011-7e25-4a0a-a9d3-2bcf5c9d8dec tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:12.955932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6e1bb011-7e25-4a0a-a9d3-2bcf5c9d8dec tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:12.979992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-136e052a-262b-4bf5-bfd0-223ddf3a5d42 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:12.993574 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6e1bb011-7e25-4a0a-a9d3-2bcf5c9d8dec tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1329 microversion: 2.1 time: 1.051635 Mar 05 21:02:12.994281 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1817/3570] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:11 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1329 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:13.010797 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-136e052a-262b-4bf5-bfd0-223ddf3a5d42 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1608 microversion: 2.1 time: 1.420871 Mar 05 21:02:13.012445 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1754/3571] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:11 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1608 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:13.018754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-5a7b010b-a013-458b-85c3-f7f856641294 req-e9714036-c8d5-40eb-bf2f-a6a594a0c1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad9443f7-ccad-4db6-8a01-914f58f54436", "name": "network-vif-plugged", "status": "completed", "tag": "1717a280-f2d9-493e-aefc-211894280866"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:13.035967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-de5f490b-ab0e-4562-8906-2a9bd31a4050 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:13.038661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5a7b010b-a013-458b-85c3-f7f856641294 req-e9714036-c8d5-40eb-bf2f-a6a594a0c1a0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:13.040074 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-de5f490b-ab0e-4562-8906-2a9bd31a4050 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:13.041182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5a7b010b-a013-458b-85c3-f7f856641294 req-e9714036-c8d5-40eb-bf2f-a6a594a0c1a0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:13.061895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-de5f490b-ab0e-4562-8906-2a9bd31a4050 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:13.072116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-de5f490b-ab0e-4562-8906-2a9bd31a4050 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:13.073112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-de5f490b-ab0e-4562-8906-2a9bd31a4050 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:13.073582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-de5f490b-ab0e-4562-8906-2a9bd31a4050 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:13.087813 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-5a7b010b-a013-458b-85c3-f7f856641294 req-e9714036-c8d5-40eb-bf2f-a6a594a0c1a0 service nova] Creating event network-vif-plugged:1717a280-f2d9-493e-aefc-211894280866 for instance ad9443f7-ccad-4db6-8a01-914f58f54436 on nch2-master-1 Mar 05 21:02:13.097131 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-5a7b010b-a013-458b-85c3-f7f856641294 req-e9714036-c8d5-40eb-bf2f-a6a594a0c1a0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083577 Mar 05 21:02:13.098511 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1818/3572] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:13.124211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2f40aebc-b7a6-4d94-bace-5e615c5af147 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:13.125272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2f40aebc-b7a6-4d94-bace-5e615c5af147 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:13.149652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f40aebc-b7a6-4d94-bace-5e615c5af147 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:13.160437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f40aebc-b7a6-4d94-bace-5e615c5af147 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:13.161575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f40aebc-b7a6-4d94-bace-5e615c5af147 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:13.162184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f40aebc-b7a6-4d94-bace-5e615c5af147 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:13.408334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-de5f490b-ab0e-4562-8906-2a9bd31a4050 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:13.431964 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-de5f490b-ab0e-4562-8906-2a9bd31a4050 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1269 microversion: 2.1 time: 0.413069 Mar 05 21:02:13.442307 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1755/3573] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:13 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1269 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:13.446901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-08c89b80-b93c-4f63-91be-005b3c035ff3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:13.448262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-08c89b80-b93c-4f63-91be-005b3c035ff3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:13.456512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08c89b80-b93c-4f63-91be-005b3c035ff3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:13.457322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08c89b80-b93c-4f63-91be-005b3c035ff3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:13.460487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08c89b80-b93c-4f63-91be-005b3c035ff3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:13.461211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08c89b80-b93c-4f63-91be-005b3c035ff3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:14.020325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-08c89b80-b93c-4f63-91be-005b3c035ff3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:14.032933 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-08c89b80-b93c-4f63-91be-005b3c035ff3 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1334 microversion: 2.1 time: 0.591258 Mar 05 21:02:14.033588 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1756/3574] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:13 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1334 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:14.049056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2a1b41e4-3364-4448-aaed-418b1e67ba82 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:14.050159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2a1b41e4-3364-4448-aaed-418b1e67ba82 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:14.070187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a1b41e4-3364-4448-aaed-418b1e67ba82 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:14.077491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a1b41e4-3364-4448-aaed-418b1e67ba82 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:14.079010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a1b41e4-3364-4448-aaed-418b1e67ba82 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:14.079549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a1b41e4-3364-4448-aaed-418b1e67ba82 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:14.478398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2f40aebc-b7a6-4d94-bace-5e615c5af147 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:14.505512 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2f40aebc-b7a6-4d94-bace-5e615c5af147 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1721 microversion: 2.1 time: 1.405560 Mar 05 21:02:14.508178 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1819/3575] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:13 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1721 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:14.525432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ac5d976b-fc13-40af-b641-ef6fb0020a77 req-d2d97c26-d08e-46e6-8af2-97acbf74a763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2699fb15-7a83-401b-8297-3362938587a4", "tag": "263116ce-7cf0-48c8-869b-4be6ced13670"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:14.551236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ac5d976b-fc13-40af-b641-ef6fb0020a77 req-d2d97c26-d08e-46e6-8af2-97acbf74a763 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:14.552166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ac5d976b-fc13-40af-b641-ef6fb0020a77 req-d2d97c26-d08e-46e6-8af2-97acbf74a763 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:14.583306 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ac5d976b-fc13-40af-b641-ef6fb0020a77 req-d2d97c26-d08e-46e6-8af2-97acbf74a763 service nova] Creating event network-changed:263116ce-7cf0-48c8-869b-4be6ced13670 for instance 2699fb15-7a83-401b-8297-3362938587a4 on nch2-master-1 Mar 05 21:02:14.590610 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ac5d976b-fc13-40af-b641-ef6fb0020a77 req-d2d97c26-d08e-46e6-8af2-97acbf74a763 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078462 Mar 05 21:02:14.592504 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1820/3576] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:14.600808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-677e3ee0-6248-4dbf-a8d6-b513269540df req-4fabd62a-bcc8-4398-a0db-63bf1ce28b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407e6bab-ea50-48db-a853-4190fadf8e50", "name": "network-vif-deleted", "tag": "1e6ee596-a668-4236-aab0-7cf7ebed5d1d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:14.620334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-677e3ee0-6248-4dbf-a8d6-b513269540df req-4fabd62a-bcc8-4398-a0db-63bf1ce28b58 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:14.621400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-677e3ee0-6248-4dbf-a8d6-b513269540df req-4fabd62a-bcc8-4398-a0db-63bf1ce28b58 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:14.643449 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-677e3ee0-6248-4dbf-a8d6-b513269540df req-4fabd62a-bcc8-4398-a0db-63bf1ce28b58 service nova] Creating event network-vif-deleted:1e6ee596-a668-4236-aab0-7cf7ebed5d1d for instance 407e6bab-ea50-48db-a853-4190fadf8e50 on nch2-master-1 Mar 05 21:02:14.664932 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-677e3ee0-6248-4dbf-a8d6-b513269540df req-4fabd62a-bcc8-4398-a0db-63bf1ce28b58 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070414 Mar 05 21:02:14.669944 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1821/3577] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:14.681102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c25b4660-8a0e-474c-b2da-fe89551c892f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:14.682845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c25b4660-8a0e-474c-b2da-fe89551c892f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:14.693555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c25b4660-8a0e-474c-b2da-fe89551c892f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:14.695885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c25b4660-8a0e-474c-b2da-fe89551c892f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:14.697059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c25b4660-8a0e-474c-b2da-fe89551c892f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:14.698309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c25b4660-8a0e-474c-b2da-fe89551c892f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:14.863582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2a1b41e4-3364-4448-aaed-418b1e67ba82 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:14.876056 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2a1b41e4-3364-4448-aaed-418b1e67ba82 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1608 microversion: 2.1 time: 0.841367 Mar 05 21:02:14.878631 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1757/3578] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:14 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1608 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:14.891232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f0be72bb-75d6-4ab9-a93a-a97c12c31d47 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:14.894275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f0be72bb-75d6-4ab9-a93a-a97c12c31d47 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:14.913809 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0be72bb-75d6-4ab9-a93a-a97c12c31d47 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:14.915874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0be72bb-75d6-4ab9-a93a-a97c12c31d47 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:14.920920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0be72bb-75d6-4ab9-a93a-a97c12c31d47 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:14.921471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0be72bb-75d6-4ab9-a93a-a97c12c31d47 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:15.082096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f0be72bb-75d6-4ab9-a93a-a97c12c31d47 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:15.092617 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f0be72bb-75d6-4ab9-a93a-a97c12c31d47 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1275 microversion: 2.1 time: 0.211256 Mar 05 21:02:15.102956 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1758/3579] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:14 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:15.109263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f7906b32-9d7d-48cc-af57-be203dc6cf74 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:15.110373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f7906b32-9d7d-48cc-af57-be203dc6cf74 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:15.117871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7906b32-9d7d-48cc-af57-be203dc6cf74 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:15.118749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7906b32-9d7d-48cc-af57-be203dc6cf74 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:15.119917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7906b32-9d7d-48cc-af57-be203dc6cf74 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:15.120637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7906b32-9d7d-48cc-af57-be203dc6cf74 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:15.443126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c25b4660-8a0e-474c-b2da-fe89551c892f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:15.451708 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c25b4660-8a0e-474c-b2da-fe89551c892f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1329 microversion: 2.1 time: 0.779812 Mar 05 21:02:15.452967 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1822/3580] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:14 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1329 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:15.458740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ee0d2ea2-3448-467d-84b6-2c03596d286e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:15.459699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ee0d2ea2-3448-467d-84b6-2c03596d286e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:15.467308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee0d2ea2-3448-467d-84b6-2c03596d286e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:15.468054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee0d2ea2-3448-467d-84b6-2c03596d286e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:15.469078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee0d2ea2-3448-467d-84b6-2c03596d286e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:15.469749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee0d2ea2-3448-467d-84b6-2c03596d286e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:15.728812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f7906b32-9d7d-48cc-af57-be203dc6cf74 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:15.750701 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f7906b32-9d7d-48cc-af57-be203dc6cf74 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1608 microversion: 2.1 time: 0.642177 Mar 05 21:02:15.753386 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1759/3581] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:15 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1608 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:15.770324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2434c924-826d-4cf5-a881-cd4a97214460 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:15.774165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2434c924-826d-4cf5-a881-cd4a97214460 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:15.798269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2434c924-826d-4cf5-a881-cd4a97214460 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:15.798999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2434c924-826d-4cf5-a881-cd4a97214460 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:15.801484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2434c924-826d-4cf5-a881-cd4a97214460 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:15.803055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2434c924-826d-4cf5-a881-cd4a97214460 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:16.048805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ee0d2ea2-3448-467d-84b6-2c03596d286e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:16.065817 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ee0d2ea2-3448-467d-84b6-2c03596d286e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1334 microversion: 2.1 time: 0.610650 Mar 05 21:02:16.068956 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1823/3582] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:15 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1334 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:16.117833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c481da94-d6f3-424d-8021-9c8de177c1d2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:16.118616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c481da94-d6f3-424d-8021-9c8de177c1d2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:16.137022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c481da94-d6f3-424d-8021-9c8de177c1d2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:16.137473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c481da94-d6f3-424d-8021-9c8de177c1d2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:16.138803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c481da94-d6f3-424d-8021-9c8de177c1d2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:16.139856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c481da94-d6f3-424d-8021-9c8de177c1d2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:16.263502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c481da94-d6f3-424d-8021-9c8de177c1d2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:16.276939 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c481da94-d6f3-424d-8021-9c8de177c1d2 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1275 microversion: 2.1 time: 0.170648 Mar 05 21:02:16.277554 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1824/3583] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:16 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:16.475032 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3fc5a7cd-4794-401e-94f8-cd13f7d959c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:16.481285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3fc5a7cd-4794-401e-94f8-cd13f7d959c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:16.507308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fc5a7cd-4794-401e-94f8-cd13f7d959c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:16.515992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fc5a7cd-4794-401e-94f8-cd13f7d959c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:16.517183 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fc5a7cd-4794-401e-94f8-cd13f7d959c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:16.517841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fc5a7cd-4794-401e-94f8-cd13f7d959c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:16.995963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2434c924-826d-4cf5-a881-cd4a97214460 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:17.007241 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2434c924-826d-4cf5-a881-cd4a97214460 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1721 microversion: 2.1 time: 1.250197 Mar 05 21:02:17.011150 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1760/3584] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:15 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1721 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:17.023496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-4435b8e4-2963-4f39-91c6-91547d7345d9 req-1e5186dd-5c3f-42a1-9b0b-bbddab84a43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2699fb15-7a83-401b-8297-3362938587a4", "tag": "dbb1a5c5-a42b-4b22-99f4-682427abb4bb"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:17.037156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4435b8e4-2963-4f39-91c6-91547d7345d9 req-1e5186dd-5c3f-42a1-9b0b-bbddab84a43b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:17.045521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4435b8e4-2963-4f39-91c6-91547d7345d9 req-1e5186dd-5c3f-42a1-9b0b-bbddab84a43b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:17.071250 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-4435b8e4-2963-4f39-91c6-91547d7345d9 req-1e5186dd-5c3f-42a1-9b0b-bbddab84a43b service nova] Creating event network-changed:dbb1a5c5-a42b-4b22-99f4-682427abb4bb for instance 2699fb15-7a83-401b-8297-3362938587a4 on nch2-master-1 Mar 05 21:02:17.083338 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-4435b8e4-2963-4f39-91c6-91547d7345d9 req-1e5186dd-5c3f-42a1-9b0b-bbddab84a43b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070172 Mar 05 21:02:17.084503 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1761/3585] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:17.089987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6f1a505-551f-481d-aecc-596085caccfd tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:17.096143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6f1a505-551f-481d-aecc-596085caccfd tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:17.113631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6f1a505-551f-481d-aecc-596085caccfd tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:17.114453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6f1a505-551f-481d-aecc-596085caccfd tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:17.115838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6f1a505-551f-481d-aecc-596085caccfd tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:17.117515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6f1a505-551f-481d-aecc-596085caccfd tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:17.119370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3fc5a7cd-4794-401e-94f8-cd13f7d959c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:17.128234 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3fc5a7cd-4794-401e-94f8-cd13f7d959c4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1509 microversion: 2.1 time: 0.662969 Mar 05 21:02:17.137065 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1825/3586] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:16 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1509 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:17.154522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-139859b1-62e7-4481-b7dd-2d9e2f21635d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:17.155352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-139859b1-62e7-4481-b7dd-2d9e2f21635d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:17.167100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-139859b1-62e7-4481-b7dd-2d9e2f21635d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:17.180453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-139859b1-62e7-4481-b7dd-2d9e2f21635d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:17.181293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-139859b1-62e7-4481-b7dd-2d9e2f21635d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:17.181958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-139859b1-62e7-4481-b7dd-2d9e2f21635d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:17.840006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-139859b1-62e7-4481-b7dd-2d9e2f21635d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:17.850698 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-139859b1-62e7-4481-b7dd-2d9e2f21635d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1509 microversion: 2.1 time: 0.701478 Mar 05 21:02:17.855581 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1826/3587] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:17 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1509 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:17.867358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-17980d48-fde5-4d6f-b25e-9220954e1fd0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:17.874674 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-17980d48-fde5-4d6f-b25e-9220954e1fd0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:17.884788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17980d48-fde5-4d6f-b25e-9220954e1fd0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:17.885539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17980d48-fde5-4d6f-b25e-9220954e1fd0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:17.886679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17980d48-fde5-4d6f-b25e-9220954e1fd0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:17.887283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17980d48-fde5-4d6f-b25e-9220954e1fd0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:18.451352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6f1a505-551f-481d-aecc-596085caccfd tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:18.460145 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6f1a505-551f-481d-aecc-596085caccfd tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1334 microversion: 2.1 time: 1.374031 Mar 05 21:02:18.461379 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1762/3588] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:17 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1334 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:18.466819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-78c2140c-8e45-4a81-bee6-3e97ff6229d7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:18.467580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-78c2140c-8e45-4a81-bee6-3e97ff6229d7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:18.474793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78c2140c-8e45-4a81-bee6-3e97ff6229d7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:18.475538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78c2140c-8e45-4a81-bee6-3e97ff6229d7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:18.476535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78c2140c-8e45-4a81-bee6-3e97ff6229d7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:18.477138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78c2140c-8e45-4a81-bee6-3e97ff6229d7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:18.506000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-78c2140c-8e45-4a81-bee6-3e97ff6229d7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:02:18.609726 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-78c2140c-8e45-4a81-bee6-3e97ff6229d7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 204 len: 0 microversion: 2.1 time: 0.146712 Mar 05 21:02:18.611499 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1763/3589] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:02:18 2022] DELETE /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:02:18.624460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-391f327c-62e2-4970-a10e-77969bf2bae0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:18.625521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-391f327c-62e2-4970-a10e-77969bf2bae0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:18.632180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-391f327c-62e2-4970-a10e-77969bf2bae0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:18.633025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-391f327c-62e2-4970-a10e-77969bf2bae0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:18.634185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-391f327c-62e2-4970-a10e-77969bf2bae0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:18.634841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-391f327c-62e2-4970-a10e-77969bf2bae0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:19.086357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-391f327c-62e2-4970-a10e-77969bf2bae0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:19.087567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-17980d48-fde5-4d6f-b25e-9220954e1fd0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:19.094865 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-17980d48-fde5-4d6f-b25e-9220954e1fd0 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1317 microversion: 2.1 time: 1.238063 Mar 05 21:02:19.105902 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1827/3590] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:17 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1317 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:19.112271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5d380ea1-bbcf-421f-9781-f9b212b2b97c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:19.113317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5d380ea1-bbcf-421f-9781-f9b212b2b97c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:19.120958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d380ea1-bbcf-421f-9781-f9b212b2b97c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:19.121633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d380ea1-bbcf-421f-9781-f9b212b2b97c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:19.122873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d380ea1-bbcf-421f-9781-f9b212b2b97c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:19.123503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d380ea1-bbcf-421f-9781-f9b212b2b97c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:19.133570 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-391f327c-62e2-4970-a10e-77969bf2bae0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1698 microversion: 2.1 time: 0.519402 Mar 05 21:02:19.141371 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1764/3591] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:18 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1698 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:19.151288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-877651020", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5638f6ea-4ec0-488e-a680-99fc30eb719d"}], "security_groups": [{"name": "tempest-securitygroup--470323971"}], "key_name": "tempest-keypair-1507396363", "user_data": "}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:19.414594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] validate_networks() for [('5638f6ea-4ec0-488e-a680-99fc30eb719d', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:02:19.840534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5d380ea1-bbcf-421f-9781-f9b212b2b97c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:19.849222 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5d380ea1-bbcf-421f-9781-f9b212b2b97c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1515 microversion: 2.1 time: 0.741575 Mar 05 21:02:19.852628 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1828/3592] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:19 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1515 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:19.871204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d205ba71-1722-416f-90b2-5b05046f97bd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:19.878695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d205ba71-1722-416f-90b2-5b05046f97bd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:19.879417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d205ba71-1722-416f-90b2-5b05046f97bd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:19.939352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d205ba71-1722-416f-90b2-5b05046f97bd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Going to try to start instance {{(pid=141479) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 05 21:02:20.012160 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d205ba71-1722-416f-90b2-5b05046f97bd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "POST /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/action" status: 202 len: 0 microversion: 2.1 time: 0.145360 Mar 05 21:02:20.013721 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1829/3593] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:02:19 2022] POST /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:02:20.040890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5516d208-aa71-438b-8a37-c9b28b71df84 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:20.046533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5516d208-aa71-438b-8a37-c9b28b71df84 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:20.059394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5516d208-aa71-438b-8a37-c9b28b71df84 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:20.060567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5516d208-aa71-438b-8a37-c9b28b71df84 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:20.062384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5516d208-aa71-438b-8a37-c9b28b71df84 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:20.063091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5516d208-aa71-438b-8a37-c9b28b71df84 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:20.474030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:02:20.476722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:02:20.478432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:02:20.478854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:02:20.479279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:02:20.489386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:20.490158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:20.491154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:20.491819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:20.542203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:02:20.547897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for user d2421fee8afc47ea822c5df54a095261 and project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:02:20.567104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:02:20.594552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:02:20.661628 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a42ff782-28c5-4f43-9a9c-e1c74a45fe12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.519005 Mar 05 21:02:20.663822 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1765/3594] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:02:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:02:20.674783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-752b70bb-dd8b-4394-af3c-f74e71faba03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:20.676368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-752b70bb-dd8b-4394-af3c-f74e71faba03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:20.703513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-752b70bb-dd8b-4394-af3c-f74e71faba03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:20.704051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-752b70bb-dd8b-4394-af3c-f74e71faba03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:20.705934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-752b70bb-dd8b-4394-af3c-f74e71faba03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:20.706381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-752b70bb-dd8b-4394-af3c-f74e71faba03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:20.845044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5516d208-aa71-438b-8a37-c9b28b71df84 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:20.856179 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5516d208-aa71-438b-8a37-c9b28b71df84 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1334 microversion: 2.1 time: 0.839558 Mar 05 21:02:20.870218 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1830/3595] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:20 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1334 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:20.881089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3ad94cd5-9073-4942-8a67-81d76adf5891 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:20.883061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3ad94cd5-9073-4942-8a67-81d76adf5891 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:20.915178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3ad94cd5-9073-4942-8a67-81d76adf5891 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:20.915865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3ad94cd5-9073-4942-8a67-81d76adf5891 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:20.917061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3ad94cd5-9073-4942-8a67-81d76adf5891 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:20.917679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3ad94cd5-9073-4942-8a67-81d76adf5891 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:21.510436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3ad94cd5-9073-4942-8a67-81d76adf5891 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:21.525149 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3ad94cd5-9073-4942-8a67-81d76adf5891 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1317 microversion: 2.1 time: 0.652848 Mar 05 21:02:21.526540 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1831/3596] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:20 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1317 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:21.535194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6417d5e2-5067-446f-bb59-8ec5552a27de req-6ea8cfba-5458-432f-ae77-c4b6198e60b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4aea58a-2255-4553-ae5e-3304f0a51c64", "tag": "f0dd87c2-bcd6-447a-8690-0daa7aa8f29b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:21.576084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6417d5e2-5067-446f-bb59-8ec5552a27de req-6ea8cfba-5458-432f-ae77-c4b6198e60b1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:21.577886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6417d5e2-5067-446f-bb59-8ec5552a27de req-6ea8cfba-5458-432f-ae77-c4b6198e60b1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:21.602738 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6417d5e2-5067-446f-bb59-8ec5552a27de req-6ea8cfba-5458-432f-ae77-c4b6198e60b1 service nova] Creating event network-changed:f0dd87c2-bcd6-447a-8690-0daa7aa8f29b for instance e4aea58a-2255-4553-ae5e-3304f0a51c64 on nch1-master-1 Mar 05 21:02:21.610573 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6417d5e2-5067-446f-bb59-8ec5552a27de req-6ea8cfba-5458-432f-ae77-c4b6198e60b1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081822 Mar 05 21:02:21.611957 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1832/3597] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:21.629565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eae93705-623e-4080-8fd6-f0f89c4c6ee1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:21.632963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eae93705-623e-4080-8fd6-f0f89c4c6ee1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:21.649619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eae93705-623e-4080-8fd6-f0f89c4c6ee1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:21.650280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eae93705-623e-4080-8fd6-f0f89c4c6ee1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:21.651234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eae93705-623e-4080-8fd6-f0f89c4c6ee1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:21.652002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eae93705-623e-4080-8fd6-f0f89c4c6ee1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:21.811284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eae93705-623e-4080-8fd6-f0f89c4c6ee1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:21.823716 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eae93705-623e-4080-8fd6-f0f89c4c6ee1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1242 microversion: 2.1 time: 0.209185 Mar 05 21:02:21.834073 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1833/3598] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:21 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1242 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:21.842823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b9459966-4bf2-4185-890b-d3544686559a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:21.843450 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b9459966-4bf2-4185-890b-d3544686559a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:21.865748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9459966-4bf2-4185-890b-d3544686559a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:21.866518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9459966-4bf2-4185-890b-d3544686559a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:21.870877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9459966-4bf2-4185-890b-d3544686559a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:21.871390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9459966-4bf2-4185-890b-d3544686559a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:22.336774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-752b70bb-dd8b-4394-af3c-f74e71faba03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:22.364346 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-752b70bb-dd8b-4394-af3c-f74e71faba03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1707 microversion: 2.1 time: 1.698375 Mar 05 21:02:22.365684 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1766/3599] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:20 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1707 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:22.371933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c55c25b-0ab4-40ec-8b26-218d2421d251 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:22.374854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c55c25b-0ab4-40ec-8b26-218d2421d251 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:22.392693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c55c25b-0ab4-40ec-8b26-218d2421d251 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:22.394915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c55c25b-0ab4-40ec-8b26-218d2421d251 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:22.396908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c55c25b-0ab4-40ec-8b26-218d2421d251 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:22.397937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c55c25b-0ab4-40ec-8b26-218d2421d251 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:23.091626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8c55c25b-0ab4-40ec-8b26-218d2421d251 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:23.099872 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8c55c25b-0ab4-40ec-8b26-218d2421d251 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1334 microversion: 2.1 time: 0.732622 Mar 05 21:02:23.109176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b9459966-4bf2-4185-890b-d3544686559a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:23.121265 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1767/3600] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:22 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1334 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:23.121507 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b9459966-4bf2-4185-890b-d3544686559a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 200 len: 1515 microversion: 2.1 time: 1.285865 Mar 05 21:02:23.121896 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1834/3601] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:21 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 1515 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:23.126760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9c48657b-08de-4986-a200-a2969b545e55 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:23.127414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9c48657b-08de-4986-a200-a2969b545e55 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:23.132060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3e5f7443-5443-4dea-a70c-71f4544be8d0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:23.133710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3e5f7443-5443-4dea-a70c-71f4544be8d0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:23.142782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e5f7443-5443-4dea-a70c-71f4544be8d0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:23.144969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e5f7443-5443-4dea-a70c-71f4544be8d0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:23.146482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e5f7443-5443-4dea-a70c-71f4544be8d0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:23.147419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e5f7443-5443-4dea-a70c-71f4544be8d0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:23.153142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c48657b-08de-4986-a200-a2969b545e55 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:23.156969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c48657b-08de-4986-a200-a2969b545e55 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:23.158767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c48657b-08de-4986-a200-a2969b545e55 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:23.159229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c48657b-08de-4986-a200-a2969b545e55 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:23.319824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3e5f7443-5443-4dea-a70c-71f4544be8d0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:23.332130 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3e5f7443-5443-4dea-a70c-71f4544be8d0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1296 microversion: 2.1 time: 0.206895 Mar 05 21:02:23.343814 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1835/3602] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:23 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1296 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:23.357628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e7f35968-d5ca-4783-a277-45eb4bb39fbc req-1449f2fe-23a8-43ba-887a-50e26e8a7952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad9443f7-ccad-4db6-8a01-914f58f54436", "name": "network-vif-deleted", "tag": "1717a280-f2d9-493e-aefc-211894280866"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:23.370228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e7f35968-d5ca-4783-a277-45eb4bb39fbc req-1449f2fe-23a8-43ba-887a-50e26e8a7952 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:23.370903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e7f35968-d5ca-4783-a277-45eb4bb39fbc req-1449f2fe-23a8-43ba-887a-50e26e8a7952 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:23.399177 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e7f35968-d5ca-4783-a277-45eb4bb39fbc req-1449f2fe-23a8-43ba-887a-50e26e8a7952 service nova] Creating event network-vif-deleted:1717a280-f2d9-493e-aefc-211894280866 for instance ad9443f7-ccad-4db6-8a01-914f58f54436 on nch2-master-1 Mar 05 21:02:23.411114 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e7f35968-d5ca-4783-a277-45eb4bb39fbc req-1449f2fe-23a8-43ba-887a-50e26e8a7952 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064911 Mar 05 21:02:23.413017 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1836/3603] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:23.424702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-42a7fee1-872f-4ff7-b503-3d6f404a2155 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:23.427133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-42a7fee1-872f-4ff7-b503-3d6f404a2155 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:23.440436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42a7fee1-872f-4ff7-b503-3d6f404a2155 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:23.441185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42a7fee1-872f-4ff7-b503-3d6f404a2155 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:23.442152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42a7fee1-872f-4ff7-b503-3d6f404a2155 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:23.442754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42a7fee1-872f-4ff7-b503-3d6f404a2155 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:23.899751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-42a7fee1-872f-4ff7-b503-3d6f404a2155 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:23.917726 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-42a7fee1-872f-4ff7-b503-3d6f404a2155 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1707 microversion: 2.1 time: 0.502545 Mar 05 21:02:23.928735 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1837/3604] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:23 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1707 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:23.935445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9c48657b-08de-4986-a200-a2969b545e55 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:23.944219 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9c48657b-08de-4986-a200-a2969b545e55 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1317 microversion: 2.1 time: 0.821781 Mar 05 21:02:23.957906 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1768/3605] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:23 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:24.129197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ae5a583c-b0fd-43e7-99d7-076f3ab4c784 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:24.129833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ae5a583c-b0fd-43e7-99d7-076f3ab4c784 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:24.140059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae5a583c-b0fd-43e7-99d7-076f3ab4c784 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:24.140518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae5a583c-b0fd-43e7-99d7-076f3ab4c784 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:24.140679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-49639f35-230b-4cc5-b65b-9e1e4fe6389e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:24.141318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae5a583c-b0fd-43e7-99d7-076f3ab4c784 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:24.141494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-49639f35-230b-4cc5-b65b-9e1e4fe6389e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:24.141775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae5a583c-b0fd-43e7-99d7-076f3ab4c784 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:24.150760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49639f35-230b-4cc5-b65b-9e1e4fe6389e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:24.154179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49639f35-230b-4cc5-b65b-9e1e4fe6389e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:24.156317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49639f35-230b-4cc5-b65b-9e1e4fe6389e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:24.168405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49639f35-230b-4cc5-b65b-9e1e4fe6389e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:24.183590 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-49639f35-230b-4cc5-b65b-9e1e4fe6389e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance ad9443f7-ccad-4db6-8a01-914f58f54436 could not be found. Mar 05 21:02:24.196621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-49639f35-230b-4cc5-b65b-9e1e4fe6389e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance ad9443f7-ccad-4db6-8a01-914f58f54436 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:24.197906 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-49639f35-230b-4cc5-b65b-9e1e4fe6389e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 404 len: 111 microversion: 2.1 time: 0.061915 Mar 05 21:02:24.199037 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1769/3606] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:24 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:02:24.208211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-09a1b4c8-a92f-4299-8d8c-0e4eb80454a3 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '.version_select at 0x7fed5d075e50>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:24.240052 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-09a1b4c8-a92f-4299-8d8c-0e4eb80454a3 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-key-1662754467" status: 202 len: 0 microversion: 2.1 time: 0.035579 Mar 05 21:02:24.240823 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1770/3607] 10.222.0.15 () {58 vars in 1208 bytes} [Sat Mar 5 21:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1662754467 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:02:24.350516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a6e80d6a-28b8-4175-86e2-cd33176ccf9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:24.351237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a6e80d6a-28b8-4175-86e2-cd33176ccf9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:24.370919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6e80d6a-28b8-4175-86e2-cd33176ccf9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:24.371494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6e80d6a-28b8-4175-86e2-cd33176ccf9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:24.372455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6e80d6a-28b8-4175-86e2-cd33176ccf9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:24.373156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6e80d6a-28b8-4175-86e2-cd33176ccf9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:24.537184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a6e80d6a-28b8-4175-86e2-cd33176ccf9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:24.545885 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a6e80d6a-28b8-4175-86e2-cd33176ccf9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1296 microversion: 2.1 time: 0.199257 Mar 05 21:02:24.546495 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1771/3608] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:24 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1296 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:24.559143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-169202149", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "5345ca04-bcd0-4ca9-94fb-fa648ce6d989"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:24.647711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] validate_networks() for [('5345ca04-bcd0-4ca9-94fb-fa648ce6d989', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:02:24.742410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ae5a583c-b0fd-43e7-99d7-076f3ab4c784 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:24.752318 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ae5a583c-b0fd-43e7-99d7-076f3ab4c784 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1334 microversion: 2.1 time: 0.627151 Mar 05 21:02:24.759182 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1838/3609] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:24 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1334 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:24.940708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-202947b4-40e8-40a6-834a-5bb5cef62601 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:24.941768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-202947b4-40e8-40a6-834a-5bb5cef62601 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:24.951616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-202947b4-40e8-40a6-834a-5bb5cef62601 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:24.953275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-202947b4-40e8-40a6-834a-5bb5cef62601 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:24.954485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-202947b4-40e8-40a6-834a-5bb5cef62601 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:24.955234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-202947b4-40e8-40a6-834a-5bb5cef62601 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:25.304437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-202947b4-40e8-40a6-834a-5bb5cef62601 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:25.318343 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-202947b4-40e8-40a6-834a-5bb5cef62601 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1711 microversion: 2.1 time: 0.384958 Mar 05 21:02:25.319380 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1839/3610] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:24 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1711 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:25.336373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5dbe9a5f-1f70-446e-b3ab-b5475586b21a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:25.337954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5dbe9a5f-1f70-446e-b3ab-b5475586b21a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:25.355651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dbe9a5f-1f70-446e-b3ab-b5475586b21a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:25.356545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dbe9a5f-1f70-446e-b3ab-b5475586b21a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:25.366375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dbe9a5f-1f70-446e-b3ab-b5475586b21a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:25.367704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dbe9a5f-1f70-446e-b3ab-b5475586b21a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:25.724029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5dbe9a5f-1f70-446e-b3ab-b5475586b21a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:25.736935 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5dbe9a5f-1f70-446e-b3ab-b5475586b21a tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1317 microversion: 2.1 time: 0.415509 Mar 05 21:02:25.737854 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1840/3611] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:25 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:25.742617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-a86d88ea-9768-4f22-9014-2b57dcee4a67 req-493a199f-0962-41bc-8dc1-edaaf497a302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd08295-9236-47d7-adfa-64e97d152d7e", "tag": "ebe41f7c-d3ac-4d67-a17b-c81e986cf55d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:25.768285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a86d88ea-9768-4f22-9014-2b57dcee4a67 req-493a199f-0962-41bc-8dc1-edaaf497a302 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:25.769343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a86d88ea-9768-4f22-9014-2b57dcee4a67 req-493a199f-0962-41bc-8dc1-edaaf497a302 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:25.787949 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-a86d88ea-9768-4f22-9014-2b57dcee4a67 req-493a199f-0962-41bc-8dc1-edaaf497a302 service nova] Creating event network-changed:ebe41f7c-d3ac-4d67-a17b-c81e986cf55d for instance 5bd08295-9236-47d7-adfa-64e97d152d7e on nch1-master-1 Mar 05 21:02:25.798948 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-a86d88ea-9768-4f22-9014-2b57dcee4a67 req-493a199f-0962-41bc-8dc1-edaaf497a302 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059618 Mar 05 21:02:25.804059 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1841/3612] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:25.815069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0b36733c-2ae6-4ab5-8688-84dd8ec59270 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:25.816624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0b36733c-2ae6-4ab5-8688-84dd8ec59270 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:25.825495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b36733c-2ae6-4ab5-8688-84dd8ec59270 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:25.826581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b36733c-2ae6-4ab5-8688-84dd8ec59270 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:25.827605 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b36733c-2ae6-4ab5-8688-84dd8ec59270 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:25.828394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b36733c-2ae6-4ab5-8688-84dd8ec59270 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:26.127935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0b36733c-2ae6-4ab5-8688-84dd8ec59270 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:26.136101 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0b36733c-2ae6-4ab5-8688-84dd8ec59270 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1363 microversion: 2.1 time: 0.329705 Mar 05 21:02:26.139148 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1842/3613] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:25 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:26.145979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-180c69b3-2730-4a37-9d94-a884fd838e60 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:26.146608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-180c69b3-2730-4a37-9d94-a884fd838e60 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:26.158643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-180c69b3-2730-4a37-9d94-a884fd838e60 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:26.159254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-180c69b3-2730-4a37-9d94-a884fd838e60 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:26.160792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-180c69b3-2730-4a37-9d94-a884fd838e60 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:26.161351 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-180c69b3-2730-4a37-9d94-a884fd838e60 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:26.622892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-180c69b3-2730-4a37-9d94-a884fd838e60 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:26.631355 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-180c69b3-2730-4a37-9d94-a884fd838e60 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1334 microversion: 2.1 time: 0.490791 Mar 05 21:02:26.636260 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1843/3614] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:26 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1334 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:26.643182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e9fadba5-40fb-4c68-a7c1-2ce9952e289d req-e5b5f853-86b2-4cba-a770-4c87313e3b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2699fb15-7a83-401b-8297-3362938587a4", "name": "network-vif-plugged", "status": "completed", "tag": "dbb1a5c5-a42b-4b22-99f4-682427abb4bb"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:26.696439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e9fadba5-40fb-4c68-a7c1-2ce9952e289d req-e5b5f853-86b2-4cba-a770-4c87313e3b54 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:26.696975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e9fadba5-40fb-4c68-a7c1-2ce9952e289d req-e5b5f853-86b2-4cba-a770-4c87313e3b54 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:26.754191 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e9fadba5-40fb-4c68-a7c1-2ce9952e289d req-e5b5f853-86b2-4cba-a770-4c87313e3b54 service nova] Creating event network-vif-plugged:dbb1a5c5-a42b-4b22-99f4-682427abb4bb for instance 2699fb15-7a83-401b-8297-3362938587a4 on nch2-master-1 Mar 05 21:02:26.786556 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e9fadba5-40fb-4c68-a7c1-2ce9952e289d req-e5b5f853-86b2-4cba-a770-4c87313e3b54 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146263 Mar 05 21:02:26.788290 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1844/3615] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:26.801481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-be2faa58-6078-4ddf-b14b-e32b3a7d10d3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:26.802862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-be2faa58-6078-4ddf-b14b-e32b3a7d10d3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:26.812447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be2faa58-6078-4ddf-b14b-e32b3a7d10d3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:26.813154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be2faa58-6078-4ddf-b14b-e32b3a7d10d3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:26.814138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be2faa58-6078-4ddf-b14b-e32b3a7d10d3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:26.815205 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be2faa58-6078-4ddf-b14b-e32b3a7d10d3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:27.133316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-be2faa58-6078-4ddf-b14b-e32b3a7d10d3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:27.139555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:02:27.140161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:02:27.140858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:02:27.141643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:02:27.142712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:02:27.151469 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-be2faa58-6078-4ddf-b14b-e32b3a7d10d3 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1317 microversion: 2.1 time: 0.361562 Mar 05 21:02:27.164044 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1845/3616] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:26 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:27.165358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:27.166073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:27.167114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:27.168286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:27.175983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c47af986-dd38-430b-8944-43d3d6b2e198 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:27.179370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c47af986-dd38-430b-8944-43d3d6b2e198 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:27.191766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c47af986-dd38-430b-8944-43d3d6b2e198 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:27.192466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c47af986-dd38-430b-8944-43d3d6b2e198 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:27.193463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c47af986-dd38-430b-8944-43d3d6b2e198 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:27.194199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c47af986-dd38-430b-8944-43d3d6b2e198 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:27.244159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:02:27.251516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for user cfbceb7c8c104af89e7d21ba411e32a8 and project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:02:27.269621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:02:27.272879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:02:27.383819 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d34c6516-6a12-4654-90dc-11e0831f8e80 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.836160 Mar 05 21:02:27.392836 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1772/3617] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:02:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:02:27.403071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4bedf0ec-0b54-4662-9616-fc59be74faaa tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:27.405920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4bedf0ec-0b54-4662-9616-fc59be74faaa tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:27.633285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4bedf0ec-0b54-4662-9616-fc59be74faaa tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:27.641546 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4bedf0ec-0b54-4662-9616-fc59be74faaa tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1208 microversion: 2.1 time: 0.247138 Mar 05 21:02:27.651331 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1773/3618] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:27 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1208 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:27.658431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5b6fb90a-20a5-47ab-9e88-c699f31e6976 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:27.659356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5b6fb90a-20a5-47ab-9e88-c699f31e6976 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:27.665950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b6fb90a-20a5-47ab-9e88-c699f31e6976 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:27.666623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b6fb90a-20a5-47ab-9e88-c699f31e6976 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:27.667578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b6fb90a-20a5-47ab-9e88-c699f31e6976 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:27.668209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b6fb90a-20a5-47ab-9e88-c699f31e6976 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:28.234792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c47af986-dd38-430b-8944-43d3d6b2e198 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:28.244954 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c47af986-dd38-430b-8944-43d3d6b2e198 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1363 microversion: 2.1 time: 1.079692 Mar 05 21:02:28.256722 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1846/3619] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:27 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1363 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:28.256722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4bd9b336-691d-44f8-8157-162c7ec419ca tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:28.256722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4bd9b336-691d-44f8-8157-162c7ec419ca tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:28.279129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bd9b336-691d-44f8-8157-162c7ec419ca tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:28.279697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bd9b336-691d-44f8-8157-162c7ec419ca tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:28.288774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bd9b336-691d-44f8-8157-162c7ec419ca tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:28.289242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bd9b336-691d-44f8-8157-162c7ec419ca tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:28.659728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4bd9b336-691d-44f8-8157-162c7ec419ca tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:28.670063 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4bd9b336-691d-44f8-8157-162c7ec419ca tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1317 microversion: 2.1 time: 0.423453 Mar 05 21:02:28.674763 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1847/3620] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:28 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:28.679792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d64a6242-36a7-4346-bc0d-08cd14d0f49a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:28.685515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d64a6242-36a7-4346-bc0d-08cd14d0f49a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:28.701349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d64a6242-36a7-4346-bc0d-08cd14d0f49a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:28.702120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d64a6242-36a7-4346-bc0d-08cd14d0f49a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:28.703076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d64a6242-36a7-4346-bc0d-08cd14d0f49a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:28.704867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d64a6242-36a7-4346-bc0d-08cd14d0f49a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:29.020385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d64a6242-36a7-4346-bc0d-08cd14d0f49a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:29.043420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5b6fb90a-20a5-47ab-9e88-c699f31e6976 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:29.058781 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d64a6242-36a7-4346-bc0d-08cd14d0f49a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1260 microversion: 2.1 time: 0.364105 Mar 05 21:02:29.068289 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1848/3621] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:28 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1260 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:29.071575 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5b6fb90a-20a5-47ab-9e88-c699f31e6976 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1334 microversion: 2.1 time: 1.418778 Mar 05 21:02:29.074487 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1774/3622] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:27 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1334 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:29.077787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ea0d9853-5472-4a7a-97aa-34a0689b8232 req-f66b533e-056b-41cb-b18e-f1583ca1992b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2699fb15-7a83-401b-8297-3362938587a4", "name": "network-vif-plugged", "status": "completed", "tag": "263116ce-7cf0-48c8-869b-4be6ced13670"}, {"server_uuid": "e4aea58a-2255-4553-ae5e-3304f0a51c64", "name": "network-vif-plugged", "status": "completed", "tag": "f0dd87c2-bcd6-447a-8690-0daa7aa8f29b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:29.105445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ea0d9853-5472-4a7a-97aa-34a0689b8232 req-f66b533e-056b-41cb-b18e-f1583ca1992b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:29.106026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ea0d9853-5472-4a7a-97aa-34a0689b8232 req-f66b533e-056b-41cb-b18e-f1583ca1992b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:29.157937 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ea0d9853-5472-4a7a-97aa-34a0689b8232 req-f66b533e-056b-41cb-b18e-f1583ca1992b service nova] Creating event network-vif-plugged:263116ce-7cf0-48c8-869b-4be6ced13670 for instance 2699fb15-7a83-401b-8297-3362938587a4 on nch2-master-1 Mar 05 21:02:29.158653 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ea0d9853-5472-4a7a-97aa-34a0689b8232 req-f66b533e-056b-41cb-b18e-f1583ca1992b service nova] Creating event network-vif-plugged:f0dd87c2-bcd6-447a-8690-0daa7aa8f29b for instance e4aea58a-2255-4553-ae5e-3304f0a51c64 on nch1-master-1 Mar 05 21:02:29.178381 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ea0d9853-5472-4a7a-97aa-34a0689b8232 req-f66b533e-056b-41cb-b18e-f1583ca1992b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104361 Mar 05 21:02:29.181643 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1849/3623] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:29.264183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd4a1ca1-0fcb-4e5d-8ecb-baacbc692b4d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:29.265196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd4a1ca1-0fcb-4e5d-8ecb-baacbc692b4d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:29.310213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd4a1ca1-0fcb-4e5d-8ecb-baacbc692b4d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:29.311491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd4a1ca1-0fcb-4e5d-8ecb-baacbc692b4d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:29.318350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd4a1ca1-0fcb-4e5d-8ecb-baacbc692b4d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:29.319659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd4a1ca1-0fcb-4e5d-8ecb-baacbc692b4d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:29.695181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-28a7dfe2-ba5f-472f-a1e3-ad06387a9afa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:29.697307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-28a7dfe2-ba5f-472f-a1e3-ad06387a9afa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:29.723115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28a7dfe2-ba5f-472f-a1e3-ad06387a9afa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:29.723993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28a7dfe2-ba5f-472f-a1e3-ad06387a9afa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:29.727032 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28a7dfe2-ba5f-472f-a1e3-ad06387a9afa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:29.729855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28a7dfe2-ba5f-472f-a1e3-ad06387a9afa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:29.908878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd4a1ca1-0fcb-4e5d-8ecb-baacbc692b4d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:29.915321 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd4a1ca1-0fcb-4e5d-8ecb-baacbc692b4d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1363 microversion: 2.1 time: 0.656797 Mar 05 21:02:29.916101 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1775/3624] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:29 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1363 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:30.058264 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7eb18bdf-72c1-4118-9f7a-922f57b34efa req-8b8c469a-a207-46f4-9493-8f1f11f24807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc548a05-5226-41f0-a34d-1d44defee56c", "tag": "30ad7984-3b01-4aac-9f3b-d69f10ea737a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:30.072982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7eb18bdf-72c1-4118-9f7a-922f57b34efa req-8b8c469a-a207-46f4-9493-8f1f11f24807 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:30.073459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7eb18bdf-72c1-4118-9f7a-922f57b34efa req-8b8c469a-a207-46f4-9493-8f1f11f24807 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:30.095866 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7eb18bdf-72c1-4118-9f7a-922f57b34efa req-8b8c469a-a207-46f4-9493-8f1f11f24807 service nova] Creating event network-changed:30ad7984-3b01-4aac-9f3b-d69f10ea737a for instance dc548a05-5226-41f0-a34d-1d44defee56c on nch1-master-1 Mar 05 21:02:30.119013 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7eb18bdf-72c1-4118-9f7a-922f57b34efa req-8b8c469a-a207-46f4-9493-8f1f11f24807 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065409 Mar 05 21:02:30.120041 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1776/3625] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Mar 05 21:02:30.125679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-62b39ae0-df24-4dc9-9561-737949e97627 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:30.126412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-62b39ae0-df24-4dc9-9561-737949e97627 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:30.138436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62b39ae0-df24-4dc9-9561-737949e97627 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:30.144255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62b39ae0-df24-4dc9-9561-737949e97627 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:30.145392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62b39ae0-df24-4dc9-9561-737949e97627 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:30.146540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62b39ae0-df24-4dc9-9561-737949e97627 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:30.190907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-28a7dfe2-ba5f-472f-a1e3-ad06387a9afa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:30.220390 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-28a7dfe2-ba5f-472f-a1e3-ad06387a9afa tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1317 microversion: 2.1 time: 0.522048 Mar 05 21:02:30.221520 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1850/3626] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:29 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:30.232698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-36a68a3e-ee28-4ea2-b187-f976c4b54a71 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:30.238235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-36a68a3e-ee28-4ea2-b187-f976c4b54a71 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:30.251096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36a68a3e-ee28-4ea2-b187-f976c4b54a71 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:30.254109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36a68a3e-ee28-4ea2-b187-f976c4b54a71 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:30.255049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36a68a3e-ee28-4ea2-b187-f976c4b54a71 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:30.255584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36a68a3e-ee28-4ea2-b187-f976c4b54a71 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:30.439880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-62b39ae0-df24-4dc9-9561-737949e97627 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:30.454666 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-62b39ae0-df24-4dc9-9561-737949e97627 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1266 microversion: 2.1 time: 0.332715 Mar 05 21:02:30.456038 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1777/3627] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:30 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1266 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:30.760944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-36a68a3e-ee28-4ea2-b187-f976c4b54a71 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:30.774155 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-36a68a3e-ee28-4ea2-b187-f976c4b54a71 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1334 microversion: 2.1 time: 0.550849 Mar 05 21:02:30.787772 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1851/3628] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:30 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1334 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:30.936746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d812124a-a99b-457c-abef-4df4ceacb7a4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:30.937788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d812124a-a99b-457c-abef-4df4ceacb7a4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:30.965473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d812124a-a99b-457c-abef-4df4ceacb7a4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:30.967407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d812124a-a99b-457c-abef-4df4ceacb7a4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:30.968760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d812124a-a99b-457c-abef-4df4ceacb7a4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:30.969463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d812124a-a99b-457c-abef-4df4ceacb7a4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:31.244161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7a00abe1-32dc-456f-b198-3667852e67dc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:31.244659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7a00abe1-32dc-456f-b198-3667852e67dc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:31.262188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a00abe1-32dc-456f-b198-3667852e67dc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:31.263287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a00abe1-32dc-456f-b198-3667852e67dc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:31.264135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a00abe1-32dc-456f-b198-3667852e67dc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:31.270756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a00abe1-32dc-456f-b198-3667852e67dc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:31.490574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d812124a-a99b-457c-abef-4df4ceacb7a4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:31.515555 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d812124a-a99b-457c-abef-4df4ceacb7a4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1363 microversion: 2.1 time: 0.586632 Mar 05 21:02:31.539327 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1778/3629] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:30 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1363 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:31.550906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6213aa65-2f6e-4912-8c72-1ee2ecf8ea7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:31.553585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6213aa65-2f6e-4912-8c72-1ee2ecf8ea7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:31.569603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6213aa65-2f6e-4912-8c72-1ee2ecf8ea7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:31.570346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6213aa65-2f6e-4912-8c72-1ee2ecf8ea7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:31.571467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6213aa65-2f6e-4912-8c72-1ee2ecf8ea7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:31.575884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6213aa65-2f6e-4912-8c72-1ee2ecf8ea7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:31.626845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7a00abe1-32dc-456f-b198-3667852e67dc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:31.640355 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7a00abe1-32dc-456f-b198-3667852e67dc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1507 microversion: 2.1 time: 0.398905 Mar 05 21:02:31.652958 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1852/3630] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:31 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:31.661850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2d6ba81f-bf00-4f89-896e-c0a52dac4a6e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:31.666459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2d6ba81f-bf00-4f89-896e-c0a52dac4a6e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:31.673345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d6ba81f-bf00-4f89-896e-c0a52dac4a6e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:31.673810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d6ba81f-bf00-4f89-896e-c0a52dac4a6e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:31.674735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d6ba81f-bf00-4f89-896e-c0a52dac4a6e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:31.675181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d6ba81f-bf00-4f89-896e-c0a52dac4a6e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:31.915273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2d6ba81f-bf00-4f89-896e-c0a52dac4a6e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:31.927591 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2d6ba81f-bf00-4f89-896e-c0a52dac4a6e tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1507 microversion: 2.1 time: 0.270788 Mar 05 21:02:31.928248 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1853/3631] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:31 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:31.948891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a4d68b7b-eb6a-4647-af36-6b36eeaa18ab tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:31.949518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a4d68b7b-eb6a-4647-af36-6b36eeaa18ab tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:31.972887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4d68b7b-eb6a-4647-af36-6b36eeaa18ab tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:31.973696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4d68b7b-eb6a-4647-af36-6b36eeaa18ab tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:31.974725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4d68b7b-eb6a-4647-af36-6b36eeaa18ab tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:31.975381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4d68b7b-eb6a-4647-af36-6b36eeaa18ab tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:32.592769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6213aa65-2f6e-4912-8c72-1ee2ecf8ea7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:32.605114 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6213aa65-2f6e-4912-8c72-1ee2ecf8ea7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1308 microversion: 2.1 time: 1.063897 Mar 05 21:02:32.605719 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1779/3632] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:31 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1308 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:32.611905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-26a5681b-ecbe-4ca6-8703-54cb6d90731d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:32.613510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-26a5681b-ecbe-4ca6-8703-54cb6d90731d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:32.620499 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-26a5681b-ecbe-4ca6-8703-54cb6d90731d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:32.621251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-26a5681b-ecbe-4ca6-8703-54cb6d90731d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:32.623061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-26a5681b-ecbe-4ca6-8703-54cb6d90731d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:32.623916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-26a5681b-ecbe-4ca6-8703-54cb6d90731d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:32.716352 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-26a5681b-ecbe-4ca6-8703-54cb6d90731d tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "PUT /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1079 microversion: 2.1 time: 0.107220 Mar 05 21:02:32.718040 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1780/3633] 10.222.0.15 () {60 vars in 1255 bytes} [Sat Mar 5 21:02:32 2022] PUT /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1079 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:32.724363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-182ebb30-677b-49cc-8eed-59a3e0c2159d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:32.725923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-182ebb30-677b-49cc-8eed-59a3e0c2159d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:32.737668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-182ebb30-677b-49cc-8eed-59a3e0c2159d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:32.738134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-182ebb30-677b-49cc-8eed-59a3e0c2159d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:32.739397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-182ebb30-677b-49cc-8eed-59a3e0c2159d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:32.739913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-182ebb30-677b-49cc-8eed-59a3e0c2159d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:32.811702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a4d68b7b-eb6a-4647-af36-6b36eeaa18ab tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:32.821606 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a4d68b7b-eb6a-4647-af36-6b36eeaa18ab tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1670 microversion: 2.1 time: 0.880496 Mar 05 21:02:32.822950 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1854/3634] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:31 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1670 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:32.830073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8d01c608-5645-4253-90b9-6630d0e1c078 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:32.830805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8d01c608-5645-4253-90b9-6630d0e1c078 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:32.837697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d01c608-5645-4253-90b9-6630d0e1c078 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:32.838818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d01c608-5645-4253-90b9-6630d0e1c078 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:32.840383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d01c608-5645-4253-90b9-6630d0e1c078 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:32.841563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d01c608-5645-4253-90b9-6630d0e1c078 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.096607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8d01c608-5645-4253-90b9-6630d0e1c078 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:33.104514 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8d01c608-5645-4253-90b9-6630d0e1c078 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1505 microversion: 2.1 time: 0.280533 Mar 05 21:02:33.116009 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1855/3635] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:32 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:33.116009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5dfab557-7376-4763-ae3e-1276febf6427 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:33.116009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5dfab557-7376-4763-ae3e-1276febf6427 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:33.134650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dfab557-7376-4763-ae3e-1276febf6427 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.135465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dfab557-7376-4763-ae3e-1276febf6427 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.136870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dfab557-7376-4763-ae3e-1276febf6427 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.137799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5dfab557-7376-4763-ae3e-1276febf6427 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.175893 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5dfab557-7376-4763-ae3e-1276febf6427 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4/ips" status: 200 len: 180 microversion: 2.1 time: 0.068119 Mar 05 21:02:33.177016 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1856/3636] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 21:02:33 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4/ips => generated 180 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:33.182490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-17275fc8-a3b0-4af6-a30a-46b2bff32838 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:33.183207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-17275fc8-a3b0-4af6-a30a-46b2bff32838 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:33.192882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17275fc8-a3b0-4af6-a30a-46b2bff32838 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.193496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17275fc8-a3b0-4af6-a30a-46b2bff32838 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.194614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17275fc8-a3b0-4af6-a30a-46b2bff32838 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.195141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17275fc8-a3b0-4af6-a30a-46b2bff32838 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.421606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-182ebb30-677b-49cc-8eed-59a3e0c2159d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:33.439621 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-182ebb30-677b-49cc-8eed-59a3e0c2159d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1363 microversion: 2.1 time: 0.720105 Mar 05 21:02:33.440599 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1781/3637] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:32 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1363 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:33.442273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-17275fc8-a3b0-4af6-a30a-46b2bff32838 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:33.446009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-398ff377-1bec-4a31-9fe0-635840defde1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:33.447511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-398ff377-1bec-4a31-9fe0-635840defde1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:33.455158 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-17275fc8-a3b0-4af6-a30a-46b2bff32838 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1505 microversion: 2.1 time: 0.276929 Mar 05 21:02:33.467896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-398ff377-1bec-4a31-9fe0-635840defde1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.467896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-398ff377-1bec-4a31-9fe0-635840defde1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.468360 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1857/3638] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:33 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:33.468459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-398ff377-1bec-4a31-9fe0-635840defde1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.468459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-398ff377-1bec-4a31-9fe0-635840defde1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.483495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2f5d288c-2399-428d-afef-8d3404e88c24 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:33.484745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2f5d288c-2399-428d-afef-8d3404e88c24 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:33.490897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f5d288c-2399-428d-afef-8d3404e88c24 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.491984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f5d288c-2399-428d-afef-8d3404e88c24 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.492809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f5d288c-2399-428d-afef-8d3404e88c24 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.493258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f5d288c-2399-428d-afef-8d3404e88c24 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.509304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-398ff377-1bec-4a31-9fe0-635840defde1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:02:33.571706 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2f5d288c-2399-428d-afef-8d3404e88c24 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "PUT /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1081 microversion: 2.1 time: 0.100492 Mar 05 21:02:33.573336 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1858/3639] 10.222.0.15 () {60 vars in 1255 bytes} [Sat Mar 5 21:02:33 2022] PUT /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1081 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:33.587215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-224dbaf2-700f-45bd-893e-ad353babde80 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:33.588378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-224dbaf2-700f-45bd-893e-ad353babde80 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:33.595646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-224dbaf2-700f-45bd-893e-ad353babde80 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.596625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-224dbaf2-700f-45bd-893e-ad353babde80 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.597509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-224dbaf2-700f-45bd-893e-ad353babde80 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.598003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-224dbaf2-700f-45bd-893e-ad353babde80 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.647721 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-398ff377-1bec-4a31-9fe0-635840defde1 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 204 len: 0 microversion: 2.1 time: 0.205671 Mar 05 21:02:33.652144 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1782/3640] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:02:33 2022] DELETE /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:02:33.659001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4ec07686-e10c-4643-beb8-fef76925559c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:33.660004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4ec07686-e10c-4643-beb8-fef76925559c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:33.667036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ec07686-e10c-4643-beb8-fef76925559c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.667658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ec07686-e10c-4643-beb8-fef76925559c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.668479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ec07686-e10c-4643-beb8-fef76925559c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.669512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ec07686-e10c-4643-beb8-fef76925559c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.759481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-224dbaf2-700f-45bd-893e-ad353babde80 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:33.768098 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-224dbaf2-700f-45bd-893e-ad353babde80 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1507 microversion: 2.1 time: 0.185296 Mar 05 21:02:33.769137 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1859/3641] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:33 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:33.774721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7a904ae9-fc27-4e74-bbfc-d8f1eb87b03e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:33.775766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7a904ae9-fc27-4e74-bbfc-d8f1eb87b03e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:33.785419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a904ae9-fc27-4e74-bbfc-d8f1eb87b03e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.785419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a904ae9-fc27-4e74-bbfc-d8f1eb87b03e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:33.786258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a904ae9-fc27-4e74-bbfc-d8f1eb87b03e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:33.787075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a904ae9-fc27-4e74-bbfc-d8f1eb87b03e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:34.010456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7a904ae9-fc27-4e74-bbfc-d8f1eb87b03e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:34.025529 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7a904ae9-fc27-4e74-bbfc-d8f1eb87b03e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1676 microversion: 2.1 time: 0.255279 Mar 05 21:02:34.035858 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1860/3642] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:33 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1676 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:34.046278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4870ec36-0313-4ab0-bd73-2067e7963a23 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:34.048189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4870ec36-0313-4ab0-bd73-2067e7963a23 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:34.059782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4870ec36-0313-4ab0-bd73-2067e7963a23 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:34.060962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4870ec36-0313-4ab0-bd73-2067e7963a23 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:34.061991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4870ec36-0313-4ab0-bd73-2067e7963a23 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:34.062628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4870ec36-0313-4ab0-bd73-2067e7963a23 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:34.173247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4ec07686-e10c-4643-beb8-fef76925559c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:34.182652 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4ec07686-e10c-4643-beb8-fef76925559c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1308 microversion: 2.1 time: 0.528308 Mar 05 21:02:34.183252 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1783/3643] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:33 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1308 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:34.246858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5d1a31f7-e675-4b67-b602-34973c711b4c req-b34caea5-f73d-4039-baa4-879f59e2ea7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da80a66d-faa9-4917-9003-758b0a8933b2", "tag": "14c74fe6-8707-41b9-b1e6-fc064c42d3e5"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:34.256947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5d1a31f7-e675-4b67-b602-34973c711b4c req-b34caea5-f73d-4039-baa4-879f59e2ea7a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:34.257683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5d1a31f7-e675-4b67-b602-34973c711b4c req-b34caea5-f73d-4039-baa4-879f59e2ea7a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:34.298552 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-5d1a31f7-e675-4b67-b602-34973c711b4c req-b34caea5-f73d-4039-baa4-879f59e2ea7a service nova] Creating event network-changed:14c74fe6-8707-41b9-b1e6-fc064c42d3e5 for instance da80a66d-faa9-4917-9003-758b0a8933b2 on nch2-master-1 Mar 05 21:02:34.313951 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5d1a31f7-e675-4b67-b602-34973c711b4c req-b34caea5-f73d-4039-baa4-879f59e2ea7a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070839 Mar 05 21:02:34.315809 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1784/3644] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:02:34.461300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-922c03ff-553a-4090-9ba8-b5755c3c8932 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:34.462192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-922c03ff-553a-4090-9ba8-b5755c3c8932 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:34.472049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-922c03ff-553a-4090-9ba8-b5755c3c8932 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:34.476117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-922c03ff-553a-4090-9ba8-b5755c3c8932 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:34.477091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-922c03ff-553a-4090-9ba8-b5755c3c8932 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:34.478952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-922c03ff-553a-4090-9ba8-b5755c3c8932 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:34.612273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4870ec36-0313-4ab0-bd73-2067e7963a23 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:34.626455 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4870ec36-0313-4ab0-bd73-2067e7963a23 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1507 microversion: 2.1 time: 0.583755 Mar 05 21:02:34.627294 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1861/3645] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:34 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1507 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:34.647161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f9a4370b-ed33-4857-bd6d-44df34d4ade9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:34.647711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f9a4370b-ed33-4857-bd6d-44df34d4ade9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:34.659231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9a4370b-ed33-4857-bd6d-44df34d4ade9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:34.660429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9a4370b-ed33-4857-bd6d-44df34d4ade9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:34.661741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9a4370b-ed33-4857-bd6d-44df34d4ade9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:34.662354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9a4370b-ed33-4857-bd6d-44df34d4ade9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:34.708298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f9a4370b-ed33-4857-bd6d-44df34d4ade9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:02:34.837283 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f9a4370b-ed33-4857-bd6d-44df34d4ade9 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 204 len: 0 microversion: 2.1 time: 0.194724 Mar 05 21:02:34.838203 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1862/3646] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:02:34 2022] DELETE /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:02:34.865003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-718e1ab2-d387-40f0-bf3a-23733738b222 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:34.865884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-718e1ab2-d387-40f0-bf3a-23733738b222 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:34.875139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-718e1ab2-d387-40f0-bf3a-23733738b222 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:34.875996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-718e1ab2-d387-40f0-bf3a-23733738b222 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:34.877172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-718e1ab2-d387-40f0-bf3a-23733738b222 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:34.877784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-718e1ab2-d387-40f0-bf3a-23733738b222 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:34.957437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-718e1ab2-d387-40f0-bf3a-23733738b222 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:02:34.993459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-922c03ff-553a-4090-9ba8-b5755c3c8932 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:35.009167 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-922c03ff-553a-4090-9ba8-b5755c3c8932 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1363 microversion: 2.1 time: 0.551820 Mar 05 21:02:35.018836 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1785/3647] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:34 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1363 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:35.042660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e32591c1-74ca-4910-9017-c5aa7665d11e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:35.043301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e32591c1-74ca-4910-9017-c5aa7665d11e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:35.057770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e32591c1-74ca-4910-9017-c5aa7665d11e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:35.060737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e32591c1-74ca-4910-9017-c5aa7665d11e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:35.061774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e32591c1-74ca-4910-9017-c5aa7665d11e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:35.064308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e32591c1-74ca-4910-9017-c5aa7665d11e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:35.073167 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.compute.api [None req-718e1ab2-d387-40f0-bf3a-23733738b222 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Instance is already in deleting state, ignoring this request Mar 05 21:02:35.074527 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-718e1ab2-d387-40f0-bf3a-23733738b222 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 204 len: 0 microversion: 2.1 time: 0.220219 Mar 05 21:02:35.076121 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1863/3648] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:02:34 2022] DELETE /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:02:35.086768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0fb7552c-b367-487f-9592-14f17622b66c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:35.087415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0fb7552c-b367-487f-9592-14f17622b66c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:35.096733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fb7552c-b367-487f-9592-14f17622b66c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:35.097734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fb7552c-b367-487f-9592-14f17622b66c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:35.098746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fb7552c-b367-487f-9592-14f17622b66c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:35.099505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fb7552c-b367-487f-9592-14f17622b66c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:35.556774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0fb7552c-b367-487f-9592-14f17622b66c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:35.568830 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0fb7552c-b367-487f-9592-14f17622b66c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1513 microversion: 2.1 time: 0.488771 Mar 05 21:02:35.580267 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1864/3649] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:35 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1513 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:35.594890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1e9948ed-3648-4ef7-bb9c-5c575463e1a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:35.595493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1e9948ed-3648-4ef7-bb9c-5c575463e1a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:35.605554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e9948ed-3648-4ef7-bb9c-5c575463e1a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:35.607116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e9948ed-3648-4ef7-bb9c-5c575463e1a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:35.607979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e9948ed-3648-4ef7-bb9c-5c575463e1a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:35.608556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e9948ed-3648-4ef7-bb9c-5c575463e1a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:35.899753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e32591c1-74ca-4910-9017-c5aa7665d11e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:35.914282 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e32591c1-74ca-4910-9017-c5aa7665d11e tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1676 microversion: 2.1 time: 0.873560 Mar 05 21:02:35.916147 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1786/3650] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:35 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1676 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:36.092359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b434ed5b-1df5-4491-bf95-ef3e578678ea tempest-FloatingIPsNegativeTestJSON-1098745155 tempest-FloatingIPsNegativeTestJSON-1098745155-project] Calling method '.version_select at 0x7fed61b308b0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:36.119059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1e9948ed-3648-4ef7-bb9c-5c575463e1a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:36.128100 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1e9948ed-3648-4ef7-bb9c-5c575463e1a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1308 microversion: 2.1 time: 0.537861 Mar 05 21:02:36.128707 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1865/3651] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:35 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1308 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:36.144020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dbe4b412-efa7-4aad-acb0-a4476d4c64fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:36.144899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dbe4b412-efa7-4aad-acb0-a4476d4c64fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:36.161035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dbe4b412-efa7-4aad-acb0-a4476d4c64fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:36.161715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dbe4b412-efa7-4aad-acb0-a4476d4c64fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:36.163243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dbe4b412-efa7-4aad-acb0-a4476d4c64fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:36.166021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dbe4b412-efa7-4aad-acb0-a4476d4c64fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:36.218196 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b434ed5b-1df5-4491-bf95-ef3e578678ea tempest-FloatingIPsNegativeTestJSON-1098745155 tempest-FloatingIPsNegativeTestJSON-1098745155-project] 10.222.0.15 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.297939 Mar 05 21:02:36.219461 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1787/3652] 10.222.0.15 () {58 vars in 1148 bytes} [Sat Mar 5 21:02:35 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:02:36.235170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f641c2f-0a93-43ad-92cf-e87449e15701 tempest-FloatingIPsNegativeTestJSON-1098745155 tempest-FloatingIPsNegativeTestJSON-1098745155-project] Action: 'create', calling method: .version_select at 0x7fed61b5fd30>, body: {"pool": "non_exist_pool"} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:36.318681 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-5f641c2f-0a93-43ad-92cf-e87449e15701 tempest-FloatingIPsNegativeTestJSON-1098745155 tempest-FloatingIPsNegativeTestJSON-1098745155-project] HTTP exception thrown: Floating IP pool not found. Mar 05 21:02:36.320468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f641c2f-0a93-43ad-92cf-e87449e15701 tempest-FloatingIPsNegativeTestJSON-1098745155 tempest-FloatingIPsNegativeTestJSON-1098745155-project] Returning 404 to user: Floating IP pool not found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:36.321679 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5f641c2f-0a93-43ad-92cf-e87449e15701 tempest-FloatingIPsNegativeTestJSON-1098745155 tempest-FloatingIPsNegativeTestJSON-1098745155-project] 10.222.0.15 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.094884 Mar 05 21:02:36.322845 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1788/3653] 10.222.0.15 () {60 vars in 1169 bytes} [Sat Mar 5 21:02:36 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:02:36.334928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3ab70246-6ad9-49d3-b8bc-f50a6bcf7d46 tempest-FloatingIPsNegativeTestJSON-1098745155 tempest-FloatingIPsNegativeTestJSON-1098745155-project] Calling method '.version_select at 0x7fed61ace790>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:36.468064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-3ab70246-6ad9-49d3-b8bc-f50a6bcf7d46 tempest-FloatingIPsNegativeTestJSON-1098745155 tempest-FloatingIPsNegativeTestJSON-1098745155-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4edde962-9abd-4f90-9769-2ae7b16a3b61 could not be found", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 21:02:36.468783 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-3ab70246-6ad9-49d3-b8bc-f50a6bcf7d46 tempest-FloatingIPsNegativeTestJSON-1098745155 tempest-FloatingIPsNegativeTestJSON-1098745155-project] HTTP exception thrown: Floating IP not found for ID 4edde962-9abd-4f90-9769-2ae7b16a3b61 Mar 05 21:02:36.469392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3ab70246-6ad9-49d3-b8bc-f50a6bcf7d46 tempest-FloatingIPsNegativeTestJSON-1098745155 tempest-FloatingIPsNegativeTestJSON-1098745155-project] Returning 404 to user: Floating IP not found for ID 4edde962-9abd-4f90-9769-2ae7b16a3b61 {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:36.470254 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3ab70246-6ad9-49d3-b8bc-f50a6bcf7d46 tempest-FloatingIPsNegativeTestJSON-1098745155 tempest-FloatingIPsNegativeTestJSON-1098745155-project] 10.222.0.15 "DELETE /compute/v2.1/os-floating-ips/4edde962-9abd-4f90-9769-2ae7b16a3b61" status: 404 len: 111 microversion: 2.1 time: 0.139816 Mar 05 21:02:36.470841 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1789/3654] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 21:02:36 2022] DELETE /compute/v2.1/os-floating-ips/4edde962-9abd-4f90-9769-2ae7b16a3b61 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:02:36.570252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-434b4269-2069-458c-a3ff-b12832b7975c req-6b4521d4-1916-46d7-85ef-e38421e9ef37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2699fb15-7a83-401b-8297-3362938587a4", "name": "network-vif-deleted", "tag": "dbb1a5c5-a42b-4b22-99f4-682427abb4bb"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:36.588333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-434b4269-2069-458c-a3ff-b12832b7975c req-6b4521d4-1916-46d7-85ef-e38421e9ef37 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:36.588795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-434b4269-2069-458c-a3ff-b12832b7975c req-6b4521d4-1916-46d7-85ef-e38421e9ef37 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:36.624252 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-434b4269-2069-458c-a3ff-b12832b7975c req-6b4521d4-1916-46d7-85ef-e38421e9ef37 service nova] Creating event network-vif-deleted:dbb1a5c5-a42b-4b22-99f4-682427abb4bb for instance 2699fb15-7a83-401b-8297-3362938587a4 on nch2-master-1 Mar 05 21:02:36.637743 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-434b4269-2069-458c-a3ff-b12832b7975c req-6b4521d4-1916-46d7-85ef-e38421e9ef37 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072181 Mar 05 21:02:36.638731 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1790/3655] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:36.644197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8cd7d039-e8f0-4928-9797-a3e172dd0765 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:36.645183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8cd7d039-e8f0-4928-9797-a3e172dd0765 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:36.666618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cd7d039-e8f0-4928-9797-a3e172dd0765 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:36.667118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cd7d039-e8f0-4928-9797-a3e172dd0765 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:36.667952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cd7d039-e8f0-4928-9797-a3e172dd0765 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:36.668396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cd7d039-e8f0-4928-9797-a3e172dd0765 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:37.085572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8cd7d039-e8f0-4928-9797-a3e172dd0765 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc62e97c4f024cd183c380c0be7b4a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa686c12d54e49ceaa2ce991119294e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:37.096636 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8cd7d039-e8f0-4928-9797-a3e172dd0765 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 200 len: 1513 microversion: 2.1 time: 0.456643 Mar 05 21:02:37.109751 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1791/3656] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:36 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 1513 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:37.117587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f1dba16-97ee-4a5a-b82a-23a4323a45aa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:37.118480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5f1dba16-97ee-4a5a-b82a-23a4323a45aa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:37.126643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f1dba16-97ee-4a5a-b82a-23a4323a45aa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:37.127970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f1dba16-97ee-4a5a-b82a-23a4323a45aa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:37.130899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f1dba16-97ee-4a5a-b82a-23a4323a45aa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:37.131551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f1dba16-97ee-4a5a-b82a-23a4323a45aa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:37.208664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dbe4b412-efa7-4aad-acb0-a4476d4c64fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:37.217876 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dbe4b412-efa7-4aad-acb0-a4476d4c64fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1363 microversion: 2.1 time: 1.078025 Mar 05 21:02:37.218945 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1866/3657] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:36 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1363 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:37.224076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8d1c2fc6-1541-4560-a93b-26bd92ce9261 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:37.224898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8d1c2fc6-1541-4560-a93b-26bd92ce9261 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:37.232613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d1c2fc6-1541-4560-a93b-26bd92ce9261 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:37.233506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d1c2fc6-1541-4560-a93b-26bd92ce9261 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:37.234485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d1c2fc6-1541-4560-a93b-26bd92ce9261 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:37.235089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d1c2fc6-1541-4560-a93b-26bd92ce9261 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:37.470561 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5f1dba16-97ee-4a5a-b82a-23a4323a45aa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:37.493603 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5f1dba16-97ee-4a5a-b82a-23a4323a45aa tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1496 microversion: 2.1 time: 0.382067 Mar 05 21:02:37.494213 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1792/3658] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:37 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1496 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:37.499472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-48e1daff-a96a-4efe-94f2-a14b98a4809e req-61f84353-0912-42d6-a4d6-0e4e92af501a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4aea58a-2255-4553-ae5e-3304f0a51c64", "name": "network-vif-deleted", "tag": "f0dd87c2-bcd6-447a-8690-0daa7aa8f29b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:37.520674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-48e1daff-a96a-4efe-94f2-a14b98a4809e req-61f84353-0912-42d6-a4d6-0e4e92af501a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:37.521440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-48e1daff-a96a-4efe-94f2-a14b98a4809e req-61f84353-0912-42d6-a4d6-0e4e92af501a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:37.535833 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-48e1daff-a96a-4efe-94f2-a14b98a4809e req-61f84353-0912-42d6-a4d6-0e4e92af501a service nova] Creating event network-vif-deleted:f0dd87c2-bcd6-447a-8690-0daa7aa8f29b for instance e4aea58a-2255-4553-ae5e-3304f0a51c64 on nch1-master-1 Mar 05 21:02:37.542853 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-48e1daff-a96a-4efe-94f2-a14b98a4809e req-61f84353-0912-42d6-a4d6-0e4e92af501a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047215 Mar 05 21:02:37.550326 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1793/3659] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:37.860223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8d1c2fc6-1541-4560-a93b-26bd92ce9261 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:37.872535 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8d1c2fc6-1541-4560-a93b-26bd92ce9261 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1308 microversion: 2.1 time: 0.652068 Mar 05 21:02:37.882265 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1867/3660] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:37 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1308 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:38.118965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9467db5f-85c0-4516-9924-8966050092cc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:38.120079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9467db5f-85c0-4516-9924-8966050092cc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: e4aea58a-2255-4553-ae5e-3304f0a51c64] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:38.135402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9467db5f-85c0-4516-9924-8966050092cc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.136078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9467db5f-85c0-4516-9924-8966050092cc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.139014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9467db5f-85c0-4516-9924-8966050092cc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.140361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9467db5f-85c0-4516-9924-8966050092cc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.188992 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-9467db5f-85c0-4516-9924-8966050092cc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] HTTP exception thrown: Instance e4aea58a-2255-4553-ae5e-3304f0a51c64 could not be found. Mar 05 21:02:38.189872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9467db5f-85c0-4516-9924-8966050092cc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Returning 404 to user: Instance e4aea58a-2255-4553-ae5e-3304f0a51c64 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:38.200765 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9467db5f-85c0-4516-9924-8966050092cc tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64" status: 404 len: 111 microversion: 2.1 time: 0.077928 Mar 05 21:02:38.200765 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1794/3661] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:38 2022] GET /compute/v2.1/servers/e4aea58a-2255-4553-ae5e-3304f0a51c64 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:02:38.226805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5cd6f943-e6b3-435a-8656-11efd75dab5b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:38.235891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5cd6f943-e6b3-435a-8656-11efd75dab5b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:38.236056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ab7af1ec-f53b-4d8b-8d3e-b13900cea386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:38.236056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ab7af1ec-f53b-4d8b-8d3e-b13900cea386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:38.238726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cd6f943-e6b3-435a-8656-11efd75dab5b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.239762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cd6f943-e6b3-435a-8656-11efd75dab5b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.243773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab7af1ec-f53b-4d8b-8d3e-b13900cea386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.248730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cd6f943-e6b3-435a-8656-11efd75dab5b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.249473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab7af1ec-f53b-4d8b-8d3e-b13900cea386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.250038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cd6f943-e6b3-435a-8656-11efd75dab5b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.252237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab7af1ec-f53b-4d8b-8d3e-b13900cea386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.253388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab7af1ec-f53b-4d8b-8d3e-b13900cea386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.285390 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-5cd6f943-e6b3-435a-8656-11efd75dab5b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] HTTP exception thrown: Instance 407e6bab-ea50-48db-a853-4190fadf8e50 could not be found. Mar 05 21:02:38.286660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5cd6f943-e6b3-435a-8656-11efd75dab5b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Returning 404 to user: Instance 407e6bab-ea50-48db-a853-4190fadf8e50 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:38.287797 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5cd6f943-e6b3-435a-8656-11efd75dab5b tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "DELETE /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 404 len: 111 microversion: 2.1 time: 0.081399 Mar 05 21:02:38.290463 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1868/3662] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:02:38 2022] DELETE /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:02:38.323451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-51449f7e-bc18-42f8-b849-ded10778fa67 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:38.328299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-51449f7e-bc18-42f8-b849-ded10778fa67 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 407e6bab-ea50-48db-a853-4190fadf8e50] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:38.334909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51449f7e-bc18-42f8-b849-ded10778fa67 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.335754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51449f7e-bc18-42f8-b849-ded10778fa67 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.337345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51449f7e-bc18-42f8-b849-ded10778fa67 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.338031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51449f7e-bc18-42f8-b849-ded10778fa67 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.366626 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-51449f7e-bc18-42f8-b849-ded10778fa67 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] HTTP exception thrown: Instance 407e6bab-ea50-48db-a853-4190fadf8e50 could not be found. Mar 05 21:02:38.373463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-51449f7e-bc18-42f8-b849-ded10778fa67 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Returning 404 to user: Instance 407e6bab-ea50-48db-a853-4190fadf8e50 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:38.374755 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-51449f7e-bc18-42f8-b849-ded10778fa67 tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50" status: 404 len: 111 microversion: 2.1 time: 0.081353 Mar 05 21:02:38.375977 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1869/3663] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:38 2022] GET /compute/v2.1/servers/407e6bab-ea50-48db-a853-4190fadf8e50 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:02:38.385452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d7dada1f-345a-45b6-944a-01ad748425dd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:38.388241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d7dada1f-345a-45b6-944a-01ad748425dd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:38.397688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7dada1f-345a-45b6-944a-01ad748425dd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.399405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7dada1f-345a-45b6-944a-01ad748425dd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.401978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7dada1f-345a-45b6-944a-01ad748425dd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.402697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7dada1f-345a-45b6-944a-01ad748425dd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.434475 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-d7dada1f-345a-45b6-944a-01ad748425dd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] HTTP exception thrown: Instance 9f0ba2b9-85e8-4b78-91be-461650cff33f could not be found. Mar 05 21:02:38.434984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d7dada1f-345a-45b6-944a-01ad748425dd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Returning 404 to user: Instance 9f0ba2b9-85e8-4b78-91be-461650cff33f could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:38.436379 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d7dada1f-345a-45b6-944a-01ad748425dd tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 404 len: 111 microversion: 2.1 time: 0.056719 Mar 05 21:02:38.437810 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1870/3664] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:02:38 2022] DELETE /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:02:38.450410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-51d644e6-ae7f-4acc-b0d2-dd23551f3f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:38.451868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-51d644e6-ae7f-4acc-b0d2-dd23551f3f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] [instance: 9f0ba2b9-85e8-4b78-91be-461650cff33f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:38.462910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51d644e6-ae7f-4acc-b0d2-dd23551f3f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.464342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51d644e6-ae7f-4acc-b0d2-dd23551f3f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.466130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51d644e6-ae7f-4acc-b0d2-dd23551f3f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.467469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-51d644e6-ae7f-4acc-b0d2-dd23551f3f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.490729 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-51d644e6-ae7f-4acc-b0d2-dd23551f3f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] HTTP exception thrown: Instance 9f0ba2b9-85e8-4b78-91be-461650cff33f could not be found. Mar 05 21:02:38.492789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-51d644e6-ae7f-4acc-b0d2-dd23551f3f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] Returning 404 to user: Instance 9f0ba2b9-85e8-4b78-91be-461650cff33f could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:38.493932 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-51d644e6-ae7f-4acc-b0d2-dd23551f3f2c tempest-ServerDiskConfigTestJSON-1384489475 tempest-ServerDiskConfigTestJSON-1384489475-project] 10.222.0.15 "GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f" status: 404 len: 111 microversion: 2.1 time: 0.049327 Mar 05 21:02:38.495402 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1871/3665] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:38 2022] GET /compute/v2.1/servers/9f0ba2b9-85e8-4b78-91be-461650cff33f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:02:38.517130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c4b54cf5-df25-4dc4-805f-76191c4f67a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:38.520741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c4b54cf5-df25-4dc4-805f-76191c4f67a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:38.544048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4b54cf5-df25-4dc4-805f-76191c4f67a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.545299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4b54cf5-df25-4dc4-805f-76191c4f67a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.547616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4b54cf5-df25-4dc4-805f-76191c4f67a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.549949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4b54cf5-df25-4dc4-805f-76191c4f67a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.575462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ab7af1ec-f53b-4d8b-8d3e-b13900cea386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:38.586285 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ab7af1ec-f53b-4d8b-8d3e-b13900cea386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1363 microversion: 2.1 time: 0.355541 Mar 05 21:02:38.587900 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1795/3666] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:38 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:38.691826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c4b54cf5-df25-4dc4-805f-76191c4f67a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5654ba611fb14b5ba8ead5c3b331522a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cdb6564d9b940f4b35211e858ba1bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:38.699596 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c4b54cf5-df25-4dc4-805f-76191c4f67a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 200 len: 1454 microversion: 2.1 time: 0.190379 Mar 05 21:02:38.700584 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1872/3667] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:38 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 1454 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:38.851018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-0a0fefaf-c8f8-4ee2-b902-f4e5330b3056 req-2b3a7d66-fcfb-4126-868a-d7fa4f6eb015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2699fb15-7a83-401b-8297-3362938587a4", "name": "network-vif-deleted", "tag": "263116ce-7cf0-48c8-869b-4be6ced13670"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:38.870040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-0a0fefaf-c8f8-4ee2-b902-f4e5330b3056 req-2b3a7d66-fcfb-4126-868a-d7fa4f6eb015 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.870789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-0a0fefaf-c8f8-4ee2-b902-f4e5330b3056 req-2b3a7d66-fcfb-4126-868a-d7fa4f6eb015 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.886933 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-0a0fefaf-c8f8-4ee2-b902-f4e5330b3056 req-2b3a7d66-fcfb-4126-868a-d7fa4f6eb015 service nova] Creating event network-vif-deleted:263116ce-7cf0-48c8-869b-4be6ced13670 for instance 2699fb15-7a83-401b-8297-3362938587a4 on nch2-master-1 Mar 05 21:02:38.892857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c6b4fd52-77a9-4de7-a4c9-6dee0efba965 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:38.893563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c6b4fd52-77a9-4de7-a4c9-6dee0efba965 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:38.896068 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-0a0fefaf-c8f8-4ee2-b902-f4e5330b3056 req-2b3a7d66-fcfb-4126-868a-d7fa4f6eb015 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048681 Mar 05 21:02:38.897176 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1796/3668] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:38.912439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6b4fd52-77a9-4de7-a4c9-6dee0efba965 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.912901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6b4fd52-77a9-4de7-a4c9-6dee0efba965 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:38.917066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6b4fd52-77a9-4de7-a4c9-6dee0efba965 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:38.919578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6b4fd52-77a9-4de7-a4c9-6dee0efba965 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:39.092549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5b5fefa9-e8b1-4765-96b5-d2e694846980 req-6472c35d-3f67-4e81-b0ab-5d40cf90fb9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc548a05-5226-41f0-a34d-1d44defee56c", "name": "network-vif-plugged", "status": "completed", "tag": "30ad7984-3b01-4aac-9f3b-d69f10ea737a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:39.104756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5b5fefa9-e8b1-4765-96b5-d2e694846980 req-6472c35d-3f67-4e81-b0ab-5d40cf90fb9c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:39.105554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5b5fefa9-e8b1-4765-96b5-d2e694846980 req-6472c35d-3f67-4e81-b0ab-5d40cf90fb9c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:39.132967 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-5b5fefa9-e8b1-4765-96b5-d2e694846980 req-6472c35d-3f67-4e81-b0ab-5d40cf90fb9c service nova] Creating event network-vif-plugged:30ad7984-3b01-4aac-9f3b-d69f10ea737a for instance dc548a05-5226-41f0-a34d-1d44defee56c on nch1-master-1 Mar 05 21:02:39.144430 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5b5fefa9-e8b1-4765-96b5-d2e694846980 req-6472c35d-3f67-4e81-b0ab-5d40cf90fb9c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056159 Mar 05 21:02:39.145759 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1797/3669] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:02:39.615385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-83d3571b-738d-4c6f-a9a2-b3f74ca8611f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:39.616138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-83d3571b-738d-4c6f-a9a2-b3f74ca8611f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:39.626792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-83d3571b-738d-4c6f-a9a2-b3f74ca8611f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:39.627257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-83d3571b-738d-4c6f-a9a2-b3f74ca8611f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:39.628667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-83d3571b-738d-4c6f-a9a2-b3f74ca8611f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:39.629117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-83d3571b-738d-4c6f-a9a2-b3f74ca8611f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:39.709774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c6b4fd52-77a9-4de7-a4c9-6dee0efba965 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:39.738406 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c6b4fd52-77a9-4de7-a4c9-6dee0efba965 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1308 microversion: 2.1 time: 0.852229 Mar 05 21:02:39.739031 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1873/3670] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:38 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1308 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:39.743653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-791a57cb-177b-437a-b1fd-ed3c7448bb95 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:39.755504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-791a57cb-177b-437a-b1fd-ed3c7448bb95 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:39.770669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-791a57cb-177b-437a-b1fd-ed3c7448bb95 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:39.771214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-791a57cb-177b-437a-b1fd-ed3c7448bb95 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:39.772100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-791a57cb-177b-437a-b1fd-ed3c7448bb95 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:39.772546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-791a57cb-177b-437a-b1fd-ed3c7448bb95 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:39.813573 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-791a57cb-177b-437a-b1fd-ed3c7448bb95 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] HTTP exception thrown: Instance 2699fb15-7a83-401b-8297-3362938587a4 could not be found. Mar 05 21:02:39.814337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-791a57cb-177b-437a-b1fd-ed3c7448bb95 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Returning 404 to user: Instance 2699fb15-7a83-401b-8297-3362938587a4 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:39.818517 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-791a57cb-177b-437a-b1fd-ed3c7448bb95 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 404 len: 111 microversion: 2.1 time: 0.078436 Mar 05 21:02:39.819123 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1874/3671] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:39 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:02:40.110136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-83d3571b-738d-4c6f-a9a2-b3f74ca8611f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:40.118780 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-83d3571b-738d-4c6f-a9a2-b3f74ca8611f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1363 microversion: 2.1 time: 0.518499 Mar 05 21:02:40.127996 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1798/3672] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:39 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1363 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:40.755202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-57b6ad05-5215-415e-8990-48939ffd5634 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:40.756054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-57b6ad05-5215-415e-8990-48939ffd5634 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:40.772358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57b6ad05-5215-415e-8990-48939ffd5634 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:40.774022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57b6ad05-5215-415e-8990-48939ffd5634 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:40.774873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57b6ad05-5215-415e-8990-48939ffd5634 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:40.777741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-57b6ad05-5215-415e-8990-48939ffd5634 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:41.144162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ce2cc569-d994-4272-9137-c039d1a977f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:41.145855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ce2cc569-d994-4272-9137-c039d1a977f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:41.157650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce2cc569-d994-4272-9137-c039d1a977f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:41.162191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce2cc569-d994-4272-9137-c039d1a977f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:41.163453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce2cc569-d994-4272-9137-c039d1a977f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:41.164198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce2cc569-d994-4272-9137-c039d1a977f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:41.397693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-57b6ad05-5215-415e-8990-48939ffd5634 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:41.419219 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-57b6ad05-5215-415e-8990-48939ffd5634 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1308 microversion: 2.1 time: 0.666549 Mar 05 21:02:41.423035 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1875/3673] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:40 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1308 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:41.661723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ce2cc569-d994-4272-9137-c039d1a977f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:41.672090 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ce2cc569-d994-4272-9137-c039d1a977f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1550 microversion: 2.1 time: 0.535302 Mar 05 21:02:41.673582 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1799/3674] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:41 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1550 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:41.694566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c470e507-971d-4f05-89f0-e550470c1e6d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:41.697121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c470e507-971d-4f05-89f0-e550470c1e6d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:41.709658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c470e507-971d-4f05-89f0-e550470c1e6d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:41.711650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c470e507-971d-4f05-89f0-e550470c1e6d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:41.712907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c470e507-971d-4f05-89f0-e550470c1e6d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:41.713451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c470e507-971d-4f05-89f0-e550470c1e6d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:41.813658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-6dae1291-eaf0-456b-a29d-c5ba7e8b698a req-6dc0f4ff-180b-4cd0-ad52-cf00b2d88ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da80a66d-faa9-4917-9003-758b0a8933b2", "name": "network-vif-plugged", "status": "completed", "tag": "14c74fe6-8707-41b9-b1e6-fc064c42d3e5"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:41.832443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6dae1291-eaf0-456b-a29d-c5ba7e8b698a req-6dc0f4ff-180b-4cd0-ad52-cf00b2d88ec9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:41.847170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6dae1291-eaf0-456b-a29d-c5ba7e8b698a req-6dc0f4ff-180b-4cd0-ad52-cf00b2d88ec9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:41.880290 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-6dae1291-eaf0-456b-a29d-c5ba7e8b698a req-6dc0f4ff-180b-4cd0-ad52-cf00b2d88ec9 service nova] Creating event network-vif-plugged:14c74fe6-8707-41b9-b1e6-fc064c42d3e5 for instance da80a66d-faa9-4917-9003-758b0a8933b2 on nch2-master-1 Mar 05 21:02:41.901391 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-6dae1291-eaf0-456b-a29d-c5ba7e8b698a req-6dc0f4ff-180b-4cd0-ad52-cf00b2d88ec9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104834 Mar 05 21:02:41.917978 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1800/3675] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:02:42.440937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3a5ac54c-694d-42e1-bd52-5b1de431a551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:42.442707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3a5ac54c-694d-42e1-bd52-5b1de431a551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:42.454702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a5ac54c-694d-42e1-bd52-5b1de431a551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:42.458270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a5ac54c-694d-42e1-bd52-5b1de431a551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:42.459538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a5ac54c-694d-42e1-bd52-5b1de431a551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:42.460311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a5ac54c-694d-42e1-bd52-5b1de431a551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:42.468458 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c470e507-971d-4f05-89f0-e550470c1e6d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.781062 Mar 05 21:02:42.469896 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1876/3676] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 21:02:41 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/os-interface => generated 285 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:43.163602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3a5ac54c-694d-42e1-bd52-5b1de431a551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:43.183126 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3a5ac54c-694d-42e1-bd52-5b1de431a551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1308 microversion: 2.1 time: 0.749360 Mar 05 21:02:43.196277 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1801/3677] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:42 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1308 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:44.201426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c07a4cc9-2939-4a9d-8aea-9adea759b87a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:44.202058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c07a4cc9-2939-4a9d-8aea-9adea759b87a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:44.213290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c07a4cc9-2939-4a9d-8aea-9adea759b87a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:44.214045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c07a4cc9-2939-4a9d-8aea-9adea759b87a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:44.215762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c07a4cc9-2939-4a9d-8aea-9adea759b87a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:44.216444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c07a4cc9-2939-4a9d-8aea-9adea759b87a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:44.585972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c07a4cc9-2939-4a9d-8aea-9adea759b87a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:44.597275 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c07a4cc9-2939-4a9d-8aea-9adea759b87a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1488 microversion: 2.1 time: 0.400787 Mar 05 21:02:44.600306 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1877/3678] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:44 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1488 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:44.854794 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-169202149", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "5345ca04-bcd0-4ca9-94fb-fa648ce6d989"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:44.954319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] validate_networks() for [('5345ca04-bcd0-4ca9-94fb-fa648ce6d989', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:02:45.022406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-239f6a3e-1392-4922-a2f3-b98ea0ad96a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:45.023275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-239f6a3e-1392-4922-a2f3-b98ea0ad96a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:45.031865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-239f6a3e-1392-4922-a2f3-b98ea0ad96a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:45.034945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-239f6a3e-1392-4922-a2f3-b98ea0ad96a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:45.041132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-239f6a3e-1392-4922-a2f3-b98ea0ad96a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:45.041885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-239f6a3e-1392-4922-a2f3-b98ea0ad96a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:45.063415 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-239f6a3e-1392-4922-a2f3-b98ea0ad96a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] HTTP exception thrown: Instance 2699fb15-7a83-401b-8297-3362938587a4 could not be found. Mar 05 21:02:45.064335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-239f6a3e-1392-4922-a2f3-b98ea0ad96a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Returning 404 to user: Instance 2699fb15-7a83-401b-8297-3362938587a4 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:45.065362 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-239f6a3e-1392-4922-a2f3-b98ea0ad96a2 tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 404 len: 111 microversion: 2.1 time: 0.050851 Mar 05 21:02:45.066475 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1878/3679] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:02:45 2022] DELETE /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:02:45.079709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-78e67c5a-a687-4390-8116-11565d79fe9b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:45.082172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-78e67c5a-a687-4390-8116-11565d79fe9b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: 2699fb15-7a83-401b-8297-3362938587a4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:45.092855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78e67c5a-a687-4390-8116-11565d79fe9b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:45.093778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78e67c5a-a687-4390-8116-11565d79fe9b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:45.094750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78e67c5a-a687-4390-8116-11565d79fe9b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:45.095395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78e67c5a-a687-4390-8116-11565d79fe9b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:45.128255 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-78e67c5a-a687-4390-8116-11565d79fe9b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] HTTP exception thrown: Instance 2699fb15-7a83-401b-8297-3362938587a4 could not be found. Mar 05 21:02:45.129382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-78e67c5a-a687-4390-8116-11565d79fe9b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Returning 404 to user: Instance 2699fb15-7a83-401b-8297-3362938587a4 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:45.130405 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-78e67c5a-a687-4390-8116-11565d79fe9b tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4" status: 404 len: 111 microversion: 2.1 time: 0.059503 Mar 05 21:02:45.135749 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1879/3680] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:45 2022] GET /compute/v2.1/servers/2699fb15-7a83-401b-8297-3362938587a4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:02:45.141660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c356e73-022b-4ac9-b4a0-628aa31588bc tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:45.144336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9c356e73-022b-4ac9-b4a0-628aa31588bc tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:45.156413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c356e73-022b-4ac9-b4a0-628aa31588bc tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:45.159357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c356e73-022b-4ac9-b4a0-628aa31588bc tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:45.160409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c356e73-022b-4ac9-b4a0-628aa31588bc tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:45.163643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c356e73-022b-4ac9-b4a0-628aa31588bc tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:45.181745 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-9c356e73-022b-4ac9-b4a0-628aa31588bc tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] HTTP exception thrown: Instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f could not be found. Mar 05 21:02:45.182573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c356e73-022b-4ac9-b4a0-628aa31588bc tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Returning 404 to user: Instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:45.183429 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c356e73-022b-4ac9-b4a0-628aa31588bc tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 404 len: 111 microversion: 2.1 time: 0.046452 Mar 05 21:02:45.187556 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1880/3681] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:02:45 2022] DELETE /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:02:45.192574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d4fa895f-0438-4ab7-9624-76681963e29d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:45.195959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d4fa895f-0438-4ab7-9624-76681963e29d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] [instance: b602fb95-a1a4-41e9-8f4b-04adfe669f0f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:45.209558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4fa895f-0438-4ab7-9624-76681963e29d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:45.211871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4fa895f-0438-4ab7-9624-76681963e29d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:45.212885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4fa895f-0438-4ab7-9624-76681963e29d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:45.213342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4fa895f-0438-4ab7-9624-76681963e29d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:45.245308 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-d4fa895f-0438-4ab7-9624-76681963e29d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] HTTP exception thrown: Instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f could not be found. Mar 05 21:02:45.246156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d4fa895f-0438-4ab7-9624-76681963e29d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] Returning 404 to user: Instance b602fb95-a1a4-41e9-8f4b-04adfe669f0f could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:02:45.247396 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d4fa895f-0438-4ab7-9624-76681963e29d tempest-ServersTestMultiNic-899819657 tempest-ServersTestMultiNic-899819657-project] 10.222.0.15 "GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f" status: 404 len: 111 microversion: 2.1 time: 0.058784 Mar 05 21:02:45.248172 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1881/3682] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:45 2022] GET /compute/v2.1/servers/b602fb95-a1a4-41e9-8f4b-04adfe669f0f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:02:46.693275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-347ee498-0d2e-4a57-a6b1-2b944d2ba829 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:46.694051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-347ee498-0d2e-4a57-a6b1-2b944d2ba829 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:46.705329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-347ee498-0d2e-4a57-a6b1-2b944d2ba829 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:46.705812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-347ee498-0d2e-4a57-a6b1-2b944d2ba829 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:46.706622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-347ee498-0d2e-4a57-a6b1-2b944d2ba829 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:46.707077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-347ee498-0d2e-4a57-a6b1-2b944d2ba829 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:46.715571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:02:46.716123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:02:46.716505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:02:46.716934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:02:46.717327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:02:46.735537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:46.735934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:46.736743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:46.737196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:46.799536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:02:46.821034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for user cfbceb7c8c104af89e7d21ba411e32a8 and project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:02:46.846012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:02:46.848911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:02:46.918776 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6c428737-9eca-496c-a52e-36008c864b19 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.070007 Mar 05 21:02:46.920559 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1802/3683] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:02:46.926543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-1748e241-e3fc-48c0-a350-393b3973d01b req-096361c9-1c6d-463f-b4a4-68e9cdcb67da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc548a05-5226-41f0-a34d-1d44defee56c", "tag": "30ad7984-3b01-4aac-9f3b-d69f10ea737a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:46.937719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1748e241-e3fc-48c0-a350-393b3973d01b req-096361c9-1c6d-463f-b4a4-68e9cdcb67da service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:46.938535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1748e241-e3fc-48c0-a350-393b3973d01b req-096361c9-1c6d-463f-b4a4-68e9cdcb67da service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:46.957559 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-1748e241-e3fc-48c0-a350-393b3973d01b req-096361c9-1c6d-463f-b4a4-68e9cdcb67da service nova] Creating event network-changed:30ad7984-3b01-4aac-9f3b-d69f10ea737a for instance dc548a05-5226-41f0-a34d-1d44defee56c on nch1-master-1 Mar 05 21:02:46.964066 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-1748e241-e3fc-48c0-a350-393b3973d01b req-096361c9-1c6d-463f-b4a4-68e9cdcb67da service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041972 Mar 05 21:02:46.966654 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1803/3684] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:46.975636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-96b186bc-0a4b-4a22-a909-9e51081a6747 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:46.976696 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-96b186bc-0a4b-4a22-a909-9e51081a6747 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:47.132223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-347ee498-0d2e-4a57-a6b1-2b944d2ba829 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:47.145934 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-347ee498-0d2e-4a57-a6b1-2b944d2ba829 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1550 microversion: 2.1 time: 0.455488 Mar 05 21:02:47.149266 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1882/3685] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:46 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1550 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:47.167626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8897d3e5-9fe2-42da-9692-e1d5c3b0c0ab tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:47.169159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8897d3e5-9fe2-42da-9692-e1d5c3b0c0ab tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:47.179555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8897d3e5-9fe2-42da-9692-e1d5c3b0c0ab tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:47.180071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8897d3e5-9fe2-42da-9692-e1d5c3b0c0ab tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:47.180888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8897d3e5-9fe2-42da-9692-e1d5c3b0c0ab tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:47.181341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8897d3e5-9fe2-42da-9692-e1d5c3b0c0ab tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:47.492638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-96b186bc-0a4b-4a22-a909-9e51081a6747 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:47.500681 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-96b186bc-0a4b-4a22-a909-9e51081a6747 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1208 microversion: 2.1 time: 0.532251 Mar 05 21:02:47.504333 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1804/3686] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:46 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1208 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:47.846421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8897d3e5-9fe2-42da-9692-e1d5c3b0c0ab tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:47.854229 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8897d3e5-9fe2-42da-9692-e1d5c3b0c0ab tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1550 microversion: 2.1 time: 0.692190 Mar 05 21:02:47.857218 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1883/3687] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:47 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1550 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:48.521384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d22abb0d-16dd-484a-8f4c-e1ce7c8ed052 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:48.524778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d22abb0d-16dd-484a-8f4c-e1ce7c8ed052 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:48.539376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d22abb0d-16dd-484a-8f4c-e1ce7c8ed052 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:48.540169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d22abb0d-16dd-484a-8f4c-e1ce7c8ed052 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:48.542152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d22abb0d-16dd-484a-8f4c-e1ce7c8ed052 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:48.543216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d22abb0d-16dd-484a-8f4c-e1ce7c8ed052 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:48.644302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d22abb0d-16dd-484a-8f4c-e1ce7c8ed052 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:48.656943 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d22abb0d-16dd-484a-8f4c-e1ce7c8ed052 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1266 microversion: 2.1 time: 0.141191 Mar 05 21:02:48.658239 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1805/3688] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:48 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:48.873926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1d27f806-955e-4bcb-8cff-14ddcdf2975a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:48.874545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1d27f806-955e-4bcb-8cff-14ddcdf2975a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:48.885146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d27f806-955e-4bcb-8cff-14ddcdf2975a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:48.888934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d27f806-955e-4bcb-8cff-14ddcdf2975a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:48.890111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d27f806-955e-4bcb-8cff-14ddcdf2975a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:48.890842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d27f806-955e-4bcb-8cff-14ddcdf2975a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:49.422807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1d27f806-955e-4bcb-8cff-14ddcdf2975a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:49.443229 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1d27f806-955e-4bcb-8cff-14ddcdf2975a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1550 microversion: 2.1 time: 0.573596 Mar 05 21:02:49.445086 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1884/3689] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:48 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1550 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:49.675173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-20a6a45d-d951-4e0c-83a5-b21e643cb806 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:49.676444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-20a6a45d-d951-4e0c-83a5-b21e643cb806 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:49.687602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20a6a45d-d951-4e0c-83a5-b21e643cb806 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:49.690259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20a6a45d-d951-4e0c-83a5-b21e643cb806 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:49.693496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20a6a45d-d951-4e0c-83a5-b21e643cb806 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:49.694160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20a6a45d-d951-4e0c-83a5-b21e643cb806 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:50.460581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3f5cb43d-c182-404f-bfd7-565d37c2d4cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:50.461849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3f5cb43d-c182-404f-bfd7-565d37c2d4cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:50.470007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f5cb43d-c182-404f-bfd7-565d37c2d4cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:50.470756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f5cb43d-c182-404f-bfd7-565d37c2d4cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:50.471768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f5cb43d-c182-404f-bfd7-565d37c2d4cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:50.472367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f5cb43d-c182-404f-bfd7-565d37c2d4cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:50.548424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-20a6a45d-d951-4e0c-83a5-b21e643cb806 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:50.557258 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-20a6a45d-d951-4e0c-83a5-b21e643cb806 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1308 microversion: 2.1 time: 0.885838 Mar 05 21:02:50.558239 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1806/3690] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:49 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1308 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:51.266745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3f5cb43d-c182-404f-bfd7-565d37c2d4cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:51.276239 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3f5cb43d-c182-404f-bfd7-565d37c2d4cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.819013 Mar 05 21:02:51.277443 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1885/3691] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:50 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:51.295620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85c96863-db70-457d-ad61-423cf48913d4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:51.296293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-85c96863-db70-457d-ad61-423cf48913d4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:51.305924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85c96863-db70-457d-ad61-423cf48913d4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:51.307038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85c96863-db70-457d-ad61-423cf48913d4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:51.308618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85c96863-db70-457d-ad61-423cf48913d4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:51.321330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85c96863-db70-457d-ad61-423cf48913d4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:51.575291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2e0b0518-2752-40a8-8c0e-36f9a27cc28d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:51.576760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2e0b0518-2752-40a8-8c0e-36f9a27cc28d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:51.585846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e0b0518-2752-40a8-8c0e-36f9a27cc28d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:51.586584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e0b0518-2752-40a8-8c0e-36f9a27cc28d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:51.587546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e0b0518-2752-40a8-8c0e-36f9a27cc28d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:51.588159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e0b0518-2752-40a8-8c0e-36f9a27cc28d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:51.980472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-85c96863-db70-457d-ad61-423cf48913d4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:51.992073 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-85c96863-db70-457d-ad61-423cf48913d4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.703052 Mar 05 21:02:51.993209 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1807/3692] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:51 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:52.013690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ec2bc029-e760-4ed4-b92e-1685dc8c594d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2094296554"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:52.015089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ec2bc029-e760-4ed4-b92e-1685dc8c594d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:52.021463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec2bc029-e760-4ed4-b92e-1685dc8c594d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:52.022187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec2bc029-e760-4ed4-b92e-1685dc8c594d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:52.023212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec2bc029-e760-4ed4-b92e-1685dc8c594d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:52.024126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec2bc029-e760-4ed4-b92e-1685dc8c594d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:52.287172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2e0b0518-2752-40a8-8c0e-36f9a27cc28d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:52.295730 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2e0b0518-2752-40a8-8c0e-36f9a27cc28d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1308 microversion: 2.1 time: 0.725880 Mar 05 21:02:52.307035 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1886/3693] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:51 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1308 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:52.313167 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8f9fc93d-7b12-442b-aca3-912c6b6a90b5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:52.314034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8f9fc93d-7b12-442b-aca3-912c6b6a90b5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:52.321533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f9fc93d-7b12-442b-aca3-912c6b6a90b5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:52.322398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f9fc93d-7b12-442b-aca3-912c6b6a90b5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:52.323434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f9fc93d-7b12-442b-aca3-912c6b6a90b5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:52.324180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f9fc93d-7b12-442b-aca3-912c6b6a90b5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:52.354683 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8f9fc93d-7b12-442b-aca3-912c6b6a90b5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.046127 Mar 05 21:02:52.355975 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1887/3694] 10.222.0.15 () {58 vars in 1292 bytes} [Sat Mar 5 21:02:52 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e/os-server-password => generated 116 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:02:52.455034 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ec2bc029-e760-4ed4-b92e-1685dc8c594d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.440257 Mar 05 21:02:52.455034 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1808/3695] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:02:52 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Mar 05 21:02:52.610517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-db19954f-a25e-4c9a-922a-cc7ca178cde3 req-7594794b-e45a-43c3-8ec8-0b86e4e2db89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c19119-1997-4996-8890-83f81bea3f82", "tag": "be21d9e5-dc05-40bf-90fc-a6eb950a496b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:52.641176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-db19954f-a25e-4c9a-922a-cc7ca178cde3 req-7594794b-e45a-43c3-8ec8-0b86e4e2db89 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:52.653272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-db19954f-a25e-4c9a-922a-cc7ca178cde3 req-7594794b-e45a-43c3-8ec8-0b86e4e2db89 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:52.673487 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-db19954f-a25e-4c9a-922a-cc7ca178cde3 req-7594794b-e45a-43c3-8ec8-0b86e4e2db89 service nova] Creating event network-changed:be21d9e5-dc05-40bf-90fc-a6eb950a496b for instance 99c19119-1997-4996-8890-83f81bea3f82 on nch2-master-1 Mar 05 21:02:52.695247 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-db19954f-a25e-4c9a-922a-cc7ca178cde3 req-7594794b-e45a-43c3-8ec8-0b86e4e2db89 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089119 Mar 05 21:02:52.697329 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1888/3696] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:02:53.317223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-64129c80-64f5-4e45-8535-7eefc59e109d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:53.319201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-64129c80-64f5-4e45-8535-7eefc59e109d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:53.331693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64129c80-64f5-4e45-8535-7eefc59e109d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:53.335234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64129c80-64f5-4e45-8535-7eefc59e109d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:53.336533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64129c80-64f5-4e45-8535-7eefc59e109d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:53.338511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64129c80-64f5-4e45-8535-7eefc59e109d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:53.786139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-64129c80-64f5-4e45-8535-7eefc59e109d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:53.797691 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-64129c80-64f5-4e45-8535-7eefc59e109d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1308 microversion: 2.1 time: 0.488104 Mar 05 21:02:53.803319 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1809/3697] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:53 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1308 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:54.820226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f49f0fc7-b630-4776-b603-0d9d23bce0a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:54.821782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f49f0fc7-b630-4776-b603-0d9d23bce0a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:54.844176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f49f0fc7-b630-4776-b603-0d9d23bce0a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:54.844636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f49f0fc7-b630-4776-b603-0d9d23bce0a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:54.848144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f49f0fc7-b630-4776-b603-0d9d23bce0a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:54.848743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f49f0fc7-b630-4776-b603-0d9d23bce0a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:55.709853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f49f0fc7-b630-4776-b603-0d9d23bce0a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:55.718878 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f49f0fc7-b630-4776-b603-0d9d23bce0a9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1308 microversion: 2.1 time: 0.904034 Mar 05 21:02:55.733415 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1889/3698] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:54 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1308 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:56.743372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cf315c4a-810e-4c9a-a5ed-dcaf38fd5913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:56.745641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cf315c4a-810e-4c9a-a5ed-dcaf38fd5913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:56.772068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf315c4a-810e-4c9a-a5ed-dcaf38fd5913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:56.772720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf315c4a-810e-4c9a-a5ed-dcaf38fd5913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:56.773796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf315c4a-810e-4c9a-a5ed-dcaf38fd5913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:56.774240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf315c4a-810e-4c9a-a5ed-dcaf38fd5913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:57.559148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cf315c4a-810e-4c9a-a5ed-dcaf38fd5913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:57.571087 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cf315c4a-810e-4c9a-a5ed-dcaf38fd5913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1308 microversion: 2.1 time: 0.834053 Mar 05 21:02:57.576263 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1810/3699] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:56 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1308 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:02:57.867576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ff085d2-96cf-4055-9fc2-0ac20b0e5546 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:57.868172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ff085d2-96cf-4055-9fc2-0ac20b0e5546 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:57.888205 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ff085d2-96cf-4055-9fc2-0ac20b0e5546 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:57.889065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ff085d2-96cf-4055-9fc2-0ac20b0e5546 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:57.890376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ff085d2-96cf-4055-9fc2-0ac20b0e5546 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:57.893873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ff085d2-96cf-4055-9fc2-0ac20b0e5546 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:58.202686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-4ff085d2-96cf-4055-9fc2-0ac20b0e5546 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lazy-loading 'services' on Instance uuid 2a84920d-9932-4cd1-975b-9a28dc682e45 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:02:58.352790 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4ff085d2-96cf-4055-9fc2-0ac20b0e5546 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/os-volume_attachments/8607c3b6-20ea-47c0-9fee-9ac4fd535791" status: 202 len: 0 microversion: 2.1 time: 0.489674 Mar 05 21:02:58.357404 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1890/3700] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 21:02:57 2022] DELETE /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/os-volume_attachments/8607c3b6-20ea-47c0-9fee-9ac4fd535791 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:02:58.595019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-50ff250c-aa45-41e6-91fa-6af5612f327f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:58.595999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-50ff250c-aa45-41e6-91fa-6af5612f327f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:58.626626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-50ff250c-aa45-41e6-91fa-6af5612f327f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:58.627871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-50ff250c-aa45-41e6-91fa-6af5612f327f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:58.634607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-50ff250c-aa45-41e6-91fa-6af5612f327f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:58.635479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-50ff250c-aa45-41e6-91fa-6af5612f327f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:58.998039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1994977844", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:59.118197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] validate_networks() for [('7c100624-2ecc-4b88-a924-0fbddd33fecd', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:02:59.468378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-50ff250c-aa45-41e6-91fa-6af5612f327f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:02:59.479082 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-50ff250c-aa45-41e6-91fa-6af5612f327f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1308 microversion: 2.1 time: 0.890464 Mar 05 21:02:59.479705 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1891/3701] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:58 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1308 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:02:59.661009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1c34f6e0-80ef-4588-8729-b28606165762 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:02:59.673039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c34f6e0-80ef-4588-8729-b28606165762 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:59.674412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c34f6e0-80ef-4588-8729-b28606165762 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:59.745140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1c34f6e0-80ef-4588-8729-b28606165762 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Going to try to stop instance {{(pid=141479) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 05 21:02:59.870132 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1c34f6e0-80ef-4588-8729-b28606165762 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "POST /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/action" status: 202 len: 0 microversion: 2.1 time: 0.213737 Mar 05 21:02:59.871584 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1892/3702] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:02:59 2022] POST /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 21:02:59.888017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-37bc2c70-4611-44a8-8dd0-cf35a0624030 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:02:59.889313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-37bc2c70-4611-44a8-8dd0-cf35a0624030 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:02:59.901457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-37bc2c70-4611-44a8-8dd0-cf35a0624030 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:59.902096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-37bc2c70-4611-44a8-8dd0-cf35a0624030 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:02:59.907619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-37bc2c70-4611-44a8-8dd0-cf35a0624030 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:02:59.908447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-37bc2c70-4611-44a8-8dd0-cf35a0624030 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:00.724918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-37bc2c70-4611-44a8-8dd0-cf35a0624030 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:00.742467 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-37bc2c70-4611-44a8-8dd0-cf35a0624030 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1675 microversion: 2.1 time: 0.866291 Mar 05 21:03:00.743104 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1893/3703] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:02:59 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1675 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:03:00.772443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-deebd042-6c35-4c8b-8f9d-aaafc8a6eec9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:00.773216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-deebd042-6c35-4c8b-8f9d-aaafc8a6eec9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:00.806372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-deebd042-6c35-4c8b-8f9d-aaafc8a6eec9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:00.806850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-deebd042-6c35-4c8b-8f9d-aaafc8a6eec9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:00.807683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-deebd042-6c35-4c8b-8f9d-aaafc8a6eec9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:00.808138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-deebd042-6c35-4c8b-8f9d-aaafc8a6eec9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:01.370931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-deebd042-6c35-4c8b-8f9d-aaafc8a6eec9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:01.383458 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-deebd042-6c35-4c8b-8f9d-aaafc8a6eec9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1308 microversion: 2.1 time: 0.633929 Mar 05 21:03:01.384112 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1894/3704] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:00 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1308 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:01.760572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67838aca-27c1-472d-acff-9ef05ff10f50 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:01.761303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-67838aca-27c1-472d-acff-9ef05ff10f50 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:01.788315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67838aca-27c1-472d-acff-9ef05ff10f50 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:01.791981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67838aca-27c1-472d-acff-9ef05ff10f50 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:01.795643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67838aca-27c1-472d-acff-9ef05ff10f50 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:01.806554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67838aca-27c1-472d-acff-9ef05ff10f50 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:02.103100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:03:02.104755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:03:02.105533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:03:02.106218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:03:02.106811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:03:02.132146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:02.132610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:02.142849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:02.147081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:02.218368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Getting quotas for project 085ced4ef30745c88d1b33842076f02e. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:02.240923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Getting quotas for user 9e2c691e443445a8a79f758dabd9042e and project 085ced4ef30745c88d1b33842076f02e. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:02.289230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:03:02.301954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:03:02.464582 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c5c47ca4-63f7-4165-a0ce-d26c998e169f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.169909 Mar 05 21:03:02.475598 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1811/3705] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:02:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 4184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 21:03:02.499275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-4da6ad14-62cd-4ad6-9c23-04ba93f4af53 req-c3676387-a37f-4627-99b2-e678fbe36c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc548a05-5226-41f0-a34d-1d44defee56c", "name": "network-vif-plugged", "status": "completed", "tag": "30ad7984-3b01-4aac-9f3b-d69f10ea737a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:02.526429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4da6ad14-62cd-4ad6-9c23-04ba93f4af53 req-c3676387-a37f-4627-99b2-e678fbe36c7c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:02.529111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4da6ad14-62cd-4ad6-9c23-04ba93f4af53 req-c3676387-a37f-4627-99b2-e678fbe36c7c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:02.558006 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-4da6ad14-62cd-4ad6-9c23-04ba93f4af53 req-c3676387-a37f-4627-99b2-e678fbe36c7c service nova] Creating event network-vif-plugged:30ad7984-3b01-4aac-9f3b-d69f10ea737a for instance dc548a05-5226-41f0-a34d-1d44defee56c on nch1-master-1 Mar 05 21:03:02.576904 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-4da6ad14-62cd-4ad6-9c23-04ba93f4af53 req-c3676387-a37f-4627-99b2-e678fbe36c7c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097215 Mar 05 21:03:02.579288 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1812/3706] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:02.608307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-701803fc-3afb-4a23-adc7-22163c1951ca tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:02.609035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-701803fc-3afb-4a23-adc7-22163c1951ca tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:02.631228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-701803fc-3afb-4a23-adc7-22163c1951ca tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:02.631496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-701803fc-3afb-4a23-adc7-22163c1951ca tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:02.635402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-701803fc-3afb-4a23-adc7-22163c1951ca tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:02.636089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-701803fc-3afb-4a23-adc7-22163c1951ca tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:03.188220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-67838aca-27c1-472d-acff-9ef05ff10f50 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:03.196955 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67838aca-27c1-472d-acff-9ef05ff10f50 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1675 microversion: 2.1 time: 1.440781 Mar 05 21:03:03.202849 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1895/3707] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:01 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1675 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:03.218906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c7725d4a-67ec-4044-a9da-dd864aa8b127 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:03.222209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c7725d4a-67ec-4044-a9da-dd864aa8b127 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:03.343815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c7725d4a-67ec-4044-a9da-dd864aa8b127 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:03.355040 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c7725d4a-67ec-4044-a9da-dd864aa8b127 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1222 microversion: 2.1 time: 0.150535 Mar 05 21:03:03.356636 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1896/3708] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:03 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1222 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:03.440661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cbf7b86c-2cc1-465c-9365-98804368a140 tempest-FloatingIPDetailsNegativeTestJSON-1710512590 tempest-FloatingIPDetailsNegativeTestJSON-1710512590-project] Calling method '.version_select at 0x7fed5c79cca0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:03.608047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG neutronclient.v2_0.client [None req-cbf7b86c-2cc1-465c-9365-98804368a140 tempest-FloatingIPDetailsNegativeTestJSON-1710512590 tempest-FloatingIPDetailsNegativeTestJSON-1710512590-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2239cadd-e052-449c-b6e9-5bbb2d95eaee could not be found", "detail": ""}} {{(pid=141479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 21:03:03.608755 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-cbf7b86c-2cc1-465c-9365-98804368a140 tempest-FloatingIPDetailsNegativeTestJSON-1710512590 tempest-FloatingIPDetailsNegativeTestJSON-1710512590-project] HTTP exception thrown: Floating IP not found for ID 2239cadd-e052-449c-b6e9-5bbb2d95eaee Mar 05 21:03:03.609430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cbf7b86c-2cc1-465c-9365-98804368a140 tempest-FloatingIPDetailsNegativeTestJSON-1710512590 tempest-FloatingIPDetailsNegativeTestJSON-1710512590-project] Returning 404 to user: Floating IP not found for ID 2239cadd-e052-449c-b6e9-5bbb2d95eaee {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:03:03.610275 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cbf7b86c-2cc1-465c-9365-98804368a140 tempest-FloatingIPDetailsNegativeTestJSON-1710512590 tempest-FloatingIPDetailsNegativeTestJSON-1710512590-project] 10.222.0.15 "GET /compute/v2.1/os-floating-ips/2239cadd-e052-449c-b6e9-5bbb2d95eaee" status: 404 len: 111 microversion: 2.1 time: 0.252406 Mar 05 21:03:03.620170 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1897/3709] 10.222.0.15 () {58 vars in 1259 bytes} [Sat Mar 5 21:03:03 2022] GET /compute/v2.1/os-floating-ips/2239cadd-e052-449c-b6e9-5bbb2d95eaee => generated 111 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:03:03.636894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1525739557", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:03.746337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] validate_networks() for [('7c100624-2ecc-4b88-a924-0fbddd33fecd', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:03:04.173416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-701803fc-3afb-4a23-adc7-22163c1951ca tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:04.186413 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-701803fc-3afb-4a23-adc7-22163c1951ca tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1308 microversion: 2.1 time: 1.605918 Mar 05 21:03:04.196221 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1813/3710] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:02 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1308 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:04.220565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a2cdae78-1e7c-4901-8c0b-5ab3604b8b37 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:04.221196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a2cdae78-1e7c-4901-8c0b-5ab3604b8b37 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:04.237317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a2cdae78-1e7c-4901-8c0b-5ab3604b8b37 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:04.238043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a2cdae78-1e7c-4901-8c0b-5ab3604b8b37 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:04.239515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a2cdae78-1e7c-4901-8c0b-5ab3604b8b37 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:04.240647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a2cdae78-1e7c-4901-8c0b-5ab3604b8b37 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:05.378494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:03:05.379552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:03:05.380340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:03:05.381127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:03:05.381844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:03:05.408770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:05.412067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:05.413110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:05.415637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:05.459207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Getting quotas for project 085ced4ef30745c88d1b33842076f02e. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:05.473402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Getting quotas for user 9e2c691e443445a8a79f758dabd9042e and project 085ced4ef30745c88d1b33842076f02e. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:05.493120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:03:05.496677 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:03:05.567377 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4bbbcf5f-c0b5-4f5a-a3d6-6416c31e3d32 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.948575 Mar 05 21:03:05.573758 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1898/3711] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:03:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:03:05.623518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-57550a16-72d6-4df0-a317-d3cefddb16b5 req-da12d8e4-87fb-414a-83f8-eab9b94eb782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c19119-1997-4996-8890-83f81bea3f82", "name": "network-vif-plugged", "status": "completed", "tag": "be21d9e5-dc05-40bf-90fc-a6eb950a496b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:05.638652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-57550a16-72d6-4df0-a317-d3cefddb16b5 req-da12d8e4-87fb-414a-83f8-eab9b94eb782 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:05.639502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-57550a16-72d6-4df0-a317-d3cefddb16b5 req-da12d8e4-87fb-414a-83f8-eab9b94eb782 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:05.691460 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-57550a16-72d6-4df0-a317-d3cefddb16b5 req-da12d8e4-87fb-414a-83f8-eab9b94eb782 service nova] Creating event network-vif-plugged:be21d9e5-dc05-40bf-90fc-a6eb950a496b for instance 99c19119-1997-4996-8890-83f81bea3f82 on nch2-master-1 Mar 05 21:03:05.706133 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-57550a16-72d6-4df0-a317-d3cefddb16b5 req-da12d8e4-87fb-414a-83f8-eab9b94eb782 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130077 Mar 05 21:03:05.707100 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1899/3712] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:05.717680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8c1dfaf1-eb15-4f78-8710-7e3df9ee345b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:05.725083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8c1dfaf1-eb15-4f78-8710-7e3df9ee345b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:05.736255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c1dfaf1-eb15-4f78-8710-7e3df9ee345b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:05.736978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c1dfaf1-eb15-4f78-8710-7e3df9ee345b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:05.737954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c1dfaf1-eb15-4f78-8710-7e3df9ee345b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:05.741574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c1dfaf1-eb15-4f78-8710-7e3df9ee345b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:06.402835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a2cdae78-1e7c-4901-8c0b-5ab3604b8b37 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:06.418777 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a2cdae78-1e7c-4901-8c0b-5ab3604b8b37 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1675 microversion: 2.1 time: 2.201646 Mar 05 21:03:06.424782 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1814/3713] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:04 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1675 bytes in 2210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:06.441003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aac7c886-8274-4b1c-8a2c-bbe0e44840ab tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:06.442090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aac7c886-8274-4b1c-8a2c-bbe0e44840ab tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:06.481327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aac7c886-8274-4b1c-8a2c-bbe0e44840ab tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:06.482542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aac7c886-8274-4b1c-8a2c-bbe0e44840ab tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:06.483559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aac7c886-8274-4b1c-8a2c-bbe0e44840ab tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:06.491715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aac7c886-8274-4b1c-8a2c-bbe0e44840ab tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:06.648824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8c1dfaf1-eb15-4f78-8710-7e3df9ee345b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:06.672868 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8c1dfaf1-eb15-4f78-8710-7e3df9ee345b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1308 microversion: 2.1 time: 0.962428 Mar 05 21:03:06.675664 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1900/3714] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:05 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1308 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:07.018292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aac7c886-8274-4b1c-8a2c-bbe0e44840ab tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:07.032288 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aac7c886-8274-4b1c-8a2c-bbe0e44840ab tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1226 microversion: 2.1 time: 0.605593 Mar 05 21:03:07.046830 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1815/3715] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:06 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1226 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:07.442602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-341ddad3-9083-4d6f-80b1-083ae1aa4483 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:07.443541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-341ddad3-9083-4d6f-80b1-083ae1aa4483 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:07.460592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-341ddad3-9083-4d6f-80b1-083ae1aa4483 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:07.463524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-341ddad3-9083-4d6f-80b1-083ae1aa4483 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:07.465449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-341ddad3-9083-4d6f-80b1-083ae1aa4483 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:07.466139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-341ddad3-9083-4d6f-80b1-083ae1aa4483 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:07.693674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-334931d7-48a7-4604-9646-e8766c28501d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:07.695096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-334931d7-48a7-4604-9646-e8766c28501d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:07.727980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-334931d7-48a7-4604-9646-e8766c28501d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:07.729205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-334931d7-48a7-4604-9646-e8766c28501d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:07.730277 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-334931d7-48a7-4604-9646-e8766c28501d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:07.732856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-334931d7-48a7-4604-9646-e8766c28501d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:08.501521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-334931d7-48a7-4604-9646-e8766c28501d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:08.510340 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-334931d7-48a7-4604-9646-e8766c28501d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1308 microversion: 2.1 time: 0.822976 Mar 05 21:03:08.511857 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1816/3716] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:07 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1308 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:08.526268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-464c12f5-bfe6-461c-b6ce-0d3f00c150a7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:08.529521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-464c12f5-bfe6-461c-b6ce-0d3f00c150a7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:08.543110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-464c12f5-bfe6-461c-b6ce-0d3f00c150a7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:08.545811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-464c12f5-bfe6-461c-b6ce-0d3f00c150a7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:08.546917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-464c12f5-bfe6-461c-b6ce-0d3f00c150a7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:08.547662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-464c12f5-bfe6-461c-b6ce-0d3f00c150a7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:08.794977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-464c12f5-bfe6-461c-b6ce-0d3f00c150a7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:08.809064 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-464c12f5-bfe6-461c-b6ce-0d3f00c150a7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1280 microversion: 2.1 time: 0.295854 Mar 05 21:03:08.810001 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1817/3717] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:08 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1280 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:09.310747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-341ddad3-9083-4d6f-80b1-083ae1aa4483 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:09.319908 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-341ddad3-9083-4d6f-80b1-083ae1aa4483 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1675 microversion: 2.1 time: 1.881691 Mar 05 21:03:09.327518 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1901/3718] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:07 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1675 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:09.526654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-64f8962d-d35a-4adb-91cf-6e68efba1b42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:09.530685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-64f8962d-d35a-4adb-91cf-6e68efba1b42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:09.542177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64f8962d-d35a-4adb-91cf-6e68efba1b42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:09.543491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64f8962d-d35a-4adb-91cf-6e68efba1b42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:09.548985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64f8962d-d35a-4adb-91cf-6e68efba1b42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:09.553989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64f8962d-d35a-4adb-91cf-6e68efba1b42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:09.773997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-d9719fd3-36c3-4d9b-b45b-62eccf41b875 req-333692f8-66df-499f-baaf-b73f7fcacf0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d64ade-0446-474b-a3d4-454133f21972", "tag": "9825a641-f476-451a-af8d-cff38d8c1ce9"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:09.784915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d9719fd3-36c3-4d9b-b45b-62eccf41b875 req-333692f8-66df-499f-baaf-b73f7fcacf0c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:09.793318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d9719fd3-36c3-4d9b-b45b-62eccf41b875 req-333692f8-66df-499f-baaf-b73f7fcacf0c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:09.832085 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-d9719fd3-36c3-4d9b-b45b-62eccf41b875 req-333692f8-66df-499f-baaf-b73f7fcacf0c service nova] Creating event network-changed:9825a641-f476-451a-af8d-cff38d8c1ce9 for instance b2d64ade-0446-474b-a3d4-454133f21972 on nch1-master-1 Mar 05 21:03:09.847138 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-d9719fd3-36c3-4d9b-b45b-62eccf41b875 req-333692f8-66df-499f-baaf-b73f7fcacf0c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076559 Mar 05 21:03:09.848570 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1902/3719] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:09.862293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8a6af673-96f0-4521-a327-fdc91978880f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:09.868249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8a6af673-96f0-4521-a327-fdc91978880f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:09.881061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a6af673-96f0-4521-a327-fdc91978880f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:09.881923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a6af673-96f0-4521-a327-fdc91978880f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:09.883859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a6af673-96f0-4521-a327-fdc91978880f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:09.887533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a6af673-96f0-4521-a327-fdc91978880f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:10.382796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8a6af673-96f0-4521-a327-fdc91978880f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:10.393036 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8a6af673-96f0-4521-a327-fdc91978880f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1280 microversion: 2.1 time: 0.542921 Mar 05 21:03:10.399983 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1903/3720] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:09 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1280 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:10.421605 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c13f61be-dd54-43d7-8c5d-9676b3cbf3ee tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:10.422296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c13f61be-dd54-43d7-8c5d-9676b3cbf3ee tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:10.443749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c13f61be-dd54-43d7-8c5d-9676b3cbf3ee tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:10.448667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c13f61be-dd54-43d7-8c5d-9676b3cbf3ee tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:10.450716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c13f61be-dd54-43d7-8c5d-9676b3cbf3ee tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:10.452641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c13f61be-dd54-43d7-8c5d-9676b3cbf3ee tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:10.706788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-64f8962d-d35a-4adb-91cf-6e68efba1b42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:10.718464 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-64f8962d-d35a-4adb-91cf-6e68efba1b42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1488 microversion: 2.1 time: 1.195965 Mar 05 21:03:10.721410 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1818/3721] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:09 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1488 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:10.737431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b657330b-40c5-4895-8b43-7fa47f48ec96 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:10.738439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b657330b-40c5-4895-8b43-7fa47f48ec96 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:10.750694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b657330b-40c5-4895-8b43-7fa47f48ec96 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:10.751418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b657330b-40c5-4895-8b43-7fa47f48ec96 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:10.754522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b657330b-40c5-4895-8b43-7fa47f48ec96 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:10.755250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b657330b-40c5-4895-8b43-7fa47f48ec96 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:11.482266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b657330b-40c5-4895-8b43-7fa47f48ec96 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:11.515228 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b657330b-40c5-4895-8b43-7fa47f48ec96 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1488 microversion: 2.1 time: 0.781678 Mar 05 21:03:11.516487 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1819/3722] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:10 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1488 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:03:11.524428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b856dd02-eeec-4e8e-8af2-d682f7e5acfd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:11.527026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b856dd02-eeec-4e8e-8af2-d682f7e5acfd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:11.552551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b856dd02-eeec-4e8e-8af2-d682f7e5acfd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:11.556683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b856dd02-eeec-4e8e-8af2-d682f7e5acfd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:11.561370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b856dd02-eeec-4e8e-8af2-d682f7e5acfd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:11.562042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b856dd02-eeec-4e8e-8af2-d682f7e5acfd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:11.864160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b856dd02-eeec-4e8e-8af2-d682f7e5acfd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:11.882468 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b856dd02-eeec-4e8e-8af2-d682f7e5acfd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1280 microversion: 2.1 time: 0.364624 Mar 05 21:03:11.890682 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1820/3723] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:11 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1280 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:11.918344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a82aa711-d879-4184-91bd-cc13b72b013c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:11.921437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a82aa711-d879-4184-91bd-cc13b72b013c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:11.937012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a82aa711-d879-4184-91bd-cc13b72b013c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:11.937419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a82aa711-d879-4184-91bd-cc13b72b013c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:11.938250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a82aa711-d879-4184-91bd-cc13b72b013c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:11.938701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a82aa711-d879-4184-91bd-cc13b72b013c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:11.969236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c13f61be-dd54-43d7-8c5d-9676b3cbf3ee tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:11.977638 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c13f61be-dd54-43d7-8c5d-9676b3cbf3ee tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1652 microversion: 2.1 time: 1.573783 Mar 05 21:03:11.980880 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1904/3724] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:10 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1652 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:11.998040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a5d9feb9-4aad-4786-bea4-ef6b69cadf88 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:12.026108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a5d9feb9-4aad-4786-bea4-ef6b69cadf88 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:12.027899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a5d9feb9-4aad-4786-bea4-ef6b69cadf88 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:12.109997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a5d9feb9-4aad-4786-bea4-ef6b69cadf88 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Going to try to start instance {{(pid=141479) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 05 21:03:12.219200 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a5d9feb9-4aad-4786-bea4-ef6b69cadf88 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "POST /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/action" status: 202 len: 0 microversion: 2.1 time: 0.225029 Mar 05 21:03:12.223329 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1905/3725] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:03:11 2022] POST /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 21:03:12.237159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d2b4341c-a7d7-4663-9b25-c83c6747e92a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:12.240173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d2b4341c-a7d7-4663-9b25-c83c6747e92a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:12.259035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2b4341c-a7d7-4663-9b25-c83c6747e92a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:12.262358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2b4341c-a7d7-4663-9b25-c83c6747e92a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:12.263341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2b4341c-a7d7-4663-9b25-c83c6747e92a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:12.263848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2b4341c-a7d7-4663-9b25-c83c6747e92a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:12.984833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a82aa711-d879-4184-91bd-cc13b72b013c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:12.992930 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a82aa711-d879-4184-91bd-cc13b72b013c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1488 microversion: 2.1 time: 1.099787 Mar 05 21:03:13.002662 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1821/3726] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:11 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1488 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:13.014246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-53dceec8-31a5-4ee9-a744-586560237a2e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:13.028586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-53dceec8-31a5-4ee9-a744-586560237a2e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:13.039235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53dceec8-31a5-4ee9-a744-586560237a2e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:13.042202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53dceec8-31a5-4ee9-a744-586560237a2e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:13.043188 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53dceec8-31a5-4ee9-a744-586560237a2e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:13.052266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53dceec8-31a5-4ee9-a744-586560237a2e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:13.388666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d2b4341c-a7d7-4663-9b25-c83c6747e92a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:13.404118 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d2b4341c-a7d7-4663-9b25-c83c6747e92a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1661 microversion: 2.1 time: 1.179312 Mar 05 21:03:13.414466 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1906/3727] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:12 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1661 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:13.428157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a26ca219-4fda-46ca-a073-1432df5c3673 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:13.428670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a26ca219-4fda-46ca-a073-1432df5c3673 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:13.444049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a26ca219-4fda-46ca-a073-1432df5c3673 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:13.445055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a26ca219-4fda-46ca-a073-1432df5c3673 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:13.465492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a26ca219-4fda-46ca-a073-1432df5c3673 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:13.466235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a26ca219-4fda-46ca-a073-1432df5c3673 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:13.523836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a26ca219-4fda-46ca-a073-1432df5c3673 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:03:13.683897 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a26ca219-4fda-46ca-a073-1432df5c3673 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 204 len: 0 microversion: 2.1 time: 0.267644 Mar 05 21:03:13.696192 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1907/3728] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:03:13 2022] DELETE /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:03:13.728519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-abfcbe0b-6fa7-4a1c-ab15-fea99acf26f1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:13.729353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-abfcbe0b-6fa7-4a1c-ab15-fea99acf26f1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:13.751051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-abfcbe0b-6fa7-4a1c-ab15-fea99acf26f1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:13.751506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-abfcbe0b-6fa7-4a1c-ab15-fea99acf26f1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:13.752584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-abfcbe0b-6fa7-4a1c-ab15-fea99acf26f1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:13.753081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-abfcbe0b-6fa7-4a1c-ab15-fea99acf26f1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:14.159653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-53dceec8-31a5-4ee9-a744-586560237a2e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:14.170887 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-53dceec8-31a5-4ee9-a744-586560237a2e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1322 microversion: 2.1 time: 1.166885 Mar 05 21:03:14.171606 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1822/3729] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:13 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1322 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:14.421811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-28c56141-28ab-47ee-b9bd-d6b621fc43f0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:14.422802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-28c56141-28ab-47ee-b9bd-d6b621fc43f0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:14.442613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28c56141-28ab-47ee-b9bd-d6b621fc43f0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:14.443356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28c56141-28ab-47ee-b9bd-d6b621fc43f0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:14.444437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28c56141-28ab-47ee-b9bd-d6b621fc43f0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:14.445284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28c56141-28ab-47ee-b9bd-d6b621fc43f0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:14.916493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-abfcbe0b-6fa7-4a1c-ab15-fea99acf26f1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:14.938997 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-abfcbe0b-6fa7-4a1c-ab15-fea99acf26f1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1494 microversion: 2.1 time: 1.233210 Mar 05 21:03:14.940116 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1908/3730] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:13 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1494 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:15.189296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-062e535d-2399-4a6f-83c0-d6db060b46db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:15.190262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-062e535d-2399-4a6f-83c0-d6db060b46db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:15.201881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-062e535d-2399-4a6f-83c0-d6db060b46db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:15.204147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-062e535d-2399-4a6f-83c0-d6db060b46db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:15.205285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-062e535d-2399-4a6f-83c0-d6db060b46db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:15.208825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-062e535d-2399-4a6f-83c0-d6db060b46db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:15.671304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-28c56141-28ab-47ee-b9bd-d6b621fc43f0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:15.689588 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-28c56141-28ab-47ee-b9bd-d6b621fc43f0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1661 microversion: 2.1 time: 1.268618 Mar 05 21:03:15.692881 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1823/3731] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:14 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1661 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:15.872107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-062e535d-2399-4a6f-83c0-d6db060b46db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:15.882097 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-062e535d-2399-4a6f-83c0-d6db060b46db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1322 microversion: 2.1 time: 0.697281 Mar 05 21:03:15.900041 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1909/3732] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:15 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1322 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:03:15.957876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f216cd5f-e09b-4514-98d9-49d644dcf003 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:15.958506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f216cd5f-e09b-4514-98d9-49d644dcf003 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:15.974628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f216cd5f-e09b-4514-98d9-49d644dcf003 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:15.975490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f216cd5f-e09b-4514-98d9-49d644dcf003 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:15.977807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f216cd5f-e09b-4514-98d9-49d644dcf003 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:15.982405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f216cd5f-e09b-4514-98d9-49d644dcf003 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:16.712219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-28f22242-c8d5-40eb-95ae-54d19b002939 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:16.713539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-28f22242-c8d5-40eb-95ae-54d19b002939 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:16.723477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28f22242-c8d5-40eb-95ae-54d19b002939 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:16.728303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28f22242-c8d5-40eb-95ae-54d19b002939 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:16.731361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28f22242-c8d5-40eb-95ae-54d19b002939 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:16.735113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28f22242-c8d5-40eb-95ae-54d19b002939 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:17.536079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f216cd5f-e09b-4514-98d9-49d644dcf003 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:17.544661 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f216cd5f-e09b-4514-98d9-49d644dcf003 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1494 microversion: 2.1 time: 1.591108 Mar 05 21:03:17.545267 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1824/3733] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:15 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1494 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:17.595014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f6d9a38f-6639-4cc6-ba36-5e31ab784360 req-895ef7a8-3202-4c48-92aa-7df02ccf09be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08399756-b179-4541-ad3e-3c179e7d7514", "tag": "f4c94118-4a65-46a6-8b43-e142d3b1d4fb"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:17.639234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f6d9a38f-6639-4cc6-ba36-5e31ab784360 req-895ef7a8-3202-4c48-92aa-7df02ccf09be service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:17.639234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f6d9a38f-6639-4cc6-ba36-5e31ab784360 req-895ef7a8-3202-4c48-92aa-7df02ccf09be service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:17.673174 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f6d9a38f-6639-4cc6-ba36-5e31ab784360 req-895ef7a8-3202-4c48-92aa-7df02ccf09be service nova] Creating event network-changed:f4c94118-4a65-46a6-8b43-e142d3b1d4fb for instance 08399756-b179-4541-ad3e-3c179e7d7514 on nch2-master-1 Mar 05 21:03:17.678497 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f6d9a38f-6639-4cc6-ba36-5e31ab784360 req-895ef7a8-3202-4c48-92aa-7df02ccf09be service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132006 Mar 05 21:03:17.679055 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1825/3734] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:17.701112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eb99bd3d-4a6e-49a6-8c15-10435e9088c5 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:17.701957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eb99bd3d-4a6e-49a6-8c15-10435e9088c5 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:17.724727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb99bd3d-4a6e-49a6-8c15-10435e9088c5 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:17.725194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb99bd3d-4a6e-49a6-8c15-10435e9088c5 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:17.725978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb99bd3d-4a6e-49a6-8c15-10435e9088c5 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:17.732708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb99bd3d-4a6e-49a6-8c15-10435e9088c5 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:18.194255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-28f22242-c8d5-40eb-95ae-54d19b002939 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:18.215349 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-28f22242-c8d5-40eb-95ae-54d19b002939 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1661 microversion: 2.1 time: 1.510099 Mar 05 21:03:18.216577 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1910/3735] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:16 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1661 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:03:18.562350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6c70f56b-8054-41ca-900b-97eaf6ff26ef tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:18.563142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6c70f56b-8054-41ca-900b-97eaf6ff26ef tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:18.582959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c70f56b-8054-41ca-900b-97eaf6ff26ef tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:18.583594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c70f56b-8054-41ca-900b-97eaf6ff26ef tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:18.591130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c70f56b-8054-41ca-900b-97eaf6ff26ef tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:18.591919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c70f56b-8054-41ca-900b-97eaf6ff26ef tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:18.694531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c70f56b-8054-41ca-900b-97eaf6ff26ef tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:18.695379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c70f56b-8054-41ca-900b-97eaf6ff26ef tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:18.696174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-6c70f56b-8054-41ca-900b-97eaf6ff26ef tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lazy-loading 'fault' on Instance uuid 99c19119-1997-4996-8890-83f81bea3f82 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:03:18.704780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eb99bd3d-4a6e-49a6-8c15-10435e9088c5 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:18.720551 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eb99bd3d-4a6e-49a6-8c15-10435e9088c5 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1322 microversion: 2.1 time: 1.040063 Mar 05 21:03:18.721191 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1826/3736] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:17 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1322 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:18.905801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6c70f56b-8054-41ca-900b-97eaf6ff26ef tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:18.920019 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6c70f56b-8054-41ca-900b-97eaf6ff26ef tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 200 len: 1298 microversion: 2.1 time: 0.356001 Mar 05 21:03:18.922699 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1911/3737] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:18 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 1298 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:03:19.234680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cef3aa83-3aa7-43a5-b546-59378429d028 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:19.235241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cef3aa83-3aa7-43a5-b546-59378429d028 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:19.247237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cef3aa83-3aa7-43a5-b546-59378429d028 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:19.250496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cef3aa83-3aa7-43a5-b546-59378429d028 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:19.257318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cef3aa83-3aa7-43a5-b546-59378429d028 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:19.258018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cef3aa83-3aa7-43a5-b546-59378429d028 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:19.706518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c0d6f6f9-1e80-4fe0-b6f7-9bbd0778b46e req-64af37c6-42e0-4944-b950-1de5d335e885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c19119-1997-4996-8890-83f81bea3f82", "name": "network-vif-deleted", "tag": "be21d9e5-dc05-40bf-90fc-a6eb950a496b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:19.720086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c0d6f6f9-1e80-4fe0-b6f7-9bbd0778b46e req-64af37c6-42e0-4944-b950-1de5d335e885 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:19.732978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c0d6f6f9-1e80-4fe0-b6f7-9bbd0778b46e req-64af37c6-42e0-4944-b950-1de5d335e885 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:19.745043 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c0d6f6f9-1e80-4fe0-b6f7-9bbd0778b46e req-64af37c6-42e0-4944-b950-1de5d335e885 service nova] Creating event network-vif-deleted:be21d9e5-dc05-40bf-90fc-a6eb950a496b for instance 99c19119-1997-4996-8890-83f81bea3f82 on nch2-master-1 Mar 05 21:03:19.757135 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c0d6f6f9-1e80-4fe0-b6f7-9bbd0778b46e req-64af37c6-42e0-4944-b950-1de5d335e885 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054788 Mar 05 21:03:19.763924 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1912/3738] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:03:19.781816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c7d34ed0-432a-4922-b0a8-9cb5f5fb04e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:19.782714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c7d34ed0-432a-4922-b0a8-9cb5f5fb04e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:19.789194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7d34ed0-432a-4922-b0a8-9cb5f5fb04e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:19.789886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7d34ed0-432a-4922-b0a8-9cb5f5fb04e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:19.790692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7d34ed0-432a-4922-b0a8-9cb5f5fb04e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:19.805141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7d34ed0-432a-4922-b0a8-9cb5f5fb04e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:20.173865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c7d34ed0-432a-4922-b0a8-9cb5f5fb04e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:20.183516 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c7d34ed0-432a-4922-b0a8-9cb5f5fb04e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1322 microversion: 2.1 time: 0.417334 Mar 05 21:03:20.189173 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1913/3739] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:19 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:20.197385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c874e659-c207-4ba5-a853-db1b1013eaf9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:20.216983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c874e659-c207-4ba5-a853-db1b1013eaf9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:20.233147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c874e659-c207-4ba5-a853-db1b1013eaf9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:20.233612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c874e659-c207-4ba5-a853-db1b1013eaf9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:20.234418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c874e659-c207-4ba5-a853-db1b1013eaf9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:20.234859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c874e659-c207-4ba5-a853-db1b1013eaf9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:20.272557 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-c874e659-c207-4ba5-a853-db1b1013eaf9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance 99c19119-1997-4996-8890-83f81bea3f82 could not be found. Mar 05 21:03:20.274031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c874e659-c207-4ba5-a853-db1b1013eaf9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance 99c19119-1997-4996-8890-83f81bea3f82 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:03:20.276157 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c874e659-c207-4ba5-a853-db1b1013eaf9 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 404 len: 111 microversion: 2.1 time: 0.083138 Mar 05 21:03:20.282884 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1914/3740] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:20 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:03:20.288503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0a120a48-e264-4cf0-af74-ab5994af1d75 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:20.293210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0a120a48-e264-4cf0-af74-ab5994af1d75 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:20.306775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0a120a48-e264-4cf0-af74-ab5994af1d75 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:20.307252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0a120a48-e264-4cf0-af74-ab5994af1d75 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:20.309471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0a120a48-e264-4cf0-af74-ab5994af1d75 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:20.309947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0a120a48-e264-4cf0-af74-ab5994af1d75 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:20.315298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cef3aa83-3aa7-43a5-b546-59378429d028 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:20.330533 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cef3aa83-3aa7-43a5-b546-59378429d028 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1665 microversion: 2.1 time: 1.098063 Mar 05 21:03:20.333707 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1827/3741] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:19 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1665 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:20.378530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0a120a48-e264-4cf0-af74-ab5994af1d75 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:03:20.586431 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0a120a48-e264-4cf0-af74-ab5994af1d75 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 204 len: 0 microversion: 2.1 time: 0.300914 Mar 05 21:03:20.588194 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1915/3742] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:03:20 2022] DELETE /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:03:20.597093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3f40deec-f3d0-4939-8070-f6d2d062f0b1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:20.597722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3f40deec-f3d0-4939-8070-f6d2d062f0b1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:20.614372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f40deec-f3d0-4939-8070-f6d2d062f0b1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:20.615093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f40deec-f3d0-4939-8070-f6d2d062f0b1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:20.616124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f40deec-f3d0-4939-8070-f6d2d062f0b1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:20.619792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f40deec-f3d0-4939-8070-f6d2d062f0b1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:21.208039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-06f13bd4-8afe-477f-9e39-61fcd7421761 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:21.209280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-06f13bd4-8afe-477f-9e39-61fcd7421761 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:21.227975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06f13bd4-8afe-477f-9e39-61fcd7421761 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:21.228670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06f13bd4-8afe-477f-9e39-61fcd7421761 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:21.233625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06f13bd4-8afe-477f-9e39-61fcd7421761 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:21.234299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06f13bd4-8afe-477f-9e39-61fcd7421761 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:21.819962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3f40deec-f3d0-4939-8070-f6d2d062f0b1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:21.830572 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3f40deec-f3d0-4939-8070-f6d2d062f0b1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1494 microversion: 2.1 time: 1.235173 Mar 05 21:03:21.833876 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1828/3743] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:20 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1494 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:21.843552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8899f7d2-8353-4699-aef7-cd4237c1e5c7 req-edc2d693-7575-4c49-854c-ba47fa82efab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d64ade-0446-474b-a3d4-454133f21972", "name": "network-vif-plugged", "status": "completed", "tag": "9825a641-f476-451a-af8d-cff38d8c1ce9"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:21.864057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8899f7d2-8353-4699-aef7-cd4237c1e5c7 req-edc2d693-7575-4c49-854c-ba47fa82efab service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:21.868582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8899f7d2-8353-4699-aef7-cd4237c1e5c7 req-edc2d693-7575-4c49-854c-ba47fa82efab service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:21.903352 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8899f7d2-8353-4699-aef7-cd4237c1e5c7 req-edc2d693-7575-4c49-854c-ba47fa82efab service nova] Creating event network-vif-plugged:9825a641-f476-451a-af8d-cff38d8c1ce9 for instance b2d64ade-0446-474b-a3d4-454133f21972 on nch1-master-1 Mar 05 21:03:21.914864 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-8899f7d2-8353-4699-aef7-cd4237c1e5c7 req-edc2d693-7575-4c49-854c-ba47fa82efab service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079241 Mar 05 21:03:21.916062 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1829/3744] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:22.270862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-06f13bd4-8afe-477f-9e39-61fcd7421761 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:22.303503 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-06f13bd4-8afe-477f-9e39-61fcd7421761 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1322 microversion: 2.1 time: 1.091605 Mar 05 21:03:22.312763 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1916/3745] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:21 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1322 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:22.852224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e86a8c13-78ab-4c38-9cda-90529ff3ae24 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:22.860432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e86a8c13-78ab-4c38-9cda-90529ff3ae24 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:22.881563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e86a8c13-78ab-4c38-9cda-90529ff3ae24 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:22.881843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e86a8c13-78ab-4c38-9cda-90529ff3ae24 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:22.888014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e86a8c13-78ab-4c38-9cda-90529ff3ae24 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:22.897135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e86a8c13-78ab-4c38-9cda-90529ff3ae24 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:23.327808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d663bb7b-dae1-4239-8e9c-2662b04c5b76 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:23.329153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d663bb7b-dae1-4239-8e9c-2662b04c5b76 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:23.340447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d663bb7b-dae1-4239-8e9c-2662b04c5b76 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:23.343141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d663bb7b-dae1-4239-8e9c-2662b04c5b76 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:23.344258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d663bb7b-dae1-4239-8e9c-2662b04c5b76 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:23.346338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d663bb7b-dae1-4239-8e9c-2662b04c5b76 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:23.565841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e86a8c13-78ab-4c38-9cda-90529ff3ae24 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:23.587428 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e86a8c13-78ab-4c38-9cda-90529ff3ae24 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1494 microversion: 2.1 time: 0.730770 Mar 05 21:03:23.601145 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1830/3746] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:22 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1494 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:24.449433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d663bb7b-dae1-4239-8e9c-2662b04c5b76 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:24.458860 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d663bb7b-dae1-4239-8e9c-2662b04c5b76 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1322 microversion: 2.1 time: 1.140676 Mar 05 21:03:24.466515 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1917/3747] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:23 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1322 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:24.607164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-90ec6424-99f5-465a-8fe4-a47e4bc71c89 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:24.608899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-90ec6424-99f5-465a-8fe4-a47e4bc71c89 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:24.618605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90ec6424-99f5-465a-8fe4-a47e4bc71c89 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:24.619241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90ec6424-99f5-465a-8fe4-a47e4bc71c89 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:24.620820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90ec6424-99f5-465a-8fe4-a47e4bc71c89 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:24.624436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90ec6424-99f5-465a-8fe4-a47e4bc71c89 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:24.895950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-90ec6424-99f5-465a-8fe4-a47e4bc71c89 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:24.911253 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-90ec6424-99f5-465a-8fe4-a47e4bc71c89 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1452 microversion: 2.1 time: 0.308025 Mar 05 21:03:24.913197 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1831/3748] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:24 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1452 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:25.478493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d7fd81dd-2526-4911-abf2-7ae38785691a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:25.492268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d7fd81dd-2526-4911-abf2-7ae38785691a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:25.523473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7fd81dd-2526-4911-abf2-7ae38785691a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:25.524392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7fd81dd-2526-4911-abf2-7ae38785691a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:25.527159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7fd81dd-2526-4911-abf2-7ae38785691a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:25.550357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7fd81dd-2526-4911-abf2-7ae38785691a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:25.618759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-c04dd0e4-12f7-44ba-a02e-6472a5fae249 req-a1a00cfa-57b8-4f2c-8ff2-c3e3aba83d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da80a66d-faa9-4917-9003-758b0a8933b2", "name": "network-vif-deleted", "tag": "14c74fe6-8707-41b9-b1e6-fc064c42d3e5"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:25.653126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c04dd0e4-12f7-44ba-a02e-6472a5fae249 req-a1a00cfa-57b8-4f2c-8ff2-c3e3aba83d74 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:25.654021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c04dd0e4-12f7-44ba-a02e-6472a5fae249 req-a1a00cfa-57b8-4f2c-8ff2-c3e3aba83d74 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:25.699846 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-c04dd0e4-12f7-44ba-a02e-6472a5fae249 req-a1a00cfa-57b8-4f2c-8ff2-c3e3aba83d74 service nova] Creating event network-vif-deleted:14c74fe6-8707-41b9-b1e6-fc064c42d3e5 for instance da80a66d-faa9-4917-9003-758b0a8933b2 on nch2-master-1 Mar 05 21:03:25.720118 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-c04dd0e4-12f7-44ba-a02e-6472a5fae249 req-a1a00cfa-57b8-4f2c-8ff2-c3e3aba83d74 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110728 Mar 05 21:03:25.726939 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1832/3749] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:25.932347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-93b69872-93b7-4057-b793-4115701e56f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:25.933641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-93b69872-93b7-4057-b793-4115701e56f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:25.947862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93b69872-93b7-4057-b793-4115701e56f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:25.949000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93b69872-93b7-4057-b793-4115701e56f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:25.950465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93b69872-93b7-4057-b793-4115701e56f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:25.951269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93b69872-93b7-4057-b793-4115701e56f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:26.034218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93b69872-93b7-4057-b793-4115701e56f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:26.034584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93b69872-93b7-4057-b793-4115701e56f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:26.035071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-93b69872-93b7-4057-b793-4115701e56f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lazy-loading 'fault' on Instance uuid da80a66d-faa9-4917-9003-758b0a8933b2 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:03:26.212015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-93b69872-93b7-4057-b793-4115701e56f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:26.227612 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-93b69872-93b7-4057-b793-4115701e56f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 200 len: 1298 microversion: 2.1 time: 0.299153 Mar 05 21:03:26.228527 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1833/3750] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:25 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 1298 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:03:26.300670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f63ccfd8-c289-4150-bde6-e46f6da7e3c8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:26.301729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f63ccfd8-c289-4150-bde6-e46f6da7e3c8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:26.315012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f63ccfd8-c289-4150-bde6-e46f6da7e3c8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:26.317307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f63ccfd8-c289-4150-bde6-e46f6da7e3c8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:26.318354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f63ccfd8-c289-4150-bde6-e46f6da7e3c8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:26.320931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f63ccfd8-c289-4150-bde6-e46f6da7e3c8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:26.437207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d7fd81dd-2526-4911-abf2-7ae38785691a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:26.452474 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d7fd81dd-2526-4911-abf2-7ae38785691a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1322 microversion: 2.1 time: 0.977967 Mar 05 21:03:26.453691 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1918/3751] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:25 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1322 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:26.599945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f63ccfd8-c289-4150-bde6-e46f6da7e3c8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:26.621417 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f63ccfd8-c289-4150-bde6-e46f6da7e3c8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1682 microversion: 2.1 time: 0.323738 Mar 05 21:03:26.623326 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1834/3752] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:26 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1682 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:03:26.739107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5c452f96-a02f-4588-b716-48e1c32445e7 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Calling method '.version_select at 0x7fed61b49820>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:26.834598 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5c452f96-a02f-4588-b716-48e1c32445e7 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa" status: 200 len: 637 microversion: 2.1 time: 0.100252 Mar 05 21:03:26.835200 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1919/3753] 10.222.0.15 () {58 vars in 1232 bytes} [Sat Mar 5 21:03:26 2022] GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa => generated 637 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:26.849131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e278cc0d-5d81-4cdc-9cef-faed7c7387c8 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Action: 'update_all', calling method: .version_select at 0x7fed5c59dd30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:26.930184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-e278cc0d-5d81-4cdc-9cef-faed7c7387c8 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:26.957616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-e278cc0d-5d81-4cdc-9cef-faed7c7387c8 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for user e3c3c7c53ba44843a3ba4d361868eca4 and project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:27.246022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ae7297e3-711f-4d88-8a16-97cbfb35e44b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:27.247368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ae7297e3-711f-4d88-8a16-97cbfb35e44b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:27.255472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae7297e3-711f-4d88-8a16-97cbfb35e44b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:27.260065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae7297e3-711f-4d88-8a16-97cbfb35e44b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:27.261468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae7297e3-711f-4d88-8a16-97cbfb35e44b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:27.266591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae7297e3-711f-4d88-8a16-97cbfb35e44b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:27.297975 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-ae7297e3-711f-4d88-8a16-97cbfb35e44b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance da80a66d-faa9-4917-9003-758b0a8933b2 could not be found. Mar 05 21:03:27.302241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ae7297e3-711f-4d88-8a16-97cbfb35e44b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance da80a66d-faa9-4917-9003-758b0a8933b2 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:03:27.303389 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ae7297e3-711f-4d88-8a16-97cbfb35e44b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 404 len: 111 microversion: 2.1 time: 0.061837 Mar 05 21:03:27.308214 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1920/3754] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:27 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:03:27.366013 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e278cc0d-5d81-4cdc-9cef-faed7c7387c8 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.520705 Mar 05 21:03:27.371003 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1835/3755] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:03:26 2022] PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata => generated 61 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:27.377070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9e0bc461-f84c-4ec7-bf23-98680352296f tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Calling method '.version_select at 0x7fed5c69e310>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:27.440300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1784707949", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "5345ca04-bcd0-4ca9-94fb-fa648ce6d989"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:27.502764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] validate_networks() for [('5345ca04-bcd0-4ca9-94fb-fa648ce6d989', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:03:27.825187 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9e0bc461-f84c-4ec7-bf23-98680352296f tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "DELETE /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.451799 Mar 05 21:03:27.825823 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1921/3756] 10.222.0.15 () {58 vars in 1295 bytes} [Sat Mar 5 21:03:27 2022] DELETE /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata/os_version => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:03:27.833559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-05af925f-9b8d-4b58-9677-47b5b54fb7ac tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:27.834853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-05af925f-9b8d-4b58-9677-47b5b54fb7ac tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:27.844421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05af925f-9b8d-4b58-9677-47b5b54fb7ac tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:27.845323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05af925f-9b8d-4b58-9677-47b5b54fb7ac tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:27.846565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05af925f-9b8d-4b58-9677-47b5b54fb7ac tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:27.847588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05af925f-9b8d-4b58-9677-47b5b54fb7ac tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:28.139959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-05af925f-9b8d-4b58-9677-47b5b54fb7ac tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:28.151809 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-05af925f-9b8d-4b58-9677-47b5b54fb7ac tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1322 microversion: 2.1 time: 0.324158 Mar 05 21:03:28.170601 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1922/3757] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:27 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:28.186551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-548bf876-a462-4dc7-95a5-0057c352f8c1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:28.189587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-548bf876-a462-4dc7-95a5-0057c352f8c1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:28.208551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-548bf876-a462-4dc7-95a5-0057c352f8c1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:28.209714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-548bf876-a462-4dc7-95a5-0057c352f8c1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:28.211768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-548bf876-a462-4dc7-95a5-0057c352f8c1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:28.212986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-548bf876-a462-4dc7-95a5-0057c352f8c1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:28.595428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-548bf876-a462-4dc7-95a5-0057c352f8c1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:28.605442 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-548bf876-a462-4dc7-95a5-0057c352f8c1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.432560 Mar 05 21:03:28.606539 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1923/3758] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:28 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:28.611378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5b6c590c-7e6a-411d-ba41-cef5b1829563 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Calling method '.version_select at 0x7fed5c4cf040>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:28.624770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:03:28.625193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:03:28.625835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:03:28.626633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:03:28.627059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:03:28.644267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:28.645093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:28.646376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:28.647034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:28.691049 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5b6c590c-7e6a-411d-ba41-cef5b1829563 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata" status: 200 len: 37 microversion: 2.1 time: 0.081784 Mar 05 21:03:28.691718 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1924/3759] 10.222.0.15 () {58 vars in 1259 bytes} [Sat Mar 5 21:03:28 2022] GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata => generated 37 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:28.697680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:28.706217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6f9372f6-d0d9-4fd3-9d42-1835d5f94076 req-14977287-387f-4d7c-9fad-11412e929186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08399756-b179-4541-ad3e-3c179e7d7514", "name": "network-vif-plugged", "status": "completed", "tag": "f4c94118-4a65-46a6-8b43-e142d3b1d4fb"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:28.710415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for user cfbceb7c8c104af89e7d21ba411e32a8 and project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:28.733558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6f9372f6-d0d9-4fd3-9d42-1835d5f94076 req-14977287-387f-4d7c-9fad-11412e929186 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:28.734079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6f9372f6-d0d9-4fd3-9d42-1835d5f94076 req-14977287-387f-4d7c-9fad-11412e929186 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:28.739194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:03:28.742516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:03:28.754368 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6f9372f6-d0d9-4fd3-9d42-1835d5f94076 req-14977287-387f-4d7c-9fad-11412e929186 service nova] Creating event network-vif-plugged:f4c94118-4a65-46a6-8b43-e142d3b1d4fb for instance 08399756-b179-4541-ad3e-3c179e7d7514 on nch2-master-1 Mar 05 21:03:28.769164 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6f9372f6-d0d9-4fd3-9d42-1835d5f94076 req-14977287-387f-4d7c-9fad-11412e929186 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076199 Mar 05 21:03:28.770558 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1925/3760] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:28.781768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7844f581-2dcd-4032-bcff-d2a6ef27dc52 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-331591692"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:28.791302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7844f581-2dcd-4032-bcff-d2a6ef27dc52 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:28.805800 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7844f581-2dcd-4032-bcff-d2a6ef27dc52 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:28.830189 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-078e971d-9c7c-45c4-b000-d877c3b0fa83 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.392505 Mar 05 21:03:28.830189 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1836/3761] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:03:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 21:03:28.838559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7844f581-2dcd-4032-bcff-d2a6ef27dc52 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:28.838559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7844f581-2dcd-4032-bcff-d2a6ef27dc52 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:28.838559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7844f581-2dcd-4032-bcff-d2a6ef27dc52 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:28.842397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-317dad13-f829-4154-a534-4f0f2fd7aa8f tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Action: 'update_all', calling method: .version_select at 0x7fed61a85700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:28.985607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-317dad13-f829-4154-a534-4f0f2fd7aa8f tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:29.002075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-317dad13-f829-4154-a534-4f0f2fd7aa8f tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for user e3c3c7c53ba44843a3ba4d361868eca4 and project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:29.507907 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7844f581-2dcd-4032-bcff-d2a6ef27dc52 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.735413 Mar 05 21:03:29.509676 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1926/3762] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:03:28 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Mar 05 21:03:29.533468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67342b98-e416-4dd8-b17b-12048d6404f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:29.558724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-67342b98-e416-4dd8-b17b-12048d6404f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:29.758929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-67342b98-e416-4dd8-b17b-12048d6404f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:29.766917 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-317dad13-f829-4154-a534-4f0f2fd7aa8f tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.936768 Mar 05 21:03:29.768295 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1837/3763] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:03:28 2022] PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata => generated 61 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:29.773971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c562fdea-cfdd-4817-9fb5-8d62a10ddd3c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:29.777242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c562fdea-cfdd-4817-9fb5-8d62a10ddd3c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:29.779195 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67342b98-e416-4dd8-b17b-12048d6404f8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1209 microversion: 2.1 time: 0.267374 Mar 05 21:03:29.781214 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1927/3764] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:29 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1209 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:29.792792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e8d5d74d-95f3-49a2-b005-015b22f40b6a tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Calling method '.version_select at 0x7fed5c69eee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:29.808583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c562fdea-cfdd-4817-9fb5-8d62a10ddd3c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:29.809314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c562fdea-cfdd-4817-9fb5-8d62a10ddd3c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:29.810240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c562fdea-cfdd-4817-9fb5-8d62a10ddd3c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:29.810817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c562fdea-cfdd-4817-9fb5-8d62a10ddd3c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:29.861214 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e8d5d74d-95f3-49a2-b005-015b22f40b6a tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.076298 Mar 05 21:03:29.862466 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1928/3765] 10.222.0.15 () {58 vars in 1289 bytes} [Sat Mar 5 21:03:29 2022] GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata/os_distro => generated 33 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:29.888483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-df59bd0d-464d-415c-b1eb-0cf2de14c358 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Action: 'update_all', calling method: .version_select at 0x7fed5c6603a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:29.977451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-df59bd0d-464d-415c-b1eb-0cf2de14c358 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:29.993393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-df59bd0d-464d-415c-b1eb-0cf2de14c358 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for user e3c3c7c53ba44843a3ba4d361868eca4 and project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:30.208760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c562fdea-cfdd-4817-9fb5-8d62a10ddd3c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:30.217253 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c562fdea-cfdd-4817-9fb5-8d62a10ddd3c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1322 microversion: 2.1 time: 0.447582 Mar 05 21:03:30.218284 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1838/3766] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:29 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1322 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:30.442774 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-df59bd0d-464d-415c-b1eb-0cf2de14c358 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.569743 Mar 05 21:03:30.443391 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1929/3767] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:03:29 2022] PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata => generated 61 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:30.454894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-73e95602-8f8c-44ab-9c8a-c5b8606262bc tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Calling method '.version_select at 0x7fed5c5de310>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:30.510558 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-73e95602-8f8c-44ab-9c8a-c5b8606262bc tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.062044 Mar 05 21:03:30.511290 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1839/3768] 10.222.0.15 () {58 vars in 1259 bytes} [Sat Mar 5 21:03:30 2022] GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata => generated 61 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 05 21:03:30.521484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-de3fb09e-2d2f-4c94-934f-c7e11eefc96b tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Action: 'update_all', calling method: .version_select at 0x7fed61aafca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:30.589689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-de3fb09e-2d2f-4c94-934f-c7e11eefc96b tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:30.617965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-de3fb09e-2d2f-4c94-934f-c7e11eefc96b tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for user e3c3c7c53ba44843a3ba4d361868eca4 and project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:30.798671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-28c4d93f-7b56-4d94-a702-d27ad22963c8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:30.799301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-28c4d93f-7b56-4d94-a702-d27ad22963c8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:30.827852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28c4d93f-7b56-4d94-a702-d27ad22963c8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:30.830416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28c4d93f-7b56-4d94-a702-d27ad22963c8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:30.832808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28c4d93f-7b56-4d94-a702-d27ad22963c8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:30.836862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28c4d93f-7b56-4d94-a702-d27ad22963c8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:31.118831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-28c4d93f-7b56-4d94-a702-d27ad22963c8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:31.124500 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-de3fb09e-2d2f-4c94-934f-c7e11eefc96b tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.606582 Mar 05 21:03:31.125758 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1930/3769] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:03:30 2022] PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata => generated 61 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:31.134491 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-28c4d93f-7b56-4d94-a702-d27ad22963c8 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1279 microversion: 2.1 time: 0.342076 Mar 05 21:03:31.138223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-21f19b54-f61a-43c7-82e7-74c64de70953 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Action: 'update_all', calling method: .version_select at 0x7fed61aafb80>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:31.145643 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1840/3770] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:30 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1279 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:03:31.209440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-21f19b54-f61a-43c7-82e7-74c64de70953 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:31.229300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-21f19b54-f61a-43c7-82e7-74c64de70953 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for user e3c3c7c53ba44843a3ba4d361868eca4 and project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:31.236002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e5af0034-79ff-4c48-82fe-738320032335 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:31.236710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e5af0034-79ff-4c48-82fe-738320032335 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:31.248423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5af0034-79ff-4c48-82fe-738320032335 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:31.249879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5af0034-79ff-4c48-82fe-738320032335 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:31.253162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5af0034-79ff-4c48-82fe-738320032335 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:31.253643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5af0034-79ff-4c48-82fe-738320032335 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:31.813489 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-21f19b54-f61a-43c7-82e7-74c64de70953 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata" status: 200 len: 64 microversion: 2.1 time: 0.680459 Mar 05 21:03:31.814921 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1931/3771] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:03:31 2022] PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata => generated 64 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:31.819880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e78b90c5-89a7-4281-b298-7b3e06089582 req-f764a50b-6433-4d3f-8a22-b7721edfac8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc548a05-5226-41f0-a34d-1d44defee56c", "name": "network-vif-unplugged", "status": "completed", "tag": "30ad7984-3b01-4aac-9f3b-d69f10ea737a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:31.850261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e78b90c5-89a7-4281-b298-7b3e06089582 req-f764a50b-6433-4d3f-8a22-b7721edfac8c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:31.852150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e78b90c5-89a7-4281-b298-7b3e06089582 req-f764a50b-6433-4d3f-8a22-b7721edfac8c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:31.880702 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e78b90c5-89a7-4281-b298-7b3e06089582 req-f764a50b-6433-4d3f-8a22-b7721edfac8c service nova] Creating event network-vif-unplugged:30ad7984-3b01-4aac-9f3b-d69f10ea737a for instance dc548a05-5226-41f0-a34d-1d44defee56c on nch1-master-1 Mar 05 21:03:31.894353 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e78b90c5-89a7-4281-b298-7b3e06089582 req-f764a50b-6433-4d3f-8a22-b7721edfac8c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077825 Mar 05 21:03:31.899300 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1932/3772] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:31.904143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e5af0034-79ff-4c48-82fe-738320032335 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:31.910279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0b15cf78-1add-49f5-a16e-a715b0c3b4db tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Calling method '.version_select at 0x7fed5c2bdca0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:31.913611 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e5af0034-79ff-4c48-82fe-738320032335 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1515 microversion: 2.1 time: 0.682626 Mar 05 21:03:31.931162 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1841/3773] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:31 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1515 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:31.943034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-341bf43e-8d0e-4f7d-aa79-466929ce0e57 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:31.944110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-341bf43e-8d0e-4f7d-aa79-466929ce0e57 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:31.974341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-341bf43e-8d0e-4f7d-aa79-466929ce0e57 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:31.975180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-341bf43e-8d0e-4f7d-aa79-466929ce0e57 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:31.976040 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0b15cf78-1add-49f5-a16e-a715b0c3b4db tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata" status: 200 len: 64 microversion: 2.1 time: 0.075028 Mar 05 21:03:31.976422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-341bf43e-8d0e-4f7d-aa79-466929ce0e57 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:31.977061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-341bf43e-8d0e-4f7d-aa79-466929ce0e57 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:31.977663 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1933/3774] 10.222.0.15 () {58 vars in 1259 bytes} [Sat Mar 5 21:03:31 2022] GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata => generated 64 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:31.990639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d49c3ba5-a0af-49c5-9932-85f11efe08f5 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Action: 'update_all', calling method: .version_select at 0x7fed5c79c4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:32.025403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-341bf43e-8d0e-4f7d-aa79-466929ce0e57 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lazy-loading 'flavor' on Instance uuid 08399756-b179-4541-ad3e-3c179e7d7514 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:03:32.074058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d49c3ba5-a0af-49c5-9932-85f11efe08f5 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:32.086979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d49c3ba5-a0af-49c5-9932-85f11efe08f5 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for user e3c3c7c53ba44843a3ba4d361868eca4 and project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:32.228751 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-341bf43e-8d0e-4f7d-aa79-466929ce0e57 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514/action" status: 200 len: 32 microversion: 2.1 time: 0.293561 Mar 05 21:03:32.229943 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1842/3775] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:03:31 2022] POST /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514/action => generated 32 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:32.241589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2927e52d-8548-4870-a581-41f1b4f42168 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:32.242472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2927e52d-8548-4870-a581-41f1b4f42168 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:32.259801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2927e52d-8548-4870-a581-41f1b4f42168 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:32.260301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2927e52d-8548-4870-a581-41f1b4f42168 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:32.264311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2927e52d-8548-4870-a581-41f1b4f42168 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:32.264797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2927e52d-8548-4870-a581-41f1b4f42168 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:32.377496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2927e52d-8548-4870-a581-41f1b4f42168 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:32.385355 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2927e52d-8548-4870-a581-41f1b4f42168 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1267 microversion: 2.1 time: 0.153996 Mar 05 21:03:32.393007 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1843/3776] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:32 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:32.406737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f01f9057-0537-4768-bba4-3acd9143f05b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:32.407608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f01f9057-0537-4768-bba4-3acd9143f05b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:32.420705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f01f9057-0537-4768-bba4-3acd9143f05b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:32.421213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f01f9057-0537-4768-bba4-3acd9143f05b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:32.422043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f01f9057-0537-4768-bba4-3acd9143f05b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:32.422500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f01f9057-0537-4768-bba4-3acd9143f05b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:32.572991 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d49c3ba5-a0af-49c5-9932-85f11efe08f5 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.588644 Mar 05 21:03:32.575311 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1934/3777] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:03:31 2022] PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata => generated 61 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:32.586425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a114e9c9-92eb-46f1-ad47-4a94653a0697 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Action: 'update', calling method: .version_select at 0x7fed61aafa60>, body: {"meta": {"os_version": "alt"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:32.669165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-a114e9c9-92eb-46f1-ad47-4a94653a0697 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:32.681848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-a114e9c9-92eb-46f1-ad47-4a94653a0697 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for user e3c3c7c53ba44843a3ba4d361868eca4 and project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:32.843616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f01f9057-0537-4768-bba4-3acd9143f05b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:32.851214 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f01f9057-0537-4768-bba4-3acd9143f05b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.456673 Mar 05 21:03:32.860757 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1844/3778] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:32 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:33.185794 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a114e9c9-92eb-46f1-ad47-4a94653a0697 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.605686 Mar 05 21:03:33.190216 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1935/3779] 10.222.0.15 () {60 vars in 1312 bytes} [Sat Mar 5 21:03:32 2022] PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata/os_version => generated 31 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:33.195527 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-be29b8dc-757a-446e-b989-cc79760792fa tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Calling method '.version_select at 0x7fed5c97baf0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:33.410735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ff49357-3057-4231-a9ff-0cdd41a01c05 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:33.411976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ff49357-3057-4231-a9ff-0cdd41a01c05 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:33.437592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ff49357-3057-4231-a9ff-0cdd41a01c05 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:33.438105 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ff49357-3057-4231-a9ff-0cdd41a01c05 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:33.438970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ff49357-3057-4231-a9ff-0cdd41a01c05 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:33.439434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ff49357-3057-4231-a9ff-0cdd41a01c05 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:33.648631 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-be29b8dc-757a-446e-b989-cc79760792fa tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata" status: 200 len: 58 microversion: 2.1 time: 0.454624 Mar 05 21:03:33.652546 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1845/3780] 10.222.0.15 () {58 vars in 1259 bytes} [Sat Mar 5 21:03:33 2022] GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata => generated 58 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:33.664898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-46280da7-66b0-47b6-8664-f75dea32b904 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Action: 'update_all', calling method: .version_select at 0x7fed5c7e5160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:33.771125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-46280da7-66b0-47b6-8664-f75dea32b904 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:33.786136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-46280da7-66b0-47b6-8664-f75dea32b904 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for user e3c3c7c53ba44843a3ba4d361868eca4 and project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:34.312220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4ff49357-3057-4231-a9ff-0cdd41a01c05 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:34.313399 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4ff49357-3057-4231-a9ff-0cdd41a01c05 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1309 microversion: 2.1 time: 0.907042 Mar 05 21:03:34.319930 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1936/3781] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:33 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1309 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:34.332790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2fa0c637-2c01-47e3-a6f4-b9f68793d9e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:34.333712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2fa0c637-2c01-47e3-a6f4-b9f68793d9e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:34.353423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2fa0c637-2c01-47e3-a6f4-b9f68793d9e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:34.353878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2fa0c637-2c01-47e3-a6f4-b9f68793d9e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:34.355409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2fa0c637-2c01-47e3-a6f4-b9f68793d9e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:34.356082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2fa0c637-2c01-47e3-a6f4-b9f68793d9e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:34.630634 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-46280da7-66b0-47b6-8664-f75dea32b904 tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata" status: 200 len: 61 microversion: 2.1 time: 0.972239 Mar 05 21:03:34.631261 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1846/3782] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:03:33 2022] PUT /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata => generated 61 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:34.642086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7fcb8a61-4594-42b9-8fb0-b9a33b4b181f tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Action: 'create', calling method: .version_select at 0x7fed61b908b0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:34.770996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-7fcb8a61-4594-42b9-8fb0-b9a33b4b181f tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:34.799401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-7fcb8a61-4594-42b9-8fb0-b9a33b4b181f tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Getting quotas for user e3c3c7c53ba44843a3ba4d361868eca4 and project facdc1abc1c5436b9cdafbd49df7e3a5. Resources: dict_keys(['metadata_items']) {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:35.017271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2fa0c637-2c01-47e3-a6f4-b9f68793d9e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:35.049303 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2fa0c637-2c01-47e3-a6f4-b9f68793d9e2 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.726569 Mar 05 21:03:35.050525 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1937/3783] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:34 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:35.226523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-95eeb728-e702-4030-94c4-be59571e1518 req-d6b72a45-ba2f-43ce-9252-ae7adadaf939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f56e76ef-62db-4859-abb3-59ad080e4cd8", "tag": "55b34c36-4d53-403e-b4b8-49a822397911"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:35.246930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-95eeb728-e702-4030-94c4-be59571e1518 req-d6b72a45-ba2f-43ce-9252-ae7adadaf939 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:35.247383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-95eeb728-e702-4030-94c4-be59571e1518 req-d6b72a45-ba2f-43ce-9252-ae7adadaf939 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:35.302005 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-95eeb728-e702-4030-94c4-be59571e1518 req-d6b72a45-ba2f-43ce-9252-ae7adadaf939 service nova] Creating event network-changed:55b34c36-4d53-403e-b4b8-49a822397911 for instance f56e76ef-62db-4859-abb3-59ad080e4cd8 on nch1-master-1 Mar 05 21:03:35.332862 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-95eeb728-e702-4030-94c4-be59571e1518 req-d6b72a45-ba2f-43ce-9252-ae7adadaf939 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103740 Mar 05 21:03:35.337987 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1938/3784] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:03:35.367993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2e7d5052-33e9-4c9b-801c-b24d916d6ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:35.376766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2e7d5052-33e9-4c9b-801c-b24d916d6ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:35.410116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e7d5052-33e9-4c9b-801c-b24d916d6ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:35.411480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e7d5052-33e9-4c9b-801c-b24d916d6ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:35.418908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e7d5052-33e9-4c9b-801c-b24d916d6ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:35.419647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e7d5052-33e9-4c9b-801c-b24d916d6ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:35.955248 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7fcb8a61-4594-42b9-8fb0-b9a33b4b181f tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "POST /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata" status: 200 len: 85 microversion: 2.1 time: 1.317695 Mar 05 21:03:35.957751 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1847/3785] 10.222.0.15 () {60 vars in 1280 bytes} [Sat Mar 5 21:03:34 2022] POST /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata => generated 85 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:35.969526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1ec6a73a-d224-4c2f-a75f-b51925fac73e tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] Calling method '.version_select at 0x7fed5c6cdca0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:36.071280 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1ec6a73a-d224-4c2f-a75f-b51925fac73e tempest-ImagesMetadataTestJSON-1212982279 tempest-ImagesMetadataTestJSON-1212982279-project] 10.222.0.15 "GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata" status: 200 len: 85 microversion: 2.1 time: 0.107207 Mar 05 21:03:36.078799 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1848/3786] 10.222.0.15 () {58 vars in 1259 bytes} [Sat Mar 5 21:03:35 2022] GET /compute/v2.1/images/dd08f739-0ee8-4252-a9ad-278d73404daa/metadata => generated 85 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:36.090926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9dfc3a91-f175-4cc2-87a1-eb2b523de533 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:36.092095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9dfc3a91-f175-4cc2-87a1-eb2b523de533 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:36.115758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9dfc3a91-f175-4cc2-87a1-eb2b523de533 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:36.116547 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9dfc3a91-f175-4cc2-87a1-eb2b523de533 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:36.118141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9dfc3a91-f175-4cc2-87a1-eb2b523de533 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:36.121645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9dfc3a91-f175-4cc2-87a1-eb2b523de533 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:36.426547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2e7d5052-33e9-4c9b-801c-b24d916d6ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:36.438039 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2e7d5052-33e9-4c9b-801c-b24d916d6ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1309 microversion: 2.1 time: 1.096470 Mar 05 21:03:36.447561 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1939/3787] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:35 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1309 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:37.310417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9dfc3a91-f175-4cc2-87a1-eb2b523de533 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:37.331176 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9dfc3a91-f175-4cc2-87a1-eb2b523de533 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 1.248069 Mar 05 21:03:37.343891 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1849/3788] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:36 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:37.455419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5ee76e2d-0b10-4539-b1bf-4250165c6694 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:37.456073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5ee76e2d-0b10-4539-b1bf-4250165c6694 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:37.465217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ee76e2d-0b10-4539-b1bf-4250165c6694 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:37.471697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ee76e2d-0b10-4539-b1bf-4250165c6694 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:37.474531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ee76e2d-0b10-4539-b1bf-4250165c6694 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:37.476791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ee76e2d-0b10-4539-b1bf-4250165c6694 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:37.871176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5ee76e2d-0b10-4539-b1bf-4250165c6694 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:37.925796 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5ee76e2d-0b10-4539-b1bf-4250165c6694 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1309 microversion: 2.1 time: 0.466751 Mar 05 21:03:37.945067 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1940/3789] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:37 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1309 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:38.351894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5d0df102-6bd8-4d12-b22f-2a297924875a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:38.352520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5d0df102-6bd8-4d12-b22f-2a297924875a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:38.375934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d0df102-6bd8-4d12-b22f-2a297924875a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:38.376602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d0df102-6bd8-4d12-b22f-2a297924875a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:38.377674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d0df102-6bd8-4d12-b22f-2a297924875a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:38.378870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d0df102-6bd8-4d12-b22f-2a297924875a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:38.908852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-aaeb08de-675f-444c-90cd-9eff57fc2314 req-c893c8ed-9289-43b9-8662-6204249d21c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc548a05-5226-41f0-a34d-1d44defee56c", "name": "network-vif-plugged", "status": "completed", "tag": "30ad7984-3b01-4aac-9f3b-d69f10ea737a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:38.937489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-aaeb08de-675f-444c-90cd-9eff57fc2314 req-c893c8ed-9289-43b9-8662-6204249d21c7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:38.937953 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-aaeb08de-675f-444c-90cd-9eff57fc2314 req-c893c8ed-9289-43b9-8662-6204249d21c7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:38.987392 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-aaeb08de-675f-444c-90cd-9eff57fc2314 req-c893c8ed-9289-43b9-8662-6204249d21c7 service nova] Creating event network-vif-plugged:30ad7984-3b01-4aac-9f3b-d69f10ea737a for instance dc548a05-5226-41f0-a34d-1d44defee56c on nch1-master-1 Mar 05 21:03:39.018609 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-aaeb08de-675f-444c-90cd-9eff57fc2314 req-c893c8ed-9289-43b9-8662-6204249d21c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113606 Mar 05 21:03:39.036789 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1941/3790] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:03:39.063259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0cca9f41-aaf2-46a1-9b3a-d3fe3face493 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:39.064014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0cca9f41-aaf2-46a1-9b3a-d3fe3face493 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:39.149787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cca9f41-aaf2-46a1-9b3a-d3fe3face493 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:39.152171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cca9f41-aaf2-46a1-9b3a-d3fe3face493 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:39.153030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cca9f41-aaf2-46a1-9b3a-d3fe3face493 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:39.153496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cca9f41-aaf2-46a1-9b3a-d3fe3face493 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:39.163057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5d0df102-6bd8-4d12-b22f-2a297924875a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:39.176082 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5d0df102-6bd8-4d12-b22f-2a297924875a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.828573 Mar 05 21:03:39.177476 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1850/3791] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:38 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:39.596814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0cca9f41-aaf2-46a1-9b3a-d3fe3face493 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:39.627722 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0cca9f41-aaf2-46a1-9b3a-d3fe3face493 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1309 microversion: 2.1 time: 0.588322 Mar 05 21:03:39.629361 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1942/3792] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:39 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1309 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:40.194283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-13a7c2af-6544-4ada-bb95-960bbd228a54 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:40.195904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-13a7c2af-6544-4ada-bb95-960bbd228a54 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:40.233019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13a7c2af-6544-4ada-bb95-960bbd228a54 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:40.238287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13a7c2af-6544-4ada-bb95-960bbd228a54 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:40.242675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13a7c2af-6544-4ada-bb95-960bbd228a54 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:40.246349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13a7c2af-6544-4ada-bb95-960bbd228a54 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:40.689537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a633eb3f-65d9-4200-905d-5ebf7eba6e8c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:40.692666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a633eb3f-65d9-4200-905d-5ebf7eba6e8c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:40.735865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a633eb3f-65d9-4200-905d-5ebf7eba6e8c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:40.738979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a633eb3f-65d9-4200-905d-5ebf7eba6e8c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:40.741799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a633eb3f-65d9-4200-905d-5ebf7eba6e8c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:40.743620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a633eb3f-65d9-4200-905d-5ebf7eba6e8c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:40.950231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-13a7c2af-6544-4ada-bb95-960bbd228a54 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:40.958871 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-13a7c2af-6544-4ada-bb95-960bbd228a54 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.768702 Mar 05 21:03:40.974489 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1851/3793] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:40 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:41.466783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a633eb3f-65d9-4200-905d-5ebf7eba6e8c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:41.482975 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a633eb3f-65d9-4200-905d-5ebf7eba6e8c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1309 microversion: 2.1 time: 0.804616 Mar 05 21:03:41.492456 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1943/3794] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:40 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1309 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:41.979866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aab45e43-af25-4ee3-b613-638256a9bdff tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:41.980800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aab45e43-af25-4ee3-b613-638256a9bdff tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:41.999063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aab45e43-af25-4ee3-b613-638256a9bdff tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:41.999601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aab45e43-af25-4ee3-b613-638256a9bdff tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:42.000478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aab45e43-af25-4ee3-b613-638256a9bdff tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:42.000937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aab45e43-af25-4ee3-b613-638256a9bdff tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:42.496067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aab45e43-af25-4ee3-b613-638256a9bdff tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:42.500777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9768e2e3-b9a4-4dcb-b0bc-16f6be528466 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:42.501530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9768e2e3-b9a4-4dcb-b0bc-16f6be528466 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:42.507256 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aab45e43-af25-4ee3-b613-638256a9bdff tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.533048 Mar 05 21:03:42.508111 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1852/3795] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:41 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:42.519061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9768e2e3-b9a4-4dcb-b0bc-16f6be528466 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:42.521996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9768e2e3-b9a4-4dcb-b0bc-16f6be528466 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:42.524499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9768e2e3-b9a4-4dcb-b0bc-16f6be528466 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:42.525183 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9768e2e3-b9a4-4dcb-b0bc-16f6be528466 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:42.885035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9768e2e3-b9a4-4dcb-b0bc-16f6be528466 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:42.907518 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9768e2e3-b9a4-4dcb-b0bc-16f6be528466 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1309 microversion: 2.1 time: 0.411123 Mar 05 21:03:42.910547 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1944/3796] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:42 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1309 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:43.489716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f3969bc4-2ccf-4bb8-bee9-b6f7651b9055 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Action: 'create', calling method: .version_select at 0x7fed5cfc8af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-729993578", "description": "tempest-description-1282675127"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:43.528438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c9d33764-8195-42da-96f3-ef07d9a29730 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:43.529085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c9d33764-8195-42da-96f3-ef07d9a29730 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:43.579347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9d33764-8195-42da-96f3-ef07d9a29730 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:43.583284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9d33764-8195-42da-96f3-ef07d9a29730 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:43.584247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9d33764-8195-42da-96f3-ef07d9a29730 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:43.584746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9d33764-8195-42da-96f3-ef07d9a29730 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:43.804795 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f3969bc4-2ccf-4bb8-bee9-b6f7651b9055 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.540329 Mar 05 21:03:43.805826 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1853/3797] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 21:03:43 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:43.820721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0cab765a-9b65-48e3-ad4e-015260be0ce0 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Action: 'create', calling method: .version_select at 0x7fed61bced30>, body: {"security_group_rule": {"parent_group_id": "ec0a490e-a4ba-4fd1-adf3-6faa9c121265", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:44.098964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c9d33764-8195-42da-96f3-ef07d9a29730 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:44.120754 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c9d33764-8195-42da-96f3-ef07d9a29730 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.598176 Mar 05 21:03:44.123515 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1945/3798] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:43 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:03:44.146792 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0cab765a-9b65-48e3-ad4e-015260be0ce0 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.332282 Mar 05 21:03:44.149042 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1854/3799] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 21:03:43 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:44.163754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-15009a78-8598-42ce-8287-b83322e332a4 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Action: 'create', calling method: .version_select at 0x7fed61b900d0>, body: {"security_group_rule": {"parent_group_id": "ec0a490e-a4ba-4fd1-adf3-6faa9c121265", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:44.168644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c4b916b2-9996-4966-8eb3-fb9e7bb01363 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:44.169393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c4b916b2-9996-4966-8eb3-fb9e7bb01363 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:44.211245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4b916b2-9996-4966-8eb3-fb9e7bb01363 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:44.212194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4b916b2-9996-4966-8eb3-fb9e7bb01363 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:44.220538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4b916b2-9996-4966-8eb3-fb9e7bb01363 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:44.221228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4b916b2-9996-4966-8eb3-fb9e7bb01363 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:44.239377 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-15009a78-8598-42ce-8287-b83322e332a4 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] HTTP exception thrown: This rule already exists in group ec0a490e-a4ba-4fd1-adf3-6faa9c121265 Mar 05 21:03:44.240045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-15009a78-8598-42ce-8287-b83322e332a4 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Returning 400 to user: This rule already exists in group ec0a490e-a4ba-4fd1-adf3-6faa9c121265 {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:03:44.240912 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-15009a78-8598-42ce-8287-b83322e332a4 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.085242 Mar 05 21:03:44.241510 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1855/3800] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 21:03:44 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 05 21:03:44.262574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f197f178-6382-4909-ae24-a8104a71facc tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Calling method '.version_select at 0x7fed61a43280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:44.580981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c4b916b2-9996-4966-8eb3-fb9e7bb01363 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:44.589595 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c4b916b2-9996-4966-8eb3-fb9e7bb01363 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1309 microversion: 2.1 time: 0.458169 Mar 05 21:03:44.592360 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1946/3801] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:44 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1309 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:44.622140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6f1390fb-a434-432e-b043-294bc93a434c req-de975a4d-c65d-46e7-94ee-16599dedc00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56e76ef-62db-4859-abb3-59ad080e4cd8", "name": "network-vif-plugged", "status": "completed", "tag": "55b34c36-4d53-403e-b4b8-49a822397911"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:44.639345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6f1390fb-a434-432e-b043-294bc93a434c req-de975a4d-c65d-46e7-94ee-16599dedc00e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:44.640418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6f1390fb-a434-432e-b043-294bc93a434c req-de975a4d-c65d-46e7-94ee-16599dedc00e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:44.688457 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6f1390fb-a434-432e-b043-294bc93a434c req-de975a4d-c65d-46e7-94ee-16599dedc00e service nova] Creating event network-vif-plugged:55b34c36-4d53-403e-b4b8-49a822397911 for instance f56e76ef-62db-4859-abb3-59ad080e4cd8 on nch1-master-1 Mar 05 21:03:44.702481 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6f1390fb-a434-432e-b043-294bc93a434c req-de975a4d-c65d-46e7-94ee-16599dedc00e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083932 Mar 05 21:03:44.704854 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1947/3802] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:03:44.833955 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f197f178-6382-4909-ae24-a8104a71facc tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-group-rules/103e45be-e130-41f5-98a8-7505d30aa026" status: 202 len: 0 microversion: 2.1 time: 0.577688 Mar 05 21:03:44.834747 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1856/3803] 10.222.0.15 () {58 vars in 1286 bytes} [Sat Mar 5 21:03:44 2022] DELETE /compute/v2.1/os-security-group-rules/103e45be-e130-41f5-98a8-7505d30aa026 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 21:03:44.851957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dda2caab-7e6b-4c89-9fad-8f14a43d6b94 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Action: 'create', calling method: .version_select at 0x7fed5c2bd0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1329301721", "description": "tempest-description-14444266"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:45.141001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1a1914c0-57aa-4bd4-972d-3aee537fecaf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:45.141640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1a1914c0-57aa-4bd4-972d-3aee537fecaf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:45.159583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a1914c0-57aa-4bd4-972d-3aee537fecaf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:45.160205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a1914c0-57aa-4bd4-972d-3aee537fecaf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:45.165148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a1914c0-57aa-4bd4-972d-3aee537fecaf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:45.172781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a1914c0-57aa-4bd4-972d-3aee537fecaf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:45.314952 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dda2caab-7e6b-4c89-9fad-8f14a43d6b94 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.473952 Mar 05 21:03:45.315576 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1948/3804] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 21:03:44 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:45.327894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f8a2d57d-af13-4c6d-9f39-c04fced3a3c4 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Action: 'create', calling method: .version_select at 0x7fed5c79cf70>, body: {"security_group_rule": {"parent_group_id": "1c21f190-5ef8-450d-9a97-190452bb4892", "ip_protocol": "tcp", "from_port": 1202902916, "to_port": 22}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:45.434487 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-f8a2d57d-af13-4c6d-9f39-c04fced3a3c4 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] HTTP exception thrown: Invalid port range 1202902916:22. Former value cannot be greater than the later Mar 05 21:03:45.435638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f8a2d57d-af13-4c6d-9f39-c04fced3a3c4 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Returning 400 to user: Invalid port range 1202902916:22. Former value cannot be greater than the later {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:03:45.436624 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f8a2d57d-af13-4c6d-9f39-c04fced3a3c4 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.113521 Mar 05 21:03:45.437591 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1949/3805] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 21:03:45 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 05 21:03:45.447483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0158ed9e-f4c3-44c3-ae9e-bc2b308666f3 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Action: 'create', calling method: .version_select at 0x7fed5c69eee0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1789283208", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:45.452296 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-0158ed9e-f4c3-44c3-ae9e-bc2b308666f3 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] HTTP exception thrown: Security group id should be uuid Mar 05 21:03:45.454000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0158ed9e-f4c3-44c3-ae9e-bc2b308666f3 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Returning 400 to user: Security group id should be uuid {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:03:45.456468 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0158ed9e-f4c3-44c3-ae9e-bc2b308666f3 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.013718 Mar 05 21:03:45.460044 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1950/3806] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 21:03:45 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Mar 05 21:03:45.489045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-78a77c8a-3aaf-408a-97cf-ecade919fd96 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Action: 'create', calling method: .version_select at 0x7fed5cee5f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1704835372", "description": "tempest-description-1726160415"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:45.590254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1a1914c0-57aa-4bd4-972d-3aee537fecaf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:45.598046 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1a1914c0-57aa-4bd4-972d-3aee537fecaf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.461476 Mar 05 21:03:45.605292 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1857/3807] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:45 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:03:45.625151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-66ec088b-48ed-4dc5-8143-ee74f7afcb16 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:45.639393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-66ec088b-48ed-4dc5-8143-ee74f7afcb16 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:45.646920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66ec088b-48ed-4dc5-8143-ee74f7afcb16 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:45.648469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66ec088b-48ed-4dc5-8143-ee74f7afcb16 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:45.649520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66ec088b-48ed-4dc5-8143-ee74f7afcb16 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:45.652420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66ec088b-48ed-4dc5-8143-ee74f7afcb16 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:45.926836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-66ec088b-48ed-4dc5-8143-ee74f7afcb16 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:45.936204 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-66ec088b-48ed-4dc5-8143-ee74f7afcb16 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1309 microversion: 2.1 time: 0.314811 Mar 05 21:03:45.937554 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1858/3808] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:45 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1309 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:46.034934 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-78a77c8a-3aaf-408a-97cf-ecade919fd96 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.561388 Mar 05 21:03:46.036646 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1951/3809] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 21:03:45 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:46.053523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8bf2e9e6-3832-441e-a3b9-0af801b0d3aa tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Action: 'create', calling method: .version_select at 0x7fed5c5dea60>, body: {"security_group_rule": {"parent_group_id": "fcf7224b-1d46-4184-830b-1a7c40baea3f", "ip_protocol": "tempest-999-1096096984", "from_port": 22, "to_port": 22}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:46.150519 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-8bf2e9e6-3832-441e-a3b9-0af801b0d3aa tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] HTTP exception thrown: Invalid IP protocol tempest-999-1096096984. Mar 05 21:03:46.153048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8bf2e9e6-3832-441e-a3b9-0af801b0d3aa tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Returning 400 to user: Invalid IP protocol tempest-999-1096096984. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:03:46.156442 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8bf2e9e6-3832-441e-a3b9-0af801b0d3aa tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.109660 Mar 05 21:03:46.158145 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1859/3810] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 21:03:46 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 05 21:03:46.167443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ef1dd56c-3e0a-4ba4-99eb-5a6647d98ded tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Action: 'create', calling method: .version_select at 0x7fed5c79cf70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-984430424", "description": "tempest-description-609461559"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:46.624192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d84952b3-99cf-4513-abe6-1ba721c41b98 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:46.624620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d84952b3-99cf-4513-abe6-1ba721c41b98 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:46.636460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d84952b3-99cf-4513-abe6-1ba721c41b98 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:46.639915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d84952b3-99cf-4513-abe6-1ba721c41b98 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:46.641043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d84952b3-99cf-4513-abe6-1ba721c41b98 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:46.642874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d84952b3-99cf-4513-abe6-1ba721c41b98 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:47.045406 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ef1dd56c-3e0a-4ba4-99eb-5a6647d98ded tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.882305 Mar 05 21:03:47.046737 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1952/3811] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 21:03:46 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:47.058261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f83116e6-a8f0-425d-942a-a50238af9358 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:47.064449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f83116e6-a8f0-425d-942a-a50238af9358 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:47.098243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f83116e6-a8f0-425d-942a-a50238af9358 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:47.107415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f83116e6-a8f0-425d-942a-a50238af9358 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:47.112124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f83116e6-a8f0-425d-942a-a50238af9358 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:47.116977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f83116e6-a8f0-425d-942a-a50238af9358 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:47.129615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d84952b3-99cf-4513-abe6-1ba721c41b98 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:47.150909 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d84952b3-99cf-4513-abe6-1ba721c41b98 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.526243 Mar 05 21:03:47.152228 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1860/3812] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:46 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:47.173398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7ffab37a-c175-47fa-b15d-5befcf74d96c tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Action: 'create', calling method: .version_select at 0x7fed5c9edaf0>, body: {"security_group_rule": {"parent_group_id": "a29c7ee3-e136-43cd-aab9-8286ccbf8d8d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:47.270589 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-7ffab37a-c175-47fa-b15d-5befcf74d96c tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Mar 05 21:03:47.271235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7ffab37a-c175-47fa-b15d-5befcf74d96c tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:03:47.272327 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7ffab37a-c175-47fa-b15d-5befcf74d96c tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.118929 Mar 05 21:03:47.273175 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1861/3813] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 21:03:47 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:03:47.285855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1c28311f-ab47-4c95-a1fd-1bfdabde6ffa tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Action: 'create', calling method: .version_select at 0x7fed5c7e50d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-418789986", "description": "tempest-description-1869688470"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:47.732179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f83116e6-a8f0-425d-942a-a50238af9358 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:47.750441 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f83116e6-a8f0-425d-942a-a50238af9358 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1490 microversion: 2.1 time: 0.700576 Mar 05 21:03:47.766087 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1953/3814] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:47 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1490 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:47.785149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c2fc00d-56ef-4070-9f2e-0de5409fd657 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:47.790421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9c2fc00d-56ef-4070-9f2e-0de5409fd657 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:47.803840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c2fc00d-56ef-4070-9f2e-0de5409fd657 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:47.804634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c2fc00d-56ef-4070-9f2e-0de5409fd657 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:47.805637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c2fc00d-56ef-4070-9f2e-0de5409fd657 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:47.806267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c2fc00d-56ef-4070-9f2e-0de5409fd657 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:47.822309 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1c28311f-ab47-4c95-a1fd-1bfdabde6ffa tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.540972 Mar 05 21:03:47.824590 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1862/3815] 10.222.0.15 () {60 vars in 1179 bytes} [Sat Mar 5 21:03:47 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:47.843949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-917b8c20-272d-4c6e-9528-2f671c3d130e tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Action: 'create', calling method: .version_select at 0x7fed5c605a60>, body: {"security_group_rule": {"parent_group_id": "a4db4e49-8d8e-4803-96bf-6acf7339940b", "ip_protocol": "tcp", "from_port": 22, "to_port": 645414861}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:48.009343 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c2fc00d-56ef-4070-9f2e-0de5409fd657 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "PUT /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1085 microversion: 2.1 time: 0.241696 Mar 05 21:03:48.011272 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1954/3816] 10.222.0.15 () {60 vars in 1255 bytes} [Sat Mar 5 21:03:47 2022] PUT /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1085 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:48.029672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ad58bc51-f90d-450e-843b-13df70875050 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:48.030932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ad58bc51-f90d-450e-843b-13df70875050 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:48.040522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad58bc51-f90d-450e-843b-13df70875050 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:48.041304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad58bc51-f90d-450e-843b-13df70875050 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:48.043345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad58bc51-f90d-450e-843b-13df70875050 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:48.044979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad58bc51-f90d-450e-843b-13df70875050 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:48.121765 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-917b8c20-272d-4c6e-9528-2f671c3d130e tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] HTTP exception thrown: Invalid port range 22:645414861. Valid TCP ports should be between 1-65535 Mar 05 21:03:48.122749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-917b8c20-272d-4c6e-9528-2f671c3d130e tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Returning 400 to user: Invalid port range 22:645414861. Valid TCP ports should be between 1-65535 {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:03:48.123908 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-917b8c20-272d-4c6e-9528-2f671c3d130e tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.290873 Mar 05 21:03:48.125113 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1863/3817] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 21:03:47 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:03:48.163594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bb9653ce-50a9-4d48-9c3b-413a10144128 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Action: 'create', calling method: .version_select at 0x7fed5c5de670>, body: {"security_group_rule": {"parent_group_id": "94147c94-4cbc-48ef-8dab-92ed09be8245", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:48.246608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG neutronclient.v2_0.client [None req-bb9653ce-50a9-4d48-9c3b-413a10144128 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 94147c94-4cbc-48ef-8dab-92ed09be8245 does not exist", "detail": ""}} {{(pid=141478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 21:03:48.246608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.security_group_api [None req-bb9653ce-50a9-4d48-9c3b-413a10144128 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Neutron security group 94147c94-4cbc-48ef-8dab-92ed09be8245 not found {{(pid=141478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 05 21:03:48.246608 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-bb9653ce-50a9-4d48-9c3b-413a10144128 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] HTTP exception thrown: Security group 94147c94-4cbc-48ef-8dab-92ed09be8245 does not exist Mar 05 21:03:48.246608 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-f78f1b46-2f9f-42bf-91c8-a405e528495a'] Mar 05 21:03:48.246608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bb9653ce-50a9-4d48-9c3b-413a10144128 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Returning 404 to user: Security group 94147c94-4cbc-48ef-8dab-92ed09be8245 does not exist Mar 05 21:03:48.246608 ncdv-master-1 devstack@n-api.service[141478]: Neutron server returns request_ids: ['req-f78f1b46-2f9f-42bf-91c8-a405e528495a'] {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:03:48.246608 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bb9653ce-50a9-4d48-9c3b-413a10144128 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.093418 Mar 05 21:03:48.262455 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1864/3818] 10.222.0.15 () {60 vars in 1194 bytes} [Sat Mar 5 21:03:48 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:03:48.272121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f4a1a5bf-c88d-472e-9f9d-80a27e915a65 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:48.273121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f4a1a5bf-c88d-472e-9f9d-80a27e915a65 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:48.321948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4a1a5bf-c88d-472e-9f9d-80a27e915a65 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:48.328875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4a1a5bf-c88d-472e-9f9d-80a27e915a65 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:48.328875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4a1a5bf-c88d-472e-9f9d-80a27e915a65 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:48.328875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4a1a5bf-c88d-472e-9f9d-80a27e915a65 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:48.700944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ad58bc51-f90d-450e-843b-13df70875050 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:48.718723 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ad58bc51-f90d-450e-843b-13df70875050 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1511 microversion: 2.1 time: 0.694576 Mar 05 21:03:48.737081 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1955/3819] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:48 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1511 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:48.742345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3efaaae0-5415-4f01-bc1d-0f5edd8893f0 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Calling method '.version_select at 0x7fed61acf160>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:48.863026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG neutronclient.v2_0.client [None req-3efaaae0-5415-4f01-bc1d-0f5edd8893f0 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 56aeaffa-da11-4180-90bc-6f3219823901 does not exist", "detail": ""}} {{(pid=141479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 05 21:03:48.864675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.security_group_api [None req-3efaaae0-5415-4f01-bc1d-0f5edd8893f0 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Neutron security group rule 56aeaffa-da11-4180-90bc-6f3219823901 not found {{(pid=141479) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Mar 05 21:03:48.867260 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-3efaaae0-5415-4f01-bc1d-0f5edd8893f0 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] HTTP exception thrown: Security group rule 56aeaffa-da11-4180-90bc-6f3219823901 does not exist Mar 05 21:03:48.867260 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-3c6836d7-f6fe-4e40-9f88-6a4a8d97ad38'] Mar 05 21:03:48.868313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3efaaae0-5415-4f01-bc1d-0f5edd8893f0 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Returning 404 to user: Security group rule 56aeaffa-da11-4180-90bc-6f3219823901 does not exist Mar 05 21:03:48.868313 ncdv-master-1 devstack@n-api.service[141479]: Neutron server returns request_ids: ['req-3c6836d7-f6fe-4e40-9f88-6a4a8d97ad38'] {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:03:48.869784 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3efaaae0-5415-4f01-bc1d-0f5edd8893f0 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-group-rules/56aeaffa-da11-4180-90bc-6f3219823901" status: 404 len: 199 microversion: 2.1 time: 0.131043 Mar 05 21:03:48.875013 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1956/3820] 10.222.0.15 () {58 vars in 1286 bytes} [Sat Mar 5 21:03:48 2022] DELETE /compute/v2.1/os-security-group-rules/56aeaffa-da11-4180-90bc-6f3219823901 => generated 199 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:03:48.886388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f4a1a5bf-c88d-472e-9f9d-80a27e915a65 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:48.902252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-59219d6b-9aa7-4af8-93c0-2e3b67755881 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:48.903141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-59219d6b-9aa7-4af8-93c0-2e3b67755881 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:48.912240 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f4a1a5bf-c88d-472e-9f9d-80a27e915a65 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.648364 Mar 05 21:03:48.917626 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1865/3821] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:48 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:48.922752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-67bb8659-0d55-45e3-a463-a663deb33834 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Calling method '.version_select at 0x7fed5c97bd30>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:48.943738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59219d6b-9aa7-4af8-93c0-2e3b67755881 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:48.957154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59219d6b-9aa7-4af8-93c0-2e3b67755881 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:48.966730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59219d6b-9aa7-4af8-93c0-2e3b67755881 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:48.967711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59219d6b-9aa7-4af8-93c0-2e3b67755881 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:49.531734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-59219d6b-9aa7-4af8-93c0-2e3b67755881 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:49.554030 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-59219d6b-9aa7-4af8-93c0-2e3b67755881 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1511 microversion: 2.1 time: 0.675414 Mar 05 21:03:49.556830 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1957/3822] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:48 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1511 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:49.573142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6a606938-8eab-45fe-9a32-5704d94bbcf5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:49.574153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6a606938-8eab-45fe-9a32-5704d94bbcf5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:49.595216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a606938-8eab-45fe-9a32-5704d94bbcf5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:49.600813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a606938-8eab-45fe-9a32-5704d94bbcf5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:49.612173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a606938-8eab-45fe-9a32-5704d94bbcf5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:49.612763 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a606938-8eab-45fe-9a32-5704d94bbcf5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:49.695517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6a606938-8eab-45fe-9a32-5704d94bbcf5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:03:49.921910 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6a606938-8eab-45fe-9a32-5704d94bbcf5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 204 len: 0 microversion: 2.1 time: 0.352528 Mar 05 21:03:49.926063 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1958/3823] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:03:49 2022] DELETE /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:03:49.936355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a7f88400-f661-443d-80e2-dc5d6a257ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:49.937242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a7f88400-f661-443d-80e2-dc5d6a257ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:49.957645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7f88400-f661-443d-80e2-dc5d6a257ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:49.963192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7f88400-f661-443d-80e2-dc5d6a257ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:49.988304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7f88400-f661-443d-80e2-dc5d6a257ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:49.989018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7f88400-f661-443d-80e2-dc5d6a257ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:50.312793 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-67bb8659-0d55-45e3-a463-a663deb33834 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/a4db4e49-8d8e-4803-96bf-6acf7339940b" status: 202 len: 0 microversion: 2.1 time: 1.392738 Mar 05 21:03:50.313423 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1866/3824] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 21:03:48 2022] DELETE /compute/v2.1/os-security-groups/a4db4e49-8d8e-4803-96bf-6acf7339940b => generated 0 bytes in 1395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:03:50.334696 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-22ddaa74-5217-4b49-a1c5-6c77764c619c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:50.335334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-22ddaa74-5217-4b49-a1c5-6c77764c619c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:50.356506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22ddaa74-5217-4b49-a1c5-6c77764c619c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:50.360041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22ddaa74-5217-4b49-a1c5-6c77764c619c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:50.363784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22ddaa74-5217-4b49-a1c5-6c77764c619c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:50.365466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22ddaa74-5217-4b49-a1c5-6c77764c619c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:50.390221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a7f88400-f661-443d-80e2-dc5d6a257ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:50.401093 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a7f88400-f661-443d-80e2-dc5d6a257ae7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1517 microversion: 2.1 time: 0.472520 Mar 05 21:03:50.406633 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1959/3825] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:49 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1517 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:50.423223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f7166e3a-2322-4f9e-b848-f1c40b298895 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Calling method '.version_select at 0x7fed5c2900d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:51.042922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-22ddaa74-5217-4b49-a1c5-6c77764c619c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:51.055539 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-22ddaa74-5217-4b49-a1c5-6c77764c619c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.740960 Mar 05 21:03:51.056824 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1867/3826] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:50 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:51.423696 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd214635-7398-4125-bcf3-3ced5027f061 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:51.424947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd214635-7398-4125-bcf3-3ced5027f061 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:51.444180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd214635-7398-4125-bcf3-3ced5027f061 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:51.445457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd214635-7398-4125-bcf3-3ced5027f061 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:51.449843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd214635-7398-4125-bcf3-3ced5027f061 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:51.454470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd214635-7398-4125-bcf3-3ced5027f061 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:51.952432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd214635-7398-4125-bcf3-3ced5027f061 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:51.960080 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd214635-7398-4125-bcf3-3ced5027f061 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1517 microversion: 2.1 time: 0.540865 Mar 05 21:03:51.973702 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1868/3827] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:51 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1517 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:03:52.074439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d6044dea-1149-47b6-be0e-abd6523fb4b7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:52.075318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d6044dea-1149-47b6-be0e-abd6523fb4b7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:52.087347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6044dea-1149-47b6-be0e-abd6523fb4b7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:52.094483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6044dea-1149-47b6-be0e-abd6523fb4b7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:52.099569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6044dea-1149-47b6-be0e-abd6523fb4b7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:52.101579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6044dea-1149-47b6-be0e-abd6523fb4b7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:52.204624 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f7166e3a-2322-4f9e-b848-f1c40b298895 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/a29c7ee3-e136-43cd-aab9-8286ccbf8d8d" status: 202 len: 0 microversion: 2.1 time: 1.796628 Mar 05 21:03:52.205924 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1960/3828] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 21:03:50 2022] DELETE /compute/v2.1/os-security-groups/a29c7ee3-e136-43cd-aab9-8286ccbf8d8d => generated 0 bytes in 1798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:03:52.215121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-96025f27-0ecf-4591-bd7b-101984e13ad6 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Calling method '.version_select at 0x7fed5c8083a0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:52.511286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d6044dea-1149-47b6-be0e-abd6523fb4b7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:52.529243 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d6044dea-1149-47b6-be0e-abd6523fb4b7 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.451055 Mar 05 21:03:52.530543 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1869/3829] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:52 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:52.535724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6a73960b-5444-42b6-8b36-9647bfe93b8f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:52.536930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6a73960b-5444-42b6-8b36-9647bfe93b8f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:52.564443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6a73960b-5444-42b6-8b36-9647bfe93b8f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:52.565069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6a73960b-5444-42b6-8b36-9647bfe93b8f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:52.566314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6a73960b-5444-42b6-8b36-9647bfe93b8f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:52.566765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6a73960b-5444-42b6-8b36-9647bfe93b8f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:52.630659 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6a73960b-5444-42b6-8b36-9647bfe93b8f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098735 Mar 05 21:03:52.640964 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1870/3830] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:03:52 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:03:52.727189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aac23280-055d-4047-bea1-a59e7fb595e8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:52.727882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aac23280-055d-4047-bea1-a59e7fb595e8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:52.736368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aac23280-055d-4047-bea1-a59e7fb595e8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:52.737044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aac23280-055d-4047-bea1-a59e7fb595e8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:52.738030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aac23280-055d-4047-bea1-a59e7fb595e8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:52.738866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aac23280-055d-4047-bea1-a59e7fb595e8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:52.818355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aac23280-055d-4047-bea1-a59e7fb595e8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:03:53.082557 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aac23280-055d-4047-bea1-a59e7fb595e8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 204 len: 0 microversion: 2.1 time: 0.359266 Mar 05 21:03:53.083851 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1871/3831] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:03:52 2022] DELETE /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:03:53.090427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-959665d2-3835-4169-94a5-932e964ab544 req-8bf614c9-46af-4898-84ae-6eb6378074f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56e76ef-62db-4859-abb3-59ad080e4cd8", "name": "network-vif-deleted", "tag": "55b34c36-4d53-403e-b4b8-49a822397911"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:53.112443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-959665d2-3835-4169-94a5-932e964ab544 req-8bf614c9-46af-4898-84ae-6eb6378074f6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:53.113112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-959665d2-3835-4169-94a5-932e964ab544 req-8bf614c9-46af-4898-84ae-6eb6378074f6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:53.140668 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-959665d2-3835-4169-94a5-932e964ab544 req-8bf614c9-46af-4898-84ae-6eb6378074f6 service nova] Creating event network-vif-deleted:55b34c36-4d53-403e-b4b8-49a822397911 for instance f56e76ef-62db-4859-abb3-59ad080e4cd8 on nch1-master-1 Mar 05 21:03:53.152356 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-959665d2-3835-4169-94a5-932e964ab544 req-8bf614c9-46af-4898-84ae-6eb6378074f6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066056 Mar 05 21:03:53.153258 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1872/3832] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:03:53.160397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6b5bccb-c2a7-4604-a02d-276028168709 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:53.161286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6b5bccb-c2a7-4604-a02d-276028168709 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:53.169222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6b5bccb-c2a7-4604-a02d-276028168709 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:53.169929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6b5bccb-c2a7-4604-a02d-276028168709 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:53.170880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6b5bccb-c2a7-4604-a02d-276028168709 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:53.171486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6b5bccb-c2a7-4604-a02d-276028168709 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:53.235333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6b5bccb-c2a7-4604-a02d-276028168709 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:53.235840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6b5bccb-c2a7-4604-a02d-276028168709 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:53.236316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-e6b5bccb-c2a7-4604-a02d-276028168709 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lazy-loading 'fault' on Instance uuid f56e76ef-62db-4859-abb3-59ad080e4cd8 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:03:53.503354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6b5bccb-c2a7-4604-a02d-276028168709 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:53.514064 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6b5bccb-c2a7-4604-a02d-276028168709 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 200 len: 1320 microversion: 2.1 time: 0.359371 Mar 05 21:03:53.540771 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1873/3833] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:53 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 1320 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:53.556511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd75b792-9dbb-4039-b44e-e28c74f93a71 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:53.558683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd75b792-9dbb-4039-b44e-e28c74f93a71 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:53.581782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd75b792-9dbb-4039-b44e-e28c74f93a71 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:53.584538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd75b792-9dbb-4039-b44e-e28c74f93a71 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:53.585614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd75b792-9dbb-4039-b44e-e28c74f93a71 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:53.586247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd75b792-9dbb-4039-b44e-e28c74f93a71 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:53.740150 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-96025f27-0ecf-4591-bd7b-101984e13ad6 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/fcf7224b-1d46-4184-830b-1a7c40baea3f" status: 202 len: 0 microversion: 2.1 time: 1.529597 Mar 05 21:03:53.740758 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1961/3834] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 21:03:52 2022] DELETE /compute/v2.1/os-security-groups/fcf7224b-1d46-4184-830b-1a7c40baea3f => generated 0 bytes in 1531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 21:03:53.746459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-63815a92-5a15-4491-927d-030ca7b3986b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:53.747103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-63815a92-5a15-4491-927d-030ca7b3986b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:53.770887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63815a92-5a15-4491-927d-030ca7b3986b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:53.771754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63815a92-5a15-4491-927d-030ca7b3986b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:53.773134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63815a92-5a15-4491-927d-030ca7b3986b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:53.774303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63815a92-5a15-4491-927d-030ca7b3986b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:53.996838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd75b792-9dbb-4039-b44e-e28c74f93a71 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:54.020253 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd75b792-9dbb-4039-b44e-e28c74f93a71 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1671 microversion: 2.1 time: 0.476646 Mar 05 21:03:54.021566 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1874/3835] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:53 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1671 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:54.026756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-55cfb7ec-2460-4fbf-b4ff-eb2510019e9d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Action: 'create', calling method: .version_select at 0x7fed61b3c040>, body: {"keypair": {"name": "tempest-keypair-431627319"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:54.060789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-55cfb7ec-2460-4fbf-b4ff-eb2510019e9d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Getting quotas for project 784a2229e2b6445589597e5bf3be6344. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:54.077223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-55cfb7ec-2460-4fbf-b4ff-eb2510019e9d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Getting quotas for user 5f63dccf0b4843cb8aaeee1070d1f82a and project 784a2229e2b6445589597e5bf3be6344. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:54.078473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-63815a92-5a15-4491-927d-030ca7b3986b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:54.095946 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-63815a92-5a15-4491-927d-030ca7b3986b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.348932 Mar 05 21:03:54.097083 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1962/3836] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:53 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:54.108762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3596be91-ef13-4887-955e-6fc39a49a02c tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Calling method '.version_select at 0x7fed5c1d93a0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:54.365938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-55cfb7ec-2460-4fbf-b4ff-eb2510019e9d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Getting quotas for project 784a2229e2b6445589597e5bf3be6344. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:54.372384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-55cfb7ec-2460-4fbf-b4ff-eb2510019e9d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Getting quotas for user 5f63dccf0b4843cb8aaeee1070d1f82a and project 784a2229e2b6445589597e5bf3be6344. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:54.395981 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-55cfb7ec-2460-4fbf-b4ff-eb2510019e9d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.42 time: 0.369552 Mar 05 21:03:54.398710 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1875/3837] 10.222.0.15 () {62 vars in 1198 bytes} [Sat Mar 5 21:03:54 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 376 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:03:54.498080 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3596be91-ef13-4887-955e-6fc39a49a02c tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/1c21f190-5ef8-450d-9a97-190452bb4892" status: 202 len: 0 microversion: 2.1 time: 0.398628 Mar 05 21:03:54.498710 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1963/3838] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 21:03:54 2022] DELETE /compute/v2.1/os-security-groups/1c21f190-5ef8-450d-9a97-190452bb4892 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:03:54.508371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f145dae4-e229-4857-ac6e-22108acd39e3 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] Calling method '.version_select at 0x7fed5c5deca0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:54.548444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-96b12362-1f85-4b28-a914-691c3ba4e429 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:54.549302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-96b12362-1f85-4b28-a914-691c3ba4e429 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:54.561912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b12362-1f85-4b28-a914-691c3ba4e429 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:54.565691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b12362-1f85-4b28-a914-691c3ba4e429 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:54.566856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b12362-1f85-4b28-a914-691c3ba4e429 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:54.569373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b12362-1f85-4b28-a914-691c3ba4e429 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:54.609688 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-96b12362-1f85-4b28-a914-691c3ba4e429 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance f56e76ef-62db-4859-abb3-59ad080e4cd8 could not be found. Mar 05 21:03:54.611299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-96b12362-1f85-4b28-a914-691c3ba4e429 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance f56e76ef-62db-4859-abb3-59ad080e4cd8 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:03:54.615144 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-96b12362-1f85-4b28-a914-691c3ba4e429 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 404 len: 111 microversion: 2.1 time: 0.072353 Mar 05 21:03:54.641021 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1964/3839] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:54 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:03:54.813469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1311293617", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "5345ca04-bcd0-4ca9-94fb-fa648ce6d989"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:54.920479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] validate_networks() for [('5345ca04-bcd0-4ca9-94fb-fa648ce6d989', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:03:55.094863 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f145dae4-e229-4857-ac6e-22108acd39e3 tempest-SecurityGroupRulesNegativeTestJSON-802361846 tempest-SecurityGroupRulesNegativeTestJSON-802361846-project] 10.222.0.15 "DELETE /compute/v2.1/os-security-groups/ec0a490e-a4ba-4fd1-adf3-6faa9c121265" status: 202 len: 0 microversion: 2.1 time: 0.591897 Mar 05 21:03:55.095576 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1876/3840] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 21:03:54 2022] DELETE /compute/v2.1/os-security-groups/ec0a490e-a4ba-4fd1-adf3-6faa9c121265 => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:03:55.101355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b7f1e33-1cec-4270-a7e6-be5515b59cbf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:55.102168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4b7f1e33-1cec-4270-a7e6-be5515b59cbf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:55.122272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b7f1e33-1cec-4270-a7e6-be5515b59cbf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:55.125996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b7f1e33-1cec-4270-a7e6-be5515b59cbf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:55.128352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b7f1e33-1cec-4270-a7e6-be5515b59cbf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:55.128988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b7f1e33-1cec-4270-a7e6-be5515b59cbf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:55.443554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4b7f1e33-1cec-4270-a7e6-be5515b59cbf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:55.466948 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4b7f1e33-1cec-4270-a7e6-be5515b59cbf tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1671 microversion: 2.1 time: 0.370062 Mar 05 21:03:55.468323 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1877/3841] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:55 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1671 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:55.473267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-32dc67a5-9124-4247-9cea-f36c8c31851b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:55.478022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-32dc67a5-9124-4247-9cea-f36c8c31851b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:55.490862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32dc67a5-9124-4247-9cea-f36c8c31851b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:55.491501 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32dc67a5-9124-4247-9cea-f36c8c31851b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:55.497759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32dc67a5-9124-4247-9cea-f36c8c31851b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:55.498741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32dc67a5-9124-4247-9cea-f36c8c31851b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:55.801530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-32dc67a5-9124-4247-9cea-f36c8c31851b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:55.814582 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-32dc67a5-9124-4247-9cea-f36c8c31851b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.342870 Mar 05 21:03:55.816195 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1878/3842] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:55 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:56.484615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d97da662-6787-46a1-a0e6-d1daf57ce2ad tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:56.485365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d97da662-6787-46a1-a0e6-d1daf57ce2ad tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:56.496480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d97da662-6787-46a1-a0e6-d1daf57ce2ad tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:56.497254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d97da662-6787-46a1-a0e6-d1daf57ce2ad tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:56.502009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d97da662-6787-46a1-a0e6-d1daf57ce2ad tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:56.502480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d97da662-6787-46a1-a0e6-d1daf57ce2ad tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:56.812360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d97da662-6787-46a1-a0e6-d1daf57ce2ad tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:56.820359 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d97da662-6787-46a1-a0e6-d1daf57ce2ad tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1671 microversion: 2.1 time: 0.339495 Mar 05 21:03:56.820960 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1879/3843] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:56 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1671 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:56.837138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2dc28191-0363-4ae6-905c-fbd0b8cdd404 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:56.838530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2dc28191-0363-4ae6-905c-fbd0b8cdd404 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:56.853399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dc28191-0363-4ae6-905c-fbd0b8cdd404 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:56.855412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dc28191-0363-4ae6-905c-fbd0b8cdd404 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:56.861005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dc28191-0363-4ae6-905c-fbd0b8cdd404 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:56.861706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2dc28191-0363-4ae6-905c-fbd0b8cdd404 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:57.050362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:03:57.050998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:03:57.051260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:03:57.051795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:03:57.054653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:03:57.089744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:57.090210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:57.091224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:57.091464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:57.149782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:03:57.168262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Getting quotas for user cfbceb7c8c104af89e7d21ba411e32a8 and project 180462533c264596b5f243c2915b027c. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:03:57.194806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:03:57.197139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:03:57.282566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2dc28191-0363-4ae6-905c-fbd0b8cdd404 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:57.283768 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a4642da4-3a01-48d3-87ba-c5ea5ca63872 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.474773 Mar 05 21:03:57.284916 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1965/3844] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:03:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:03:57.292385 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2dc28191-0363-4ae6-905c-fbd0b8cdd404 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.458001 Mar 05 21:03:57.293806 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1880/3845] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:56 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:03:57.298825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-debefed3-c28b-40e6-82f6-d027d52b0e93 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:57.299811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-debefed3-c28b-40e6-82f6-d027d52b0e93 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:57.482965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-debefed3-c28b-40e6-82f6-d027d52b0e93 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:57.490520 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-debefed3-c28b-40e6-82f6-d027d52b0e93 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1209 microversion: 2.1 time: 0.197117 Mar 05 21:03:57.491210 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1966/3846] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:57 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1209 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:57.704068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1787246724", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7313a2ce-6db2-4b8d-90cd-4116bd0e5d75"}, {"port": "6b1907e2-b9fc-4106-b4bf-9d467bd3635b", "tag": "port-1"}, {"port": "3580f7be-3101-44d5-a719-3970e25ebd07", "tag": "port-2"}, {"uuid": "f583ae73-6c59-430c-be06-cb0088aec665", "tag": "net-1"}, {"uuid": "f583ae73-6c59-430c-be06-cb0088aec665"}, {"uuid": "3c8e0a46-e570-496b-970e-60743f7e52d3", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3c8e0a46-e570-496b-970e-60743f7e52d3", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c4889834-9564-427c-924e-8df6f5bc7738", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "0d7be807-5817-4f1d-a429-8b9efd75b15c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "00215bb7-a3ee-4481-8b60-e90a6dd81c02", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1514745958"}], "key_name": "tempest-keypair-431627319", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:57.839630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-96b254b3-9bcb-494d-b607-6ac928a98666 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:57.841042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-96b254b3-9bcb-494d-b607-6ac928a98666 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:57.854470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b254b3-9bcb-494d-b607-6ac928a98666 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:57.856562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b254b3-9bcb-494d-b607-6ac928a98666 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:57.860319 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b254b3-9bcb-494d-b607-6ac928a98666 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:57.861263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96b254b3-9bcb-494d-b607-6ac928a98666 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:58.014322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] validate_networks() for [('7313a2ce-6db2-4b8d-90cd-4116bd0e5d75', None, None, None, None, None), (None, None, '6b1907e2-b9fc-4106-b4bf-9d467bd3635b', None, None, None), (None, None, '3580f7be-3101-44d5-a719-3970e25ebd07', None, None, None), ('f583ae73-6c59-430c-be06-cb0088aec665', None, None, None, None, None), ('f583ae73-6c59-430c-be06-cb0088aec665', None, None, None, None, None), ('3c8e0a46-e570-496b-970e-60743f7e52d3', '10.2.2.100', None, None, None, None), ('3c8e0a46-e570-496b-970e-60743f7e52d3', '10.2.2.200', None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:03:58.357915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-96b254b3-9bcb-494d-b607-6ac928a98666 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:58.379330 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-96b254b3-9bcb-494d-b607-6ac928a98666 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 200 len: 1671 microversion: 2.1 time: 0.544036 Mar 05 21:03:58.380106 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1967/3847] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:57 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 1671 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:03:58.395128 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-828d1f69-c578-4c4b-aeb8-cf954666c43b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:58.396207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-828d1f69-c578-4c4b-aeb8-cf954666c43b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:58.426640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-828d1f69-c578-4c4b-aeb8-cf954666c43b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:58.427112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-828d1f69-c578-4c4b-aeb8-cf954666c43b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:58.433872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-828d1f69-c578-4c4b-aeb8-cf954666c43b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:58.434438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-828d1f69-c578-4c4b-aeb8-cf954666c43b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:58.894803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-828d1f69-c578-4c4b-aeb8-cf954666c43b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:58.912391 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-828d1f69-c578-4c4b-aeb8-cf954666c43b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.530392 Mar 05 21:03:58.913001 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1968/3848] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:58 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:58.924539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2d7a9539-645c-44b8-9d72-e363b881e281 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:58.924539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2d7a9539-645c-44b8-9d72-e363b881e281 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:58.935057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d7a9539-645c-44b8-9d72-e363b881e281 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:58.935525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d7a9539-645c-44b8-9d72-e363b881e281 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:58.936376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d7a9539-645c-44b8-9d72-e363b881e281 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:58.936830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d7a9539-645c-44b8-9d72-e363b881e281 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:59.391983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2d7a9539-645c-44b8-9d72-e363b881e281 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:59.402828 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2d7a9539-645c-44b8-9d72-e363b881e281 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.488638 Mar 05 21:03:59.403929 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1969/3849] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:58 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:59.418426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-be0257c7-6f20-457f-8dd9-90f2ff64bfd0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:03:59.424236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-be0257c7-6f20-457f-8dd9-90f2ff64bfd0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:59.441013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be0257c7-6f20-457f-8dd9-90f2ff64bfd0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:59.442128 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be0257c7-6f20-457f-8dd9-90f2ff64bfd0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:59.443230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be0257c7-6f20-457f-8dd9-90f2ff64bfd0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:59.444061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be0257c7-6f20-457f-8dd9-90f2ff64bfd0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:59.538669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-be0257c7-6f20-457f-8dd9-90f2ff64bfd0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:03:59.546817 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-be0257c7-6f20-457f-8dd9-90f2ff64bfd0 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1267 microversion: 2.1 time: 0.138672 Mar 05 21:03:59.561408 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1970/3850] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:03:59 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:03:59.567509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c2dd7313-46a1-40d3-a52d-a5f141f548f6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-984900085"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:03:59.569465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c2dd7313-46a1-40d3-a52d-a5f141f548f6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:03:59.576622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2dd7313-46a1-40d3-a52d-a5f141f548f6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:59.577482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2dd7313-46a1-40d3-a52d-a5f141f548f6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:03:59.578525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2dd7313-46a1-40d3-a52d-a5f141f548f6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:03:59.579214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2dd7313-46a1-40d3-a52d-a5f141f548f6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:00.107941 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c2dd7313-46a1-40d3-a52d-a5f141f548f6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.544306 Mar 05 21:04:00.109207 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1971/3851] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:03:59 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Mar 05 21:04:00.128729 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b27f91ee-9267-4169-b62f-ef7cf3bc7468 req-10cdda9a-3e5c-4e74-b3f6-c6942da9a685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a84920d-9932-4cd1-975b-9a28dc682e45", "name": "network-vif-deleted", "tag": "fe8c874c-29b6-4154-bd1d-0bdf845e26a3"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:00.143631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b27f91ee-9267-4169-b62f-ef7cf3bc7468 req-10cdda9a-3e5c-4e74-b3f6-c6942da9a685 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:00.144145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b27f91ee-9267-4169-b62f-ef7cf3bc7468 req-10cdda9a-3e5c-4e74-b3f6-c6942da9a685 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:00.160723 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b27f91ee-9267-4169-b62f-ef7cf3bc7468 req-10cdda9a-3e5c-4e74-b3f6-c6942da9a685 service nova] Creating event network-vif-deleted:fe8c874c-29b6-4154-bd1d-0bdf845e26a3 for instance 2a84920d-9932-4cd1-975b-9a28dc682e45 on nch2-master-1 Mar 05 21:04:00.166889 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b27f91ee-9267-4169-b62f-ef7cf3bc7468 req-10cdda9a-3e5c-4e74-b3f6-c6942da9a685 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047869 Mar 05 21:04:00.168910 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1972/3852] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:00.174406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b3c6038e-679e-4e27-8d5e-a43cebd4da20 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:00.175120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b3c6038e-679e-4e27-8d5e-a43cebd4da20 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:00.189924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3c6038e-679e-4e27-8d5e-a43cebd4da20 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:00.190774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3c6038e-679e-4e27-8d5e-a43cebd4da20 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:00.192175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3c6038e-679e-4e27-8d5e-a43cebd4da20 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:00.192989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3c6038e-679e-4e27-8d5e-a43cebd4da20 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:00.212365 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-b3c6038e-679e-4e27-8d5e-a43cebd4da20 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] HTTP exception thrown: Instance 2a84920d-9932-4cd1-975b-9a28dc682e45 could not be found. Mar 05 21:04:00.213377 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b3c6038e-679e-4e27-8d5e-a43cebd4da20 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Returning 404 to user: Instance 2a84920d-9932-4cd1-975b-9a28dc682e45 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:00.214401 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b3c6038e-679e-4e27-8d5e-a43cebd4da20 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 404 len: 111 microversion: 2.1 time: 0.044206 Mar 05 21:04:00.218138 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1973/3853] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:00 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:04:00.222067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cd855be1-8f2b-4c35-a89a-94e8625fd8ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:00.222700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cd855be1-8f2b-4c35-a89a-94e8625fd8ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:00.231525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd855be1-8f2b-4c35-a89a-94e8625fd8ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:00.232299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd855be1-8f2b-4c35-a89a-94e8625fd8ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:00.233552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd855be1-8f2b-4c35-a89a-94e8625fd8ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:00.234152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd855be1-8f2b-4c35-a89a-94e8625fd8ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:00.605971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cd855be1-8f2b-4c35-a89a-94e8625fd8ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:00.618068 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cd855be1-8f2b-4c35-a89a-94e8625fd8ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 0.401654 Mar 05 21:04:00.635764 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1974/3854] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:00 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:00.640910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-95f32862-0dc6-44d3-a13c-d76786239a11 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '.version_select at 0x7fed61aff9d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:00.669918 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-95f32862-0dc6-44d3-a13c-d76786239a11 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752220655" status: 202 len: 0 microversion: 2.1 time: 0.032714 Mar 05 21:04:00.671495 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1975/3855] 10.222.0.15 () {58 vars in 1220 bytes} [Sat Mar 5 21:04:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752220655 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:04:00.678453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ab3429a7-1f28-430d-b365-c1244a5ad0e4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:00.679798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ab3429a7-1f28-430d-b365-c1244a5ad0e4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:00.693084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab3429a7-1f28-430d-b365-c1244a5ad0e4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:00.694181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab3429a7-1f28-430d-b365-c1244a5ad0e4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:00.695614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab3429a7-1f28-430d-b365-c1244a5ad0e4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:00.696318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab3429a7-1f28-430d-b365-c1244a5ad0e4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:01.452168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ab3429a7-1f28-430d-b365-c1244a5ad0e4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:01.460204 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ab3429a7-1f28-430d-b365-c1244a5ad0e4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1521 microversion: 2.1 time: 0.787288 Mar 05 21:04:01.461186 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1976/3856] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:00 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1521 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:01.466551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eea8e235-6410-478b-8985-20d39f4de913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:01.467177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eea8e235-6410-478b-8985-20d39f4de913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:01.481289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eea8e235-6410-478b-8985-20d39f4de913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:01.481776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eea8e235-6410-478b-8985-20d39f4de913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:01.482604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eea8e235-6410-478b-8985-20d39f4de913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:01.483243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eea8e235-6410-478b-8985-20d39f4de913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:02.021001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eea8e235-6410-478b-8985-20d39f4de913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:02.050058 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eea8e235-6410-478b-8985-20d39f4de913 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1309 microversion: 2.1 time: 0.587695 Mar 05 21:04:02.068207 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1977/3857] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:01 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1309 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:02.076475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-af8213fe-8db3-400c-8b01-24f31c1b8534 req-0c6b37d3-ce86-4d79-9d39-1909709e2ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc548a05-5226-41f0-a34d-1d44defee56c", "name": "network-vif-unplugged", "status": "completed", "tag": "30ad7984-3b01-4aac-9f3b-d69f10ea737a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:02.089962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-af8213fe-8db3-400c-8b01-24f31c1b8534 req-0c6b37d3-ce86-4d79-9d39-1909709e2ebe service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:02.091890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-af8213fe-8db3-400c-8b01-24f31c1b8534 req-0c6b37d3-ce86-4d79-9d39-1909709e2ebe service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:02.128727 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-af8213fe-8db3-400c-8b01-24f31c1b8534 req-0c6b37d3-ce86-4d79-9d39-1909709e2ebe service nova] Creating event network-vif-unplugged:30ad7984-3b01-4aac-9f3b-d69f10ea737a for instance dc548a05-5226-41f0-a34d-1d44defee56c on nch1-master-1 Mar 05 21:04:02.134183 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-af8213fe-8db3-400c-8b01-24f31c1b8534 req-0c6b37d3-ce86-4d79-9d39-1909709e2ebe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064364 Mar 05 21:04:02.136838 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1978/3858] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:02.146102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-24167a8f-c4bf-4442-bdcc-043e7fc2f41b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:02.146735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-24167a8f-c4bf-4442-bdcc-043e7fc2f41b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:02.181569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-24167a8f-c4bf-4442-bdcc-043e7fc2f41b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:02.184064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-24167a8f-c4bf-4442-bdcc-043e7fc2f41b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:02.185906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-24167a8f-c4bf-4442-bdcc-043e7fc2f41b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:02.186689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-24167a8f-c4bf-4442-bdcc-043e7fc2f41b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:02.554111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-24167a8f-c4bf-4442-bdcc-043e7fc2f41b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:02.567908 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-24167a8f-c4bf-4442-bdcc-043e7fc2f41b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1687 microversion: 2.1 time: 0.426445 Mar 05 21:04:02.568826 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1979/3859] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:02 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1687 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:02.590117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b6b52bb7-572d-4e38-bca7-3e9e39d85216 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:02.591607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b6b52bb7-572d-4e38-bca7-3e9e39d85216 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:02.599885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6b52bb7-572d-4e38-bca7-3e9e39d85216 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:02.602915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6b52bb7-572d-4e38-bca7-3e9e39d85216 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:02.604575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6b52bb7-572d-4e38-bca7-3e9e39d85216 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:02.605938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6b52bb7-572d-4e38-bca7-3e9e39d85216 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:03.156266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b6b52bb7-572d-4e38-bca7-3e9e39d85216 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:03.165252 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b6b52bb7-572d-4e38-bca7-3e9e39d85216 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1501 microversion: 2.1 time: 0.594993 Mar 05 21:04:03.166256 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1980/3860] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:02 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1501 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:03.173647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b6239370-a1ba-46b1-b089-6adba398fa78 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Action: 'create', calling method: .version_select at 0x7fed5c4cf040>, body: {"keypair": {"name": "tempest-keypair-415623795"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:03.193067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b6239370-a1ba-46b1-b089-6adba398fa78 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Getting quotas for project f59b6cf41e6d4308819eb264dcaa320e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:04:03.200121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b6239370-a1ba-46b1-b089-6adba398fa78 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Getting quotas for user 352a9d7250c742638d90f17006f12c13 and project f59b6cf41e6d4308819eb264dcaa320e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:04:03.891020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b6239370-a1ba-46b1-b089-6adba398fa78 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Getting quotas for project f59b6cf41e6d4308819eb264dcaa320e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:04:03.906356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b6239370-a1ba-46b1-b089-6adba398fa78 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Getting quotas for user 352a9d7250c742638d90f17006f12c13 and project f59b6cf41e6d4308819eb264dcaa320e. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:04:03.940758 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b6239370-a1ba-46b1-b089-6adba398fa78 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.771741 Mar 05 21:04:03.941398 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1981/3861] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:04:03 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:03.963209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6ec76fb5-a2f5-4794-9d38-db4bce185151 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:03.976675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6ec76fb5-a2f5-4794-9d38-db4bce185151 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:03.993423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ec76fb5-a2f5-4794-9d38-db4bce185151 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:03.993913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ec76fb5-a2f5-4794-9d38-db4bce185151 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:03.994978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ec76fb5-a2f5-4794-9d38-db4bce185151 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:03.995422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ec76fb5-a2f5-4794-9d38-db4bce185151 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:04.602250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:04:04.607093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:04:04.609955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:04:04.610934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:04:04.611715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:04:04.640472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:04.643006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:04.645784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:04.646480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:04.706859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Getting quotas for project 784a2229e2b6445589597e5bf3be6344. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:04:04.728525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Getting quotas for user 5f63dccf0b4843cb8aaeee1070d1f82a and project 784a2229e2b6445589597e5bf3be6344. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:04:05.014972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6ec76fb5-a2f5-4794-9d38-db4bce185151 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:05.031612 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6ec76fb5-a2f5-4794-9d38-db4bce185151 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1309 microversion: 2.1 time: 1.089112 Mar 05 21:04:05.032248 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1982/3862] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:03 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1309 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:05.053806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-90f0150a-21e4-4d1d-b172-f01df513c0ae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:05.058104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-90f0150a-21e4-4d1d-b172-f01df513c0ae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:05.070363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90f0150a-21e4-4d1d-b172-f01df513c0ae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:05.079283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90f0150a-21e4-4d1d-b172-f01df513c0ae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:05.084758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90f0150a-21e4-4d1d-b172-f01df513c0ae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:05.087015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90f0150a-21e4-4d1d-b172-f01df513c0ae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:05.099280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:04:05.102201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c4889834-9564-427c-924e-8df6f5bc7738',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='0d7be807-5817-4f1d-a429-8b9efd75b15c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='00215bb7-a3ee-4481-8b60-e90a6dd81c02',volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:04:05.846293 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6073d279-247d-425b-ac9e-29c0716424b2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.150809 Mar 05 21:04:05.847320 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1881/3863] 10.222.0.15 () {62 vars in 1188 bytes} [Sat Mar 5 21:03:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 8153 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 05 21:04:05.852228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8cad7bd8-387a-4490-bbae-83ef3745f349 req-68f3ec8d-e8a4-429c-b735-e909b55097e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3107763c-59c3-4635-8506-ceac63b004b0", "tag": "e6f29933-01e9-44e2-b2d2-710980940a5a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:05.862470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8cad7bd8-387a-4490-bbae-83ef3745f349 req-68f3ec8d-e8a4-429c-b735-e909b55097e5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:05.863212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8cad7bd8-387a-4490-bbae-83ef3745f349 req-68f3ec8d-e8a4-429c-b735-e909b55097e5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:05.897141 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8cad7bd8-387a-4490-bbae-83ef3745f349 req-68f3ec8d-e8a4-429c-b735-e909b55097e5 service nova] Creating event network-changed:e6f29933-01e9-44e2-b2d2-710980940a5a for instance 3107763c-59c3-4635-8506-ceac63b004b0 on nch1-master-1 Mar 05 21:04:05.918282 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-8cad7bd8-387a-4490-bbae-83ef3745f349 req-68f3ec8d-e8a4-429c-b735-e909b55097e5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069654 Mar 05 21:04:05.925760 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1882/3864] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:05.963552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a6467056-820c-4524-abc3-3db4efc71d32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:05.965136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a6467056-820c-4524-abc3-3db4efc71d32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:05.984504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6467056-820c-4524-abc3-3db4efc71d32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:05.992147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6467056-820c-4524-abc3-3db4efc71d32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:05.993124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6467056-820c-4524-abc3-3db4efc71d32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:05.993687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6467056-820c-4524-abc3-3db4efc71d32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:06.951821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-90f0150a-21e4-4d1d-b172-f01df513c0ae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:06.960198 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-90f0150a-21e4-4d1d-b172-f01df513c0ae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1515 microversion: 2.1 time: 1.913764 Mar 05 21:04:06.960816 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1983/3865] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:05 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1515 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:06.981007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a6467056-820c-4524-abc3-3db4efc71d32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:06.987535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ced330b7-cd70-431c-892c-ccde02368367 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:06.988219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ced330b7-cd70-431c-892c-ccde02368367 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:07.001186 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a6467056-820c-4524-abc3-3db4efc71d32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1682 microversion: 2.1 time: 1.074029 Mar 05 21:04:07.016145 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1883/3866] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:05 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1682 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:07.033356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4d4544f3-f747-44e3-bb17-814ffa5ba036 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:07.033967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4d4544f3-f747-44e3-bb17-814ffa5ba036 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:07.058117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d4544f3-f747-44e3-bb17-814ffa5ba036 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:07.058853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d4544f3-f747-44e3-bb17-814ffa5ba036 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:07.059869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d4544f3-f747-44e3-bb17-814ffa5ba036 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:07.060512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d4544f3-f747-44e3-bb17-814ffa5ba036 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:07.218149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ced330b7-cd70-431c-892c-ccde02368367 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:07.235972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ced330b7-cd70-431c-892c-ccde02368367 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:07.242239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ced330b7-cd70-431c-892c-ccde02368367 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:07.244289 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ced330b7-cd70-431c-892c-ccde02368367 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1285 microversion: 2.42 time: 0.260594 Mar 05 21:04:07.245542 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1984/3867] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:06 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1285 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:07.281000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c1af1030-bdb0-4a93-8662-e2cd9f6ef11c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:07.283540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c1af1030-bdb0-4a93-8662-e2cd9f6ef11c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 6504b6c7-42b9-4e6d-9c30-c4fda8fa5a04] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:07.302639 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-c1af1030-bdb0-4a93-8662-e2cd9f6ef11c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] HTTP exception thrown: Instance 6504b6c7-42b9-4e6d-9c30-c4fda8fa5a04 could not be found. Mar 05 21:04:07.305536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c1af1030-bdb0-4a93-8662-e2cd9f6ef11c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Returning 404 to user: Instance 6504b6c7-42b9-4e6d-9c30-c4fda8fa5a04 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:07.308776 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c1af1030-bdb0-4a93-8662-e2cd9f6ef11c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers/6504b6c7-42b9-4e6d-9c30-c4fda8fa5a04/action" status: 404 len: 111 microversion: 2.1 time: 0.061972 Mar 05 21:04:07.313314 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1985/3868] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:04:07 2022] POST /compute/v2.1/servers/6504b6c7-42b9-4e6d-9c30-c4fda8fa5a04/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:04:07.327815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7fe15ccf-97c3-4abf-b212-b39c03430566 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:07.329057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7fe15ccf-97c3-4abf-b212-b39c03430566 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:07.361170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fe15ccf-97c3-4abf-b212-b39c03430566 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:07.362042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fe15ccf-97c3-4abf-b212-b39c03430566 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:07.367244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fe15ccf-97c3-4abf-b212-b39c03430566 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:07.370302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fe15ccf-97c3-4abf-b212-b39c03430566 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:07.583065 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7fe15ccf-97c3-4abf-b212-b39c03430566 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action" status: 202 len: 0 microversion: 2.1 time: 0.267331 Mar 05 21:04:07.590470 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1986/3869] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:04:07 2022] POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:04:07.719426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4d4544f3-f747-44e3-bb17-814ffa5ba036 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:07.728439 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4d4544f3-f747-44e3-bb17-814ffa5ba036 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1309 microversion: 2.1 time: 0.710290 Mar 05 21:04:07.730725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6eab39b5-8d1d-4801-85f5-c46ee34f098d req-bdf57474-880a-42fa-83a5-a83133bc527c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc548a05-5226-41f0-a34d-1d44defee56c", "name": "network-vif-plugged", "status": "completed", "tag": "30ad7984-3b01-4aac-9f3b-d69f10ea737a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:07.734574 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1884/3870] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:07 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1309 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:07.748765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f1dfeec7-2921-4ed4-af3a-74361dff4a6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:07.761613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6eab39b5-8d1d-4801-85f5-c46ee34f098d req-bdf57474-880a-42fa-83a5-a83133bc527c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:07.764169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6eab39b5-8d1d-4801-85f5-c46ee34f098d req-bdf57474-880a-42fa-83a5-a83133bc527c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:07.772678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f1dfeec7-2921-4ed4-af3a-74361dff4a6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:07.809430 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6eab39b5-8d1d-4801-85f5-c46ee34f098d req-bdf57474-880a-42fa-83a5-a83133bc527c service nova] Creating event network-vif-plugged:30ad7984-3b01-4aac-9f3b-d69f10ea737a for instance dc548a05-5226-41f0-a34d-1d44defee56c on nch1-master-1 Mar 05 21:04:07.812984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1dfeec7-2921-4ed4-af3a-74361dff4a6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:07.816840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1dfeec7-2921-4ed4-af3a-74361dff4a6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:07.820257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1dfeec7-2921-4ed4-af3a-74361dff4a6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:07.826305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1dfeec7-2921-4ed4-af3a-74361dff4a6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:07.827706 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6eab39b5-8d1d-4801-85f5-c46ee34f098d req-bdf57474-880a-42fa-83a5-a83133bc527c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233000 Mar 05 21:04:07.843442 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1987/3871] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:08.020137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2a29f23e-2289-4ec5-8942-1f2520e9760f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:08.021892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2a29f23e-2289-4ec5-8942-1f2520e9760f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:08.052385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a29f23e-2289-4ec5-8942-1f2520e9760f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:08.053051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a29f23e-2289-4ec5-8942-1f2520e9760f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:08.054008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a29f23e-2289-4ec5-8942-1f2520e9760f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:08.054588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a29f23e-2289-4ec5-8942-1f2520e9760f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:08.384394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f1dfeec7-2921-4ed4-af3a-74361dff4a6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:08.398507 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f1dfeec7-2921-4ed4-af3a-74361dff4a6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1520 microversion: 2.1 time: 0.660641 Mar 05 21:04:08.405864 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1885/3872] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:07 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1520 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:08.418817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-19392586-6ec2-4eb1-8911-8c789f1a9f42 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:08.419710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-19392586-6ec2-4eb1-8911-8c789f1a9f42 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:08.435022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19392586-6ec2-4eb1-8911-8c789f1a9f42 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:08.440389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19392586-6ec2-4eb1-8911-8c789f1a9f42 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:08.441469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19392586-6ec2-4eb1-8911-8c789f1a9f42 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:08.442096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19392586-6ec2-4eb1-8911-8c789f1a9f42 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:08.648531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-19392586-6ec2-4eb1-8911-8c789f1a9f42 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:08.662658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-19392586-6ec2-4eb1-8911-8c789f1a9f42 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:08.664233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-19392586-6ec2-4eb1-8911-8c789f1a9f42 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:08.672346 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-19392586-6ec2-4eb1-8911-8c789f1a9f42 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1519 microversion: 2.42 time: 0.258291 Mar 05 21:04:08.673107 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1886/3873] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:08 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:08.674786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2a29f23e-2289-4ec5-8942-1f2520e9760f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:08.697412 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2a29f23e-2289-4ec5-8942-1f2520e9760f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1682 microversion: 2.1 time: 0.679622 Mar 05 21:04:08.701777 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1988/3874] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:08 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1682 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:04:08.750900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-80034d68-c262-466a-bdc8-b8a30dfa7766 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:08.751808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-80034d68-c262-466a-bdc8-b8a30dfa7766 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:08.759255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80034d68-c262-466a-bdc8-b8a30dfa7766 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:08.763769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80034d68-c262-466a-bdc8-b8a30dfa7766 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:08.764821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80034d68-c262-466a-bdc8-b8a30dfa7766 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:08.767224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80034d68-c262-466a-bdc8-b8a30dfa7766 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:08.968786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-941655272", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb152f6f-c57d-4619-b0c4-9bec5538183b"}], "security_groups": [{"name": "tempest-securitygroup--219858971"}], "key_name": "tempest-keypair-415623795", "user_data": "}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:09.100965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-80034d68-c262-466a-bdc8-b8a30dfa7766 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:09.112755 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-80034d68-c262-466a-bdc8-b8a30dfa7766 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1309 microversion: 2.1 time: 0.365649 Mar 05 21:04:09.126789 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1887/3875] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:08 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1309 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:09.415388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] validate_networks() for [('eb152f6f-c57d-4619-b0c4-9bec5538183b', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:04:09.422401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bc31ca13-a225-424d-a0af-af54e63a0c46 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:09.423860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bc31ca13-a225-424d-a0af-af54e63a0c46 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:09.437793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc31ca13-a225-424d-a0af-af54e63a0c46 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:09.440652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc31ca13-a225-424d-a0af-af54e63a0c46 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:09.442581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc31ca13-a225-424d-a0af-af54e63a0c46 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:09.444056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc31ca13-a225-424d-a0af-af54e63a0c46 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:09.731198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bc31ca13-a225-424d-a0af-af54e63a0c46 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:09.744765 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bc31ca13-a225-424d-a0af-af54e63a0c46 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1500 microversion: 2.1 time: 0.331628 Mar 05 21:04:09.745350 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1888/3876] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:09 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1500 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:04:09.761861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fdc203a0-ea07-436a-8031-c5e5cebb7b5c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:09.762749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fdc203a0-ea07-436a-8031-c5e5cebb7b5c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:09.770268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc203a0-ea07-436a-8031-c5e5cebb7b5c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:09.771008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc203a0-ea07-436a-8031-c5e5cebb7b5c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:09.772024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc203a0-ea07-436a-8031-c5e5cebb7b5c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:09.772880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc203a0-ea07-436a-8031-c5e5cebb7b5c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:09.965923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fdc203a0-ea07-436a-8031-c5e5cebb7b5c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:09.982225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fdc203a0-ea07-436a-8031-c5e5cebb7b5c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:09.984087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fdc203a0-ea07-436a-8031-c5e5cebb7b5c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:09.985599 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fdc203a0-ea07-436a-8031-c5e5cebb7b5c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1593 microversion: 2.42 time: 0.227835 Mar 05 21:04:09.986583 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1889/3877] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:09 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1593 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:09.992817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-145ee26d-7beb-49e2-8546-83a7f75d37fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:09.993857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-145ee26d-7beb-49e2-8546-83a7f75d37fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:10.003328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-145ee26d-7beb-49e2-8546-83a7f75d37fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:10.004152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-145ee26d-7beb-49e2-8546-83a7f75d37fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:10.005173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-145ee26d-7beb-49e2-8546-83a7f75d37fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:10.005891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-145ee26d-7beb-49e2-8546-83a7f75d37fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:10.262587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-145ee26d-7beb-49e2-8546-83a7f75d37fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:10.270324 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-145ee26d-7beb-49e2-8546-83a7f75d37fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1682 microversion: 2.1 time: 0.282487 Mar 05 21:04:10.276272 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1890/3878] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:09 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1682 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:10.294330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f4c2422a-078f-44a8-a34f-9d1aafe6863a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:10.295726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f4c2422a-078f-44a8-a34f-9d1aafe6863a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:10.317190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4c2422a-078f-44a8-a34f-9d1aafe6863a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:10.317660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4c2422a-078f-44a8-a34f-9d1aafe6863a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:10.318454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4c2422a-078f-44a8-a34f-9d1aafe6863a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:10.318900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4c2422a-078f-44a8-a34f-9d1aafe6863a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:10.392538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-f4c2422a-078f-44a8-a34f-9d1aafe6863a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lazy-loading 'flavor' on Instance uuid b2d64ade-0446-474b-a3d4-454133f21972 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:04:10.444405 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-f4c2422a-078f-44a8-a34f-9d1aafe6863a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] HTTP exception thrown: Cannot 'rescue' instance b2d64ade-0446-474b-a3d4-454133f21972 while it is in vm_state paused Mar 05 21:04:10.446335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f4c2422a-078f-44a8-a34f-9d1aafe6863a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Returning 409 to user: Cannot 'rescue' instance b2d64ade-0446-474b-a3d4-454133f21972 while it is in vm_state paused {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:10.448126 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f4c2422a-078f-44a8-a34f-9d1aafe6863a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action" status: 409 len: 144 microversion: 2.1 time: 0.169996 Mar 05 21:04:10.449364 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1891/3879] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:04:10 2022] POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action => generated 144 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:04:10.456217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0f883294-6170-47c0-ba19-d4b842491bfa tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:10.457121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0f883294-6170-47c0-ba19-d4b842491bfa tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:10.468259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0f883294-6170-47c0-ba19-d4b842491bfa tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:10.472511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0f883294-6170-47c0-ba19-d4b842491bfa tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:10.476066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0f883294-6170-47c0-ba19-d4b842491bfa tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:10.476754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0f883294-6170-47c0-ba19-d4b842491bfa tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:10.859394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0f883294-6170-47c0-ba19-d4b842491bfa tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:10.889595 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0f883294-6170-47c0-ba19-d4b842491bfa tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1309 microversion: 2.1 time: 0.438824 Mar 05 21:04:10.893584 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1892/3880] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:10 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1309 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:10.908369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b7cde7c4-794a-42be-8a9f-e3e370474997 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:10.910890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b7cde7c4-794a-42be-8a9f-e3e370474997 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:10.927295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7cde7c4-794a-42be-8a9f-e3e370474997 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:10.928174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7cde7c4-794a-42be-8a9f-e3e370474997 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:10.938152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7cde7c4-794a-42be-8a9f-e3e370474997 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:10.939382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7cde7c4-794a-42be-8a9f-e3e370474997 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:11.131925 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b7cde7c4-794a-42be-8a9f-e3e370474997 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action" status: 202 len: 0 microversion: 2.1 time: 0.226078 Mar 05 21:04:11.136221 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1893/3881] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:04:10 2022] POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:04:11.149083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-61f28667-8bdf-4995-9959-469e590b37e1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:11.149810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-61f28667-8bdf-4995-9959-469e590b37e1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:11.166629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61f28667-8bdf-4995-9959-469e590b37e1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:11.167087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61f28667-8bdf-4995-9959-469e590b37e1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:11.169891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61f28667-8bdf-4995-9959-469e590b37e1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:11.172223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61f28667-8bdf-4995-9959-469e590b37e1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:11.310065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-61f28667-8bdf-4995-9959-469e590b37e1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:11.319716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-61f28667-8bdf-4995-9959-469e590b37e1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:11.333758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-61f28667-8bdf-4995-9959-469e590b37e1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:11.335003 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-61f28667-8bdf-4995-9959-469e590b37e1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1593 microversion: 2.42 time: 0.197564 Mar 05 21:04:11.345652 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1894/3882] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:11 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1593 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:11.356660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-80209ac9-0663-40e0-8073-ddda1f556c52 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:11.357352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-80209ac9-0663-40e0-8073-ddda1f556c52 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:11.374900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80209ac9-0663-40e0-8073-ddda1f556c52 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:11.375899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80209ac9-0663-40e0-8073-ddda1f556c52 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:11.376719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80209ac9-0663-40e0-8073-ddda1f556c52 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:11.377359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80209ac9-0663-40e0-8073-ddda1f556c52 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:11.652671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-80209ac9-0663-40e0-8073-ddda1f556c52 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:11.663365 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-80209ac9-0663-40e0-8073-ddda1f556c52 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1515 microversion: 2.1 time: 0.316545 Mar 05 21:04:11.664206 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1895/3883] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:11 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1515 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:11.681148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a25505b7-10cb-4a22-a7b2-a5c053f8f184 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:11.683406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a25505b7-10cb-4a22-a7b2-a5c053f8f184 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:11.695761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a25505b7-10cb-4a22-a7b2-a5c053f8f184 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:11.697926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a25505b7-10cb-4a22-a7b2-a5c053f8f184 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:11.699767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a25505b7-10cb-4a22-a7b2-a5c053f8f184 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:11.701628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a25505b7-10cb-4a22-a7b2-a5c053f8f184 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:12.096271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a25505b7-10cb-4a22-a7b2-a5c053f8f184 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:12.104060 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a25505b7-10cb-4a22-a7b2-a5c053f8f184 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1682 microversion: 2.1 time: 0.438974 Mar 05 21:04:12.104825 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1896/3884] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:11 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1682 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:12.113750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2d3c3507-bfe0-47ae-8252-58e24b9c47dd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:12.114369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2d3c3507-bfe0-47ae-8252-58e24b9c47dd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:12.133138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d3c3507-bfe0-47ae-8252-58e24b9c47dd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:12.133590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d3c3507-bfe0-47ae-8252-58e24b9c47dd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:12.136179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d3c3507-bfe0-47ae-8252-58e24b9c47dd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:12.136785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d3c3507-bfe0-47ae-8252-58e24b9c47dd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:12.499615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d3c3507-bfe0-47ae-8252-58e24b9c47dd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:12.514060 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2d3c3507-bfe0-47ae-8252-58e24b9c47dd tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1309 microversion: 2.1 time: 0.408129 Mar 05 21:04:12.544983 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1897/3885] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:12 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1309 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:12.565593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ac08ee52-0233-41b8-b81d-4f013c1e5d20 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:12.566989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ac08ee52-0233-41b8-b81d-4f013c1e5d20 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:12.578093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac08ee52-0233-41b8-b81d-4f013c1e5d20 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:12.579402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac08ee52-0233-41b8-b81d-4f013c1e5d20 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:12.580314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac08ee52-0233-41b8-b81d-4f013c1e5d20 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:12.580774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac08ee52-0233-41b8-b81d-4f013c1e5d20 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:12.700770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:04:12.701683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:04:12.702363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:04:12.703293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:04:12.703931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:04:12.722798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:12.723547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:12.727864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:12.730787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:12.781342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ac08ee52-0233-41b8-b81d-4f013c1e5d20 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:12.787182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Getting quotas for project f59b6cf41e6d4308819eb264dcaa320e. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:04:12.801271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ac08ee52-0233-41b8-b81d-4f013c1e5d20 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:12.801914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Getting quotas for user 352a9d7250c742638d90f17006f12c13 and project f59b6cf41e6d4308819eb264dcaa320e. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:04:12.808388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ac08ee52-0233-41b8-b81d-4f013c1e5d20 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:12.811229 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ac08ee52-0233-41b8-b81d-4f013c1e5d20 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1593 microversion: 2.42 time: 0.264693 Mar 05 21:04:12.812149 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1898/3886] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:12 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1593 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:12.861589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:04:12.864464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:04:13.029259 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5bc6975c-9a85-40db-a408-b5c15cc36580 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.073441 Mar 05 21:04:13.031279 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1989/3887] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:04:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 4076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:04:13.044067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e4966492-88f2-48ca-9fa8-5aa5618747d5 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:13.045024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e4966492-88f2-48ca-9fa8-5aa5618747d5 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:13.123927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-72bf8e7c-79a7-44b6-942f-c1298da9d868 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:13.124706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-72bf8e7c-79a7-44b6-942f-c1298da9d868 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:13.155943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72bf8e7c-79a7-44b6-942f-c1298da9d868 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:13.156282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72bf8e7c-79a7-44b6-942f-c1298da9d868 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:13.157090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72bf8e7c-79a7-44b6-942f-c1298da9d868 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:13.157534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72bf8e7c-79a7-44b6-942f-c1298da9d868 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:13.236118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e4966492-88f2-48ca-9fa8-5aa5618747d5 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:13.246012 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e4966492-88f2-48ca-9fa8-5aa5618747d5 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1236 microversion: 2.1 time: 0.207307 Mar 05 21:04:13.248331 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1899/3888] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:13 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1236 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:13.261460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-067c4251-7a5f-40d8-ba72-def26c6bac8d req-1950fd84-82e5-48bf-9184-770ab3d4f266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3107763c-59c3-4635-8506-ceac63b004b0", "name": "network-vif-plugged", "status": "completed", "tag": "e6f29933-01e9-44e2-b2d2-710980940a5a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:13.283922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-067c4251-7a5f-40d8-ba72-def26c6bac8d req-1950fd84-82e5-48bf-9184-770ab3d4f266 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:13.286427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-067c4251-7a5f-40d8-ba72-def26c6bac8d req-1950fd84-82e5-48bf-9184-770ab3d4f266 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:13.315035 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-067c4251-7a5f-40d8-ba72-def26c6bac8d req-1950fd84-82e5-48bf-9184-770ab3d4f266 service nova] Creating event network-vif-plugged:e6f29933-01e9-44e2-b2d2-710980940a5a for instance 3107763c-59c3-4635-8506-ceac63b004b0 on nch1-master-1 Mar 05 21:04:13.326294 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-067c4251-7a5f-40d8-ba72-def26c6bac8d req-1950fd84-82e5-48bf-9184-770ab3d4f266 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075493 Mar 05 21:04:13.331270 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1900/3889] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:13.492382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e4e08d2c-4659-4f60-8cb9-146b799ba775 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:13.495159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e4e08d2c-4659-4f60-8cb9-146b799ba775 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:13.514984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e4e08d2c-4659-4f60-8cb9-146b799ba775 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:13.516083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e4e08d2c-4659-4f60-8cb9-146b799ba775 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:13.520269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e4e08d2c-4659-4f60-8cb9-146b799ba775 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:13.522835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e4e08d2c-4659-4f60-8cb9-146b799ba775 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:13.603255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-e4e08d2c-4659-4f60-8cb9-146b799ba775 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lazy-loading 'flavor' on Instance uuid b2d64ade-0446-474b-a3d4-454133f21972 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:04:13.826306 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e4e08d2c-4659-4f60-8cb9-146b799ba775 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action" status: 200 len: 32 microversion: 2.1 time: 0.337064 Mar 05 21:04:13.829220 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1901/3890] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:04:13 2022] POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action => generated 32 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 05 21:04:13.842776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aa9cf9c0-5a61-4853-9bb3-9205ce7f4553 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:13.845539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aa9cf9c0-5a61-4853-9bb3-9205ce7f4553 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:13.860042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa9cf9c0-5a61-4853-9bb3-9205ce7f4553 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:13.862577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa9cf9c0-5a61-4853-9bb3-9205ce7f4553 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:13.865112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa9cf9c0-5a61-4853-9bb3-9205ce7f4553 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:13.867236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa9cf9c0-5a61-4853-9bb3-9205ce7f4553 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:15.006484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aa9cf9c0-5a61-4853-9bb3-9205ce7f4553 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:15.030068 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aa9cf9c0-5a61-4853-9bb3-9205ce7f4553 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1309 microversion: 2.1 time: 1.197651 Mar 05 21:04:15.044465 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1902/3891] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:13 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1309 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:15.059544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7504d5b9-7405-4612-a5f2-47ab6de74ff0 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:15.060223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7504d5b9-7405-4612-a5f2-47ab6de74ff0 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:15.083725 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7504d5b9-7405-4612-a5f2-47ab6de74ff0 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:15.084452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7504d5b9-7405-4612-a5f2-47ab6de74ff0 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:15.085432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7504d5b9-7405-4612-a5f2-47ab6de74ff0 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:15.086313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7504d5b9-7405-4612-a5f2-47ab6de74ff0 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:15.491401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7504d5b9-7405-4612-a5f2-47ab6de74ff0 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:15.516589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7504d5b9-7405-4612-a5f2-47ab6de74ff0 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:15.521333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7504d5b9-7405-4612-a5f2-47ab6de74ff0 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:15.529234 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7504d5b9-7405-4612-a5f2-47ab6de74ff0 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1661 microversion: 2.42 time: 0.482357 Mar 05 21:04:15.533089 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1903/3892] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:15 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1661 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:15.555609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-57fedfeb-9620-4b1c-a7e2-e9453f3ad447 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:15.564556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-57fedfeb-9620-4b1c-a7e2-e9453f3ad447 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:15.593568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-57fedfeb-9620-4b1c-a7e2-e9453f3ad447 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:15.593971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-57fedfeb-9620-4b1c-a7e2-e9453f3ad447 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:15.601461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-57fedfeb-9620-4b1c-a7e2-e9453f3ad447 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:15.605438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-57fedfeb-9620-4b1c-a7e2-e9453f3ad447 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:15.844098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-72bf8e7c-79a7-44b6-942f-c1298da9d868 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:15.882900 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-72bf8e7c-79a7-44b6-942f-c1298da9d868 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1682 microversion: 2.1 time: 2.745200 Mar 05 21:04:15.883651 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1990/3893] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:13 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1682 bytes in 2766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:04:15.926348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b82038da-1776-4bfd-91a2-a10d106891fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:15.940609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b82038da-1776-4bfd-91a2-a10d106891fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:15.962393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b82038da-1776-4bfd-91a2-a10d106891fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:15.964875 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b82038da-1776-4bfd-91a2-a10d106891fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:15.967061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b82038da-1776-4bfd-91a2-a10d106891fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:15.967761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b82038da-1776-4bfd-91a2-a10d106891fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:16.236657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-57fedfeb-9620-4b1c-a7e2-e9453f3ad447 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:16.245016 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-57fedfeb-9620-4b1c-a7e2-e9453f3ad447 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 0.708741 Mar 05 21:04:16.249947 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1904/3894] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:15 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:16.263818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1e2a05c8-5559-4f65-a32c-615432092bb4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:16.272925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1e2a05c8-5559-4f65-a32c-615432092bb4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:16.302732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e2a05c8-5559-4f65-a32c-615432092bb4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:16.325662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e2a05c8-5559-4f65-a32c-615432092bb4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:16.335213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b82038da-1776-4bfd-91a2-a10d106891fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:16.337041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e2a05c8-5559-4f65-a32c-615432092bb4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:16.339226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e2a05c8-5559-4f65-a32c-615432092bb4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:16.347727 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b82038da-1776-4bfd-91a2-a10d106891fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1294 microversion: 2.1 time: 0.450722 Mar 05 21:04:16.349682 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1991/3895] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:15 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1294 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:16.550641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-898ac2e5-01e3-41a1-9aad-a3dbac969ffd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:16.551270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-898ac2e5-01e3-41a1-9aad-a3dbac969ffd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:16.564481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-898ac2e5-01e3-41a1-9aad-a3dbac969ffd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:16.565556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-898ac2e5-01e3-41a1-9aad-a3dbac969ffd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:16.566554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-898ac2e5-01e3-41a1-9aad-a3dbac969ffd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:16.567643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-898ac2e5-01e3-41a1-9aad-a3dbac969ffd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:16.604992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1e2a05c8-5559-4f65-a32c-615432092bb4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:16.614308 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1e2a05c8-5559-4f65-a32c-615432092bb4 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1489 microversion: 2.1 time: 0.362999 Mar 05 21:04:16.615690 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1905/3896] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:16 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1489 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:16.637451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9d436d2c-5da0-456e-96a5-e216ac3f978c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-445372763"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:16.638582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9d436d2c-5da0-456e-96a5-e216ac3f978c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:16.646292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d436d2c-5da0-456e-96a5-e216ac3f978c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:16.646725 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d436d2c-5da0-456e-96a5-e216ac3f978c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:16.647782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d436d2c-5da0-456e-96a5-e216ac3f978c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:16.648238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9d436d2c-5da0-456e-96a5-e216ac3f978c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:16.768741 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9d436d2c-5da0-456e-96a5-e216ac3f978c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "PUT /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1073 microversion: 2.1 time: 0.140720 Mar 05 21:04:16.770024 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1906/3897] 10.222.0.15 () {60 vars in 1255 bytes} [Sat Mar 5 21:04:16 2022] PUT /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1073 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:16.786071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-949b7fbd-cf2b-4753-b834-29a93bdf3413 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:16.787309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-949b7fbd-cf2b-4753-b834-29a93bdf3413 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:16.810578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-949b7fbd-cf2b-4753-b834-29a93bdf3413 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:16.811477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-949b7fbd-cf2b-4753-b834-29a93bdf3413 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:16.812603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-949b7fbd-cf2b-4753-b834-29a93bdf3413 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:16.813204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-949b7fbd-cf2b-4753-b834-29a93bdf3413 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:17.013626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-949b7fbd-cf2b-4753-b834-29a93bdf3413 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:17.028067 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-949b7fbd-cf2b-4753-b834-29a93bdf3413 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1499 microversion: 2.1 time: 0.248030 Mar 05 21:04:17.039237 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1907/3898] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:16 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1499 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:17.044724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1dc097b2-9eaa-4e6d-a18d-f4bd468ffb98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:17.045631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1dc097b2-9eaa-4e6d-a18d-f4bd468ffb98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:17.052313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1dc097b2-9eaa-4e6d-a18d-f4bd468ffb98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:17.053018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1dc097b2-9eaa-4e6d-a18d-f4bd468ffb98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:17.053973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1dc097b2-9eaa-4e6d-a18d-f4bd468ffb98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:17.054576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1dc097b2-9eaa-4e6d-a18d-f4bd468ffb98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:17.373754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1dc097b2-9eaa-4e6d-a18d-f4bd468ffb98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:17.396428 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1dc097b2-9eaa-4e6d-a18d-f4bd468ffb98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1682 microversion: 2.1 time: 0.355286 Mar 05 21:04:17.414935 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1908/3899] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:17 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1682 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:17.414935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-72faf208-b683-4f18-a1ff-97f348d72170 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:17.414935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-72faf208-b683-4f18-a1ff-97f348d72170 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:17.425623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72faf208-b683-4f18-a1ff-97f348d72170 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:17.425623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72faf208-b683-4f18-a1ff-97f348d72170 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:17.425623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72faf208-b683-4f18-a1ff-97f348d72170 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:17.426413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72faf208-b683-4f18-a1ff-97f348d72170 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:17.601815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-72faf208-b683-4f18-a1ff-97f348d72170 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:17.616201 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-72faf208-b683-4f18-a1ff-97f348d72170 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1499 microversion: 2.1 time: 0.209477 Mar 05 21:04:17.628556 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1909/3900] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:17 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1499 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:17.634072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e5f7abe9-371d-4718-81f1-140bdd8f93a9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:17.635877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e5f7abe9-371d-4718-81f1-140bdd8f93a9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:17.644822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5f7abe9-371d-4718-81f1-140bdd8f93a9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:17.645348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5f7abe9-371d-4718-81f1-140bdd8f93a9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:17.645832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5f7abe9-371d-4718-81f1-140bdd8f93a9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:17.646272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5f7abe9-371d-4718-81f1-140bdd8f93a9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:17.673634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-898ac2e5-01e3-41a1-9aad-a3dbac969ffd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:17.690909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-898ac2e5-01e3-41a1-9aad-a3dbac969ffd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:17.693912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-898ac2e5-01e3-41a1-9aad-a3dbac969ffd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:17.696768 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-898ac2e5-01e3-41a1-9aad-a3dbac969ffd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1649 microversion: 2.42 time: 1.149502 Mar 05 21:04:17.700067 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1992/3901] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:16 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1649 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:04:17.715970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fe8cdaed-8549-4e77-aa2c-4bb52c48a33e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:17.717402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fe8cdaed-8549-4e77-aa2c-4bb52c48a33e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:17.727561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe8cdaed-8549-4e77-aa2c-4bb52c48a33e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:17.728603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe8cdaed-8549-4e77-aa2c-4bb52c48a33e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:17.730106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe8cdaed-8549-4e77-aa2c-4bb52c48a33e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:17.730957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe8cdaed-8549-4e77-aa2c-4bb52c48a33e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:17.842045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e5f7abe9-371d-4718-81f1-140bdd8f93a9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:17.854727 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e5f7abe9-371d-4718-81f1-140bdd8f93a9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 0.224826 Mar 05 21:04:17.867847 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1910/3902] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:17 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:17.873272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-64c31a6a-6788-4bdb-86f4-189188b30e14 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:17.879814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64c31a6a-6788-4bdb-86f4-189188b30e14 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:17.880265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64c31a6a-6788-4bdb-86f4-189188b30e14 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:17.922311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fe8cdaed-8549-4e77-aa2c-4bb52c48a33e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:17.937251 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fe8cdaed-8549-4e77-aa2c-4bb52c48a33e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1294 microversion: 2.1 time: 0.235586 Mar 05 21:04:17.953561 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1993/3903] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:17 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1294 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:17.962802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-64c31a6a-6788-4bdb-86f4-189188b30e14 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Going to try to stop instance {{(pid=141478) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 05 21:04:18.043299 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-64c31a6a-6788-4bdb-86f4-189188b30e14 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "POST /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0/action" status: 202 len: 0 microversion: 2.1 time: 0.173962 Mar 05 21:04:18.048231 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1911/3904] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:04:17 2022] POST /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:04:18.052969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0cbb3d20-77e3-426c-82c3-2653a43c6bed tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:18.053808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0cbb3d20-77e3-426c-82c3-2653a43c6bed tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:18.064898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cbb3d20-77e3-426c-82c3-2653a43c6bed tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:18.065749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cbb3d20-77e3-426c-82c3-2653a43c6bed tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:18.067377 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cbb3d20-77e3-426c-82c3-2653a43c6bed tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:18.068088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cbb3d20-77e3-426c-82c3-2653a43c6bed tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:18.428629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cbaff80b-5b26-4a77-8d34-99b1da3bb8ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:18.430287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cbaff80b-5b26-4a77-8d34-99b1da3bb8ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:18.452470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbaff80b-5b26-4a77-8d34-99b1da3bb8ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:18.453272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbaff80b-5b26-4a77-8d34-99b1da3bb8ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:18.458311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbaff80b-5b26-4a77-8d34-99b1da3bb8ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:18.462164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbaff80b-5b26-4a77-8d34-99b1da3bb8ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:18.549392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0cbb3d20-77e3-426c-82c3-2653a43c6bed tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:18.557726 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0cbb3d20-77e3-426c-82c3-2653a43c6bed tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.508512 Mar 05 21:04:18.558251 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1994/3905] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:18 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:04:18.710806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9f2b63f2-dde9-469c-ad97-82728ea380fd tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Action: 'create', calling method: .version_select at 0x7fed4f7b8e50>, body: {"keypair": {"name": "tempest-keypair-2085100150"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:18.754380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9f2b63f2-dde9-469c-ad97-82728ea380fd tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Getting quotas for project 7efe7e39b29a47fcb344c08b109d4e40. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:04:18.781612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9f2b63f2-dde9-469c-ad97-82728ea380fd tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Getting quotas for user 3aee798b914c450f9dd2de705aa6233c and project 7efe7e39b29a47fcb344c08b109d4e40. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:04:18.909759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cbaff80b-5b26-4a77-8d34-99b1da3bb8ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:18.930048 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cbaff80b-5b26-4a77-8d34-99b1da3bb8ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1682 microversion: 2.1 time: 0.507214 Mar 05 21:04:18.940231 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1912/3906] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:18 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1682 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:04:18.950216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3c05097d-0a94-436a-a52a-f37bd4346388 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:18.965267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3c05097d-0a94-436a-a52a-f37bd4346388 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:18.995760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c05097d-0a94-436a-a52a-f37bd4346388 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:19.000545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c05097d-0a94-436a-a52a-f37bd4346388 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:19.002434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c05097d-0a94-436a-a52a-f37bd4346388 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:19.003072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c05097d-0a94-436a-a52a-f37bd4346388 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:19.301061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9f2b63f2-dde9-469c-ad97-82728ea380fd tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Getting quotas for project 7efe7e39b29a47fcb344c08b109d4e40. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:04:19.314881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9f2b63f2-dde9-469c-ad97-82728ea380fd tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Getting quotas for user 3aee798b914c450f9dd2de705aa6233c and project 7efe7e39b29a47fcb344c08b109d4e40. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:04:19.348587 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9f2b63f2-dde9-469c-ad97-82728ea380fd tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.737991 Mar 05 21:04:19.350380 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1995/3907] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:04:18 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:04:19.357080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1f155016-d4d7-4803-a0a2-66388bfd3f23 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:19.362691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1f155016-d4d7-4803-a0a2-66388bfd3f23 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:19.395495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f155016-d4d7-4803-a0a2-66388bfd3f23 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:19.401836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f155016-d4d7-4803-a0a2-66388bfd3f23 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:19.403745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f155016-d4d7-4803-a0a2-66388bfd3f23 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:19.409242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f155016-d4d7-4803-a0a2-66388bfd3f23 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:19.544174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3c05097d-0a94-436a-a52a-f37bd4346388 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:19.565272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3c05097d-0a94-436a-a52a-f37bd4346388 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:19.569710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3c05097d-0a94-436a-a52a-f37bd4346388 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:19.570989 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3c05097d-0a94-436a-a52a-f37bd4346388 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1696 microversion: 2.42 time: 0.628170 Mar 05 21:04:19.571596 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1913/3908] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:18 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1696 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:19.602441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1f43b9cd-5dbe-4cdd-a7f1-83cddc94830f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:19.603547 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1f43b9cd-5dbe-4cdd-a7f1-83cddc94830f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:19.643294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f43b9cd-5dbe-4cdd-a7f1-83cddc94830f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:19.646134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f43b9cd-5dbe-4cdd-a7f1-83cddc94830f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:19.647041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f43b9cd-5dbe-4cdd-a7f1-83cddc94830f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:19.648041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f43b9cd-5dbe-4cdd-a7f1-83cddc94830f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:19.886300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1f155016-d4d7-4803-a0a2-66388bfd3f23 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:19.898859 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1f155016-d4d7-4803-a0a2-66388bfd3f23 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 0.547078 Mar 05 21:04:19.910977 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1996/3909] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:19 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:19.916587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-63cb5776-dac1-404b-a16a-137d93f9fb7a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:19.917391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-63cb5776-dac1-404b-a16a-137d93f9fb7a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:19.926614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63cb5776-dac1-404b-a16a-137d93f9fb7a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:19.927086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63cb5776-dac1-404b-a16a-137d93f9fb7a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:19.927940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63cb5776-dac1-404b-a16a-137d93f9fb7a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:19.928423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63cb5776-dac1-404b-a16a-137d93f9fb7a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:20.134577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1f43b9cd-5dbe-4cdd-a7f1-83cddc94830f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:20.145208 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1f43b9cd-5dbe-4cdd-a7f1-83cddc94830f tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1361 microversion: 2.1 time: 0.571655 Mar 05 21:04:20.146739 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1914/3910] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:19 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1361 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:20.159627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5b30a6a7-1153-49df-b38d-e6a711b82d31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:20.163951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5b30a6a7-1153-49df-b38d-e6a711b82d31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:20.178133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b30a6a7-1153-49df-b38d-e6a711b82d31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:20.178815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b30a6a7-1153-49df-b38d-e6a711b82d31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:20.187092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b30a6a7-1153-49df-b38d-e6a711b82d31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:20.188018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b30a6a7-1153-49df-b38d-e6a711b82d31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:20.518893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5b30a6a7-1153-49df-b38d-e6a711b82d31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:20.544139 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5b30a6a7-1153-49df-b38d-e6a711b82d31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1682 microversion: 2.1 time: 0.384239 Mar 05 21:04:20.545582 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1915/3911] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:20 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1682 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:20.632359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4496ebc9-e054-445c-82ac-1b3a1140671b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:20.633363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4496ebc9-e054-445c-82ac-1b3a1140671b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:20.640883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4496ebc9-e054-445c-82ac-1b3a1140671b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:20.641706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4496ebc9-e054-445c-82ac-1b3a1140671b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:20.642774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4496ebc9-e054-445c-82ac-1b3a1140671b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:20.648669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4496ebc9-e054-445c-82ac-1b3a1140671b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:20.753346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-63cb5776-dac1-404b-a16a-137d93f9fb7a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:20.761569 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-63cb5776-dac1-404b-a16a-137d93f9fb7a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.849113 Mar 05 21:04:20.769568 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1997/3912] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:19 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:20.926453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dc2c2cf3-cd4b-45d9-b74a-eb10196f05c9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:20.927960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dc2c2cf3-cd4b-45d9-b74a-eb10196f05c9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:20.946869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc2c2cf3-cd4b-45d9-b74a-eb10196f05c9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:20.947550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc2c2cf3-cd4b-45d9-b74a-eb10196f05c9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:20.948460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc2c2cf3-cd4b-45d9-b74a-eb10196f05c9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:20.948979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc2c2cf3-cd4b-45d9-b74a-eb10196f05c9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:21.137497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4496ebc9-e054-445c-82ac-1b3a1140671b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:21.152807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4496ebc9-e054-445c-82ac-1b3a1140671b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:21.157673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4496ebc9-e054-445c-82ac-1b3a1140671b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:21.159191 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4496ebc9-e054-445c-82ac-1b3a1140671b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1696 microversion: 2.42 time: 0.530792 Mar 05 21:04:21.162820 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1916/3913] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:20 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1696 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:04:21.197395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d530bc4a-dba5-4474-9a01-4e4a6062796e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:21.198034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d530bc4a-dba5-4474-9a01-4e4a6062796e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:21.205573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d530bc4a-dba5-4474-9a01-4e4a6062796e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:21.216269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d530bc4a-dba5-4474-9a01-4e4a6062796e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:21.217466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d530bc4a-dba5-4474-9a01-4e4a6062796e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:21.217916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d530bc4a-dba5-4474-9a01-4e4a6062796e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:21.588220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d530bc4a-dba5-4474-9a01-4e4a6062796e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:21.598999 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d530bc4a-dba5-4474-9a01-4e4a6062796e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1361 microversion: 2.1 time: 0.427903 Mar 05 21:04:21.604978 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1917/3914] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:21 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1361 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:21.615090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-38490dce-4d61-47ec-9df6-9dcc1e0644e3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:21.617389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-38490dce-4d61-47ec-9df6-9dcc1e0644e3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:21.637159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38490dce-4d61-47ec-9df6-9dcc1e0644e3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:21.638700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38490dce-4d61-47ec-9df6-9dcc1e0644e3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:21.640284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38490dce-4d61-47ec-9df6-9dcc1e0644e3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:21.643245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38490dce-4d61-47ec-9df6-9dcc1e0644e3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:22.126622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dc2c2cf3-cd4b-45d9-b74a-eb10196f05c9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:22.153396 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dc2c2cf3-cd4b-45d9-b74a-eb10196f05c9 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 1.230784 Mar 05 21:04:22.154059 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1998/3915] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:20 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:04:22.161178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b4d75f90-ff1a-404b-ba20-a66f1ebe15a2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:22.161873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b4d75f90-ff1a-404b-ba20-a66f1ebe15a2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:22.184304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4d75f90-ff1a-404b-ba20-a66f1ebe15a2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:22.185746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4d75f90-ff1a-404b-ba20-a66f1ebe15a2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:22.188535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4d75f90-ff1a-404b-ba20-a66f1ebe15a2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:22.188947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4d75f90-ff1a-404b-ba20-a66f1ebe15a2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:22.317907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-38490dce-4d61-47ec-9df6-9dcc1e0644e3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:22.333005 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-38490dce-4d61-47ec-9df6-9dcc1e0644e3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1682 microversion: 2.1 time: 0.726596 Mar 05 21:04:22.347603 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1918/3916] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:21 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1682 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:22.353742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74fa2c6f-d17b-46dc-a281-eb8999d1a938 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:22.354684 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-74fa2c6f-d17b-46dc-a281-eb8999d1a938 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:22.364814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74fa2c6f-d17b-46dc-a281-eb8999d1a938 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:22.365825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74fa2c6f-d17b-46dc-a281-eb8999d1a938 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:22.366860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74fa2c6f-d17b-46dc-a281-eb8999d1a938 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:22.367756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-74fa2c6f-d17b-46dc-a281-eb8999d1a938 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:22.795348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b4d75f90-ff1a-404b-ba20-a66f1ebe15a2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:22.807291 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b4d75f90-ff1a-404b-ba20-a66f1ebe15a2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.651508 Mar 05 21:04:22.811692 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 1999/3917] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:22 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:22.823271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-46359eaf-619f-4366-97bf-89ba4ed92845 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:22.824717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-46359eaf-619f-4366-97bf-89ba4ed92845 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:22.839354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46359eaf-619f-4366-97bf-89ba4ed92845 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:22.839848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46359eaf-619f-4366-97bf-89ba4ed92845 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:22.843807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46359eaf-619f-4366-97bf-89ba4ed92845 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:22.846160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46359eaf-619f-4366-97bf-89ba4ed92845 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:23.037919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-74fa2c6f-d17b-46dc-a281-eb8999d1a938 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:23.054116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-74fa2c6f-d17b-46dc-a281-eb8999d1a938 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:23.056609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-74fa2c6f-d17b-46dc-a281-eb8999d1a938 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:23.059911 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-74fa2c6f-d17b-46dc-a281-eb8999d1a938 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1743 microversion: 2.42 time: 0.710819 Mar 05 21:04:23.066221 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1919/3918] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:22 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1743 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:23.172219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eeae4d1d-6f98-4d41-b675-31c8f8cad0cc tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:23.172841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eeae4d1d-6f98-4d41-b675-31c8f8cad0cc tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:23.182464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eeae4d1d-6f98-4d41-b675-31c8f8cad0cc tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:23.182925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eeae4d1d-6f98-4d41-b675-31c8f8cad0cc tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:23.187885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eeae4d1d-6f98-4d41-b675-31c8f8cad0cc tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:23.188808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eeae4d1d-6f98-4d41-b675-31c8f8cad0cc tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:23.525534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-46359eaf-619f-4366-97bf-89ba4ed92845 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:23.537297 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-46359eaf-619f-4366-97bf-89ba4ed92845 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1361 microversion: 2.1 time: 0.724413 Mar 05 21:04:23.537929 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2000/3919] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:22 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1361 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:23.601919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eeae4d1d-6f98-4d41-b675-31c8f8cad0cc tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:23.613241 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eeae4d1d-6f98-4d41-b675-31c8f8cad0cc tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 0.446008 Mar 05 21:04:23.626697 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1920/3920] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:23 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:23.657370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-223739ec-9eb1-4afd-a6bb-17c55796cb4b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:23.660864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-223739ec-9eb1-4afd-a6bb-17c55796cb4b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:23.675575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-223739ec-9eb1-4afd-a6bb-17c55796cb4b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:23.677511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-223739ec-9eb1-4afd-a6bb-17c55796cb4b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:23.680747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-223739ec-9eb1-4afd-a6bb-17c55796cb4b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:23.682456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-223739ec-9eb1-4afd-a6bb-17c55796cb4b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:23.768851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-51ac3fa6-08b7-4d61-afd5-b8ad28284b22 req-cdfb644e-6dd6-455a-9316-bd6c5031a18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf406b0-8c85-4126-ade0-797f76b7b3cf", "tag": "2f672d97-7658-4404-9c2c-23bec705e4a1"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:23.798623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-51ac3fa6-08b7-4d61-afd5-b8ad28284b22 req-cdfb644e-6dd6-455a-9316-bd6c5031a18f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:23.799093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-51ac3fa6-08b7-4d61-afd5-b8ad28284b22 req-cdfb644e-6dd6-455a-9316-bd6c5031a18f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:23.855058 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-51ac3fa6-08b7-4d61-afd5-b8ad28284b22 req-cdfb644e-6dd6-455a-9316-bd6c5031a18f service nova] Creating event network-changed:2f672d97-7658-4404-9c2c-23bec705e4a1 for instance bbf406b0-8c85-4126-ade0-797f76b7b3cf on nch1-master-1 Mar 05 21:04:23.870539 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-51ac3fa6-08b7-4d61-afd5-b8ad28284b22 req-cdfb644e-6dd6-455a-9316-bd6c5031a18f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326989 Mar 05 21:04:23.873334 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2001/3921] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:23.880833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-83222bd6-d102-43b3-a9ba-608d9a83816c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:23.883277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-83222bd6-d102-43b3-a9ba-608d9a83816c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:23.921702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83222bd6-d102-43b3-a9ba-608d9a83816c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:23.923484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83222bd6-d102-43b3-a9ba-608d9a83816c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:23.926518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83222bd6-d102-43b3-a9ba-608d9a83816c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:23.926993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83222bd6-d102-43b3-a9ba-608d9a83816c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:24.374021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-83222bd6-d102-43b3-a9ba-608d9a83816c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:24.390032 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-83222bd6-d102-43b3-a9ba-608d9a83816c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.514678 Mar 05 21:04:24.403820 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2002/3922] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:23 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:24.416319 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-94abe123-3848-47d5-b1fe-4f1b8bd9ed4a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:24.417449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-94abe123-3848-47d5-b1fe-4f1b8bd9ed4a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:24.445638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94abe123-3848-47d5-b1fe-4f1b8bd9ed4a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:24.452370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94abe123-3848-47d5-b1fe-4f1b8bd9ed4a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:24.456344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94abe123-3848-47d5-b1fe-4f1b8bd9ed4a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:24.457125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-94abe123-3848-47d5-b1fe-4f1b8bd9ed4a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:25.055102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-94abe123-3848-47d5-b1fe-4f1b8bd9ed4a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:25.056594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-223739ec-9eb1-4afd-a6bb-17c55796cb4b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:25.068388 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-223739ec-9eb1-4afd-a6bb-17c55796cb4b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1682 microversion: 2.1 time: 1.439851 Mar 05 21:04:25.073221 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1921/3923] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:23 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1682 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:25.082542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-94abe123-3848-47d5-b1fe-4f1b8bd9ed4a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:25.082803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-94abe123-3848-47d5-b1fe-4f1b8bd9ed4a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:25.087450 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-94abe123-3848-47d5-b1fe-4f1b8bd9ed4a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1743 microversion: 2.42 time: 0.677359 Mar 05 21:04:25.089217 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2003/3924] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:24 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1743 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:25.090823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-46caa9b5-e359-4ab4-9786-a8c1f935d826 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:25.091633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-46caa9b5-e359-4ab4-9786-a8c1f935d826 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:25.107415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dd2d4b81-68b7-4a56-952e-68efb686e63e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:25.108082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dd2d4b81-68b7-4a56-952e-68efb686e63e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:25.109704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46caa9b5-e359-4ab4-9786-a8c1f935d826 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:25.110377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46caa9b5-e359-4ab4-9786-a8c1f935d826 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:25.112297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46caa9b5-e359-4ab4-9786-a8c1f935d826 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:25.112981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46caa9b5-e359-4ab4-9786-a8c1f935d826 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:25.122033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd2d4b81-68b7-4a56-952e-68efb686e63e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:25.123179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd2d4b81-68b7-4a56-952e-68efb686e63e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:25.124227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd2d4b81-68b7-4a56-952e-68efb686e63e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:25.124864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd2d4b81-68b7-4a56-952e-68efb686e63e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:26.107904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-46caa9b5-e359-4ab4-9786-a8c1f935d826 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:26.118196 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-46caa9b5-e359-4ab4-9786-a8c1f935d826 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1361 microversion: 2.1 time: 1.033054 Mar 05 21:04:26.121482 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1922/3925] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:25 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1361 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:26.136790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3410ec5d-d518-441b-95fa-7bf6c64d587e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:26.138434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3410ec5d-d518-441b-95fa-7bf6c64d587e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:26.157469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3410ec5d-d518-441b-95fa-7bf6c64d587e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:26.158759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3410ec5d-d518-441b-95fa-7bf6c64d587e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:26.163638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3410ec5d-d518-441b-95fa-7bf6c64d587e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:26.164622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3410ec5d-d518-441b-95fa-7bf6c64d587e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:26.320140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dd2d4b81-68b7-4a56-952e-68efb686e63e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:26.329505 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dd2d4b81-68b7-4a56-952e-68efb686e63e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 1.227412 Mar 05 21:04:26.347031 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2004/3926] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:25 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:26.361654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-671585368", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6cc85f70-b559-4cc0-8cde-193983972fc4"}], "security_groups": [{"name": "tempest-securitygroup--1160101462"}], "key_name": "tempest-keypair-2085100150", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:26.636887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3410ec5d-d518-441b-95fa-7bf6c64d587e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:26.652130 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3410ec5d-d518-441b-95fa-7bf6c64d587e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.526984 Mar 05 21:04:26.652776 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1923/3927] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:26 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:26.658213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-202fbc5e-27c7-45fe-9f78-109062156a76 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:26.659508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-202fbc5e-27c7-45fe-9f78-109062156a76 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:26.668947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-202fbc5e-27c7-45fe-9f78-109062156a76 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:26.669787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-202fbc5e-27c7-45fe-9f78-109062156a76 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:26.670821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-202fbc5e-27c7-45fe-9f78-109062156a76 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:26.671432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-202fbc5e-27c7-45fe-9f78-109062156a76 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:26.985218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-202fbc5e-27c7-45fe-9f78-109062156a76 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:26.997477 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-202fbc5e-27c7-45fe-9f78-109062156a76 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1682 microversion: 2.1 time: 0.343204 Mar 05 21:04:27.008402 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1924/3928] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:26 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1682 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:27.020140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ad2bcfc6-f03d-4905-8cdf-cf03345333a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:27.023312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ad2bcfc6-f03d-4905-8cdf-cf03345333a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:27.049308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad2bcfc6-f03d-4905-8cdf-cf03345333a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:27.050823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad2bcfc6-f03d-4905-8cdf-cf03345333a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:27.061928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad2bcfc6-f03d-4905-8cdf-cf03345333a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:27.063178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad2bcfc6-f03d-4905-8cdf-cf03345333a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:27.224485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] validate_networks() for [('6cc85f70-b559-4cc0-8cde-193983972fc4', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:04:27.268653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad2bcfc6-f03d-4905-8cdf-cf03345333a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:27.279177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad2bcfc6-f03d-4905-8cdf-cf03345333a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:27.281388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad2bcfc6-f03d-4905-8cdf-cf03345333a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:27.282841 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ad2bcfc6-f03d-4905-8cdf-cf03345333a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1790 microversion: 2.42 time: 0.268554 Mar 05 21:04:27.283637 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1925/3929] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:27 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1790 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:27.289019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3ea743f8-8777-4a04-94e6-397f4f8f00d0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:27.289823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3ea743f8-8777-4a04-94e6-397f4f8f00d0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:27.297031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ea743f8-8777-4a04-94e6-397f4f8f00d0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:27.297586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ea743f8-8777-4a04-94e6-397f4f8f00d0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:27.298447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ea743f8-8777-4a04-94e6-397f4f8f00d0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:27.299023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ea743f8-8777-4a04-94e6-397f4f8f00d0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:27.481426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3ea743f8-8777-4a04-94e6-397f4f8f00d0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:27.492212 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3ea743f8-8777-4a04-94e6-397f4f8f00d0 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1361 microversion: 2.1 time: 0.207163 Mar 05 21:04:27.493191 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1926/3930] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:27 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:27.498924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b46bcc87-2582-4b9a-9980-4e9c77eb08db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:27.500267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b46bcc87-2582-4b9a-9980-4e9c77eb08db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:27.508223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b46bcc87-2582-4b9a-9980-4e9c77eb08db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:27.510261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b46bcc87-2582-4b9a-9980-4e9c77eb08db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:27.511655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b46bcc87-2582-4b9a-9980-4e9c77eb08db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:27.512598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b46bcc87-2582-4b9a-9980-4e9c77eb08db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:27.697387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b46bcc87-2582-4b9a-9980-4e9c77eb08db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:27.726460 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b46bcc87-2582-4b9a-9980-4e9c77eb08db tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 0.231306 Mar 05 21:04:27.738856 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1927/3931] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:27 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:27.750904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fac983b3-abda-4517-9209-009fe9bafaae tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:27.751530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fac983b3-abda-4517-9209-009fe9bafaae tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:27.758599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fac983b3-abda-4517-9209-009fe9bafaae tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:27.759770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fac983b3-abda-4517-9209-009fe9bafaae tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:27.782792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fac983b3-abda-4517-9209-009fe9bafaae tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:27.783525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fac983b3-abda-4517-9209-009fe9bafaae tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:28.040983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fac983b3-abda-4517-9209-009fe9bafaae tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:28.051895 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fac983b3-abda-4517-9209-009fe9bafaae tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.311674 Mar 05 21:04:28.058038 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1928/3932] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:27 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:28.065666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c7d7fb22-ab7b-40ed-a609-860f84d066f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:28.066285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c7d7fb22-ab7b-40ed-a609-860f84d066f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:28.080815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7d7fb22-ab7b-40ed-a609-860f84d066f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:28.081273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7d7fb22-ab7b-40ed-a609-860f84d066f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:28.082070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7d7fb22-ab7b-40ed-a609-860f84d066f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:28.082506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7d7fb22-ab7b-40ed-a609-860f84d066f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:28.251626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c7d7fb22-ab7b-40ed-a609-860f84d066f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:28.260034 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c7d7fb22-ab7b-40ed-a609-860f84d066f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1682 microversion: 2.1 time: 0.200696 Mar 05 21:04:28.270279 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1929/3933] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:28 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1682 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:28.306791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-99717a31-05cb-4c43-b201-f4bc14b8df84 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:28.307627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-99717a31-05cb-4c43-b201-f4bc14b8df84 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:28.316564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99717a31-05cb-4c43-b201-f4bc14b8df84 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:28.317179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99717a31-05cb-4c43-b201-f4bc14b8df84 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:28.318179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99717a31-05cb-4c43-b201-f4bc14b8df84 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:28.318759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99717a31-05cb-4c43-b201-f4bc14b8df84 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:28.523581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Getting quotas for project 7efe7e39b29a47fcb344c08b109d4e40. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:04:28.540407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Getting quotas for user 3aee798b914c450f9dd2de705aa6233c and project 7efe7e39b29a47fcb344c08b109d4e40. Resources: dict_keys(['metadata_items']) {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:04:28.567312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:04:28.567771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:04:28.568252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:04:28.568669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:04:28.571413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:04:28.597413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:28.598109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:28.599348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:28.600899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:28.623743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Getting quotas for project 7efe7e39b29a47fcb344c08b109d4e40. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:04:28.631861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Getting quotas for user 3aee798b914c450f9dd2de705aa6233c and project 7efe7e39b29a47fcb344c08b109d4e40. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:04:28.645541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-99717a31-05cb-4c43-b201-f4bc14b8df84 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:28.657349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:04:28.660390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:04:28.662203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-99717a31-05cb-4c43-b201-f4bc14b8df84 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:28.663881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-99717a31-05cb-4c43-b201-f4bc14b8df84 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:28.668775 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-99717a31-05cb-4c43-b201-f4bc14b8df84 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1837 microversion: 2.42 time: 0.369918 Mar 05 21:04:28.670116 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1930/3934] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:28 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1837 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:28.681874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-11c289cb-1e5b-4890-8d91-a2786d47e4d3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:28.685099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-11c289cb-1e5b-4890-8d91-a2786d47e4d3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:28.694320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11c289cb-1e5b-4890-8d91-a2786d47e4d3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:28.695035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11c289cb-1e5b-4890-8d91-a2786d47e4d3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:28.696157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11c289cb-1e5b-4890-8d91-a2786d47e4d3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:28.698328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11c289cb-1e5b-4890-8d91-a2786d47e4d3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:28.771590 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0fb996fc-ad65-45b9-b963-a01607c8b836 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.419574 Mar 05 21:04:28.775914 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2005/3935] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:04:26 2022] POST /compute/v2.1/servers => generated 407 bytes in 2428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:04:28.792999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8731d76b-3bae-4d21-818a-cfc2d973a3bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:28.794021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8731d76b-3bae-4d21-818a-cfc2d973a3bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:28.803055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8731d76b-3bae-4d21-818a-cfc2d973a3bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:28.804505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8731d76b-3bae-4d21-818a-cfc2d973a3bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:28.806460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8731d76b-3bae-4d21-818a-cfc2d973a3bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:28.807098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8731d76b-3bae-4d21-818a-cfc2d973a3bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:28.894951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-11c289cb-1e5b-4890-8d91-a2786d47e4d3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:28.912278 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-11c289cb-1e5b-4890-8d91-a2786d47e4d3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1361 microversion: 2.1 time: 0.234314 Mar 05 21:04:28.912932 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1931/3936] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:28 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:28.924028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a7001707-37e7-47e9-865c-d77418e41326 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:28.924652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a7001707-37e7-47e9-865c-d77418e41326 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:29.018820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a7001707-37e7-47e9-865c-d77418e41326 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:29.042173 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a7001707-37e7-47e9-865c-d77418e41326 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1269 microversion: 2.1 time: 0.126483 Mar 05 21:04:29.043253 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1932/3937] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:28 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1269 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:29.072814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1335b875-ca07-4f4e-a538-f2455880f495 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:29.074401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1335b875-ca07-4f4e-a538-f2455880f495 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:29.083893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1335b875-ca07-4f4e-a538-f2455880f495 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:29.084720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1335b875-ca07-4f4e-a538-f2455880f495 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:29.090882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1335b875-ca07-4f4e-a538-f2455880f495 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:29.091361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1335b875-ca07-4f4e-a538-f2455880f495 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:29.307759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1335b875-ca07-4f4e-a538-f2455880f495 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:29.319238 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1335b875-ca07-4f4e-a538-f2455880f495 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.253937 Mar 05 21:04:29.319902 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1933/3938] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:29 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:29.346970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9e3ae60a-62f4-4909-91a4-3e5781d9392e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:29.348813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9e3ae60a-62f4-4909-91a4-3e5781d9392e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:29.359858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e3ae60a-62f4-4909-91a4-3e5781d9392e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:29.360276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e3ae60a-62f4-4909-91a4-3e5781d9392e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:29.361179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e3ae60a-62f4-4909-91a4-3e5781d9392e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:29.361653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e3ae60a-62f4-4909-91a4-3e5781d9392e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:29.378011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8731d76b-3bae-4d21-818a-cfc2d973a3bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:29.396325 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8731d76b-3bae-4d21-818a-cfc2d973a3bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 0.616302 Mar 05 21:04:29.398879 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2006/3939] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:28 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:29.667022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9e3ae60a-62f4-4909-91a4-3e5781d9392e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:29.680298 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9e3ae60a-62f4-4909-91a4-3e5781d9392e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.346166 Mar 05 21:04:29.697383 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1934/3940] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:29 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:29.699975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-05fdbd41-fea0-4b5c-97a9-d82e61be81c1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:29.701751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-05fdbd41-fea0-4b5c-97a9-d82e61be81c1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:29.730699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05fdbd41-fea0-4b5c-97a9-d82e61be81c1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:29.731203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05fdbd41-fea0-4b5c-97a9-d82e61be81c1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:29.737271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05fdbd41-fea0-4b5c-97a9-d82e61be81c1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:29.739910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05fdbd41-fea0-4b5c-97a9-d82e61be81c1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:29.856992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9639c478-abc6-4945-8620-7923b495a57b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:29.860931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9639c478-abc6-4945-8620-7923b495a57b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:29.874423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9639c478-abc6-4945-8620-7923b495a57b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:29.875064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9639c478-abc6-4945-8620-7923b495a57b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:29.875963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9639c478-abc6-4945-8620-7923b495a57b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:29.876409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9639c478-abc6-4945-8620-7923b495a57b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:30.070271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9639c478-abc6-4945-8620-7923b495a57b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:30.083438 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9639c478-abc6-4945-8620-7923b495a57b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.238933 Mar 05 21:04:30.094898 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1935/3941] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:29 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:30.094898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b3a7b06-4319-4484-98dc-0eb2ab0bee3b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:30.094898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4b3a7b06-4319-4484-98dc-0eb2ab0bee3b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:30.101650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b3a7b06-4319-4484-98dc-0eb2ab0bee3b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:30.102492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b3a7b06-4319-4484-98dc-0eb2ab0bee3b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:30.104124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b3a7b06-4319-4484-98dc-0eb2ab0bee3b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:30.104574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b3a7b06-4319-4484-98dc-0eb2ab0bee3b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:30.234293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-05fdbd41-fea0-4b5c-97a9-d82e61be81c1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:30.253067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-05fdbd41-fea0-4b5c-97a9-d82e61be81c1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:30.257249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-05fdbd41-fea0-4b5c-97a9-d82e61be81c1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:30.261109 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-05fdbd41-fea0-4b5c-97a9-d82e61be81c1 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1837 microversion: 2.42 time: 0.569916 Mar 05 21:04:30.262019 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2007/3942] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:29 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1837 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:30.275791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-309ac35a-8c1d-447b-b390-1932d110af99 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:30.276468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-309ac35a-8c1d-447b-b390-1932d110af99 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:30.288118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-309ac35a-8c1d-447b-b390-1932d110af99 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:30.288632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-309ac35a-8c1d-447b-b390-1932d110af99 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:30.292260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-309ac35a-8c1d-447b-b390-1932d110af99 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:30.292771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-309ac35a-8c1d-447b-b390-1932d110af99 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:30.364868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4b3a7b06-4319-4484-98dc-0eb2ab0bee3b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:30.373873 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4b3a7b06-4319-4484-98dc-0eb2ab0bee3b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1361 microversion: 2.1 time: 0.288025 Mar 05 21:04:30.375529 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1936/3943] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:30 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:30.380498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7a523f9f-baf4-4154-83bd-7909a92bb7c1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:30.381395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7a523f9f-baf4-4154-83bd-7909a92bb7c1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:30.388783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a523f9f-baf4-4154-83bd-7909a92bb7c1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:30.389593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a523f9f-baf4-4154-83bd-7909a92bb7c1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:30.390683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a523f9f-baf4-4154-83bd-7909a92bb7c1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:30.391252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a523f9f-baf4-4154-83bd-7909a92bb7c1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:30.583468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7a523f9f-baf4-4154-83bd-7909a92bb7c1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:30.592734 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7a523f9f-baf4-4154-83bd-7909a92bb7c1 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.216038 Mar 05 21:04:30.593338 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1937/3944] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:30 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:30.598592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-133aa8f6-0bed-437d-894c-799c4ed6727b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:30.599247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-133aa8f6-0bed-437d-894c-799c4ed6727b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:30.606365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-133aa8f6-0bed-437d-894c-799c4ed6727b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:30.606836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-133aa8f6-0bed-437d-894c-799c4ed6727b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:30.607637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-133aa8f6-0bed-437d-894c-799c4ed6727b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:30.608117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-133aa8f6-0bed-437d-894c-799c4ed6727b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:30.801071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-309ac35a-8c1d-447b-b390-1932d110af99 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:30.810967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-133aa8f6-0bed-437d-894c-799c4ed6727b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:30.811410 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-309ac35a-8c1d-447b-b390-1932d110af99 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1329 microversion: 2.1 time: 0.548337 Mar 05 21:04:30.812565 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2008/3945] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:30 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1329 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:30.829284 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-133aa8f6-0bed-437d-894c-799c4ed6727b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 0.234499 Mar 05 21:04:30.830022 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1938/3946] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:30 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:30.923163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-44195601-7568-472b-af98-6dab81173ffc req-dc9d6b83-f5b7-46f2-b0f6-5cbb9f36306e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "tag": "2a2cb2ee-09d5-4c68-906a-931117ce5ea0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:30.926648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-56b273ab-5253-469d-b104-a04c6b8bd85a req-2589c14e-5568-4632-964d-d61be7ea1bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf406b0-8c85-4126-ade0-797f76b7b3cf", "name": "network-vif-plugged", "status": "completed", "tag": "2f672d97-7658-4404-9c2c-23bec705e4a1"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:30.964296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-44195601-7568-472b-af98-6dab81173ffc req-dc9d6b83-f5b7-46f2-b0f6-5cbb9f36306e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:30.965218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-56b273ab-5253-469d-b104-a04c6b8bd85a req-2589c14e-5568-4632-964d-d61be7ea1bed service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:30.965925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-56b273ab-5253-469d-b104-a04c6b8bd85a req-2589c14e-5568-4632-964d-d61be7ea1bed service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:30.966562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-44195601-7568-472b-af98-6dab81173ffc req-dc9d6b83-f5b7-46f2-b0f6-5cbb9f36306e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:30.987375 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-44195601-7568-472b-af98-6dab81173ffc req-dc9d6b83-f5b7-46f2-b0f6-5cbb9f36306e service nova] Creating event network-changed:2a2cb2ee-09d5-4c68-906a-931117ce5ea0 for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:04:30.997019 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-44195601-7568-472b-af98-6dab81173ffc req-dc9d6b83-f5b7-46f2-b0f6-5cbb9f36306e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081959 Mar 05 21:04:30.998163 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2009/3947] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:31.001980 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-56b273ab-5253-469d-b104-a04c6b8bd85a req-2589c14e-5568-4632-964d-d61be7ea1bed service nova] Creating event network-vif-plugged:2f672d97-7658-4404-9c2c-23bec705e4a1 for instance bbf406b0-8c85-4126-ade0-797f76b7b3cf on nch1-master-1 Mar 05 21:04:31.017789 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-56b273ab-5253-469d-b104-a04c6b8bd85a req-2589c14e-5568-4632-964d-d61be7ea1bed service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095976 Mar 05 21:04:31.019071 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1939/3948] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:04:31.281660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-97ca0d41-4266-47e9-b6fb-b6a17ca3e6a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:31.282625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-97ca0d41-4266-47e9-b6fb-b6a17ca3e6a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:31.299219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97ca0d41-4266-47e9-b6fb-b6a17ca3e6a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:31.300163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97ca0d41-4266-47e9-b6fb-b6a17ca3e6a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:31.301411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97ca0d41-4266-47e9-b6fb-b6a17ca3e6a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:31.305304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97ca0d41-4266-47e9-b6fb-b6a17ca3e6a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:31.367915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fe54a54b-d826-48d2-9a18-8967adb56f44 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:31.369564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fe54a54b-d826-48d2-9a18-8967adb56f44 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:31.378676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe54a54b-d826-48d2-9a18-8967adb56f44 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:31.379345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe54a54b-d826-48d2-9a18-8967adb56f44 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:31.380424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe54a54b-d826-48d2-9a18-8967adb56f44 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:31.380868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe54a54b-d826-48d2-9a18-8967adb56f44 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:31.597268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fe54a54b-d826-48d2-9a18-8967adb56f44 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:31.608091 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fe54a54b-d826-48d2-9a18-8967adb56f44 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.244574 Mar 05 21:04:31.609878 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1940/3949] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:31 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:31.614767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ae9a2891-487d-4c38-b509-f5d99e92779a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:31.615634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ae9a2891-487d-4c38-b509-f5d99e92779a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:31.622474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae9a2891-487d-4c38-b509-f5d99e92779a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:31.623103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae9a2891-487d-4c38-b509-f5d99e92779a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:31.623926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae9a2891-487d-4c38-b509-f5d99e92779a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:31.624377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae9a2891-487d-4c38-b509-f5d99e92779a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:31.781409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ae9a2891-487d-4c38-b509-f5d99e92779a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:31.791046 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ae9a2891-487d-4c38-b509-f5d99e92779a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1361 microversion: 2.1 time: 0.179693 Mar 05 21:04:31.791939 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1941/3950] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:31 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:31.796657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ab4bd164-d65c-4653-8e4e-ab50982a5e49 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:31.797273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ab4bd164-d65c-4653-8e4e-ab50982a5e49 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:31.803177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab4bd164-d65c-4653-8e4e-ab50982a5e49 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:31.803637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab4bd164-d65c-4653-8e4e-ab50982a5e49 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:31.805143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab4bd164-d65c-4653-8e4e-ab50982a5e49 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:31.805143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab4bd164-d65c-4653-8e4e-ab50982a5e49 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:31.949770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ab4bd164-d65c-4653-8e4e-ab50982a5e49 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:31.957490 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ab4bd164-d65c-4653-8e4e-ab50982a5e49 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.164696 Mar 05 21:04:31.958084 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1942/3951] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:31 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:31.963713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bd05e11e-9c16-48c5-a7c3-7284654c26b1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:31.964528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bd05e11e-9c16-48c5-a7c3-7284654c26b1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:31.970933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd05e11e-9c16-48c5-a7c3-7284654c26b1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:31.971396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd05e11e-9c16-48c5-a7c3-7284654c26b1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:31.972206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd05e11e-9c16-48c5-a7c3-7284654c26b1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:31.972658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd05e11e-9c16-48c5-a7c3-7284654c26b1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:31.979428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-97ca0d41-4266-47e9-b6fb-b6a17ca3e6a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:31.989038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-97ca0d41-4266-47e9-b6fb-b6a17ca3e6a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:31.990842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-97ca0d41-4266-47e9-b6fb-b6a17ca3e6a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:31.992258 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-97ca0d41-4266-47e9-b6fb-b6a17ca3e6a4 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1837 microversion: 2.42 time: 0.715067 Mar 05 21:04:31.992837 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2010/3952] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:31 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1837 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:31.997808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-348fc729-5c53-4284-ba00-04eccf87d73e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:31.998429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-348fc729-5c53-4284-ba00-04eccf87d73e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:32.004732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-348fc729-5c53-4284-ba00-04eccf87d73e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:32.005381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-348fc729-5c53-4284-ba00-04eccf87d73e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:32.006376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-348fc729-5c53-4284-ba00-04eccf87d73e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:32.006828 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-348fc729-5c53-4284-ba00-04eccf87d73e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:32.126015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bd05e11e-9c16-48c5-a7c3-7284654c26b1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:32.132709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-348fc729-5c53-4284-ba00-04eccf87d73e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:32.136230 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bd05e11e-9c16-48c5-a7c3-7284654c26b1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.177022 Mar 05 21:04:32.136825 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1943/3953] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:31 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:32.154889 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-348fc729-5c53-4284-ba00-04eccf87d73e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1327 microversion: 2.1 time: 0.160653 Mar 05 21:04:32.155646 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2011/3954] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:31 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1327 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:32.168437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0fcbe06d-e21e-4d8a-a069-521ba73a4526 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:32.173008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0fcbe06d-e21e-4d8a-a069-521ba73a4526 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:32.174920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9d58820b-1fc9-4d0a-889e-a73fde13607d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:32.175650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9d58820b-1fc9-4d0a-889e-a73fde13607d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:32.186983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fcbe06d-e21e-4d8a-a069-521ba73a4526 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:32.187216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d58820b-1fc9-4d0a-889e-a73fde13607d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:32.187454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d58820b-1fc9-4d0a-889e-a73fde13607d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:32.188342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fcbe06d-e21e-4d8a-a069-521ba73a4526 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:32.189900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fcbe06d-e21e-4d8a-a069-521ba73a4526 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:32.190629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fcbe06d-e21e-4d8a-a069-521ba73a4526 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:32.192542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d58820b-1fc9-4d0a-889e-a73fde13607d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:32.193081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d58820b-1fc9-4d0a-889e-a73fde13607d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:32.363883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0fcbe06d-e21e-4d8a-a069-521ba73a4526 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:32.372847 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0fcbe06d-e21e-4d8a-a069-521ba73a4526 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 0.223090 Mar 05 21:04:32.374223 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1944/3955] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:32 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:32.728273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9d58820b-1fc9-4d0a-889e-a73fde13607d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:32.737597 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9d58820b-1fc9-4d0a-889e-a73fde13607d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.567963 Mar 05 21:04:32.738910 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2012/3956] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:32 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:32.755875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-61f59da4-8d10-4f76-b73f-2aba4717cd4c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:32.756930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-61f59da4-8d10-4f76-b73f-2aba4717cd4c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:32.771742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61f59da4-8d10-4f76-b73f-2aba4717cd4c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:32.771742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61f59da4-8d10-4f76-b73f-2aba4717cd4c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:32.771742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61f59da4-8d10-4f76-b73f-2aba4717cd4c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:32.775179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-61f59da4-8d10-4f76-b73f-2aba4717cd4c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:32.818436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-18781d1a-1405-4cc7-9ba8-e570d00763f4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:32.827719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-18781d1a-1405-4cc7-9ba8-e570d00763f4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:32.851700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18781d1a-1405-4cc7-9ba8-e570d00763f4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:32.852726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18781d1a-1405-4cc7-9ba8-e570d00763f4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:32.856546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18781d1a-1405-4cc7-9ba8-e570d00763f4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:32.857879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18781d1a-1405-4cc7-9ba8-e570d00763f4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:32.895298 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-61f59da4-8d10-4f76-b73f-2aba4717cd4c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.143786 Mar 05 21:04:32.916378 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1945/3957] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:04:32 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:04:32.926231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-869a94b6-1515-44e3-806e-72fe42b21081 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:32.927306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-869a94b6-1515-44e3-806e-72fe42b21081 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:32.935707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-869a94b6-1515-44e3-806e-72fe42b21081 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:32.936452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-869a94b6-1515-44e3-806e-72fe42b21081 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:32.937566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-869a94b6-1515-44e3-806e-72fe42b21081 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:32.938331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-869a94b6-1515-44e3-806e-72fe42b21081 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:33.282052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-869a94b6-1515-44e3-806e-72fe42b21081 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:33.299618 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-869a94b6-1515-44e3-806e-72fe42b21081 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1671 microversion: 2.1 time: 0.380670 Mar 05 21:04:33.312362 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1946/3958] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:32 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1671 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:33.320141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fdd26fd8-6464-414d-8a7e-a795ca413c7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:33.322222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fdd26fd8-6464-414d-8a7e-a795ca413c7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:33.338842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdd26fd8-6464-414d-8a7e-a795ca413c7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:33.339566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdd26fd8-6464-414d-8a7e-a795ca413c7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:33.340659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdd26fd8-6464-414d-8a7e-a795ca413c7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:33.346456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdd26fd8-6464-414d-8a7e-a795ca413c7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:33.509386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-18781d1a-1405-4cc7-9ba8-e570d00763f4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:33.517824 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-18781d1a-1405-4cc7-9ba8-e570d00763f4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1361 microversion: 2.1 time: 0.713414 Mar 05 21:04:33.528632 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2013/3959] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:32 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1361 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:33.541569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bef7f3d1-4f64-411e-8404-05f5ee7fd9ee tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:33.544971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bef7f3d1-4f64-411e-8404-05f5ee7fd9ee tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:33.559174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bef7f3d1-4f64-411e-8404-05f5ee7fd9ee tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:33.559735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bef7f3d1-4f64-411e-8404-05f5ee7fd9ee tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:33.560604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bef7f3d1-4f64-411e-8404-05f5ee7fd9ee tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:33.561204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bef7f3d1-4f64-411e-8404-05f5ee7fd9ee tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:33.651376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fdd26fd8-6464-414d-8a7e-a795ca413c7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:33.662084 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fdd26fd8-6464-414d-8a7e-a795ca413c7e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.348051 Mar 05 21:04:33.667640 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1947/3960] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:33 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:33.687858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7eae6177-90e7-411c-9e96-6a2a5b0ba083 req-96ee96d7-53c5-481a-86d4-4178dea35af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc548a05-5226-41f0-a34d-1d44defee56c", "name": "network-vif-unplugged", "status": "completed", "tag": "30ad7984-3b01-4aac-9f3b-d69f10ea737a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:33.719291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7eae6177-90e7-411c-9e96-6a2a5b0ba083 req-96ee96d7-53c5-481a-86d4-4178dea35af4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:33.720003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7eae6177-90e7-411c-9e96-6a2a5b0ba083 req-96ee96d7-53c5-481a-86d4-4178dea35af4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:33.757237 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7eae6177-90e7-411c-9e96-6a2a5b0ba083 req-96ee96d7-53c5-481a-86d4-4178dea35af4 service nova] Creating event network-vif-unplugged:30ad7984-3b01-4aac-9f3b-d69f10ea737a for instance dc548a05-5226-41f0-a34d-1d44defee56c on nch1-master-1 Mar 05 21:04:33.766928 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7eae6177-90e7-411c-9e96-6a2a5b0ba083 req-96ee96d7-53c5-481a-86d4-4178dea35af4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091376 Mar 05 21:04:33.769381 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1948/3961] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:33.778465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-15125ec4-30a4-461b-a52e-86c98f728ff0 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:33.779588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-15125ec4-30a4-461b-a52e-86c98f728ff0 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:33.788947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15125ec4-30a4-461b-a52e-86c98f728ff0 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:33.789783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15125ec4-30a4-461b-a52e-86c98f728ff0 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:33.791549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15125ec4-30a4-461b-a52e-86c98f728ff0 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:33.792251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15125ec4-30a4-461b-a52e-86c98f728ff0 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:34.150490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-15125ec4-30a4-461b-a52e-86c98f728ff0 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:34.166848 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-15125ec4-30a4-461b-a52e-86c98f728ff0 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1395 microversion: 2.1 time: 0.395734 Mar 05 21:04:34.167743 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1949/3962] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:33 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1395 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:34.182043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f8bf5603-eafb-4a88-b1bb-bca89cd2ebd8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:34.183017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f8bf5603-eafb-4a88-b1bb-bca89cd2ebd8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:34.193413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8bf5603-eafb-4a88-b1bb-bca89cd2ebd8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:34.194157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8bf5603-eafb-4a88-b1bb-bca89cd2ebd8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:34.195406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8bf5603-eafb-4a88-b1bb-bca89cd2ebd8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:34.195524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8bf5603-eafb-4a88-b1bb-bca89cd2ebd8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:34.378877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f8bf5603-eafb-4a88-b1bb-bca89cd2ebd8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:34.388993 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f8bf5603-eafb-4a88-b1bb-bca89cd2ebd8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 0.219951 Mar 05 21:04:34.390201 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1950/3963] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:34 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:34.395513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-44282474-6265-4f5f-a6fa-2830d22d5c06 req-2c27e211-376d-4446-8856-0ceb072fb8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "tag": "6b1907e2-b9fc-4106-b4bf-9d467bd3635b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:34.406219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-44282474-6265-4f5f-a6fa-2830d22d5c06 req-2c27e211-376d-4446-8856-0ceb072fb8b7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:34.406679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-44282474-6265-4f5f-a6fa-2830d22d5c06 req-2c27e211-376d-4446-8856-0ceb072fb8b7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:34.422012 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-44282474-6265-4f5f-a6fa-2830d22d5c06 req-2c27e211-376d-4446-8856-0ceb072fb8b7 service nova] Creating event network-changed:6b1907e2-b9fc-4106-b4bf-9d467bd3635b for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:04:34.428112 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-44282474-6265-4f5f-a6fa-2830d22d5c06 req-2c27e211-376d-4446-8856-0ceb072fb8b7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036106 Mar 05 21:04:34.429184 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1951/3964] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:34.435866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-89c7142a-e5a5-47d3-a2b7-661a147b2dd0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:34.436596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-89c7142a-e5a5-47d3-a2b7-661a147b2dd0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:34.444812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89c7142a-e5a5-47d3-a2b7-661a147b2dd0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:34.445415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89c7142a-e5a5-47d3-a2b7-661a147b2dd0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:34.446405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89c7142a-e5a5-47d3-a2b7-661a147b2dd0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:34.447037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89c7142a-e5a5-47d3-a2b7-661a147b2dd0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:34.646972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bef7f3d1-4f64-411e-8404-05f5ee7fd9ee tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:34.656520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bef7f3d1-4f64-411e-8404-05f5ee7fd9ee tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:34.658165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bef7f3d1-4f64-411e-8404-05f5ee7fd9ee tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:34.659421 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bef7f3d1-4f64-411e-8404-05f5ee7fd9ee tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1858 microversion: 2.42 time: 1.139359 Mar 05 21:04:34.660115 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2014/3965] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:33 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1858 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:34.665556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2266dc1e-b955-491d-9220-f03906a79c32 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:34.666656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2266dc1e-b955-491d-9220-f03906a79c32 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:34.674405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2266dc1e-b955-491d-9220-f03906a79c32 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:34.675295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2266dc1e-b955-491d-9220-f03906a79c32 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:34.676328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2266dc1e-b955-491d-9220-f03906a79c32 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:34.676780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2266dc1e-b955-491d-9220-f03906a79c32 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:34.702551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-89c7142a-e5a5-47d3-a2b7-661a147b2dd0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:34.710585 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-89c7142a-e5a5-47d3-a2b7-661a147b2dd0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1676 microversion: 2.1 time: 0.280104 Mar 05 21:04:34.721312 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1952/3966] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:34 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1676 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:34.721312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b0bad3fa-e0da-4966-9c19-ea74b97339e7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:34.721312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b0bad3fa-e0da-4966-9c19-ea74b97339e7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:34.736892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0bad3fa-e0da-4966-9c19-ea74b97339e7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:34.737350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0bad3fa-e0da-4966-9c19-ea74b97339e7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:34.742255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0bad3fa-e0da-4966-9c19-ea74b97339e7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:34.742949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0bad3fa-e0da-4966-9c19-ea74b97339e7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:34.995638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b0bad3fa-e0da-4966-9c19-ea74b97339e7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:35.003461 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b0bad3fa-e0da-4966-9c19-ea74b97339e7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.288137 Mar 05 21:04:35.004428 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1953/3967] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:34 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:35.184563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4b4af700-819d-4493-ae84-a97383c7a22e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:35.185432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4b4af700-819d-4493-ae84-a97383c7a22e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:35.207701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b4af700-819d-4493-ae84-a97383c7a22e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:35.208507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b4af700-819d-4493-ae84-a97383c7a22e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:35.210251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b4af700-819d-4493-ae84-a97383c7a22e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:35.210936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4b4af700-819d-4493-ae84-a97383c7a22e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:35.252697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2266dc1e-b955-491d-9220-f03906a79c32 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:35.265863 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2266dc1e-b955-491d-9220-f03906a79c32 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1546 microversion: 2.1 time: 0.603523 Mar 05 21:04:35.268305 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2015/3968] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:34 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1546 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:35.283650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7063f6f8-ebe1-4cf2-96e0-4b88be3ac0f8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:35.284542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7063f6f8-ebe1-4cf2-96e0-4b88be3ac0f8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:35.293526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7063f6f8-ebe1-4cf2-96e0-4b88be3ac0f8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:35.294109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7063f6f8-ebe1-4cf2-96e0-4b88be3ac0f8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:35.294999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7063f6f8-ebe1-4cf2-96e0-4b88be3ac0f8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:35.295580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7063f6f8-ebe1-4cf2-96e0-4b88be3ac0f8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:35.500068 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7063f6f8-ebe1-4cf2-96e0-4b88be3ac0f8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.220481 Mar 05 21:04:35.501051 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2016/3969] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 21:04:35 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:04:35.506326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dc3ac147-4151-4dac-a260-7f1301ee780f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:35.506959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dc3ac147-4151-4dac-a260-7f1301ee780f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:35.519717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc3ac147-4151-4dac-a260-7f1301ee780f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:35.520181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc3ac147-4151-4dac-a260-7f1301ee780f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:35.520981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc3ac147-4151-4dac-a260-7f1301ee780f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:35.521427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc3ac147-4151-4dac-a260-7f1301ee780f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:35.642917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4b4af700-819d-4493-ae84-a97383c7a22e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:35.653294 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4b4af700-819d-4493-ae84-a97383c7a22e tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1395 microversion: 2.1 time: 0.471780 Mar 05 21:04:35.656618 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1954/3970] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:35 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1395 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:35.678535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8d1e6983-53ae-49d7-a4aa-8070acef91e3 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:35.679533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8d1e6983-53ae-49d7-a4aa-8070acef91e3 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:35.698042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d1e6983-53ae-49d7-a4aa-8070acef91e3 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:35.698510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d1e6983-53ae-49d7-a4aa-8070acef91e3 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:35.699315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d1e6983-53ae-49d7-a4aa-8070acef91e3 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:35.699798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d1e6983-53ae-49d7-a4aa-8070acef91e3 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:36.139535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8d1e6983-53ae-49d7-a4aa-8070acef91e3 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:36.149697 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8d1e6983-53ae-49d7-a4aa-8070acef91e3 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:36.158981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8d1e6983-53ae-49d7-a4aa-8070acef91e3 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:36.163792 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8d1e6983-53ae-49d7-a4aa-8070acef91e3 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.486861 Mar 05 21:04:36.166324 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1955/3971] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:35 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:36.174116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4826097f-bc63-45c6-b9d8-08f44c137c28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:36.174994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4826097f-bc63-45c6-b9d8-08f44c137c28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:36.189810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dc3ac147-4151-4dac-a260-7f1301ee780f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:36.196158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4826097f-bc63-45c6-b9d8-08f44c137c28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:36.196704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4826097f-bc63-45c6-b9d8-08f44c137c28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:36.197539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4826097f-bc63-45c6-b9d8-08f44c137c28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:36.197988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4826097f-bc63-45c6-b9d8-08f44c137c28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:36.206416 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dc3ac147-4151-4dac-a260-7f1301ee780f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1501 microversion: 2.1 time: 0.703993 Mar 05 21:04:36.207379 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2017/3972] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:35 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1501 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:36.212297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-86802dd8-4dff-4135-9615-9f5159a0e929 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:36.212963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-86802dd8-4dff-4135-9615-9f5159a0e929 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:36.244829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86802dd8-4dff-4135-9615-9f5159a0e929 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:36.245292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86802dd8-4dff-4135-9615-9f5159a0e929 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:36.247769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86802dd8-4dff-4135-9615-9f5159a0e929 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:36.250269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-86802dd8-4dff-4135-9615-9f5159a0e929 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:36.513465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4826097f-bc63-45c6-b9d8-08f44c137c28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:36.521846 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4826097f-bc63-45c6-b9d8-08f44c137c28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.352437 Mar 05 21:04:36.522710 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1956/3973] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:36 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:36.536858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82805a40-c7ee-4ce6-bc5a-d57d288feaa4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f864d28a-30a4-4c39-816b-157a4f914240"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:36.538289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-82805a40-c7ee-4ce6-bc5a-d57d288feaa4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:36.547582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82805a40-c7ee-4ce6-bc5a-d57d288feaa4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:36.548317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82805a40-c7ee-4ce6-bc5a-d57d288feaa4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:36.549622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82805a40-c7ee-4ce6-bc5a-d57d288feaa4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:36.550619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82805a40-c7ee-4ce6-bc5a-d57d288feaa4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:36.609543 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-82805a40-c7ee-4ce6-bc5a-d57d288feaa4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] HTTP exception thrown: Cannot 'attach_volume' instance b2d64ade-0446-474b-a3d4-454133f21972 while it is in vm_state rescued Mar 05 21:04:36.610148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82805a40-c7ee-4ce6-bc5a-d57d288feaa4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Returning 409 to user: Cannot 'attach_volume' instance b2d64ade-0446-474b-a3d4-454133f21972 while it is in vm_state rescued {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:36.618108 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-82805a40-c7ee-4ce6-bc5a-d57d288feaa4 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.094079 Mar 05 21:04:36.619650 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1957/3974] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:04:36 2022] POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/os-volume_attachments => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:04:36.628574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f11f67ca-cdab-4796-8df2-7abe34a1c16c req-17c8df0b-896c-409c-9f2b-733e6fd83685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "tag": "3580f7be-3101-44d5-a719-3970e25ebd07"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:36.645471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f11f67ca-cdab-4796-8df2-7abe34a1c16c req-17c8df0b-896c-409c-9f2b-733e6fd83685 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:36.650639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f11f67ca-cdab-4796-8df2-7abe34a1c16c req-17c8df0b-896c-409c-9f2b-733e6fd83685 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:36.671738 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f11f67ca-cdab-4796-8df2-7abe34a1c16c req-17c8df0b-896c-409c-9f2b-733e6fd83685 service nova] Creating event network-changed:3580f7be-3101-44d5-a719-3970e25ebd07 for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:04:36.677502 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f11f67ca-cdab-4796-8df2-7abe34a1c16c req-17c8df0b-896c-409c-9f2b-733e6fd83685 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056170 Mar 05 21:04:36.678290 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1958/3975] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:36.684780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b0272a45-b352-40dc-b341-517b342ee5f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:36.689294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b0272a45-b352-40dc-b341-517b342ee5f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:36.706858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0272a45-b352-40dc-b341-517b342ee5f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:36.707524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0272a45-b352-40dc-b341-517b342ee5f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:36.709100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0272a45-b352-40dc-b341-517b342ee5f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:36.709826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0272a45-b352-40dc-b341-517b342ee5f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:36.767537 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b0272a45-b352-40dc-b341-517b342ee5f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 200 len: 322 microversion: 2.1 time: 0.087478 Mar 05 21:04:36.776331 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1959/3976] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:04:36 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 322 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:36.793512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b67032e1-6012-4f3d-9763-674b0735791b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:36.795204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b67032e1-6012-4f3d-9763-674b0735791b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:36.805768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b67032e1-6012-4f3d-9763-674b0735791b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:36.806242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b67032e1-6012-4f3d-9763-674b0735791b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:36.807052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b67032e1-6012-4f3d-9763-674b0735791b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:36.807706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b67032e1-6012-4f3d-9763-674b0735791b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:36.926135 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b67032e1-6012-4f3d-9763-674b0735791b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action" status: 202 len: 0 microversion: 2.1 time: 0.147748 Mar 05 21:04:36.928832 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1960/3977] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:04:36 2022] POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:04:36.949909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a93027e7-ce04-430b-b11a-53ea8f89a584 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:36.953904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a93027e7-ce04-430b-b11a-53ea8f89a584 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:36.974744 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a93027e7-ce04-430b-b11a-53ea8f89a584 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:36.975247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a93027e7-ce04-430b-b11a-53ea8f89a584 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:36.976196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a93027e7-ce04-430b-b11a-53ea8f89a584 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:36.987141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a93027e7-ce04-430b-b11a-53ea8f89a584 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:37.034324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-86802dd8-4dff-4135-9615-9f5159a0e929 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:37.042764 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-86802dd8-4dff-4135-9615-9f5159a0e929 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.834099 Mar 05 21:04:37.043964 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2018/3978] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:36 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:37.048764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8b14ca8e-7931-4362-87f8-cdccb7ceac60 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:37.049548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8b14ca8e-7931-4362-87f8-cdccb7ceac60 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:37.056747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b14ca8e-7931-4362-87f8-cdccb7ceac60 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:37.057389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b14ca8e-7931-4362-87f8-cdccb7ceac60 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:37.058355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b14ca8e-7931-4362-87f8-cdccb7ceac60 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:37.058984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b14ca8e-7931-4362-87f8-cdccb7ceac60 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:37.875728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a93027e7-ce04-430b-b11a-53ea8f89a584 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:37.883357 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a93027e7-ce04-430b-b11a-53ea8f89a584 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1395 microversion: 2.1 time: 0.952974 Mar 05 21:04:37.884532 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1961/3979] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:36 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1395 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:37.891253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-81813e08-b80e-41d1-ac00-7da8d272d07b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:37.892333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-81813e08-b80e-41d1-ac00-7da8d272d07b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:37.903719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81813e08-b80e-41d1-ac00-7da8d272d07b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:37.904362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81813e08-b80e-41d1-ac00-7da8d272d07b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:37.905992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81813e08-b80e-41d1-ac00-7da8d272d07b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:37.906438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81813e08-b80e-41d1-ac00-7da8d272d07b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:37.977620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8b14ca8e-7931-4362-87f8-cdccb7ceac60 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:37.987476 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8b14ca8e-7931-4362-87f8-cdccb7ceac60 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.942173 Mar 05 21:04:37.988252 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2019/3980] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:37 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:37.994508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f8398efd-6d0d-41bd-8dfd-51d4f1e9b6a9 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:37.995374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f8398efd-6d0d-41bd-8dfd-51d4f1e9b6a9 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:38.005781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8398efd-6d0d-41bd-8dfd-51d4f1e9b6a9 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:38.006781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8398efd-6d0d-41bd-8dfd-51d4f1e9b6a9 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:38.010884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8398efd-6d0d-41bd-8dfd-51d4f1e9b6a9 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:38.011869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8398efd-6d0d-41bd-8dfd-51d4f1e9b6a9 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:38.294551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-81813e08-b80e-41d1-ac00-7da8d272d07b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:38.302487 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-81813e08-b80e-41d1-ac00-7da8d272d07b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1509 microversion: 2.1 time: 0.415816 Mar 05 21:04:38.313821 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1962/3981] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:37 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1509 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:38.319147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f6767d47-f3d3-4acb-ba97-6ed130dfe934 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:38.320096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f6767d47-f3d3-4acb-ba97-6ed130dfe934 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:38.329690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6767d47-f3d3-4acb-ba97-6ed130dfe934 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:38.331230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6767d47-f3d3-4acb-ba97-6ed130dfe934 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:38.332539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6767d47-f3d3-4acb-ba97-6ed130dfe934 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:38.333414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6767d47-f3d3-4acb-ba97-6ed130dfe934 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:38.569937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f8398efd-6d0d-41bd-8dfd-51d4f1e9b6a9 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:38.581071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f8398efd-6d0d-41bd-8dfd-51d4f1e9b6a9 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:38.582872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f8398efd-6d0d-41bd-8dfd-51d4f1e9b6a9 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:38.584305 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f8398efd-6d0d-41bd-8dfd-51d4f1e9b6a9 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.593884 Mar 05 21:04:38.585060 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2020/3982] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:37 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:38.601704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2d2f5d47-2b35-4113-b6d6-a38f9253cf1e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:38.602325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2d2f5d47-2b35-4113-b6d6-a38f9253cf1e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:38.608981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d2f5d47-2b35-4113-b6d6-a38f9253cf1e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:38.609362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d2f5d47-2b35-4113-b6d6-a38f9253cf1e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:38.610210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d2f5d47-2b35-4113-b6d6-a38f9253cf1e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:38.610659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d2f5d47-2b35-4113-b6d6-a38f9253cf1e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:38.693013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f6767d47-f3d3-4acb-ba97-6ed130dfe934 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:38.702293 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f6767d47-f3d3-4acb-ba97-6ed130dfe934 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.387078 Mar 05 21:04:38.703182 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1963/3983] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:38 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:38.719706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8dd1798e-25ef-4e31-9898-c19282665e05 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:38.720594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8dd1798e-25ef-4e31-9898-c19282665e05 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:38.728398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8dd1798e-25ef-4e31-9898-c19282665e05 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:38.729121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8dd1798e-25ef-4e31-9898-c19282665e05 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:38.729997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8dd1798e-25ef-4e31-9898-c19282665e05 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:38.730451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8dd1798e-25ef-4e31-9898-c19282665e05 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:39.002855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8dd1798e-25ef-4e31-9898-c19282665e05 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:39.014949 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8dd1798e-25ef-4e31-9898-c19282665e05 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.298548 Mar 05 21:04:39.016507 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1964/3984] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:38 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:04:39.026543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2d2f5d47-2b35-4113-b6d6-a38f9253cf1e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:39.036452 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2d2f5d47-2b35-4113-b6d6-a38f9253cf1e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.438473 Mar 05 21:04:39.037093 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2021/3985] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:38 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:39.040871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-cb7bdc15-d962-4163-9f06-24767224308d req-2b3a7210-12cd-4887-ab93-d3704f307e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d57f60-92f1-4612-9719-11df0d9eaa78", "tag": "0d4bfa0a-fdb5-4443-bed4-e96bace20d35"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:39.053850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0477e54d-e6a5-4577-b9d7-e81d5a6e0e40 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:39.054784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0477e54d-e6a5-4577-b9d7-e81d5a6e0e40 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:39.064858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0477e54d-e6a5-4577-b9d7-e81d5a6e0e40 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:39.066835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-cb7bdc15-d962-4163-9f06-24767224308d req-2b3a7210-12cd-4887-ab93-d3704f307e8b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:39.067294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-cb7bdc15-d962-4163-9f06-24767224308d req-2b3a7210-12cd-4887-ab93-d3704f307e8b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:39.071772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0477e54d-e6a5-4577-b9d7-e81d5a6e0e40 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:39.073762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0477e54d-e6a5-4577-b9d7-e81d5a6e0e40 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:39.075230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0477e54d-e6a5-4577-b9d7-e81d5a6e0e40 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:39.096435 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-cb7bdc15-d962-4163-9f06-24767224308d req-2b3a7210-12cd-4887-ab93-d3704f307e8b service nova] Creating event network-changed:0d4bfa0a-fdb5-4443-bed4-e96bace20d35 for instance e4d57f60-92f1-4612-9719-11df0d9eaa78 on nch2-master-1 Mar 05 21:04:39.111825 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-cb7bdc15-d962-4163-9f06-24767224308d req-2b3a7210-12cd-4887-ab93-d3704f307e8b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081747 Mar 05 21:04:39.112697 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1965/3986] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:39.135407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ebf8d5b8-91f4-438f-9e03-afb92a643305 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:39.136164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ebf8d5b8-91f4-438f-9e03-afb92a643305 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:39.143766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ebf8d5b8-91f4-438f-9e03-afb92a643305 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:39.144458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ebf8d5b8-91f4-438f-9e03-afb92a643305 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:39.145292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ebf8d5b8-91f4-438f-9e03-afb92a643305 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:39.145982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ebf8d5b8-91f4-438f-9e03-afb92a643305 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:39.405600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ebf8d5b8-91f4-438f-9e03-afb92a643305 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:39.413377 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ebf8d5b8-91f4-438f-9e03-afb92a643305 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.299479 Mar 05 21:04:39.427899 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1966/3987] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:39 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:39.437121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6bd2f38d-80db-4416-929d-d5bff8df4133 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:39.437912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6bd2f38d-80db-4416-929d-d5bff8df4133 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:39.444296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6bd2f38d-80db-4416-929d-d5bff8df4133 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:39.444992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6bd2f38d-80db-4416-929d-d5bff8df4133 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:39.446099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6bd2f38d-80db-4416-929d-d5bff8df4133 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:39.446978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6bd2f38d-80db-4416-929d-d5bff8df4133 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:39.593933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0477e54d-e6a5-4577-b9d7-e81d5a6e0e40 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:39.605968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6bd2f38d-80db-4416-929d-d5bff8df4133 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:39.609962 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0477e54d-e6a5-4577-b9d7-e81d5a6e0e40 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1395 microversion: 2.1 time: 0.560905 Mar 05 21:04:39.611248 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2022/3988] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:39 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1395 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:39.614180 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6bd2f38d-80db-4416-929d-d5bff8df4133 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1509 microversion: 2.1 time: 0.184512 Mar 05 21:04:39.615310 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1967/3989] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:39 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:39.620649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1220a884-6ec3-44c4-ba34-040ae80ec477 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:39.621426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1220a884-6ec3-44c4-ba34-040ae80ec477 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:39.627712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1220a884-6ec3-44c4-ba34-040ae80ec477 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:39.628367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1220a884-6ec3-44c4-ba34-040ae80ec477 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:39.628699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2102749587", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "5638f6ea-4ec0-488e-a680-99fc30eb719d"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:39.629692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1220a884-6ec3-44c4-ba34-040ae80ec477 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:39.630296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1220a884-6ec3-44c4-ba34-040ae80ec477 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:39.727560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] validate_networks() for [('5638f6ea-4ec0-488e-a680-99fc30eb719d', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:04:39.898655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1220a884-6ec3-44c4-ba34-040ae80ec477 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:39.910122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1220a884-6ec3-44c4-ba34-040ae80ec477 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:39.911987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1220a884-6ec3-44c4-ba34-040ae80ec477 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:39.913413 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1220a884-6ec3-44c4-ba34-040ae80ec477 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.297002 Mar 05 21:04:39.914874 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1968/3990] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:39 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:40.057727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-424807a3-e287-4b8e-a92b-65791893684f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:40.061044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-424807a3-e287-4b8e-a92b-65791893684f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:40.072779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-424807a3-e287-4b8e-a92b-65791893684f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:40.073580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-424807a3-e287-4b8e-a92b-65791893684f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:40.074593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-424807a3-e287-4b8e-a92b-65791893684f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:40.075242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-424807a3-e287-4b8e-a92b-65791893684f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:40.238950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-424807a3-e287-4b8e-a92b-65791893684f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:40.257779 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-424807a3-e287-4b8e-a92b-65791893684f tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.205372 Mar 05 21:04:40.259521 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1969/3991] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:40 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:40.631175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-03e0c2b3-d6ef-4a47-95fe-bf70d6528ffb tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:40.631837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-03e0c2b3-d6ef-4a47-95fe-bf70d6528ffb tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:40.638852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-03e0c2b3-d6ef-4a47-95fe-bf70d6528ffb tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:40.639571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-03e0c2b3-d6ef-4a47-95fe-bf70d6528ffb tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:40.640599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-03e0c2b3-d6ef-4a47-95fe-bf70d6528ffb tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:40.641266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-03e0c2b3-d6ef-4a47-95fe-bf70d6528ffb tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:40.843410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-03e0c2b3-d6ef-4a47-95fe-bf70d6528ffb tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:40.854058 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-03e0c2b3-d6ef-4a47-95fe-bf70d6528ffb tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1395 microversion: 2.1 time: 0.226283 Mar 05 21:04:40.855331 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1970/3992] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:40 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1395 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:40.860672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-38e3793d-8832-4aaa-9225-bf1b3969f296 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:40.861600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-38e3793d-8832-4aaa-9225-bf1b3969f296 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:40.869353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38e3793d-8832-4aaa-9225-bf1b3969f296 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:40.869917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38e3793d-8832-4aaa-9225-bf1b3969f296 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:40.870916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38e3793d-8832-4aaa-9225-bf1b3969f296 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:40.871528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38e3793d-8832-4aaa-9225-bf1b3969f296 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:41.086446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-38e3793d-8832-4aaa-9225-bf1b3969f296 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:41.099243 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-38e3793d-8832-4aaa-9225-bf1b3969f296 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1515 microversion: 2.1 time: 0.242551 Mar 05 21:04:41.100067 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1971/3993] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:40 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:41.105286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7f0c3f70-762e-4041-a44c-81fba2e81aaf tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:41.106150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7f0c3f70-762e-4041-a44c-81fba2e81aaf tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:41.117739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f0c3f70-762e-4041-a44c-81fba2e81aaf tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:41.119707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f0c3f70-762e-4041-a44c-81fba2e81aaf tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:41.120798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f0c3f70-762e-4041-a44c-81fba2e81aaf tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:41.121439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f0c3f70-762e-4041-a44c-81fba2e81aaf tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:41.437403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7f0c3f70-762e-4041-a44c-81fba2e81aaf tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:41.447859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7f0c3f70-762e-4041-a44c-81fba2e81aaf tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:41.449666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7f0c3f70-762e-4041-a44c-81fba2e81aaf tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:41.451029 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7f0c3f70-762e-4041-a44c-81fba2e81aaf tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.349885 Mar 05 21:04:41.452243 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1972/3994] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:41 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:41.457347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d55f5c97-5b6a-4296-a2f9-3f180dc04d48 req-96a21741-c2da-4034-ba9c-c67caf6676fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "tag": "49b54a86-30ae-437a-8e99-4dbd8347c99d"}, {"name": "network-changed", "server_uuid": "bbf406b0-8c85-4126-ade0-797f76b7b3cf", "tag": "2f672d97-7658-4404-9c2c-23bec705e4a1"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:41.469077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d55f5c97-5b6a-4296-a2f9-3f180dc04d48 req-96a21741-c2da-4034-ba9c-c67caf6676fb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:41.469804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d55f5c97-5b6a-4296-a2f9-3f180dc04d48 req-96a21741-c2da-4034-ba9c-c67caf6676fb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:41.485184 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d55f5c97-5b6a-4296-a2f9-3f180dc04d48 req-96a21741-c2da-4034-ba9c-c67caf6676fb service nova] Creating event network-changed:49b54a86-30ae-437a-8e99-4dbd8347c99d for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:04:41.485627 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d55f5c97-5b6a-4296-a2f9-3f180dc04d48 req-96a21741-c2da-4034-ba9c-c67caf6676fb service nova] Creating event network-changed:2f672d97-7658-4404-9c2c-23bec705e4a1 for instance bbf406b0-8c85-4126-ade0-797f76b7b3cf on nch1-master-1 Mar 05 21:04:41.501724 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d55f5c97-5b6a-4296-a2f9-3f180dc04d48 req-96a21741-c2da-4034-ba9c-c67caf6676fb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047819 Mar 05 21:04:41.503091 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1973/3995] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:41.511654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-639a523b-b506-40bb-aa92-a33842e48c90 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:41.512405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-639a523b-b506-40bb-aa92-a33842e48c90 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:41.520185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-639a523b-b506-40bb-aa92-a33842e48c90 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:41.520609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-639a523b-b506-40bb-aa92-a33842e48c90 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:41.522214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-639a523b-b506-40bb-aa92-a33842e48c90 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:41.522670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-639a523b-b506-40bb-aa92-a33842e48c90 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:41.871001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-639a523b-b506-40bb-aa92-a33842e48c90 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:41.879273 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-639a523b-b506-40bb-aa92-a33842e48c90 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.374875 Mar 05 21:04:41.882534 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1974/3996] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:41 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:41.912594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-15cb4f2b-b810-4982-a2b6-b9574da462a1 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:41.915340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-15cb4f2b-b810-4982-a2b6-b9574da462a1 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:41.930195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15cb4f2b-b810-4982-a2b6-b9574da462a1 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:41.932925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15cb4f2b-b810-4982-a2b6-b9574da462a1 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:41.935580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15cb4f2b-b810-4982-a2b6-b9574da462a1 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:41.936692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15cb4f2b-b810-4982-a2b6-b9574da462a1 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:41.939870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:04:41.941265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:04:41.942007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:04:41.942618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:04:41.944059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:04:41.969623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:41.969876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:41.974609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:41.975125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:42.037193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:04:42.043859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for user d2421fee8afc47ea822c5df54a095261 and project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:04:42.066713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:04:42.073565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:04:42.123293 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-87a04564-d938-4650-92b9-9e79f23e9d9a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.510700 Mar 05 21:04:42.124060 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2023/3997] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:04:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:04:42.134522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f5ef0d55-f0a4-477c-baf4-fcfa45c9fd86 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:42.135581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f5ef0d55-f0a4-477c-baf4-fcfa45c9fd86 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:42.248600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f5ef0d55-f0a4-477c-baf4-fcfa45c9fd86 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:42.275519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-15cb4f2b-b810-4982-a2b6-b9574da462a1 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:42.276720 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f5ef0d55-f0a4-477c-baf4-fcfa45c9fd86 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1215 microversion: 2.1 time: 0.146497 Mar 05 21:04:42.277356 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2024/3998] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:42 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:42.287974 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-15cb4f2b-b810-4982-a2b6-b9574da462a1 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1395 microversion: 2.1 time: 0.391796 Mar 05 21:04:42.288594 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1975/3999] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:41 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1395 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:42.470271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-11a93529-ee07-4c53-9353-732e762ed71f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:42.470903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-11a93529-ee07-4c53-9353-732e762ed71f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:42.478316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-11a93529-ee07-4c53-9353-732e762ed71f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:42.479123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-11a93529-ee07-4c53-9353-732e762ed71f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:42.480479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-11a93529-ee07-4c53-9353-732e762ed71f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:42.481130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-11a93529-ee07-4c53-9353-732e762ed71f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:42.685717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-882fab7d-0340-4d5a-a9c9-2566251f59bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:42.686482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-882fab7d-0340-4d5a-a9c9-2566251f59bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:42.697740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-882fab7d-0340-4d5a-a9c9-2566251f59bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:42.698055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-882fab7d-0340-4d5a-a9c9-2566251f59bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:42.699157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-882fab7d-0340-4d5a-a9c9-2566251f59bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:42.699857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-882fab7d-0340-4d5a-a9c9-2566251f59bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:42.938069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-11a93529-ee07-4c53-9353-732e762ed71f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:42.975699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-11a93529-ee07-4c53-9353-732e762ed71f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:42.982791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-11a93529-ee07-4c53-9353-732e762ed71f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:42.986410 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-11a93529-ee07-4c53-9353-732e762ed71f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.519562 Mar 05 21:04:42.989343 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2025/4000] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:42 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:43.003892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ce411e3-6c76-426c-b12e-0f6a383760e6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:43.006955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ce411e3-6c76-426c-b12e-0f6a383760e6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:43.027859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ce411e3-6c76-426c-b12e-0f6a383760e6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:43.029609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ce411e3-6c76-426c-b12e-0f6a383760e6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:43.035186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ce411e3-6c76-426c-b12e-0f6a383760e6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:43.036052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ce411e3-6c76-426c-b12e-0f6a383760e6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:43.038052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-882fab7d-0340-4d5a-a9c9-2566251f59bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:43.053764 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-882fab7d-0340-4d5a-a9c9-2566251f59bf tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1515 microversion: 2.1 time: 0.373219 Mar 05 21:04:43.065667 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1976/4001] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:42 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1515 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:43.071316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a3f1c510-543b-4855-97db-1744c525d4c6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65350572-d864-493f-aaec-a23a7dfc2714"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:43.075462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a3f1c510-543b-4855-97db-1744c525d4c6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:43.081977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3f1c510-543b-4855-97db-1744c525d4c6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:43.082814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3f1c510-543b-4855-97db-1744c525d4c6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:43.084114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3f1c510-543b-4855-97db-1744c525d4c6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:43.085489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3f1c510-543b-4855-97db-1744c525d4c6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:43.441254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9ce411e3-6c76-426c-b12e-0f6a383760e6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:43.454525 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ce411e3-6c76-426c-b12e-0f6a383760e6 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1509 microversion: 2.1 time: 0.462837 Mar 05 21:04:43.459397 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2026/4002] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:42 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1509 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:43.487217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dcbd8479-4d12-42cf-9da1-8e39267d4f51 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:43.489082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dcbd8479-4d12-42cf-9da1-8e39267d4f51 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:43.504164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcbd8479-4d12-42cf-9da1-8e39267d4f51 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:43.511600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcbd8479-4d12-42cf-9da1-8e39267d4f51 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:43.513789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcbd8479-4d12-42cf-9da1-8e39267d4f51 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:43.516133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcbd8479-4d12-42cf-9da1-8e39267d4f51 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:43.575595 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a3f1c510-543b-4855-97db-1744c525d4c6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.508229 Mar 05 21:04:43.581322 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1977/4003] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:04:43 2022] POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:43.600304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e8d6c686-a729-4899-a172-35ad5672b107 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:43.604261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e8d6c686-a729-4899-a172-35ad5672b107 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:43.637022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8d6c686-a729-4899-a172-35ad5672b107 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:43.641003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8d6c686-a729-4899-a172-35ad5672b107 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:43.648479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8d6c686-a729-4899-a172-35ad5672b107 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:43.649828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8d6c686-a729-4899-a172-35ad5672b107 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:43.935755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dcbd8479-4d12-42cf-9da1-8e39267d4f51 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:43.945570 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dcbd8479-4d12-42cf-9da1-8e39267d4f51 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1267 microversion: 2.1 time: 0.472223 Mar 05 21:04:43.948893 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2027/4004] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:43 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1267 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:43.956296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-d9c07d78-5f54-490b-9441-24a0a1dc1d22 req-4d2389cd-6039-4dc0-a5f4-b420955f59ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "tag": "14f8b7cc-1e4e-4f90-b62b-841a16e0f7ac"}, {"name": "network-changed", "server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "tag": "48f2f3bb-2642-4a75-8eb1-b1d8812cc628"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:43.985124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d9c07d78-5f54-490b-9441-24a0a1dc1d22 req-4d2389cd-6039-4dc0-a5f4-b420955f59ea service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:43.986243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d9c07d78-5f54-490b-9441-24a0a1dc1d22 req-4d2389cd-6039-4dc0-a5f4-b420955f59ea service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:44.015308 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-d9c07d78-5f54-490b-9441-24a0a1dc1d22 req-4d2389cd-6039-4dc0-a5f4-b420955f59ea service nova] Creating event network-changed:14f8b7cc-1e4e-4f90-b62b-841a16e0f7ac for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:04:44.017181 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-d9c07d78-5f54-490b-9441-24a0a1dc1d22 req-4d2389cd-6039-4dc0-a5f4-b420955f59ea service nova] Creating event network-changed:48f2f3bb-2642-4a75-8eb1-b1d8812cc628 for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:04:44.027978 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-d9c07d78-5f54-490b-9441-24a0a1dc1d22 req-4d2389cd-6039-4dc0-a5f4-b420955f59ea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075814 Mar 05 21:04:44.028984 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2028/4005] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:44.034751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-44986973-0286-40a5-9f67-990120bb6ab2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:44.035824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-44986973-0286-40a5-9f67-990120bb6ab2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:44.042669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44986973-0286-40a5-9f67-990120bb6ab2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:44.043487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44986973-0286-40a5-9f67-990120bb6ab2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:44.044532 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44986973-0286-40a5-9f67-990120bb6ab2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:44.045224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44986973-0286-40a5-9f67-990120bb6ab2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:44.438979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e8d6c686-a729-4899-a172-35ad5672b107 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:44.448171 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e8d6c686-a729-4899-a172-35ad5672b107 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1395 microversion: 2.1 time: 0.863142 Mar 05 21:04:44.457610 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1978/4006] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:43 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1395 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:44.457610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-701a1475-aaac-47ae-8117-d3daf9a234e1 req-baf1975b-bdb0-41c7-9331-2f42cd5c1589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d57f60-92f1-4612-9719-11df0d9eaa78", "name": "network-vif-plugged", "status": "completed", "tag": "0d4bfa0a-fdb5-4443-bed4-e96bace20d35"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:44.479210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-701a1475-aaac-47ae-8117-d3daf9a234e1 req-baf1975b-bdb0-41c7-9331-2f42cd5c1589 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:44.479652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-701a1475-aaac-47ae-8117-d3daf9a234e1 req-baf1975b-bdb0-41c7-9331-2f42cd5c1589 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:44.512950 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-701a1475-aaac-47ae-8117-d3daf9a234e1 req-baf1975b-bdb0-41c7-9331-2f42cd5c1589 service nova] Creating event network-vif-plugged:0d4bfa0a-fdb5-4443-bed4-e96bace20d35 for instance e4d57f60-92f1-4612-9719-11df0d9eaa78 on nch2-master-1 Mar 05 21:04:44.524138 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-701a1475-aaac-47ae-8117-d3daf9a234e1 req-baf1975b-bdb0-41c7-9331-2f42cd5c1589 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071312 Mar 05 21:04:44.525444 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1979/4007] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:44.564211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c50e4f95-3b8e-4fd6-8fd7-539a2ba31fb2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:44.565358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c50e4f95-3b8e-4fd6-8fd7-539a2ba31fb2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:44.591147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c50e4f95-3b8e-4fd6-8fd7-539a2ba31fb2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:44.592683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c50e4f95-3b8e-4fd6-8fd7-539a2ba31fb2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:44.595555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c50e4f95-3b8e-4fd6-8fd7-539a2ba31fb2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:44.596222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c50e4f95-3b8e-4fd6-8fd7-539a2ba31fb2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:44.675111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-44986973-0286-40a5-9f67-990120bb6ab2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:44.691564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-44986973-0286-40a5-9f67-990120bb6ab2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:44.695460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-44986973-0286-40a5-9f67-990120bb6ab2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:44.699087 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-44986973-0286-40a5-9f67-990120bb6ab2 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.666416 Mar 05 21:04:44.710418 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2029/4008] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:44 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:44.966394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-de0a8df4-5072-46df-814f-ab5c44abaab9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:44.967019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-de0a8df4-5072-46df-814f-ab5c44abaab9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:44.975337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de0a8df4-5072-46df-814f-ab5c44abaab9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:44.976067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de0a8df4-5072-46df-814f-ab5c44abaab9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:44.977221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de0a8df4-5072-46df-814f-ab5c44abaab9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:44.977924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de0a8df4-5072-46df-814f-ab5c44abaab9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:45.342219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-de0a8df4-5072-46df-814f-ab5c44abaab9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:45.358422 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-de0a8df4-5072-46df-814f-ab5c44abaab9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1273 microversion: 2.1 time: 0.396281 Mar 05 21:04:45.362268 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2030/4009] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:44 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1273 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:04:45.469198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-325e7c2f-b97c-45e9-9d72-e6bb1c98f146 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:45.472262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-325e7c2f-b97c-45e9-9d72-e6bb1c98f146 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:45.481156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-325e7c2f-b97c-45e9-9d72-e6bb1c98f146 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:45.482103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-325e7c2f-b97c-45e9-9d72-e6bb1c98f146 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:45.483743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-325e7c2f-b97c-45e9-9d72-e6bb1c98f146 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:45.483871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c50e4f95-3b8e-4fd6-8fd7-539a2ba31fb2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:45.484482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-325e7c2f-b97c-45e9-9d72-e6bb1c98f146 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:45.495965 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c50e4f95-3b8e-4fd6-8fd7-539a2ba31fb2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1486 microversion: 2.1 time: 0.968911 Mar 05 21:04:45.501413 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1980/4010] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:44 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1486 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:45.514755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ad410315-a311-421d-ac54-1d6add837369 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1087061971"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:45.515988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ad410315-a311-421d-ac54-1d6add837369 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:45.522296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad410315-a311-421d-ac54-1d6add837369 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:45.522893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad410315-a311-421d-ac54-1d6add837369 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:45.528965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad410315-a311-421d-ac54-1d6add837369 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:45.529599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad410315-a311-421d-ac54-1d6add837369 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:45.635559 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ad410315-a311-421d-ac54-1d6add837369 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "PUT /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1060 microversion: 2.1 time: 0.124984 Mar 05 21:04:45.645784 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1981/4011] 10.222.0.15 () {60 vars in 1255 bytes} [Sat Mar 5 21:04:45 2022] PUT /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1060 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:04:45.654390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8658cf3a-fe0d-4459-a271-0063a31ab145 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:45.655171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8658cf3a-fe0d-4459-a271-0063a31ab145 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:45.667007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8658cf3a-fe0d-4459-a271-0063a31ab145 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:45.667837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8658cf3a-fe0d-4459-a271-0063a31ab145 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:45.669400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8658cf3a-fe0d-4459-a271-0063a31ab145 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:45.670133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8658cf3a-fe0d-4459-a271-0063a31ab145 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:45.914544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-325e7c2f-b97c-45e9-9d72-e6bb1c98f146 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:45.926539 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-325e7c2f-b97c-45e9-9d72-e6bb1c98f146 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1395 microversion: 2.1 time: 0.462831 Mar 05 21:04:45.928324 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2031/4012] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:45 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1395 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:45.937728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5cc2639c-51f4-4ac3-bae9-f9f114b78565 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:45.941393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5cc2639c-51f4-4ac3-bae9-f9f114b78565 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:45.956867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cc2639c-51f4-4ac3-bae9-f9f114b78565 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:45.957591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cc2639c-51f4-4ac3-bae9-f9f114b78565 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:45.958591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cc2639c-51f4-4ac3-bae9-f9f114b78565 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:45.960390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cc2639c-51f4-4ac3-bae9-f9f114b78565 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:46.428323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8658cf3a-fe0d-4459-a271-0063a31ab145 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:46.441939 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8658cf3a-fe0d-4459-a271-0063a31ab145 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1487 microversion: 2.1 time: 0.795271 Mar 05 21:04:46.443139 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1982/4013] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:45 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1487 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:04:46.452958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-76645bf2-305c-48a6-a352-8fc4c39aed20 req-13f6124e-dd2f-4090-9af0-ce61d26c3666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "tag": "d03778ff-0dff-4440-ad01-ea9b00fcbdae"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:46.476124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-76645bf2-305c-48a6-a352-8fc4c39aed20 req-13f6124e-dd2f-4090-9af0-ce61d26c3666 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:46.478303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-76645bf2-305c-48a6-a352-8fc4c39aed20 req-13f6124e-dd2f-4090-9af0-ce61d26c3666 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:46.500913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5cc2639c-51f4-4ac3-bae9-f9f114b78565 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:46.518935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5cc2639c-51f4-4ac3-bae9-f9f114b78565 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:46.527921 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-76645bf2-305c-48a6-a352-8fc4c39aed20 req-13f6124e-dd2f-4090-9af0-ce61d26c3666 service nova] Creating event network-changed:d03778ff-0dff-4440-ad01-ea9b00fcbdae for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:04:46.528590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5cc2639c-51f4-4ac3-bae9-f9f114b78565 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:46.532409 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5cc2639c-51f4-4ac3-bae9-f9f114b78565 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.603070 Mar 05 21:04:46.535079 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2032/4014] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:45 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:46.546358 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-76645bf2-305c-48a6-a352-8fc4c39aed20 req-13f6124e-dd2f-4090-9af0-ce61d26c3666 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099406 Mar 05 21:04:46.548572 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1983/4015] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:46.555139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a15770d9-2903-4625-af66-b977364d7f5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:46.557058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a15770d9-2903-4625-af66-b977364d7f5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:46.566236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-47a95f7b-c77f-41a7-8f62-4305918ea887 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:46.569857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-47a95f7b-c77f-41a7-8f62-4305918ea887 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:46.575089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a15770d9-2903-4625-af66-b977364d7f5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:46.575564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a15770d9-2903-4625-af66-b977364d7f5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:46.576371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a15770d9-2903-4625-af66-b977364d7f5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:46.581245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a15770d9-2903-4625-af66-b977364d7f5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:46.583871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47a95f7b-c77f-41a7-8f62-4305918ea887 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:46.585729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47a95f7b-c77f-41a7-8f62-4305918ea887 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:46.587971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47a95f7b-c77f-41a7-8f62-4305918ea887 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:46.589482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47a95f7b-c77f-41a7-8f62-4305918ea887 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:46.898319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-47a95f7b-c77f-41a7-8f62-4305918ea887 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:46.912746 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-47a95f7b-c77f-41a7-8f62-4305918ea887 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1487 microversion: 2.1 time: 0.361602 Mar 05 21:04:46.913743 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1984/4016] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:46 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1487 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:46.931978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f508dc9b-e449-4c42-b17f-8fa2e3c66b8d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:46.932577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f508dc9b-e449-4c42-b17f-8fa2e3c66b8d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:46.939508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f508dc9b-e449-4c42-b17f-8fa2e3c66b8d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:46.940002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f508dc9b-e449-4c42-b17f-8fa2e3c66b8d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:46.940826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f508dc9b-e449-4c42-b17f-8fa2e3c66b8d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:46.941287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f508dc9b-e449-4c42-b17f-8fa2e3c66b8d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:46.972165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f508dc9b-e449-4c42-b17f-8fa2e3c66b8d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:04:47.099658 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f508dc9b-e449-4c42-b17f-8fa2e3c66b8d tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 204 len: 0 microversion: 2.1 time: 0.170696 Mar 05 21:04:47.105498 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1985/4017] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:04:46 2022] DELETE /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:04:47.116636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-625d20a9-9286-4109-a888-91fbe17c68d9 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:47.117660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-625d20a9-9286-4109-a888-91fbe17c68d9 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:47.128526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-625d20a9-9286-4109-a888-91fbe17c68d9 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:47.128994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-625d20a9-9286-4109-a888-91fbe17c68d9 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:47.131613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-625d20a9-9286-4109-a888-91fbe17c68d9 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:47.132317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-625d20a9-9286-4109-a888-91fbe17c68d9 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:47.169653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a15770d9-2903-4625-af66-b977364d7f5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:47.179011 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a15770d9-2903-4625-af66-b977364d7f5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1315 microversion: 2.1 time: 0.642588 Mar 05 21:04:47.180945 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2033/4018] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:46 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:47.194466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3b56e167-6601-462f-af22-93abde895d4b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:47.195353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3b56e167-6601-462f-af22-93abde895d4b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:47.204318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b56e167-6601-462f-af22-93abde895d4b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:47.206814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b56e167-6601-462f-af22-93abde895d4b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:47.210940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b56e167-6601-462f-af22-93abde895d4b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:47.212758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b56e167-6601-462f-af22-93abde895d4b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:47.496361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-625d20a9-9286-4109-a888-91fbe17c68d9 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:47.507948 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-625d20a9-9286-4109-a888-91fbe17c68d9 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1576 microversion: 2.1 time: 0.400602 Mar 05 21:04:47.524897 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1986/4019] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:47 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1576 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:47.543407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0d26855d-e069-48a6-b2a8-b612f314ee5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:47.544683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0d26855d-e069-48a6-b2a8-b612f314ee5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:47.560109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d26855d-e069-48a6-b2a8-b612f314ee5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:47.561335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d26855d-e069-48a6-b2a8-b612f314ee5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:47.562799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d26855d-e069-48a6-b2a8-b612f314ee5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:47.563457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0d26855d-e069-48a6-b2a8-b612f314ee5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:47.605345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-0d26855d-e069-48a6-b2a8-b612f314ee5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lazy-loading 'flavor' on Instance uuid b2d64ade-0446-474b-a3d4-454133f21972 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:04:47.609055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3b56e167-6601-462f-af22-93abde895d4b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:47.620591 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3b56e167-6601-462f-af22-93abde895d4b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1493 microversion: 2.1 time: 0.435928 Mar 05 21:04:47.631593 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2034/4020] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:47 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1493 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:47.645258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-64f3e298-b6c8-4fc1-9a23-cd4a7a5ef8b3 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:47.646455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-64f3e298-b6c8-4fc1-9a23-cd4a7a5ef8b3 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:47.662779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64f3e298-b6c8-4fc1-9a23-cd4a7a5ef8b3 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:47.671571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64f3e298-b6c8-4fc1-9a23-cd4a7a5ef8b3 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:47.672576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64f3e298-b6c8-4fc1-9a23-cd4a7a5ef8b3 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:47.673164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64f3e298-b6c8-4fc1-9a23-cd4a7a5ef8b3 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:47.833998 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0d26855d-e069-48a6-b2a8-b612f314ee5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action" status: 200 len: 32 microversion: 2.1 time: 0.307285 Mar 05 21:04:47.836359 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1987/4021] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:04:47 2022] POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action => generated 32 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:04:47.849543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d23da60f-dafc-4259-ae36-917d33310913 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:47.850347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d23da60f-dafc-4259-ae36-917d33310913 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:47.869636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d23da60f-dafc-4259-ae36-917d33310913 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:47.870468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d23da60f-dafc-4259-ae36-917d33310913 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:47.872176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d23da60f-dafc-4259-ae36-917d33310913 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:47.873181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d23da60f-dafc-4259-ae36-917d33310913 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:48.020262 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-64f3e298-b6c8-4fc1-9a23-cd4a7a5ef8b3 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.382353 Mar 05 21:04:48.021134 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2035/4022] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 21:04:47 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78/os-interface => generated 284 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:48.026539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6d5673b1-7a91-4832-82b5-bf43584cb11b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:48.027171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6d5673b1-7a91-4832-82b5-bf43584cb11b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:48.038694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d5673b1-7a91-4832-82b5-bf43584cb11b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:48.041401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d5673b1-7a91-4832-82b5-bf43584cb11b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:48.044052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d5673b1-7a91-4832-82b5-bf43584cb11b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:48.047538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d5673b1-7a91-4832-82b5-bf43584cb11b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:48.454064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d23da60f-dafc-4259-ae36-917d33310913 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:48.465457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d23da60f-dafc-4259-ae36-917d33310913 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:48.467268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d23da60f-dafc-4259-ae36-917d33310913 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:48.468640 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d23da60f-dafc-4259-ae36-917d33310913 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.630390 Mar 05 21:04:48.469346 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1988/4023] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:47 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:48.474428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f3b351ed-04ee-4aa2-8f08-e111279898c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:48.478209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f3b351ed-04ee-4aa2-8f08-e111279898c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:48.487627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3b351ed-04ee-4aa2-8f08-e111279898c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:48.488233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3b351ed-04ee-4aa2-8f08-e111279898c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:48.489143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3b351ed-04ee-4aa2-8f08-e111279898c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:48.489667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3b351ed-04ee-4aa2-8f08-e111279898c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:48.716876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6d5673b1-7a91-4832-82b5-bf43584cb11b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:48.728038 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6d5673b1-7a91-4832-82b5-bf43584cb11b tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.705703 Mar 05 21:04:48.730025 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2036/4024] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:48 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:48.736561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2e2df98b-85ea-46d4-9e4a-4dd2c52db338 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:48.737272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2e2df98b-85ea-46d4-9e4a-4dd2c52db338 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:48.745154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e2df98b-85ea-46d4-9e4a-4dd2c52db338 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:48.746325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e2df98b-85ea-46d4-9e4a-4dd2c52db338 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:48.747944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e2df98b-85ea-46d4-9e4a-4dd2c52db338 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:48.748604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e2df98b-85ea-46d4-9e4a-4dd2c52db338 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:49.054870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f3b351ed-04ee-4aa2-8f08-e111279898c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:49.063439 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f3b351ed-04ee-4aa2-8f08-e111279898c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1315 microversion: 2.1 time: 0.592933 Mar 05 21:04:49.064178 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1989/4025] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:48 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:49.070347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-afef0e4d-ad1e-4e42-957d-067f8cf2a42a req-14330dd8-702e-49c4-9657-1892a62817db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b396188c-9bd6-472d-ae9d-86ea8b66a01c", "tag": "67768743-b786-49b6-9794-7c55e5d612f7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:49.080237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-afef0e4d-ad1e-4e42-957d-067f8cf2a42a req-14330dd8-702e-49c4-9657-1892a62817db service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:49.080815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-afef0e4d-ad1e-4e42-957d-067f8cf2a42a req-14330dd8-702e-49c4-9657-1892a62817db service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:49.094460 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-afef0e4d-ad1e-4e42-957d-067f8cf2a42a req-14330dd8-702e-49c4-9657-1892a62817db service nova] Creating event network-changed:67768743-b786-49b6-9794-7c55e5d612f7 for instance b396188c-9bd6-472d-ae9d-86ea8b66a01c on nch2-master-1 Mar 05 21:04:49.100480 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-afef0e4d-ad1e-4e42-957d-067f8cf2a42a req-14330dd8-702e-49c4-9657-1892a62817db service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033902 Mar 05 21:04:49.101797 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1990/4026] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:49.490023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-43c472dd-919c-41fb-bc0a-d2cc2d96664e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:49.491628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-43c472dd-919c-41fb-bc0a-d2cc2d96664e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:49.500106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43c472dd-919c-41fb-bc0a-d2cc2d96664e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:49.500877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43c472dd-919c-41fb-bc0a-d2cc2d96664e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:49.502480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43c472dd-919c-41fb-bc0a-d2cc2d96664e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:49.503001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43c472dd-919c-41fb-bc0a-d2cc2d96664e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:49.568970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2e2df98b-85ea-46d4-9e4a-4dd2c52db338 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:49.577640 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2e2df98b-85ea-46d4-9e4a-4dd2c52db338 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1493 microversion: 2.1 time: 0.846243 Mar 05 21:04:49.578716 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2037/4027] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:48 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1493 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:49.747554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0542b7c5-6eaa-4bd7-84c3-b71540d34a05 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:49.748624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0542b7c5-6eaa-4bd7-84c3-b71540d34a05 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:49.756071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0542b7c5-6eaa-4bd7-84c3-b71540d34a05 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:49.756799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0542b7c5-6eaa-4bd7-84c3-b71540d34a05 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:49.757599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0542b7c5-6eaa-4bd7-84c3-b71540d34a05 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:49.758526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0542b7c5-6eaa-4bd7-84c3-b71540d34a05 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:50.162423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-43c472dd-919c-41fb-bc0a-d2cc2d96664e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:50.176473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-43c472dd-919c-41fb-bc0a-d2cc2d96664e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:50.177985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-43c472dd-919c-41fb-bc0a-d2cc2d96664e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:50.179170 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-43c472dd-919c-41fb-bc0a-d2cc2d96664e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.694467 Mar 05 21:04:50.180163 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1991/4028] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:49 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:50.186303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-96ba1f83-e9ce-4471-a35d-4d2301542a3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:50.187258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-96ba1f83-e9ce-4471-a35d-4d2301542a3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:50.196282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96ba1f83-e9ce-4471-a35d-4d2301542a3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:50.197293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96ba1f83-e9ce-4471-a35d-4d2301542a3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:50.198349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96ba1f83-e9ce-4471-a35d-4d2301542a3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:50.199059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96ba1f83-e9ce-4471-a35d-4d2301542a3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:50.434388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0542b7c5-6eaa-4bd7-84c3-b71540d34a05 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:50.442675 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0542b7c5-6eaa-4bd7-84c3-b71540d34a05 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.700933 Mar 05 21:04:50.453226 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2038/4029] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:49 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:50.482302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-96ba1f83-e9ce-4471-a35d-4d2301542a3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:50.496532 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-96ba1f83-e9ce-4471-a35d-4d2301542a3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1315 microversion: 2.1 time: 0.313981 Mar 05 21:04:50.498404 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1992/4030] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:50 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:50.595442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b5c2058b-679b-4fb4-a5e3-6abed049cad5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:50.596483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b5c2058b-679b-4fb4-a5e3-6abed049cad5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:50.608871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5c2058b-679b-4fb4-a5e3-6abed049cad5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:50.609272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5c2058b-679b-4fb4-a5e3-6abed049cad5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:50.610060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5c2058b-679b-4fb4-a5e3-6abed049cad5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:50.610509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5c2058b-679b-4fb4-a5e3-6abed049cad5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:50.778689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b5c2058b-679b-4fb4-a5e3-6abed049cad5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:50.797124 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b5c2058b-679b-4fb4-a5e3-6abed049cad5 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 200 len: 1451 microversion: 2.1 time: 0.206326 Mar 05 21:04:50.809181 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2039/4031] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:50 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 1451 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:51.198889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ad87810d-831a-48bf-9384-437cb82cbe11 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:51.199854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ad87810d-831a-48bf-9384-437cb82cbe11 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:51.206293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad87810d-831a-48bf-9384-437cb82cbe11 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:51.206976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad87810d-831a-48bf-9384-437cb82cbe11 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:51.208095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad87810d-831a-48bf-9384-437cb82cbe11 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:51.208931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad87810d-831a-48bf-9384-437cb82cbe11 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:51.289283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b77902cc-b5c2-40d4-b78f-ed2c628d4359 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:51.291788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b77902cc-b5c2-40d4-b78f-ed2c628d4359 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:51.299140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b77902cc-b5c2-40d4-b78f-ed2c628d4359 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:51.299923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b77902cc-b5c2-40d4-b78f-ed2c628d4359 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:51.301311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b77902cc-b5c2-40d4-b78f-ed2c628d4359 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:51.302123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b77902cc-b5c2-40d4-b78f-ed2c628d4359 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:51.583270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad87810d-831a-48bf-9384-437cb82cbe11 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:51.598401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad87810d-831a-48bf-9384-437cb82cbe11 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:51.601040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad87810d-831a-48bf-9384-437cb82cbe11 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:51.603520 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ad87810d-831a-48bf-9384-437cb82cbe11 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.408967 Mar 05 21:04:51.605736 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1993/4032] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:51 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:51.613325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d69896c4-c099-4bf7-b345-8be0f928382e req-c33a3d49-c202-4b48-9d54-b17b137434e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3107763c-59c3-4635-8506-ceac63b004b0", "name": "network-vif-deleted", "tag": "e6f29933-01e9-44e2-b2d2-710980940a5a"}, {"name": "network-changed", "server_uuid": "e4d57f60-92f1-4612-9719-11df0d9eaa78", "tag": "0d4bfa0a-fdb5-4443-bed4-e96bace20d35"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:51.625879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d69896c4-c099-4bf7-b345-8be0f928382e req-c33a3d49-c202-4b48-9d54-b17b137434e7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:51.626634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d69896c4-c099-4bf7-b345-8be0f928382e req-c33a3d49-c202-4b48-9d54-b17b137434e7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:51.655033 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d69896c4-c099-4bf7-b345-8be0f928382e req-c33a3d49-c202-4b48-9d54-b17b137434e7 service nova] Creating event network-vif-deleted:e6f29933-01e9-44e2-b2d2-710980940a5a for instance 3107763c-59c3-4635-8506-ceac63b004b0 on nch1-master-1 Mar 05 21:04:51.656355 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d69896c4-c099-4bf7-b345-8be0f928382e req-c33a3d49-c202-4b48-9d54-b17b137434e7 service nova] Creating event network-changed:0d4bfa0a-fdb5-4443-bed4-e96bace20d35 for instance e4d57f60-92f1-4612-9719-11df0d9eaa78 on nch2-master-1 Mar 05 21:04:51.670322 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d69896c4-c099-4bf7-b345-8be0f928382e req-c33a3d49-c202-4b48-9d54-b17b137434e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.062490 Mar 05 21:04:51.672631 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1994/4033] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:51.700305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d001461a-2c77-4e18-be64-c6f5c5bcae8a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:51.701197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d001461a-2c77-4e18-be64-c6f5c5bcae8a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:51.708193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d001461a-2c77-4e18-be64-c6f5c5bcae8a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:51.708738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d001461a-2c77-4e18-be64-c6f5c5bcae8a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:51.709612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d001461a-2c77-4e18-be64-c6f5c5bcae8a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:51.710263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d001461a-2c77-4e18-be64-c6f5c5bcae8a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:51.808722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b77902cc-b5c2-40d4-b78f-ed2c628d4359 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:51.826782 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b77902cc-b5c2-40d4-b78f-ed2c628d4359 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1576 microversion: 2.1 time: 0.540044 Mar 05 21:04:51.830802 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2040/4034] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:51 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1576 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:51.837050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-93d551af-7620-4632-abe6-e236dc4c1702 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:51.838778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-93d551af-7620-4632-abe6-e236dc4c1702 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:51.862742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93d551af-7620-4632-abe6-e236dc4c1702 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:51.863544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93d551af-7620-4632-abe6-e236dc4c1702 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:51.864517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93d551af-7620-4632-abe6-e236dc4c1702 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:51.865100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93d551af-7620-4632-abe6-e236dc4c1702 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:51.937018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d001461a-2c77-4e18-be64-c6f5c5bcae8a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:51.954091 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d001461a-2c77-4e18-be64-c6f5c5bcae8a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.279834 Mar 05 21:04:51.954692 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1995/4035] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:51 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:51.967162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9601b7e1-0675-4791-9a40-10f16300f2df tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:51.973570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9601b7e1-0675-4791-9a40-10f16300f2df tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:51.993043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9601b7e1-0675-4791-9a40-10f16300f2df tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:51.993811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9601b7e1-0675-4791-9a40-10f16300f2df tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:51.994794 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9601b7e1-0675-4791-9a40-10f16300f2df tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:51.995393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9601b7e1-0675-4791-9a40-10f16300f2df tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.010848 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-9601b7e1-0675-4791-9a40-10f16300f2df tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance 3107763c-59c3-4635-8506-ceac63b004b0 could not be found. Mar 05 21:04:52.011797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9601b7e1-0675-4791-9a40-10f16300f2df tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance 3107763c-59c3-4635-8506-ceac63b004b0 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.012818 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9601b7e1-0675-4791-9a40-10f16300f2df tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 404 len: 111 microversion: 2.1 time: 0.055237 Mar 05 21:04:52.013581 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1996/4036] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:51 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:04:52.038932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3938cdb3-8a9e-40c1-90e6-f8f3ecbce68e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.039917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3938cdb3-8a9e-40c1-90e6-f8f3ecbce68e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.048465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3938cdb3-8a9e-40c1-90e6-f8f3ecbce68e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.048926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3938cdb3-8a9e-40c1-90e6-f8f3ecbce68e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.050035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3938cdb3-8a9e-40c1-90e6-f8f3ecbce68e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.050490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3938cdb3-8a9e-40c1-90e6-f8f3ecbce68e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.073732 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-3938cdb3-8a9e-40c1-90e6-f8f3ecbce68e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance 3107763c-59c3-4635-8506-ceac63b004b0 could not be found. Mar 05 21:04:52.074295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3938cdb3-8a9e-40c1-90e6-f8f3ecbce68e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance 3107763c-59c3-4635-8506-ceac63b004b0 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.075175 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3938cdb3-8a9e-40c1-90e6-f8f3ecbce68e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 404 len: 111 microversion: 2.1 time: 0.040332 Mar 05 21:04:52.076089 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1997/4037] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:04:52 2022] DELETE /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:04:52.084559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b73a86d2-0de7-4a3d-b71d-59a37486d017 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.085274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b73a86d2-0de7-4a3d-b71d-59a37486d017 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 3107763c-59c3-4635-8506-ceac63b004b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.093376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b73a86d2-0de7-4a3d-b71d-59a37486d017 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.093921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b73a86d2-0de7-4a3d-b71d-59a37486d017 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.094807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b73a86d2-0de7-4a3d-b71d-59a37486d017 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.095326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b73a86d2-0de7-4a3d-b71d-59a37486d017 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.112242 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-b73a86d2-0de7-4a3d-b71d-59a37486d017 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance 3107763c-59c3-4635-8506-ceac63b004b0 could not be found. Mar 05 21:04:52.112960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b73a86d2-0de7-4a3d-b71d-59a37486d017 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance 3107763c-59c3-4635-8506-ceac63b004b0 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.113897 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b73a86d2-0de7-4a3d-b71d-59a37486d017 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0" status: 404 len: 111 microversion: 2.1 time: 0.033911 Mar 05 21:04:52.117681 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1998/4038] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:52 2022] GET /compute/v2.1/servers/3107763c-59c3-4635-8506-ceac63b004b0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:04:52.124259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dce98cc7-8e4c-4610-afc9-16c3061e6c42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.124779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dce98cc7-8e4c-4610-afc9-16c3061e6c42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.131205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dce98cc7-8e4c-4610-afc9-16c3061e6c42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.131710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dce98cc7-8e4c-4610-afc9-16c3061e6c42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.132518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dce98cc7-8e4c-4610-afc9-16c3061e6c42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.132968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dce98cc7-8e4c-4610-afc9-16c3061e6c42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.151648 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-dce98cc7-8e4c-4610-afc9-16c3061e6c42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance f56e76ef-62db-4859-abb3-59ad080e4cd8 could not be found. Mar 05 21:04:52.152330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dce98cc7-8e4c-4610-afc9-16c3061e6c42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance f56e76ef-62db-4859-abb3-59ad080e4cd8 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.153271 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dce98cc7-8e4c-4610-afc9-16c3061e6c42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 404 len: 111 microversion: 2.1 time: 0.033410 Mar 05 21:04:52.154197 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 1999/4039] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:04:52 2022] DELETE /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:04:52.162337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d2ee896c-fa0d-4fdc-9972-3d69d3bede85 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.162950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d2ee896c-fa0d-4fdc-9972-3d69d3bede85 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: f56e76ef-62db-4859-abb3-59ad080e4cd8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.169700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2ee896c-fa0d-4fdc-9972-3d69d3bede85 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.170111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2ee896c-fa0d-4fdc-9972-3d69d3bede85 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.170876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2ee896c-fa0d-4fdc-9972-3d69d3bede85 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.171318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2ee896c-fa0d-4fdc-9972-3d69d3bede85 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.194910 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-d2ee896c-fa0d-4fdc-9972-3d69d3bede85 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance f56e76ef-62db-4859-abb3-59ad080e4cd8 could not be found. Mar 05 21:04:52.195982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d2ee896c-fa0d-4fdc-9972-3d69d3bede85 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance f56e76ef-62db-4859-abb3-59ad080e4cd8 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.197046 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d2ee896c-fa0d-4fdc-9972-3d69d3bede85 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8" status: 404 len: 111 microversion: 2.1 time: 0.038769 Mar 05 21:04:52.198132 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2000/4040] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:52 2022] GET /compute/v2.1/servers/f56e76ef-62db-4859-abb3-59ad080e4cd8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:04:52.209439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd802084-4821-451d-b908-1bac87e3de5e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.210305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd802084-4821-451d-b908-1bac87e3de5e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.220976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd802084-4821-451d-b908-1bac87e3de5e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.221649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd802084-4821-451d-b908-1bac87e3de5e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.222919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd802084-4821-451d-b908-1bac87e3de5e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.223369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd802084-4821-451d-b908-1bac87e3de5e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.239637 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-fd802084-4821-451d-b908-1bac87e3de5e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance 99c19119-1997-4996-8890-83f81bea3f82 could not be found. Mar 05 21:04:52.240282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd802084-4821-451d-b908-1bac87e3de5e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance 99c19119-1997-4996-8890-83f81bea3f82 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.241150 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd802084-4821-451d-b908-1bac87e3de5e tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 404 len: 111 microversion: 2.1 time: 0.038516 Mar 05 21:04:52.242045 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2001/4041] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:04:52 2022] DELETE /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:04:52.251231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4e43df30-c635-48f8-b2c2-06a8c5d492ee tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.251984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4e43df30-c635-48f8-b2c2-06a8c5d492ee tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 99c19119-1997-4996-8890-83f81bea3f82] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.260454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e43df30-c635-48f8-b2c2-06a8c5d492ee tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.261006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e43df30-c635-48f8-b2c2-06a8c5d492ee tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.261882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e43df30-c635-48f8-b2c2-06a8c5d492ee tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.262402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e43df30-c635-48f8-b2c2-06a8c5d492ee tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.279451 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4e43df30-c635-48f8-b2c2-06a8c5d492ee tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance 99c19119-1997-4996-8890-83f81bea3f82 could not be found. Mar 05 21:04:52.280183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4e43df30-c635-48f8-b2c2-06a8c5d492ee tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance 99c19119-1997-4996-8890-83f81bea3f82 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.281115 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4e43df30-c635-48f8-b2c2-06a8c5d492ee tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82" status: 404 len: 111 microversion: 2.1 time: 0.033887 Mar 05 21:04:52.284762 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2002/4042] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:52 2022] GET /compute/v2.1/servers/99c19119-1997-4996-8890-83f81bea3f82 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:04:52.290504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3b17ebce-c775-426f-a2e9-82c99f6c1822 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.290823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3b17ebce-c775-426f-a2e9-82c99f6c1822 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.297804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b17ebce-c775-426f-a2e9-82c99f6c1822 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.298353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b17ebce-c775-426f-a2e9-82c99f6c1822 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.299225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b17ebce-c775-426f-a2e9-82c99f6c1822 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.299847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b17ebce-c775-426f-a2e9-82c99f6c1822 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.316583 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-3b17ebce-c775-426f-a2e9-82c99f6c1822 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance da80a66d-faa9-4917-9003-758b0a8933b2 could not be found. Mar 05 21:04:52.317560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3b17ebce-c775-426f-a2e9-82c99f6c1822 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance da80a66d-faa9-4917-9003-758b0a8933b2 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.318625 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3b17ebce-c775-426f-a2e9-82c99f6c1822 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 404 len: 111 microversion: 2.1 time: 0.032670 Mar 05 21:04:52.319595 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2003/4043] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:04:52 2022] DELETE /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:04:52.328905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c3217a21-c954-4afe-b5f0-00fe83e1c3f2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.329537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c3217a21-c954-4afe-b5f0-00fe83e1c3f2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: da80a66d-faa9-4917-9003-758b0a8933b2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.335594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c3217a21-c954-4afe-b5f0-00fe83e1c3f2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.336100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c3217a21-c954-4afe-b5f0-00fe83e1c3f2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.338232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c3217a21-c954-4afe-b5f0-00fe83e1c3f2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.338845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c3217a21-c954-4afe-b5f0-00fe83e1c3f2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.354261 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-c3217a21-c954-4afe-b5f0-00fe83e1c3f2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance da80a66d-faa9-4917-9003-758b0a8933b2 could not be found. Mar 05 21:04:52.354891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c3217a21-c954-4afe-b5f0-00fe83e1c3f2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance da80a66d-faa9-4917-9003-758b0a8933b2 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.356055 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c3217a21-c954-4afe-b5f0-00fe83e1c3f2 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2" status: 404 len: 111 microversion: 2.1 time: 0.031325 Mar 05 21:04:52.357415 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2004/4044] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:52 2022] GET /compute/v2.1/servers/da80a66d-faa9-4917-9003-758b0a8933b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:04:52.369068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9c164d19-0f26-43e3-b1a1-45ae6699f06a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.369560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9c164d19-0f26-43e3-b1a1-45ae6699f06a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.375856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c164d19-0f26-43e3-b1a1-45ae6699f06a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.376317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c164d19-0f26-43e3-b1a1-45ae6699f06a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.377221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c164d19-0f26-43e3-b1a1-45ae6699f06a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.377673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c164d19-0f26-43e3-b1a1-45ae6699f06a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.393696 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-9c164d19-0f26-43e3-b1a1-45ae6699f06a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance ad9443f7-ccad-4db6-8a01-914f58f54436 could not be found. Mar 05 21:04:52.394328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9c164d19-0f26-43e3-b1a1-45ae6699f06a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance ad9443f7-ccad-4db6-8a01-914f58f54436 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.395192 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9c164d19-0f26-43e3-b1a1-45ae6699f06a tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 404 len: 111 microversion: 2.1 time: 0.033720 Mar 05 21:04:52.396393 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2005/4045] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:04:52 2022] DELETE /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:04:52.405400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-df2f0f7a-1c5f-4719-b257-74cc972de408 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.406274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-df2f0f7a-1c5f-4719-b257-74cc972de408 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: ad9443f7-ccad-4db6-8a01-914f58f54436] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.412793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df2f0f7a-1c5f-4719-b257-74cc972de408 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.413260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df2f0f7a-1c5f-4719-b257-74cc972de408 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.414058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df2f0f7a-1c5f-4719-b257-74cc972de408 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.414684 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df2f0f7a-1c5f-4719-b257-74cc972de408 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.430879 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-df2f0f7a-1c5f-4719-b257-74cc972de408 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance ad9443f7-ccad-4db6-8a01-914f58f54436 could not be found. Mar 05 21:04:52.431740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-df2f0f7a-1c5f-4719-b257-74cc972de408 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance ad9443f7-ccad-4db6-8a01-914f58f54436 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.433731 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-df2f0f7a-1c5f-4719-b257-74cc972de408 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436" status: 404 len: 111 microversion: 2.1 time: 0.031398 Mar 05 21:04:52.434602 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2006/4046] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:52 2022] GET /compute/v2.1/servers/ad9443f7-ccad-4db6-8a01-914f58f54436 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:04:52.448121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-36b7f362-5f10-4832-a1f4-9dbb8be0092b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.448965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-36b7f362-5f10-4832-a1f4-9dbb8be0092b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.465316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36b7f362-5f10-4832-a1f4-9dbb8be0092b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.465718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36b7f362-5f10-4832-a1f4-9dbb8be0092b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.466722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36b7f362-5f10-4832-a1f4-9dbb8be0092b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.467261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36b7f362-5f10-4832-a1f4-9dbb8be0092b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.488712 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-36b7f362-5f10-4832-a1f4-9dbb8be0092b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance 2fae69a3-c2ff-4129-b817-65fe16e6a526 could not be found. Mar 05 21:04:52.491139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-36b7f362-5f10-4832-a1f4-9dbb8be0092b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance 2fae69a3-c2ff-4129-b817-65fe16e6a526 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.493755 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-36b7f362-5f10-4832-a1f4-9dbb8be0092b tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 404 len: 111 microversion: 2.1 time: 0.053529 Mar 05 21:04:52.499963 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2007/4047] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:04:52 2022] DELETE /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:04:52.512141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3577a873-469b-46fb-a1f9-72dad2354f79 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.514790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3577a873-469b-46fb-a1f9-72dad2354f79 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 2fae69a3-c2ff-4129-b817-65fe16e6a526] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.527520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3577a873-469b-46fb-a1f9-72dad2354f79 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.528604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3577a873-469b-46fb-a1f9-72dad2354f79 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.529462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3577a873-469b-46fb-a1f9-72dad2354f79 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.529912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3577a873-469b-46fb-a1f9-72dad2354f79 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.551827 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-3577a873-469b-46fb-a1f9-72dad2354f79 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance 2fae69a3-c2ff-4129-b817-65fe16e6a526 could not be found. Mar 05 21:04:52.552437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3577a873-469b-46fb-a1f9-72dad2354f79 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance 2fae69a3-c2ff-4129-b817-65fe16e6a526 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.554639 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3577a873-469b-46fb-a1f9-72dad2354f79 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526" status: 404 len: 111 microversion: 2.1 time: 0.053687 Mar 05 21:04:52.564273 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2008/4048] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:52 2022] GET /compute/v2.1/servers/2fae69a3-c2ff-4129-b817-65fe16e6a526 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:04:52.573226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-95e57e20-ecb5-4df4-98ad-99a8c6db23c7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.574045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-95e57e20-ecb5-4df4-98ad-99a8c6db23c7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.581690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95e57e20-ecb5-4df4-98ad-99a8c6db23c7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.582482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95e57e20-ecb5-4df4-98ad-99a8c6db23c7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.583543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95e57e20-ecb5-4df4-98ad-99a8c6db23c7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.584709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95e57e20-ecb5-4df4-98ad-99a8c6db23c7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.615243 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-95e57e20-ecb5-4df4-98ad-99a8c6db23c7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2 could not be found. Mar 05 21:04:52.616326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-95e57e20-ecb5-4df4-98ad-99a8c6db23c7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.617429 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-95e57e20-ecb5-4df4-98ad-99a8c6db23c7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2" status: 404 len: 111 microversion: 2.1 time: 0.052343 Mar 05 21:04:52.619079 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2009/4049] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:04:52 2022] DELETE /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:04:52.633147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5c49a1c2-7b1c-4caa-8444-0aeffcc1e313 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.635324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5c49a1c2-7b1c-4caa-8444-0aeffcc1e313 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.644082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5c49a1c2-7b1c-4caa-8444-0aeffcc1e313 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.644899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5c49a1c2-7b1c-4caa-8444-0aeffcc1e313 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.646053 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5c49a1c2-7b1c-4caa-8444-0aeffcc1e313 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.647070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5c49a1c2-7b1c-4caa-8444-0aeffcc1e313 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.701640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-93d551af-7620-4632-abe6-e236dc4c1702 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:52.709486 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-93d551af-7620-4632-abe6-e236dc4c1702 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1315 microversion: 2.1 time: 0.877503 Mar 05 21:04:52.717787 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2041/4050] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:51 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:52.725509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a6187aa5-a8dc-45db-9f0b-58ed4d8a3a42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.726516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a6187aa5-a8dc-45db-9f0b-58ed4d8a3a42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.742526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6187aa5-a8dc-45db-9f0b-58ed4d8a3a42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.743103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6187aa5-a8dc-45db-9f0b-58ed4d8a3a42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.743877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6187aa5-a8dc-45db-9f0b-58ed4d8a3a42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.744324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6187aa5-a8dc-45db-9f0b-58ed4d8a3a42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.767785 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-a6187aa5-a8dc-45db-9f0b-58ed4d8a3a42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2 could not be found. Mar 05 21:04:52.768530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a6187aa5-a8dc-45db-9f0b-58ed4d8a3a42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance 5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:52.769733 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a6187aa5-a8dc-45db-9f0b-58ed4d8a3a42 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2" status: 404 len: 111 microversion: 2.1 time: 0.050608 Mar 05 21:04:52.770583 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2042/4051] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:52 2022] GET /compute/v2.1/servers/5004c65f-d6e8-4a09-8ba3-c8f40fd09fb2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:04:52.796629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0ee0be26-4590-4ed0-945b-48e23136b57c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:52.797161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0ee0be26-4590-4ed0-945b-48e23136b57c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:52.813973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0ee0be26-4590-4ed0-945b-48e23136b57c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.816913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0ee0be26-4590-4ed0-945b-48e23136b57c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.820516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0ee0be26-4590-4ed0-945b-48e23136b57c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:52.823398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0ee0be26-4590-4ed0-945b-48e23136b57c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:52.872967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0ee0be26-4590-4ed0-945b-48e23136b57c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:04:52.990679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5c49a1c2-7b1c-4caa-8444-0aeffcc1e313 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:53.005511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5c49a1c2-7b1c-4caa-8444-0aeffcc1e313 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:53.012593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5c49a1c2-7b1c-4caa-8444-0aeffcc1e313 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:53.014480 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5c49a1c2-7b1c-4caa-8444-0aeffcc1e313 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.393213 Mar 05 21:04:53.026870 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2010/4052] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:52 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:53.043265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-59d53103-1d78-4dd9-b65f-be709616e784 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:53.044614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-59d53103-1d78-4dd9-b65f-be709616e784 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:53.049042 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0ee0be26-4590-4ed0-945b-48e23136b57c tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 204 len: 0 microversion: 2.1 time: 0.267996 Mar 05 21:04:53.052976 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2043/4053] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:04:52 2022] DELETE /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:04:53.059905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-59d53103-1d78-4dd9-b65f-be709616e784 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:53.060371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-59d53103-1d78-4dd9-b65f-be709616e784 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:53.061160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-59d53103-1d78-4dd9-b65f-be709616e784 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:53.063025 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8baa341d-d00e-439e-aa06-1cbcb9a97a77 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:53.064660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8baa341d-d00e-439e-aa06-1cbcb9a97a77 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:53.068833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-59d53103-1d78-4dd9-b65f-be709616e784 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:53.074195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8baa341d-d00e-439e-aa06-1cbcb9a97a77 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:53.074666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8baa341d-d00e-439e-aa06-1cbcb9a97a77 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:53.076760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8baa341d-d00e-439e-aa06-1cbcb9a97a77 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:53.077359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8baa341d-d00e-439e-aa06-1cbcb9a97a77 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:53.362844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-59d53103-1d78-4dd9-b65f-be709616e784 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:53.377407 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-59d53103-1d78-4dd9-b65f-be709616e784 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.348818 Mar 05 21:04:53.379707 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2011/4054] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:53 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:53.433016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8baa341d-d00e-439e-aa06-1cbcb9a97a77 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:53.442096 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8baa341d-d00e-439e-aa06-1cbcb9a97a77 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1478 microversion: 2.1 time: 0.383701 Mar 05 21:04:53.442716 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2044/4055] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:53 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1478 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:53.734349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-28bfc7db-107f-446b-a575-59d094fecb23 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:53.735090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-28bfc7db-107f-446b-a575-59d094fecb23 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:53.741723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28bfc7db-107f-446b-a575-59d094fecb23 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:53.742192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28bfc7db-107f-446b-a575-59d094fecb23 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:53.743018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28bfc7db-107f-446b-a575-59d094fecb23 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:53.743786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-28bfc7db-107f-446b-a575-59d094fecb23 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:54.036753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b00b89bb-839c-48ef-95c5-60808a168640 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:54.037459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b00b89bb-839c-48ef-95c5-60808a168640 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:54.049575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b00b89bb-839c-48ef-95c5-60808a168640 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:54.050335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b00b89bb-839c-48ef-95c5-60808a168640 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:54.054246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b00b89bb-839c-48ef-95c5-60808a168640 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:54.064161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b00b89bb-839c-48ef-95c5-60808a168640 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:54.101916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-28bfc7db-107f-446b-a575-59d094fecb23 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:54.110978 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-28bfc7db-107f-446b-a575-59d094fecb23 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1315 microversion: 2.1 time: 0.380155 Mar 05 21:04:54.126649 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2012/4056] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:53 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:54.328710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b00b89bb-839c-48ef-95c5-60808a168640 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:54.343793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b00b89bb-839c-48ef-95c5-60808a168640 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:54.345638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b00b89bb-839c-48ef-95c5-60808a168640 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:54.347224 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b00b89bb-839c-48ef-95c5-60808a168640 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.317061 Mar 05 21:04:54.359926 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2045/4057] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:54 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:04:54.396620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f1e36f40-16c9-40e6-954e-2f93a2346cbb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:54.397829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f1e36f40-16c9-40e6-954e-2f93a2346cbb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:54.406905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1e36f40-16c9-40e6-954e-2f93a2346cbb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:54.407617 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1e36f40-16c9-40e6-954e-2f93a2346cbb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:54.408625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1e36f40-16c9-40e6-954e-2f93a2346cbb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:54.409994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1e36f40-16c9-40e6-954e-2f93a2346cbb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:54.460046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-16b55bc6-6f1d-40a7-95ea-c44ae2da3551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:54.460970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-16b55bc6-6f1d-40a7-95ea-c44ae2da3551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:54.468642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16b55bc6-6f1d-40a7-95ea-c44ae2da3551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:54.469389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16b55bc6-6f1d-40a7-95ea-c44ae2da3551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:54.470404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16b55bc6-6f1d-40a7-95ea-c44ae2da3551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:54.470873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16b55bc6-6f1d-40a7-95ea-c44ae2da3551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:54.672304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-16b55bc6-6f1d-40a7-95ea-c44ae2da3551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:54.680295 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-16b55bc6-6f1d-40a7-95ea-c44ae2da3551 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1478 microversion: 2.1 time: 0.224005 Mar 05 21:04:54.680876 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2046/4058] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:54 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1478 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:04:54.764318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f1e36f40-16c9-40e6-954e-2f93a2346cbb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:54.775617 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f1e36f40-16c9-40e6-954e-2f93a2346cbb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.382911 Mar 05 21:04:54.776328 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2013/4059] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:54 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:55.128657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b3b542f6-893a-4975-aa60-f2f06b4051cd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:55.129287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b3b542f6-893a-4975-aa60-f2f06b4051cd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:55.139046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3b542f6-893a-4975-aa60-f2f06b4051cd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:55.140789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3b542f6-893a-4975-aa60-f2f06b4051cd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:55.147400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3b542f6-893a-4975-aa60-f2f06b4051cd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:55.148270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3b542f6-893a-4975-aa60-f2f06b4051cd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:55.203778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-2ce61046-e8aa-4fe8-a9ce-9e9572651f19 req-0594a986-e34c-4338-822c-9d91fd904bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583f8cd2-5dd5-4afb-973c-8029c917a627", "name": "network-vif-deleted", "tag": "13e30f1f-3efa-4b94-9aa8-e3fa05224e82"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:55.219862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-2ce61046-e8aa-4fe8-a9ce-9e9572651f19 req-0594a986-e34c-4338-822c-9d91fd904bda service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:55.223232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-2ce61046-e8aa-4fe8-a9ce-9e9572651f19 req-0594a986-e34c-4338-822c-9d91fd904bda service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:55.255835 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-2ce61046-e8aa-4fe8-a9ce-9e9572651f19 req-0594a986-e34c-4338-822c-9d91fd904bda service nova] Creating event network-vif-deleted:13e30f1f-3efa-4b94-9aa8-e3fa05224e82 for instance 583f8cd2-5dd5-4afb-973c-8029c917a627 on nch1-master-1 Mar 05 21:04:55.268761 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-2ce61046-e8aa-4fe8-a9ce-9e9572651f19 req-0594a986-e34c-4338-822c-9d91fd904bda service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071141 Mar 05 21:04:55.274575 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2014/4060] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:04:55.368861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-341ae14b-8138-4faf-a6de-0a92ba615fab tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:55.369596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-341ae14b-8138-4faf-a6de-0a92ba615fab tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:55.380099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-341ae14b-8138-4faf-a6de-0a92ba615fab tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:55.380985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-341ae14b-8138-4faf-a6de-0a92ba615fab tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:55.382457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-341ae14b-8138-4faf-a6de-0a92ba615fab tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:55.383171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-341ae14b-8138-4faf-a6de-0a92ba615fab tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:55.389810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b3b542f6-893a-4975-aa60-f2f06b4051cd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:55.398744 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b3b542f6-893a-4975-aa60-f2f06b4051cd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1315 microversion: 2.1 time: 0.274082 Mar 05 21:04:55.414054 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2047/4061] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:55 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:55.673809 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-341ae14b-8138-4faf-a6de-0a92ba615fab tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:55.685500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-341ae14b-8138-4faf-a6de-0a92ba615fab tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:55.698811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c5ad0eef-1c21-4096-811d-37a3cc5e2f67 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:55.699839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c5ad0eef-1c21-4096-811d-37a3cc5e2f67 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:55.707993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-341ae14b-8138-4faf-a6de-0a92ba615fab tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:55.709945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5ad0eef-1c21-4096-811d-37a3cc5e2f67 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:55.710410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5ad0eef-1c21-4096-811d-37a3cc5e2f67 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:55.713039 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-341ae14b-8138-4faf-a6de-0a92ba615fab tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.349699 Mar 05 21:04:55.714110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5ad0eef-1c21-4096-811d-37a3cc5e2f67 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:55.714482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5ad0eef-1c21-4096-811d-37a3cc5e2f67 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:55.717705 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2015/4062] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:55 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:04:55.754980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5ad0eef-1c21-4096-811d-37a3cc5e2f67 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:55.755749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5ad0eef-1c21-4096-811d-37a3cc5e2f67 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:55.756401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-c5ad0eef-1c21-4096-811d-37a3cc5e2f67 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lazy-loading 'fault' on Instance uuid 583f8cd2-5dd5-4afb-973c-8029c917a627 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:04:55.796146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6054bf2-5077-4386-9050-87a97b38e17e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:55.797171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c6054bf2-5077-4386-9050-87a97b38e17e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:55.805999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6054bf2-5077-4386-9050-87a97b38e17e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:55.806582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6054bf2-5077-4386-9050-87a97b38e17e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:55.807517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6054bf2-5077-4386-9050-87a97b38e17e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:55.808077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6054bf2-5077-4386-9050-87a97b38e17e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:55.824349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c5ad0eef-1c21-4096-811d-37a3cc5e2f67 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfbceb7c8c104af89e7d21ba411e32a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180462533c264596b5f243c2915b027c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:55.833544 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c5ad0eef-1c21-4096-811d-37a3cc5e2f67 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 200 len: 1282 microversion: 2.1 time: 0.139660 Mar 05 21:04:55.835565 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2048/4063] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:55 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 1282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:56.010119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c6054bf2-5077-4386-9050-87a97b38e17e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:56.026409 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c6054bf2-5077-4386-9050-87a97b38e17e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.234449 Mar 05 21:04:56.035806 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2016/4064] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:55 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:56.148225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-1bfd6c75-0475-4ba1-8e2a-931432b3ee88 req-3018b187-f2e2-404c-b1fe-71e0f48154ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b396188c-9bd6-472d-ae9d-86ea8b66a01c", "name": "network-vif-plugged", "status": "completed", "tag": "67768743-b786-49b6-9794-7c55e5d612f7"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:56.158101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1bfd6c75-0475-4ba1-8e2a-931432b3ee88 req-3018b187-f2e2-404c-b1fe-71e0f48154ce service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:56.158562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1bfd6c75-0475-4ba1-8e2a-931432b3ee88 req-3018b187-f2e2-404c-b1fe-71e0f48154ce service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:56.177972 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-1bfd6c75-0475-4ba1-8e2a-931432b3ee88 req-3018b187-f2e2-404c-b1fe-71e0f48154ce service nova] Creating event network-vif-plugged:67768743-b786-49b6-9794-7c55e5d612f7 for instance b396188c-9bd6-472d-ae9d-86ea8b66a01c on nch2-master-1 Mar 05 21:04:56.183866 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-1bfd6c75-0475-4ba1-8e2a-931432b3ee88 req-3018b187-f2e2-404c-b1fe-71e0f48154ce service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040206 Mar 05 21:04:56.184740 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2049/4065] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:04:56.416058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9981ceb4-cbea-4758-a13a-ccf39ceb1fec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:56.416690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9981ceb4-cbea-4758-a13a-ccf39ceb1fec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:56.422828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9981ceb4-cbea-4758-a13a-ccf39ceb1fec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:56.423289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9981ceb4-cbea-4758-a13a-ccf39ceb1fec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:56.424117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9981ceb4-cbea-4758-a13a-ccf39ceb1fec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:56.424556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9981ceb4-cbea-4758-a13a-ccf39ceb1fec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:56.621172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9981ceb4-cbea-4758-a13a-ccf39ceb1fec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:56.628636 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9981ceb4-cbea-4758-a13a-ccf39ceb1fec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1315 microversion: 2.1 time: 0.217049 Mar 05 21:04:56.629229 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2017/4066] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:56 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:56.740795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bae70a0f-2ddb-4d87-ae2f-e847b1865950 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:56.741540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bae70a0f-2ddb-4d87-ae2f-e847b1865950 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:56.748538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bae70a0f-2ddb-4d87-ae2f-e847b1865950 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:56.749004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bae70a0f-2ddb-4d87-ae2f-e847b1865950 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:56.749793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bae70a0f-2ddb-4d87-ae2f-e847b1865950 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:56.750243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bae70a0f-2ddb-4d87-ae2f-e847b1865950 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:56.850521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e775850e-51fb-43ea-98fe-06580bbdaad7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:56.851174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e775850e-51fb-43ea-98fe-06580bbdaad7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] [instance: 583f8cd2-5dd5-4afb-973c-8029c917a627] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:56.857786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e775850e-51fb-43ea-98fe-06580bbdaad7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:56.858248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e775850e-51fb-43ea-98fe-06580bbdaad7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:56.859036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e775850e-51fb-43ea-98fe-06580bbdaad7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:56.859480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e775850e-51fb-43ea-98fe-06580bbdaad7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:56.873797 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-e775850e-51fb-43ea-98fe-06580bbdaad7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] HTTP exception thrown: Instance 583f8cd2-5dd5-4afb-973c-8029c917a627 could not be found. Mar 05 21:04:56.874416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e775850e-51fb-43ea-98fe-06580bbdaad7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] Returning 404 to user: Instance 583f8cd2-5dd5-4afb-973c-8029c917a627 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:04:56.875264 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e775850e-51fb-43ea-98fe-06580bbdaad7 tempest-ServersTestJSON-395353542 tempest-ServersTestJSON-395353542-project] 10.222.0.15 "GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627" status: 404 len: 111 microversion: 2.1 time: 0.028839 Mar 05 21:04:56.878811 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2018/4067] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:56 2022] GET /compute/v2.1/servers/583f8cd2-5dd5-4afb-973c-8029c917a627 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:04:57.048572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1b8d5f18-c843-4a5b-a007-4733d14add34 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:57.049217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1b8d5f18-c843-4a5b-a007-4733d14add34 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:57.066702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bae70a0f-2ddb-4d87-ae2f-e847b1865950 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:57.078598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b8d5f18-c843-4a5b-a007-4733d14add34 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:57.079103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b8d5f18-c843-4a5b-a007-4733d14add34 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:57.080032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b8d5f18-c843-4a5b-a007-4733d14add34 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:57.081026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bae70a0f-2ddb-4d87-ae2f-e847b1865950 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:57.083135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bae70a0f-2ddb-4d87-ae2f-e847b1865950 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:57.083541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b8d5f18-c843-4a5b-a007-4733d14add34 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:57.085099 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bae70a0f-2ddb-4d87-ae2f-e847b1865950 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.349262 Mar 05 21:04:57.098015 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2050/4068] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:56 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:04:57.646025 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e89ec07a-d896-4804-a990-74125fb00d6e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:57.647717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e89ec07a-d896-4804-a990-74125fb00d6e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:57.655182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e89ec07a-d896-4804-a990-74125fb00d6e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:57.656295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e89ec07a-d896-4804-a990-74125fb00d6e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:57.657736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e89ec07a-d896-4804-a990-74125fb00d6e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:57.658454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e89ec07a-d896-4804-a990-74125fb00d6e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:57.743195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1b8d5f18-c843-4a5b-a007-4733d14add34 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:57.763924 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1b8d5f18-c843-4a5b-a007-4733d14add34 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.724155 Mar 05 21:04:57.764968 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2019/4069] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:57 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:58.001265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e89ec07a-d896-4804-a990-74125fb00d6e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:58.017346 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e89ec07a-d896-4804-a990-74125fb00d6e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1501 microversion: 2.1 time: 0.375062 Mar 05 21:04:58.018640 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2051/4070] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:57 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1501 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:04:58.034747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bfd7ba6d-03df-44b1-a8ec-73013dafbc59 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:04:58.041954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfd7ba6d-03df-44b1-a8ec-73013dafbc59 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:58.042632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfd7ba6d-03df-44b1-a8ec-73013dafbc59 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:58.066954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bfd7ba6d-03df-44b1-a8ec-73013dafbc59 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Going to try to stop instance {{(pid=141478) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 05 21:04:58.112590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-394e9c6e-825e-4f00-adeb-39a074357345 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:58.115299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-394e9c6e-825e-4f00-adeb-39a074357345 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:58.131579 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bfd7ba6d-03df-44b1-a8ec-73013dafbc59 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c/action" status: 202 len: 0 microversion: 2.1 time: 0.100222 Mar 05 21:04:58.132692 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2020/4071] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:04:58 2022] POST /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:04:58.132897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-394e9c6e-825e-4f00-adeb-39a074357345 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:58.135130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-394e9c6e-825e-4f00-adeb-39a074357345 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:58.137373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-394e9c6e-825e-4f00-adeb-39a074357345 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:58.138013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-394e9c6e-825e-4f00-adeb-39a074357345 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:58.152476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c30b7bc2-41f1-4765-abb7-8892bff045c7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:58.153333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c30b7bc2-41f1-4765-abb7-8892bff045c7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:58.160775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c30b7bc2-41f1-4765-abb7-8892bff045c7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:58.161663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c30b7bc2-41f1-4765-abb7-8892bff045c7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:58.162770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c30b7bc2-41f1-4765-abb7-8892bff045c7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:58.163551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c30b7bc2-41f1-4765-abb7-8892bff045c7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:58.433706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c30b7bc2-41f1-4765-abb7-8892bff045c7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:58.446645 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c30b7bc2-41f1-4765-abb7-8892bff045c7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.296100 Mar 05 21:04:58.447645 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2021/4072] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:58 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:58.532320 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-394e9c6e-825e-4f00-adeb-39a074357345 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:58.546687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-394e9c6e-825e-4f00-adeb-39a074357345 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:58.549921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-394e9c6e-825e-4f00-adeb-39a074357345 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:58.551421 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-394e9c6e-825e-4f00-adeb-39a074357345 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.448915 Mar 05 21:04:58.552336 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2052/4073] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:58 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:04:58.782532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-930d567c-d762-49bc-b8b9-385dfca86026 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:58.783466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-930d567c-d762-49bc-b8b9-385dfca86026 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:58.795151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-930d567c-d762-49bc-b8b9-385dfca86026 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:58.795611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-930d567c-d762-49bc-b8b9-385dfca86026 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:58.796447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-930d567c-d762-49bc-b8b9-385dfca86026 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:58.796899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-930d567c-d762-49bc-b8b9-385dfca86026 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:58.995269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-930d567c-d762-49bc-b8b9-385dfca86026 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:59.005753 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-930d567c-d762-49bc-b8b9-385dfca86026 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.227508 Mar 05 21:04:59.007142 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2022/4074] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:58 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:04:59.466615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2e7f3939-0403-4d4a-8c8f-e12720f4ca37 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:59.467447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2e7f3939-0403-4d4a-8c8f-e12720f4ca37 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:59.486810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e7f3939-0403-4d4a-8c8f-e12720f4ca37 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:59.487458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e7f3939-0403-4d4a-8c8f-e12720f4ca37 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:59.489032 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e7f3939-0403-4d4a-8c8f-e12720f4ca37 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:59.489487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e7f3939-0403-4d4a-8c8f-e12720f4ca37 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:59.571308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-20797d66-7a84-4143-893c-cedf65fea911 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:04:59.572734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-20797d66-7a84-4143-893c-cedf65fea911 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:04:59.591519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20797d66-7a84-4143-893c-cedf65fea911 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:59.591991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20797d66-7a84-4143-893c-cedf65fea911 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:59.592771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20797d66-7a84-4143-893c-cedf65fea911 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:04:59.593220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20797d66-7a84-4143-893c-cedf65fea911 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:04:59.752539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2e7f3939-0403-4d4a-8c8f-e12720f4ca37 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:04:59.761935 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2e7f3939-0403-4d4a-8c8f-e12720f4ca37 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.301533 Mar 05 21:04:59.763730 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2053/4075] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:04:59 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:00.025140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1b805b03-6d80-4753-8e79-1e8a4dd5ad3a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:00.026893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1b805b03-6d80-4753-8e79-1e8a4dd5ad3a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:00.036278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1b805b03-6d80-4753-8e79-1e8a4dd5ad3a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:00.037485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1b805b03-6d80-4753-8e79-1e8a4dd5ad3a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:00.038856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1b805b03-6d80-4753-8e79-1e8a4dd5ad3a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:00.040275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1b805b03-6d80-4753-8e79-1e8a4dd5ad3a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:00.077852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-20797d66-7a84-4143-893c-cedf65fea911 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:00.091814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-20797d66-7a84-4143-893c-cedf65fea911 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:00.095803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-20797d66-7a84-4143-893c-cedf65fea911 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:00.100217 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-20797d66-7a84-4143-893c-cedf65fea911 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.533629 Mar 05 21:05:00.101428 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2023/4076] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:04:59 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:05:00.205566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1b805b03-6d80-4753-8e79-1e8a4dd5ad3a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:00.213924 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1b805b03-6d80-4753-8e79-1e8a4dd5ad3a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.194297 Mar 05 21:05:00.224043 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2054/4077] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:00 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:00.779912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7f4be2bc-2806-4e51-80fe-99cdeb35d84d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:00.781270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7f4be2bc-2806-4e51-80fe-99cdeb35d84d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:00.790280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f4be2bc-2806-4e51-80fe-99cdeb35d84d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:00.791292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f4be2bc-2806-4e51-80fe-99cdeb35d84d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:00.792708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f4be2bc-2806-4e51-80fe-99cdeb35d84d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:00.793388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f4be2bc-2806-4e51-80fe-99cdeb35d84d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:01.103819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7f4be2bc-2806-4e51-80fe-99cdeb35d84d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:01.113138 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7f4be2bc-2806-4e51-80fe-99cdeb35d84d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.338199 Mar 05 21:05:01.121771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-accd8a08-9e8d-4587-a968-be65bb32326f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:01.123002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-accd8a08-9e8d-4587-a968-be65bb32326f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:01.135849 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2024/4078] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:00 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:01.142368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-accd8a08-9e8d-4587-a968-be65bb32326f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:01.143379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-accd8a08-9e8d-4587-a968-be65bb32326f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:01.144438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-accd8a08-9e8d-4587-a968-be65bb32326f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:01.145117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-accd8a08-9e8d-4587-a968-be65bb32326f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:01.232497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cec5d836-605a-46f6-a473-09a458895067 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:01.233114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cec5d836-605a-46f6-a473-09a458895067 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:01.244456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cec5d836-605a-46f6-a473-09a458895067 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:01.244976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cec5d836-605a-46f6-a473-09a458895067 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:01.245926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cec5d836-605a-46f6-a473-09a458895067 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:01.246758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cec5d836-605a-46f6-a473-09a458895067 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:01.499708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-accd8a08-9e8d-4587-a968-be65bb32326f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:01.510428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-accd8a08-9e8d-4587-a968-be65bb32326f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:01.512272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-accd8a08-9e8d-4587-a968-be65bb32326f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:01.513618 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-accd8a08-9e8d-4587-a968-be65bb32326f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.398818 Mar 05 21:05:01.521919 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2055/4079] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:01 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:05:01.524914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-accd8a08-9e8d-4587-a968-be65bb32326f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:01.526830 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-accd8a08-9e8d-4587-a968-be65bb32326f tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003094 Mar 05 21:05:01.527573 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2056/4080] 10.222.0.15 () {56 vars in 885 bytes} [Sat Mar 5 21:05:01 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 05 21:05:01.532957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cec5d836-605a-46f6-a473-09a458895067 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:01.541823 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cec5d836-605a-46f6-a473-09a458895067 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.314877 Mar 05 21:05:01.553617 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2025/4081] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:01 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:02.153440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2e37c2cb-0e89-4ef0-8b00-3797e411ac38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:02.154072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2e37c2cb-0e89-4ef0-8b00-3797e411ac38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:02.162084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e37c2cb-0e89-4ef0-8b00-3797e411ac38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:02.162554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e37c2cb-0e89-4ef0-8b00-3797e411ac38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:02.163528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e37c2cb-0e89-4ef0-8b00-3797e411ac38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:02.163964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e37c2cb-0e89-4ef0-8b00-3797e411ac38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:02.378330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2e37c2cb-0e89-4ef0-8b00-3797e411ac38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:02.386915 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2e37c2cb-0e89-4ef0-8b00-3797e411ac38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.238362 Mar 05 21:05:02.388148 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2057/4082] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:02 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:02.533487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1d6082d1-a9d8-4e19-be53-516ed6999e3d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:02.534871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1d6082d1-a9d8-4e19-be53-516ed6999e3d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:02.548723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d6082d1-a9d8-4e19-be53-516ed6999e3d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:02.549861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d6082d1-a9d8-4e19-be53-516ed6999e3d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:02.560822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d6082d1-a9d8-4e19-be53-516ed6999e3d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:02.564282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d6082d1-a9d8-4e19-be53-516ed6999e3d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:02.568078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cc89ed6b-417c-46c6-9b03-8df14c4494d6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:02.571572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cc89ed6b-417c-46c6-9b03-8df14c4494d6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:02.593085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc89ed6b-417c-46c6-9b03-8df14c4494d6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:02.594575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc89ed6b-417c-46c6-9b03-8df14c4494d6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:02.597359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc89ed6b-417c-46c6-9b03-8df14c4494d6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:02.598368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc89ed6b-417c-46c6-9b03-8df14c4494d6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:02.859039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1d6082d1-a9d8-4e19-be53-516ed6999e3d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:02.878115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1d6082d1-a9d8-4e19-be53-516ed6999e3d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:02.882091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1d6082d1-a9d8-4e19-be53-516ed6999e3d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:02.891748 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1d6082d1-a9d8-4e19-be53-516ed6999e3d tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.362306 Mar 05 21:05:02.895355 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2026/4083] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:02 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:05:03.028819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cc89ed6b-417c-46c6-9b03-8df14c4494d6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:03.045530 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cc89ed6b-417c-46c6-9b03-8df14c4494d6 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.487715 Mar 05 21:05:03.047076 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2058/4084] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:02 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:03.405220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c2f2146-a997-4e17-8f3a-4f4dbeabc6ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:03.406088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c2f2146-a997-4e17-8f3a-4f4dbeabc6ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:03.415101 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c2f2146-a997-4e17-8f3a-4f4dbeabc6ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:03.415580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c2f2146-a997-4e17-8f3a-4f4dbeabc6ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:03.416373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c2f2146-a997-4e17-8f3a-4f4dbeabc6ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:03.416973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c2f2146-a997-4e17-8f3a-4f4dbeabc6ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:03.614542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8c2f2146-a997-4e17-8f3a-4f4dbeabc6ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:03.623190 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8c2f2146-a997-4e17-8f3a-4f4dbeabc6ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.221899 Mar 05 21:05:03.633033 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2027/4085] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:03 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:03.915997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3a5547f4-acd2-46fc-9ffa-2394dddc8aed tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:03.916629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3a5547f4-acd2-46fc-9ffa-2394dddc8aed tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:03.923011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a5547f4-acd2-46fc-9ffa-2394dddc8aed tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:03.927902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a5547f4-acd2-46fc-9ffa-2394dddc8aed tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:03.929389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a5547f4-acd2-46fc-9ffa-2394dddc8aed tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:03.930436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a5547f4-acd2-46fc-9ffa-2394dddc8aed tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:04.064026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cee66a92-220f-4939-a8f9-2fcf0f51d912 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:04.064647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cee66a92-220f-4939-a8f9-2fcf0f51d912 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:04.072815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cee66a92-220f-4939-a8f9-2fcf0f51d912 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:04.076280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cee66a92-220f-4939-a8f9-2fcf0f51d912 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:04.076280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cee66a92-220f-4939-a8f9-2fcf0f51d912 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:04.076280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cee66a92-220f-4939-a8f9-2fcf0f51d912 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:04.258980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cee66a92-220f-4939-a8f9-2fcf0f51d912 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:04.268463 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cee66a92-220f-4939-a8f9-2fcf0f51d912 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.208262 Mar 05 21:05:04.279210 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2028/4086] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:04 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:04.297554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3a5547f4-acd2-46fc-9ffa-2394dddc8aed tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:04.307916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3a5547f4-acd2-46fc-9ffa-2394dddc8aed tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:04.309642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3a5547f4-acd2-46fc-9ffa-2394dddc8aed tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:04.311001 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3a5547f4-acd2-46fc-9ffa-2394dddc8aed tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.402223 Mar 05 21:05:04.311903 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2059/4087] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:03 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:05:04.643127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-366cdba7-3a58-477f-b683-58f3060f96ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:04.643127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-366cdba7-3a58-477f-b683-58f3060f96ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:04.656293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-366cdba7-3a58-477f-b683-58f3060f96ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:04.656747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-366cdba7-3a58-477f-b683-58f3060f96ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:04.657737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-366cdba7-3a58-477f-b683-58f3060f96ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:04.658359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-366cdba7-3a58-477f-b683-58f3060f96ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:04.847892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-1c947da7-d8c7-4d39-82f1-3e7a14c4fa28 req-e67941f1-fe43-4380-9f0d-6597fd8c3eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-plugged", "status": "completed", "tag": "14f8b7cc-1e4e-4f90-b62b-841a16e0f7ac"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:04.869164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1c947da7-d8c7-4d39-82f1-3e7a14c4fa28 req-e67941f1-fe43-4380-9f0d-6597fd8c3eb7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:04.871181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1c947da7-d8c7-4d39-82f1-3e7a14c4fa28 req-e67941f1-fe43-4380-9f0d-6597fd8c3eb7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:04.884560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-366cdba7-3a58-477f-b683-58f3060f96ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:04.895605 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-366cdba7-3a58-477f-b683-58f3060f96ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.258485 Mar 05 21:05:04.898101 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2029/4088] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:04 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:04.923625 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-1c947da7-d8c7-4d39-82f1-3e7a14c4fa28 req-e67941f1-fe43-4380-9f0d-6597fd8c3eb7 service nova] Creating event network-vif-plugged:14f8b7cc-1e4e-4f90-b62b-841a16e0f7ac for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:05:04.937387 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-1c947da7-d8c7-4d39-82f1-3e7a14c4fa28 req-e67941f1-fe43-4380-9f0d-6597fd8c3eb7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095708 Mar 05 21:05:04.940705 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2060/4089] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:05:05.285661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-96ceca0d-74ad-463c-b7d7-78e8e0d813ef tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:05.286684 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-96ceca0d-74ad-463c-b7d7-78e8e0d813ef tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:05.293625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96ceca0d-74ad-463c-b7d7-78e8e0d813ef tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:05.294291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96ceca0d-74ad-463c-b7d7-78e8e0d813ef tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:05.295292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96ceca0d-74ad-463c-b7d7-78e8e0d813ef tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:05.295755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96ceca0d-74ad-463c-b7d7-78e8e0d813ef tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:05.331022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d64d04c4-3e70-4c13-9cbd-cfec29b88d9e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:05.332176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d64d04c4-3e70-4c13-9cbd-cfec29b88d9e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:05.342499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d64d04c4-3e70-4c13-9cbd-cfec29b88d9e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:05.342967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d64d04c4-3e70-4c13-9cbd-cfec29b88d9e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:05.343797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d64d04c4-3e70-4c13-9cbd-cfec29b88d9e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:05.344243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d64d04c4-3e70-4c13-9cbd-cfec29b88d9e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:05.553338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-96ceca0d-74ad-463c-b7d7-78e8e0d813ef tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:05.567706 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-96ceca0d-74ad-463c-b7d7-78e8e0d813ef tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.285778 Mar 05 21:05:05.568927 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2030/4090] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:05 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:05.664078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d64d04c4-3e70-4c13-9cbd-cfec29b88d9e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:05.676385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d64d04c4-3e70-4c13-9cbd-cfec29b88d9e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:05.679219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d64d04c4-3e70-4c13-9cbd-cfec29b88d9e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:05.681486 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d64d04c4-3e70-4c13-9cbd-cfec29b88d9e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.354826 Mar 05 21:05:05.694167 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2061/4091] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:05 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:05:05.922268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-56b1110e-e7c2-4f15-bcb6-c2273ab13978 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:05.923015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-56b1110e-e7c2-4f15-bcb6-c2273ab13978 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:05.932291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-56b1110e-e7c2-4f15-bcb6-c2273ab13978 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:05.932979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-56b1110e-e7c2-4f15-bcb6-c2273ab13978 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:05.934332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-56b1110e-e7c2-4f15-bcb6-c2273ab13978 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:05.934936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-56b1110e-e7c2-4f15-bcb6-c2273ab13978 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:06.084928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-56b1110e-e7c2-4f15-bcb6-c2273ab13978 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:06.093618 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-56b1110e-e7c2-4f15-bcb6-c2273ab13978 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.176735 Mar 05 21:05:06.094306 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2031/4092] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:05 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:06.589670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fbab949d-e3e7-42af-92c6-f38ac2d1bd5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:06.591172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fbab949d-e3e7-42af-92c6-f38ac2d1bd5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:06.598220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbab949d-e3e7-42af-92c6-f38ac2d1bd5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:06.598692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbab949d-e3e7-42af-92c6-f38ac2d1bd5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:06.599491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbab949d-e3e7-42af-92c6-f38ac2d1bd5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:06.599974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbab949d-e3e7-42af-92c6-f38ac2d1bd5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:06.700782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d810f3d8-0e6c-4ee6-9c4a-f56810225a90 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:06.701512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d810f3d8-0e6c-4ee6-9c4a-f56810225a90 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:06.709308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d810f3d8-0e6c-4ee6-9c4a-f56810225a90 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:06.712383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d810f3d8-0e6c-4ee6-9c4a-f56810225a90 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:06.713314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d810f3d8-0e6c-4ee6-9c4a-f56810225a90 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:06.716219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d810f3d8-0e6c-4ee6-9c4a-f56810225a90 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:06.804844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fbab949d-e3e7-42af-92c6-f38ac2d1bd5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:06.816095 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fbab949d-e3e7-42af-92c6-f38ac2d1bd5a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.235053 Mar 05 21:05:06.817717 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2062/4093] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:06 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:06.962480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-df0dffe4-1930-4de5-b5d5-a23412c61c25 req-93642518-29ea-49f1-915f-3726851128d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-plugged", "status": "completed", "tag": "49b54a86-30ae-437a-8e99-4dbd8347c99d"}, {"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-plugged", "status": "completed", "tag": "6b1907e2-b9fc-4106-b4bf-9d467bd3635b"}, {"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-plugged", "status": "completed", "tag": "d03778ff-0dff-4440-ad01-ea9b00fcbdae"}, {"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-plugged", "status": "completed", "tag": "3580f7be-3101-44d5-a719-3970e25ebd07"}, {"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-plugged", "status": "completed", "tag": "2a2cb2ee-09d5-4c68-906a-931117ce5ea0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:06.973583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-df0dffe4-1930-4de5-b5d5-a23412c61c25 req-93642518-29ea-49f1-915f-3726851128d4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:06.974712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-df0dffe4-1930-4de5-b5d5-a23412c61c25 req-93642518-29ea-49f1-915f-3726851128d4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:06.989543 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-df0dffe4-1930-4de5-b5d5-a23412c61c25 req-93642518-29ea-49f1-915f-3726851128d4 service nova] Creating event network-vif-plugged:49b54a86-30ae-437a-8e99-4dbd8347c99d for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:05:06.990535 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-df0dffe4-1930-4de5-b5d5-a23412c61c25 req-93642518-29ea-49f1-915f-3726851128d4 service nova] Creating event network-vif-plugged:6b1907e2-b9fc-4106-b4bf-9d467bd3635b for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:05:06.991048 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-df0dffe4-1930-4de5-b5d5-a23412c61c25 req-93642518-29ea-49f1-915f-3726851128d4 service nova] Creating event network-vif-plugged:d03778ff-0dff-4440-ad01-ea9b00fcbdae for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:05:06.991780 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-df0dffe4-1930-4de5-b5d5-a23412c61c25 req-93642518-29ea-49f1-915f-3726851128d4 service nova] Creating event network-vif-plugged:3580f7be-3101-44d5-a719-3970e25ebd07 for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:05:06.992714 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-df0dffe4-1930-4de5-b5d5-a23412c61c25 req-93642518-29ea-49f1-915f-3726851128d4 service nova] Creating event network-vif-plugged:2a2cb2ee-09d5-4c68-906a-931117ce5ea0 for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:05:07.001499 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-df0dffe4-1930-4de5-b5d5-a23412c61c25 req-93642518-29ea-49f1-915f-3726851128d4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.044737 Mar 05 21:05:07.003399 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2063/4094] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:07.083241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d810f3d8-0e6c-4ee6-9c4a-f56810225a90 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:07.094016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d810f3d8-0e6c-4ee6-9c4a-f56810225a90 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:07.096485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d810f3d8-0e6c-4ee6-9c4a-f56810225a90 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:07.097760 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d810f3d8-0e6c-4ee6-9c4a-f56810225a90 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.400938 Mar 05 21:05:07.098644 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2032/4095] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:06 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:05:07.117039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2d881ce8-fe7a-4863-ab30-670a64e10064 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:07.118551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2d881ce8-fe7a-4863-ab30-670a64e10064 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:07.127699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d881ce8-fe7a-4863-ab30-670a64e10064 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:07.128605 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d881ce8-fe7a-4863-ab30-670a64e10064 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:07.130099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d881ce8-fe7a-4863-ab30-670a64e10064 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:07.131692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d881ce8-fe7a-4863-ab30-670a64e10064 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:07.312309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2d881ce8-fe7a-4863-ab30-670a64e10064 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:07.320068 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2d881ce8-fe7a-4863-ab30-670a64e10064 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.208472 Mar 05 21:05:07.320739 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2064/4096] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:07 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:07.833361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9a56e63e-5cfc-429c-8e75-ff2b3fc18492 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:07.834077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9a56e63e-5cfc-429c-8e75-ff2b3fc18492 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:07.840392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a56e63e-5cfc-429c-8e75-ff2b3fc18492 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:07.841084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a56e63e-5cfc-429c-8e75-ff2b3fc18492 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:07.841874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a56e63e-5cfc-429c-8e75-ff2b3fc18492 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:07.842500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a56e63e-5cfc-429c-8e75-ff2b3fc18492 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:08.091342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9a56e63e-5cfc-429c-8e75-ff2b3fc18492 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:08.100931 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9a56e63e-5cfc-429c-8e75-ff2b3fc18492 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.271495 Mar 05 21:05:08.102192 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2033/4097] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:07 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:08.116893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b7238413-76c6-49dc-a91a-5b8e4c12d6dd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:08.118179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b7238413-76c6-49dc-a91a-5b8e4c12d6dd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:08.125424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b7238413-76c6-49dc-a91a-5b8e4c12d6dd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:08.125938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b7238413-76c6-49dc-a91a-5b8e4c12d6dd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:08.126764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b7238413-76c6-49dc-a91a-5b8e4c12d6dd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:08.127288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b7238413-76c6-49dc-a91a-5b8e4c12d6dd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:08.334238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b7238413-76c6-49dc-a91a-5b8e4c12d6dd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:08.338035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4db3df64-d4c0-4ea6-b500-82e14f576b04 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:08.338890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4db3df64-d4c0-4ea6-b500-82e14f576b04 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:08.346391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4db3df64-d4c0-4ea6-b500-82e14f576b04 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:08.347037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4db3df64-d4c0-4ea6-b500-82e14f576b04 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:08.347203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b7238413-76c6-49dc-a91a-5b8e4c12d6dd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:08.348371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4db3df64-d4c0-4ea6-b500-82e14f576b04 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:08.348745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b7238413-76c6-49dc-a91a-5b8e4c12d6dd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:08.349061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4db3df64-d4c0-4ea6-b500-82e14f576b04 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:08.350669 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b7238413-76c6-49dc-a91a-5b8e4c12d6dd tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.237651 Mar 05 21:05:08.351425 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2065/4098] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:08 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:05:08.598114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4db3df64-d4c0-4ea6-b500-82e14f576b04 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:08.612216 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4db3df64-d4c0-4ea6-b500-82e14f576b04 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.278725 Mar 05 21:05:08.613489 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2034/4099] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:08 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:09.025811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-1efb2668-bfd5-4b95-aa7b-11b7e6566c42 req-8f7d0e13-1dd4-45f6-b081-3128357219c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-plugged", "status": "completed", "tag": "48f2f3bb-2642-4a75-8eb1-b1d8812cc628"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:09.053022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1efb2668-bfd5-4b95-aa7b-11b7e6566c42 req-8f7d0e13-1dd4-45f6-b081-3128357219c3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:09.054247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1efb2668-bfd5-4b95-aa7b-11b7e6566c42 req-8f7d0e13-1dd4-45f6-b081-3128357219c3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:09.073024 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-1efb2668-bfd5-4b95-aa7b-11b7e6566c42 req-8f7d0e13-1dd4-45f6-b081-3128357219c3 service nova] Creating event network-vif-plugged:48f2f3bb-2642-4a75-8eb1-b1d8812cc628 for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:05:09.080806 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-1efb2668-bfd5-4b95-aa7b-11b7e6566c42 req-8f7d0e13-1dd4-45f6-b081-3128357219c3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060652 Mar 05 21:05:09.082254 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2066/4100] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:05:09.119808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d76afbd8-b761-43b9-94e4-a8ff8d616d4a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:09.125855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d76afbd8-b761-43b9-94e4-a8ff8d616d4a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:09.145947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d76afbd8-b761-43b9-94e4-a8ff8d616d4a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:09.146848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d76afbd8-b761-43b9-94e4-a8ff8d616d4a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:09.148995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d76afbd8-b761-43b9-94e4-a8ff8d616d4a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:09.156588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d76afbd8-b761-43b9-94e4-a8ff8d616d4a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:09.372261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2d01971d-a78a-4552-8ec8-2442346862b6 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:09.372693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2d01971d-a78a-4552-8ec8-2442346862b6 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:09.378756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d01971d-a78a-4552-8ec8-2442346862b6 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:09.379301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d01971d-a78a-4552-8ec8-2442346862b6 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:09.380289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d01971d-a78a-4552-8ec8-2442346862b6 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:09.380532 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d01971d-a78a-4552-8ec8-2442346862b6 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:09.389676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d76afbd8-b761-43b9-94e4-a8ff8d616d4a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:09.431460 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d76afbd8-b761-43b9-94e4-a8ff8d616d4a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.315765 Mar 05 21:05:09.436187 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2035/4101] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:09 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:09.632099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3a741c03-2964-4303-899f-2fef7543fa32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:09.633508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3a741c03-2964-4303-899f-2fef7543fa32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:09.646293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a741c03-2964-4303-899f-2fef7543fa32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:09.647261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a741c03-2964-4303-899f-2fef7543fa32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:09.648101 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a741c03-2964-4303-899f-2fef7543fa32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:09.649201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a741c03-2964-4303-899f-2fef7543fa32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:09.763793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2d01971d-a78a-4552-8ec8-2442346862b6 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:09.783998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2d01971d-a78a-4552-8ec8-2442346862b6 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:09.788537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2d01971d-a78a-4552-8ec8-2442346862b6 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:09.790330 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2d01971d-a78a-4552-8ec8-2442346862b6 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.424236 Mar 05 21:05:09.790919 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2067/4102] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:09 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:05:09.829649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3a741c03-2964-4303-899f-2fef7543fa32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:09.839893 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3a741c03-2964-4303-899f-2fef7543fa32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.212844 Mar 05 21:05:09.840761 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2036/4103] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:09 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:10.453610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6f64e80d-a824-4d46-a822-bd00bbac1e5d tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:10.455049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6f64e80d-a824-4d46-a822-bd00bbac1e5d tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:10.463146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f64e80d-a824-4d46-a822-bd00bbac1e5d tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:10.463486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f64e80d-a824-4d46-a822-bd00bbac1e5d tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:10.464443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f64e80d-a824-4d46-a822-bd00bbac1e5d tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:10.464721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f64e80d-a824-4d46-a822-bd00bbac1e5d tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:10.786628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6f64e80d-a824-4d46-a822-bd00bbac1e5d tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:10.798206 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6f64e80d-a824-4d46-a822-bd00bbac1e5d tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.348526 Mar 05 21:05:10.798802 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2068/4104] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:10 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:10.809367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e2db1e3b-0ace-4743-8138-d47e87169d15 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:10.809978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e2db1e3b-0ace-4743-8138-d47e87169d15 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:10.828212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e2db1e3b-0ace-4743-8138-d47e87169d15 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:10.828675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e2db1e3b-0ace-4743-8138-d47e87169d15 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:10.829483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e2db1e3b-0ace-4743-8138-d47e87169d15 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:10.829956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e2db1e3b-0ace-4743-8138-d47e87169d15 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:10.859622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-64eb7475-eaff-418c-ae3e-01b7c76d3533 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:10.860329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-64eb7475-eaff-418c-ae3e-01b7c76d3533 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:10.868099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64eb7475-eaff-418c-ae3e-01b7c76d3533 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:10.869762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64eb7475-eaff-418c-ae3e-01b7c76d3533 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:10.872261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64eb7475-eaff-418c-ae3e-01b7c76d3533 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:10.872757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64eb7475-eaff-418c-ae3e-01b7c76d3533 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:11.073029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-64eb7475-eaff-418c-ae3e-01b7c76d3533 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:11.082377 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-64eb7475-eaff-418c-ae3e-01b7c76d3533 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.226550 Mar 05 21:05:11.095542 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2069/4105] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:10 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:11.143963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e2db1e3b-0ace-4743-8138-d47e87169d15 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:11.156341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e2db1e3b-0ace-4743-8138-d47e87169d15 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:11.158111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e2db1e3b-0ace-4743-8138-d47e87169d15 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:11.160518 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e2db1e3b-0ace-4743-8138-d47e87169d15 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1879 microversion: 2.42 time: 0.355412 Mar 05 21:05:11.161206 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2037/4106] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:10 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1879 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:05:11.816950 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-871e3fe9-d3df-48a8-8cee-29cf71b636ba tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:11.817584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-871e3fe9-d3df-48a8-8cee-29cf71b636ba tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:11.834463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-871e3fe9-d3df-48a8-8cee-29cf71b636ba tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:11.834972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-871e3fe9-d3df-48a8-8cee-29cf71b636ba tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:11.836590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-871e3fe9-d3df-48a8-8cee-29cf71b636ba tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:11.837328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-871e3fe9-d3df-48a8-8cee-29cf71b636ba tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:11.994232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-871e3fe9-d3df-48a8-8cee-29cf71b636ba tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:12.002851 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-871e3fe9-d3df-48a8-8cee-29cf71b636ba tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.190719 Mar 05 21:05:12.016439 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2070/4107] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:11 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:12.105254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-25359732-fb3d-4ce6-a303-630690c36537 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:12.106505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-25359732-fb3d-4ce6-a303-630690c36537 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:12.114048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25359732-fb3d-4ce6-a303-630690c36537 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:12.114656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25359732-fb3d-4ce6-a303-630690c36537 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:12.115443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25359732-fb3d-4ce6-a303-630690c36537 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:12.116077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25359732-fb3d-4ce6-a303-630690c36537 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:12.184397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-46f642ae-3b60-49d6-b65b-420ad3eaac0c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:12.204381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-46f642ae-3b60-49d6-b65b-420ad3eaac0c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:12.218454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46f642ae-3b60-49d6-b65b-420ad3eaac0c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:12.219207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46f642ae-3b60-49d6-b65b-420ad3eaac0c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:12.220222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46f642ae-3b60-49d6-b65b-420ad3eaac0c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:12.220826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46f642ae-3b60-49d6-b65b-420ad3eaac0c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:12.325362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-25359732-fb3d-4ce6-a303-630690c36537 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:12.339518 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-25359732-fb3d-4ce6-a303-630690c36537 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.243020 Mar 05 21:05:12.340994 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2038/4108] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:12 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:12.529312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-46f642ae-3b60-49d6-b65b-420ad3eaac0c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:12.540377 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-46f642ae-3b60-49d6-b65b-420ad3eaac0c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:12.542122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-46f642ae-3b60-49d6-b65b-420ad3eaac0c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:12.544506 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-46f642ae-3b60-49d6-b65b-420ad3eaac0c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 2835 microversion: 2.42 time: 0.369345 Mar 05 21:05:12.545107 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2071/4109] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:12 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 2835 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:05:12.563813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4e3b8ecd-c201-4221-9966-33f25c653cda tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:12.564341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4e3b8ecd-c201-4221-9966-33f25c653cda tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:12.570504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e3b8ecd-c201-4221-9966-33f25c653cda tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:12.571043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e3b8ecd-c201-4221-9966-33f25c653cda tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:12.572041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e3b8ecd-c201-4221-9966-33f25c653cda tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:12.572686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e3b8ecd-c201-4221-9966-33f25c653cda tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:12.718694 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4e3b8ecd-c201-4221-9966-33f25c653cda tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.158604 Mar 05 21:05:12.719126 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2039/4110] 10.222.0.15 () {60 vars in 1315 bytes} [Sat Mar 5 21:05:12 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7/os-interface => generated 1831 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:05:13.028820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fb9291cf-780c-4835-beee-33fd805c6baa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:13.029453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fb9291cf-780c-4835-beee-33fd805c6baa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:13.038056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb9291cf-780c-4835-beee-33fd805c6baa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:13.038712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb9291cf-780c-4835-beee-33fd805c6baa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:13.039956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb9291cf-780c-4835-beee-33fd805c6baa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:13.040622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb9291cf-780c-4835-beee-33fd805c6baa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:13.208206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fb9291cf-780c-4835-beee-33fd805c6baa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:13.239975 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fb9291cf-780c-4835-beee-33fd805c6baa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.199660 Mar 05 21:05:13.239975 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2072/4111] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:13 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:13.363872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-88534ad3-cfa0-4e3a-9710-38220cf06f8b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:13.364514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-88534ad3-cfa0-4e3a-9710-38220cf06f8b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:13.372774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-88534ad3-cfa0-4e3a-9710-38220cf06f8b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:13.379697 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-88534ad3-cfa0-4e3a-9710-38220cf06f8b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:13.380586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-88534ad3-cfa0-4e3a-9710-38220cf06f8b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:13.381045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-88534ad3-cfa0-4e3a-9710-38220cf06f8b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:13.467741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-976f8e93-885b-46fb-b8af-9320b03b6b68 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:13.468355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-976f8e93-885b-46fb-b8af-9320b03b6b68 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:13.479111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-976f8e93-885b-46fb-b8af-9320b03b6b68 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:13.480480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-976f8e93-885b-46fb-b8af-9320b03b6b68 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:13.481693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-976f8e93-885b-46fb-b8af-9320b03b6b68 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:13.484077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-976f8e93-885b-46fb-b8af-9320b03b6b68 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:13.542946 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-976f8e93-885b-46fb-b8af-9320b03b6b68 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/ips" status: 200 len: 145 microversion: 2.1 time: 0.079287 Mar 05 21:05:13.544571 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2073/4112] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 21:05:13 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/ips => generated 145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:13.750123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-88534ad3-cfa0-4e3a-9710-38220cf06f8b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:13.758238 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-88534ad3-cfa0-4e3a-9710-38220cf06f8b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.403674 Mar 05 21:05:13.759232 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2040/4113] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:13 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:14.247688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3c4e1050-34b7-475a-925c-023826b82116 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:14.255225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3c4e1050-34b7-475a-925c-023826b82116 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:14.286854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c4e1050-34b7-475a-925c-023826b82116 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:14.287319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c4e1050-34b7-475a-925c-023826b82116 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:14.288142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c4e1050-34b7-475a-925c-023826b82116 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:14.288587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c4e1050-34b7-475a-925c-023826b82116 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:14.468785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-76663945-75f6-4320-999d-e3ec77139b6e req-0e9310f9-e5fa-4976-ad57-4174bc7e2789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "tag": "2a2cb2ee-09d5-4c68-906a-931117ce5ea0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:14.481597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-76663945-75f6-4320-999d-e3ec77139b6e req-0e9310f9-e5fa-4976-ad57-4174bc7e2789 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:14.482681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-76663945-75f6-4320-999d-e3ec77139b6e req-0e9310f9-e5fa-4976-ad57-4174bc7e2789 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:14.506505 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-76663945-75f6-4320-999d-e3ec77139b6e req-0e9310f9-e5fa-4976-ad57-4174bc7e2789 service nova] Creating event network-changed:2a2cb2ee-09d5-4c68-906a-931117ce5ea0 for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:05:14.514547 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-76663945-75f6-4320-999d-e3ec77139b6e req-0e9310f9-e5fa-4976-ad57-4174bc7e2789 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.284997 Mar 05 21:05:14.515611 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2074/4114] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:14.534894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3c4e1050-34b7-475a-925c-023826b82116 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:14.546838 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3c4e1050-34b7-475a-925c-023826b82116 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.303174 Mar 05 21:05:14.550462 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2041/4115] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:14 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:14.781390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1cc35ee5-13f5-4858-bf14-7fce43a95f8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:14.783089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1cc35ee5-13f5-4858-bf14-7fce43a95f8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:14.795415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cc35ee5-13f5-4858-bf14-7fce43a95f8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:14.797045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cc35ee5-13f5-4858-bf14-7fce43a95f8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:14.798206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cc35ee5-13f5-4858-bf14-7fce43a95f8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:14.799208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cc35ee5-13f5-4858-bf14-7fce43a95f8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:15.016380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-20d1ebab-e73a-41c1-925c-852d1722dbe4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "709d15ba-e7de-47cb-b413-2d77e7440ddd"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:15.017508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-20d1ebab-e73a-41c1-925c-852d1722dbe4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:15.024483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20d1ebab-e73a-41c1-925c-852d1722dbe4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:15.025257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20d1ebab-e73a-41c1-925c-852d1722dbe4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:15.026263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20d1ebab-e73a-41c1-925c-852d1722dbe4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:15.026702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20d1ebab-e73a-41c1-925c-852d1722dbe4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:15.331468 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-20d1ebab-e73a-41c1-925c-852d1722dbe4 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "POST /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319001 Mar 05 21:05:15.333930 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2042/4116] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:05:15 2022] POST /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:05:15.524872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1cc35ee5-13f5-4858-bf14-7fce43a95f8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:15.534412 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1cc35ee5-13f5-4858-bf14-7fce43a95f8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.761395 Mar 05 21:05:15.538181 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2075/4117] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:14 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:15.569170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6eab0f6-660d-47f7-8f54-ea06da5eaccd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:15.570576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c6eab0f6-660d-47f7-8f54-ea06da5eaccd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:15.585117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6eab0f6-660d-47f7-8f54-ea06da5eaccd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:15.588254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6eab0f6-660d-47f7-8f54-ea06da5eaccd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:15.591329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6eab0f6-660d-47f7-8f54-ea06da5eaccd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:15.592588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6eab0f6-660d-47f7-8f54-ea06da5eaccd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:16.208969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c6eab0f6-660d-47f7-8f54-ea06da5eaccd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:16.221417 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c6eab0f6-660d-47f7-8f54-ea06da5eaccd tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1567 microversion: 2.1 time: 0.657933 Mar 05 21:05:16.223286 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2043/4118] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:15 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1567 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:16.558506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3de1e90c-b8cd-491b-8985-c4be37a91200 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:16.559815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3de1e90c-b8cd-491b-8985-c4be37a91200 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:16.575019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3de1e90c-b8cd-491b-8985-c4be37a91200 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:16.577364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3de1e90c-b8cd-491b-8985-c4be37a91200 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:16.579031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3de1e90c-b8cd-491b-8985-c4be37a91200 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:16.579496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3de1e90c-b8cd-491b-8985-c4be37a91200 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:16.774786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3de1e90c-b8cd-491b-8985-c4be37a91200 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:16.789707 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3de1e90c-b8cd-491b-8985-c4be37a91200 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.237057 Mar 05 21:05:16.791003 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2076/4119] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:16 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:17.240245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c95b8098-9088-4ee5-ad62-150ec658b9b0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:17.241599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c95b8098-9088-4ee5-ad62-150ec658b9b0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:17.250851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c95b8098-9088-4ee5-ad62-150ec658b9b0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:17.251941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c95b8098-9088-4ee5-ad62-150ec658b9b0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:17.252969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c95b8098-9088-4ee5-ad62-150ec658b9b0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:17.253889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c95b8098-9088-4ee5-ad62-150ec658b9b0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:17.636910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c95b8098-9088-4ee5-ad62-150ec658b9b0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:17.650771 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c95b8098-9088-4ee5-ad62-150ec658b9b0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1547 microversion: 2.1 time: 0.414592 Mar 05 21:05:17.652780 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2044/4120] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:17 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1547 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:17.678686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fcec5a38-e6c3-4ab0-95a5-5b929b78a9ea tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:17.680296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fcec5a38-e6c3-4ab0-95a5-5b929b78a9ea tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:17.692361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fcec5a38-e6c3-4ab0-95a5-5b929b78a9ea tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:17.692917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fcec5a38-e6c3-4ab0-95a5-5b929b78a9ea tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:17.693867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fcec5a38-e6c3-4ab0-95a5-5b929b78a9ea tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:17.695432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fcec5a38-e6c3-4ab0-95a5-5b929b78a9ea tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:17.808254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6be952d7-827c-4b76-ab2d-6e751d700003 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:17.809082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6be952d7-827c-4b76-ab2d-6e751d700003 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:17.811602 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-fcec5a38-e6c3-4ab0-95a5-5b929b78a9ea tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] HTTP exception thrown: Cannot 'detach_volume' instance b2d64ade-0446-474b-a3d4-454133f21972 while it is in vm_state rescued Mar 05 21:05:17.812536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fcec5a38-e6c3-4ab0-95a5-5b929b78a9ea tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Returning 409 to user: Cannot 'detach_volume' instance b2d64ade-0446-474b-a3d4-454133f21972 while it is in vm_state rescued {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:17.813673 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fcec5a38-e6c3-4ab0-95a5-5b929b78a9ea tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/os-volume_attachments/65350572-d864-493f-aaec-a23a7dfc2714" status: 409 len: 152 microversion: 2.1 time: 0.141526 Mar 05 21:05:17.814633 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2077/4121] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 21:05:17 2022] DELETE /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/os-volume_attachments/65350572-d864-493f-aaec-a23a7dfc2714 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 05 21:05:17.824797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6be952d7-827c-4b76-ab2d-6e751d700003 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:17.825192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6be952d7-827c-4b76-ab2d-6e751d700003 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:17.826078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6be952d7-827c-4b76-ab2d-6e751d700003 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:17.826537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6be952d7-827c-4b76-ab2d-6e751d700003 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:17.831465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a2e298e3-9535-4677-9e7b-d85dc5a5e72f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:17.832694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a2e298e3-9535-4677-9e7b-d85dc5a5e72f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:17.841718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2e298e3-9535-4677-9e7b-d85dc5a5e72f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:17.842625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2e298e3-9535-4677-9e7b-d85dc5a5e72f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:17.843754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2e298e3-9535-4677-9e7b-d85dc5a5e72f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:17.844455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2e298e3-9535-4677-9e7b-d85dc5a5e72f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:17.968855 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a2e298e3-9535-4677-9e7b-d85dc5a5e72f tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action" status: 202 len: 0 microversion: 2.1 time: 0.141972 Mar 05 21:05:17.971590 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2078/4122] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:17 2022] POST /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:05:17.980923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-647866e0-a011-44ba-835b-f7cc6ad2e50e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:17.981727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-647866e0-a011-44ba-835b-f7cc6ad2e50e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:17.991545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-647866e0-a011-44ba-835b-f7cc6ad2e50e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:17.992604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-647866e0-a011-44ba-835b-f7cc6ad2e50e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:17.993531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-647866e0-a011-44ba-835b-f7cc6ad2e50e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:17.994669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-647866e0-a011-44ba-835b-f7cc6ad2e50e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:18.064711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6be952d7-827c-4b76-ab2d-6e751d700003 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:18.072566 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6be952d7-827c-4b76-ab2d-6e751d700003 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.269402 Mar 05 21:05:18.073593 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2045/4123] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:17 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:18.292573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-647866e0-a011-44ba-835b-f7cc6ad2e50e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:18.305562 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-647866e0-a011-44ba-835b-f7cc6ad2e50e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1555 microversion: 2.1 time: 0.328355 Mar 05 21:05:18.307336 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2079/4124] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:17 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1555 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:18.646408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82f82072-d9ea-4158-8a7f-741342ffb390 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:18.647780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-82f82072-d9ea-4158-8a7f-741342ffb390 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:18.657172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82f82072-d9ea-4158-8a7f-741342ffb390 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:18.657821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82f82072-d9ea-4158-8a7f-741342ffb390 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:18.658913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82f82072-d9ea-4158-8a7f-741342ffb390 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:18.660040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82f82072-d9ea-4158-8a7f-741342ffb390 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:18.698572 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-82f82072-d9ea-4158-8a7f-741342ffb390 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056553 Mar 05 21:05:18.699492 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2046/4125] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:05:18 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:18.709839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4d7fcf2e-834e-4a56-88c6-c67144b21d46 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:18.710469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4d7fcf2e-834e-4a56-88c6-c67144b21d46 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:18.718057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d7fcf2e-834e-4a56-88c6-c67144b21d46 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:18.718666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d7fcf2e-834e-4a56-88c6-c67144b21d46 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:18.719447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d7fcf2e-834e-4a56-88c6-c67144b21d46 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:18.719917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d7fcf2e-834e-4a56-88c6-c67144b21d46 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:18.780358 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4d7fcf2e-834e-4a56-88c6-c67144b21d46 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments/709d15ba-e7de-47cb-b413-2d77e7440ddd" status: 200 len: 194 microversion: 2.1 time: 0.074329 Mar 05 21:05:18.781847 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2080/4126] 10.222.0.15 () {58 vars in 1412 bytes} [Sat Mar 5 21:05:18 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments/709d15ba-e7de-47cb-b413-2d77e7440ddd => generated 194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:19.092035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-148e2d27-0166-4c1c-aba7-68390cbfcb08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:19.093149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-148e2d27-0166-4c1c-aba7-68390cbfcb08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:19.105893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-148e2d27-0166-4c1c-aba7-68390cbfcb08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:19.106469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-148e2d27-0166-4c1c-aba7-68390cbfcb08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:19.108366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-148e2d27-0166-4c1c-aba7-68390cbfcb08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:19.109699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-148e2d27-0166-4c1c-aba7-68390cbfcb08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:19.324929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a9b48f57-bc82-49ae-82e0-3b9e870efc2a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:19.325698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a9b48f57-bc82-49ae-82e0-3b9e870efc2a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:19.343818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9b48f57-bc82-49ae-82e0-3b9e870efc2a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:19.345779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9b48f57-bc82-49ae-82e0-3b9e870efc2a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:19.347215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9b48f57-bc82-49ae-82e0-3b9e870efc2a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:19.355032 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9b48f57-bc82-49ae-82e0-3b9e870efc2a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:19.491587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-148e2d27-0166-4c1c-aba7-68390cbfcb08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:19.501222 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-148e2d27-0166-4c1c-aba7-68390cbfcb08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.415175 Mar 05 21:05:19.502138 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2047/4127] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:19 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:19.551281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a9b48f57-bc82-49ae-82e0-3b9e870efc2a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:19.560449 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a9b48f57-bc82-49ae-82e0-3b9e870efc2a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1555 microversion: 2.1 time: 0.239814 Mar 05 21:05:19.561044 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2081/4128] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:19 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1555 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:20.194743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6bde9d05-69a8-428a-8858-e2dc2a030bdc tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e06e2c79-85f3-45fe-82b7-e23e9817cca9"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:20.194743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6bde9d05-69a8-428a-8858-e2dc2a030bdc tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:20.198872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6bde9d05-69a8-428a-8858-e2dc2a030bdc tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:20.199467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6bde9d05-69a8-428a-8858-e2dc2a030bdc tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:20.200485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6bde9d05-69a8-428a-8858-e2dc2a030bdc tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:20.201571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6bde9d05-69a8-428a-8858-e2dc2a030bdc tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:20.520641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bb193b79-45dc-423f-9ce3-d7c48adb3750 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:20.521286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bb193b79-45dc-423f-9ce3-d7c48adb3750 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:20.529596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb193b79-45dc-423f-9ce3-d7c48adb3750 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:20.530329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb193b79-45dc-423f-9ce3-d7c48adb3750 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:20.531207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb193b79-45dc-423f-9ce3-d7c48adb3750 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:20.531926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb193b79-45dc-423f-9ce3-d7c48adb3750 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:20.547469 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6bde9d05-69a8-428a-8858-e2dc2a030bdc tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "POST /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367993 Mar 05 21:05:20.552861 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2048/4129] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:05:20 2022] POST /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:05:20.580762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-37c80810-1a63-47fe-aa58-4a358bcf9125 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:20.581936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-37c80810-1a63-47fe-aa58-4a358bcf9125 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:20.593247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-37c80810-1a63-47fe-aa58-4a358bcf9125 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:20.593992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-37c80810-1a63-47fe-aa58-4a358bcf9125 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:20.595049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-37c80810-1a63-47fe-aa58-4a358bcf9125 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:20.595939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-37c80810-1a63-47fe-aa58-4a358bcf9125 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:20.932317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb193b79-45dc-423f-9ce3-d7c48adb3750 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:20.947404 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bb193b79-45dc-423f-9ce3-d7c48adb3750 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.432961 Mar 05 21:05:20.948308 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2082/4130] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:20 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:20.986668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-37c80810-1a63-47fe-aa58-4a358bcf9125 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:21.003271 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-37c80810-1a63-47fe-aa58-4a358bcf9125 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1561 microversion: 2.1 time: 0.428395 Mar 05 21:05:21.004555 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2049/4131] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:20 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1561 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:21.096956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b809894d-1311-4ad9-8c60-bb5dfc85a966 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:21.097465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b809894d-1311-4ad9-8c60-bb5dfc85a966 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:21.104116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b809894d-1311-4ad9-8c60-bb5dfc85a966 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:21.105024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b809894d-1311-4ad9-8c60-bb5dfc85a966 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:21.106156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b809894d-1311-4ad9-8c60-bb5dfc85a966 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:21.106826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b809894d-1311-4ad9-8c60-bb5dfc85a966 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:21.233711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-b809894d-1311-4ad9-8c60-bb5dfc85a966 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lazy-loading 'services' on Instance uuid b2d64ade-0446-474b-a3d4-454133f21972 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:05:21.330697 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b809894d-1311-4ad9-8c60-bb5dfc85a966 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/os-volume_attachments/65350572-d864-493f-aaec-a23a7dfc2714" status: 202 len: 0 microversion: 2.1 time: 0.237167 Mar 05 21:05:21.331580 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2083/4132] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 21:05:21 2022] DELETE /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/os-volume_attachments/65350572-d864-493f-aaec-a23a7dfc2714 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:05:21.342255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-177f3371-403b-44a3-afa4-d571c3184081 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:21.344117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-177f3371-403b-44a3-afa4-d571c3184081 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:21.352847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-177f3371-403b-44a3-afa4-d571c3184081 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:21.353796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-177f3371-403b-44a3-afa4-d571c3184081 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:21.355467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-177f3371-403b-44a3-afa4-d571c3184081 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:21.356168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-177f3371-403b-44a3-afa4-d571c3184081 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:21.410699 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-177f3371-403b-44a3-afa4-d571c3184081 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073259 Mar 05 21:05:21.414902 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2050/4133] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:05:21 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:21.967577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-828f8d80-6a55-42bb-ba03-a1dd83ec39fa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:21.968339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-828f8d80-6a55-42bb-ba03-a1dd83ec39fa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:21.979963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-828f8d80-6a55-42bb-ba03-a1dd83ec39fa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:21.980738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-828f8d80-6a55-42bb-ba03-a1dd83ec39fa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:21.988779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-828f8d80-6a55-42bb-ba03-a1dd83ec39fa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:21.990777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-828f8d80-6a55-42bb-ba03-a1dd83ec39fa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:22.254101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-828f8d80-6a55-42bb-ba03-a1dd83ec39fa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:22.264899 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-828f8d80-6a55-42bb-ba03-a1dd83ec39fa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.303473 Mar 05 21:05:22.274843 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2084/4134] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:21 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:22.423350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eb5cab5b-65b4-47db-80a6-15b1a8b1b26e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:22.425018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eb5cab5b-65b4-47db-80a6-15b1a8b1b26e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:22.433596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb5cab5b-65b4-47db-80a6-15b1a8b1b26e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:22.434436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb5cab5b-65b4-47db-80a6-15b1a8b1b26e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:22.435394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb5cab5b-65b4-47db-80a6-15b1a8b1b26e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:22.436079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb5cab5b-65b4-47db-80a6-15b1a8b1b26e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:22.474116 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eb5cab5b-65b4-47db-80a6-15b1a8b1b26e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054920 Mar 05 21:05:22.475046 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2051/4135] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:05:22 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:05:22.541099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-42af096b-3ee8-4fe8-b586-c4adebd537c8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:22.542606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-42af096b-3ee8-4fe8-b586-c4adebd537c8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:22.549193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42af096b-3ee8-4fe8-b586-c4adebd537c8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:22.549933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42af096b-3ee8-4fe8-b586-c4adebd537c8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:22.550716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42af096b-3ee8-4fe8-b586-c4adebd537c8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:22.551332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42af096b-3ee8-4fe8-b586-c4adebd537c8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:22.577299 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-42af096b-3ee8-4fe8-b586-c4adebd537c8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] HTTP exception thrown: Cannot 'reboot' instance 08399756-b179-4541-ad3e-3c179e7d7514 while it is in vm_state rescued Mar 05 21:05:22.577994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-42af096b-3ee8-4fe8-b586-c4adebd537c8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Returning 409 to user: Cannot 'reboot' instance 08399756-b179-4541-ad3e-3c179e7d7514 while it is in vm_state rescued {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:22.578960 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-42af096b-3ee8-4fe8-b586-c4adebd537c8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514/action" status: 409 len: 145 microversion: 2.1 time: 0.043714 Mar 05 21:05:22.579602 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2085/4136] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:22 2022] POST /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514/action => generated 145 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:05:22.590973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e861082d-f60d-41f1-86b9-f69cc0d25e68 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:22.593028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e861082d-f60d-41f1-86b9-f69cc0d25e68 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:22.599130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e861082d-f60d-41f1-86b9-f69cc0d25e68 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:22.599563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e861082d-f60d-41f1-86b9-f69cc0d25e68 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:22.600381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e861082d-f60d-41f1-86b9-f69cc0d25e68 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:22.600858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e861082d-f60d-41f1-86b9-f69cc0d25e68 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:22.629061 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-e861082d-f60d-41f1-86b9-f69cc0d25e68 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] HTTP exception thrown: Cannot 'rebuild' instance 08399756-b179-4541-ad3e-3c179e7d7514 while it is in vm_state rescued Mar 05 21:05:22.629671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e861082d-f60d-41f1-86b9-f69cc0d25e68 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Returning 409 to user: Cannot 'rebuild' instance 08399756-b179-4541-ad3e-3c179e7d7514 while it is in vm_state rescued {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:22.630515 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e861082d-f60d-41f1-86b9-f69cc0d25e68 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "POST /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514/action" status: 409 len: 146 microversion: 2.1 time: 0.045447 Mar 05 21:05:22.631238 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2052/4137] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:22 2022] POST /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514/action => generated 146 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:05:23.283243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-89bfc553-0ebb-4ad3-a888-08ed0b878cbf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:23.284721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-89bfc553-0ebb-4ad3-a888-08ed0b878cbf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:23.292521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89bfc553-0ebb-4ad3-a888-08ed0b878cbf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:23.293093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89bfc553-0ebb-4ad3-a888-08ed0b878cbf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:23.294082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89bfc553-0ebb-4ad3-a888-08ed0b878cbf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:23.294640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89bfc553-0ebb-4ad3-a888-08ed0b878cbf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:23.508617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-89bfc553-0ebb-4ad3-a888-08ed0b878cbf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:23.517484 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-89bfc553-0ebb-4ad3-a888-08ed0b878cbf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.238872 Mar 05 21:05:23.520211 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2086/4138] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:23 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:24.042620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bcb4c810-2b4b-497f-ba8b-7b437d8ef4fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:24.044923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bcb4c810-2b4b-497f-ba8b-7b437d8ef4fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:24.072981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bcb4c810-2b4b-497f-ba8b-7b437d8ef4fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:24.073866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bcb4c810-2b4b-497f-ba8b-7b437d8ef4fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:24.075411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bcb4c810-2b4b-497f-ba8b-7b437d8ef4fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:24.075999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bcb4c810-2b4b-497f-ba8b-7b437d8ef4fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:24.115011 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bcb4c810-2b4b-497f-ba8b-7b437d8ef4fd tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.078660 Mar 05 21:05:24.116303 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2053/4139] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:05:24 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:24.264062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-41547a1f-462e-434f-b188-7c21ef37635a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:24.265591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-41547a1f-462e-434f-b188-7c21ef37635a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:24.274703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41547a1f-462e-434f-b188-7c21ef37635a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:24.276667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41547a1f-462e-434f-b188-7c21ef37635a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:24.277753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41547a1f-462e-434f-b188-7c21ef37635a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:24.277941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41547a1f-462e-434f-b188-7c21ef37635a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:24.312798 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-41547a1f-462e-434f-b188-7c21ef37635a tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments/709d15ba-e7de-47cb-b413-2d77e7440ddd" status: 200 len: 194 microversion: 2.1 time: 0.054874 Mar 05 21:05:24.314379 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2087/4140] 10.222.0.15 () {58 vars in 1412 bytes} [Sat Mar 5 21:05:24 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments/709d15ba-e7de-47cb-b413-2d77e7440ddd => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:24.324441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c443fc90-994f-4070-acfe-203e49ba6e03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:24.325059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c443fc90-994f-4070-acfe-203e49ba6e03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:24.333810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c443fc90-994f-4070-acfe-203e49ba6e03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:24.334272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c443fc90-994f-4070-acfe-203e49ba6e03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:24.335179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c443fc90-994f-4070-acfe-203e49ba6e03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:24.335701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c443fc90-994f-4070-acfe-203e49ba6e03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:24.438690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-c443fc90-994f-4070-acfe-203e49ba6e03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lazy-loading 'services' on Instance uuid bbf406b0-8c85-4126-ade0-797f76b7b3cf {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:05:24.537352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-acbb4994-b195-4bf4-a8a6-541f0c8beedb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:24.537971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-acbb4994-b195-4bf4-a8a6-541f0c8beedb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:24.545929 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c443fc90-994f-4070-acfe-203e49ba6e03 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments/709d15ba-e7de-47cb-b413-2d77e7440ddd" status: 202 len: 0 microversion: 2.1 time: 0.225980 Mar 05 21:05:24.547280 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2054/4141] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 21:05:24 2022] DELETE /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments/709d15ba-e7de-47cb-b413-2d77e7440ddd => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:05:24.557792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acbb4994-b195-4bf4-a8a6-541f0c8beedb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:24.560914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acbb4994-b195-4bf4-a8a6-541f0c8beedb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:24.562550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acbb4994-b195-4bf4-a8a6-541f0c8beedb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:24.564225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acbb4994-b195-4bf4-a8a6-541f0c8beedb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:24.893395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-acbb4994-b195-4bf4-a8a6-541f0c8beedb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:24.902778 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-acbb4994-b195-4bf4-a8a6-541f0c8beedb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.369580 Mar 05 21:05:24.912795 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2088/4142] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:24 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:25.024567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d57e29c8-0a2b-4146-9427-474f2a0c2ead tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:25.025180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d57e29c8-0a2b-4146-9427-474f2a0c2ead tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:25.032970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d57e29c8-0a2b-4146-9427-474f2a0c2ead tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:25.033462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d57e29c8-0a2b-4146-9427-474f2a0c2ead tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:25.034441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d57e29c8-0a2b-4146-9427-474f2a0c2ead tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:25.034972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d57e29c8-0a2b-4146-9427-474f2a0c2ead tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:25.064639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d57e29c8-0a2b-4146-9427-474f2a0c2ead tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:05:25.155341 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d57e29c8-0a2b-4146-9427-474f2a0c2ead tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "DELETE /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 204 len: 0 microversion: 2.1 time: 0.135484 Mar 05 21:05:25.156040 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2055/4143] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:05:25 2022] DELETE /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:05:25.166689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e4db6f8f-30b4-4d1f-8bf0-7fbc70987fae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:25.167463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e4db6f8f-30b4-4d1f-8bf0-7fbc70987fae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:25.186175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4db6f8f-30b4-4d1f-8bf0-7fbc70987fae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:25.187146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4db6f8f-30b4-4d1f-8bf0-7fbc70987fae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:25.191119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4db6f8f-30b4-4d1f-8bf0-7fbc70987fae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:25.191774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4db6f8f-30b4-4d1f-8bf0-7fbc70987fae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:25.438204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e4db6f8f-30b4-4d1f-8bf0-7fbc70987fae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:25.447353 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e4db6f8f-30b4-4d1f-8bf0-7fbc70987fae tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1507 microversion: 2.1 time: 0.286688 Mar 05 21:05:25.458246 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2089/4144] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:25 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:25.771059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aa58b002-0de4-4f23-8b1b-df1c716c11ef tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:25.771936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aa58b002-0de4-4f23-8b1b-df1c716c11ef tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:25.780023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa58b002-0de4-4f23-8b1b-df1c716c11ef tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:25.781174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa58b002-0de4-4f23-8b1b-df1c716c11ef tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:25.782216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa58b002-0de4-4f23-8b1b-df1c716c11ef tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:25.783191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa58b002-0de4-4f23-8b1b-df1c716c11ef tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:25.819463 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aa58b002-0de4-4f23-8b1b-df1c716c11ef tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments/e06e2c79-85f3-45fe-82b7-e23e9817cca9" status: 200 len: 194 microversion: 2.1 time: 0.052733 Mar 05 21:05:25.821023 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2056/4145] 10.222.0.15 () {58 vars in 1412 bytes} [Sat Mar 5 21:05:25 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments/e06e2c79-85f3-45fe-82b7-e23e9817cca9 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:25.832409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e84266c1-1d3f-434a-937e-6fb92041f55e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:25.832973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e84266c1-1d3f-434a-937e-6fb92041f55e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:25.841123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e84266c1-1d3f-434a-937e-6fb92041f55e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:25.841722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e84266c1-1d3f-434a-937e-6fb92041f55e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:25.842668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e84266c1-1d3f-434a-937e-6fb92041f55e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:25.843183 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e84266c1-1d3f-434a-937e-6fb92041f55e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:25.921305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e5af9a15-cb40-42a7-86d8-8551a15054ee tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:25.950739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e5af9a15-cb40-42a7-86d8-8551a15054ee tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:25.951632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-e84266c1-1d3f-434a-937e-6fb92041f55e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lazy-loading 'services' on Instance uuid bbf406b0-8c85-4126-ade0-797f76b7b3cf {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:05:25.951995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5af9a15-cb40-42a7-86d8-8551a15054ee tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:25.952769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5af9a15-cb40-42a7-86d8-8551a15054ee tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:25.953627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5af9a15-cb40-42a7-86d8-8551a15054ee tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:25.954203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5af9a15-cb40-42a7-86d8-8551a15054ee tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:26.058053 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e84266c1-1d3f-434a-937e-6fb92041f55e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments/e06e2c79-85f3-45fe-82b7-e23e9817cca9" status: 202 len: 0 microversion: 2.1 time: 0.229753 Mar 05 21:05:26.058053 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2090/4146] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 21:05:25 2022] DELETE /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments/e06e2c79-85f3-45fe-82b7-e23e9817cca9 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 21:05:26.282911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e5af9a15-cb40-42a7-86d8-8551a15054ee tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:26.291699 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e5af9a15-cb40-42a7-86d8-8551a15054ee tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.375391 Mar 05 21:05:26.301311 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2057/4147] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:25 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:26.468260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3f780568-92b0-4c3d-89e7-4977cdd0b80e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:26.469001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3f780568-92b0-4c3d-89e7-4977cdd0b80e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:26.475544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f780568-92b0-4c3d-89e7-4977cdd0b80e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:26.476568 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f780568-92b0-4c3d-89e7-4977cdd0b80e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:26.477383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f780568-92b0-4c3d-89e7-4977cdd0b80e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:26.477825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f780568-92b0-4c3d-89e7-4977cdd0b80e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:26.627632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3f780568-92b0-4c3d-89e7-4977cdd0b80e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:26.636751 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3f780568-92b0-4c3d-89e7-4977cdd0b80e tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1507 microversion: 2.1 time: 0.173639 Mar 05 21:05:26.637611 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2091/4148] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:26 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:26.705197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-67380ae5-a72b-4c1c-a241-9fb231ccb0a4 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:26.709597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-67380ae5-a72b-4c1c-a241-9fb231ccb0a4 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:26.710923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-67380ae5-a72b-4c1c-a241-9fb231ccb0a4 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Searching by: {'deleted': False, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 21:05:26.716530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-67380ae5-a72b-4c1c-a241-9fb231ccb0a4 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:26.717710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-67380ae5-a72b-4c1c-a241-9fb231ccb0a4 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:26.718931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-67380ae5-a72b-4c1c-a241-9fb231ccb0a4 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:26.719781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-67380ae5-a72b-4c1c-a241-9fb231ccb0a4 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:26.750457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-67380ae5-a72b-4c1c-a241-9fb231ccb0a4 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 21:05:26.789305 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-67380ae5-a72b-4c1c-a241-9fb231ccb0a4 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.088057 Mar 05 21:05:26.790672 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2058/4149] 10.222.0.15 () {58 vars in 1124 bytes} [Sat Mar 5 21:05:26 2022] GET /compute/v2.1/servers => generated 333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:26.801852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5707a31a-3470-4004-9b33-c06bc309d01d tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:26.806690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5707a31a-3470-4004-9b33-c06bc309d01d tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:26.807877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5707a31a-3470-4004-9b33-c06bc309d01d tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Searching by: {'deleted': False, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40'} {{(pid=141479) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 21:05:26.815540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5707a31a-3470-4004-9b33-c06bc309d01d tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:26.816577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5707a31a-3470-4004-9b33-c06bc309d01d tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:26.817614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5707a31a-3470-4004-9b33-c06bc309d01d tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:26.818482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5707a31a-3470-4004-9b33-c06bc309d01d tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:26.852270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.multi_cell_list [None req-5707a31a-3470-4004-9b33-c06bc309d01d tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 21:05:26.891845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5707a31a-3470-4004-9b33-c06bc309d01d tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:26.915217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5707a31a-3470-4004-9b33-c06bc309d01d tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:26.915821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5707a31a-3470-4004-9b33-c06bc309d01d tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:27.220039 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5707a31a-3470-4004-9b33-c06bc309d01d tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.422027 Mar 05 21:05:27.220920 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2092/4150] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 21:05:26 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:27.249405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-113e1df0-66f7-43db-b1a7-dc82d8c2df43 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:27.275210 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-113e1df0-66f7-43db-b1a7-dc82d8c2df43 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028327 Mar 05 21:05:27.275210 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2059/4151] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 21:05:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:27.309594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8902eb36-298c-4367-bb64-00996532631f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:27.310289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8902eb36-298c-4367-bb64-00996532631f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:27.319103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-913b8cd0-f74f-424f-a6dd-946c201c7445 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:27.321742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-913b8cd0-f74f-424f-a6dd-946c201c7445 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:27.332491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8902eb36-298c-4367-bb64-00996532631f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:27.332964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8902eb36-298c-4367-bb64-00996532631f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:27.333739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8902eb36-298c-4367-bb64-00996532631f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:27.334187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8902eb36-298c-4367-bb64-00996532631f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:27.344642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-913b8cd0-f74f-424f-a6dd-946c201c7445 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:27.345432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-913b8cd0-f74f-424f-a6dd-946c201c7445 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:27.346840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-913b8cd0-f74f-424f-a6dd-946c201c7445 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:27.348439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-913b8cd0-f74f-424f-a6dd-946c201c7445 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:27.392650 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-913b8cd0-f74f-424f-a6dd-946c201c7445 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077774 Mar 05 21:05:27.393335 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2060/4152] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:05:27 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 05 21:05:27.525130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d53d7c60-6252-425c-8d25-a87d40bdd872 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:27.527022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d53d7c60-6252-425c-8d25-a87d40bdd872 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:27.533815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d53d7c60-6252-425c-8d25-a87d40bdd872 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:27.534351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d53d7c60-6252-425c-8d25-a87d40bdd872 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:27.535826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d53d7c60-6252-425c-8d25-a87d40bdd872 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:27.536613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d53d7c60-6252-425c-8d25-a87d40bdd872 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:27.582852 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d53d7c60-6252-425c-8d25-a87d40bdd872 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062560 Mar 05 21:05:27.583793 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2061/4153] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:05:27 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 05 21:05:27.656614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-381ce8de-2111-40db-8c49-03bd61d283f0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:27.657293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-381ce8de-2111-40db-8c49-03bd61d283f0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:27.665712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-381ce8de-2111-40db-8c49-03bd61d283f0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:27.666350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-381ce8de-2111-40db-8c49-03bd61d283f0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:27.667422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-381ce8de-2111-40db-8c49-03bd61d283f0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:27.670266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-381ce8de-2111-40db-8c49-03bd61d283f0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:27.689309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8902eb36-298c-4367-bb64-00996532631f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:27.702516 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8902eb36-298c-4367-bb64-00996532631f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1511 microversion: 2.1 time: 0.397506 Mar 05 21:05:27.703707 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2093/4154] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:27 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:27.716830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f8de544e-664b-40ce-bc93-af3c576831a2 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:27.718673 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f8de544e-664b-40ce-bc93-af3c576831a2 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:27.732957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8de544e-664b-40ce-bc93-af3c576831a2 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:27.733432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8de544e-664b-40ce-bc93-af3c576831a2 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:27.736801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8de544e-664b-40ce-bc93-af3c576831a2 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:27.737270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f8de544e-664b-40ce-bc93-af3c576831a2 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:27.800161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f8de544e-664b-40ce-bc93-af3c576831a2 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:05:27.964658 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f8de544e-664b-40ce-bc93-af3c576831a2 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 204 len: 0 microversion: 2.1 time: 0.259370 Mar 05 21:05:27.965572 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2094/4155] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:05:27 2022] DELETE /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:05:27.970897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-75663a43-568b-4b1f-8e5e-0d2db03ddc6a tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:27.978547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-75663a43-568b-4b1f-8e5e-0d2db03ddc6a tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:27.992585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75663a43-568b-4b1f-8e5e-0d2db03ddc6a tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:27.993109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75663a43-568b-4b1f-8e5e-0d2db03ddc6a tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:27.994052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75663a43-568b-4b1f-8e5e-0d2db03ddc6a tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:27.994513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75663a43-568b-4b1f-8e5e-0d2db03ddc6a tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:28.033397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-75663a43-568b-4b1f-8e5e-0d2db03ddc6a tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:05:28.159929 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-75663a43-568b-4b1f-8e5e-0d2db03ddc6a tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 204 len: 0 microversion: 2.1 time: 0.186604 Mar 05 21:05:28.161995 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2095/4156] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:05:27 2022] DELETE /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:05:28.178075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6636559b-ce84-42b5-a7b0-27af891f6d3e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:28.181981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6636559b-ce84-42b5-a7b0-27af891f6d3e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:28.195840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6636559b-ce84-42b5-a7b0-27af891f6d3e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:28.196629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6636559b-ce84-42b5-a7b0-27af891f6d3e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:28.197651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6636559b-ce84-42b5-a7b0-27af891f6d3e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:28.198988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6636559b-ce84-42b5-a7b0-27af891f6d3e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:28.200254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-381ce8de-2111-40db-8c49-03bd61d283f0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:28.208734 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-381ce8de-2111-40db-8c49-03bd61d283f0 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1507 microversion: 2.1 time: 0.557578 Mar 05 21:05:28.211121 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2062/4157] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:27 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1507 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:28.216386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-843a530f-4617-4080-8cee-5de1c6120b33 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:28.232816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-843a530f-4617-4080-8cee-5de1c6120b33 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:28.238916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-843a530f-4617-4080-8cee-5de1c6120b33 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:28.239368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-843a530f-4617-4080-8cee-5de1c6120b33 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:28.240185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-843a530f-4617-4080-8cee-5de1c6120b33 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:28.240624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-843a530f-4617-4080-8cee-5de1c6120b33 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:28.566569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6636559b-ce84-42b5-a7b0-27af891f6d3e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:28.576848 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6636559b-ce84-42b5-a7b0-27af891f6d3e tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1671 microversion: 2.1 time: 0.412864 Mar 05 21:05:28.577918 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2096/4158] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:28 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1671 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:28.720585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-90e7f03a-84bb-44da-a295-7abcd40feb89 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:28.721368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-90e7f03a-84bb-44da-a295-7abcd40feb89 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:28.730110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90e7f03a-84bb-44da-a295-7abcd40feb89 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:28.731594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90e7f03a-84bb-44da-a295-7abcd40feb89 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:28.733628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90e7f03a-84bb-44da-a295-7abcd40feb89 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:28.734476 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90e7f03a-84bb-44da-a295-7abcd40feb89 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:28.983340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-843a530f-4617-4080-8cee-5de1c6120b33 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:28.997587 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-843a530f-4617-4080-8cee-5de1c6120b33 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1701 microversion: 2.1 time: 0.784468 Mar 05 21:05:28.998496 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2063/4159] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:28 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1701 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:29.092480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-90e7f03a-84bb-44da-a295-7abcd40feb89 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:29.102482 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-90e7f03a-84bb-44da-a295-7abcd40feb89 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1488 microversion: 2.1 time: 0.384984 Mar 05 21:05:29.104716 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2097/4160] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:28 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1488 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:29.120905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-46f05859-ae2b-4014-bfa6-7cb580456652 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:29.122034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-46f05859-ae2b-4014-bfa6-7cb580456652 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:29.135787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46f05859-ae2b-4014-bfa6-7cb580456652 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:29.136858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46f05859-ae2b-4014-bfa6-7cb580456652 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:29.141142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46f05859-ae2b-4014-bfa6-7cb580456652 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:29.141615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46f05859-ae2b-4014-bfa6-7cb580456652 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:29.227344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-098f33f1-08bb-436a-bf26-2455f760c5aa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:29.228158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-098f33f1-08bb-436a-bf26-2455f760c5aa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:29.234497 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-46f05859-ae2b-4014-bfa6-7cb580456652 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 200 len: 170 microversion: 2.1 time: 0.118016 Mar 05 21:05:29.242199 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2064/4161] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:29 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 170 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:29.243170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-098f33f1-08bb-436a-bf26-2455f760c5aa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:29.246321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-098f33f1-08bb-436a-bf26-2455f760c5aa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:29.246559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ef2ad621-8add-4938-b035-1b7547688dfb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:29.247282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ef2ad621-8add-4938-b035-1b7547688dfb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:29.248533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-098f33f1-08bb-436a-bf26-2455f760c5aa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:29.250296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-098f33f1-08bb-436a-bf26-2455f760c5aa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:29.269688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef2ad621-8add-4938-b035-1b7547688dfb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:29.273407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef2ad621-8add-4938-b035-1b7547688dfb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:29.274648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef2ad621-8add-4938-b035-1b7547688dfb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:29.275282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef2ad621-8add-4938-b035-1b7547688dfb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:29.343414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-098f33f1-08bb-436a-bf26-2455f760c5aa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:29.356480 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-098f33f1-08bb-436a-bf26-2455f760c5aa tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 200 len: 1465 microversion: 2.1 time: 0.133928 Mar 05 21:05:29.362130 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2098/4162] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:29 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 1465 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:29.407232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-1fdf5b4e-0b08-4858-8a1a-fc21672ccf8a req-ac52bd7d-d546-4de7-b237-f5ea723dc482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08399756-b179-4541-ad3e-3c179e7d7514", "name": "network-vif-deleted", "tag": "f4c94118-4a65-46a6-8b43-e142d3b1d4fb"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:29.423185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1fdf5b4e-0b08-4858-8a1a-fc21672ccf8a req-ac52bd7d-d546-4de7-b237-f5ea723dc482 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:29.423877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1fdf5b4e-0b08-4858-8a1a-fc21672ccf8a req-ac52bd7d-d546-4de7-b237-f5ea723dc482 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:29.456286 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-1fdf5b4e-0b08-4858-8a1a-fc21672ccf8a req-ac52bd7d-d546-4de7-b237-f5ea723dc482 service nova] Creating event network-vif-deleted:f4c94118-4a65-46a6-8b43-e142d3b1d4fb for instance 08399756-b179-4541-ad3e-3c179e7d7514 on nch2-master-1 Mar 05 21:05:29.480121 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-1fdf5b4e-0b08-4858-8a1a-fc21672ccf8a req-ac52bd7d-d546-4de7-b237-f5ea723dc482 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074680 Mar 05 21:05:29.483512 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2099/4163] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:05:29.546469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ef2ad621-8add-4938-b035-1b7547688dfb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:29.563009 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ef2ad621-8add-4938-b035-1b7547688dfb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.321055 Mar 05 21:05:29.563812 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2065/4164] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:29 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:29.591619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1e1b5e8d-1361-4678-9447-a2dc2a2dab93 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:29.592603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1e1b5e8d-1361-4678-9447-a2dc2a2dab93 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:29.596728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fae158a5-b5d4-456f-9e21-a10bc05160b1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:29.597858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fae158a5-b5d4-456f-9e21-a10bc05160b1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:29.602794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e1b5e8d-1361-4678-9447-a2dc2a2dab93 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:29.603436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e1b5e8d-1361-4678-9447-a2dc2a2dab93 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:29.604484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e1b5e8d-1361-4678-9447-a2dc2a2dab93 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:29.605273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e1b5e8d-1361-4678-9447-a2dc2a2dab93 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:29.614330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fae158a5-b5d4-456f-9e21-a10bc05160b1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:29.618362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fae158a5-b5d4-456f-9e21-a10bc05160b1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:29.619534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fae158a5-b5d4-456f-9e21-a10bc05160b1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:29.622259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fae158a5-b5d4-456f-9e21-a10bc05160b1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:30.075963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fae158a5-b5d4-456f-9e21-a10bc05160b1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:30.084923 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fae158a5-b5d4-456f-9e21-a10bc05160b1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1671 microversion: 2.1 time: 0.493374 Mar 05 21:05:30.085679 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2066/4165] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:29 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1671 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:30.091226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-20fcf039-e581-4dfd-905f-cafb3e46e2b8 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:30.092109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-20fcf039-e581-4dfd-905f-cafb3e46e2b8 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:30.102119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20fcf039-e581-4dfd-905f-cafb3e46e2b8 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:30.102595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20fcf039-e581-4dfd-905f-cafb3e46e2b8 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:30.103395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20fcf039-e581-4dfd-905f-cafb3e46e2b8 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:30.103876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20fcf039-e581-4dfd-905f-cafb3e46e2b8 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:30.242776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1e1b5e8d-1361-4678-9447-a2dc2a2dab93 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:30.252100 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1e1b5e8d-1361-4678-9447-a2dc2a2dab93 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.665953 Mar 05 21:05:30.252811 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2100/4166] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:29 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:30.268666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b37f21dd-59a3-40f0-a6c2-0902950f8c3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:30.269523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b37f21dd-59a3-40f0-a6c2-0902950f8c3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:30.276283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b37f21dd-59a3-40f0-a6c2-0902950f8c3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:30.276742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b37f21dd-59a3-40f0-a6c2-0902950f8c3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:30.277539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b37f21dd-59a3-40f0-a6c2-0902950f8c3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:30.278021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b37f21dd-59a3-40f0-a6c2-0902950f8c3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:30.642772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b37f21dd-59a3-40f0-a6c2-0902950f8c3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:30.650083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-20fcf039-e581-4dfd-905f-cafb3e46e2b8 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:30.660303 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b37f21dd-59a3-40f0-a6c2-0902950f8c3f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.395641 Mar 05 21:05:30.663705 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2101/4167] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:30 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:30.681489 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-20fcf039-e581-4dfd-905f-cafb3e46e2b8 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1701 microversion: 2.1 time: 0.589380 Mar 05 21:05:30.682670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c87c9957-2a07-4fc0-9748-7d607fed3650 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:30.683645 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2067/4168] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:30 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1701 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:30.686983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c87c9957-2a07-4fc0-9748-7d607fed3650 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: 08399756-b179-4541-ad3e-3c179e7d7514] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:30.693171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c87c9957-2a07-4fc0-9748-7d607fed3650 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:30.693634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c87c9957-2a07-4fc0-9748-7d607fed3650 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:30.694799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c87c9957-2a07-4fc0-9748-7d607fed3650 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:30.703907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-75ca7ae5-958d-4d8a-9793-9aff671793fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:30.704758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-75ca7ae5-958d-4d8a-9793-9aff671793fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:30.711725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c87c9957-2a07-4fc0-9748-7d607fed3650 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:30.725637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75ca7ae5-958d-4d8a-9793-9aff671793fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:30.727262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75ca7ae5-958d-4d8a-9793-9aff671793fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:30.728394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75ca7ae5-958d-4d8a-9793-9aff671793fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:30.729596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75ca7ae5-958d-4d8a-9793-9aff671793fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:30.733519 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-c87c9957-2a07-4fc0-9748-7d607fed3650 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] HTTP exception thrown: Instance 08399756-b179-4541-ad3e-3c179e7d7514 could not be found. Mar 05 21:05:30.740616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c87c9957-2a07-4fc0-9748-7d607fed3650 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Returning 404 to user: Instance 08399756-b179-4541-ad3e-3c179e7d7514 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:30.741567 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c87c9957-2a07-4fc0-9748-7d607fed3650 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514" status: 404 len: 111 microversion: 2.1 time: 0.075861 Mar 05 21:05:30.746544 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2102/4169] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:30 2022] GET /compute/v2.1/servers/08399756-b179-4541-ad3e-3c179e7d7514 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:05:30.760432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f6657aec-1e32-42bb-8427-371a15462d29 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:30.760948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f6657aec-1e32-42bb-8427-371a15462d29 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:30.767892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f6657aec-1e32-42bb-8427-371a15462d29 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:30.768358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f6657aec-1e32-42bb-8427-371a15462d29 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:30.778442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f6657aec-1e32-42bb-8427-371a15462d29 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:30.779511 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f6657aec-1e32-42bb-8427-371a15462d29 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:30.810620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f6657aec-1e32-42bb-8427-371a15462d29 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:05:30.972819 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f6657aec-1e32-42bb-8427-371a15462d29 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 204 len: 0 microversion: 2.1 time: 0.224267 Mar 05 21:05:30.974225 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2103/4170] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:05:30 2022] DELETE /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:05:30.987991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6c527621-2b25-475d-b755-be475b5ecf6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:30.989469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6c527621-2b25-475d-b755-be475b5ecf6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:31.002011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c527621-2b25-475d-b755-be475b5ecf6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:31.002794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c527621-2b25-475d-b755-be475b5ecf6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:31.004104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c527621-2b25-475d-b755-be475b5ecf6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:31.004810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c527621-2b25-475d-b755-be475b5ecf6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:31.271888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-75ca7ae5-958d-4d8a-9793-9aff671793fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:31.292765 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-75ca7ae5-958d-4d8a-9793-9aff671793fe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.606105 Mar 05 21:05:31.298869 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2068/4171] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:30 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:31.312297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-916d6723-661c-4ee6-ba49-b9b34a7eb69b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:31.320408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-916d6723-661c-4ee6-ba49-b9b34a7eb69b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:31.349489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6c527621-2b25-475d-b755-be475b5ecf6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:31.361851 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6c527621-2b25-475d-b755-be475b5ecf6a tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 0.381689 Mar 05 21:05:31.366724 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2104/4172] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:30 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:31.375170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-916d6723-661c-4ee6-ba49-b9b34a7eb69b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:31.378593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-916d6723-661c-4ee6-ba49-b9b34a7eb69b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:31.384428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-916d6723-661c-4ee6-ba49-b9b34a7eb69b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:31.390595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-916d6723-661c-4ee6-ba49-b9b34a7eb69b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:31.551070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-916d6723-661c-4ee6-ba49-b9b34a7eb69b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352a9d7250c742638d90f17006f12c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59b6cf41e6d4308819eb264dcaa320e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:31.566322 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-916d6723-661c-4ee6-ba49-b9b34a7eb69b tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 200 len: 1604 microversion: 2.1 time: 0.262789 Mar 05 21:05:31.567815 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2069/4173] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:31 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 1604 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:31.596656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1475936613", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "5638f6ea-4ec0-488e-a680-99fc30eb719d"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:31.669666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] validate_networks() for [('5638f6ea-4ec0-488e-a680-99fc30eb719d', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:05:31.703199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6babda58-8585-4f37-be36-35fc98348a41 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:31.704123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6babda58-8585-4f37-be36-35fc98348a41 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:31.717245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6babda58-8585-4f37-be36-35fc98348a41 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:31.718932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6babda58-8585-4f37-be36-35fc98348a41 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:31.721599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6babda58-8585-4f37-be36-35fc98348a41 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:31.724389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6babda58-8585-4f37-be36-35fc98348a41 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:31.893130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6babda58-8585-4f37-be36-35fc98348a41 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:31.905329 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6babda58-8585-4f37-be36-35fc98348a41 tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1633 microversion: 2.1 time: 0.207179 Mar 05 21:05:31.906778 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2070/4174] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:31 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1633 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:32.276327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-0c1b229b-68ab-45c9-a7d1-c1279854e8c5 req-43c03d72-cf19-48fb-a56e-4af91e591d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf406b0-8c85-4126-ade0-797f76b7b3cf", "name": "network-vif-deleted", "tag": "2f672d97-7658-4404-9c2c-23bec705e4a1"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:32.302646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-0c1b229b-68ab-45c9-a7d1-c1279854e8c5 req-43c03d72-cf19-48fb-a56e-4af91e591d27 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:32.305153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-0c1b229b-68ab-45c9-a7d1-c1279854e8c5 req-43c03d72-cf19-48fb-a56e-4af91e591d27 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:32.351696 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-0c1b229b-68ab-45c9-a7d1-c1279854e8c5 req-43c03d72-cf19-48fb-a56e-4af91e591d27 service nova] Creating event network-vif-deleted:2f672d97-7658-4404-9c2c-23bec705e4a1 for instance bbf406b0-8c85-4126-ade0-797f76b7b3cf on nch1-master-1 Mar 05 21:05:32.363361 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-0c1b229b-68ab-45c9-a7d1-c1279854e8c5 req-43c03d72-cf19-48fb-a56e-4af91e591d27 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109464 Mar 05 21:05:32.369006 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2071/4175] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:32.385781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-04f62687-e213-4e2d-9bf8-3a092076cd9c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:32.388792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-04f62687-e213-4e2d-9bf8-3a092076cd9c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:32.405919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04f62687-e213-4e2d-9bf8-3a092076cd9c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:32.406746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04f62687-e213-4e2d-9bf8-3a092076cd9c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:32.407919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04f62687-e213-4e2d-9bf8-3a092076cd9c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:32.408596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04f62687-e213-4e2d-9bf8-3a092076cd9c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:32.945594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-04f62687-e213-4e2d-9bf8-3a092076cd9c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:32.955645 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-04f62687-e213-4e2d-9bf8-3a092076cd9c tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 0.578656 Mar 05 21:05:32.967592 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2072/4176] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:32 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:32.978487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-128c5ad6-1fe2-4567-81c4-ffb3c803b7c3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:32.980284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-128c5ad6-1fe2-4567-81c4-ffb3c803b7c3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:32.992494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-128c5ad6-1fe2-4567-81c4-ffb3c803b7c3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:32.992964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-128c5ad6-1fe2-4567-81c4-ffb3c803b7c3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:32.993763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-128c5ad6-1fe2-4567-81c4-ffb3c803b7c3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:32.994213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-128c5ad6-1fe2-4567-81c4-ffb3c803b7c3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:33.033034 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-128c5ad6-1fe2-4567-81c4-ffb3c803b7c3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] HTTP exception thrown: Instance bbf406b0-8c85-4126-ade0-797f76b7b3cf could not be found. Mar 05 21:05:33.035309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-128c5ad6-1fe2-4567-81c4-ffb3c803b7c3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Returning 404 to user: Instance bbf406b0-8c85-4126-ade0-797f76b7b3cf could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:33.036770 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-128c5ad6-1fe2-4567-81c4-ffb3c803b7c3 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 404 len: 111 microversion: 2.1 time: 0.068031 Mar 05 21:05:33.039997 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2073/4177] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:32 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:05:33.047763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b32f56ba-7f53-41ac-a373-74f97f482690 req-186256a6-5fc6-40b2-af94-78c6f2bf435d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d57f60-92f1-4612-9719-11df0d9eaa78", "name": "network-vif-deleted", "tag": "0d4bfa0a-fdb5-4443-bed4-e96bace20d35"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:33.070630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b32f56ba-7f53-41ac-a373-74f97f482690 req-186256a6-5fc6-40b2-af94-78c6f2bf435d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:33.072189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b32f56ba-7f53-41ac-a373-74f97f482690 req-186256a6-5fc6-40b2-af94-78c6f2bf435d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:33.106685 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-b32f56ba-7f53-41ac-a373-74f97f482690 req-186256a6-5fc6-40b2-af94-78c6f2bf435d service nova] Creating event network-vif-deleted:0d4bfa0a-fdb5-4443-bed4-e96bace20d35 for instance e4d57f60-92f1-4612-9719-11df0d9eaa78 on nch2-master-1 Mar 05 21:05:33.120584 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b32f56ba-7f53-41ac-a373-74f97f482690 req-186256a6-5fc6-40b2-af94-78c6f2bf435d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073834 Mar 05 21:05:33.121172 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2074/4178] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:33.131191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ed265abc-29d1-497b-8f51-fc859caa9b4f tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:33.132705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ed265abc-29d1-497b-8f51-fc859caa9b4f tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:33.152251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed265abc-29d1-497b-8f51-fc859caa9b4f tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:33.152802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed265abc-29d1-497b-8f51-fc859caa9b4f tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:33.153704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed265abc-29d1-497b-8f51-fc859caa9b4f tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:33.154154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed265abc-29d1-497b-8f51-fc859caa9b4f tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:33.238399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed265abc-29d1-497b-8f51-fc859caa9b4f tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:33.239019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed265abc-29d1-497b-8f51-fc859caa9b4f tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:33.239513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-ed265abc-29d1-497b-8f51-fc859caa9b4f tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lazy-loading 'fault' on Instance uuid e4d57f60-92f1-4612-9719-11df0d9eaa78 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:05:33.623852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ed265abc-29d1-497b-8f51-fc859caa9b4f tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aee798b914c450f9dd2de705aa6233c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe7e39b29a47fcb344c08b109d4e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:33.637783 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ed265abc-29d1-497b-8f51-fc859caa9b4f tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 200 len: 1359 microversion: 2.1 time: 0.515325 Mar 05 21:05:33.658800 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2075/4179] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:33 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 1359 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:33.677682 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:05:33.678155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-26057f7a-fd3a-44ac-a125-734338519701 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '.version_select at 0x7fed5c737ee0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:33.678295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:05:33.678722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:05:33.680029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:05:33.680461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:05:33.700593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:33.702141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:33.702986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:33.703443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:33.721031 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-26057f7a-fd3a-44ac-a125-734338519701 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-415623795" status: 202 len: 0 microversion: 2.1 time: 0.059911 Mar 05 21:05:33.722225 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2076/4180] 10.222.0.15 () {58 vars in 1217 bytes} [Sat Mar 5 21:05:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-415623795 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:05:33.766561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:05:33.787422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for user d2421fee8afc47ea822c5df54a095261 and project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:05:33.820369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:05:33.826444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:05:33.939625 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-299b446f-3248-48d4-bb94-fad3f05ac0d6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.346941 Mar 05 21:05:33.948520 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2105/4181] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:05:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:05:33.966494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-77253cf5-84c5-4fd4-bbb7-89e6bd1871fb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:33.967832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-77253cf5-84c5-4fd4-bbb7-89e6bd1871fb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:33.981210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-afa46af9-a777-4ed3-b4cb-3f4cf80cf4bb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:33.982209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-afa46af9-a777-4ed3-b4cb-3f4cf80cf4bb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:33.999222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afa46af9-a777-4ed3-b4cb-3f4cf80cf4bb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:34.000050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afa46af9-a777-4ed3-b4cb-3f4cf80cf4bb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:34.001062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afa46af9-a777-4ed3-b4cb-3f4cf80cf4bb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:34.001528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afa46af9-a777-4ed3-b4cb-3f4cf80cf4bb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:34.263465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-77253cf5-84c5-4fd4-bbb7-89e6bd1871fb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:34.273806 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-77253cf5-84c5-4fd4-bbb7-89e6bd1871fb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1215 microversion: 2.1 time: 0.318234 Mar 05 21:05:34.280458 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2077/4182] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:33 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1215 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:34.553809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-afa46af9-a777-4ed3-b4cb-3f4cf80cf4bb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:34.571495 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-afa46af9-a777-4ed3-b4cb-3f4cf80cf4bb tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 0.594422 Mar 05 21:05:34.582081 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2106/4183] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:33 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:34.656620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fe90ba46-7042-4b47-a831-457dcfb87bbf tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:34.657412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fe90ba46-7042-4b47-a831-457dcfb87bbf tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] [instance: e4d57f60-92f1-4612-9719-11df0d9eaa78] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:34.672788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe90ba46-7042-4b47-a831-457dcfb87bbf tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:34.675577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe90ba46-7042-4b47-a831-457dcfb87bbf tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:34.677533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe90ba46-7042-4b47-a831-457dcfb87bbf tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:34.679809 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe90ba46-7042-4b47-a831-457dcfb87bbf tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:34.715909 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-fe90ba46-7042-4b47-a831-457dcfb87bbf tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] HTTP exception thrown: Instance e4d57f60-92f1-4612-9719-11df0d9eaa78 could not be found. Mar 05 21:05:34.717223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fe90ba46-7042-4b47-a831-457dcfb87bbf tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Returning 404 to user: Instance e4d57f60-92f1-4612-9719-11df0d9eaa78 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:34.720850 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fe90ba46-7042-4b47-a831-457dcfb87bbf tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78" status: 404 len: 111 microversion: 2.1 time: 0.067271 Mar 05 21:05:34.722305 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2078/4184] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:34 2022] GET /compute/v2.1/servers/e4d57f60-92f1-4612-9719-11df0d9eaa78 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:05:34.732409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c4c82eb3-9785-422a-8b66-32f4160357ee tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] Calling method '.version_select at 0x7fed4f8f4e50>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:34.779234 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c4c82eb3-9785-422a-8b66-32f4160357ee tempest-ServersTestJSON-240629896 tempest-ServersTestJSON-240629896-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085100150" status: 202 len: 0 microversion: 2.1 time: 0.051866 Mar 05 21:05:34.780686 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2107/4185] 10.222.0.15 () {58 vars in 1220 bytes} [Sat Mar 5 21:05:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085100150 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:05:35.299026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9456ef67-b62b-4729-843b-f85eb91f1e62 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:35.299712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9456ef67-b62b-4729-843b-f85eb91f1e62 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:35.317765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9456ef67-b62b-4729-843b-f85eb91f1e62 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:35.318223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9456ef67-b62b-4729-843b-f85eb91f1e62 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:35.319162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9456ef67-b62b-4729-843b-f85eb91f1e62 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:35.320206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9456ef67-b62b-4729-843b-f85eb91f1e62 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:35.504250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9456ef67-b62b-4729-843b-f85eb91f1e62 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:35.517200 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9456ef67-b62b-4729-843b-f85eb91f1e62 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1211 microversion: 2.1 time: 0.222250 Mar 05 21:05:35.520232 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2079/4186] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:35 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1211 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:35.592394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e839e3c4-eebe-4738-8a16-95f6701fd451 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:35.594044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e839e3c4-eebe-4738-8a16-95f6701fd451 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:35.610402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e839e3c4-eebe-4738-8a16-95f6701fd451 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:35.611006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e839e3c4-eebe-4738-8a16-95f6701fd451 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:35.611608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e839e3c4-eebe-4738-8a16-95f6701fd451 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:35.617655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e839e3c4-eebe-4738-8a16-95f6701fd451 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:36.103564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e839e3c4-eebe-4738-8a16-95f6701fd451 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:36.118826 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e839e3c4-eebe-4738-8a16-95f6701fd451 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1521 microversion: 2.1 time: 0.531472 Mar 05 21:05:36.119514 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2108/4187] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:35 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1521 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:36.555682 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41ab4ccf-8886-4059-ab34-ce9da064a46a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:36.561033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-41ab4ccf-8886-4059-ab34-ce9da064a46a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:36.573534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41ab4ccf-8886-4059-ab34-ce9da064a46a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:36.574160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41ab4ccf-8886-4059-ab34-ce9da064a46a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:36.575558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41ab4ccf-8886-4059-ab34-ce9da064a46a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:36.576546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41ab4ccf-8886-4059-ab34-ce9da064a46a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:36.758370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-41ab4ccf-8886-4059-ab34-ce9da064a46a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:36.773685 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-41ab4ccf-8886-4059-ab34-ce9da064a46a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1273 microversion: 2.1 time: 0.238814 Mar 05 21:05:36.783924 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2080/4188] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:36 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:37.143549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-08aca5c2-44af-4c04-a96a-923644305261 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:37.144284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-08aca5c2-44af-4c04-a96a-923644305261 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:37.155862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-08aca5c2-44af-4c04-a96a-923644305261 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:37.156604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-08aca5c2-44af-4c04-a96a-923644305261 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:37.157577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-08aca5c2-44af-4c04-a96a-923644305261 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:37.158189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-08aca5c2-44af-4c04-a96a-923644305261 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:37.361737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-08aca5c2-44af-4c04-a96a-923644305261 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2c691e443445a8a79f758dabd9042e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '085ced4ef30745c88d1b33842076f02e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:37.377395 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-08aca5c2-44af-4c04-a96a-923644305261 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 200 len: 1479 microversion: 2.1 time: 0.242947 Mar 05 21:05:37.379717 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2109/4189] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:37 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 1479 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:37.480495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-40aa89c1-037c-4183-8eb0-4bc659fa1b67 req-6a277f7b-a1b4-47a7-a9af-46e658245cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d64ade-0446-474b-a3d4-454133f21972", "name": "network-vif-deleted", "tag": "9825a641-f476-451a-af8d-cff38d8c1ce9"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:37.505810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-40aa89c1-037c-4183-8eb0-4bc659fa1b67 req-6a277f7b-a1b4-47a7-a9af-46e658245cdd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:37.506766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-40aa89c1-037c-4183-8eb0-4bc659fa1b67 req-6a277f7b-a1b4-47a7-a9af-46e658245cdd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:37.549935 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-40aa89c1-037c-4183-8eb0-4bc659fa1b67 req-6a277f7b-a1b4-47a7-a9af-46e658245cdd service nova] Creating event network-vif-deleted:9825a641-f476-451a-af8d-cff38d8c1ce9 for instance b2d64ade-0446-474b-a3d4-454133f21972 on nch1-master-1 Mar 05 21:05:37.559370 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-40aa89c1-037c-4183-8eb0-4bc659fa1b67 req-6a277f7b-a1b4-47a7-a9af-46e658245cdd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085037 Mar 05 21:05:37.560428 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2081/4190] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:37.791569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8bf144b7-d908-45dc-ba03-377a1e51b8eb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:37.792335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8bf144b7-d908-45dc-ba03-377a1e51b8eb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:37.802682 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bf144b7-d908-45dc-ba03-377a1e51b8eb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:37.803445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bf144b7-d908-45dc-ba03-377a1e51b8eb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:37.804988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bf144b7-d908-45dc-ba03-377a1e51b8eb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:37.805690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8bf144b7-d908-45dc-ba03-377a1e51b8eb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:37.983284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8bf144b7-d908-45dc-ba03-377a1e51b8eb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:38.001955 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8bf144b7-d908-45dc-ba03-377a1e51b8eb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1273 microversion: 2.1 time: 0.211328 Mar 05 21:05:38.002905 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2110/4191] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:37 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1273 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:38.403279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d5870610-b2b0-4b4d-8ad6-33f309d6afb8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:38.404335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d5870610-b2b0-4b4d-8ad6-33f309d6afb8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] [instance: b2d64ade-0446-474b-a3d4-454133f21972] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:38.415992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d5870610-b2b0-4b4d-8ad6-33f309d6afb8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:38.416784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d5870610-b2b0-4b4d-8ad6-33f309d6afb8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:38.417963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d5870610-b2b0-4b4d-8ad6-33f309d6afb8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:38.418753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d5870610-b2b0-4b4d-8ad6-33f309d6afb8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:38.438467 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-d5870610-b2b0-4b4d-8ad6-33f309d6afb8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] HTTP exception thrown: Instance b2d64ade-0446-474b-a3d4-454133f21972 could not be found. Mar 05 21:05:38.439986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d5870610-b2b0-4b4d-8ad6-33f309d6afb8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] Returning 404 to user: Instance b2d64ade-0446-474b-a3d4-454133f21972 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:38.441120 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d5870610-b2b0-4b4d-8ad6-33f309d6afb8 tempest-ServerRescueNegativeTestJSON-406228691 tempest-ServerRescueNegativeTestJSON-406228691-project] 10.222.0.15 "GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972" status: 404 len: 111 microversion: 2.1 time: 0.047516 Mar 05 21:05:38.442242 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2082/4192] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:38 2022] GET /compute/v2.1/servers/b2d64ade-0446-474b-a3d4-454133f21972 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:05:38.552201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5563a392-b0e2-42df-b404-ea6939740ce1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:38.553302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5563a392-b0e2-42df-b404-ea6939740ce1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:38.583293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5563a392-b0e2-42df-b404-ea6939740ce1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:38.583790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5563a392-b0e2-42df-b404-ea6939740ce1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:38.590852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5563a392-b0e2-42df-b404-ea6939740ce1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:38.592314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5563a392-b0e2-42df-b404-ea6939740ce1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:38.629084 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-5563a392-b0e2-42df-b404-ea6939740ce1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] HTTP exception thrown: Instance bbf406b0-8c85-4126-ade0-797f76b7b3cf could not be found. Mar 05 21:05:38.633005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5563a392-b0e2-42df-b404-ea6939740ce1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Returning 404 to user: Instance bbf406b0-8c85-4126-ade0-797f76b7b3cf could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:38.636718 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5563a392-b0e2-42df-b404-ea6939740ce1 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 404 len: 111 microversion: 2.1 time: 0.089732 Mar 05 21:05:38.641657 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2111/4193] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:05:38 2022] DELETE /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:05:38.646983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4d617026-3fb6-4f0e-84fd-54bf4e75bab9 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:38.648996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4d617026-3fb6-4f0e-84fd-54bf4e75bab9 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: bbf406b0-8c85-4126-ade0-797f76b7b3cf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:38.659449 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d617026-3fb6-4f0e-84fd-54bf4e75bab9 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:38.659947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d617026-3fb6-4f0e-84fd-54bf4e75bab9 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:38.660762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d617026-3fb6-4f0e-84fd-54bf4e75bab9 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:38.661210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d617026-3fb6-4f0e-84fd-54bf4e75bab9 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:38.712022 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4d617026-3fb6-4f0e-84fd-54bf4e75bab9 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] HTTP exception thrown: Instance bbf406b0-8c85-4126-ade0-797f76b7b3cf could not be found. Mar 05 21:05:38.712976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4d617026-3fb6-4f0e-84fd-54bf4e75bab9 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Returning 404 to user: Instance bbf406b0-8c85-4126-ade0-797f76b7b3cf could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:38.716566 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4d617026-3fb6-4f0e-84fd-54bf4e75bab9 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf" status: 404 len: 111 microversion: 2.1 time: 0.074179 Mar 05 21:05:38.717500 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2083/4194] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:38 2022] GET /compute/v2.1/servers/bbf406b0-8c85-4126-ade0-797f76b7b3cf => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:05:39.021886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-710d358e-8a02-4f1d-9123-44462998a73b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:39.023094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-710d358e-8a02-4f1d-9123-44462998a73b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:39.033087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-710d358e-8a02-4f1d-9123-44462998a73b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:39.036935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-710d358e-8a02-4f1d-9123-44462998a73b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:39.038860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-710d358e-8a02-4f1d-9123-44462998a73b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:39.042097 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-710d358e-8a02-4f1d-9123-44462998a73b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:39.533779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-710d358e-8a02-4f1d-9123-44462998a73b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:39.546405 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-710d358e-8a02-4f1d-9123-44462998a73b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1315 microversion: 2.1 time: 0.528965 Mar 05 21:05:39.547247 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2112/4195] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:39 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:05:40.028238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-29daddf0-c931-4dbd-81b1-a2010f9e3123 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:40.029288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-29daddf0-c931-4dbd-81b1-a2010f9e3123 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:40.038869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-29daddf0-c931-4dbd-81b1-a2010f9e3123 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:40.039611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-29daddf0-c931-4dbd-81b1-a2010f9e3123 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:40.040735 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-29daddf0-c931-4dbd-81b1-a2010f9e3123 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:40.041459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-29daddf0-c931-4dbd-81b1-a2010f9e3123 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:40.058838 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-29daddf0-c931-4dbd-81b1-a2010f9e3123 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] HTTP exception thrown: Instance 2a84920d-9932-4cd1-975b-9a28dc682e45 could not be found. Mar 05 21:05:40.059407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-29daddf0-c931-4dbd-81b1-a2010f9e3123 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Returning 404 to user: Instance 2a84920d-9932-4cd1-975b-9a28dc682e45 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:40.060362 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-29daddf0-c931-4dbd-81b1-a2010f9e3123 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 404 len: 111 microversion: 2.1 time: 0.037752 Mar 05 21:05:40.061025 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2084/4196] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:05:40 2022] DELETE /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:05:40.070656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0f7d482c-92d7-4457-a948-c5801c3281d8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:40.071919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0f7d482c-92d7-4457-a948-c5801c3281d8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] [instance: 2a84920d-9932-4cd1-975b-9a28dc682e45] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:40.079176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f7d482c-92d7-4457-a948-c5801c3281d8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:40.080047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f7d482c-92d7-4457-a948-c5801c3281d8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:40.080913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f7d482c-92d7-4457-a948-c5801c3281d8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:40.081432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f7d482c-92d7-4457-a948-c5801c3281d8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:40.105268 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-0f7d482c-92d7-4457-a948-c5801c3281d8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] HTTP exception thrown: Instance 2a84920d-9932-4cd1-975b-9a28dc682e45 could not be found. Mar 05 21:05:40.106830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0f7d482c-92d7-4457-a948-c5801c3281d8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] Returning 404 to user: Instance 2a84920d-9932-4cd1-975b-9a28dc682e45 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:40.108010 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0f7d482c-92d7-4457-a948-c5801c3281d8 tempest-AttachVolumeTestJSON-1994322257 tempest-AttachVolumeTestJSON-1994322257-project] 10.222.0.15 "GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45" status: 404 len: 111 microversion: 2.1 time: 0.042133 Mar 05 21:05:40.112744 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2113/4197] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:40 2022] GET /compute/v2.1/servers/2a84920d-9932-4cd1-975b-9a28dc682e45 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:05:40.564540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-282cff2f-29f2-44e3-9d96-0788b8cfb69b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:40.565471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-282cff2f-29f2-44e3-9d96-0788b8cfb69b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:40.572482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-282cff2f-29f2-44e3-9d96-0788b8cfb69b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:40.573151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-282cff2f-29f2-44e3-9d96-0788b8cfb69b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:40.574152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-282cff2f-29f2-44e3-9d96-0788b8cfb69b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:40.574825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-282cff2f-29f2-44e3-9d96-0788b8cfb69b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:40.627300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-797ad7c6-6640-44b3-95b4-8fcfc897ffb8 req-48b1a651-3118-4cc4-8a28-0358f37f6264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df", "tag": "4c91a561-c474-4d92-b44b-1cbcce180e5e"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:40.644681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-797ad7c6-6640-44b3-95b4-8fcfc897ffb8 req-48b1a651-3118-4cc4-8a28-0358f37f6264 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:40.647507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-797ad7c6-6640-44b3-95b4-8fcfc897ffb8 req-48b1a651-3118-4cc4-8a28-0358f37f6264 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:40.667137 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-797ad7c6-6640-44b3-95b4-8fcfc897ffb8 req-48b1a651-3118-4cc4-8a28-0358f37f6264 service nova] Creating event network-changed:4c91a561-c474-4d92-b44b-1cbcce180e5e for instance ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df on nch1-master-1 Mar 05 21:05:40.673306 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-797ad7c6-6640-44b3-95b4-8fcfc897ffb8 req-48b1a651-3118-4cc4-8a28-0358f37f6264 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049681 Mar 05 21:05:40.674489 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2114/4198] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:41.583014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-282cff2f-29f2-44e3-9d96-0788b8cfb69b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:41.614561 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-282cff2f-29f2-44e3-9d96-0788b8cfb69b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1315 microversion: 2.1 time: 1.053763 Mar 05 21:05:41.626741 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2085/4199] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:40 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1315 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:42.637208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0bd5dd8f-90cd-4d63-b2c9-79d8ae1ba44c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:42.638308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0bd5dd8f-90cd-4d63-b2c9-79d8ae1ba44c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:42.652926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0bd5dd8f-90cd-4d63-b2c9-79d8ae1ba44c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:42.655173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0bd5dd8f-90cd-4d63-b2c9-79d8ae1ba44c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:42.656789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0bd5dd8f-90cd-4d63-b2c9-79d8ae1ba44c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:42.657429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0bd5dd8f-90cd-4d63-b2c9-79d8ae1ba44c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:43.448001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0bd5dd8f-90cd-4d63-b2c9-79d8ae1ba44c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:43.468664 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0bd5dd8f-90cd-4d63-b2c9-79d8ae1ba44c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1315 microversion: 2.1 time: 0.836833 Mar 05 21:05:43.471404 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2115/4200] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:42 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1315 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:44.492416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bd5cdd31-3768-4608-8f22-6b8ca823398e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:44.493873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bd5cdd31-3768-4608-8f22-6b8ca823398e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:44.505531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd5cdd31-3768-4608-8f22-6b8ca823398e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:44.509052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd5cdd31-3768-4608-8f22-6b8ca823398e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:44.511914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd5cdd31-3768-4608-8f22-6b8ca823398e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:44.512869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bd5cdd31-3768-4608-8f22-6b8ca823398e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:45.109066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bd5cdd31-3768-4608-8f22-6b8ca823398e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:45.123489 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bd5cdd31-3768-4608-8f22-6b8ca823398e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1315 microversion: 2.1 time: 0.637893 Mar 05 21:05:45.124455 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2086/4201] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:44 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:46.142278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5f7bab5b-f75f-4c32-92be-1439e4da4abe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:46.142966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5f7bab5b-f75f-4c32-92be-1439e4da4abe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:46.154190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f7bab5b-f75f-4c32-92be-1439e4da4abe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:46.154466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f7bab5b-f75f-4c32-92be-1439e4da4abe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:46.155698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f7bab5b-f75f-4c32-92be-1439e4da4abe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:46.156363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f7bab5b-f75f-4c32-92be-1439e4da4abe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:46.652599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5f7bab5b-f75f-4c32-92be-1439e4da4abe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:46.661793 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5f7bab5b-f75f-4c32-92be-1439e4da4abe tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1315 microversion: 2.1 time: 0.524369 Mar 05 21:05:46.663249 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2116/4202] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:46 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:47.436221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-1bb386a7-91e5-43c4-9da5-b00a546995af req-0b361f2b-a94e-400b-b706-0c8a8b58cb29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df", "name": "network-vif-plugged", "status": "completed", "tag": "4c91a561-c474-4d92-b44b-1cbcce180e5e"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:47.490316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1bb386a7-91e5-43c4-9da5-b00a546995af req-0b361f2b-a94e-400b-b706-0c8a8b58cb29 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:47.500597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1bb386a7-91e5-43c4-9da5-b00a546995af req-0b361f2b-a94e-400b-b706-0c8a8b58cb29 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:47.529647 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-1bb386a7-91e5-43c4-9da5-b00a546995af req-0b361f2b-a94e-400b-b706-0c8a8b58cb29 service nova] Creating event network-vif-plugged:4c91a561-c474-4d92-b44b-1cbcce180e5e for instance ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df on nch1-master-1 Mar 05 21:05:47.536780 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-1bb386a7-91e5-43c4-9da5-b00a546995af req-0b361f2b-a94e-400b-b706-0c8a8b58cb29 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132936 Mar 05 21:05:47.539946 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2087/4203] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:47.683601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9903cf56-a101-44cf-a482-b8f18cdb038a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:47.684822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9903cf56-a101-44cf-a482-b8f18cdb038a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:47.693649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9903cf56-a101-44cf-a482-b8f18cdb038a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:47.694575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9903cf56-a101-44cf-a482-b8f18cdb038a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:47.696954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9903cf56-a101-44cf-a482-b8f18cdb038a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:47.698239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9903cf56-a101-44cf-a482-b8f18cdb038a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:48.519707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9903cf56-a101-44cf-a482-b8f18cdb038a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:48.531719 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9903cf56-a101-44cf-a482-b8f18cdb038a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1315 microversion: 2.1 time: 0.855380 Mar 05 21:05:48.534229 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2117/4204] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:47 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1315 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:49.563327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-72ef1454-84aa-41c5-aab6-742d1da4903c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:49.564982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-72ef1454-84aa-41c5-aab6-742d1da4903c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:49.576241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72ef1454-84aa-41c5-aab6-742d1da4903c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:49.577060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72ef1454-84aa-41c5-aab6-742d1da4903c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:49.578622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72ef1454-84aa-41c5-aab6-742d1da4903c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:49.579444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72ef1454-84aa-41c5-aab6-742d1da4903c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:49.881293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-72ef1454-84aa-41c5-aab6-742d1da4903c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:49.902012 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-72ef1454-84aa-41c5-aab6-742d1da4903c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1502 microversion: 2.1 time: 0.352421 Mar 05 21:05:49.902757 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2088/4205] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:05:49 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1502 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:05:49.924165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7b5b4d9a-4d8d-4c52-8054-0eace26e72ac tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:49.927405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7b5b4d9a-4d8d-4c52-8054-0eace26e72ac tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:49.942992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b5b4d9a-4d8d-4c52-8054-0eace26e72ac tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:49.943914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b5b4d9a-4d8d-4c52-8054-0eace26e72ac tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:49.945142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b5b4d9a-4d8d-4c52-8054-0eace26e72ac tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:49.947717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b5b4d9a-4d8d-4c52-8054-0eace26e72ac tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:50.033203 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7b5b4d9a-4d8d-4c52-8054-0eace26e72ac tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action" status: 200 len: 14 microversion: 2.1 time: 0.113836 Mar 05 21:05:50.048872 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2118/4206] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:49 2022] POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:05:51.046376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1168f357-b66f-4519-9e8f-50155d6c7658 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:51.047457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1168f357-b66f-4519-9e8f-50155d6c7658 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:51.057229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1168f357-b66f-4519-9e8f-50155d6c7658 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:51.057924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1168f357-b66f-4519-9e8f-50155d6c7658 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:51.060256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1168f357-b66f-4519-9e8f-50155d6c7658 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:51.061682 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1168f357-b66f-4519-9e8f-50155d6c7658 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:51.111099 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1168f357-b66f-4519-9e8f-50155d6c7658 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action" status: 200 len: 14 microversion: 2.1 time: 0.069191 Mar 05 21:05:51.111782 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2089/4207] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:51 2022] POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:05:51.807050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-78a3dda6-d2ba-400c-b699-ebbfc1f24bac tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2128954639", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:51.812019 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-78a3dda6-d2ba-400c-b699-ebbfc1f24bac tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] HTTP exception thrown: min_count must be <= max_count Mar 05 21:05:51.813176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-78a3dda6-d2ba-400c-b699-ebbfc1f24bac tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] Returning 400 to user: min_count must be <= max_count {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:51.813472 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-78a3dda6-d2ba-400c-b699-ebbfc1f24bac tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.350937 Mar 05 21:05:51.814085 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2119/4208] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:05:51 2022] POST /compute/v2.1/servers => generated 74 bytes in 352 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 05 21:05:51.902348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2059d638-3217-44fa-8c01-02e700f60812 tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1066654466", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "max_count": 0}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:51.903991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2059d638-3217-44fa-8c01-02e700f60812 tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:51.905224 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2059d638-3217-44fa-8c01-02e700f60812 tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021146 Mar 05 21:05:51.905966 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2090/4209] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:05:51 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:05:52.125019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5716ea84-eb79-435f-a640-18e84957868b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:52.126457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5716ea84-eb79-435f-a640-18e84957868b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:52.146542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5716ea84-eb79-435f-a640-18e84957868b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:52.149996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5716ea84-eb79-435f-a640-18e84957868b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:52.158330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5716ea84-eb79-435f-a640-18e84957868b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:52.159009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5716ea84-eb79-435f-a640-18e84957868b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:52.225192 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5716ea84-eb79-435f-a640-18e84957868b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action" status: 200 len: 14 microversion: 2.1 time: 0.106507 Mar 05 21:05:52.229862 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2091/4210] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:52 2022] POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:05:52.242012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-19491820-ca20-4b54-a43e-1ee422488f2c tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1007745018", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "max_count": 2.5}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:52.243472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-19491820-ca20-4b54-a43e-1ee422488f2c tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:52.248560 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-19491820-ca20-4b54-a43e-1ee422488f2c tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.014524 Mar 05 21:05:52.263381 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2092/4211] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:05:52 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:05:52.357196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d932769d-8b7f-464b-9c1c-435eeac4f7ed tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1178422239", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "min_count": 0}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:52.360236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-541886756", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": "none"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:52.361852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d932769d-8b7f-464b-9c1c-435eeac4f7ed tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:52.368028 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d932769d-8b7f-464b-9c1c-435eeac4f7ed tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019011 Mar 05 21:05:52.368980 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2093/4212] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:05:52 2022] POST /compute/v2.1/servers => generated 130 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:05:52.442359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:05:52.442782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:05:52.443276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:05:52.443716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:05:52.444464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:05:52.449974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eda921ce-b1bb-4c5a-b47e-86b4cfb62f89 tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-411700207", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "min_count": 2.5}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:52.451354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eda921ce-b1bb-4c5a-b47e-86b4cfb62f89 tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:05:52.452217 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eda921ce-b1bb-4c5a-b47e-86b4cfb62f89 tempest-MultipleCreateNegativeTestJSON-1990671147 tempest-MultipleCreateNegativeTestJSON-1990671147-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017185 Mar 05 21:05:52.452767 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2094/4213] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:05:52 2022] POST /compute/v2.1/servers => generated 139 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:05:52.465756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:52.466220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:52.467060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:52.467978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:52.494242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Getting quotas for project 6747aa9ae4c44bcbb1f2d9763aed06bd. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:05:52.501087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Getting quotas for user bd3aad24725f49c79d90352a8a18352f and project 6747aa9ae4c44bcbb1f2d9763aed06bd. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:05:52.521673 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:05:52.525246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: b26b5edf-0207-4fca-b548-ba276e282c2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:05:52.587020 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-499cfbbb-2d1e-49e8-bc97-9b270e6428c1 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.570462 Mar 05 21:05:52.588074 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2120/4214] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 21:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 05 21:05:52.601146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2c13bbd1-6731-4e7a-8519-c9aad60786f0 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:52.602619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2c13bbd1-6731-4e7a-8519-c9aad60786f0 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: b26b5edf-0207-4fca-b548-ba276e282c2c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:52.694616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2c13bbd1-6731-4e7a-8519-c9aad60786f0 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:52.708359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2c13bbd1-6731-4e7a-8519-c9aad60786f0 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:52.711369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2c13bbd1-6731-4e7a-8519-c9aad60786f0 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:52.714392 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2c13bbd1-6731-4e7a-8519-c9aad60786f0 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/b26b5edf-0207-4fca-b548-ba276e282c2c" status: 200 len: 1277 microversion: 2.47 time: 0.120572 Mar 05 21:05:52.716292 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2095/4215] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:52 2022] GET /compute/v2.1/servers/b26b5edf-0207-4fca-b548-ba276e282c2c => generated 1277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:05:53.041182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1995430235", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": "none"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:53.164325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:05:53.168730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:05:53.168730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:05:53.168730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:05:53.168730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:05:53.180501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:53.181996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:53.182958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:53.183826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:53.216853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Getting quotas for project 6747aa9ae4c44bcbb1f2d9763aed06bd. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:05:53.223430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Getting quotas for user bd3aad24725f49c79d90352a8a18352f and project 6747aa9ae4c44bcbb1f2d9763aed06bd. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:05:53.237922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b7b023ce-6fe9-46f2-a9c1-fb7a9b5499a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:53.239009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b7b023ce-6fe9-46f2-a9c1-fb7a9b5499a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:53.250290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:05:53.254607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:05:53.254880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7b023ce-6fe9-46f2-a9c1-fb7a9b5499a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:53.255899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7b023ce-6fe9-46f2-a9c1-fb7a9b5499a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:53.259503 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7b023ce-6fe9-46f2-a9c1-fb7a9b5499a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:53.260051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7b023ce-6fe9-46f2-a9c1-fb7a9b5499a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:53.342005 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b7b023ce-6fe9-46f2-a9c1-fb7a9b5499a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action" status: 200 len: 14 microversion: 2.1 time: 0.108609 Mar 05 21:05:53.342890 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2096/4216] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:53 2022] POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:05:53.353872 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7fa8e61d-da10-4240-8608-390b089071c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.317935 Mar 05 21:05:53.355826 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2121/4217] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 21:05:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 321 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 05 21:05:53.366011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-04cae0b4-a520-4ee6-b909-ebe9ec9fe0c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:53.370196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-04cae0b4-a520-4ee6-b909-ebe9ec9fe0c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:53.493606 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-04cae0b4-a520-4ee6-b909-ebe9ec9fe0c7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "PUT /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 992 microversion: 2.47 time: 0.132542 Mar 05 21:05:53.494614 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2097/4218] 10.222.0.15 () {62 vars in 1296 bytes} [Sat Mar 5 21:05:53 2022] PUT /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 992 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:05:53.511253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d8af9f7f-7f5e-4c8e-8c62-f01cddcb45d0 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:53.511901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d8af9f7f-7f5e-4c8e-8c62-f01cddcb45d0 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:53.629543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d8af9f7f-7f5e-4c8e-8c62-f01cddcb45d0 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:53.644948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d8af9f7f-7f5e-4c8e-8c62-f01cddcb45d0 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:53.651600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d8af9f7f-7f5e-4c8e-8c62-f01cddcb45d0 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:53.654669 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d8af9f7f-7f5e-4c8e-8c62-f01cddcb45d0 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1278 microversion: 2.47 time: 0.148177 Mar 05 21:05:53.657247 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2122/4219] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:53 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:05:54.356231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0552c4c4-f859-4c6a-8d86-a75f20b6896e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:54.358590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0552c4c4-f859-4c6a-8d86-a75f20b6896e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:54.373010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0552c4c4-f859-4c6a-8d86-a75f20b6896e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:54.375826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0552c4c4-f859-4c6a-8d86-a75f20b6896e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:54.379245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0552c4c4-f859-4c6a-8d86-a75f20b6896e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:54.380030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0552c4c4-f859-4c6a-8d86-a75f20b6896e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:54.430253 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0552c4c4-f859-4c6a-8d86-a75f20b6896e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action" status: 200 len: 14 microversion: 2.1 time: 0.079565 Mar 05 21:05:54.431917 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2098/4220] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:54 2022] POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:05:54.675650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:54.677085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:54.689777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:54.691823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:54.692922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:54.696805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:54.859997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:54.876404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:54.878250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:54.882252 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1330 microversion: 2.47 time: 0.210125 Mar 05 21:05:54.893811 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2123/4221] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:54 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1330 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:05:55.444427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-edcd9c45-916b-4b68-a22c-69950d5bd662 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:55.446251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-edcd9c45-916b-4b68-a22c-69950d5bd662 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:55.466028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edcd9c45-916b-4b68-a22c-69950d5bd662 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:55.467124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edcd9c45-916b-4b68-a22c-69950d5bd662 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:55.470630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edcd9c45-916b-4b68-a22c-69950d5bd662 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:55.472243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edcd9c45-916b-4b68-a22c-69950d5bd662 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:55.512286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:55.513546 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002399 Mar 05 21:05:55.514443 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2124/4222] 10.222.0.15 () {56 vars in 885 bytes} [Sat Mar 5 21:05:55 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 05 21:05:55.521817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:55.525325 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004224 Mar 05 21:05:55.527075 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2125/4223] 10.222.0.15 () {54 vars in 1034 bytes} [Sat Mar 5 21:05:55 2022] GET /compute/v2/ => generated 379 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Mar 05 21:05:55.534428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:55.536324 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002335 Mar 05 21:05:55.537754 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2126/4224] 10.222.0.15 () {54 vars in 1040 bytes} [Sat Mar 5 21:05:55 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:05:55.546717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:55.548404 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-645605ed-3748-4c42-8c23-5564fb2dbf33 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002235 Mar 05 21:05:55.549040 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2127/4225] 10.222.0.15 () {56 vars in 885 bytes} [Sat Mar 5 21:05:55 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 05 21:05:55.560245 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-edcd9c45-916b-4b68-a22c-69950d5bd662 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action" status: 200 len: 14 microversion: 2.1 time: 0.120257 Mar 05 21:05:55.561656 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2099/4226] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:55 2022] POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:05:55.901813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8b0717a0-ed8a-4e02-8cb4-8a6b9de51057 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:55.902447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8b0717a0-ed8a-4e02-8cb4-8a6b9de51057 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:55.921441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b0717a0-ed8a-4e02-8cb4-8a6b9de51057 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:55.922213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b0717a0-ed8a-4e02-8cb4-8a6b9de51057 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:55.923173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b0717a0-ed8a-4e02-8cb4-8a6b9de51057 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:55.928373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b0717a0-ed8a-4e02-8cb4-8a6b9de51057 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:56.039285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8b0717a0-ed8a-4e02-8cb4-8a6b9de51057 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:56.057818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8b0717a0-ed8a-4e02-8cb4-8a6b9de51057 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:56.063819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8b0717a0-ed8a-4e02-8cb4-8a6b9de51057 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:56.068924 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8b0717a0-ed8a-4e02-8cb4-8a6b9de51057 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1336 microversion: 2.47 time: 0.169573 Mar 05 21:05:56.070682 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2128/4227] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:55 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1336 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:05:56.575850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85a2928e-142f-4872-b858-fcae92aedf4f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:56.578251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-85a2928e-142f-4872-b858-fcae92aedf4f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:56.595113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85a2928e-142f-4872-b858-fcae92aedf4f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:56.596397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85a2928e-142f-4872-b858-fcae92aedf4f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:56.597642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85a2928e-142f-4872-b858-fcae92aedf4f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:56.598520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85a2928e-142f-4872-b858-fcae92aedf4f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:56.655537 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-85a2928e-142f-4872-b858-fcae92aedf4f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action" status: 200 len: 14 microversion: 2.1 time: 0.087810 Mar 05 21:05:56.658770 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2100/4228] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:56 2022] POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:05:57.093597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5c36fae9-0f50-47ae-9437-2939366ed870 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:57.094383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5c36fae9-0f50-47ae-9437-2939366ed870 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:57.104110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c36fae9-0f50-47ae-9437-2939366ed870 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:57.108727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c36fae9-0f50-47ae-9437-2939366ed870 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:57.110031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c36fae9-0f50-47ae-9437-2939366ed870 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:57.110747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c36fae9-0f50-47ae-9437-2939366ed870 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:57.236500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5c36fae9-0f50-47ae-9437-2939366ed870 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:57.245017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5c36fae9-0f50-47ae-9437-2939366ed870 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:57.248000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5c36fae9-0f50-47ae-9437-2939366ed870 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:57.249920 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5c36fae9-0f50-47ae-9437-2939366ed870 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1336 microversion: 2.47 time: 0.160377 Mar 05 21:05:57.263166 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2129/4229] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:57 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1336 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:05:57.668821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3d2083bf-639a-4106-a156-276f224e6ad0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:57.671878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3d2083bf-639a-4106-a156-276f224e6ad0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:57.682620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3d2083bf-639a-4106-a156-276f224e6ad0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:57.683244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3d2083bf-639a-4106-a156-276f224e6ad0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:57.684188 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3d2083bf-639a-4106-a156-276f224e6ad0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:57.684884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3d2083bf-639a-4106-a156-276f224e6ad0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:57.729898 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3d2083bf-639a-4106-a156-276f224e6ad0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action" status: 200 len: 14 microversion: 2.1 time: 0.066684 Mar 05 21:05:57.730763 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2101/4230] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:57 2022] POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:05:58.270291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0e98faf0-d9aa-474e-9e63-a257ca04ae37 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:58.272541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0e98faf0-d9aa-474e-9e63-a257ca04ae37 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:58.280659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e98faf0-d9aa-474e-9e63-a257ca04ae37 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:58.281300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e98faf0-d9aa-474e-9e63-a257ca04ae37 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:58.282416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e98faf0-d9aa-474e-9e63-a257ca04ae37 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:58.283022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e98faf0-d9aa-474e-9e63-a257ca04ae37 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:58.684519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0e98faf0-d9aa-474e-9e63-a257ca04ae37 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:58.692734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0e98faf0-d9aa-474e-9e63-a257ca04ae37 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:58.696979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0e98faf0-d9aa-474e-9e63-a257ca04ae37 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:58.698213 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0e98faf0-d9aa-474e-9e63-a257ca04ae37 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1357 microversion: 2.47 time: 0.432001 Mar 05 21:05:58.698796 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2130/4231] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:58 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1357 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:05:58.720453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:58.721979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:58.730752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:58.731209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:58.732454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:58.733068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:58.741564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-343abbb1-4fcc-4205-83b8-f685f5728f8c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:58.742898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-343abbb1-4fcc-4205-83b8-f685f5728f8c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:58.750039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-343abbb1-4fcc-4205-83b8-f685f5728f8c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:58.750708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-343abbb1-4fcc-4205-83b8-f685f5728f8c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:58.751977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-343abbb1-4fcc-4205-83b8-f685f5728f8c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:58.752717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-343abbb1-4fcc-4205-83b8-f685f5728f8c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:58.830411 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-343abbb1-4fcc-4205-83b8-f685f5728f8c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action" status: 200 len: 14 microversion: 2.1 time: 0.089447 Mar 05 21:05:58.831094 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2131/4232] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:58 2022] POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 05 21:05:58.882007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:05:58.883266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:05:58.889304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:05:58.890617 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:05:58.894289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:05:58.969802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:58.978699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:58.979071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:58.985541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:58.987112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:59.027798 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cd4fa7c8-3fd3-4ff0-8ba6-56078d019549 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "POST /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab/action" status: 202 len: 1079 microversion: 2.47 time: 0.312069 Mar 05 21:05:59.028545 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2102/4233] 10.222.0.15 () {62 vars in 1318 bytes} [Sat Mar 5 21:05:58 2022] POST /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab/action => generated 1079 bytes in 314 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 05 21:05:59.048112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fcd20cf4-364c-4b0a-b9c5-a39f7a24dc09 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:05:59.049690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fcd20cf4-364c-4b0a-b9c5-a39f7a24dc09 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:59.062074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fcd20cf4-364c-4b0a-b9c5-a39f7a24dc09 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:59.064099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fcd20cf4-364c-4b0a-b9c5-a39f7a24dc09 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:59.067314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fcd20cf4-364c-4b0a-b9c5-a39f7a24dc09 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:59.068049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fcd20cf4-364c-4b0a-b9c5-a39f7a24dc09 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:59.167316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fcd20cf4-364c-4b0a-b9c5-a39f7a24dc09 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:59.176713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fcd20cf4-364c-4b0a-b9c5-a39f7a24dc09 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:59.179045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fcd20cf4-364c-4b0a-b9c5-a39f7a24dc09 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:05:59.180645 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fcd20cf4-364c-4b0a-b9c5-a39f7a24dc09 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.138611 Mar 05 21:05:59.181386 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2132/4234] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:05:59 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:05:59.843878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e73ce03d-f23d-4579-8e41-2aea7c893880 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:05:59.847133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e73ce03d-f23d-4579-8e41-2aea7c893880 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:05:59.858967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e73ce03d-f23d-4579-8e41-2aea7c893880 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:59.861246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e73ce03d-f23d-4579-8e41-2aea7c893880 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:59.861246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e73ce03d-f23d-4579-8e41-2aea7c893880 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:05:59.862014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e73ce03d-f23d-4579-8e41-2aea7c893880 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:05:59.940153 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e73ce03d-f23d-4579-8e41-2aea7c893880 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action" status: 200 len: 14 microversion: 2.1 time: 0.100971 Mar 05 21:05:59.940854 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2103/4235] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:05:59 2022] POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:06:00.203359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-73e82133-1b8f-4e6c-ab37-ea51a604adbb tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:00.205004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-73e82133-1b8f-4e6c-ab37-ea51a604adbb tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:00.212866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-73e82133-1b8f-4e6c-ab37-ea51a604adbb tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:00.213330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-73e82133-1b8f-4e6c-ab37-ea51a604adbb tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:00.214111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-73e82133-1b8f-4e6c-ab37-ea51a604adbb tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:00.214558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-73e82133-1b8f-4e6c-ab37-ea51a604adbb tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:00.294717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-73e82133-1b8f-4e6c-ab37-ea51a604adbb tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:00.307235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-73e82133-1b8f-4e6c-ab37-ea51a604adbb tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:00.309667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-73e82133-1b8f-4e6c-ab37-ea51a604adbb tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:00.311189 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-73e82133-1b8f-4e6c-ab37-ea51a604adbb tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.112775 Mar 05 21:06:00.312445 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2133/4236] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:00 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:00.952534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a0db5191-91e0-4926-9af9-b8437cca4a95 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:00.953646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a0db5191-91e0-4926-9af9-b8437cca4a95 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:00.961750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0db5191-91e0-4926-9af9-b8437cca4a95 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:00.962202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0db5191-91e0-4926-9af9-b8437cca4a95 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:00.963350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0db5191-91e0-4926-9af9-b8437cca4a95 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:00.963980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0db5191-91e0-4926-9af9-b8437cca4a95 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:01.008666 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a0db5191-91e0-4926-9af9-b8437cca4a95 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action" status: 200 len: 14 microversion: 2.1 time: 0.061021 Mar 05 21:06:01.009608 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2104/4237] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:06:00 2022] POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 05 21:06:01.332033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5379bfc5-44ee-48ec-a47b-eb22cf7a370f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:01.333402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5379bfc5-44ee-48ec-a47b-eb22cf7a370f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:01.344884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5379bfc5-44ee-48ec-a47b-eb22cf7a370f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:01.345910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5379bfc5-44ee-48ec-a47b-eb22cf7a370f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:01.347188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5379bfc5-44ee-48ec-a47b-eb22cf7a370f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:01.349446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5379bfc5-44ee-48ec-a47b-eb22cf7a370f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:01.429560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5379bfc5-44ee-48ec-a47b-eb22cf7a370f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:01.439715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5379bfc5-44ee-48ec-a47b-eb22cf7a370f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:01.441626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5379bfc5-44ee-48ec-a47b-eb22cf7a370f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:01.443525 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5379bfc5-44ee-48ec-a47b-eb22cf7a370f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.116277 Mar 05 21:06:01.445268 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2134/4238] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:01 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:02.027263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1d30b436-938b-47b3-9108-6cd129780a1b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:02.028551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1d30b436-938b-47b3-9108-6cd129780a1b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:02.044337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d30b436-938b-47b3-9108-6cd129780a1b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:02.046916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d30b436-938b-47b3-9108-6cd129780a1b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:02.050428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d30b436-938b-47b3-9108-6cd129780a1b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:02.051200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d30b436-938b-47b3-9108-6cd129780a1b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:02.115031 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1d30b436-938b-47b3-9108-6cd129780a1b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action" status: 200 len: 8206 microversion: 2.1 time: 0.096527 Mar 05 21:06:02.117917 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2105/4239] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:06:02 2022] POST /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df/action => generated 8206 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:02.128926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-77e56431-5348-4aa1-86fe-c7c65a70c9d2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:02.129549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-77e56431-5348-4aa1-86fe-c7c65a70c9d2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:02.137897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77e56431-5348-4aa1-86fe-c7c65a70c9d2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:02.138774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77e56431-5348-4aa1-86fe-c7c65a70c9d2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:02.139902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77e56431-5348-4aa1-86fe-c7c65a70c9d2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:02.140620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77e56431-5348-4aa1-86fe-c7c65a70c9d2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:02.437910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-77e56431-5348-4aa1-86fe-c7c65a70c9d2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:02.454769 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-77e56431-5348-4aa1-86fe-c7c65a70c9d2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.331749 Mar 05 21:06:02.455773 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2135/4240] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:02 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:02.470155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8b5f9dd8-967e-4b95-a264-8ba33fc66e8a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:02.471662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8b5f9dd8-967e-4b95-a264-8ba33fc66e8a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:02.486196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a2c5dad9-cff7-417b-b814-c695247d11f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:02.487446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a2c5dad9-cff7-417b-b814-c695247d11f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:02.488028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b5f9dd8-967e-4b95-a264-8ba33fc66e8a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:02.489034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b5f9dd8-967e-4b95-a264-8ba33fc66e8a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:02.490268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b5f9dd8-967e-4b95-a264-8ba33fc66e8a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:02.492543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b5f9dd8-967e-4b95-a264-8ba33fc66e8a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:02.498915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2c5dad9-cff7-417b-b814-c695247d11f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:02.500873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2c5dad9-cff7-417b-b814-c695247d11f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:02.501867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2c5dad9-cff7-417b-b814-c695247d11f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:02.502474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2c5dad9-cff7-417b-b814-c695247d11f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:02.662193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8b5f9dd8-967e-4b95-a264-8ba33fc66e8a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:02.676149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8b5f9dd8-967e-4b95-a264-8ba33fc66e8a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:02.679388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8b5f9dd8-967e-4b95-a264-8ba33fc66e8a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:02.681611 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8b5f9dd8-967e-4b95-a264-8ba33fc66e8a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.219449 Mar 05 21:06:02.696401 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2106/4241] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:02 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:02.783147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a2c5dad9-cff7-417b-b814-c695247d11f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:02.794144 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a2c5dad9-cff7-417b-b814-c695247d11f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.315088 Mar 05 21:06:02.795092 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2136/4242] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:02 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:02.817103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-46fc8108-eddf-4bba-af51-f2f695ed8671 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:02.820757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-46fc8108-eddf-4bba-af51-f2f695ed8671 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:02.829436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46fc8108-eddf-4bba-af51-f2f695ed8671 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:02.831004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46fc8108-eddf-4bba-af51-f2f695ed8671 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:02.831859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46fc8108-eddf-4bba-af51-f2f695ed8671 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:02.832490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46fc8108-eddf-4bba-af51-f2f695ed8671 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:03.203041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-46fc8108-eddf-4bba-af51-f2f695ed8671 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:03.216861 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-46fc8108-eddf-4bba-af51-f2f695ed8671 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.405348 Mar 05 21:06:03.218103 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2107/4243] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:02 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:03.237628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8cc79b00-ab98-49d6-9aa0-c36cef4bd59d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:03.238548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8cc79b00-ab98-49d6-9aa0-c36cef4bd59d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:03.247041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cc79b00-ab98-49d6-9aa0-c36cef4bd59d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:03.247813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cc79b00-ab98-49d6-9aa0-c36cef4bd59d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:03.248980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cc79b00-ab98-49d6-9aa0-c36cef4bd59d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:03.249528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cc79b00-ab98-49d6-9aa0-c36cef4bd59d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:03.598665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8cc79b00-ab98-49d6-9aa0-c36cef4bd59d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:03.614686 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8cc79b00-ab98-49d6-9aa0-c36cef4bd59d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.380306 Mar 05 21:06:03.618836 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2137/4244] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:03 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:03.640119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8d928c62-e3be-4031-ba72-4baf3349b75c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:03.641728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8d928c62-e3be-4031-ba72-4baf3349b75c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:03.653977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d928c62-e3be-4031-ba72-4baf3349b75c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:03.656257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d928c62-e3be-4031-ba72-4baf3349b75c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:03.659815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d928c62-e3be-4031-ba72-4baf3349b75c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:03.660578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d928c62-e3be-4031-ba72-4baf3349b75c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:03.705175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-159bdfe3-d94b-4005-ba6c-818a5ce3c78a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:03.706139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-159bdfe3-d94b-4005-ba6c-818a5ce3c78a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:03.716649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-159bdfe3-d94b-4005-ba6c-818a5ce3c78a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:03.722156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-159bdfe3-d94b-4005-ba6c-818a5ce3c78a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:03.723636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-159bdfe3-d94b-4005-ba6c-818a5ce3c78a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:03.724517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-159bdfe3-d94b-4005-ba6c-818a5ce3c78a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:03.781428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8d928c62-e3be-4031-ba72-4baf3349b75c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Locking {{(pid=141478) lock /opt/stack/nova/nova/compute/api.py:4698}} Mar 05 21:06:03.879619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-159bdfe3-d94b-4005-ba6c-818a5ce3c78a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:03.899995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-159bdfe3-d94b-4005-ba6c-818a5ce3c78a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:03.903361 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8d928c62-e3be-4031-ba72-4baf3349b75c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.266285 Mar 05 21:06:03.905217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-159bdfe3-d94b-4005-ba6c-818a5ce3c78a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:03.905727 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2108/4245] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:06:03 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:06:03.912323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6d44dc27-12ac-4c0b-8f91-173b5d394fea tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:03.914715 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-159bdfe3-d94b-4005-ba6c-818a5ce3c78a tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.207973 Mar 05 21:06:03.914859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6d44dc27-12ac-4c0b-8f91-173b5d394fea tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:03.920412 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2138/4246] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:03 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:03.945380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d44dc27-12ac-4c0b-8f91-173b5d394fea tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:03.945380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d44dc27-12ac-4c0b-8f91-173b5d394fea tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:03.945380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d44dc27-12ac-4c0b-8f91-173b5d394fea tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:03.945380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d44dc27-12ac-4c0b-8f91-173b5d394fea tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:04.220605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6d44dc27-12ac-4c0b-8f91-173b5d394fea tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:04.231133 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6d44dc27-12ac-4c0b-8f91-173b5d394fea tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.323916 Mar 05 21:06:04.233984 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2109/4247] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:03 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:04.252225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9b6cbea1-882c-4299-9eec-498c6e43674b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:04.260762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9b6cbea1-882c-4299-9eec-498c6e43674b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:04.260983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9b6cbea1-882c-4299-9eec-498c6e43674b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:04.291728 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-9b6cbea1-882c-4299-9eec-498c6e43674b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] HTTP exception thrown: Instance dc548a05-5226-41f0-a34d-1d44defee56c is locked Mar 05 21:06:04.293918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9b6cbea1-882c-4299-9eec-498c6e43674b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Returning 409 to user: Instance dc548a05-5226-41f0-a34d-1d44defee56c is locked {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:06:04.297225 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9b6cbea1-882c-4299-9eec-498c6e43674b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 409 len: 107 microversion: 2.1 time: 0.047283 Mar 05 21:06:04.299027 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2139/4248] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:06:04 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 107 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:06:04.307823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8d423699-3481-489c-949a-64c0f5fa1a12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:04.308420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8d423699-3481-489c-949a-64c0f5fa1a12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:04.319403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d423699-3481-489c-949a-64c0f5fa1a12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:04.324363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d423699-3481-489c-949a-64c0f5fa1a12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:04.325237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d423699-3481-489c-949a-64c0f5fa1a12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:04.325806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d423699-3481-489c-949a-64c0f5fa1a12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:04.384843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8d423699-3481-489c-949a-64c0f5fa1a12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Unlocking {{(pid=141478) unlock /opt/stack/nova/nova/compute/api.py:4727}} Mar 05 21:06:04.465133 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8d423699-3481-489c-949a-64c0f5fa1a12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.162020 Mar 05 21:06:04.467068 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2110/4249] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:06:04 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:06:04.481515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-11c4e668-e158-4ac3-9d16-98f34967df0c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:04.495123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-11c4e668-e158-4ac3-9d16-98f34967df0c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:04.495921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-11c4e668-e158-4ac3-9d16-98f34967df0c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:04.536038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-11c4e668-e158-4ac3-9d16-98f34967df0c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Going to try to stop instance {{(pid=141479) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 05 21:06:04.619264 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-11c4e668-e158-4ac3-9d16-98f34967df0c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.147311 Mar 05 21:06:04.620298 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2140/4250] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:06:04 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:06:04.630769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c16f87c9-bc96-4a13-af99-c1bac4fe3e99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:04.632240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c16f87c9-bc96-4a13-af99-c1bac4fe3e99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:04.649036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c16f87c9-bc96-4a13-af99-c1bac4fe3e99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:04.652328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c16f87c9-bc96-4a13-af99-c1bac4fe3e99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:04.655482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c16f87c9-bc96-4a13-af99-c1bac4fe3e99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:04.657607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c16f87c9-bc96-4a13-af99-c1bac4fe3e99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:04.949240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d38ef8c2-8fed-4bdb-af48-f3bf5a1a6bc5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:04.952704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d38ef8c2-8fed-4bdb-af48-f3bf5a1a6bc5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:04.968380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d38ef8c2-8fed-4bdb-af48-f3bf5a1a6bc5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:04.970068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d38ef8c2-8fed-4bdb-af48-f3bf5a1a6bc5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:04.973479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d38ef8c2-8fed-4bdb-af48-f3bf5a1a6bc5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:04.974504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d38ef8c2-8fed-4bdb-af48-f3bf5a1a6bc5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:05.095295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d38ef8c2-8fed-4bdb-af48-f3bf5a1a6bc5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:05.107954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d38ef8c2-8fed-4bdb-af48-f3bf5a1a6bc5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:05.112268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d38ef8c2-8fed-4bdb-af48-f3bf5a1a6bc5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:05.113946 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d38ef8c2-8fed-4bdb-af48-f3bf5a1a6bc5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.178995 Mar 05 21:06:05.129358 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2141/4251] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:04 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:05.216070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c16f87c9-bc96-4a13-af99-c1bac4fe3e99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:05.226784 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c16f87c9-bc96-4a13-af99-c1bac4fe3e99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 0.602283 Mar 05 21:06:05.227447 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2111/4252] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:04 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:06.140686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-866a7671-6c97-4f0a-869b-4ec3dc35aa43 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:06.141488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-866a7671-6c97-4f0a-869b-4ec3dc35aa43 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:06.167188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-866a7671-6c97-4f0a-869b-4ec3dc35aa43 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:06.167751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-866a7671-6c97-4f0a-869b-4ec3dc35aa43 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:06.170235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-866a7671-6c97-4f0a-869b-4ec3dc35aa43 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:06.171981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-866a7671-6c97-4f0a-869b-4ec3dc35aa43 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:06.245147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7599b576-ac62-4677-9c99-a76f6af7cb2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:06.245860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7599b576-ac62-4677-9c99-a76f6af7cb2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:06.268814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7599b576-ac62-4677-9c99-a76f6af7cb2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:06.269665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7599b576-ac62-4677-9c99-a76f6af7cb2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:06.274900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7599b576-ac62-4677-9c99-a76f6af7cb2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:06.276445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7599b576-ac62-4677-9c99-a76f6af7cb2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:06.379975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-866a7671-6c97-4f0a-869b-4ec3dc35aa43 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:06.399352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-866a7671-6c97-4f0a-869b-4ec3dc35aa43 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:06.401850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-866a7671-6c97-4f0a-869b-4ec3dc35aa43 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:06.403875 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-866a7671-6c97-4f0a-869b-4ec3dc35aa43 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.268004 Mar 05 21:06:06.405125 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2142/4253] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:06 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:06.869948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7599b576-ac62-4677-9c99-a76f6af7cb2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:06.883525 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7599b576-ac62-4677-9c99-a76f6af7cb2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 0.643175 Mar 05 21:06:06.902922 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2112/4254] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:06 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:06:07.434409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0f09da84-b5e2-41e3-a951-20d8273f05ce tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:07.437035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0f09da84-b5e2-41e3-a951-20d8273f05ce tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:07.484094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f09da84-b5e2-41e3-a951-20d8273f05ce tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:07.485524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f09da84-b5e2-41e3-a951-20d8273f05ce tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:07.489403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f09da84-b5e2-41e3-a951-20d8273f05ce tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:07.491604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f09da84-b5e2-41e3-a951-20d8273f05ce tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:07.748326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0f09da84-b5e2-41e3-a951-20d8273f05ce tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:07.767465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0f09da84-b5e2-41e3-a951-20d8273f05ce tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:07.774925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0f09da84-b5e2-41e3-a951-20d8273f05ce tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:07.779267 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0f09da84-b5e2-41e3-a951-20d8273f05ce tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.357773 Mar 05 21:06:07.781603 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2143/4255] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:07 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:07.925371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-109df750-bad4-4598-a3e0-a5e3b0cd3962 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:07.930297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-109df750-bad4-4598-a3e0-a5e3b0cd3962 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:07.946781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-109df750-bad4-4598-a3e0-a5e3b0cd3962 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:07.947662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-109df750-bad4-4598-a3e0-a5e3b0cd3962 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:07.948824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-109df750-bad4-4598-a3e0-a5e3b0cd3962 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:07.949652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-109df750-bad4-4598-a3e0-a5e3b0cd3962 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:08.576292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-109df750-bad4-4598-a3e0-a5e3b0cd3962 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:08.589462 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-109df750-bad4-4598-a3e0-a5e3b0cd3962 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 0.675603 Mar 05 21:06:08.590061 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2113/4256] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:07 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:08.802540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3b5fe9ae-6063-4eeb-a756-40a9f9b5301b tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:08.806422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3b5fe9ae-6063-4eeb-a756-40a9f9b5301b tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:08.815993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b5fe9ae-6063-4eeb-a756-40a9f9b5301b tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:08.817424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b5fe9ae-6063-4eeb-a756-40a9f9b5301b tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:08.819312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b5fe9ae-6063-4eeb-a756-40a9f9b5301b tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:08.821205 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b5fe9ae-6063-4eeb-a756-40a9f9b5301b tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:09.191617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3b5fe9ae-6063-4eeb-a756-40a9f9b5301b tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:09.201047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3b5fe9ae-6063-4eeb-a756-40a9f9b5301b tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:09.202724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3b5fe9ae-6063-4eeb-a756-40a9f9b5301b tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:09.212223 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3b5fe9ae-6063-4eeb-a756-40a9f9b5301b tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.409638 Mar 05 21:06:09.224116 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2144/4257] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:08 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:09.606737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e7697a14-da1a-456e-8459-64c12c972ac0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:09.607395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e7697a14-da1a-456e-8459-64c12c972ac0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:09.616468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7697a14-da1a-456e-8459-64c12c972ac0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:09.617431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7697a14-da1a-456e-8459-64c12c972ac0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:09.618683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7697a14-da1a-456e-8459-64c12c972ac0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:09.619344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7697a14-da1a-456e-8459-64c12c972ac0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:09.931887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e7697a14-da1a-456e-8459-64c12c972ac0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:09.944440 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e7697a14-da1a-456e-8459-64c12c972ac0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 0.341184 Mar 05 21:06:09.945221 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2114/4258] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:09 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:10.233870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d1396366-3f3d-47bd-932a-659fe278876f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:10.234643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d1396366-3f3d-47bd-932a-659fe278876f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:10.245898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1396366-3f3d-47bd-932a-659fe278876f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:10.248398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1396366-3f3d-47bd-932a-659fe278876f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:10.252669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1396366-3f3d-47bd-932a-659fe278876f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:10.254953 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1396366-3f3d-47bd-932a-659fe278876f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:10.358486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d1396366-3f3d-47bd-932a-659fe278876f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:10.375321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d1396366-3f3d-47bd-932a-659fe278876f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:10.377738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d1396366-3f3d-47bd-932a-659fe278876f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:10.378301 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d1396366-3f3d-47bd-932a-659fe278876f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.149723 Mar 05 21:06:10.378927 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2145/4259] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:10 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:10.965738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-414dbc53-fbb5-4a58-914a-98e4ae9b4e8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:10.966532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-414dbc53-fbb5-4a58-914a-98e4ae9b4e8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:10.977962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-414dbc53-fbb5-4a58-914a-98e4ae9b4e8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:10.978372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-414dbc53-fbb5-4a58-914a-98e4ae9b4e8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:10.979425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-414dbc53-fbb5-4a58-914a-98e4ae9b4e8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:10.980353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-414dbc53-fbb5-4a58-914a-98e4ae9b4e8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:11.401377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-414dbc53-fbb5-4a58-914a-98e4ae9b4e8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:11.408106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-afcdba9e-3873-4c9b-a84d-9d1c4afcc3ed tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:11.408737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-afcdba9e-3873-4c9b-a84d-9d1c4afcc3ed tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:11.433136 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-414dbc53-fbb5-4a58-914a-98e4ae9b4e8f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 0.465311 Mar 05 21:06:11.435894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afcdba9e-3873-4c9b-a84d-9d1c4afcc3ed tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:11.436718 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2115/4260] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:10 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:11.442159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afcdba9e-3873-4c9b-a84d-9d1c4afcc3ed tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:11.443221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afcdba9e-3873-4c9b-a84d-9d1c4afcc3ed tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:11.444031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afcdba9e-3873-4c9b-a84d-9d1c4afcc3ed tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:11.634311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-afcdba9e-3873-4c9b-a84d-9d1c4afcc3ed tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:11.649368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-afcdba9e-3873-4c9b-a84d-9d1c4afcc3ed tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:11.651459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-afcdba9e-3873-4c9b-a84d-9d1c4afcc3ed tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:11.655491 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-afcdba9e-3873-4c9b-a84d-9d1c4afcc3ed tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.263345 Mar 05 21:06:11.656249 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2146/4261] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:11 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:12.452335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a32eaa14-88d7-4720-bdee-e14618db325e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:12.453266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a32eaa14-88d7-4720-bdee-e14618db325e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:12.466681 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a32eaa14-88d7-4720-bdee-e14618db325e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:12.467433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a32eaa14-88d7-4720-bdee-e14618db325e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:12.468281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a32eaa14-88d7-4720-bdee-e14618db325e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:12.468737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a32eaa14-88d7-4720-bdee-e14618db325e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:12.681051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c466a01-d8dd-4cfb-b010-2656397c6eb2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:12.681661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3c466a01-d8dd-4cfb-b010-2656397c6eb2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:12.698336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c466a01-d8dd-4cfb-b010-2656397c6eb2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:12.698774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c466a01-d8dd-4cfb-b010-2656397c6eb2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:12.699571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c466a01-d8dd-4cfb-b010-2656397c6eb2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:12.700040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c466a01-d8dd-4cfb-b010-2656397c6eb2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:12.801523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3c466a01-d8dd-4cfb-b010-2656397c6eb2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:12.814375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3c466a01-d8dd-4cfb-b010-2656397c6eb2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:12.827248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3c466a01-d8dd-4cfb-b010-2656397c6eb2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:12.828829 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3c466a01-d8dd-4cfb-b010-2656397c6eb2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.153874 Mar 05 21:06:12.830026 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2147/4262] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:12 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:06:12.842076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a32eaa14-88d7-4720-bdee-e14618db325e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:12.852951 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a32eaa14-88d7-4720-bdee-e14618db325e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 0.404390 Mar 05 21:06:12.854607 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2116/4263] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:12 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:06:13.850871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d50a0e7-49ac-42d5-91e2-1856dc68ef17 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:13.852230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7d50a0e7-49ac-42d5-91e2-1856dc68ef17 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:13.861882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d50a0e7-49ac-42d5-91e2-1856dc68ef17 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:13.862608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d50a0e7-49ac-42d5-91e2-1856dc68ef17 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:13.863642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d50a0e7-49ac-42d5-91e2-1856dc68ef17 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:13.864277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d50a0e7-49ac-42d5-91e2-1856dc68ef17 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:13.874829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f34c336f-d884-48ff-85ff-f576c3a97558 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:13.876080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f34c336f-d884-48ff-85ff-f576c3a97558 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:13.895457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f34c336f-d884-48ff-85ff-f576c3a97558 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:13.896498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f34c336f-d884-48ff-85ff-f576c3a97558 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:13.898468 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f34c336f-d884-48ff-85ff-f576c3a97558 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:13.899031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f34c336f-d884-48ff-85ff-f576c3a97558 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:14.250667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d50a0e7-49ac-42d5-91e2-1856dc68ef17 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:14.262570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f34c336f-d884-48ff-85ff-f576c3a97558 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:14.267500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d50a0e7-49ac-42d5-91e2-1856dc68ef17 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:14.273446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d50a0e7-49ac-42d5-91e2-1856dc68ef17 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:14.274845 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f34c336f-d884-48ff-85ff-f576c3a97558 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 0.405673 Mar 05 21:06:14.275544 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2117/4264] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:13 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:06:14.277122 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7d50a0e7-49ac-42d5-91e2-1856dc68ef17 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.428767 Mar 05 21:06:14.277809 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2148/4265] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:13 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:15.301009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e132e848-160e-4faf-b9aa-8a85bdcfed98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:15.304257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fb208841-50bb-4b97-b9f4-a524f3e9daee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:15.305174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e132e848-160e-4faf-b9aa-8a85bdcfed98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:15.305847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fb208841-50bb-4b97-b9f4-a524f3e9daee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:15.320648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e132e848-160e-4faf-b9aa-8a85bdcfed98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:15.321108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e132e848-160e-4faf-b9aa-8a85bdcfed98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:15.322004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e132e848-160e-4faf-b9aa-8a85bdcfed98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:15.322479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e132e848-160e-4faf-b9aa-8a85bdcfed98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:15.324520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb208841-50bb-4b97-b9f4-a524f3e9daee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:15.325269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb208841-50bb-4b97-b9f4-a524f3e9daee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:15.326127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb208841-50bb-4b97-b9f4-a524f3e9daee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:15.326565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb208841-50bb-4b97-b9f4-a524f3e9daee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:15.419713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fb208841-50bb-4b97-b9f4-a524f3e9daee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:15.429964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fb208841-50bb-4b97-b9f4-a524f3e9daee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:15.431886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fb208841-50bb-4b97-b9f4-a524f3e9daee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:15.433212 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fb208841-50bb-4b97-b9f4-a524f3e9daee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.140069 Mar 05 21:06:15.433997 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2149/4266] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:15 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:15.678367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e132e848-160e-4faf-b9aa-8a85bdcfed98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:15.695600 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e132e848-160e-4faf-b9aa-8a85bdcfed98 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1656 microversion: 2.1 time: 0.405434 Mar 05 21:06:15.696664 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2118/4267] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:15 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1656 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:15.713921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c6183057-a8b7-46d3-a342-33401fbbc3b3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:15.721449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6183057-a8b7-46d3-a342-33401fbbc3b3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:15.722264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c6183057-a8b7-46d3-a342-33401fbbc3b3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:15.752841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c6183057-a8b7-46d3-a342-33401fbbc3b3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Going to try to start instance {{(pid=141479) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 05 21:06:15.824207 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c6183057-a8b7-46d3-a342-33401fbbc3b3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.113980 Mar 05 21:06:15.828216 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2150/4268] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:06:15 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:06:15.837992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-720689b2-1e0e-4eef-bbc1-ead1c0d0b7b4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:15.839189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-720689b2-1e0e-4eef-bbc1-ead1c0d0b7b4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:15.847130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-720689b2-1e0e-4eef-bbc1-ead1c0d0b7b4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:15.848061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-720689b2-1e0e-4eef-bbc1-ead1c0d0b7b4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:15.851228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-720689b2-1e0e-4eef-bbc1-ead1c0d0b7b4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:15.852005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-720689b2-1e0e-4eef-bbc1-ead1c0d0b7b4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:16.452753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c2363395-e574-4d71-88c7-598e8c0ebb4f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:16.454317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c2363395-e574-4d71-88c7-598e8c0ebb4f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:16.462898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2363395-e574-4d71-88c7-598e8c0ebb4f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:16.464408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2363395-e574-4d71-88c7-598e8c0ebb4f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:16.465763 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2363395-e574-4d71-88c7-598e8c0ebb4f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:16.466923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2363395-e574-4d71-88c7-598e8c0ebb4f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:16.552437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-720689b2-1e0e-4eef-bbc1-ead1c0d0b7b4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:16.560983 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-720689b2-1e0e-4eef-bbc1-ead1c0d0b7b4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1665 microversion: 2.1 time: 0.730341 Mar 05 21:06:16.561657 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2119/4269] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:15 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1665 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:16.632679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c2363395-e574-4d71-88c7-598e8c0ebb4f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:16.642523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c2363395-e574-4d71-88c7-598e8c0ebb4f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:16.644371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c2363395-e574-4d71-88c7-598e8c0ebb4f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:16.646294 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c2363395-e574-4d71-88c7-598e8c0ebb4f tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.197753 Mar 05 21:06:16.648285 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2151/4270] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:16 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:06:17.579979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1c8fb4d1-ba97-4d91-99b9-bad5822c55f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:17.580712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1c8fb4d1-ba97-4d91-99b9-bad5822c55f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:17.588297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c8fb4d1-ba97-4d91-99b9-bad5822c55f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:17.589057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c8fb4d1-ba97-4d91-99b9-bad5822c55f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:17.590193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c8fb4d1-ba97-4d91-99b9-bad5822c55f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:17.590814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c8fb4d1-ba97-4d91-99b9-bad5822c55f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:17.668266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d3edbed1-432b-4d60-a5d2-26e04acac275 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:17.669699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d3edbed1-432b-4d60-a5d2-26e04acac275 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:17.676955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3edbed1-432b-4d60-a5d2-26e04acac275 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:17.677503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3edbed1-432b-4d60-a5d2-26e04acac275 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:17.679729 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3edbed1-432b-4d60-a5d2-26e04acac275 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:17.680251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3edbed1-432b-4d60-a5d2-26e04acac275 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:18.226310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d3edbed1-432b-4d60-a5d2-26e04acac275 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:18.248232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d3edbed1-432b-4d60-a5d2-26e04acac275 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:18.254678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d3edbed1-432b-4d60-a5d2-26e04acac275 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:18.258116 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d3edbed1-432b-4d60-a5d2-26e04acac275 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.594700 Mar 05 21:06:18.270046 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1c8fb4d1-ba97-4d91-99b9-bad5822c55f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:18.275847 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2152/4271] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:17 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:06:18.288303 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1c8fb4d1-ba97-4d91-99b9-bad5822c55f4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1665 microversion: 2.1 time: 0.712079 Mar 05 21:06:18.289180 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2120/4272] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:17 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1665 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:19.298758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-987927a4-e561-41e2-9a09-c1f94763a3e3 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:19.299658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-987927a4-e561-41e2-9a09-c1f94763a3e3 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:19.310465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6d272eb3-62e6-4ca2-820d-521c8e200ad7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:19.311435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6d272eb3-62e6-4ca2-820d-521c8e200ad7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:19.327731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d272eb3-62e6-4ca2-820d-521c8e200ad7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:19.328584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d272eb3-62e6-4ca2-820d-521c8e200ad7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:19.329601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d272eb3-62e6-4ca2-820d-521c8e200ad7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:19.330221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d272eb3-62e6-4ca2-820d-521c8e200ad7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:19.343550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-987927a4-e561-41e2-9a09-c1f94763a3e3 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:19.344872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-987927a4-e561-41e2-9a09-c1f94763a3e3 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:19.346277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-987927a4-e561-41e2-9a09-c1f94763a3e3 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:19.346893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-987927a4-e561-41e2-9a09-c1f94763a3e3 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:19.469055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-987927a4-e561-41e2-9a09-c1f94763a3e3 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:19.528598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-987927a4-e561-41e2-9a09-c1f94763a3e3 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:19.535322 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-987927a4-e561-41e2-9a09-c1f94763a3e3 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:19.538608 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-987927a4-e561-41e2-9a09-c1f94763a3e3 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.251268 Mar 05 21:06:19.542486 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2153/4273] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:19 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:19.887374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6d272eb3-62e6-4ca2-820d-521c8e200ad7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:19.915209 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6d272eb3-62e6-4ca2-820d-521c8e200ad7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.606259 Mar 05 21:06:19.916621 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2121/4274] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:19 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:19.938107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-99d8b8f4-4784-4f81-9580-a2f331903ad6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:19.939232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-99d8b8f4-4784-4f81-9580-a2f331903ad6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:19.954981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99d8b8f4-4784-4f81-9580-a2f331903ad6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:19.957833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99d8b8f4-4784-4f81-9580-a2f331903ad6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:19.963180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99d8b8f4-4784-4f81-9580-a2f331903ad6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:19.965015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99d8b8f4-4784-4f81-9580-a2f331903ad6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:20.561836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-65391145-739e-43f4-aa0e-2bd5636a578d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:20.562465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-65391145-739e-43f4-aa0e-2bd5636a578d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:20.578246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65391145-739e-43f4-aa0e-2bd5636a578d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:20.578712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65391145-739e-43f4-aa0e-2bd5636a578d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:20.579522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65391145-739e-43f4-aa0e-2bd5636a578d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:20.579997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65391145-739e-43f4-aa0e-2bd5636a578d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:20.666017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-99d8b8f4-4784-4f81-9580-a2f331903ad6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:20.676056 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-99d8b8f4-4784-4f81-9580-a2f331903ad6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.746120 Mar 05 21:06:20.676929 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2154/4275] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:19 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:20.697408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dff23848-2d98-4e39-b667-9d4f9da8d648 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:20.701409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dff23848-2d98-4e39-b667-9d4f9da8d648 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:20.714086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dff23848-2d98-4e39-b667-9d4f9da8d648 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:20.716335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dff23848-2d98-4e39-b667-9d4f9da8d648 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:20.717190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dff23848-2d98-4e39-b667-9d4f9da8d648 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:20.717828 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dff23848-2d98-4e39-b667-9d4f9da8d648 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:20.729397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-65391145-739e-43f4-aa0e-2bd5636a578d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:20.739589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-65391145-739e-43f4-aa0e-2bd5636a578d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:20.742321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-65391145-739e-43f4-aa0e-2bd5636a578d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:20.745389 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-65391145-739e-43f4-aa0e-2bd5636a578d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.187821 Mar 05 21:06:20.746501 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2122/4276] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:20 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:20.795041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dff23848-2d98-4e39-b667-9d4f9da8d648 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Unlocking {{(pid=141479) unlock /opt/stack/nova/nova/compute/api.py:4727}} Mar 05 21:06:20.915306 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dff23848-2d98-4e39-b667-9d4f9da8d648 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.218599 Mar 05 21:06:20.917035 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2155/4277] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:06:20 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:06:20.930412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0c8fb058-a7c7-4a75-b9a4-6d119df0877e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:20.931216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0c8fb058-a7c7-4a75-b9a4-6d119df0877e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:20.940943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c8fb058-a7c7-4a75-b9a4-6d119df0877e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:20.941242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c8fb058-a7c7-4a75-b9a4-6d119df0877e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:20.942570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c8fb058-a7c7-4a75-b9a4-6d119df0877e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:20.943302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c8fb058-a7c7-4a75-b9a4-6d119df0877e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:21.767057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1ddea274-e199-4c6a-adb9-961da24001d6 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:21.770029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1ddea274-e199-4c6a-adb9-961da24001d6 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:21.784486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ddea274-e199-4c6a-adb9-961da24001d6 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:21.785367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ddea274-e199-4c6a-adb9-961da24001d6 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:21.786610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ddea274-e199-4c6a-adb9-961da24001d6 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:21.788907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ddea274-e199-4c6a-adb9-961da24001d6 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:21.862503 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0c8fb058-a7c7-4a75-b9a4-6d119df0877e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:21.876345 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0c8fb058-a7c7-4a75-b9a4-6d119df0877e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.951005 Mar 05 21:06:21.877788 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2123/4278] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:20 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:21.899356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-21e04d81-8d0f-45cf-93d5-98e0340d3fcc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:21.901219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-21e04d81-8d0f-45cf-93d5-98e0340d3fcc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:21.909083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21e04d81-8d0f-45cf-93d5-98e0340d3fcc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:21.909820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21e04d81-8d0f-45cf-93d5-98e0340d3fcc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:21.911212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21e04d81-8d0f-45cf-93d5-98e0340d3fcc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:21.912457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21e04d81-8d0f-45cf-93d5-98e0340d3fcc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:21.985318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1ddea274-e199-4c6a-adb9-961da24001d6 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:22.000026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1ddea274-e199-4c6a-adb9-961da24001d6 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:22.002331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1ddea274-e199-4c6a-adb9-961da24001d6 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:22.004745 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1ddea274-e199-4c6a-adb9-961da24001d6 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.244428 Mar 05 21:06:22.005935 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2156/4279] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:21 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:06:22.273221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-21e04d81-8d0f-45cf-93d5-98e0340d3fcc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:22.282919 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-21e04d81-8d0f-45cf-93d5-98e0340d3fcc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.388546 Mar 05 21:06:22.296166 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2124/4280] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:21 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:22.303291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ec74e415-8193-4557-a3ea-ebc538d2bd2c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:22.304774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ec74e415-8193-4557-a3ea-ebc538d2bd2c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:22.312706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec74e415-8193-4557-a3ea-ebc538d2bd2c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:22.313716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec74e415-8193-4557-a3ea-ebc538d2bd2c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:22.314946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec74e415-8193-4557-a3ea-ebc538d2bd2c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:22.315776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec74e415-8193-4557-a3ea-ebc538d2bd2c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:22.596972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ec74e415-8193-4557-a3ea-ebc538d2bd2c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:22.610450 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ec74e415-8193-4557-a3ea-ebc538d2bd2c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.311698 Mar 05 21:06:22.611140 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2157/4281] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:22 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:06:22.629496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-efddc89e-2c81-4495-966d-ca4949a67ab4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:22.629970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-efddc89e-2c81-4495-966d-ca4949a67ab4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:22.639260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-efddc89e-2c81-4495-966d-ca4949a67ab4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:22.640085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-efddc89e-2c81-4495-966d-ca4949a67ab4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:22.641217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-efddc89e-2c81-4495-966d-ca4949a67ab4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:22.641870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-efddc89e-2c81-4495-966d-ca4949a67ab4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:22.734621 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-efddc89e-2c81-4495-966d-ca4949a67ab4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.109581 Mar 05 21:06:22.737139 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2125/4282] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:06:22 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:06:22.747715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6bf56f34-292d-453d-8eda-252756a9a4b0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:22.748426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6bf56f34-292d-453d-8eda-252756a9a4b0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:22.761521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bf56f34-292d-453d-8eda-252756a9a4b0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:22.762096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bf56f34-292d-453d-8eda-252756a9a4b0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:22.762903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bf56f34-292d-453d-8eda-252756a9a4b0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:22.763439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bf56f34-292d-453d-8eda-252756a9a4b0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:23.026249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e083c705-77e7-41a0-b994-5cb4950c8fa2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:23.027112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e083c705-77e7-41a0-b994-5cb4950c8fa2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:23.036704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e083c705-77e7-41a0-b994-5cb4950c8fa2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:23.037193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e083c705-77e7-41a0-b994-5cb4950c8fa2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:23.038052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e083c705-77e7-41a0-b994-5cb4950c8fa2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:23.038508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e083c705-77e7-41a0-b994-5cb4950c8fa2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:23.135542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e083c705-77e7-41a0-b994-5cb4950c8fa2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:23.150455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e083c705-77e7-41a0-b994-5cb4950c8fa2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:23.154014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e083c705-77e7-41a0-b994-5cb4950c8fa2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:23.155534 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e083c705-77e7-41a0-b994-5cb4950c8fa2 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.135515 Mar 05 21:06:23.156808 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2126/4283] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:23 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:06:23.552252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6bf56f34-292d-453d-8eda-252756a9a4b0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:23.580701 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6bf56f34-292d-453d-8eda-252756a9a4b0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1674 microversion: 2.1 time: 0.837553 Mar 05 21:06:23.581669 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2158/4284] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:22 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1674 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:24.175391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ff5ecdda-9328-4c51-b42d-2b1b86596c14 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:24.176661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ff5ecdda-9328-4c51-b42d-2b1b86596c14 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:24.186986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff5ecdda-9328-4c51-b42d-2b1b86596c14 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:24.194202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff5ecdda-9328-4c51-b42d-2b1b86596c14 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:24.195459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff5ecdda-9328-4c51-b42d-2b1b86596c14 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:24.199960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff5ecdda-9328-4c51-b42d-2b1b86596c14 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:24.385861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ff5ecdda-9328-4c51-b42d-2b1b86596c14 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:24.393981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ff5ecdda-9328-4c51-b42d-2b1b86596c14 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:24.395809 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ff5ecdda-9328-4c51-b42d-2b1b86596c14 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:24.397076 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ff5ecdda-9328-4c51-b42d-2b1b86596c14 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.226252 Mar 05 21:06:24.397872 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2127/4285] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:24 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:24.602278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-17f148d7-9071-47a2-94ad-1cad8c3ce2cf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:24.603090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-17f148d7-9071-47a2-94ad-1cad8c3ce2cf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:24.614730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17f148d7-9071-47a2-94ad-1cad8c3ce2cf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:24.615684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17f148d7-9071-47a2-94ad-1cad8c3ce2cf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:24.617936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17f148d7-9071-47a2-94ad-1cad8c3ce2cf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:24.619028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17f148d7-9071-47a2-94ad-1cad8c3ce2cf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:25.085099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-17f148d7-9071-47a2-94ad-1cad8c3ce2cf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:25.093376 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-17f148d7-9071-47a2-94ad-1cad8c3ce2cf tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1654 microversion: 2.1 time: 0.497325 Mar 05 21:06:25.099807 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2159/4286] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:24 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1654 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:06:25.129167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e63ea3bf-022e-4ec0-b103-76fff96977f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:25.129922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e63ea3bf-022e-4ec0-b103-76fff96977f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:25.151439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e63ea3bf-022e-4ec0-b103-76fff96977f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:25.156771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e63ea3bf-022e-4ec0-b103-76fff96977f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:25.156771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e63ea3bf-022e-4ec0-b103-76fff96977f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:25.156771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e63ea3bf-022e-4ec0-b103-76fff96977f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:25.265139 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e63ea3bf-022e-4ec0-b103-76fff96977f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.152093 Mar 05 21:06:25.267330 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2128/4287] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:06:25 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:06:25.278380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0477ce5-c95e-47bc-b366-843b9e231b6f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:25.279230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e0477ce5-c95e-47bc-b366-843b9e231b6f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:25.296569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0477ce5-c95e-47bc-b366-843b9e231b6f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:25.298360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0477ce5-c95e-47bc-b366-843b9e231b6f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:25.304184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0477ce5-c95e-47bc-b366-843b9e231b6f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:25.304962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0477ce5-c95e-47bc-b366-843b9e231b6f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:25.418878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-759df2e5-a915-43d5-8422-fc3c80d7775c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:25.422191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-759df2e5-a915-43d5-8422-fc3c80d7775c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:25.439768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-759df2e5-a915-43d5-8422-fc3c80d7775c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:25.440695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-759df2e5-a915-43d5-8422-fc3c80d7775c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:25.444255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-759df2e5-a915-43d5-8422-fc3c80d7775c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:25.445028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-759df2e5-a915-43d5-8422-fc3c80d7775c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:25.580901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e0477ce5-c95e-47bc-b366-843b9e231b6f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:25.591155 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0477ce5-c95e-47bc-b366-843b9e231b6f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1661 microversion: 2.1 time: 0.318364 Mar 05 21:06:25.592831 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2160/4288] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:25 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1661 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:25.751266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-759df2e5-a915-43d5-8422-fc3c80d7775c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:25.764346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-759df2e5-a915-43d5-8422-fc3c80d7775c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:25.770392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-759df2e5-a915-43d5-8422-fc3c80d7775c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:25.775063 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-759df2e5-a915-43d5-8422-fc3c80d7775c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1366 microversion: 2.47 time: 0.362491 Mar 05 21:06:25.783918 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2129/4289] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:25 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:06:26.610676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f9d08d47-be0c-4849-8176-090690d79d35 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:26.611308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f9d08d47-be0c-4849-8176-090690d79d35 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:26.624051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9d08d47-be0c-4849-8176-090690d79d35 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:26.624895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9d08d47-be0c-4849-8176-090690d79d35 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:26.626063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9d08d47-be0c-4849-8176-090690d79d35 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:26.626681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f9d08d47-be0c-4849-8176-090690d79d35 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:26.794558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-39bf36a1-2651-4cd1-b547-d87277b36d9c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:26.795950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-39bf36a1-2651-4cd1-b547-d87277b36d9c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:26.807516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39bf36a1-2651-4cd1-b547-d87277b36d9c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:26.808004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39bf36a1-2651-4cd1-b547-d87277b36d9c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:26.808785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39bf36a1-2651-4cd1-b547-d87277b36d9c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:26.809482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39bf36a1-2651-4cd1-b547-d87277b36d9c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:26.844259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f9d08d47-be0c-4849-8176-090690d79d35 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:26.852626 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f9d08d47-be0c-4849-8176-090690d79d35 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.246236 Mar 05 21:06:26.855710 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2161/4290] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:26 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:26.870137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-88a8f8b8-a185-4af4-9765-29819548a0ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:26.870889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-88a8f8b8-a185-4af4-9765-29819548a0ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:26.878542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88a8f8b8-a185-4af4-9765-29819548a0ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:26.879489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88a8f8b8-a185-4af4-9765-29819548a0ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:26.881110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88a8f8b8-a185-4af4-9765-29819548a0ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:26.881820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88a8f8b8-a185-4af4-9765-29819548a0ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:27.023210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-39bf36a1-2651-4cd1-b547-d87277b36d9c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:27.035076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-39bf36a1-2651-4cd1-b547-d87277b36d9c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:27.038037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-39bf36a1-2651-4cd1-b547-d87277b36d9c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:27.040370 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-39bf36a1-2651-4cd1-b547-d87277b36d9c tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1372 microversion: 2.47 time: 0.250160 Mar 05 21:06:27.042265 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2130/4291] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:26 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1372 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:27.088369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-88a8f8b8-a185-4af4-9765-29819548a0ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:27.097772 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-88a8f8b8-a185-4af4-9765-29819548a0ef tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.231483 Mar 05 21:06:27.098637 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2162/4292] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:26 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:27.117311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cc0b0491-fdf5-4504-aade-20e8715bd495 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:27.117925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cc0b0491-fdf5-4504-aade-20e8715bd495 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:27.133363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc0b0491-fdf5-4504-aade-20e8715bd495 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:27.134085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc0b0491-fdf5-4504-aade-20e8715bd495 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:27.147572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc0b0491-fdf5-4504-aade-20e8715bd495 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:27.148273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc0b0491-fdf5-4504-aade-20e8715bd495 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:27.798478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cc0b0491-fdf5-4504-aade-20e8715bd495 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:27.808806 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cc0b0491-fdf5-4504-aade-20e8715bd495 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.695714 Mar 05 21:06:27.810025 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2131/4293] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:27 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:06:27.827058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eda8b952-aad3-412a-b146-389637d24ac5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:27.828371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eda8b952-aad3-412a-b146-389637d24ac5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:27.840215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eda8b952-aad3-412a-b146-389637d24ac5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:27.840993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eda8b952-aad3-412a-b146-389637d24ac5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:27.841811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eda8b952-aad3-412a-b146-389637d24ac5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:27.842209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eda8b952-aad3-412a-b146-389637d24ac5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:28.061508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-296252d1-985e-4ecd-8ca6-90e9e51a0c5d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:28.062514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-296252d1-985e-4ecd-8ca6-90e9e51a0c5d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:28.072310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-296252d1-985e-4ecd-8ca6-90e9e51a0c5d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:28.072982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-296252d1-985e-4ecd-8ca6-90e9e51a0c5d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:28.073940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-296252d1-985e-4ecd-8ca6-90e9e51a0c5d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:28.074235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eda8b952-aad3-412a-b146-389637d24ac5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:28.074738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-296252d1-985e-4ecd-8ca6-90e9e51a0c5d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:28.088802 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eda8b952-aad3-412a-b146-389637d24ac5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.264227 Mar 05 21:06:28.090917 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2163/4294] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:27 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:28.110374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-71d2f582-dbdb-428f-b73c-e74c9e6d865b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:28.111008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-71d2f582-dbdb-428f-b73c-e74c9e6d865b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:28.119726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71d2f582-dbdb-428f-b73c-e74c9e6d865b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:28.120276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71d2f582-dbdb-428f-b73c-e74c9e6d865b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:28.121365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71d2f582-dbdb-428f-b73c-e74c9e6d865b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:28.121824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71d2f582-dbdb-428f-b73c-e74c9e6d865b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:28.205013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-296252d1-985e-4ecd-8ca6-90e9e51a0c5d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:28.225283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-296252d1-985e-4ecd-8ca6-90e9e51a0c5d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:28.231192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-296252d1-985e-4ecd-8ca6-90e9e51a0c5d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:28.234208 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-296252d1-985e-4ecd-8ca6-90e9e51a0c5d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1372 microversion: 2.47 time: 0.177956 Mar 05 21:06:28.248490 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2132/4295] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:28 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:28.331928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-71d2f582-dbdb-428f-b73c-e74c9e6d865b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:28.346197 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-71d2f582-dbdb-428f-b73c-e74c9e6d865b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.241560 Mar 05 21:06:28.347816 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2164/4296] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:28 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:28.364713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-81bb7ada-1bce-43d7-9707-c2dc65e391cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:28.366208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-81bb7ada-1bce-43d7-9707-c2dc65e391cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:28.376573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81bb7ada-1bce-43d7-9707-c2dc65e391cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:28.377563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81bb7ada-1bce-43d7-9707-c2dc65e391cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:28.378679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81bb7ada-1bce-43d7-9707-c2dc65e391cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:28.379863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81bb7ada-1bce-43d7-9707-c2dc65e391cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:28.932446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-81bb7ada-1bce-43d7-9707-c2dc65e391cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:28.945583 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-81bb7ada-1bce-43d7-9707-c2dc65e391cb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.584874 Mar 05 21:06:28.947755 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2133/4297] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:28 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:29.254375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a13747f4-d989-43ac-9310-2957078fd112 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:29.256525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a13747f4-d989-43ac-9310-2957078fd112 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:29.268609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a13747f4-d989-43ac-9310-2957078fd112 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:29.277973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a13747f4-d989-43ac-9310-2957078fd112 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:29.280551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a13747f4-d989-43ac-9310-2957078fd112 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:29.281071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a13747f4-d989-43ac-9310-2957078fd112 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:29.592486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a13747f4-d989-43ac-9310-2957078fd112 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:29.600853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a13747f4-d989-43ac-9310-2957078fd112 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:29.606545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a13747f4-d989-43ac-9310-2957078fd112 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:29.613791 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a13747f4-d989-43ac-9310-2957078fd112 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1357 microversion: 2.47 time: 0.363233 Mar 05 21:06:29.614416 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2165/4298] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:29 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1357 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:29.639341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:29.656580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:29.659997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Searching by: {'deleted': False, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 21:06:29.677769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:29.678237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:29.679132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:29.682573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:29.987055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 21:06:30.112820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:30.124978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:30.125826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:30.145405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:30.149992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:30.304258 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6535f907-c6ef-4e97-be53-9fb0661ddbbc tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.669324 Mar 05 21:06:30.316672 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2134/4299] 10.222.0.15 () {60 vars in 1186 bytes} [Sat Mar 5 21:06:29 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:30.331326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e3f6ff1f-140b-441d-b4e5-83fbd3422cfd tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:30.332868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e3f6ff1f-140b-441d-b4e5-83fbd3422cfd tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:30.343753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3f6ff1f-140b-441d-b4e5-83fbd3422cfd tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:30.344571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3f6ff1f-140b-441d-b4e5-83fbd3422cfd tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:30.345645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3f6ff1f-140b-441d-b4e5-83fbd3422cfd tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:30.346309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3f6ff1f-140b-441d-b4e5-83fbd3422cfd tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:30.383919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e3f6ff1f-140b-441d-b4e5-83fbd3422cfd tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:06:30.517749 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e3f6ff1f-140b-441d-b4e5-83fbd3422cfd tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 204 len: 0 microversion: 2.47 time: 0.192111 Mar 05 21:06:30.520183 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2166/4300] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:06:30 2022] DELETE /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:06:30.529138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-16c550bf-4cfc-423e-8f44-cdf79b63dcee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:30.530272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-16c550bf-4cfc-423e-8f44-cdf79b63dcee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:30.537609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16c550bf-4cfc-423e-8f44-cdf79b63dcee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:30.548483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16c550bf-4cfc-423e-8f44-cdf79b63dcee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:30.549427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16c550bf-4cfc-423e-8f44-cdf79b63dcee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:30.549946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16c550bf-4cfc-423e-8f44-cdf79b63dcee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:30.642354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-16c550bf-4cfc-423e-8f44-cdf79b63dcee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:30.655844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-16c550bf-4cfc-423e-8f44-cdf79b63dcee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:30.660154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-16c550bf-4cfc-423e-8f44-cdf79b63dcee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:30.664001 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-16c550bf-4cfc-423e-8f44-cdf79b63dcee tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1363 microversion: 2.47 time: 0.139002 Mar 05 21:06:30.666896 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2135/4301] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:30 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:06:31.686452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-27a84e2a-ad3f-40df-bd7a-94e0fe9865a5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:31.687171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-27a84e2a-ad3f-40df-bd7a-94e0fe9865a5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:31.694965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27a84e2a-ad3f-40df-bd7a-94e0fe9865a5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:31.695430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27a84e2a-ad3f-40df-bd7a-94e0fe9865a5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:31.696412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27a84e2a-ad3f-40df-bd7a-94e0fe9865a5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:31.697040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27a84e2a-ad3f-40df-bd7a-94e0fe9865a5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:31.806908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-27a84e2a-ad3f-40df-bd7a-94e0fe9865a5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:31.827938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-27a84e2a-ad3f-40df-bd7a-94e0fe9865a5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:31.830272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-27a84e2a-ad3f-40df-bd7a-94e0fe9865a5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:31.833507 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-27a84e2a-ad3f-40df-bd7a-94e0fe9865a5 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1363 microversion: 2.47 time: 0.151637 Mar 05 21:06:31.847604 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2167/4302] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:31 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:32.855641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-118697d0-5dcc-4eb2-9470-d54bc39a20f7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:32.856951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-118697d0-5dcc-4eb2-9470-d54bc39a20f7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:32.865358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-118697d0-5dcc-4eb2-9470-d54bc39a20f7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:32.866234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-118697d0-5dcc-4eb2-9470-d54bc39a20f7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:32.867301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-118697d0-5dcc-4eb2-9470-d54bc39a20f7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:32.868095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-118697d0-5dcc-4eb2-9470-d54bc39a20f7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:32.908763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-118697d0-5dcc-4eb2-9470-d54bc39a20f7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:32.909535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-118697d0-5dcc-4eb2-9470-d54bc39a20f7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:32.910066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-118697d0-5dcc-4eb2-9470-d54bc39a20f7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lazy-loading 'fault' on Instance uuid d25a254e-7b70-4a1e-a12f-be2cb54ca5ab {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:06:32.967938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-118697d0-5dcc-4eb2-9470-d54bc39a20f7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:32.984858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-118697d0-5dcc-4eb2-9470-d54bc39a20f7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:32.988464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-118697d0-5dcc-4eb2-9470-d54bc39a20f7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:32.990237 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-118697d0-5dcc-4eb2-9470-d54bc39a20f7 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 200 len: 1368 microversion: 2.47 time: 0.138399 Mar 05 21:06:32.999742 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2136/4303] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:32 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:34.011352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c511aa91-b4c0-4803-8e5d-54d188b52b82 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:34.011997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c511aa91-b4c0-4803-8e5d-54d188b52b82 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: d25a254e-7b70-4a1e-a12f-be2cb54ca5ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:34.028447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c511aa91-b4c0-4803-8e5d-54d188b52b82 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:34.033647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c511aa91-b4c0-4803-8e5d-54d188b52b82 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:34.034552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c511aa91-b4c0-4803-8e5d-54d188b52b82 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:34.036254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c511aa91-b4c0-4803-8e5d-54d188b52b82 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:34.063852 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-c511aa91-b4c0-4803-8e5d-54d188b52b82 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] HTTP exception thrown: Instance d25a254e-7b70-4a1e-a12f-be2cb54ca5ab could not be found. Mar 05 21:06:34.064674 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c511aa91-b4c0-4803-8e5d-54d188b52b82 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Returning 404 to user: Instance d25a254e-7b70-4a1e-a12f-be2cb54ca5ab could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:06:34.065784 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c511aa91-b4c0-4803-8e5d-54d188b52b82 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab" status: 404 len: 111 microversion: 2.47 time: 0.058340 Mar 05 21:06:34.067899 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2168/4304] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:34 2022] GET /compute/v2.1/servers/d25a254e-7b70-4a1e-a12f-be2cb54ca5ab => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:06:34.077450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c8b33456-af48-44e8-95b4-375926c64908 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:34.077936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c8b33456-af48-44e8-95b4-375926c64908 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: b26b5edf-0207-4fca-b548-ba276e282c2c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:34.091737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8b33456-af48-44e8-95b4-375926c64908 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:34.092532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8b33456-af48-44e8-95b4-375926c64908 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:34.093478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8b33456-af48-44e8-95b4-375926c64908 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:34.093936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8b33456-af48-44e8-95b4-375926c64908 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:34.144691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c8b33456-af48-44e8-95b4-375926c64908 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: b26b5edf-0207-4fca-b548-ba276e282c2c] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:06:34.307514 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c8b33456-af48-44e8-95b4-375926c64908 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b26b5edf-0207-4fca-b548-ba276e282c2c" status: 204 len: 0 microversion: 2.47 time: 0.235466 Mar 05 21:06:34.311412 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2137/4305] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:06:34 2022] DELETE /compute/v2.1/servers/b26b5edf-0207-4fca-b548-ba276e282c2c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:06:34.320069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3aeaa176-393c-4603-9aa2-26aa7caceb51 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:34.320674 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3aeaa176-393c-4603-9aa2-26aa7caceb51 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: b26b5edf-0207-4fca-b548-ba276e282c2c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:34.326872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3aeaa176-393c-4603-9aa2-26aa7caceb51 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:34.327330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3aeaa176-393c-4603-9aa2-26aa7caceb51 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:34.328443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3aeaa176-393c-4603-9aa2-26aa7caceb51 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:34.329090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3aeaa176-393c-4603-9aa2-26aa7caceb51 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:34.460452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3aeaa176-393c-4603-9aa2-26aa7caceb51 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:34.472605 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3aeaa176-393c-4603-9aa2-26aa7caceb51 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:34.484020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3aeaa176-393c-4603-9aa2-26aa7caceb51 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:34.486966 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3aeaa176-393c-4603-9aa2-26aa7caceb51 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/b26b5edf-0207-4fca-b548-ba276e282c2c" status: 200 len: 1362 microversion: 2.47 time: 0.171165 Mar 05 21:06:34.502362 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2169/4306] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:34 2022] GET /compute/v2.1/servers/b26b5edf-0207-4fca-b548-ba276e282c2c => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:35.516915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1f2a940f-5db3-4f2d-b97b-ecc05a17d121 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:35.519205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1f2a940f-5db3-4f2d-b97b-ecc05a17d121 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: b26b5edf-0207-4fca-b548-ba276e282c2c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:35.545984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f2a940f-5db3-4f2d-b97b-ecc05a17d121 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:35.548431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f2a940f-5db3-4f2d-b97b-ecc05a17d121 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:35.550832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f2a940f-5db3-4f2d-b97b-ecc05a17d121 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:35.551545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f2a940f-5db3-4f2d-b97b-ecc05a17d121 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:35.681066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1f2a940f-5db3-4f2d-b97b-ecc05a17d121 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:35.700398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1f2a940f-5db3-4f2d-b97b-ecc05a17d121 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:35.704892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1f2a940f-5db3-4f2d-b97b-ecc05a17d121 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:35.707924 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1f2a940f-5db3-4f2d-b97b-ecc05a17d121 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/b26b5edf-0207-4fca-b548-ba276e282c2c" status: 200 len: 1362 microversion: 2.47 time: 0.198882 Mar 05 21:06:35.720683 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2138/4307] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:35 2022] GET /compute/v2.1/servers/b26b5edf-0207-4fca-b548-ba276e282c2c => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:36.731166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7e6c05ef-bceb-4f77-8ecc-8bffac722d25 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:36.731912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7e6c05ef-bceb-4f77-8ecc-8bffac722d25 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: b26b5edf-0207-4fca-b548-ba276e282c2c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:36.744407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e6c05ef-bceb-4f77-8ecc-8bffac722d25 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:36.746600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e6c05ef-bceb-4f77-8ecc-8bffac722d25 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:36.747747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e6c05ef-bceb-4f77-8ecc-8bffac722d25 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:36.756455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e6c05ef-bceb-4f77-8ecc-8bffac722d25 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:36.831823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e6c05ef-bceb-4f77-8ecc-8bffac722d25 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:36.832619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e6c05ef-bceb-4f77-8ecc-8bffac722d25 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:36.833309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-7e6c05ef-bceb-4f77-8ecc-8bffac722d25 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lazy-loading 'fault' on Instance uuid b26b5edf-0207-4fca-b548-ba276e282c2c {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:06:37.498106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7e6c05ef-bceb-4f77-8ecc-8bffac722d25 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:37.506637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7e6c05ef-bceb-4f77-8ecc-8bffac722d25 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:37.509230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7e6c05ef-bceb-4f77-8ecc-8bffac722d25 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd3aad24725f49c79d90352a8a18352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747aa9ae4c44bcbb1f2d9763aed06bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:37.510933 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7e6c05ef-bceb-4f77-8ecc-8bffac722d25 tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/b26b5edf-0207-4fca-b548-ba276e282c2c" status: 200 len: 1367 microversion: 2.47 time: 0.784171 Mar 05 21:06:37.512134 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2170/4308] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:36 2022] GET /compute/v2.1/servers/b26b5edf-0207-4fca-b548-ba276e282c2c => generated 1367 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:38.535148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5eebf79d-d18c-4d8f-b3a3-85a5f310c98d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:38.537842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5eebf79d-d18c-4d8f-b3a3-85a5f310c98d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] [instance: b26b5edf-0207-4fca-b548-ba276e282c2c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:38.559759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5eebf79d-d18c-4d8f-b3a3-85a5f310c98d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:38.560690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5eebf79d-d18c-4d8f-b3a3-85a5f310c98d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:38.561707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5eebf79d-d18c-4d8f-b3a3-85a5f310c98d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:38.562503 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5eebf79d-d18c-4d8f-b3a3-85a5f310c98d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:38.581045 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-5eebf79d-d18c-4d8f-b3a3-85a5f310c98d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] HTTP exception thrown: Instance b26b5edf-0207-4fca-b548-ba276e282c2c could not be found. Mar 05 21:06:38.582867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5eebf79d-d18c-4d8f-b3a3-85a5f310c98d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] Returning 404 to user: Instance b26b5edf-0207-4fca-b548-ba276e282c2c could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:06:38.585775 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5eebf79d-d18c-4d8f-b3a3-85a5f310c98d tempest-ServerShowV247Test-1048988113 tempest-ServerShowV247Test-1048988113-project] 10.222.0.15 "GET /compute/v2.1/servers/b26b5edf-0207-4fca-b548-ba276e282c2c" status: 404 len: 111 microversion: 2.47 time: 0.054874 Mar 05 21:06:38.589176 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2139/4309] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:38 2022] GET /compute/v2.1/servers/b26b5edf-0207-4fca-b548-ba276e282c2c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:06:41.597676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6b3a584c-02be-40e1-bf5a-9cdb6201d75b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:41.599850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6b3a584c-02be-40e1-bf5a-9cdb6201d75b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:41.609654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b3a584c-02be-40e1-bf5a-9cdb6201d75b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:41.610525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b3a584c-02be-40e1-bf5a-9cdb6201d75b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:41.611598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b3a584c-02be-40e1-bf5a-9cdb6201d75b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:41.613179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b3a584c-02be-40e1-bf5a-9cdb6201d75b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:42.535762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6b3a584c-02be-40e1-bf5a-9cdb6201d75b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:42.547202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6b3a584c-02be-40e1-bf5a-9cdb6201d75b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:42.549162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6b3a584c-02be-40e1-bf5a-9cdb6201d75b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:42.550686 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6b3a584c-02be-40e1-bf5a-9cdb6201d75b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 2954 microversion: 2.42 time: 0.959376 Mar 05 21:06:42.564168 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2171/4310] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:06:41 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 2954 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:42.584303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b6f1b270-8988-494b-83d1-ac2fc443ec58 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:42.585673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b6f1b270-8988-494b-83d1-ac2fc443ec58 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:42.592779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6f1b270-8988-494b-83d1-ac2fc443ec58 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:42.593619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6f1b270-8988-494b-83d1-ac2fc443ec58 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:42.594651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6f1b270-8988-494b-83d1-ac2fc443ec58 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:42.595364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b6f1b270-8988-494b-83d1-ac2fc443ec58 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:43.234925 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b6f1b270-8988-494b-83d1-ac2fc443ec58 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.655363 Mar 05 21:06:43.235900 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2140/4311] 10.222.0.15 () {60 vars in 1315 bytes} [Sat Mar 5 21:06:42 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7/os-interface => generated 1831 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:06:44.582156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-255256245", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:44.642479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] validate_networks() for [('009197ce-e0dc-47b9-b8f3-b27f078b9f37', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:06:45.488743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:06:45.489177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:06:45.489757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:06:45.490180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:06:45.490602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:06:45.499568 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:45.500056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:45.501027 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:45.501477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:45.518710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Getting quotas for project def4cea650ac491985dac1868ac5052a. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:06:45.525234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Getting quotas for user 2aa54ee852c148f19a384be2177b19a6 and project def4cea650ac491985dac1868ac5052a. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:06:45.539009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:06:45.541331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:06:45.591913 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5fa9f5e6-b76a-43bf-86f3-87dce191bc6a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.142276 Mar 05 21:06:45.598002 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2172/4312] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:06:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:06:45.604648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bcc40672-a263-49d5-9b8f-1bef89afb2ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:45.605267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bcc40672-a263-49d5-9b8f-1bef89afb2ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:45.724750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bcc40672-a263-49d5-9b8f-1bef89afb2ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:45.737533 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bcc40672-a263-49d5-9b8f-1bef89afb2ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1216 microversion: 2.1 time: 0.137103 Mar 05 21:06:45.739165 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2141/4313] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:45 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1216 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:46.759560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-36cadfb6-d67b-49d2-9c2b-2208855940b3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:46.761021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-36cadfb6-d67b-49d2-9c2b-2208855940b3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:46.779136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36cadfb6-d67b-49d2-9c2b-2208855940b3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:46.782544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36cadfb6-d67b-49d2-9c2b-2208855940b3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:46.783907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36cadfb6-d67b-49d2-9c2b-2208855940b3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:46.785967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36cadfb6-d67b-49d2-9c2b-2208855940b3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:46.950894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-36cadfb6-d67b-49d2-9c2b-2208855940b3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:46.974514 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-36cadfb6-d67b-49d2-9c2b-2208855940b3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1276 microversion: 2.1 time: 0.218520 Mar 05 21:06:46.976579 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2173/4314] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:46 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:47.996631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b32b9fc6-f9a9-4c63-b6e5-d060df0e0f99 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:47.997962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b32b9fc6-f9a9-4c63-b6e5-d060df0e0f99 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:48.009099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b32b9fc6-f9a9-4c63-b6e5-d060df0e0f99 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:48.010017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b32b9fc6-f9a9-4c63-b6e5-d060df0e0f99 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:48.011088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b32b9fc6-f9a9-4c63-b6e5-d060df0e0f99 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:48.011762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b32b9fc6-f9a9-4c63-b6e5-d060df0e0f99 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:48.108058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b32b9fc6-f9a9-4c63-b6e5-d060df0e0f99 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:48.127160 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b32b9fc6-f9a9-4c63-b6e5-d060df0e0f99 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1274 microversion: 2.1 time: 0.135332 Mar 05 21:06:48.128598 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2142/4315] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:47 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1274 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:49.147114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-48bd3c56-e78f-472d-811a-d8d0651c163f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:49.147713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-48bd3c56-e78f-472d-811a-d8d0651c163f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:49.159831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48bd3c56-e78f-472d-811a-d8d0651c163f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:49.160786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48bd3c56-e78f-472d-811a-d8d0651c163f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:49.162908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48bd3c56-e78f-472d-811a-d8d0651c163f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:49.163923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48bd3c56-e78f-472d-811a-d8d0651c163f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:49.712265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-48bd3c56-e78f-472d-811a-d8d0651c163f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:49.731993 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-48bd3c56-e78f-472d-811a-d8d0651c163f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1316 microversion: 2.1 time: 0.589495 Mar 05 21:06:49.732927 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2174/4316] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:49 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:06:50.751040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-84e89fef-ef57-4e01-82a4-44ac224b66e4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:50.751697 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-84e89fef-ef57-4e01-82a4-44ac224b66e4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:50.761431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84e89fef-ef57-4e01-82a4-44ac224b66e4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:50.761986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84e89fef-ef57-4e01-82a4-44ac224b66e4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:50.763171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84e89fef-ef57-4e01-82a4-44ac224b66e4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:50.763989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84e89fef-ef57-4e01-82a4-44ac224b66e4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:51.083784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-84e89fef-ef57-4e01-82a4-44ac224b66e4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:51.101186 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-84e89fef-ef57-4e01-82a4-44ac224b66e4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1316 microversion: 2.1 time: 0.355566 Mar 05 21:06:51.102764 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2143/4317] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:50 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:51.197125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-a68e43db-c06e-4905-b80b-a78c669ef325 req-1d56d4f9-8958-4dc5-b5e3-93ec0c4fb22d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bacfc2c-ea7e-43a5-b26d-af976d17edd9", "tag": "94b1d404-120e-4570-9658-48bf6610ec97"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:51.208669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a68e43db-c06e-4905-b80b-a78c669ef325 req-1d56d4f9-8958-4dc5-b5e3-93ec0c4fb22d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:51.210004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a68e43db-c06e-4905-b80b-a78c669ef325 req-1d56d4f9-8958-4dc5-b5e3-93ec0c4fb22d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:51.231593 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-a68e43db-c06e-4905-b80b-a78c669ef325 req-1d56d4f9-8958-4dc5-b5e3-93ec0c4fb22d service nova] Creating event network-changed:94b1d404-120e-4570-9658-48bf6610ec97 for instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 on nch2-master-1 Mar 05 21:06:51.237263 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-a68e43db-c06e-4905-b80b-a78c669ef325 req-1d56d4f9-8958-4dc5-b5e3-93ec0c4fb22d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044837 Mar 05 21:06:51.237883 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2175/4318] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:06:52.119115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cd460a28-cd18-4348-b5aa-150af57f5350 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:52.119910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cd460a28-cd18-4348-b5aa-150af57f5350 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:52.129464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd460a28-cd18-4348-b5aa-150af57f5350 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:52.130989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd460a28-cd18-4348-b5aa-150af57f5350 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:52.132244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd460a28-cd18-4348-b5aa-150af57f5350 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:52.133247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd460a28-cd18-4348-b5aa-150af57f5350 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:52.463328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cd460a28-cd18-4348-b5aa-150af57f5350 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:52.472043 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cd460a28-cd18-4348-b5aa-150af57f5350 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1316 microversion: 2.1 time: 0.357276 Mar 05 21:06:52.478240 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2144/4319] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:52 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:53.492102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-957085c9-2f26-4d62-9ed3-45b051a091d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:53.493391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-957085c9-2f26-4d62-9ed3-45b051a091d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:53.499801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-957085c9-2f26-4d62-9ed3-45b051a091d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:53.500481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-957085c9-2f26-4d62-9ed3-45b051a091d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:53.501411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-957085c9-2f26-4d62-9ed3-45b051a091d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:53.502033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-957085c9-2f26-4d62-9ed3-45b051a091d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:54.421593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-957085c9-2f26-4d62-9ed3-45b051a091d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:54.429219 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-957085c9-2f26-4d62-9ed3-45b051a091d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1316 microversion: 2.1 time: 0.943623 Mar 05 21:06:54.430020 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2176/4320] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:53 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1316 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:55.092741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23197cac-f303-448e-9d45-f73c5211ddf7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:55.093761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-23197cac-f303-448e-9d45-f73c5211ddf7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:55.105508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23197cac-f303-448e-9d45-f73c5211ddf7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:55.111989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23197cac-f303-448e-9d45-f73c5211ddf7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:55.113041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23197cac-f303-448e-9d45-f73c5211ddf7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:55.114611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23197cac-f303-448e-9d45-f73c5211ddf7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:55.233661 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-23197cac-f303-448e-9d45-f73c5211ddf7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.145304 Mar 05 21:06:55.237137 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2145/4321] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:06:55 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:06:55.242596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-46ce9e1c-adba-4d56-8e71-f4cf292370e0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:55.250923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-46ce9e1c-adba-4d56-8e71-f4cf292370e0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:55.261234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46ce9e1c-adba-4d56-8e71-f4cf292370e0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:55.261705 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46ce9e1c-adba-4d56-8e71-f4cf292370e0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:55.262659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46ce9e1c-adba-4d56-8e71-f4cf292370e0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:55.263113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-46ce9e1c-adba-4d56-8e71-f4cf292370e0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:55.448835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85c9e945-664a-450f-8dcc-ac88d5dc68c5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:55.449991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-85c9e945-664a-450f-8dcc-ac88d5dc68c5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:55.459465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85c9e945-664a-450f-8dcc-ac88d5dc68c5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:55.460629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85c9e945-664a-450f-8dcc-ac88d5dc68c5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:55.465638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85c9e945-664a-450f-8dcc-ac88d5dc68c5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:55.467321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85c9e945-664a-450f-8dcc-ac88d5dc68c5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:55.773746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-46ce9e1c-adba-4d56-8e71-f4cf292370e0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:55.784623 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-46ce9e1c-adba-4d56-8e71-f4cf292370e0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1671 microversion: 2.1 time: 0.545973 Mar 05 21:06:55.785855 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2177/4322] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:55 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1671 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:56.276018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-85c9e945-664a-450f-8dcc-ac88d5dc68c5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:56.283586 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-85c9e945-664a-450f-8dcc-ac88d5dc68c5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1316 microversion: 2.1 time: 0.841195 Mar 05 21:06:56.284271 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2146/4323] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:55 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1316 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:56.580801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f0891d40-ed56-4930-8b3c-24c44401298a tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:56.581278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f0891d40-ed56-4930-8b3c-24c44401298a tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:56.594712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f0891d40-ed56-4930-8b3c-24c44401298a tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:56.595290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f0891d40-ed56-4930-8b3c-24c44401298a tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:56.595987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f0891d40-ed56-4930-8b3c-24c44401298a tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:56.596436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f0891d40-ed56-4930-8b3c-24c44401298a tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:56.646665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f0891d40-ed56-4930-8b3c-24c44401298a tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:06:56.774648 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f0891d40-ed56-4930-8b3c-24c44401298a tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 204 len: 0 microversion: 2.1 time: 0.477755 Mar 05 21:06:56.778335 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2178/4324] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:06:56 2022] DELETE /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:06:56.786403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-09222f62-09d0-4aca-a20f-a74f565474d8 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:56.787361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-09222f62-09d0-4aca-a20f-a74f565474d8 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:56.798634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09222f62-09d0-4aca-a20f-a74f565474d8 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:56.803200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09222f62-09d0-4aca-a20f-a74f565474d8 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:56.804329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09222f62-09d0-4aca-a20f-a74f565474d8 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:56.804631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2b59badc-9aeb-4cea-8e31-252fbd21c6db tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:56.805145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09222f62-09d0-4aca-a20f-a74f565474d8 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:56.806216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2b59badc-9aeb-4cea-8e31-252fbd21c6db tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:56.822903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b59badc-9aeb-4cea-8e31-252fbd21c6db tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:56.825888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b59badc-9aeb-4cea-8e31-252fbd21c6db tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:56.828445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b59badc-9aeb-4cea-8e31-252fbd21c6db tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:56.829921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b59badc-9aeb-4cea-8e31-252fbd21c6db tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:57.389402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2b59badc-9aeb-4cea-8e31-252fbd21c6db tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:57.397676 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2b59badc-9aeb-4cea-8e31-252fbd21c6db tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.598065 Mar 05 21:06:57.399139 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2179/4325] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:56 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:57.404170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dbcfdd3f-5a27-45ca-9b65-adfcff353bdd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:57.405218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dbcfdd3f-5a27-45ca-9b65-adfcff353bdd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:57.413875 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dbcfdd3f-5a27-45ca-9b65-adfcff353bdd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:57.414345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dbcfdd3f-5a27-45ca-9b65-adfcff353bdd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:57.415195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dbcfdd3f-5a27-45ca-9b65-adfcff353bdd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:57.415734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dbcfdd3f-5a27-45ca-9b65-adfcff353bdd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:57.548432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-09222f62-09d0-4aca-a20f-a74f565474d8 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:57.573547 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-09222f62-09d0-4aca-a20f-a74f565474d8 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1733 microversion: 2.1 time: 0.791245 Mar 05 21:06:57.574452 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2147/4326] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:56 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1733 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:57.605547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dbcfdd3f-5a27-45ca-9b65-adfcff353bdd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:57.618308 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dbcfdd3f-5a27-45ca-9b65-adfcff353bdd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1316 microversion: 2.1 time: 0.217259 Mar 05 21:06:57.619055 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2180/4327] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:57 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:58.591374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cd88f48e-e4d8-453d-b995-3af2678150c2 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:58.592106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cd88f48e-e4d8-453d-b995-3af2678150c2 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:58.602323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd88f48e-e4d8-453d-b995-3af2678150c2 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:58.602770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd88f48e-e4d8-453d-b995-3af2678150c2 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:58.604011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd88f48e-e4d8-453d-b995-3af2678150c2 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:58.604663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd88f48e-e4d8-453d-b995-3af2678150c2 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:58.636032 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-117002d6-a8b9-4c11-846d-cc0d74792c8c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:06:58.636653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-117002d6-a8b9-4c11-846d-cc0d74792c8c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:06:58.649870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-117002d6-a8b9-4c11-846d-cc0d74792c8c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:58.650665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-117002d6-a8b9-4c11-846d-cc0d74792c8c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:58.651939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-117002d6-a8b9-4c11-846d-cc0d74792c8c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:58.652591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-117002d6-a8b9-4c11-846d-cc0d74792c8c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:59.185061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cd88f48e-e4d8-453d-b995-3af2678150c2 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:59.193049 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cd88f48e-e4d8-453d-b995-3af2678150c2 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1733 microversion: 2.1 time: 0.605915 Mar 05 21:06:59.193766 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2148/4328] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:58 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1733 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:06:59.201321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-fb0f0ba6-3d68-45b1-a57d-33dbe08bd465 req-bc5bb662-94d1-41ac-bb79-18dae1547526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bacfc2c-ea7e-43a5-b26d-af976d17edd9", "name": "network-vif-plugged", "status": "completed", "tag": "94b1d404-120e-4570-9658-48bf6610ec97"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:06:59.216089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-fb0f0ba6-3d68-45b1-a57d-33dbe08bd465 req-bc5bb662-94d1-41ac-bb79-18dae1547526 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:06:59.217033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-fb0f0ba6-3d68-45b1-a57d-33dbe08bd465 req-bc5bb662-94d1-41ac-bb79-18dae1547526 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:06:59.229936 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-fb0f0ba6-3d68-45b1-a57d-33dbe08bd465 req-bc5bb662-94d1-41ac-bb79-18dae1547526 service nova] Creating event network-vif-plugged:94b1d404-120e-4570-9658-48bf6610ec97 for instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 on nch2-master-1 Mar 05 21:06:59.236345 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-fb0f0ba6-3d68-45b1-a57d-33dbe08bd465 req-bc5bb662-94d1-41ac-bb79-18dae1547526 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041509 Mar 05 21:06:59.237642 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2149/4329] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:06:59.457957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-117002d6-a8b9-4c11-846d-cc0d74792c8c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:06:59.465572 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-117002d6-a8b9-4c11-846d-cc0d74792c8c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1316 microversion: 2.1 time: 0.834466 Mar 05 21:06:59.466436 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2181/4330] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:06:58 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1316 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:00.212319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5021cf4d-82cc-4d08-9e7c-f0ead3be27f5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:00.213773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5021cf4d-82cc-4d08-9e7c-f0ead3be27f5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:00.221032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5021cf4d-82cc-4d08-9e7c-f0ead3be27f5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:00.221495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5021cf4d-82cc-4d08-9e7c-f0ead3be27f5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:00.225978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5021cf4d-82cc-4d08-9e7c-f0ead3be27f5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:00.227258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5021cf4d-82cc-4d08-9e7c-f0ead3be27f5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:00.320234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-4223819c-5c1c-4d1c-bd2d-08ff8165ad37 req-314a7b27-e10f-487c-9011-a4bddfaeb07c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd08295-9236-47d7-adfa-64e97d152d7e", "name": "network-vif-deleted", "tag": "ebe41f7c-d3ac-4d67-a17b-c81e986cf55d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:00.330821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4223819c-5c1c-4d1c-bd2d-08ff8165ad37 req-314a7b27-e10f-487c-9011-a4bddfaeb07c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:00.331558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4223819c-5c1c-4d1c-bd2d-08ff8165ad37 req-314a7b27-e10f-487c-9011-a4bddfaeb07c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:00.344348 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-4223819c-5c1c-4d1c-bd2d-08ff8165ad37 req-314a7b27-e10f-487c-9011-a4bddfaeb07c service nova] Creating event network-vif-deleted:ebe41f7c-d3ac-4d67-a17b-c81e986cf55d for instance 5bd08295-9236-47d7-adfa-64e97d152d7e on nch1-master-1 Mar 05 21:07:00.346208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5021cf4d-82cc-4d08-9e7c-f0ead3be27f5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a3e85dbbe7423893c25e7b45bda8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899872f9f3b243ef89011a53ba07e160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:00.352595 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-4223819c-5c1c-4d1c-bd2d-08ff8165ad37 req-314a7b27-e10f-487c-9011-a4bddfaeb07c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035347 Mar 05 21:07:00.353700 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2182/4331] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:07:00.355761 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5021cf4d-82cc-4d08-9e7c-f0ead3be27f5 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 200 len: 1665 microversion: 2.1 time: 0.148444 Mar 05 21:07:00.377441 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2150/4332] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:00 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 1665 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:00.485163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ca6ebad-ddee-44dc-a279-41ce0dc3209c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:00.486130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ca6ebad-ddee-44dc-a279-41ce0dc3209c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:00.495632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ca6ebad-ddee-44dc-a279-41ce0dc3209c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:00.496437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ca6ebad-ddee-44dc-a279-41ce0dc3209c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:00.497443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ca6ebad-ddee-44dc-a279-41ce0dc3209c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:00.498144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ca6ebad-ddee-44dc-a279-41ce0dc3209c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:00.775220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9ca6ebad-ddee-44dc-a279-41ce0dc3209c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:00.786699 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ca6ebad-ddee-44dc-a279-41ce0dc3209c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1316 microversion: 2.1 time: 0.303320 Mar 05 21:07:00.790200 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2183/4333] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:00 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:01.396579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f05cd98d-1ec7-4fbc-b0b2-003d9329b220 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:01.398211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f05cd98d-1ec7-4fbc-b0b2-003d9329b220 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:01.412767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f05cd98d-1ec7-4fbc-b0b2-003d9329b220 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:01.414420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f05cd98d-1ec7-4fbc-b0b2-003d9329b220 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:01.418026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f05cd98d-1ec7-4fbc-b0b2-003d9329b220 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:01.418508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f05cd98d-1ec7-4fbc-b0b2-003d9329b220 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:01.460194 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-f05cd98d-1ec7-4fbc-b0b2-003d9329b220 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] HTTP exception thrown: Instance 5bd08295-9236-47d7-adfa-64e97d152d7e could not be found. Mar 05 21:07:01.460816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f05cd98d-1ec7-4fbc-b0b2-003d9329b220 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Returning 404 to user: Instance 5bd08295-9236-47d7-adfa-64e97d152d7e could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:01.461668 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f05cd98d-1ec7-4fbc-b0b2-003d9329b220 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 404 len: 111 microversion: 2.1 time: 0.082072 Mar 05 21:07:01.465745 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2151/4334] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:01 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:07:01.809465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3b2fe0bd-72e6-4cb3-bd27-b08c413b6112 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:01.814642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3b2fe0bd-72e6-4cb3-bd27-b08c413b6112 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:01.839865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b2fe0bd-72e6-4cb3-bd27-b08c413b6112 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:01.841264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b2fe0bd-72e6-4cb3-bd27-b08c413b6112 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:01.844757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b2fe0bd-72e6-4cb3-bd27-b08c413b6112 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:01.846748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3b2fe0bd-72e6-4cb3-bd27-b08c413b6112 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:02.511386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b8d19f3b-39c7-4897-be80-21e5551c1373 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:02.513324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b8d19f3b-39c7-4897-be80-21e5551c1373 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:02.523658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8d19f3b-39c7-4897-be80-21e5551c1373 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:02.524536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8d19f3b-39c7-4897-be80-21e5551c1373 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:02.525574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8d19f3b-39c7-4897-be80-21e5551c1373 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:02.526270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8d19f3b-39c7-4897-be80-21e5551c1373 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:02.542202 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-b8d19f3b-39c7-4897-be80-21e5551c1373 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] HTTP exception thrown: Instance 5bd08295-9236-47d7-adfa-64e97d152d7e could not be found. Mar 05 21:07:02.543495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b8d19f3b-39c7-4897-be80-21e5551c1373 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Returning 404 to user: Instance 5bd08295-9236-47d7-adfa-64e97d152d7e could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:02.544617 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b8d19f3b-39c7-4897-be80-21e5551c1373 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 404 len: 111 microversion: 2.1 time: 0.037765 Mar 05 21:07:02.548837 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2152/4335] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:07:02 2022] DELETE /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:07:02.554892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-beb1fd41-c679-4084-9da9-3afe194a2944 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:02.556042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-beb1fd41-c679-4084-9da9-3afe194a2944 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] [instance: 5bd08295-9236-47d7-adfa-64e97d152d7e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:02.563505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-beb1fd41-c679-4084-9da9-3afe194a2944 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:02.564322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-beb1fd41-c679-4084-9da9-3afe194a2944 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:02.565373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-beb1fd41-c679-4084-9da9-3afe194a2944 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:02.566058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-beb1fd41-c679-4084-9da9-3afe194a2944 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:02.588798 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-beb1fd41-c679-4084-9da9-3afe194a2944 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] HTTP exception thrown: Instance 5bd08295-9236-47d7-adfa-64e97d152d7e could not be found. Mar 05 21:07:02.589691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-beb1fd41-c679-4084-9da9-3afe194a2944 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Returning 404 to user: Instance 5bd08295-9236-47d7-adfa-64e97d152d7e could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:02.590809 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-beb1fd41-c679-4084-9da9-3afe194a2944 tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e" status: 404 len: 111 microversion: 2.1 time: 0.040430 Mar 05 21:07:02.591631 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2153/4336] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:02 2022] GET /compute/v2.1/servers/5bd08295-9236-47d7-adfa-64e97d152d7e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:07:02.614017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3b2fe0bd-72e6-4cb3-bd27-b08c413b6112 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:02.623394 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3b2fe0bd-72e6-4cb3-bd27-b08c413b6112 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.821917 Mar 05 21:07:02.624168 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2184/4337] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:01 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:02.814297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-465729762", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:02.909864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] validate_networks() for [('009197ce-e0dc-47b9-b8f3-b27f078b9f37', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:07:03.604390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f328a4df-3067-40ce-9c2c-fc65741a804f tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] Calling method '.version_select at 0x7fed4f6144c0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:03.647940 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f328a4df-3067-40ce-9c2c-fc65741a804f tempest-TestServerBasicOps-1919413773 tempest-TestServerBasicOps-1919413773-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1793312921" status: 202 len: 0 microversion: 2.1 time: 0.047220 Mar 05 21:07:03.648559 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2185/4338] 10.222.0.15 () {58 vars in 1253 bytes} [Sat Mar 5 21:07:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1793312921 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:07:03.852141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:07:03.852817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:07:03.853297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:07:03.853708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:07:03.854123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:07:03.866007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:03.866587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:03.867267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:03.867730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:03.902632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Getting quotas for project def4cea650ac491985dac1868ac5052a. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:07:03.912326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Getting quotas for user 2aa54ee852c148f19a384be2177b19a6 and project def4cea650ac491985dac1868ac5052a. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:07:03.930923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:07:03.938256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:07:04.001626 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-edf2ec39-2c00-4cd8-912b-a9c6a03349ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.191122 Mar 05 21:07:04.003583 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2154/4339] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:07:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:07:04.016175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8b78028f-a02c-44f4-a901-ba04b293ecd0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:04.017123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8b78028f-a02c-44f4-a901-ba04b293ecd0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:04.809651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8b78028f-a02c-44f4-a901-ba04b293ecd0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:04.819221 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8b78028f-a02c-44f4-a901-ba04b293ecd0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 200 len: 1216 microversion: 2.1 time: 0.808663 Mar 05 21:07:04.830869 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2186/4340] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:04 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 1216 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:05.838597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-889ff7a8-8e19-4c55-98cb-7247533aeea9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:05.839224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-889ff7a8-8e19-4c55-98cb-7247533aeea9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:05.853554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-889ff7a8-8e19-4c55-98cb-7247533aeea9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:05.854374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-889ff7a8-8e19-4c55-98cb-7247533aeea9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:05.855192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-889ff7a8-8e19-4c55-98cb-7247533aeea9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:05.855645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-889ff7a8-8e19-4c55-98cb-7247533aeea9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:05.998093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-889ff7a8-8e19-4c55-98cb-7247533aeea9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:06.012480 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-889ff7a8-8e19-4c55-98cb-7247533aeea9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 200 len: 1274 microversion: 2.1 time: 0.177670 Mar 05 21:07:06.013615 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2155/4341] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:05 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:07:07.030276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7b8c13ad-256f-44e5-bc03-f8cb862b1b1e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:07.031439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7b8c13ad-256f-44e5-bc03-f8cb862b1b1e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:07.047021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b8c13ad-256f-44e5-bc03-f8cb862b1b1e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:07.047732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b8c13ad-256f-44e5-bc03-f8cb862b1b1e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:07.048683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b8c13ad-256f-44e5-bc03-f8cb862b1b1e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:07.049270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b8c13ad-256f-44e5-bc03-f8cb862b1b1e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:07.203235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7b8c13ad-256f-44e5-bc03-f8cb862b1b1e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:07.214364 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7b8c13ad-256f-44e5-bc03-f8cb862b1b1e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 200 len: 1274 microversion: 2.1 time: 0.187783 Mar 05 21:07:07.225790 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2187/4342] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:07 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:08.235870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-51ec1b4b-58fc-4956-ae28-d1ea4705bdc5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:08.237603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-51ec1b4b-58fc-4956-ae28-d1ea4705bdc5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:08.249939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-51ec1b4b-58fc-4956-ae28-d1ea4705bdc5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:08.251019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-51ec1b4b-58fc-4956-ae28-d1ea4705bdc5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:08.252079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-51ec1b4b-58fc-4956-ae28-d1ea4705bdc5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:08.253019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-51ec1b4b-58fc-4956-ae28-d1ea4705bdc5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:08.922131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-51ec1b4b-58fc-4956-ae28-d1ea4705bdc5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:08.942629 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-51ec1b4b-58fc-4956-ae28-d1ea4705bdc5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 200 len: 1316 microversion: 2.1 time: 0.708044 Mar 05 21:07:08.955050 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2156/4343] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:08 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 1316 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:09.943772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7373b825-526d-4cde-8dbb-025e1123acab req-0f9b5beb-6737-4779-9a91-0fc155d8b202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c1f962-469b-4cf5-9f61-a158b83a42a9", "tag": "d1163956-93fd-4a9c-b586-9b23092f296b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:09.954000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7373b825-526d-4cde-8dbb-025e1123acab req-0f9b5beb-6737-4779-9a91-0fc155d8b202 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:09.956356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7373b825-526d-4cde-8dbb-025e1123acab req-0f9b5beb-6737-4779-9a91-0fc155d8b202 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:09.969718 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7373b825-526d-4cde-8dbb-025e1123acab req-0f9b5beb-6737-4779-9a91-0fc155d8b202 service nova] Creating event network-changed:d1163956-93fd-4a9c-b586-9b23092f296b for instance 16c1f962-469b-4cf5-9f61-a158b83a42a9 on nch1-master-1 Mar 05 21:07:09.975764 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7373b825-526d-4cde-8dbb-025e1123acab req-0f9b5beb-6737-4779-9a91-0fc155d8b202 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036194 Mar 05 21:07:09.977004 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2157/4344] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:07:09.983308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ec39d5d2-f993-46d1-9f07-075a7a0aaa01 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:09.984274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ec39d5d2-f993-46d1-9f07-075a7a0aaa01 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:09.998037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec39d5d2-f993-46d1-9f07-075a7a0aaa01 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:09.998729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec39d5d2-f993-46d1-9f07-075a7a0aaa01 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:09.999850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec39d5d2-f993-46d1-9f07-075a7a0aaa01 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:10.000486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec39d5d2-f993-46d1-9f07-075a7a0aaa01 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:10.226814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-93c99385-dead-405f-9178-0c621691e80f tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733 tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733-project-admin] Calling method '.version_select at 0x7fed4f76b790>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:10.228478 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:07:10.228478 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 21:07:10.232501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93c99385-dead-405f-9178-0c621691e80f tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733 tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:10.233049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93c99385-dead-405f-9178-0c621691e80f tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733 tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:10.278236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93c99385-dead-405f-9178-0c621691e80f tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733 tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:10.278722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93c99385-dead-405f-9178-0c621691e80f tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733 tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:10.305177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93c99385-dead-405f-9178-0c621691e80f tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733 tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:10.305639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93c99385-dead-405f-9178-0c621691e80f tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733 tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:10.318890 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-93c99385-dead-405f-9178-0c621691e80f tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733 tempest-PortsAdminExtendedAttrsIpV6TestJSON-538609733-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.541962 Mar 05 21:07:10.323054 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2188/4345] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 21:07:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:07:10.696243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ec39d5d2-f993-46d1-9f07-075a7a0aaa01 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:10.704635 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ec39d5d2-f993-46d1-9f07-075a7a0aaa01 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 200 len: 1316 microversion: 2.1 time: 0.726108 Mar 05 21:07:10.705691 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2158/4346] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:09 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 1316 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:11.721827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-04d56fbf-2c4e-4c71-a1fe-20c1eaaa7a76 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:11.722451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-04d56fbf-2c4e-4c71-a1fe-20c1eaaa7a76 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:11.733672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04d56fbf-2c4e-4c71-a1fe-20c1eaaa7a76 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:11.734291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04d56fbf-2c4e-4c71-a1fe-20c1eaaa7a76 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:11.735607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04d56fbf-2c4e-4c71-a1fe-20c1eaaa7a76 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:11.736214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04d56fbf-2c4e-4c71-a1fe-20c1eaaa7a76 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:12.054396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-04d56fbf-2c4e-4c71-a1fe-20c1eaaa7a76 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:12.067728 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-04d56fbf-2c4e-4c71-a1fe-20c1eaaa7a76 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 200 len: 1316 microversion: 2.1 time: 0.348563 Mar 05 21:07:12.068499 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2189/4347] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:11 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:13.084776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fbb81c3b-091c-499a-a707-2303639f45c3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:13.085402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fbb81c3b-091c-499a-a707-2303639f45c3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:13.096137 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbb81c3b-091c-499a-a707-2303639f45c3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:13.096790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbb81c3b-091c-499a-a707-2303639f45c3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:13.098294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbb81c3b-091c-499a-a707-2303639f45c3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:13.098880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbb81c3b-091c-499a-a707-2303639f45c3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:13.640298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fbb81c3b-091c-499a-a707-2303639f45c3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:13.648714 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fbb81c3b-091c-499a-a707-2303639f45c3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 200 len: 1316 microversion: 2.1 time: 0.568173 Mar 05 21:07:13.649893 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2159/4348] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:13 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 1316 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:14.670163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d34511c6-c521-4bea-817a-5a8d34e20eaf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:14.671708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d34511c6-c521-4bea-817a-5a8d34e20eaf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:14.682818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d34511c6-c521-4bea-817a-5a8d34e20eaf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:14.685254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d34511c6-c521-4bea-817a-5a8d34e20eaf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:14.686294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d34511c6-c521-4bea-817a-5a8d34e20eaf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:14.686939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d34511c6-c521-4bea-817a-5a8d34e20eaf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:14.937127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d34511c6-c521-4bea-817a-5a8d34e20eaf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:14.957845 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d34511c6-c521-4bea-817a-5a8d34e20eaf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 200 len: 1316 microversion: 2.1 time: 0.290689 Mar 05 21:07:14.959522 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2190/4349] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:14 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:15.602633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f60daca0-0bb8-4e19-b53c-3cce2eb20e7f req-106c1984-826f-490a-8998-06721764908d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c1f962-469b-4cf5-9f61-a158b83a42a9", "name": "network-vif-plugged", "status": "completed", "tag": "d1163956-93fd-4a9c-b586-9b23092f296b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:15.615225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f60daca0-0bb8-4e19-b53c-3cce2eb20e7f req-106c1984-826f-490a-8998-06721764908d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:15.616016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f60daca0-0bb8-4e19-b53c-3cce2eb20e7f req-106c1984-826f-490a-8998-06721764908d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:15.631499 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f60daca0-0bb8-4e19-b53c-3cce2eb20e7f req-106c1984-826f-490a-8998-06721764908d service nova] Creating event network-vif-plugged:d1163956-93fd-4a9c-b586-9b23092f296b for instance 16c1f962-469b-4cf5-9f61-a158b83a42a9 on nch1-master-1 Mar 05 21:07:15.639135 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f60daca0-0bb8-4e19-b53c-3cce2eb20e7f req-106c1984-826f-490a-8998-06721764908d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041461 Mar 05 21:07:15.641477 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2160/4350] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:07:15.978681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2a87d6ab-76fc-4004-90a9-0e594ada0ad3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:15.980046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2a87d6ab-76fc-4004-90a9-0e594ada0ad3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:15.986863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a87d6ab-76fc-4004-90a9-0e594ada0ad3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:15.987553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a87d6ab-76fc-4004-90a9-0e594ada0ad3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:15.990088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a87d6ab-76fc-4004-90a9-0e594ada0ad3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:15.990722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a87d6ab-76fc-4004-90a9-0e594ada0ad3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:16.293265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2a87d6ab-76fc-4004-90a9-0e594ada0ad3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:16.306957 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2a87d6ab-76fc-4004-90a9-0e594ada0ad3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 200 len: 1316 microversion: 2.1 time: 0.334020 Mar 05 21:07:16.309688 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2191/4351] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:15 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:17.328800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c472002f-2625-403d-9cc2-ec6de9e642ed tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:17.330259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c472002f-2625-403d-9cc2-ec6de9e642ed tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:17.340707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c472002f-2625-403d-9cc2-ec6de9e642ed tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:17.341511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c472002f-2625-403d-9cc2-ec6de9e642ed tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:17.342694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c472002f-2625-403d-9cc2-ec6de9e642ed tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:17.343382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c472002f-2625-403d-9cc2-ec6de9e642ed tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:17.942777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c472002f-2625-403d-9cc2-ec6de9e642ed tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:17.960229 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c472002f-2625-403d-9cc2-ec6de9e642ed tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 200 len: 1505 microversion: 2.1 time: 0.637791 Mar 05 21:07:17.961320 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2161/4352] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:17 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 1505 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:17.978898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fa19d70c-036e-489a-9103-2a519a6d50c0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:17.980032 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fa19d70c-036e-489a-9103-2a519a6d50c0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:17.987717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa19d70c-036e-489a-9103-2a519a6d50c0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:17.989006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa19d70c-036e-489a-9103-2a519a6d50c0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:17.990252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa19d70c-036e-489a-9103-2a519a6d50c0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:17.991016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa19d70c-036e-489a-9103-2a519a6d50c0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:18.040382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fa19d70c-036e-489a-9103-2a519a6d50c0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:07:18.170082 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fa19d70c-036e-489a-9103-2a519a6d50c0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "DELETE /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 204 len: 0 microversion: 2.1 time: 0.195597 Mar 05 21:07:18.173957 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2192/4353] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:07:17 2022] DELETE /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:07:18.180388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0564b092-928e-4d98-98cc-1f44ee696c93 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:18.180998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0564b092-928e-4d98-98cc-1f44ee696c93 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:18.188566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0564b092-928e-4d98-98cc-1f44ee696c93 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:18.189310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0564b092-928e-4d98-98cc-1f44ee696c93 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:18.190551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0564b092-928e-4d98-98cc-1f44ee696c93 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:18.191165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0564b092-928e-4d98-98cc-1f44ee696c93 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:18.662989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0564b092-928e-4d98-98cc-1f44ee696c93 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:18.677855 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0564b092-928e-4d98-98cc-1f44ee696c93 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 200 len: 1511 microversion: 2.1 time: 0.499848 Mar 05 21:07:18.679948 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2162/4354] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:18 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 1511 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:19.695919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5f7918b5-88ef-4224-9730-01d212229409 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:19.697320 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5f7918b5-88ef-4224-9730-01d212229409 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:19.712279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f7918b5-88ef-4224-9730-01d212229409 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:19.715425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f7918b5-88ef-4224-9730-01d212229409 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:19.716545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f7918b5-88ef-4224-9730-01d212229409 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:19.718066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f7918b5-88ef-4224-9730-01d212229409 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:20.885050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5f7918b5-88ef-4224-9730-01d212229409 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:20.894280 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5f7918b5-88ef-4224-9730-01d212229409 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 200 len: 1511 microversion: 2.1 time: 1.203375 Mar 05 21:07:20.898308 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2193/4355] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:19 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 1511 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:21.915300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9707fb7c-9aa0-4114-95b8-873e8795f28a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:21.916168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9707fb7c-9aa0-4114-95b8-873e8795f28a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:21.931039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9707fb7c-9aa0-4114-95b8-873e8795f28a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:21.932146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9707fb7c-9aa0-4114-95b8-873e8795f28a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:21.933680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9707fb7c-9aa0-4114-95b8-873e8795f28a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:21.937219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9707fb7c-9aa0-4114-95b8-873e8795f28a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:21.971161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-acb428ab-49d2-4e3a-bdcd-fa25dca5ae68 req-c49c2736-2d92-4c31-8467-6a25b4f5dbda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c1f962-469b-4cf5-9f61-a158b83a42a9", "name": "network-vif-deleted", "tag": "d1163956-93fd-4a9c-b586-9b23092f296b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:22.002886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-acb428ab-49d2-4e3a-bdcd-fa25dca5ae68 req-c49c2736-2d92-4c31-8467-6a25b4f5dbda service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:22.003371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-acb428ab-49d2-4e3a-bdcd-fa25dca5ae68 req-c49c2736-2d92-4c31-8467-6a25b4f5dbda service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:22.031244 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-acb428ab-49d2-4e3a-bdcd-fa25dca5ae68 req-c49c2736-2d92-4c31-8467-6a25b4f5dbda service nova] Creating event network-vif-deleted:d1163956-93fd-4a9c-b586-9b23092f296b for instance 16c1f962-469b-4cf5-9f61-a158b83a42a9 on nch1-master-1 Mar 05 21:07:22.046972 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-acb428ab-49d2-4e3a-bdcd-fa25dca5ae68 req-c49c2736-2d92-4c31-8467-6a25b4f5dbda service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079501 Mar 05 21:07:22.048137 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2194/4356] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:07:22.102777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9707fb7c-9aa0-4114-95b8-873e8795f28a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:22.124359 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9707fb7c-9aa0-4114-95b8-873e8795f28a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 200 len: 1469 microversion: 2.1 time: 0.210651 Mar 05 21:07:22.132542 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2163/4357] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:21 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 1469 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:23.151134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-26539b4f-2769-4810-8949-e2b242906b10 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:23.152619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-26539b4f-2769-4810-8949-e2b242906b10 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:23.161210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26539b4f-2769-4810-8949-e2b242906b10 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:23.161921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26539b4f-2769-4810-8949-e2b242906b10 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:23.162971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26539b4f-2769-4810-8949-e2b242906b10 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:23.164552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26539b4f-2769-4810-8949-e2b242906b10 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:23.194554 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-26539b4f-2769-4810-8949-e2b242906b10 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 16c1f962-469b-4cf5-9f61-a158b83a42a9 could not be found. Mar 05 21:07:23.196112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-26539b4f-2769-4810-8949-e2b242906b10 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 16c1f962-469b-4cf5-9f61-a158b83a42a9 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:23.197709 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-26539b4f-2769-4810-8949-e2b242906b10 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 404 len: 111 microversion: 2.1 time: 0.051911 Mar 05 21:07:23.199181 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2195/4358] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:23 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:07:23.209596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c545010e-b074-48fd-b830-93ba04231788 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:23.210234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c545010e-b074-48fd-b830-93ba04231788 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:23.220594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c545010e-b074-48fd-b830-93ba04231788 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:23.221993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c545010e-b074-48fd-b830-93ba04231788 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:23.223644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c545010e-b074-48fd-b830-93ba04231788 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:23.226524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c545010e-b074-48fd-b830-93ba04231788 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:23.850401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c545010e-b074-48fd-b830-93ba04231788 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:23.866236 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c545010e-b074-48fd-b830-93ba04231788 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.661921 Mar 05 21:07:23.867150 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2164/4359] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:23 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:24.058877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bd1ef907-04f7-42f1-917f-480e4f125194 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:24.060312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bd1ef907-04f7-42f1-917f-480e4f125194 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:24.062318 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bd1ef907-04f7-42f1-917f-480e4f125194 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.010303 Mar 05 21:07:24.064110 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2196/4360] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:07:24 2022] POST /compute/v2.1/servers => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:07:24.074723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-69f88209-0a58-4779-8d96-dc2b0159f13b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:24.075694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-69f88209-0a58-4779-8d96-dc2b0159f13b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:24.085661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-69f88209-0a58-4779-8d96-dc2b0159f13b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:24.087562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-69f88209-0a58-4779-8d96-dc2b0159f13b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:24.089482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-69f88209-0a58-4779-8d96-dc2b0159f13b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:24.090398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-69f88209-0a58-4779-8d96-dc2b0159f13b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:24.637877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-69f88209-0a58-4779-8d96-dc2b0159f13b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:24.646477 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-69f88209-0a58-4779-8d96-dc2b0159f13b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.577433 Mar 05 21:07:24.647089 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2165/4361] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:24 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:24.671894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0a96c800-2c7e-4d84-a788-98c5a2e0708e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:24.672942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0a96c800-2c7e-4d84-a788-98c5a2e0708e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:24.688183 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0a96c800-2c7e-4d84-a788-98c5a2e0708e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:24.688656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0a96c800-2c7e-4d84-a788-98c5a2e0708e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:24.689526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0a96c800-2c7e-4d84-a788-98c5a2e0708e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:24.689993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0a96c800-2c7e-4d84-a788-98c5a2e0708e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:26.095946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0a96c800-2c7e-4d84-a788-98c5a2e0708e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:26.105366 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0a96c800-2c7e-4d84-a788-98c5a2e0708e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.437238 Mar 05 21:07:26.117962 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2197/4362] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:24 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:28.171107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c12e6f2f-ba46-4c08-b914-b682fd28bf49 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2090440855", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "1b988a6d-e525-416a-98bd-60d0787e1b67", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:28.334300 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-c12e6f2f-ba46-4c08-b914-b682fd28bf49 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Block Device 1b988a6d-e525-416a-98bd-60d0787e1b67 is not bootable. Mar 05 21:07:28.334924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c12e6f2f-ba46-4c08-b914-b682fd28bf49 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Block Device 1b988a6d-e525-416a-98bd-60d0787e1b67 is not bootable. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:28.335807 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c12e6f2f-ba46-4c08-b914-b682fd28bf49 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.170589 Mar 05 21:07:28.336760 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2166/4363] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:07:28 2022] POST /compute/v2.1/servers => generated 110 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:07:28.350938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-14497a83-f974-4d40-9b8b-b5bba353f626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:28.352066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-14497a83-f974-4d40-9b8b-b5bba353f626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:28.358659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14497a83-f974-4d40-9b8b-b5bba353f626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:28.359442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14497a83-f974-4d40-9b8b-b5bba353f626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:28.360432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14497a83-f974-4d40-9b8b-b5bba353f626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:28.361014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14497a83-f974-4d40-9b8b-b5bba353f626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:29.299306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-14497a83-f974-4d40-9b8b-b5bba353f626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:29.309801 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-14497a83-f974-4d40-9b8b-b5bba353f626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.962192 Mar 05 21:07:29.312703 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2198/4364] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:28 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:29.338338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b162137b-670a-4700-88bd-1f5396d54d79 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:29.339016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b162137b-670a-4700-88bd-1f5396d54d79 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:29.355569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b162137b-670a-4700-88bd-1f5396d54d79 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:29.355974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b162137b-670a-4700-88bd-1f5396d54d79 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:29.356934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b162137b-670a-4700-88bd-1f5396d54d79 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:29.357550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b162137b-670a-4700-88bd-1f5396d54d79 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:29.862236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b162137b-670a-4700-88bd-1f5396d54d79 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:29.870952 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b162137b-670a-4700-88bd-1f5396d54d79 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.537403 Mar 05 21:07:29.874686 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2167/4365] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:29 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:29.959438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e42fcb92-e17a-49fb-b9c9-ca23277c6f53 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:29.961299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e42fcb92-e17a-49fb-b9c9-ca23277c6f53 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:29.969529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e42fcb92-e17a-49fb-b9c9-ca23277c6f53 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:29.972551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e42fcb92-e17a-49fb-b9c9-ca23277c6f53 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:29.985760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e42fcb92-e17a-49fb-b9c9-ca23277c6f53 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:29.986965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e42fcb92-e17a-49fb-b9c9-ca23277c6f53 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:30.741472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e42fcb92-e17a-49fb-b9c9-ca23277c6f53 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:30.752820 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e42fcb92-e17a-49fb-b9c9-ca23277c6f53 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 1.197347 Mar 05 21:07:30.758074 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2199/4366] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:29 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:07:30.781993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-be566c9a-5731-46e9-bfa4-ce1b6ea860d1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:30.783358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-be566c9a-5731-46e9-bfa4-ce1b6ea860d1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:30.815773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be566c9a-5731-46e9-bfa4-ce1b6ea860d1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:30.821062 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be566c9a-5731-46e9-bfa4-ce1b6ea860d1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:30.821998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be566c9a-5731-46e9-bfa4-ce1b6ea860d1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:30.829890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be566c9a-5731-46e9-bfa4-ce1b6ea860d1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:31.993191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0a61e41f-5780-4ae8-9dcb-bcc2bffc21af tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-799948050", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "destination_type": "local"}, {"source_type": "volume", "uuid": "aec7721e-406d-4947-9acc-557054b0a1e0", "destination_type": "invalid"}], "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:31.996244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0a61e41f-5780-4ae8-9dcb-bcc2bffc21af tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:31.997830 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0a61e41f-5780-4ae8-9dcb-bcc2bffc21af tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.011084 Mar 05 21:07:32.003596 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2200/4367] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:07:31 2022] POST /compute/v2.1/servers => generated 155 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:07:32.042519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0b2cb7bc-f9d9-4235-8ed9-adcb2995929d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:32.043226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0b2cb7bc-f9d9-4235-8ed9-adcb2995929d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:32.056521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b2cb7bc-f9d9-4235-8ed9-adcb2995929d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:32.056978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b2cb7bc-f9d9-4235-8ed9-adcb2995929d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:32.057783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b2cb7bc-f9d9-4235-8ed9-adcb2995929d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:32.058224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b2cb7bc-f9d9-4235-8ed9-adcb2995929d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:32.381317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-be566c9a-5731-46e9-bfa4-ce1b6ea860d1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:32.396925 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-be566c9a-5731-46e9-bfa4-ce1b6ea860d1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 1.623058 Mar 05 21:07:32.398113 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2168/4368] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:30 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:32.420279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-89100880-c9e7-41b3-9178-1b3a423efb9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:32.421197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-89100880-c9e7-41b3-9178-1b3a423efb9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:32.429774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89100880-c9e7-41b3-9178-1b3a423efb9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:32.430483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89100880-c9e7-41b3-9178-1b3a423efb9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:32.431438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89100880-c9e7-41b3-9178-1b3a423efb9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:32.432077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89100880-c9e7-41b3-9178-1b3a423efb9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:33.065246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-89100880-c9e7-41b3-9178-1b3a423efb9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:33.077079 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-89100880-c9e7-41b3-9178-1b3a423efb9d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.667402 Mar 05 21:07:33.077782 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2169/4369] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:32 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:07:33.095920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dbe0143a-ffed-4613-95d9-a528fe170b50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:33.096841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dbe0143a-ffed-4613-95d9-a528fe170b50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:33.112239 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dbe0143a-ffed-4613-95d9-a528fe170b50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:33.113151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dbe0143a-ffed-4613-95d9-a528fe170b50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:33.115073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dbe0143a-ffed-4613-95d9-a528fe170b50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:33.117569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dbe0143a-ffed-4613-95d9-a528fe170b50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:33.125673 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0b2cb7bc-f9d9-4235-8ed9-adcb2995929d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:33.140519 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0b2cb7bc-f9d9-4235-8ed9-adcb2995929d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.133060 Mar 05 21:07:33.141984 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2201/4370] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:32 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:33.160242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e1a9498f-7264-4924-8e2f-f3bd92236335 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:33.161505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e1a9498f-7264-4924-8e2f-f3bd92236335 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:33.175635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1a9498f-7264-4924-8e2f-f3bd92236335 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:33.176548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1a9498f-7264-4924-8e2f-f3bd92236335 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:33.178895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1a9498f-7264-4924-8e2f-f3bd92236335 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:33.181115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1a9498f-7264-4924-8e2f-f3bd92236335 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:34.120900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dbe0143a-ffed-4613-95d9-a528fe170b50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:34.155416 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dbe0143a-ffed-4613-95d9-a528fe170b50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 1.063985 Mar 05 21:07:34.158500 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2170/4371] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:33 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:34.460191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-880867332", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "5638f6ea-4ec0-488e-a680-99fc30eb719d"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:34.580797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] validate_networks() for [('5638f6ea-4ec0-488e-a680-99fc30eb719d', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:07:34.667948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e1a9498f-7264-4924-8e2f-f3bd92236335 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:34.676086 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e1a9498f-7264-4924-8e2f-f3bd92236335 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.520539 Mar 05 21:07:34.679430 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2202/4372] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:33 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:34.873987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-80406c75-8640-4a6b-8410-f638f19dc508 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-740763132", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:34.875692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-80406c75-8640-4a6b-8410-f638f19dc508 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:34.876854 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-80406c75-8640-4a6b-8410-f638f19dc508 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.007454 Mar 05 21:07:34.877460 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2203/4373] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:07:34 2022] POST /compute/v2.1/servers => generated 624 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 05 21:07:34.898355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dd7195a1-17cc-4293-a62d-465fe4caa7b9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:34.898983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dd7195a1-17cc-4293-a62d-465fe4caa7b9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:34.952824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd7195a1-17cc-4293-a62d-465fe4caa7b9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:34.954658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd7195a1-17cc-4293-a62d-465fe4caa7b9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:34.957598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd7195a1-17cc-4293-a62d-465fe4caa7b9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:34.961714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dd7195a1-17cc-4293-a62d-465fe4caa7b9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:36.340156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dd7195a1-17cc-4293-a62d-465fe4caa7b9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:36.356748 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dd7195a1-17cc-4293-a62d-465fe4caa7b9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.473445 Mar 05 21:07:36.358365 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2204/4374] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:34 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:36.374664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-43122225-0bcf-4ce0-b06c-86d091565b05 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:36.375379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-43122225-0bcf-4ce0-b06c-86d091565b05 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:36.386332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43122225-0bcf-4ce0-b06c-86d091565b05 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:36.389644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43122225-0bcf-4ce0-b06c-86d091565b05 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:36.390624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43122225-0bcf-4ce0-b06c-86d091565b05 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:36.391148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43122225-0bcf-4ce0-b06c-86d091565b05 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:36.980985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:07:36.981555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:07:36.981869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:07:36.982279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:07:36.982683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:07:36.997625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:36.998081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:37.001243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:37.002248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:37.055956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:07:37.072956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for user d2421fee8afc47ea822c5df54a095261 and project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:07:37.103975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:07:37.111205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:07:37.216088 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a1d9bfbc-b6cc-45f8-831a-1137af6119a5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.760102 Mar 05 21:07:37.223114 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2171/4375] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:07:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:07:37.229436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8b1cce5d-7991-44f6-baa7-36ec7c55b503 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:37.230332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8b1cce5d-7991-44f6-baa7-36ec7c55b503 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:37.468132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8b1cce5d-7991-44f6-baa7-36ec7c55b503 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:37.493173 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8b1cce5d-7991-44f6-baa7-36ec7c55b503 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1214 microversion: 2.1 time: 0.268160 Mar 05 21:07:37.493779 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2172/4376] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:37 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1214 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:37.496406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-43122225-0bcf-4ce0-b06c-86d091565b05 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:37.516830 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-43122225-0bcf-4ce0-b06c-86d091565b05 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.146202 Mar 05 21:07:37.517429 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2205/4377] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:36 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:37.666573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c36920e4-2782-4d49-ac2b-99e54926fc3a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:37.668180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c36920e4-2782-4d49-ac2b-99e54926fc3a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:37.669375 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c36920e4-2782-4d49-ac2b-99e54926fc3a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.006825 Mar 05 21:07:37.670823 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2173/4378] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:07:37 2022] POST /compute/v2.1/servers => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:07:37.679840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7ac9f2c1-a96f-4551-bd50-9930686693ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:37.680599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7ac9f2c1-a96f-4551-bd50-9930686693ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:37.692875 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ac9f2c1-a96f-4551-bd50-9930686693ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:37.694700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ac9f2c1-a96f-4551-bd50-9930686693ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:37.695598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ac9f2c1-a96f-4551-bd50-9930686693ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:37.697986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ac9f2c1-a96f-4551-bd50-9930686693ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:38.512052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7c7c4b94-7853-47d8-9278-65ad04f6509b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:38.513345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7c7c4b94-7853-47d8-9278-65ad04f6509b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:38.525278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c7c4b94-7853-47d8-9278-65ad04f6509b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:38.526098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c7c4b94-7853-47d8-9278-65ad04f6509b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:38.527472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c7c4b94-7853-47d8-9278-65ad04f6509b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:38.530762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c7c4b94-7853-47d8-9278-65ad04f6509b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:38.849826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7c7c4b94-7853-47d8-9278-65ad04f6509b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:38.863531 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7c7c4b94-7853-47d8-9278-65ad04f6509b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1266 microversion: 2.1 time: 0.356806 Mar 05 21:07:38.864620 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2174/4379] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:38 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:39.275280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7ac9f2c1-a96f-4551-bd50-9930686693ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:39.283738 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7ac9f2c1-a96f-4551-bd50-9930686693ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.608337 Mar 05 21:07:39.303625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7ee70aec-de7d-4db1-b5b4-c41b806921d3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:39.304689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7ee70aec-de7d-4db1-b5b4-c41b806921d3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:39.308314 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2206/4380] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:37 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:39.312389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ee70aec-de7d-4db1-b5b4-c41b806921d3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:39.313376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ee70aec-de7d-4db1-b5b4-c41b806921d3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:39.314580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ee70aec-de7d-4db1-b5b4-c41b806921d3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:39.315233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ee70aec-de7d-4db1-b5b4-c41b806921d3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:40.041760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-68ebd1fb-c23f-4f3c-88ee-6d5211ec18c1 tempest-PortsAdminExtendedAttrsTestJSON-334586316 tempest-PortsAdminExtendedAttrsTestJSON-334586316-project-admin] Calling method '.version_select at 0x7fed4f5e9ca0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:40.042751 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:07:40.042751 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 21:07:40.044137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68ebd1fb-c23f-4f3c-88ee-6d5211ec18c1 tempest-PortsAdminExtendedAttrsTestJSON-334586316 tempest-PortsAdminExtendedAttrsTestJSON-334586316-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:40.045983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68ebd1fb-c23f-4f3c-88ee-6d5211ec18c1 tempest-PortsAdminExtendedAttrsTestJSON-334586316 tempest-PortsAdminExtendedAttrsTestJSON-334586316-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:40.077297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68ebd1fb-c23f-4f3c-88ee-6d5211ec18c1 tempest-PortsAdminExtendedAttrsTestJSON-334586316 tempest-PortsAdminExtendedAttrsTestJSON-334586316-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:40.078097 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68ebd1fb-c23f-4f3c-88ee-6d5211ec18c1 tempest-PortsAdminExtendedAttrsTestJSON-334586316 tempest-PortsAdminExtendedAttrsTestJSON-334586316-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:40.101744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68ebd1fb-c23f-4f3c-88ee-6d5211ec18c1 tempest-PortsAdminExtendedAttrsTestJSON-334586316 tempest-PortsAdminExtendedAttrsTestJSON-334586316-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:40.102448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68ebd1fb-c23f-4f3c-88ee-6d5211ec18c1 tempest-PortsAdminExtendedAttrsTestJSON-334586316 tempest-PortsAdminExtendedAttrsTestJSON-334586316-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:40.109200 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-68ebd1fb-c23f-4f3c-88ee-6d5211ec18c1 tempest-PortsAdminExtendedAttrsTestJSON-334586316 tempest-PortsAdminExtendedAttrsTestJSON-334586316-project-admin] 10.222.0.15 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.285024 Mar 05 21:07:40.110425 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2207/4381] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 21:07:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:07:40.116106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c1e5b902-894c-46b2-a23a-28cbe9734911 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:40.116996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c1e5b902-894c-46b2-a23a-28cbe9734911 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:40.123491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1e5b902-894c-46b2-a23a-28cbe9734911 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:40.124344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1e5b902-894c-46b2-a23a-28cbe9734911 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:40.125356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1e5b902-894c-46b2-a23a-28cbe9734911 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:40.125986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1e5b902-894c-46b2-a23a-28cbe9734911 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:40.177389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7ee70aec-de7d-4db1-b5b4-c41b806921d3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:40.189813 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7ee70aec-de7d-4db1-b5b4-c41b806921d3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.891383 Mar 05 21:07:40.207845 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2175/4382] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:39 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:40.221217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c1e5b902-894c-46b2-a23a-28cbe9734911 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:40.234811 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c1e5b902-894c-46b2-a23a-28cbe9734911 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1272 microversion: 2.1 time: 0.122947 Mar 05 21:07:40.236613 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2208/4383] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:40 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:40.355868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-367b5326-b07b-4b3a-9372-08e4ab77f797 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1339809934", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": -1, "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:40.372340 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-367b5326-b07b-4b3a-9372-08e4ab77f797 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Flavor -1 could not be found. Mar 05 21:07:40.372956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-367b5326-b07b-4b3a-9372-08e4ab77f797 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:40.373810 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-367b5326-b07b-4b3a-9372-08e4ab77f797 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.022155 Mar 05 21:07:40.379067 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2176/4384] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:07:40 2022] POST /compute/v2.1/servers => generated 73 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 05 21:07:40.387588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b8820c76-ef27-4372-8f11-741e46bbaea7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:40.388931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b8820c76-ef27-4372-8f11-741e46bbaea7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:40.405744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8820c76-ef27-4372-8f11-741e46bbaea7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:40.406228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8820c76-ef27-4372-8f11-741e46bbaea7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:40.407022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8820c76-ef27-4372-8f11-741e46bbaea7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:40.407474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8820c76-ef27-4372-8f11-741e46bbaea7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:41.084717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b8820c76-ef27-4372-8f11-741e46bbaea7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:41.101271 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b8820c76-ef27-4372-8f11-741e46bbaea7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.717608 Mar 05 21:07:41.103251 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2209/4385] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:40 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:41.125390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4bc8e787-9ac1-4806-b024-6333dd0849f0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:41.126279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4bc8e787-9ac1-4806-b024-6333dd0849f0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:41.136251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4bc8e787-9ac1-4806-b024-6333dd0849f0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:41.136940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4bc8e787-9ac1-4806-b024-6333dd0849f0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:41.137918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4bc8e787-9ac1-4806-b024-6333dd0849f0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:41.138500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4bc8e787-9ac1-4806-b024-6333dd0849f0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:41.271926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-52f33a78-2738-44df-8b99-0e7f2eb15bc0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:41.273211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-52f33a78-2738-44df-8b99-0e7f2eb15bc0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:41.294173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52f33a78-2738-44df-8b99-0e7f2eb15bc0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:41.294992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52f33a78-2738-44df-8b99-0e7f2eb15bc0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:41.297056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52f33a78-2738-44df-8b99-0e7f2eb15bc0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:41.298314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52f33a78-2738-44df-8b99-0e7f2eb15bc0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:41.485342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-52f33a78-2738-44df-8b99-0e7f2eb15bc0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:41.506756 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-52f33a78-2738-44df-8b99-0e7f2eb15bc0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1272 microversion: 2.1 time: 0.247675 Mar 05 21:07:41.508568 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2210/4386] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:41 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:07:41.619600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4bc8e787-9ac1-4806-b024-6333dd0849f0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:41.633467 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4bc8e787-9ac1-4806-b024-6333dd0849f0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.510552 Mar 05 21:07:41.634971 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2177/4387] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:41 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:41.745722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-515ed140-f40d-4bf3-b730-6a6d2f1295c6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1662560018", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:41.748127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-515ed140-f40d-4bf3-b730-6a6d2f1295c6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:41.749879 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-515ed140-f40d-4bf3-b730-6a6d2f1295c6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.017258 Mar 05 21:07:41.751129 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2211/4388] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:07:41 2022] POST /compute/v2.1/servers => generated 145 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:07:41.764620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-04913811-1771-4dd4-8939-42e7ff0287f7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:41.775818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-04913811-1771-4dd4-8939-42e7ff0287f7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:41.797397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04913811-1771-4dd4-8939-42e7ff0287f7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:41.798130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04913811-1771-4dd4-8939-42e7ff0287f7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:41.799389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04913811-1771-4dd4-8939-42e7ff0287f7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:41.801629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04913811-1771-4dd4-8939-42e7ff0287f7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:42.528311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4eacff08-b5a0-4d90-ae13-60e52a324386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:42.528952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4eacff08-b5a0-4d90-ae13-60e52a324386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:42.555416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4eacff08-b5a0-4d90-ae13-60e52a324386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:42.562389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4eacff08-b5a0-4d90-ae13-60e52a324386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:42.572337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4eacff08-b5a0-4d90-ae13-60e52a324386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:42.573231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4eacff08-b5a0-4d90-ae13-60e52a324386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:43.187889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-04913811-1771-4dd4-8939-42e7ff0287f7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:43.200498 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-04913811-1771-4dd4-8939-42e7ff0287f7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.444369 Mar 05 21:07:43.201878 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2178/4389] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:41 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:07:43.222845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-edb1d4aa-00f5-4349-923a-2cdac5d97def tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:43.223770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-edb1d4aa-00f5-4349-923a-2cdac5d97def tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:43.232680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edb1d4aa-00f5-4349-923a-2cdac5d97def tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:43.233545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edb1d4aa-00f5-4349-923a-2cdac5d97def tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:43.234576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edb1d4aa-00f5-4349-923a-2cdac5d97def tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:43.235162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-edb1d4aa-00f5-4349-923a-2cdac5d97def tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:43.501430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4eacff08-b5a0-4d90-ae13-60e52a324386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:43.512577 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4eacff08-b5a0-4d90-ae13-60e52a324386 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1314 microversion: 2.1 time: 0.989924 Mar 05 21:07:43.514103 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2212/4390] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:42 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1314 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:07:44.044555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-edb1d4aa-00f5-4349-923a-2cdac5d97def tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:44.063452 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-edb1d4aa-00f5-4349-923a-2cdac5d97def tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.845909 Mar 05 21:07:44.067831 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2179/4391] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:43 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:44.171199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-10fc3620-d85c-48dc-8daf-a52797d1d039 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1802802532", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:44.185636 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-10fc3620-d85c-48dc-8daf-a52797d1d039 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Mar 05 21:07:44.186497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-10fc3620-d85c-48dc-8daf-a52797d1d039 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:44.187579 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-10fc3620-d85c-48dc-8daf-a52797d1d039 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.024745 Mar 05 21:07:44.188569 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2213/4392] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:07:44 2022] POST /compute/v2.1/servers => generated 123 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:07:44.204258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2b442704-252d-486d-ad86-4a20d68303af tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:44.205253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2b442704-252d-486d-ad86-4a20d68303af tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:44.229859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b442704-252d-486d-ad86-4a20d68303af tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:44.231152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b442704-252d-486d-ad86-4a20d68303af tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:44.233020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b442704-252d-486d-ad86-4a20d68303af tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:44.233525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b442704-252d-486d-ad86-4a20d68303af tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:44.546472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eb203027-a056-49b0-a855-76dab8eb6f6a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:44.547434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eb203027-a056-49b0-a855-76dab8eb6f6a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:44.563307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb203027-a056-49b0-a855-76dab8eb6f6a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:44.564855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb203027-a056-49b0-a855-76dab8eb6f6a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:44.568246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb203027-a056-49b0-a855-76dab8eb6f6a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:44.568938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb203027-a056-49b0-a855-76dab8eb6f6a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:45.266214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2b442704-252d-486d-ad86-4a20d68303af tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:45.291530 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2b442704-252d-486d-ad86-4a20d68303af tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.096452 Mar 05 21:07:45.293589 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2180/4393] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:44 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:45.322938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4314e45a-03a7-4e1f-8d1a-91bf8b350e4f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:45.327997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4314e45a-03a7-4e1f-8d1a-91bf8b350e4f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:45.338901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4314e45a-03a7-4e1f-8d1a-91bf8b350e4f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:45.339785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4314e45a-03a7-4e1f-8d1a-91bf8b350e4f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:45.341415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4314e45a-03a7-4e1f-8d1a-91bf8b350e4f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:45.342040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4314e45a-03a7-4e1f-8d1a-91bf8b350e4f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:46.086955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eb203027-a056-49b0-a855-76dab8eb6f6a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:46.098941 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eb203027-a056-49b0-a855-76dab8eb6f6a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1314 microversion: 2.1 time: 1.561743 Mar 05 21:07:46.100602 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2214/4394] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:44 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1314 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:46.451394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-a9049ca2-10f3-4219-9bd2-dadd67a1a18f req-1e81ef48-ba5e-489d-b708-a487a48bcc78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aadfd70b-cacd-4483-9974-3190f70167c9", "tag": "dd23e2dc-da6a-4c82-92a8-c32b30b75f06"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:46.470114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a9049ca2-10f3-4219-9bd2-dadd67a1a18f req-1e81ef48-ba5e-489d-b708-a487a48bcc78 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:46.474477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a9049ca2-10f3-4219-9bd2-dadd67a1a18f req-1e81ef48-ba5e-489d-b708-a487a48bcc78 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:46.555619 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-a9049ca2-10f3-4219-9bd2-dadd67a1a18f req-1e81ef48-ba5e-489d-b708-a487a48bcc78 service nova] Creating event network-changed:dd23e2dc-da6a-4c82-92a8-c32b30b75f06 for instance aadfd70b-cacd-4483-9974-3190f70167c9 on nch1-master-1 Mar 05 21:07:46.579402 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-a9049ca2-10f3-4219-9bd2-dadd67a1a18f req-1e81ef48-ba5e-489d-b708-a487a48bcc78 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131441 Mar 05 21:07:46.584526 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2215/4395] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:07:46.648538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4314e45a-03a7-4e1f-8d1a-91bf8b350e4f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:46.662179 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4314e45a-03a7-4e1f-8d1a-91bf8b350e4f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.352874 Mar 05 21:07:46.663272 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2181/4396] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:45 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:46.798635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6c3732c1-1098-40fa-89d5-a2ad43d886ba tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-914788888", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "key_name": "tempest-key-462049780", "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:46.949036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-6c3732c1-1098-40fa-89d5-a2ad43d886ba tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] validate_networks() for [('009197ce-e0dc-47b9-b8f3-b27f078b9f37', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:07:47.118072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-afcfcf15-25b6-4860-aa80-87e24f65fe08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:47.129819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-afcfcf15-25b6-4860-aa80-87e24f65fe08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:47.162467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-afcfcf15-25b6-4860-aa80-87e24f65fe08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:47.163325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-afcfcf15-25b6-4860-aa80-87e24f65fe08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:47.166087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-afcfcf15-25b6-4860-aa80-87e24f65fe08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:47.179562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-afcfcf15-25b6-4860-aa80-87e24f65fe08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:47.985094 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-6c3732c1-1098-40fa-89d5-a2ad43d886ba tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Invalid key_name provided. Mar 05 21:07:47.986426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6c3732c1-1098-40fa-89d5-a2ad43d886ba tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Invalid key_name provided. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:47.988103 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6c3732c1-1098-40fa-89d5-a2ad43d886ba tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.194277 Mar 05 21:07:47.989112 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2216/4397] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:07:46 2022] POST /compute/v2.1/servers => generated 70 bytes in 1197 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 05 21:07:47.997851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fa772121-cc22-4fdb-9445-98052824be83 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:48.005893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fa772121-cc22-4fdb-9445-98052824be83 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:48.028019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa772121-cc22-4fdb-9445-98052824be83 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:48.033001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa772121-cc22-4fdb-9445-98052824be83 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:48.034728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa772121-cc22-4fdb-9445-98052824be83 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:48.035721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa772121-cc22-4fdb-9445-98052824be83 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:48.317908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-afcfcf15-25b6-4860-aa80-87e24f65fe08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:48.341163 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-afcfcf15-25b6-4860-aa80-87e24f65fe08 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1314 microversion: 2.1 time: 1.227833 Mar 05 21:07:48.344876 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2182/4398] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:47 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1314 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:49.367268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fa772121-cc22-4fdb-9445-98052824be83 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:49.372312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bff90b3f-ef8a-443e-87fe-e917f9f04fb2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:49.374075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bff90b3f-ef8a-443e-87fe-e917f9f04fb2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:49.388022 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fa772121-cc22-4fdb-9445-98052824be83 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.393939 Mar 05 21:07:49.392546 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2217/4399] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:47 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:07:49.405928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bff90b3f-ef8a-443e-87fe-e917f9f04fb2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:49.407994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bff90b3f-ef8a-443e-87fe-e917f9f04fb2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:49.409058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bff90b3f-ef8a-443e-87fe-e917f9f04fb2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:49.412354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bff90b3f-ef8a-443e-87fe-e917f9f04fb2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:49.417647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0f3bea6b-fbe4-444b-a2eb-cf0fa797f388 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:49.420712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0f3bea6b-fbe4-444b-a2eb-cf0fa797f388 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:49.437350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f3bea6b-fbe4-444b-a2eb-cf0fa797f388 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:49.439330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f3bea6b-fbe4-444b-a2eb-cf0fa797f388 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:49.445424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f3bea6b-fbe4-444b-a2eb-cf0fa797f388 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:49.446389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f3bea6b-fbe4-444b-a2eb-cf0fa797f388 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:50.168638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0f3bea6b-fbe4-444b-a2eb-cf0fa797f388 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:50.194534 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0f3bea6b-fbe4-444b-a2eb-cf0fa797f388 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.787593 Mar 05 21:07:50.197565 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2218/4400] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:49 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:50.422080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f64bbf9a-5224-4def-a763-2202a92d1805 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2093703807", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:50.513637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bff90b3f-ef8a-443e-87fe-e917f9f04fb2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:50.530279 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bff90b3f-ef8a-443e-87fe-e917f9f04fb2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1314 microversion: 2.1 time: 1.169093 Mar 05 21:07:50.536064 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2183/4401] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:49 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1314 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:51.486234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.security_group_api [None req-f64bbf9a-5224-4def-a763-2202a92d1805 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Neutron security group does_not_exist not found {{(pid=141479) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Mar 05 21:07:51.487073 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-f64bbf9a-5224-4def-a763-2202a92d1805 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Mar 05 21:07:51.488970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f64bbf9a-5224-4def-a763-2202a92d1805 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:51.490010 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f64bbf9a-5224-4def-a763-2202a92d1805 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 1.075085 Mar 05 21:07:51.490789 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2219/4402] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:07:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 1077 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:07:51.501486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5cbdcea6-19dd-4966-9aa2-e9c6c33a639d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:51.502285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5cbdcea6-19dd-4966-9aa2-e9c6c33a639d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:51.519827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cbdcea6-19dd-4966-9aa2-e9c6c33a639d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:51.521325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cbdcea6-19dd-4966-9aa2-e9c6c33a639d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:51.524851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cbdcea6-19dd-4966-9aa2-e9c6c33a639d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:51.525929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cbdcea6-19dd-4966-9aa2-e9c6c33a639d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:51.555801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0f622076-719c-4c06-975e-3e1693d91529 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:51.556543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0f622076-719c-4c06-975e-3e1693d91529 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:51.579688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f622076-719c-4c06-975e-3e1693d91529 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:51.580777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f622076-719c-4c06-975e-3e1693d91529 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:51.583711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f622076-719c-4c06-975e-3e1693d91529 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:51.587613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f622076-719c-4c06-975e-3e1693d91529 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:52.384019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5cbdcea6-19dd-4966-9aa2-e9c6c33a639d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:52.392670 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5cbdcea6-19dd-4966-9aa2-e9c6c33a639d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.896267 Mar 05 21:07:52.400287 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2184/4403] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:51 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:52.417953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-00c957ed-862a-45dc-b261-f183b54ea8cb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:52.418734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-00c957ed-862a-45dc-b261-f183b54ea8cb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:52.444175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00c957ed-862a-45dc-b261-f183b54ea8cb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:52.446033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00c957ed-862a-45dc-b261-f183b54ea8cb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:52.450032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00c957ed-862a-45dc-b261-f183b54ea8cb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:52.451097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00c957ed-862a-45dc-b261-f183b54ea8cb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:52.930640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0f622076-719c-4c06-975e-3e1693d91529 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:52.938314 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0f622076-719c-4c06-975e-3e1693d91529 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1314 microversion: 2.1 time: 1.389001 Mar 05 21:07:52.938909 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2220/4404] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:51 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1314 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:53.211270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-00c957ed-862a-45dc-b261-f183b54ea8cb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:53.221448 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-00c957ed-862a-45dc-b261-f183b54ea8cb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.807492 Mar 05 21:07:53.223026 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2185/4405] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:52 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:07:53.242274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b7cbac53-89e2-4a34-94f8-656b943d8329 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:53.243133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b7cbac53-89e2-4a34-94f8-656b943d8329 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: f11f3b57-4102-4f7b-bf78-56db2dc7cfe9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:53.250793 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-b7cbac53-89e2-4a34-94f8-656b943d8329 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance f11f3b57-4102-4f7b-bf78-56db2dc7cfe9 could not be found. Mar 05 21:07:53.251731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b7cbac53-89e2-4a34-94f8-656b943d8329 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance f11f3b57-4102-4f7b-bf78-56db2dc7cfe9 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:53.252938 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b7cbac53-89e2-4a34-94f8-656b943d8329 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f11f3b57-4102-4f7b-bf78-56db2dc7cfe9" status: 404 len: 111 microversion: 2.1 time: 0.015677 Mar 05 21:07:53.253855 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2221/4406] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:07:53 2022] DELETE /compute/v2.1/servers/f11f3b57-4102-4f7b-bf78-56db2dc7cfe9 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:07:53.269006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-78d98068-2ebf-4a56-98ed-82702656fb69 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:53.270579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-78d98068-2ebf-4a56-98ed-82702656fb69 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:53.278154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78d98068-2ebf-4a56-98ed-82702656fb69 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:53.278873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78d98068-2ebf-4a56-98ed-82702656fb69 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:53.281658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78d98068-2ebf-4a56-98ed-82702656fb69 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:53.282581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-78d98068-2ebf-4a56-98ed-82702656fb69 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:53.751714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-78d98068-2ebf-4a56-98ed-82702656fb69 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:53.790578 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-78d98068-2ebf-4a56-98ed-82702656fb69 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.531797 Mar 05 21:07:53.791433 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2186/4407] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:53 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:53.810591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-33c7c2ac-dc70-4dbb-ba06-97dec702faad tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:53.811237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-33c7c2ac-dc70-4dbb-ba06-97dec702faad tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:53.823557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-33c7c2ac-dc70-4dbb-ba06-97dec702faad tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:53.824063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-33c7c2ac-dc70-4dbb-ba06-97dec702faad tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:53.824887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-33c7c2ac-dc70-4dbb-ba06-97dec702faad tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:53.825334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-33c7c2ac-dc70-4dbb-ba06-97dec702faad tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:53.957934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5b7f68b5-caec-45c5-aa66-7aa052d87221 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:53.958813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5b7f68b5-caec-45c5-aa66-7aa052d87221 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:53.974771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b7f68b5-caec-45c5-aa66-7aa052d87221 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:53.975467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b7f68b5-caec-45c5-aa66-7aa052d87221 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:53.976446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b7f68b5-caec-45c5-aa66-7aa052d87221 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:53.977031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b7f68b5-caec-45c5-aa66-7aa052d87221 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:54.351204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5b7f68b5-caec-45c5-aa66-7aa052d87221 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:54.374353 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5b7f68b5-caec-45c5-aa66-7aa052d87221 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1314 microversion: 2.1 time: 0.417530 Mar 05 21:07:54.388306 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2187/4408] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:53 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:54.436126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-33c7c2ac-dc70-4dbb-ba06-97dec702faad tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:54.459723 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-33c7c2ac-dc70-4dbb-ba06-97dec702faad tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.645595 Mar 05 21:07:54.462132 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2222/4409] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:53 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:54.483455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b1d2e424-ba39-4f9f-8ac5-35ac3cbf06ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:54.484587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b1d2e424-ba39-4f9f-8ac5-35ac3cbf06ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Failed to fetch instance by id 9223372036854775808 {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 05 21:07:54.485270 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-b1d2e424-ba39-4f9f-8ac5-35ac3cbf06ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Mar 05 21:07:54.486048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b1d2e424-ba39-4f9f-8ac5-35ac3cbf06ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:54.489927 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b1d2e424-ba39-4f9f-8ac5-35ac3cbf06ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.011636 Mar 05 21:07:54.491757 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2188/4410] 10.222.0.15 () {58 vars in 1187 bytes} [Sat Mar 5 21:07:54 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:07:54.507001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1eb662a2-e442-41fc-9f01-85654cea9549 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:54.508174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1eb662a2-e442-41fc-9f01-85654cea9549 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:54.522409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1eb662a2-e442-41fc-9f01-85654cea9549 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:54.523220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1eb662a2-e442-41fc-9f01-85654cea9549 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:54.524753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1eb662a2-e442-41fc-9f01-85654cea9549 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:54.526146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1eb662a2-e442-41fc-9f01-85654cea9549 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:55.399108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c4ae832f-0c70-4ebe-abd3-72cf6c492d06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:55.399968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c4ae832f-0c70-4ebe-abd3-72cf6c492d06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:55.418540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4ae832f-0c70-4ebe-abd3-72cf6c492d06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:55.420359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4ae832f-0c70-4ebe-abd3-72cf6c492d06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:55.421372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4ae832f-0c70-4ebe-abd3-72cf6c492d06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:55.422665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4ae832f-0c70-4ebe-abd3-72cf6c492d06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:56.245292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1eb662a2-e442-41fc-9f01-85654cea9549 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:56.264497 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1eb662a2-e442-41fc-9f01-85654cea9549 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.765236 Mar 05 21:07:56.266225 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2223/4411] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:54 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:56.292901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-632af597-9ba0-4891-8486-4680055a9b2d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:56.294723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-632af597-9ba0-4891-8486-4680055a9b2d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:56.312825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-632af597-9ba0-4891-8486-4680055a9b2d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:56.315598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-632af597-9ba0-4891-8486-4680055a9b2d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:56.317240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-632af597-9ba0-4891-8486-4680055a9b2d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:56.319290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-632af597-9ba0-4891-8486-4680055a9b2d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:56.880891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c4ae832f-0c70-4ebe-abd3-72cf6c492d06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:56.888715 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c4ae832f-0c70-4ebe-abd3-72cf6c492d06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1314 microversion: 2.1 time: 1.497710 Mar 05 21:07:56.889323 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2189/4412] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:55 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1314 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:56.901369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7666ab43-00c6-4124-92f6-118a77120bfe req-f8065a0c-5ff5-47fe-9549-ae6603ceb602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aadfd70b-cacd-4483-9974-3190f70167c9", "name": "network-vif-plugged", "status": "completed", "tag": "dd23e2dc-da6a-4c82-92a8-c32b30b75f06"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:56.929089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7666ab43-00c6-4124-92f6-118a77120bfe req-f8065a0c-5ff5-47fe-9549-ae6603ceb602 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:56.929629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7666ab43-00c6-4124-92f6-118a77120bfe req-f8065a0c-5ff5-47fe-9549-ae6603ceb602 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:56.961479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-632af597-9ba0-4891-8486-4680055a9b2d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:56.980860 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-632af597-9ba0-4891-8486-4680055a9b2d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.694438 Mar 05 21:07:56.993862 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2224/4413] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:56 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:07:56.994317 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7666ab43-00c6-4124-92f6-118a77120bfe req-f8065a0c-5ff5-47fe-9549-ae6603ceb602 service nova] Creating event network-vif-plugged:dd23e2dc-da6a-4c82-92a8-c32b30b75f06 for instance aadfd70b-cacd-4483-9974-3190f70167c9 on nch1-master-1 Mar 05 21:07:57.010617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3447559a-a609-4b3d-b819-223d45eb7ee2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:57.012382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3447559a-a609-4b3d-b819-223d45eb7ee2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Failed to fetch instance by id -1 {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 05 21:07:57.013151 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-3447559a-a609-4b3d-b819-223d45eb7ee2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance -1 could not be found. Mar 05 21:07:57.014429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3447559a-a609-4b3d-b819-223d45eb7ee2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance -1 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:57.027777 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3447559a-a609-4b3d-b819-223d45eb7ee2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.026516 Mar 05 21:07:57.033528 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7666ab43-00c6-4124-92f6-118a77120bfe req-f8065a0c-5ff5-47fe-9549-ae6603ceb602 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138263 Mar 05 21:07:57.035388 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2190/4414] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:07:57.036497 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2225/4415] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 21:07:56 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:07:57.072811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-49f354d7-cfa7-49d7-bfae-3abd15e61cf2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:57.074539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-49f354d7-cfa7-49d7-bfae-3abd15e61cf2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:57.095262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49f354d7-cfa7-49d7-bfae-3abd15e61cf2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:57.103865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49f354d7-cfa7-49d7-bfae-3abd15e61cf2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:57.105199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49f354d7-cfa7-49d7-bfae-3abd15e61cf2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:57.108336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49f354d7-cfa7-49d7-bfae-3abd15e61cf2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:57.916509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c0d9161-84e2-4d8b-ab4e-3bd355c4ca66 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:57.917252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3c0d9161-84e2-4d8b-ab4e-3bd355c4ca66 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:57.926276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c0d9161-84e2-4d8b-ab4e-3bd355c4ca66 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:57.933825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c0d9161-84e2-4d8b-ab4e-3bd355c4ca66 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:57.938826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c0d9161-84e2-4d8b-ab4e-3bd355c4ca66 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:57.941135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c0d9161-84e2-4d8b-ab4e-3bd355c4ca66 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:58.336568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-49f354d7-cfa7-49d7-bfae-3abd15e61cf2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:58.345472 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-49f354d7-cfa7-49d7-bfae-3abd15e61cf2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.304311 Mar 05 21:07:58.351088 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2191/4416] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:57 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:58.376851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5cea2296-6c34-4221-9b66-befdfc9b362f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:58.377775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5cea2296-6c34-4221-9b66-befdfc9b362f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:58.390874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cea2296-6c34-4221-9b66-befdfc9b362f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:58.391594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cea2296-6c34-4221-9b66-befdfc9b362f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:58.392648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cea2296-6c34-4221-9b66-befdfc9b362f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:58.396360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cea2296-6c34-4221-9b66-befdfc9b362f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:58.668474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3c0d9161-84e2-4d8b-ab4e-3bd355c4ca66 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:58.676632 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3c0d9161-84e2-4d8b-ab4e-3bd355c4ca66 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1314 microversion: 2.1 time: 0.774053 Mar 05 21:07:58.686273 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2226/4417] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:57 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:07:59.694801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4c0e4f7f-4354-49f3-861d-003c3f377e0d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:59.695458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4c0e4f7f-4354-49f3-861d-003c3f377e0d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:59.704786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c0e4f7f-4354-49f3-861d-003c3f377e0d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:59.708145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c0e4f7f-4354-49f3-861d-003c3f377e0d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:59.709159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c0e4f7f-4354-49f3-861d-003c3f377e0d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:59.713753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c0e4f7f-4354-49f3-861d-003c3f377e0d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:59.723887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5cea2296-6c34-4221-9b66-befdfc9b362f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:07:59.732884 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5cea2296-6c34-4221-9b66-befdfc9b362f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.364220 Mar 05 21:07:59.746782 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2192/4418] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:58 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:07:59.770685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cb8f1ae4-0c75-41d7-98bb-1aa3fb7d07ff tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:07:59.771189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cb8f1ae4-0c75-41d7-98bb-1aa3fb7d07ff tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 07ed6648-579b-44a0-b679-56d3b3d3666d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:59.805043 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-cb8f1ae4-0c75-41d7-98bb-1aa3fb7d07ff tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 07ed6648-579b-44a0-b679-56d3b3d3666d could not be found. Mar 05 21:07:59.805829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cb8f1ae4-0c75-41d7-98bb-1aa3fb7d07ff tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 07ed6648-579b-44a0-b679-56d3b3d3666d could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:07:59.811749 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cb8f1ae4-0c75-41d7-98bb-1aa3fb7d07ff tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/07ed6648-579b-44a0-b679-56d3b3d3666d/action" status: 404 len: 111 microversion: 2.1 time: 0.045323 Mar 05 21:07:59.816285 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2193/4419] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:07:59 2022] POST /compute/v2.1/servers/07ed6648-579b-44a0-b679-56d3b3d3666d/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:07:59.886475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-93531b5c-12dd-48dd-be00-4bb5a85db82d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:07:59.887029 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-93531b5c-12dd-48dd-be00-4bb5a85db82d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:07:59.897449 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93531b5c-12dd-48dd-be00-4bb5a85db82d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:59.897924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93531b5c-12dd-48dd-be00-4bb5a85db82d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:07:59.898805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93531b5c-12dd-48dd-be00-4bb5a85db82d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:07:59.899256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-93531b5c-12dd-48dd-be00-4bb5a85db82d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:00.429399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-93531b5c-12dd-48dd-be00-4bb5a85db82d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:00.454197 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-93531b5c-12dd-48dd-be00-4bb5a85db82d tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.629112 Mar 05 21:08:00.458375 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2194/4420] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:59 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:00.478064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b234b37d-c403-4e23-b2e7-da636c311f82 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:00.479757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b234b37d-c403-4e23-b2e7-da636c311f82 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:00.493202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b234b37d-c403-4e23-b2e7-da636c311f82 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:00.493828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b234b37d-c403-4e23-b2e7-da636c311f82 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:00.494777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b234b37d-c403-4e23-b2e7-da636c311f82 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:00.495659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b234b37d-c403-4e23-b2e7-da636c311f82 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:01.230452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b234b37d-c403-4e23-b2e7-da636c311f82 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:01.238267 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b234b37d-c403-4e23-b2e7-da636c311f82 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.764983 Mar 05 21:08:01.250069 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2195/4421] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:00 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:01.256420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0bc1dc03-fba7-48f9-bb08-d231322f9cd4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:01.257635 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0bc1dc03-fba7-48f9-bb08-d231322f9cd4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 7680984c-99b9-4579-81d4-58df72d5342d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:01.263571 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-0bc1dc03-fba7-48f9-bb08-d231322f9cd4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 7680984c-99b9-4579-81d4-58df72d5342d could not be found. Mar 05 21:08:01.264797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0bc1dc03-fba7-48f9-bb08-d231322f9cd4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 7680984c-99b9-4579-81d4-58df72d5342d could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:01.265911 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0bc1dc03-fba7-48f9-bb08-d231322f9cd4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/7680984c-99b9-4579-81d4-58df72d5342d/action" status: 404 len: 111 microversion: 2.1 time: 0.013639 Mar 05 21:08:01.271217 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2196/4422] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:01 2022] POST /compute/v2.1/servers/7680984c-99b9-4579-81d4-58df72d5342d/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:08:01.276174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2252708a-52f5-4568-9a58-0e841095962a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:01.276987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2252708a-52f5-4568-9a58-0e841095962a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:01.284322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2252708a-52f5-4568-9a58-0e841095962a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:01.284997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2252708a-52f5-4568-9a58-0e841095962a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:01.285981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2252708a-52f5-4568-9a58-0e841095962a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:01.286572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2252708a-52f5-4568-9a58-0e841095962a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:01.672107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4c0e4f7f-4354-49f3-861d-003c3f377e0d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:01.686583 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4c0e4f7f-4354-49f3-861d-003c3f377e0d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1500 microversion: 2.1 time: 1.996308 Mar 05 21:08:01.691527 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2227/4423] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:07:59 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1500 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:01.716551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-99d97841-b7f6-4873-94f0-c2f434c734a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:01.717914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-99d97841-b7f6-4873-94f0-c2f434c734a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:01.732708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99d97841-b7f6-4873-94f0-c2f434c734a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:01.733413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99d97841-b7f6-4873-94f0-c2f434c734a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:01.736409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99d97841-b7f6-4873-94f0-c2f434c734a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:01.737604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99d97841-b7f6-4873-94f0-c2f434c734a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:02.114782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2252708a-52f5-4568-9a58-0e841095962a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:02.127435 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2252708a-52f5-4568-9a58-0e841095962a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.854624 Mar 05 21:08:02.128566 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2197/4424] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:01 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:02.148737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f92a91d2-96e4-47d4-8f3f-8d9c28b2b2d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:02.149873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f92a91d2-96e4-47d4-8f3f-8d9c28b2b2d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:02.164167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f92a91d2-96e4-47d4-8f3f-8d9c28b2b2d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:02.164864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f92a91d2-96e4-47d4-8f3f-8d9c28b2b2d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:02.166256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f92a91d2-96e4-47d4-8f3f-8d9c28b2b2d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:02.166872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f92a91d2-96e4-47d4-8f3f-8d9c28b2b2d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:02.630734 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.network.security_group_api [None req-99d97841-b7f6-4873-94f0-c2f434c734a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Removing security group 92601977-ae9f-44a5-940f-7a0abdac9102 from port dd23e2dc-da6a-4c82-92a8-c32b30b75f06 Mar 05 21:08:03.138079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f92a91d2-96e4-47d4-8f3f-8d9c28b2b2d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:03.153020 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f92a91d2-96e4-47d4-8f3f-8d9c28b2b2d4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.008371 Mar 05 21:08:03.154315 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2198/4425] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:02 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:03.175612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-649f71f2-57ea-4268-9b56-af40e3fa3173 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:03.176398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-649f71f2-57ea-4268-9b56-af40e3fa3173 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 0023b375-01ac-4d61-89ee-8d3433d5336c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:03.186735 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-649f71f2-57ea-4268-9b56-af40e3fa3173 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 0023b375-01ac-4d61-89ee-8d3433d5336c could not be found. Mar 05 21:08:03.187474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-649f71f2-57ea-4268-9b56-af40e3fa3173 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 0023b375-01ac-4d61-89ee-8d3433d5336c could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:03.188549 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-649f71f2-57ea-4268-9b56-af40e3fa3173 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/0023b375-01ac-4d61-89ee-8d3433d5336c" status: 404 len: 111 microversion: 2.1 time: 0.021128 Mar 05 21:08:03.192505 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2199/4426] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:03 2022] GET /compute/v2.1/servers/0023b375-01ac-4d61-89ee-8d3433d5336c => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:08:03.200553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2140db64-75f2-4523-b252-9bdc0fe1e631 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:03.203655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2140db64-75f2-4523-b252-9bdc0fe1e631 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:03.222603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2140db64-75f2-4523-b252-9bdc0fe1e631 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:03.223360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2140db64-75f2-4523-b252-9bdc0fe1e631 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:03.224416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2140db64-75f2-4523-b252-9bdc0fe1e631 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:03.230832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2140db64-75f2-4523-b252-9bdc0fe1e631 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:03.742425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2140db64-75f2-4523-b252-9bdc0fe1e631 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:03.794745 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2140db64-75f2-4523-b252-9bdc0fe1e631 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.597050 Mar 05 21:08:03.802860 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2200/4427] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:03 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:03.825400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ce8fcabe-a6f3-45d4-a81d-de072e947ad5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:03.826151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ce8fcabe-a6f3-45d4-a81d-de072e947ad5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:03.839643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce8fcabe-a6f3-45d4-a81d-de072e947ad5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:03.840256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce8fcabe-a6f3-45d4-a81d-de072e947ad5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:03.841312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce8fcabe-a6f3-45d4-a81d-de072e947ad5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:03.841865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce8fcabe-a6f3-45d4-a81d-de072e947ad5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:04.347514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ce8fcabe-a6f3-45d4-a81d-de072e947ad5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:04.358932 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ce8fcabe-a6f3-45d4-a81d-de072e947ad5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.541051 Mar 05 21:08:04.359798 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2201/4428] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:03 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:04.479232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eb2e4b37-3393-42fe-8db3-2d48f0d059ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-866661297", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:04.480956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eb2e4b37-3393-42fe-8db3-2d48f0d059ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:04.481804 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eb2e4b37-3393-42fe-8db3-2d48f0d059ab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006665 Mar 05 21:08:04.482729 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2202/4429] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:08:04 2022] POST /compute/v2.1/servers => generated 139 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:08:04.501603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8de81dbb-c1ce-4946-8bea-36c214da2490 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:04.504893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8de81dbb-c1ce-4946-8bea-36c214da2490 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:04.524100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8de81dbb-c1ce-4946-8bea-36c214da2490 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:04.525056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8de81dbb-c1ce-4946-8bea-36c214da2490 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:04.526176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8de81dbb-c1ce-4946-8bea-36c214da2490 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:04.527410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8de81dbb-c1ce-4946-8bea-36c214da2490 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:04.751099 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-99d97841-b7f6-4873-94f0-c2f434c734a8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9/action" status: 202 len: 0 microversion: 2.1 time: 3.047809 Mar 05 21:08:04.752561 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2228/4430] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:01 2022] POST /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9/action => generated 0 bytes in 3050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:08:04.761529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6047419d-9a61-430d-99c1-414793aadd45 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:04.762668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6047419d-9a61-430d-99c1-414793aadd45 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:04.775079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6047419d-9a61-430d-99c1-414793aadd45 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:04.776569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6047419d-9a61-430d-99c1-414793aadd45 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:04.777803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6047419d-9a61-430d-99c1-414793aadd45 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:04.778634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6047419d-9a61-430d-99c1-414793aadd45 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:05.102176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6047419d-9a61-430d-99c1-414793aadd45 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:05.122591 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6047419d-9a61-430d-99c1-414793aadd45 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1458 microversion: 2.1 time: 0.363239 Mar 05 21:08:05.125584 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2229/4431] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:04 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1458 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:05.168284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-cd2ae64c-a1ea-4ed0-89d0-fc26eb405e30 req-33b8564d-a8c8-4206-8a66-b0162d4c881e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aadfd70b-cacd-4483-9974-3190f70167c9", "tag": "dd23e2dc-da6a-4c82-92a8-c32b30b75f06"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:05.221093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-cd2ae64c-a1ea-4ed0-89d0-fc26eb405e30 req-33b8564d-a8c8-4206-8a66-b0162d4c881e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:05.221842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-cd2ae64c-a1ea-4ed0-89d0-fc26eb405e30 req-33b8564d-a8c8-4206-8a66-b0162d4c881e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:05.256342 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-cd2ae64c-a1ea-4ed0-89d0-fc26eb405e30 req-33b8564d-a8c8-4206-8a66-b0162d4c881e service nova] Creating event network-changed:dd23e2dc-da6a-4c82-92a8-c32b30b75f06 for instance aadfd70b-cacd-4483-9974-3190f70167c9 on nch1-master-1 Mar 05 21:08:05.269484 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-cd2ae64c-a1ea-4ed0-89d0-fc26eb405e30 req-33b8564d-a8c8-4206-8a66-b0162d4c881e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137416 Mar 05 21:08:05.273056 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2230/4432] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:08:05.286903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d06704e2-cdc3-4808-a7db-241dafa34012 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:05.287870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d06704e2-cdc3-4808-a7db-241dafa34012 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:05.304675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d06704e2-cdc3-4808-a7db-241dafa34012 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:05.305515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d06704e2-cdc3-4808-a7db-241dafa34012 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:05.306532 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d06704e2-cdc3-4808-a7db-241dafa34012 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:05.307170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d06704e2-cdc3-4808-a7db-241dafa34012 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:05.809520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8de81dbb-c1ce-4946-8bea-36c214da2490 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:05.818697 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8de81dbb-c1ce-4946-8bea-36c214da2490 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.331678 Mar 05 21:08:05.821631 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2203/4433] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:04 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:05.858935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0e5e0304-6f3f-47a2-9d1c-9a654e20337e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:05.865051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0e5e0304-6f3f-47a2-9d1c-9a654e20337e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:05.875367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e5e0304-6f3f-47a2-9d1c-9a654e20337e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:05.876458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e5e0304-6f3f-47a2-9d1c-9a654e20337e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:05.879431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e5e0304-6f3f-47a2-9d1c-9a654e20337e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:05.880387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e5e0304-6f3f-47a2-9d1c-9a654e20337e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:05.930655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d06704e2-cdc3-4808-a7db-241dafa34012 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:05.957333 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d06704e2-cdc3-4808-a7db-241dafa34012 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.679731 Mar 05 21:08:05.958421 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2231/4434] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:05 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:05.982594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5ee0c254-0d6d-44ea-b72b-ec261ef38e70 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:05.983622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5ee0c254-0d6d-44ea-b72b-ec261ef38e70 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:05.993447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ee0c254-0d6d-44ea-b72b-ec261ef38e70 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:05.994010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ee0c254-0d6d-44ea-b72b-ec261ef38e70 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:05.994894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ee0c254-0d6d-44ea-b72b-ec261ef38e70 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:05.995415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ee0c254-0d6d-44ea-b72b-ec261ef38e70 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:06.476758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0e5e0304-6f3f-47a2-9d1c-9a654e20337e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:06.489389 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0e5e0304-6f3f-47a2-9d1c-9a654e20337e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.647833 Mar 05 21:08:06.494028 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2204/4435] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:05 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:06.580599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b4c9b664-d16d-473d-ab19-ef4d33f27941 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1054422817", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:06.582597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b4c9b664-d16d-473d-ab19-ef4d33f27941 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:06.586306 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b4c9b664-d16d-473d-ab19-ef4d33f27941 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.014670 Mar 05 21:08:06.594153 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2205/4436] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:08:06 2022] POST /compute/v2.1/servers => generated 133 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:08:06.628440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5ee0c254-0d6d-44ea-b72b-ec261ef38e70 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:06.641942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d3ad0009-de8c-4713-ac07-5260ca1786c7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:06.647276 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5ee0c254-0d6d-44ea-b72b-ec261ef38e70 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.669029 Mar 05 21:08:06.647916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d3ad0009-de8c-4713-ac07-5260ca1786c7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:06.649988 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2232/4437] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:05 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:06.668021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e4acc191-e19f-43ed-af62-6922dc708f3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:06.668975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e4acc191-e19f-43ed-af62-6922dc708f3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:06.669086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d3ad0009-de8c-4713-ac07-5260ca1786c7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:06.669600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d3ad0009-de8c-4713-ac07-5260ca1786c7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:06.670437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d3ad0009-de8c-4713-ac07-5260ca1786c7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:06.670878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d3ad0009-de8c-4713-ac07-5260ca1786c7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:06.683940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4acc191-e19f-43ed-af62-6922dc708f3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:06.684589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4acc191-e19f-43ed-af62-6922dc708f3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:06.687202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4acc191-e19f-43ed-af62-6922dc708f3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:06.687750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4acc191-e19f-43ed-af62-6922dc708f3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:07.301849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d3ad0009-de8c-4713-ac07-5260ca1786c7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:07.317918 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d3ad0009-de8c-4713-ac07-5260ca1786c7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.721138 Mar 05 21:08:07.320578 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2206/4438] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:06 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:07.339113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1f19af70-04bb-428c-8700-8fe29a519041 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:07.339980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1f19af70-04bb-428c-8700-8fe29a519041 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:07.346373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f19af70-04bb-428c-8700-8fe29a519041 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:07.347175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f19af70-04bb-428c-8700-8fe29a519041 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:07.348288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f19af70-04bb-428c-8700-8fe29a519041 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:07.353583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f19af70-04bb-428c-8700-8fe29a519041 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:07.852914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1f19af70-04bb-428c-8700-8fe29a519041 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:07.860574 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1f19af70-04bb-428c-8700-8fe29a519041 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.525215 Mar 05 21:08:07.863605 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2207/4439] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:07 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:07.883060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9d092416-3c36-4a67-9764-48786913541b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:07.883606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9d092416-3c36-4a67-9764-48786913541b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 13e0f633-131e-4538-b8b5-6a03deca9ca7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:07.892348 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-9d092416-3c36-4a67-9764-48786913541b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 13e0f633-131e-4538-b8b5-6a03deca9ca7 could not be found. Mar 05 21:08:07.892965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9d092416-3c36-4a67-9764-48786913541b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 13e0f633-131e-4538-b8b5-6a03deca9ca7 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:07.893875 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9d092416-3c36-4a67-9764-48786913541b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/13e0f633-131e-4538-b8b5-6a03deca9ca7/action" status: 404 len: 111 microversion: 2.1 time: 0.014811 Mar 05 21:08:07.896651 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2208/4440] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:07 2022] POST /compute/v2.1/servers/13e0f633-131e-4538-b8b5-6a03deca9ca7/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:08:07.906853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0a324683-62e5-4389-9ffe-cb7cc7810dc9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:07.912135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0a324683-62e5-4389-9ffe-cb7cc7810dc9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:07.937333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a324683-62e5-4389-9ffe-cb7cc7810dc9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:07.940175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a324683-62e5-4389-9ffe-cb7cc7810dc9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:07.941217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a324683-62e5-4389-9ffe-cb7cc7810dc9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:07.945040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a324683-62e5-4389-9ffe-cb7cc7810dc9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:08.271336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0a324683-62e5-4389-9ffe-cb7cc7810dc9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:08.280906 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0a324683-62e5-4389-9ffe-cb7cc7810dc9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.381636 Mar 05 21:08:08.308981 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2209/4441] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:07 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:08.319213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-06a907c7-c368-4b3e-b234-aed97a2d1a86 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:08.321480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-06a907c7-c368-4b3e-b234-aed97a2d1a86 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:08.338470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-06a907c7-c368-4b3e-b234-aed97a2d1a86 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:08.340457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-06a907c7-c368-4b3e-b234-aed97a2d1a86 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:08.341389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-06a907c7-c368-4b3e-b234-aed97a2d1a86 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:08.344340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-06a907c7-c368-4b3e-b234-aed97a2d1a86 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:08.643774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e4acc191-e19f-43ed-af62-6922dc708f3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:08.659982 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e4acc191-e19f-43ed-af62-6922dc708f3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 1.996340 Mar 05 21:08:08.679294 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2233/4442] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:06 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:08.686082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-34052e2a-bb41-4490-8731-d859677e75b6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:08.686940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-34052e2a-bb41-4490-8731-d859677e75b6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:08.697363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34052e2a-bb41-4490-8731-d859677e75b6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:08.698046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34052e2a-bb41-4490-8731-d859677e75b6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:08.698998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34052e2a-bb41-4490-8731-d859677e75b6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:08.699757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34052e2a-bb41-4490-8731-d859677e75b6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:08.748548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-06a907c7-c368-4b3e-b234-aed97a2d1a86 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:08.758905 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-06a907c7-c368-4b3e-b234-aed97a2d1a86 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.446352 Mar 05 21:08:08.760069 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2210/4443] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:08 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:08.784491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ae1b6ee5-c268-495e-a5cc-4bf55a91597f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:08.785168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ae1b6ee5-c268-495e-a5cc-4bf55a91597f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:08.814066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae1b6ee5-c268-495e-a5cc-4bf55a91597f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:08.814438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae1b6ee5-c268-495e-a5cc-4bf55a91597f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:08.816505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae1b6ee5-c268-495e-a5cc-4bf55a91597f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:08.817395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae1b6ee5-c268-495e-a5cc-4bf55a91597f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:09.000711 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ae1b6ee5-c268-495e-a5cc-4bf55a91597f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action" status: 202 len: 0 microversion: 2.1 time: 0.225311 Mar 05 21:08:09.003108 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2211/4444] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:08 2022] POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 21:08:09.026574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d1fd7db1-1128-49ef-a6f1-15c84c9c9f5a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:09.027621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d1fd7db1-1128-49ef-a6f1-15c84c9c9f5a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:09.036927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1fd7db1-1128-49ef-a6f1-15c84c9c9f5a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:09.037667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1fd7db1-1128-49ef-a6f1-15c84c9c9f5a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:09.038876 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1fd7db1-1128-49ef-a6f1-15c84c9c9f5a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:09.039516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1fd7db1-1128-49ef-a6f1-15c84c9c9f5a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:09.369054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d1fd7db1-1128-49ef-a6f1-15c84c9c9f5a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:09.377955 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d1fd7db1-1128-49ef-a6f1-15c84c9c9f5a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1510 microversion: 2.1 time: 0.364099 Mar 05 21:08:09.387932 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2212/4445] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:09 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:09.539869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-34052e2a-bb41-4490-8731-d859677e75b6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:09.547970 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-34052e2a-bb41-4490-8731-d859677e75b6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.866917 Mar 05 21:08:09.548570 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2234/4446] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:08 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:09.740706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-313154021", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "5638f6ea-4ec0-488e-a680-99fc30eb719d"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:09.847607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] validate_networks() for [('5638f6ea-4ec0-488e-a680-99fc30eb719d', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:08:10.397598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dee29a7c-2c98-4d4b-a0e9-28e51f4f5b3b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:10.398206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dee29a7c-2c98-4d4b-a0e9-28e51f4f5b3b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:10.411052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dee29a7c-2c98-4d4b-a0e9-28e51f4f5b3b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:10.411509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dee29a7c-2c98-4d4b-a0e9-28e51f4f5b3b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:10.412334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dee29a7c-2c98-4d4b-a0e9-28e51f4f5b3b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:10.416893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dee29a7c-2c98-4d4b-a0e9-28e51f4f5b3b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:10.727076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dee29a7c-2c98-4d4b-a0e9-28e51f4f5b3b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:10.742814 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dee29a7c-2c98-4d4b-a0e9-28e51f4f5b3b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1490 microversion: 2.1 time: 0.350827 Mar 05 21:08:10.749047 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2235/4447] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:10 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1490 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:10.766882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cb5b6b27-b0ad-41fe-ac8f-b508be4c4f8f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:10.767435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cb5b6b27-b0ad-41fe-ac8f-b508be4c4f8f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:10.803333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb5b6b27-b0ad-41fe-ac8f-b508be4c4f8f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:10.805835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb5b6b27-b0ad-41fe-ac8f-b508be4c4f8f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:10.811791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb5b6b27-b0ad-41fe-ac8f-b508be4c4f8f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:10.812518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb5b6b27-b0ad-41fe-ac8f-b508be4c4f8f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:10.923386 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-cb5b6b27-b0ad-41fe-ac8f-b508be4c4f8f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Cannot 'pause' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state paused Mar 05 21:08:10.924383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cb5b6b27-b0ad-41fe-ac8f-b508be4c4f8f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 409 to user: Cannot 'pause' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state paused {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:10.925495 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cb5b6b27-b0ad-41fe-ac8f-b508be4c4f8f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action" status: 409 len: 143 microversion: 2.1 time: 0.168019 Mar 05 21:08:10.930038 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2236/4448] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:10 2022] POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action => generated 143 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 05 21:08:10.950453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1ab5a209-516a-4e48-bcc7-bbf683920ae4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:10.951086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1ab5a209-516a-4e48-bcc7-bbf683920ae4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:10.973806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ab5a209-516a-4e48-bcc7-bbf683920ae4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:10.978861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ab5a209-516a-4e48-bcc7-bbf683920ae4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:10.979946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ab5a209-516a-4e48-bcc7-bbf683920ae4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:10.980868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ab5a209-516a-4e48-bcc7-bbf683920ae4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:11.155845 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1ab5a209-516a-4e48-bcc7-bbf683920ae4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action" status: 202 len: 0 microversion: 2.1 time: 0.220860 Mar 05 21:08:11.158587 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2237/4449] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:10 2022] POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:08:11.179408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-27498712-39cd-407c-9e7a-ce6a4b2f2629 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:11.181641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-27498712-39cd-407c-9e7a-ce6a4b2f2629 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:11.198112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27498712-39cd-407c-9e7a-ce6a4b2f2629 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:11.198596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27498712-39cd-407c-9e7a-ce6a4b2f2629 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:11.199623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27498712-39cd-407c-9e7a-ce6a4b2f2629 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:11.200422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-27498712-39cd-407c-9e7a-ce6a4b2f2629 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:11.812297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-27498712-39cd-407c-9e7a-ce6a4b2f2629 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:11.820462 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-27498712-39cd-407c-9e7a-ce6a4b2f2629 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1497 microversion: 2.1 time: 0.656724 Mar 05 21:08:11.827466 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2238/4450] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:11 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1497 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:12.164917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:08:12.164917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:08:12.165420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:08:12.166096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:08:12.166612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:08:12.186964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:12.187957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:12.191090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:12.191612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:12.237687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:08:12.248055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Getting quotas for user d2421fee8afc47ea822c5df54a095261 and project 1b7fc33099aa4a2a9d459a269ac2e82f. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:08:12.271090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:08:12.274635 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:08:12.399156 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ff38731a-9775-4500-af09-d6fb9308d133 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.663623 Mar 05 21:08:12.405503 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2213/4451] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:08:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:08:12.412634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dcff0398-8e10-4eaa-a8a7-c15bdf01fca8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:12.413585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dcff0398-8e10-4eaa-a8a7-c15bdf01fca8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:12.656793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dcff0398-8e10-4eaa-a8a7-c15bdf01fca8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:12.665951 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dcff0398-8e10-4eaa-a8a7-c15bdf01fca8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1214 microversion: 2.1 time: 0.258762 Mar 05 21:08:12.679687 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2239/4452] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:12 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1214 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:12.849913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b980015f-633a-4506-8f72-824bb64003b7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:12.850780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b980015f-633a-4506-8f72-824bb64003b7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:12.877374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b980015f-633a-4506-8f72-824bb64003b7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:12.879017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b980015f-633a-4506-8f72-824bb64003b7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:12.879886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b980015f-633a-4506-8f72-824bb64003b7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:12.883658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b980015f-633a-4506-8f72-824bb64003b7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:13.687014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6ad8bb13-ed2e-4966-a243-8cc4127b38f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:13.687635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6ad8bb13-ed2e-4966-a243-8cc4127b38f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:13.713089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ad8bb13-ed2e-4966-a243-8cc4127b38f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:13.713569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ad8bb13-ed2e-4966-a243-8cc4127b38f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:13.714353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ad8bb13-ed2e-4966-a243-8cc4127b38f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:13.715117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ad8bb13-ed2e-4966-a243-8cc4127b38f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:13.860148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6ad8bb13-ed2e-4966-a243-8cc4127b38f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:13.868356 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6ad8bb13-ed2e-4966-a243-8cc4127b38f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1210 microversion: 2.1 time: 0.185643 Mar 05 21:08:13.879652 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2240/4453] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:13 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1210 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:13.893789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b980015f-633a-4506-8f72-824bb64003b7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:13.917206 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b980015f-633a-4506-8f72-824bb64003b7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.072315 Mar 05 21:08:13.922719 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2214/4454] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:12 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:13.945848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e676af06-0eb2-4898-a087-2c9ca2d00ca1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:13.946481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e676af06-0eb2-4898-a087-2c9ca2d00ca1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:13.962252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e676af06-0eb2-4898-a087-2c9ca2d00ca1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:13.962713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e676af06-0eb2-4898-a087-2c9ca2d00ca1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:13.980120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e676af06-0eb2-4898-a087-2c9ca2d00ca1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:13.980574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e676af06-0eb2-4898-a087-2c9ca2d00ca1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:14.895972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3bd52aae-9fc5-4c59-a951-517716b18d9f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:14.896604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3bd52aae-9fc5-4c59-a951-517716b18d9f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:14.918201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bd52aae-9fc5-4c59-a951-517716b18d9f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:14.918673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bd52aae-9fc5-4c59-a951-517716b18d9f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:14.919491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bd52aae-9fc5-4c59-a951-517716b18d9f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:14.919967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bd52aae-9fc5-4c59-a951-517716b18d9f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:15.084934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3bd52aae-9fc5-4c59-a951-517716b18d9f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:15.094899 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3bd52aae-9fc5-4c59-a951-517716b18d9f tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1272 microversion: 2.1 time: 0.212738 Mar 05 21:08:15.095578 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2215/4455] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:14 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:15.352279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e676af06-0eb2-4898-a087-2c9ca2d00ca1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:15.370564 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e676af06-0eb2-4898-a087-2c9ca2d00ca1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.428789 Mar 05 21:08:15.371158 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2241/4456] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:13 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:15.388863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-63944096-9475-449b-a29b-414ac0547619 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:15.390140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-63944096-9475-449b-a29b-414ac0547619 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:15.398372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-63944096-9475-449b-a29b-414ac0547619 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:15.399967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-63944096-9475-449b-a29b-414ac0547619 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:15.400954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-63944096-9475-449b-a29b-414ac0547619 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:15.402189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-63944096-9475-449b-a29b-414ac0547619 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:15.417794 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-63944096-9475-449b-a29b-414ac0547619 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 16c1f962-469b-4cf5-9f61-a158b83a42a9 could not be found. Mar 05 21:08:15.418752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-63944096-9475-449b-a29b-414ac0547619 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 16c1f962-469b-4cf5-9f61-a158b83a42a9 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:15.419909 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-63944096-9475-449b-a29b-414ac0547619 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9/action" status: 404 len: 111 microversion: 2.1 time: 0.035113 Mar 05 21:08:15.421311 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2216/4457] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:15 2022] POST /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:08:15.431033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d95bc16b-15ca-49c8-9c69-f7254882fdfa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:15.431940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d95bc16b-15ca-49c8-9c69-f7254882fdfa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:15.439727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d95bc16b-15ca-49c8-9c69-f7254882fdfa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:15.440870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d95bc16b-15ca-49c8-9c69-f7254882fdfa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:15.442147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d95bc16b-15ca-49c8-9c69-f7254882fdfa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:15.442856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d95bc16b-15ca-49c8-9c69-f7254882fdfa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:16.113881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3dd1751e-2cdf-4281-a0fb-056f99b4e402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:16.114521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3dd1751e-2cdf-4281-a0fb-056f99b4e402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:16.124215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3dd1751e-2cdf-4281-a0fb-056f99b4e402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:16.124764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3dd1751e-2cdf-4281-a0fb-056f99b4e402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:16.125482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3dd1751e-2cdf-4281-a0fb-056f99b4e402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:16.125994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3dd1751e-2cdf-4281-a0fb-056f99b4e402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:16.317235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d95bc16b-15ca-49c8-9c69-f7254882fdfa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:16.378143 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d95bc16b-15ca-49c8-9c69-f7254882fdfa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.949711 Mar 05 21:08:16.384833 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2242/4458] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:15 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:16.402719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-db63aec3-f9be-4e78-9d84-b01ef851aae5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:16.403796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-db63aec3-f9be-4e78-9d84-b01ef851aae5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:16.411139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-db63aec3-f9be-4e78-9d84-b01ef851aae5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:16.412083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-db63aec3-f9be-4e78-9d84-b01ef851aae5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:16.413117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-db63aec3-f9be-4e78-9d84-b01ef851aae5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:16.413776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-db63aec3-f9be-4e78-9d84-b01ef851aae5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:16.517105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3dd1751e-2cdf-4281-a0fb-056f99b4e402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:16.528746 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3dd1751e-2cdf-4281-a0fb-056f99b4e402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1272 microversion: 2.1 time: 0.419397 Mar 05 21:08:16.539509 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2217/4459] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:16 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1272 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:17.101923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-db63aec3-f9be-4e78-9d84-b01ef851aae5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:17.113731 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-db63aec3-f9be-4e78-9d84-b01ef851aae5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.712549 Mar 05 21:08:17.115786 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2243/4460] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:16 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:17.138989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6416538-a235-4203-bde2-7cab390ef36c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:17.141229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c6416538-a235-4203-bde2-7cab390ef36c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 87222045-bad7-4de8-b666-8dc77274b19d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:17.159241 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-c6416538-a235-4203-bde2-7cab390ef36c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 87222045-bad7-4de8-b666-8dc77274b19d could not be found. Mar 05 21:08:17.161221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6416538-a235-4203-bde2-7cab390ef36c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 87222045-bad7-4de8-b666-8dc77274b19d could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:17.162141 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c6416538-a235-4203-bde2-7cab390ef36c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/87222045-bad7-4de8-b666-8dc77274b19d/action" status: 404 len: 111 microversion: 2.1 time: 0.031251 Mar 05 21:08:17.163355 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2218/4461] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:17 2022] POST /compute/v2.1/servers/87222045-bad7-4de8-b666-8dc77274b19d/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:08:17.172759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-54601fb6-a5c5-4298-9d51-89ef7e537761 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:17.176453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-54601fb6-a5c5-4298-9d51-89ef7e537761 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:17.191226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-54601fb6-a5c5-4298-9d51-89ef7e537761 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:17.192007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-54601fb6-a5c5-4298-9d51-89ef7e537761 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:17.196347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-54601fb6-a5c5-4298-9d51-89ef7e537761 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:17.197084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-54601fb6-a5c5-4298-9d51-89ef7e537761 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:17.551438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ee38f613-0caa-436d-977e-0035c22a7bf0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:17.552295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ee38f613-0caa-436d-977e-0035c22a7bf0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:17.567700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee38f613-0caa-436d-977e-0035c22a7bf0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:17.570218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee38f613-0caa-436d-977e-0035c22a7bf0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:17.572789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee38f613-0caa-436d-977e-0035c22a7bf0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:17.575820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee38f613-0caa-436d-977e-0035c22a7bf0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:17.701529 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ee38f613-0caa-436d-977e-0035c22a7bf0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:17.729665 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ee38f613-0caa-436d-977e-0035c22a7bf0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1272 microversion: 2.1 time: 0.182920 Mar 05 21:08:17.733345 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2219/4462] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:17 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:18.017238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-54601fb6-a5c5-4298-9d51-89ef7e537761 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:18.037495 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-54601fb6-a5c5-4298-9d51-89ef7e537761 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.868465 Mar 05 21:08:18.039188 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2244/4463] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:17 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:18.061988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-05384c2a-6b65-4beb-8e11-264972f7471e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:18.062959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-05384c2a-6b65-4beb-8e11-264972f7471e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:18.074193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05384c2a-6b65-4beb-8e11-264972f7471e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:18.078538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05384c2a-6b65-4beb-8e11-264972f7471e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:18.079654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05384c2a-6b65-4beb-8e11-264972f7471e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:18.080368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05384c2a-6b65-4beb-8e11-264972f7471e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:18.655727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-05384c2a-6b65-4beb-8e11-264972f7471e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:18.673330 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-05384c2a-6b65-4beb-8e11-264972f7471e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.615843 Mar 05 21:08:18.715663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-61d34346-b3d7-4dd6-8116-e22b56138a8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:18.721015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-61d34346-b3d7-4dd6-8116-e22b56138a8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:18.738310 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2220/4464] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:18 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:18.751846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82bf1c05-a572-480b-b6fa-7e13b687a6ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:18.795858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61d34346-b3d7-4dd6-8116-e22b56138a8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:18.797390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-82bf1c05-a572-480b-b6fa-7e13b687a6ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:18.814404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61d34346-b3d7-4dd6-8116-e22b56138a8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:18.816805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61d34346-b3d7-4dd6-8116-e22b56138a8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:18.819091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61d34346-b3d7-4dd6-8116-e22b56138a8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:18.824289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82bf1c05-a572-480b-b6fa-7e13b687a6ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:18.825089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82bf1c05-a572-480b-b6fa-7e13b687a6ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:18.826096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82bf1c05-a572-480b-b6fa-7e13b687a6ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:18.826691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82bf1c05-a572-480b-b6fa-7e13b687a6ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:18.860357 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-61d34346-b3d7-4dd6-8116-e22b56138a8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 16c1f962-469b-4cf5-9f61-a158b83a42a9 could not be found. Mar 05 21:08:18.861043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-61d34346-b3d7-4dd6-8116-e22b56138a8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 16c1f962-469b-4cf5-9f61-a158b83a42a9 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:18.862724 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-61d34346-b3d7-4dd6-8116-e22b56138a8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9/action" status: 404 len: 111 microversion: 2.1 time: 0.162443 Mar 05 21:08:18.866491 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2245/4465] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:18 2022] POST /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9/action => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:08:18.875512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-61f012a4-47c4-40a5-8481-d0e7dc98ad2e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:18.876195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-61f012a4-47c4-40a5-8481-d0e7dc98ad2e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:18.899895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61f012a4-47c4-40a5-8481-d0e7dc98ad2e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:18.900619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61f012a4-47c4-40a5-8481-d0e7dc98ad2e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:18.901562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61f012a4-47c4-40a5-8481-d0e7dc98ad2e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:18.902174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61f012a4-47c4-40a5-8481-d0e7dc98ad2e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:19.336339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-82bf1c05-a572-480b-b6fa-7e13b687a6ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:19.362569 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-82bf1c05-a572-480b-b6fa-7e13b687a6ba tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1314 microversion: 2.1 time: 0.615310 Mar 05 21:08:19.364037 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2221/4466] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:18 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:20.062751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-61f012a4-47c4-40a5-8481-d0e7dc98ad2e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:20.103945 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-61f012a4-47c4-40a5-8481-d0e7dc98ad2e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.235765 Mar 05 21:08:20.107526 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2246/4467] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:18 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:20.125641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-133b43dd-77c8-4f05-aaa5-b615472f2628 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:20.126850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-133b43dd-77c8-4f05-aaa5-b615472f2628 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:20.141440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-133b43dd-77c8-4f05-aaa5-b615472f2628 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:20.142413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-133b43dd-77c8-4f05-aaa5-b615472f2628 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:20.147575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-133b43dd-77c8-4f05-aaa5-b615472f2628 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:20.148209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-133b43dd-77c8-4f05-aaa5-b615472f2628 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:20.382194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-75ddf1cd-1021-43dc-ac1c-ef96f00cdff6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:20.382783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-75ddf1cd-1021-43dc-ac1c-ef96f00cdff6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:20.409755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75ddf1cd-1021-43dc-ac1c-ef96f00cdff6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:20.413698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75ddf1cd-1021-43dc-ac1c-ef96f00cdff6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:20.415472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75ddf1cd-1021-43dc-ac1c-ef96f00cdff6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:20.419361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75ddf1cd-1021-43dc-ac1c-ef96f00cdff6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:20.596718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-133b43dd-77c8-4f05-aaa5-b615472f2628 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:20.608076 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-133b43dd-77c8-4f05-aaa5-b615472f2628 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.486553 Mar 05 21:08:20.637421 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2222/4468] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:20 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:20.642452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-666ba76f-f339-464c-8b7b-974a96f24cd1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:20.646532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-666ba76f-f339-464c-8b7b-974a96f24cd1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: f9131e0e-245d-4be3-8aee-4edfc8cbb6ec] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:20.656347 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-666ba76f-f339-464c-8b7b-974a96f24cd1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance f9131e0e-245d-4be3-8aee-4edfc8cbb6ec could not be found. Mar 05 21:08:20.660530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-666ba76f-f339-464c-8b7b-974a96f24cd1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance f9131e0e-245d-4be3-8aee-4edfc8cbb6ec could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:20.662135 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-666ba76f-f339-464c-8b7b-974a96f24cd1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/f9131e0e-245d-4be3-8aee-4edfc8cbb6ec/action" status: 404 len: 111 microversion: 2.1 time: 0.024521 Mar 05 21:08:20.663387 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2223/4469] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:20 2022] POST /compute/v2.1/servers/f9131e0e-245d-4be3-8aee-4edfc8cbb6ec/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:08:20.674698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ef213ce4-4b1b-465b-bda7-cba3105cb920 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:20.690727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ef213ce4-4b1b-465b-bda7-cba3105cb920 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:20.728772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef213ce4-4b1b-465b-bda7-cba3105cb920 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:20.737426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef213ce4-4b1b-465b-bda7-cba3105cb920 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:20.739692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef213ce4-4b1b-465b-bda7-cba3105cb920 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:20.740788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef213ce4-4b1b-465b-bda7-cba3105cb920 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:21.338419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-75ddf1cd-1021-43dc-ac1c-ef96f00cdff6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:21.351047 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-75ddf1cd-1021-43dc-ac1c-ef96f00cdff6 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1314 microversion: 2.1 time: 0.973289 Mar 05 21:08:21.352730 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2247/4470] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:20 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1314 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:21.482552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ef213ce4-4b1b-465b-bda7-cba3105cb920 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:21.493359 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ef213ce4-4b1b-465b-bda7-cba3105cb920 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.824379 Mar 05 21:08:21.494088 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2224/4471] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:20 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:21.510740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-996e0dd9-57e7-4e22-b20c-bff459d618bf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:21.511397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-996e0dd9-57e7-4e22-b20c-bff459d618bf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:21.521514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-996e0dd9-57e7-4e22-b20c-bff459d618bf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:21.521719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-996e0dd9-57e7-4e22-b20c-bff459d618bf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:21.522556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-996e0dd9-57e7-4e22-b20c-bff459d618bf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:21.523200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-996e0dd9-57e7-4e22-b20c-bff459d618bf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:22.323024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5e35cbd4-bba7-4a7d-9e6c-eac5c0c2b4d7 req-2a7ed9c6-992f-448d-98df-a334e1200fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb113c5-40de-49b7-8f60-c10f275d42db", "tag": "2de15539-9dfc-43c7-86e8-df851b4d8dbe"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:22.348562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5e35cbd4-bba7-4a7d-9e6c-eac5c0c2b4d7 req-2a7ed9c6-992f-448d-98df-a334e1200fbb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:22.349118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5e35cbd4-bba7-4a7d-9e6c-eac5c0c2b4d7 req-2a7ed9c6-992f-448d-98df-a334e1200fbb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:22.370487 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-5e35cbd4-bba7-4a7d-9e6c-eac5c0c2b4d7 req-2a7ed9c6-992f-448d-98df-a334e1200fbb service nova] Creating event network-changed:2de15539-9dfc-43c7-86e8-df851b4d8dbe for instance 7eb113c5-40de-49b7-8f60-c10f275d42db on nch2-master-1 Mar 05 21:08:22.379876 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5e35cbd4-bba7-4a7d-9e6c-eac5c0c2b4d7 req-2a7ed9c6-992f-448d-98df-a334e1200fbb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060611 Mar 05 21:08:22.382033 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2225/4472] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:08:22.391151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-be2389b6-ab13-4fe7-b5f9-24c024272c38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:22.393121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-be2389b6-ab13-4fe7-b5f9-24c024272c38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:22.405903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be2389b6-ab13-4fe7-b5f9-24c024272c38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:22.406733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be2389b6-ab13-4fe7-b5f9-24c024272c38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:22.408060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be2389b6-ab13-4fe7-b5f9-24c024272c38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:22.408874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be2389b6-ab13-4fe7-b5f9-24c024272c38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:22.671154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-be2389b6-ab13-4fe7-b5f9-24c024272c38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:22.679962 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-be2389b6-ab13-4fe7-b5f9-24c024272c38 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1314 microversion: 2.1 time: 0.296031 Mar 05 21:08:22.680684 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2226/4473] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:22 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:22.755699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-996e0dd9-57e7-4e22-b20c-bff459d618bf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:22.770589 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-996e0dd9-57e7-4e22-b20c-bff459d618bf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.263488 Mar 05 21:08:22.784340 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2248/4474] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:21 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:22.791711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-417b60cc-49f9-4626-b4fc-dc2dc72d7a79 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:22.792688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-417b60cc-49f9-4626-b4fc-dc2dc72d7a79 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 1032de97-a4f2-4eb1-9499-1217b38a0517] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:22.802030 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-417b60cc-49f9-4626-b4fc-dc2dc72d7a79 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 1032de97-a4f2-4eb1-9499-1217b38a0517 could not be found. Mar 05 21:08:22.803113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-417b60cc-49f9-4626-b4fc-dc2dc72d7a79 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 1032de97-a4f2-4eb1-9499-1217b38a0517 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:22.805389 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-417b60cc-49f9-4626-b4fc-dc2dc72d7a79 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/1032de97-a4f2-4eb1-9499-1217b38a0517/action" status: 404 len: 111 microversion: 2.1 time: 0.021030 Mar 05 21:08:22.808111 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2227/4475] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:22 2022] POST /compute/v2.1/servers/1032de97-a4f2-4eb1-9499-1217b38a0517/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:08:22.819247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-523be99f-55bb-4f94-aaa8-498c50b5f805 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:22.819943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-523be99f-55bb-4f94-aaa8-498c50b5f805 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:22.832285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-523be99f-55bb-4f94-aaa8-498c50b5f805 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:22.832749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-523be99f-55bb-4f94-aaa8-498c50b5f805 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:22.833607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-523be99f-55bb-4f94-aaa8-498c50b5f805 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:22.834035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-523be99f-55bb-4f94-aaa8-498c50b5f805 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:23.630084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-523be99f-55bb-4f94-aaa8-498c50b5f805 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:23.641315 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-523be99f-55bb-4f94-aaa8-498c50b5f805 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.827905 Mar 05 21:08:23.643232 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2249/4476] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:22 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:23.665032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0f6e3920-a7b1-4bc0-aae0-ab2b4ee135f2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:23.666000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0f6e3920-a7b1-4bc0-aae0-ab2b4ee135f2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:23.674901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0f6e3920-a7b1-4bc0-aae0-ab2b4ee135f2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:23.676420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0f6e3920-a7b1-4bc0-aae0-ab2b4ee135f2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:23.677756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0f6e3920-a7b1-4bc0-aae0-ab2b4ee135f2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:23.678378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0f6e3920-a7b1-4bc0-aae0-ab2b4ee135f2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:23.698562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f19f0de3-19db-4817-8d93-00f9f6a0b36a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:23.699385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f19f0de3-19db-4817-8d93-00f9f6a0b36a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:23.711252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f19f0de3-19db-4817-8d93-00f9f6a0b36a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:23.714786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f19f0de3-19db-4817-8d93-00f9f6a0b36a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:23.715716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f19f0de3-19db-4817-8d93-00f9f6a0b36a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:23.716284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f19f0de3-19db-4817-8d93-00f9f6a0b36a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:23.954248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0f6e3920-a7b1-4bc0-aae0-ab2b4ee135f2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:23.963471 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0f6e3920-a7b1-4bc0-aae0-ab2b4ee135f2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.302139 Mar 05 21:08:23.964243 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2228/4477] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:23 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:23.982612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-669d9580-27ce-48d0-86f0-7d171abbbcfd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:23.983221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-669d9580-27ce-48d0-86f0-7d171abbbcfd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:23.990651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-669d9580-27ce-48d0-86f0-7d171abbbcfd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:23.991116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-669d9580-27ce-48d0-86f0-7d171abbbcfd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:23.991958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-669d9580-27ce-48d0-86f0-7d171abbbcfd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:23.992581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-669d9580-27ce-48d0-86f0-7d171abbbcfd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:24.028444 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-669d9580-27ce-48d0-86f0-7d171abbbcfd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Cannot 'restore' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state active Mar 05 21:08:24.029830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-669d9580-27ce-48d0-86f0-7d171abbbcfd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 409 to user: Cannot 'restore' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state active {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:24.030883 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-669d9580-27ce-48d0-86f0-7d171abbbcfd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action" status: 409 len: 145 microversion: 2.1 time: 0.053847 Mar 05 21:08:24.035566 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2229/4478] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:23 2022] POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action => generated 145 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:08:24.041739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd915425-bc6a-4823-b880-4bb83be7b594 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:24.043095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd915425-bc6a-4823-b880-4bb83be7b594 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:24.050228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd915425-bc6a-4823-b880-4bb83be7b594 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:24.050687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd915425-bc6a-4823-b880-4bb83be7b594 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:24.051864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd915425-bc6a-4823-b880-4bb83be7b594 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:24.052359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd915425-bc6a-4823-b880-4bb83be7b594 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:24.312452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd915425-bc6a-4823-b880-4bb83be7b594 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:24.324494 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd915425-bc6a-4823-b880-4bb83be7b594 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.287505 Mar 05 21:08:24.325122 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2230/4479] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:24 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:24.342427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8675a357-1b3d-498f-9088-6f989239d138 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:24.343408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8675a357-1b3d-498f-9088-6f989239d138 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:24.358984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8675a357-1b3d-498f-9088-6f989239d138 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:24.359373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8675a357-1b3d-498f-9088-6f989239d138 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:24.360338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8675a357-1b3d-498f-9088-6f989239d138 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:24.360865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8675a357-1b3d-498f-9088-6f989239d138 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:24.708006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f19f0de3-19db-4817-8d93-00f9f6a0b36a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:24.720468 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f19f0de3-19db-4817-8d93-00f9f6a0b36a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1314 microversion: 2.1 time: 1.026115 Mar 05 21:08:24.723577 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2250/4480] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:23 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:24.792687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8675a357-1b3d-498f-9088-6f989239d138 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:24.808068 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8675a357-1b3d-498f-9088-6f989239d138 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.469368 Mar 05 21:08:24.809459 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2231/4481] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:24 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:24.841474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5ce871b3-f13b-4ff3-8e91-9a6c9cd1e526 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:24.842062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5ce871b3-f13b-4ff3-8e91-9a6c9cd1e526 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: e75b58bb-4a49-4382-b995-27f4f177009a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:24.858532 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-5ce871b3-f13b-4ff3-8e91-9a6c9cd1e526 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance e75b58bb-4a49-4382-b995-27f4f177009a could not be found. Mar 05 21:08:24.859434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5ce871b3-f13b-4ff3-8e91-9a6c9cd1e526 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance e75b58bb-4a49-4382-b995-27f4f177009a could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:24.860485 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5ce871b3-f13b-4ff3-8e91-9a6c9cd1e526 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/e75b58bb-4a49-4382-b995-27f4f177009a/action" status: 404 len: 111 microversion: 2.1 time: 0.033294 Mar 05 21:08:24.864588 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2251/4482] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:24 2022] POST /compute/v2.1/servers/e75b58bb-4a49-4382-b995-27f4f177009a/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:08:24.870465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f635133-3174-474d-8500-6354c96bc09e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:24.871348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5f635133-3174-474d-8500-6354c96bc09e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:24.881002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f635133-3174-474d-8500-6354c96bc09e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:24.881861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f635133-3174-474d-8500-6354c96bc09e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:24.883600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f635133-3174-474d-8500-6354c96bc09e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:24.917231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f635133-3174-474d-8500-6354c96bc09e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:25.440349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5f635133-3174-474d-8500-6354c96bc09e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:25.449917 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5f635133-3174-474d-8500-6354c96bc09e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.584134 Mar 05 21:08:25.459160 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2232/4483] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:24 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:25.477146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af3a79ed-82e5-4cda-a63e-dddfe0e0fffa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:25.478047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-af3a79ed-82e5-4cda-a63e-dddfe0e0fffa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:25.492632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af3a79ed-82e5-4cda-a63e-dddfe0e0fffa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:25.496863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af3a79ed-82e5-4cda-a63e-dddfe0e0fffa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:25.498067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af3a79ed-82e5-4cda-a63e-dddfe0e0fffa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:25.498666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af3a79ed-82e5-4cda-a63e-dddfe0e0fffa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:25.738867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e37f0072-258b-4644-b1e1-c00e120dea06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:25.739500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e37f0072-258b-4644-b1e1-c00e120dea06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:25.748706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e37f0072-258b-4644-b1e1-c00e120dea06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:25.749173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e37f0072-258b-4644-b1e1-c00e120dea06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:25.749952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e37f0072-258b-4644-b1e1-c00e120dea06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:25.750389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e37f0072-258b-4644-b1e1-c00e120dea06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:26.414810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e37f0072-258b-4644-b1e1-c00e120dea06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:26.425127 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e37f0072-258b-4644-b1e1-c00e120dea06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1314 microversion: 2.1 time: 0.691175 Mar 05 21:08:26.425872 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2233/4484] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:25 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:26.502727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-af3a79ed-82e5-4cda-a63e-dddfe0e0fffa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:26.511128 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-af3a79ed-82e5-4cda-a63e-dddfe0e0fffa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.038749 Mar 05 21:08:26.512104 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2252/4485] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:25 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:26.529114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-33accdf0-8927-4317-ae66-45551ebe6afa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:26.529896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-33accdf0-8927-4317-ae66-45551ebe6afa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:26.538410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33accdf0-8927-4317-ae66-45551ebe6afa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:26.539133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33accdf0-8927-4317-ae66-45551ebe6afa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:26.540091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33accdf0-8927-4317-ae66-45551ebe6afa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:26.540904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33accdf0-8927-4317-ae66-45551ebe6afa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:26.569043 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-33accdf0-8927-4317-ae66-45551ebe6afa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Cannot 'resume' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state active Mar 05 21:08:26.569647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-33accdf0-8927-4317-ae66-45551ebe6afa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 409 to user: Cannot 'resume' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state active {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:26.570828 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-33accdf0-8927-4317-ae66-45551ebe6afa tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action" status: 409 len: 144 microversion: 2.1 time: 0.046140 Mar 05 21:08:26.571782 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2234/4486] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:26 2022] POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action => generated 144 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:08:26.581501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5ae6a2c7-0696-49e4-b6fc-4342b7abb214 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:26.582270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5ae6a2c7-0696-49e4-b6fc-4342b7abb214 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:26.588988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ae6a2c7-0696-49e4-b6fc-4342b7abb214 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:26.590648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ae6a2c7-0696-49e4-b6fc-4342b7abb214 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:26.591566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ae6a2c7-0696-49e4-b6fc-4342b7abb214 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:26.592148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ae6a2c7-0696-49e4-b6fc-4342b7abb214 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:27.171801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5ae6a2c7-0696-49e4-b6fc-4342b7abb214 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:27.188386 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5ae6a2c7-0696-49e4-b6fc-4342b7abb214 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.612651 Mar 05 21:08:27.189162 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2253/4487] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:26 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:27.208361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4f5ee716-47c9-495a-ae7f-02f065d9a457 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:27.209281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4f5ee716-47c9-495a-ae7f-02f065d9a457 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:27.225850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f5ee716-47c9-495a-ae7f-02f065d9a457 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:27.226464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f5ee716-47c9-495a-ae7f-02f065d9a457 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:27.227562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f5ee716-47c9-495a-ae7f-02f065d9a457 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:27.228121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f5ee716-47c9-495a-ae7f-02f065d9a457 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:27.443584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0881ff47-5728-436f-b6a4-ad30e4334ea3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:27.444361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0881ff47-5728-436f-b6a4-ad30e4334ea3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:27.459012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0881ff47-5728-436f-b6a4-ad30e4334ea3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:27.462951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0881ff47-5728-436f-b6a4-ad30e4334ea3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:27.464142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0881ff47-5728-436f-b6a4-ad30e4334ea3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:27.464821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0881ff47-5728-436f-b6a4-ad30e4334ea3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:28.494511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4f5ee716-47c9-495a-ae7f-02f065d9a457 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:28.503426 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4f5ee716-47c9-495a-ae7f-02f065d9a457 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.299794 Mar 05 21:08:28.507699 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2235/4488] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:27 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:28.648249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0881ff47-5728-436f-b6a4-ad30e4334ea3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:28.662253 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0881ff47-5728-436f-b6a4-ad30e4334ea3 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1314 microversion: 2.1 time: 1.223432 Mar 05 21:08:28.663812 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2254/4489] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:27 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1314 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:28.776734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9ddc2521-d571-4db6-8917-ff8ebcd02af0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "009197ce-e0dc-47b9-b8f3-b27f078b9f37"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:28.784904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9ddc2521-d571-4db6-8917-ff8ebcd02af0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:28.788150 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9ddc2521-d571-4db6-8917-ff8ebcd02af0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.015512 Mar 05 21:08:28.817111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8dc81539-d51d-4c69-9488-073ada11d49f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:28.820482 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2236/4490] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:08:28 2022] POST /compute/v2.1/servers => generated 108 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:08:28.820797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8dc81539-d51d-4c69-9488-073ada11d49f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:28.841263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8dc81539-d51d-4c69-9488-073ada11d49f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:28.842044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8dc81539-d51d-4c69-9488-073ada11d49f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:28.843438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8dc81539-d51d-4c69-9488-073ada11d49f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:28.856663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8dc81539-d51d-4c69-9488-073ada11d49f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:29.681762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-556c7c76-c9c0-4d99-97a4-9a8eeb05df86 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:29.683034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-556c7c76-c9c0-4d99-97a4-9a8eeb05df86 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:29.703010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-556c7c76-c9c0-4d99-97a4-9a8eeb05df86 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:29.707621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-556c7c76-c9c0-4d99-97a4-9a8eeb05df86 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:29.712880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-556c7c76-c9c0-4d99-97a4-9a8eeb05df86 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:29.717340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-556c7c76-c9c0-4d99-97a4-9a8eeb05df86 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:29.799400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8dc81539-d51d-4c69-9488-073ada11d49f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:29.824499 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8dc81539-d51d-4c69-9488-073ada11d49f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.008217 Mar 05 21:08:29.835259 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2255/4491] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:28 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:29.856166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b09dfc5c-3356-4b28-bd30-9f1f4ef805e9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:29.858432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b09dfc5c-3356-4b28-bd30-9f1f4ef805e9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:29.907095 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b09dfc5c-3356-4b28-bd30-9f1f4ef805e9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:29.914201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b09dfc5c-3356-4b28-bd30-9f1f4ef805e9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:29.926101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b09dfc5c-3356-4b28-bd30-9f1f4ef805e9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:29.927290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b09dfc5c-3356-4b28-bd30-9f1f4ef805e9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:30.152294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-556c7c76-c9c0-4d99-97a4-9a8eeb05df86 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:30.156600 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-556c7c76-c9c0-4d99-97a4-9a8eeb05df86 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1314 microversion: 2.1 time: 0.479862 Mar 05 21:08:30.157572 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2237/4492] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:29 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:30.163502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-ea6da78c-217e-4abf-ba94-644561f5f17a req-3eaaa471-8773-4171-be8b-f80c2a4fcabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb113c5-40de-49b7-8f60-c10f275d42db", "name": "network-vif-plugged", "status": "completed", "tag": "2de15539-9dfc-43c7-86e8-df851b4d8dbe"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:30.172829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ea6da78c-217e-4abf-ba94-644561f5f17a req-3eaaa471-8773-4171-be8b-f80c2a4fcabd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:30.173578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ea6da78c-217e-4abf-ba94-644561f5f17a req-3eaaa471-8773-4171-be8b-f80c2a4fcabd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:30.195058 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ea6da78c-217e-4abf-ba94-644561f5f17a req-3eaaa471-8773-4171-be8b-f80c2a4fcabd service nova] Creating event network-vif-plugged:2de15539-9dfc-43c7-86e8-df851b4d8dbe for instance 7eb113c5-40de-49b7-8f60-c10f275d42db on nch2-master-1 Mar 05 21:08:30.212813 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-ea6da78c-217e-4abf-ba94-644561f5f17a req-3eaaa471-8773-4171-be8b-f80c2a4fcabd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053475 Mar 05 21:08:30.212813 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2238/4493] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:08:30.798757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b09dfc5c-3356-4b28-bd30-9f1f4ef805e9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:30.816293 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b09dfc5c-3356-4b28-bd30-9f1f4ef805e9 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.963216 Mar 05 21:08:30.827797 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2256/4494] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:29 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:30.848030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c7b109ac-cbf8-4439-8747-7ea58623b00e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:30.848867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c7b109ac-cbf8-4439-8747-7ea58623b00e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: af2766d4-b948-4f60-bbfd-a513f94f0b4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:30.867642 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-c7b109ac-cbf8-4439-8747-7ea58623b00e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance af2766d4-b948-4f60-bbfd-a513f94f0b4f could not be found. Mar 05 21:08:30.868748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c7b109ac-cbf8-4439-8747-7ea58623b00e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance af2766d4-b948-4f60-bbfd-a513f94f0b4f could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:08:30.914836 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c7b109ac-cbf8-4439-8747-7ea58623b00e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/af2766d4-b948-4f60-bbfd-a513f94f0b4f/action" status: 404 len: 111 microversion: 2.1 time: 0.042693 Mar 05 21:08:30.918973 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2239/4495] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:30 2022] POST /compute/v2.1/servers/af2766d4-b948-4f60-bbfd-a513f94f0b4f/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:08:30.934869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ae1177a1-d621-413e-ba21-b77422cc5c19 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:30.936130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ae1177a1-d621-413e-ba21-b77422cc5c19 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:30.952887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae1177a1-d621-413e-ba21-b77422cc5c19 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:30.955945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae1177a1-d621-413e-ba21-b77422cc5c19 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:30.957877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae1177a1-d621-413e-ba21-b77422cc5c19 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:30.958650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae1177a1-d621-413e-ba21-b77422cc5c19 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:31.176321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6a77e1fd-ac29-4308-b45b-5f1ccf0854f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:31.177604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6a77e1fd-ac29-4308-b45b-5f1ccf0854f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:31.190432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6a77e1fd-ac29-4308-b45b-5f1ccf0854f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:31.196131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6a77e1fd-ac29-4308-b45b-5f1ccf0854f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:31.197722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6a77e1fd-ac29-4308-b45b-5f1ccf0854f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:31.198496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6a77e1fd-ac29-4308-b45b-5f1ccf0854f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:31.594585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6a77e1fd-ac29-4308-b45b-5f1ccf0854f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:31.635026 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6a77e1fd-ac29-4308-b45b-5f1ccf0854f1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1314 microversion: 2.1 time: 0.451161 Mar 05 21:08:31.676180 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2240/4496] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:31 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:31.727954 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:08:31.728181 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 21:08:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:08:31.964347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ae1177a1-d621-413e-ba21-b77422cc5c19 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:31.981732 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ae1177a1-d621-413e-ba21-b77422cc5c19 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.055649 Mar 05 21:08:31.990653 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2257/4497] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:30 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:32.029622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c04a7494-810e-4caf-bdc4-b74034e10e3f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:32.039453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c04a7494-810e-4caf-bdc4-b74034e10e3f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:32.066958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c04a7494-810e-4caf-bdc4-b74034e10e3f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:32.072084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c04a7494-810e-4caf-bdc4-b74034e10e3f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:32.074588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c04a7494-810e-4caf-bdc4-b74034e10e3f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:32.075121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c04a7494-810e-4caf-bdc4-b74034e10e3f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:32.693325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f12c6fdb-e77c-4d3a-85da-55103c484408 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:32.694323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f12c6fdb-e77c-4d3a-85da-55103c484408 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:32.706949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f12c6fdb-e77c-4d3a-85da-55103c484408 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:32.713203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f12c6fdb-e77c-4d3a-85da-55103c484408 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:32.714302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f12c6fdb-e77c-4d3a-85da-55103c484408 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:32.715002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f12c6fdb-e77c-4d3a-85da-55103c484408 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:33.038045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c04a7494-810e-4caf-bdc4-b74034e10e3f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:33.056122 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c04a7494-810e-4caf-bdc4-b74034e10e3f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.049988 Mar 05 21:08:33.066932 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2241/4498] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:32 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:33.081432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0adc101c-0eb8-4417-9ba0-65c2d7ee3ad4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:33.082057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0adc101c-0eb8-4417-9ba0-65c2d7ee3ad4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:33.090304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0adc101c-0eb8-4417-9ba0-65c2d7ee3ad4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:33.090771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0adc101c-0eb8-4417-9ba0-65c2d7ee3ad4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:33.105885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0adc101c-0eb8-4417-9ba0-65c2d7ee3ad4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:33.107271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0adc101c-0eb8-4417-9ba0-65c2d7ee3ad4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:33.206436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-0adc101c-0eb8-4417-9ba0-65c2d7ee3ad4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lazy-loading 'flavor' on Instance uuid 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:08:33.241255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f12c6fdb-e77c-4d3a-85da-55103c484408 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:33.254982 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f12c6fdb-e77c-4d3a-85da-55103c484408 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1500 microversion: 2.1 time: 0.564885 Mar 05 21:08:33.258340 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2258/4499] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:32 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1500 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:33.287652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-35c46317-ca07-48c6-a2a7-845c66fe6f99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:33.288948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-35c46317-ca07-48c6-a2a7-845c66fe6f99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:33.307595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35c46317-ca07-48c6-a2a7-845c66fe6f99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:33.311197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35c46317-ca07-48c6-a2a7-845c66fe6f99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:33.313642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35c46317-ca07-48c6-a2a7-845c66fe6f99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:33.314441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35c46317-ca07-48c6-a2a7-845c66fe6f99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:33.488803 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-35c46317-ca07-48c6-a2a7-845c66fe6f99 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db/action" status: 202 len: 0 microversion: 2.1 time: 0.214036 Mar 05 21:08:33.491549 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2259/4500] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:33 2022] POST /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:08:33.504862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e6bd6dde-1d9f-470e-a10a-1d9b7eff555a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:33.506527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e6bd6dde-1d9f-470e-a10a-1d9b7eff555a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:33.530882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6bd6dde-1d9f-470e-a10a-1d9b7eff555a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:33.532038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6bd6dde-1d9f-470e-a10a-1d9b7eff555a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:33.533678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6bd6dde-1d9f-470e-a10a-1d9b7eff555a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:33.534501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6bd6dde-1d9f-470e-a10a-1d9b7eff555a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:33.680714 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0adc101c-0eb8-4417-9ba0-65c2d7ee3ad4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action" status: 202 len: 0 microversion: 2.1 time: 0.610194 Mar 05 21:08:33.681754 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2242/4501] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:33 2022] POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 21:08:33.706973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f38efa47-6368-4f04-8cf1-909916895dda tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:33.710043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f38efa47-6368-4f04-8cf1-909916895dda tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:33.723210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f38efa47-6368-4f04-8cf1-909916895dda tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:33.725476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f38efa47-6368-4f04-8cf1-909916895dda tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:33.726646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f38efa47-6368-4f04-8cf1-909916895dda tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:33.727291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f38efa47-6368-4f04-8cf1-909916895dda tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:33.995589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f38efa47-6368-4f04-8cf1-909916895dda tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:34.006187 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f38efa47-6368-4f04-8cf1-909916895dda tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1511 microversion: 2.1 time: 0.303533 Mar 05 21:08:34.007308 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2243/4502] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:33 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:34.041888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e6bd6dde-1d9f-470e-a10a-1d9b7eff555a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:34.051948 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e6bd6dde-1d9f-470e-a10a-1d9b7eff555a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1505 microversion: 2.1 time: 0.556335 Mar 05 21:08:34.052663 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2260/4503] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:33 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:35.030146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-18d25384-eaa1-432f-9595-4b992fcb1665 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:35.031962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-18d25384-eaa1-432f-9595-4b992fcb1665 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:35.042231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-18d25384-eaa1-432f-9595-4b992fcb1665 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:35.051148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-18d25384-eaa1-432f-9595-4b992fcb1665 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:35.052448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-18d25384-eaa1-432f-9595-4b992fcb1665 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:35.059439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-18d25384-eaa1-432f-9595-4b992fcb1665 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:35.070624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4de53d91-b081-44cd-8538-f88df8016008 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:35.071431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4de53d91-b081-44cd-8538-f88df8016008 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:35.078540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4de53d91-b081-44cd-8538-f88df8016008 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:35.089443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4de53d91-b081-44cd-8538-f88df8016008 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:35.096542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4de53d91-b081-44cd-8538-f88df8016008 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:35.097394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4de53d91-b081-44cd-8538-f88df8016008 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:35.498057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4de53d91-b081-44cd-8538-f88df8016008 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:35.512348 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4de53d91-b081-44cd-8538-f88df8016008 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1485 microversion: 2.1 time: 0.445830 Mar 05 21:08:35.520698 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2261/4504] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:35 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1485 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:35.528630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2cbe0d7f-8ed4-49d0-b181-6ba670c76412 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Action: 'create', calling method: .version_select at 0x7fed4f587e50>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-636395213"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:35.545076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-2cbe0d7f-8ed4-49d0-b181-6ba670c76412 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Getting quotas for project aa71bdd8c3394c1ca9fb656a112d9349. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:08:35.551081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-2cbe0d7f-8ed4-49d0-b181-6ba670c76412 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Getting quotas for user d0f84866b0f34e6da2d051b5b3583e13 and project aa71bdd8c3394c1ca9fb656a112d9349. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:08:35.616008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-18d25384-eaa1-432f-9595-4b992fcb1665 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:35.626627 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-18d25384-eaa1-432f-9595-4b992fcb1665 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1511 microversion: 2.1 time: 0.605603 Mar 05 21:08:35.627225 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2244/4505] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:35 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1511 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:35.638339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23866134-1015-48f0-934c-df5940f9c826 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:35.642197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-23866134-1015-48f0-934c-df5940f9c826 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:35.653508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23866134-1015-48f0-934c-df5940f9c826 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:35.656189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23866134-1015-48f0-934c-df5940f9c826 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:35.657244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23866134-1015-48f0-934c-df5940f9c826 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:35.658975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23866134-1015-48f0-934c-df5940f9c826 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:35.716124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-23866134-1015-48f0-934c-df5940f9c826 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lazy-loading 'flavor' on Instance uuid 7eb113c5-40de-49b7-8f60-c10f275d42db {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:08:36.216847 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-23866134-1015-48f0-934c-df5940f9c826 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db/action" status: 202 len: 0 microversion: 2.1 time: 0.585208 Mar 05 21:08:36.225321 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2245/4506] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:08:35 2022] POST /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:08:36.244194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-2cbe0d7f-8ed4-49d0-b181-6ba670c76412 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Getting quotas for project aa71bdd8c3394c1ca9fb656a112d9349. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:08:36.257711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-2cbe0d7f-8ed4-49d0-b181-6ba670c76412 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Getting quotas for user d0f84866b0f34e6da2d051b5b3583e13 and project aa71bdd8c3394c1ca9fb656a112d9349. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:08:36.257916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b09fac63-4757-403d-b223-b0732b3f1b31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:36.258831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b09fac63-4757-403d-b223-b0732b3f1b31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:36.277543 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2cbe0d7f-8ed4-49d0-b181-6ba670c76412 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.755406 Mar 05 21:08:36.278422 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2262/4507] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:08:35 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:36.284827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b09fac63-4757-403d-b223-b0732b3f1b31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:36.285516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b09fac63-4757-403d-b223-b0732b3f1b31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:36.286491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b09fac63-4757-403d-b223-b0732b3f1b31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:36.287142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b09fac63-4757-403d-b223-b0732b3f1b31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:36.663836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8a5fe687-c195-417e-955e-be3ae1de79f6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:36.665180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8a5fe687-c195-417e-955e-be3ae1de79f6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:36.684350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a5fe687-c195-417e-955e-be3ae1de79f6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:36.686678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a5fe687-c195-417e-955e-be3ae1de79f6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:36.692017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a5fe687-c195-417e-955e-be3ae1de79f6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:36.693026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a5fe687-c195-417e-955e-be3ae1de79f6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:36.711522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b09fac63-4757-403d-b223-b0732b3f1b31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:36.722476 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b09fac63-4757-403d-b223-b0732b3f1b31 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1491 microversion: 2.1 time: 0.492921 Mar 05 21:08:36.723076 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2246/4508] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:36 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1491 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:37.144214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8a5fe687-c195-417e-955e-be3ae1de79f6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:37.153964 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8a5fe687-c195-417e-955e-be3ae1de79f6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1511 microversion: 2.1 time: 0.513540 Mar 05 21:08:37.155641 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2263/4509] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:36 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1511 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:37.741548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7e6a081d-be28-4dc6-8f5a-2d36af9395d8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:37.742168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7e6a081d-be28-4dc6-8f5a-2d36af9395d8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:37.749398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e6a081d-be28-4dc6-8f5a-2d36af9395d8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:37.750089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e6a081d-be28-4dc6-8f5a-2d36af9395d8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:37.751102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e6a081d-be28-4dc6-8f5a-2d36af9395d8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:37.752278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e6a081d-be28-4dc6-8f5a-2d36af9395d8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:38.080611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7e6a081d-be28-4dc6-8f5a-2d36af9395d8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:38.093068 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7e6a081d-be28-4dc6-8f5a-2d36af9395d8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1512 microversion: 2.1 time: 0.355301 Mar 05 21:08:38.109190 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2247/4510] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:37 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1512 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:38.181428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2e78df7b-0cc6-421f-9f07-3d94102f5aab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:38.182627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2e78df7b-0cc6-421f-9f07-3d94102f5aab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:38.192480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e78df7b-0cc6-421f-9f07-3d94102f5aab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:38.193236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e78df7b-0cc6-421f-9f07-3d94102f5aab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:38.194664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e78df7b-0cc6-421f-9f07-3d94102f5aab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:38.195209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e78df7b-0cc6-421f-9f07-3d94102f5aab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:38.841592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-417752183", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "58a73208-a97d-4148-854a-a7d6520bb60b", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-636395213", "security_groups": [{"name": "tempest-secgroup-smoke-422979215"}], "networks": [{"uuid": "ae1269f1-682e-4aa3-b338-a2b7ba6d8a67"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:38.978612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2e78df7b-0cc6-421f-9f07-3d94102f5aab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:38.994373 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2e78df7b-0cc6-421f-9f07-3d94102f5aab tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1511 microversion: 2.1 time: 0.826139 Mar 05 21:08:38.995000 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2264/4511] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:38 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1511 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:39.119297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5d5bc494-24e0-478c-b4cc-1e7b973fcfaa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:39.120347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5d5bc494-24e0-478c-b4cc-1e7b973fcfaa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:39.136940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] validate_networks() for [('ae1269f1-682e-4aa3-b338-a2b7ba6d8a67', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:08:39.143339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d5bc494-24e0-478c-b4cc-1e7b973fcfaa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:39.144460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d5bc494-24e0-478c-b4cc-1e7b973fcfaa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:39.145846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d5bc494-24e0-478c-b4cc-1e7b973fcfaa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:39.146518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d5bc494-24e0-478c-b4cc-1e7b973fcfaa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:39.841464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5d5bc494-24e0-478c-b4cc-1e7b973fcfaa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:39.857833 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5d5bc494-24e0-478c-b4cc-1e7b973fcfaa tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1507 microversion: 2.1 time: 0.743586 Mar 05 21:08:39.859172 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2265/4512] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:39 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1507 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:40.023381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7eddc64d-1186-4ca5-93a7-1590d51b31f1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:40.024563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7eddc64d-1186-4ca5-93a7-1590d51b31f1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:40.038315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7eddc64d-1186-4ca5-93a7-1590d51b31f1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:40.038872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7eddc64d-1186-4ca5-93a7-1590d51b31f1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:40.040140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7eddc64d-1186-4ca5-93a7-1590d51b31f1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:40.040927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7eddc64d-1186-4ca5-93a7-1590d51b31f1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:40.561757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7eddc64d-1186-4ca5-93a7-1590d51b31f1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:40.588643 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7eddc64d-1186-4ca5-93a7-1590d51b31f1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1511 microversion: 2.1 time: 0.568041 Mar 05 21:08:40.591354 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2266/4513] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:40 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1511 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:40.887954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d884c77-1286-463a-bd0f-708842198588 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:40.890531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7d884c77-1286-463a-bd0f-708842198588 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:40.899545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d884c77-1286-463a-bd0f-708842198588 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:40.901165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d884c77-1286-463a-bd0f-708842198588 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:40.903112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d884c77-1286-463a-bd0f-708842198588 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:40.903864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d884c77-1286-463a-bd0f-708842198588 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:41.016861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:08:41.019697 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:08:41.020370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:08:41.020993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:08:41.021727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:08:41.034687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:41.035339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:41.039123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:41.040161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:41.074955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Getting quotas for project aa71bdd8c3394c1ca9fb656a112d9349. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:08:41.085014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Getting quotas for user d0f84866b0f34e6da2d051b5b3583e13 and project aa71bdd8c3394c1ca9fb656a112d9349. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:08:41.187415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:08:41.190954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='58a73208-a97d-4148-854a-a7d6520bb60b',volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:08:41.505276 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-76455f84-c475-463a-8ab5-c527aff22749 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.667032 Mar 05 21:08:41.511406 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2248/4514] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:08:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 2674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:08:41.518960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a2d274ec-0221-4c97-9c92-80aad8fb161f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:41.525161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a2d274ec-0221-4c97-9c92-80aad8fb161f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:41.658186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a2d274ec-0221-4c97-9c92-80aad8fb161f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:41.669291 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a2d274ec-0221-4c97-9c92-80aad8fb161f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1097 microversion: 2.1 time: 0.154114 Mar 05 21:08:41.679714 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2249/4515] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:41 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1097 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:41.693943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3908ff5a-4a3d-4bcd-a402-b3d57d9c861f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:41.695721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3908ff5a-4a3d-4bcd-a402-b3d57d9c861f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:41.707629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3908ff5a-4a3d-4bcd-a402-b3d57d9c861f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:41.710768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3908ff5a-4a3d-4bcd-a402-b3d57d9c861f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:41.711803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3908ff5a-4a3d-4bcd-a402-b3d57d9c861f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:41.716486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3908ff5a-4a3d-4bcd-a402-b3d57d9c861f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:42.150658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d884c77-1286-463a-bd0f-708842198588 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:42.168273 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7d884c77-1286-463a-bd0f-708842198588 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1507 microversion: 2.1 time: 1.290323 Mar 05 21:08:42.169237 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2267/4516] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:40 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1507 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:42.185998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b2dcd09a-3adb-471b-8233-ee99e005edc6 req-40137524-8630-422d-804b-c8f1f4628eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb113c5-40de-49b7-8f60-c10f275d42db", "name": "network-vif-plugged", "status": "completed", "tag": "2de15539-9dfc-43c7-86e8-df851b4d8dbe"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:42.211900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b2dcd09a-3adb-471b-8233-ee99e005edc6 req-40137524-8630-422d-804b-c8f1f4628eab service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:42.213252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b2dcd09a-3adb-471b-8233-ee99e005edc6 req-40137524-8630-422d-804b-c8f1f4628eab service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:42.228196 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b2dcd09a-3adb-471b-8233-ee99e005edc6 req-40137524-8630-422d-804b-c8f1f4628eab service nova] Creating event network-vif-plugged:2de15539-9dfc-43c7-86e8-df851b4d8dbe for instance 7eb113c5-40de-49b7-8f60-c10f275d42db on nch2-master-1 Mar 05 21:08:42.235584 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b2dcd09a-3adb-471b-8233-ee99e005edc6 req-40137524-8630-422d-804b-c8f1f4628eab service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062389 Mar 05 21:08:42.236694 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2268/4517] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:08:42.328016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3908ff5a-4a3d-4bcd-a402-b3d57d9c861f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:42.338268 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3908ff5a-4a3d-4bcd-a402-b3d57d9c861f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1511 microversion: 2.1 time: 0.656063 Mar 05 21:08:42.341242 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2250/4518] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:41 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1511 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:42.690257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-228dd173-2e42-42b4-80e0-0ea3ac47f67c tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:42.692434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-228dd173-2e42-42b4-80e0-0ea3ac47f67c tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:42.701608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-228dd173-2e42-42b4-80e0-0ea3ac47f67c tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:42.703074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-228dd173-2e42-42b4-80e0-0ea3ac47f67c tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:42.706240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-228dd173-2e42-42b4-80e0-0ea3ac47f67c tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:42.706987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-228dd173-2e42-42b4-80e0-0ea3ac47f67c tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:42.863823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-228dd173-2e42-42b4-80e0-0ea3ac47f67c tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:42.885456 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-228dd173-2e42-42b4-80e0-0ea3ac47f67c tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1195 microversion: 2.1 time: 0.199883 Mar 05 21:08:42.887057 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2269/4519] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:42 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1195 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:43.187895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-846cb9eb-0bf6-48ca-8f71-d85fdcdaca7b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:43.189923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-846cb9eb-0bf6-48ca-8f71-d85fdcdaca7b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:43.203322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-846cb9eb-0bf6-48ca-8f71-d85fdcdaca7b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:43.209665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-846cb9eb-0bf6-48ca-8f71-d85fdcdaca7b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:43.212915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-846cb9eb-0bf6-48ca-8f71-d85fdcdaca7b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:43.215075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-846cb9eb-0bf6-48ca-8f71-d85fdcdaca7b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:43.358470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-79281a49-9c75-43fa-9fbc-9693105f311f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:43.359815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-79281a49-9c75-43fa-9fbc-9693105f311f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:43.378714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-79281a49-9c75-43fa-9fbc-9693105f311f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:43.380438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-79281a49-9c75-43fa-9fbc-9693105f311f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:43.383871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-79281a49-9c75-43fa-9fbc-9693105f311f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:43.388342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-79281a49-9c75-43fa-9fbc-9693105f311f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:44.271618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-846cb9eb-0bf6-48ca-8f71-d85fdcdaca7b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:44.283121 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-846cb9eb-0bf6-48ca-8f71-d85fdcdaca7b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1507 microversion: 2.1 time: 1.099756 Mar 05 21:08:44.292039 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2251/4520] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:43 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1507 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:44.307296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5dd11d03-e860-4236-99b6-6450e95bd2ff tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:44.317298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5dd11d03-e860-4236-99b6-6450e95bd2ff tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:44.326406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-79281a49-9c75-43fa-9fbc-9693105f311f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:44.346336 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-79281a49-9c75-43fa-9fbc-9693105f311f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1511 microversion: 2.1 time: 0.990913 Mar 05 21:08:44.357770 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2270/4521] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:43 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1511 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:44.363451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5dd11d03-e860-4236-99b6-6450e95bd2ff tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:44.367924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5dd11d03-e860-4236-99b6-6450e95bd2ff tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:44.368828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5dd11d03-e860-4236-99b6-6450e95bd2ff tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:44.376112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5dd11d03-e860-4236-99b6-6450e95bd2ff tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:44.724242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5dd11d03-e860-4236-99b6-6450e95bd2ff tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:44.735535 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5dd11d03-e860-4236-99b6-6450e95bd2ff tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1213 microversion: 2.1 time: 0.442115 Mar 05 21:08:44.738824 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2252/4522] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:44 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1213 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:45.307012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fab5a54b-1bb3-430c-90c4-2d8386534817 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:45.310957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fab5a54b-1bb3-430c-90c4-2d8386534817 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:45.323992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fab5a54b-1bb3-430c-90c4-2d8386534817 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:45.326830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fab5a54b-1bb3-430c-90c4-2d8386534817 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:45.328555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fab5a54b-1bb3-430c-90c4-2d8386534817 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:45.330120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fab5a54b-1bb3-430c-90c4-2d8386534817 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:45.365999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1a89bcd7-c517-4d1e-9808-39f931b5b86b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:45.367373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1a89bcd7-c517-4d1e-9808-39f931b5b86b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:45.385341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a89bcd7-c517-4d1e-9808-39f931b5b86b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:45.387225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a89bcd7-c517-4d1e-9808-39f931b5b86b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:45.388337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a89bcd7-c517-4d1e-9808-39f931b5b86b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:45.390991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a89bcd7-c517-4d1e-9808-39f931b5b86b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:46.426366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1a89bcd7-c517-4d1e-9808-39f931b5b86b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:46.437663 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1a89bcd7-c517-4d1e-9808-39f931b5b86b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1532 microversion: 2.1 time: 1.076180 Mar 05 21:08:46.457212 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2253/4523] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:45 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1532 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:46.479316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a0d1f349-c610-4f4a-a667-f43eabf2db25 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:46.482011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a0d1f349-c610-4f4a-a667-f43eabf2db25 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:46.501950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0d1f349-c610-4f4a-a667-f43eabf2db25 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:46.503630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0d1f349-c610-4f4a-a667-f43eabf2db25 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:46.505261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0d1f349-c610-4f4a-a667-f43eabf2db25 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:46.507076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0d1f349-c610-4f4a-a667-f43eabf2db25 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:46.529492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fab5a54b-1bb3-430c-90c4-2d8386534817 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:46.544660 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fab5a54b-1bb3-430c-90c4-2d8386534817 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1507 microversion: 2.1 time: 1.241915 Mar 05 21:08:46.546014 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2271/4524] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:45 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1507 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:46.785998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a0d1f349-c610-4f4a-a667-f43eabf2db25 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:46.794474 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a0d1f349-c610-4f4a-a667-f43eabf2db25 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1201 microversion: 2.1 time: 0.335818 Mar 05 21:08:46.797369 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2254/4525] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:46 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1201 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:47.340034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c7215f89-2998-40f3-babd-b3a62303910c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:47.340551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c7215f89-2998-40f3-babd-b3a62303910c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:47.369308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7215f89-2998-40f3-babd-b3a62303910c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:47.369695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7215f89-2998-40f3-babd-b3a62303910c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:47.370499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7215f89-2998-40f3-babd-b3a62303910c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:47.370951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7215f89-2998-40f3-babd-b3a62303910c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:47.455162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c7215f89-2998-40f3-babd-b3a62303910c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:08:47.475197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e8938f4f-e476-484a-8745-17cbf4b577cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:47.476445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e8938f4f-e476-484a-8745-17cbf4b577cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:47.492110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8938f4f-e476-484a-8745-17cbf4b577cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:47.503257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8938f4f-e476-484a-8745-17cbf4b577cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:47.513921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8938f4f-e476-484a-8745-17cbf4b577cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:47.514546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8938f4f-e476-484a-8745-17cbf4b577cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:47.858229 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c7215f89-2998-40f3-babd-b3a62303910c tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 204 len: 0 microversion: 2.42 time: 0.925347 Mar 05 21:08:47.875942 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2272/4526] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:08:46 2022] DELETE /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:08:47.924232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f442bf36-fc5b-49dd-a4a0-947736c816fb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:47.927839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f442bf36-fc5b-49dd-a4a0-947736c816fb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:47.940320 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f442bf36-fc5b-49dd-a4a0-947736c816fb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:47.941717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f442bf36-fc5b-49dd-a4a0-947736c816fb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:47.948383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f442bf36-fc5b-49dd-a4a0-947736c816fb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:47.950019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f442bf36-fc5b-49dd-a4a0-947736c816fb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:48.421910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e8938f4f-e476-484a-8745-17cbf4b577cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:48.440413 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e8938f4f-e476-484a-8745-17cbf4b577cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1527 microversion: 2.1 time: 0.968941 Mar 05 21:08:48.441789 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2255/4527] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:47 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1527 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:48.468743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-766a08c3-571f-4196-a486-98615f6c9caf tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:48.480480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-766a08c3-571f-4196-a486-98615f6c9caf tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:48.491126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-766a08c3-571f-4196-a486-98615f6c9caf tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:48.498455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-766a08c3-571f-4196-a486-98615f6c9caf tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:48.500000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-766a08c3-571f-4196-a486-98615f6c9caf tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:48.503190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-766a08c3-571f-4196-a486-98615f6c9caf tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:49.238867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f442bf36-fc5b-49dd-a4a0-947736c816fb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:49.252795 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f442bf36-fc5b-49dd-a4a0-947736c816fb tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1507 microversion: 2.1 time: 1.370791 Mar 05 21:08:49.269828 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2273/4528] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:47 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1507 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:49.279941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e23b33ce-0463-42c6-8e1f-a330f8d9747a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:49.280847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e23b33ce-0463-42c6-8e1f-a330f8d9747a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:49.299561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e23b33ce-0463-42c6-8e1f-a330f8d9747a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:49.308402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e23b33ce-0463-42c6-8e1f-a330f8d9747a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:49.309506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e23b33ce-0463-42c6-8e1f-a330f8d9747a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:49.315175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e23b33ce-0463-42c6-8e1f-a330f8d9747a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:50.140533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-766a08c3-571f-4196-a486-98615f6c9caf tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:50.207058 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-766a08c3-571f-4196-a486-98615f6c9caf tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1268 microversion: 2.1 time: 1.753750 Mar 05 21:08:50.210374 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2256/4529] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:48 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1268 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:50.225296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e65da009-4313-493d-bd24-673cd7322a69 req-a48e02ec-ed0d-476e-8ba0-bb9eab03bbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bacfc2c-ea7e-43a5-b26d-af976d17edd9", "name": "network-vif-plugged", "status": "completed", "tag": "94b1d404-120e-4570-9658-48bf6610ec97"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:50.243189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e65da009-4313-493d-bd24-673cd7322a69 req-a48e02ec-ed0d-476e-8ba0-bb9eab03bbb5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:50.254112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e65da009-4313-493d-bd24-673cd7322a69 req-a48e02ec-ed0d-476e-8ba0-bb9eab03bbb5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:50.285002 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e65da009-4313-493d-bd24-673cd7322a69 req-a48e02ec-ed0d-476e-8ba0-bb9eab03bbb5 service nova] Creating event network-vif-plugged:94b1d404-120e-4570-9658-48bf6610ec97 for instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 on nch2-master-1 Mar 05 21:08:50.293805 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e65da009-4313-493d-bd24-673cd7322a69 req-a48e02ec-ed0d-476e-8ba0-bb9eab03bbb5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081811 Mar 05 21:08:50.305952 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2257/4530] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:08:50.319768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f49a18ae-6d9a-4c34-a18a-4114fa09b397 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:50.320691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f49a18ae-6d9a-4c34-a18a-4114fa09b397 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:50.337334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f49a18ae-6d9a-4c34-a18a-4114fa09b397 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:50.344218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f49a18ae-6d9a-4c34-a18a-4114fa09b397 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:50.346683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f49a18ae-6d9a-4c34-a18a-4114fa09b397 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:50.347381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f49a18ae-6d9a-4c34-a18a-4114fa09b397 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:50.917068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f49a18ae-6d9a-4c34-a18a-4114fa09b397 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:50.936722 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f49a18ae-6d9a-4c34-a18a-4114fa09b397 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1527 microversion: 2.1 time: 0.629325 Mar 05 21:08:50.940119 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2258/4531] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:50 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1527 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:50.965167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fb7ff4c3-2060-4d3c-ac3b-5d338d16af81 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:50.968701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fb7ff4c3-2060-4d3c-ac3b-5d338d16af81 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:50.987035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb7ff4c3-2060-4d3c-ac3b-5d338d16af81 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:50.992927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb7ff4c3-2060-4d3c-ac3b-5d338d16af81 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:50.993966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb7ff4c3-2060-4d3c-ac3b-5d338d16af81 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:50.994412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb7ff4c3-2060-4d3c-ac3b-5d338d16af81 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:51.076071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e23b33ce-0463-42c6-8e1f-a330f8d9747a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:51.097080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e23b33ce-0463-42c6-8e1f-a330f8d9747a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:51.099267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e23b33ce-0463-42c6-8e1f-a330f8d9747a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:51.100949 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e23b33ce-0463-42c6-8e1f-a330f8d9747a tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 2960 microversion: 2.42 time: 1.829112 Mar 05 21:08:51.125578 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2274/4532] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:08:49 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 2960 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:08:51.241045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8b90feae-bb85-46df-9f59-411110b1774f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:51.242028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8b90feae-bb85-46df-9f59-411110b1774f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:51.254469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b90feae-bb85-46df-9f59-411110b1774f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:51.256203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b90feae-bb85-46df-9f59-411110b1774f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:51.258590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b90feae-bb85-46df-9f59-411110b1774f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:51.260441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b90feae-bb85-46df-9f59-411110b1774f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:52.515303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8b90feae-bb85-46df-9f59-411110b1774f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:52.525882 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8b90feae-bb85-46df-9f59-411110b1774f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1268 microversion: 2.1 time: 1.293737 Mar 05 21:08:52.536512 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2275/4533] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:51 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1268 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:52.569796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-56b940d8-991a-48e1-8296-fff60298dd1a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:52.571659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-56b940d8-991a-48e1-8296-fff60298dd1a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:52.582876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56b940d8-991a-48e1-8296-fff60298dd1a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:52.584108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56b940d8-991a-48e1-8296-fff60298dd1a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:52.586176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56b940d8-991a-48e1-8296-fff60298dd1a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:52.586936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56b940d8-991a-48e1-8296-fff60298dd1a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:53.052516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fb7ff4c3-2060-4d3c-ac3b-5d338d16af81 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:53.066754 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fb7ff4c3-2060-4d3c-ac3b-5d338d16af81 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1507 microversion: 2.1 time: 2.125370 Mar 05 21:08:53.067365 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2259/4534] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:50 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1507 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:53.084345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0fa0ad09-0854-435f-9ec6-f37480309224 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:53.085122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0fa0ad09-0854-435f-9ec6-f37480309224 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:53.109635 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fa0ad09-0854-435f-9ec6-f37480309224 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:53.110104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fa0ad09-0854-435f-9ec6-f37480309224 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:53.111505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fa0ad09-0854-435f-9ec6-f37480309224 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:53.111982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fa0ad09-0854-435f-9ec6-f37480309224 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:53.265079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-56b940d8-991a-48e1-8296-fff60298dd1a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:53.282006 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-56b940d8-991a-48e1-8296-fff60298dd1a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1527 microversion: 2.1 time: 0.739261 Mar 05 21:08:53.284277 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2276/4535] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:52 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1527 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:53.295645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-4c3f05d4-2c7d-4833-a949-34db39ed78db req-0f835162-8a10-41d1-a036-596f63656b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a47955-7a01-4ad3-bffa-719e3e892243", "tag": "e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:53.305616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4c3f05d4-2c7d-4833-a949-34db39ed78db req-0f835162-8a10-41d1-a036-596f63656b27 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:53.306367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4c3f05d4-2c7d-4833-a949-34db39ed78db req-0f835162-8a10-41d1-a036-596f63656b27 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:53.327788 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-4c3f05d4-2c7d-4833-a949-34db39ed78db req-0f835162-8a10-41d1-a036-596f63656b27 service nova] Creating event network-changed:e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2 for instance c4a47955-7a01-4ad3-bffa-719e3e892243 on nch1-master-1 Mar 05 21:08:53.344959 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-4c3f05d4-2c7d-4833-a949-34db39ed78db req-0f835162-8a10-41d1-a036-596f63656b27 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057680 Mar 05 21:08:53.345806 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2277/4536] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:08:53.544626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cd88f259-364c-49c6-bf71-fb767106b277 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:53.545561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cd88f259-364c-49c6-bf71-fb767106b277 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:53.569475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd88f259-364c-49c6-bf71-fb767106b277 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:53.569945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd88f259-364c-49c6-bf71-fb767106b277 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:53.570747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd88f259-364c-49c6-bf71-fb767106b277 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:53.571189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd88f259-364c-49c6-bf71-fb767106b277 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:54.214149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0fa0ad09-0854-435f-9ec6-f37480309224 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:54.227055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0fa0ad09-0854-435f-9ec6-f37480309224 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:54.231499 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0fa0ad09-0854-435f-9ec6-f37480309224 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:54.245948 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0fa0ad09-0854-435f-9ec6-f37480309224 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 2960 microversion: 2.42 time: 1.177475 Mar 05 21:08:54.246817 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2260/4537] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:08:53 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 2960 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:08:54.263471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5880ba96-8e7c-4d64-8da2-ad925d14d249 req-f649c633-ab78-441a-80ce-64d078119cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-unplugged", "status": "completed", "tag": "14f8b7cc-1e4e-4f90-b62b-841a16e0f7ac"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:54.297701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5880ba96-8e7c-4d64-8da2-ad925d14d249 req-f649c633-ab78-441a-80ce-64d078119cb9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:54.299224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5880ba96-8e7c-4d64-8da2-ad925d14d249 req-f649c633-ab78-441a-80ce-64d078119cb9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:54.332864 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-5880ba96-8e7c-4d64-8da2-ad925d14d249 req-f649c633-ab78-441a-80ce-64d078119cb9 service nova] Creating event network-vif-unplugged:14f8b7cc-1e4e-4f90-b62b-841a16e0f7ac for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:08:54.339551 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5880ba96-8e7c-4d64-8da2-ad925d14d249 req-f649c633-ab78-441a-80ce-64d078119cb9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079654 Mar 05 21:08:54.343988 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2261/4538] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:08:54.361294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-df558c16-237b-42ac-b722-4ef3a5f6c1f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:54.365125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-df558c16-237b-42ac-b722-4ef3a5f6c1f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:54.384967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df558c16-237b-42ac-b722-4ef3a5f6c1f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:54.385420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df558c16-237b-42ac-b722-4ef3a5f6c1f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:54.386224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df558c16-237b-42ac-b722-4ef3a5f6c1f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:54.386666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df558c16-237b-42ac-b722-4ef3a5f6c1f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:55.317118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cd88f259-364c-49c6-bf71-fb767106b277 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:55.330301 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cd88f259-364c-49c6-bf71-fb767106b277 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1268 microversion: 2.1 time: 1.790769 Mar 05 21:08:55.331516 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2278/4539] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:53 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1268 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:08:55.357167 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fbc269ee-f0ab-4da0-b121-233f474d0036 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:55.366911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fbc269ee-f0ab-4da0-b121-233f474d0036 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:55.389448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbc269ee-f0ab-4da0-b121-233f474d0036 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:55.390184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbc269ee-f0ab-4da0-b121-233f474d0036 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:55.391255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbc269ee-f0ab-4da0-b121-233f474d0036 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:55.392411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbc269ee-f0ab-4da0-b121-233f474d0036 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:55.656510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-df558c16-237b-42ac-b722-4ef3a5f6c1f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:55.673464 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-df558c16-237b-42ac-b722-4ef3a5f6c1f8 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1507 microversion: 2.1 time: 1.321094 Mar 05 21:08:55.676299 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2262/4540] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:54 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1507 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:55.697601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a259868c-3d55-46ec-a25a-79333d68f48e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:55.698974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a259868c-3d55-46ec-a25a-79333d68f48e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:55.725145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a259868c-3d55-46ec-a25a-79333d68f48e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:55.726036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a259868c-3d55-46ec-a25a-79333d68f48e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:55.729504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a259868c-3d55-46ec-a25a-79333d68f48e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:55.733200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a259868c-3d55-46ec-a25a-79333d68f48e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:56.678782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a259868c-3d55-46ec-a25a-79333d68f48e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:56.697084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a259868c-3d55-46ec-a25a-79333d68f48e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:56.710236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a259868c-3d55-46ec-a25a-79333d68f48e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:56.713462 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a259868c-3d55-46ec-a25a-79333d68f48e tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 2939 microversion: 2.42 time: 1.034109 Mar 05 21:08:56.723771 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2263/4541] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:08:55 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 2939 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:08:56.738572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-af171c84-187e-4692-9237-0706e3faf9bc tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:56.738778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-af171c84-187e-4692-9237-0706e3faf9bc tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:56.765079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-af171c84-187e-4692-9237-0706e3faf9bc tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:56.767648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-af171c84-187e-4692-9237-0706e3faf9bc tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:56.769456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-af171c84-187e-4692-9237-0706e3faf9bc tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:56.776520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-af171c84-187e-4692-9237-0706e3faf9bc tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:57.733065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-af171c84-187e-4692-9237-0706e3faf9bc tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:57.745783 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-af171c84-187e-4692-9237-0706e3faf9bc tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1268 microversion: 2.1 time: 1.024232 Mar 05 21:08:57.746442 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2264/4542] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:56 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1268 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:57.764844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-1afe8b2f-1bd8-4818-bf41-7c895850f89b req-2152be3d-2216-452a-b3a0-9da8046ed2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-unplugged", "status": "completed", "tag": "2a2cb2ee-09d5-4c68-906a-931117ce5ea0"}, {"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-unplugged", "status": "completed", "tag": "49b54a86-30ae-437a-8e99-4dbd8347c99d"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:08:57.790715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1afe8b2f-1bd8-4818-bf41-7c895850f89b req-2152be3d-2216-452a-b3a0-9da8046ed2f1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:57.796890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1afe8b2f-1bd8-4818-bf41-7c895850f89b req-2152be3d-2216-452a-b3a0-9da8046ed2f1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:57.839326 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-1afe8b2f-1bd8-4818-bf41-7c895850f89b req-2152be3d-2216-452a-b3a0-9da8046ed2f1 service nova] Creating event network-vif-unplugged:2a2cb2ee-09d5-4c68-906a-931117ce5ea0 for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:08:57.845343 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-1afe8b2f-1bd8-4818-bf41-7c895850f89b req-2152be3d-2216-452a-b3a0-9da8046ed2f1 service nova] Creating event network-vif-unplugged:49b54a86-30ae-437a-8e99-4dbd8347c99d for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:08:57.873534 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-1afe8b2f-1bd8-4818-bf41-7c895850f89b req-2152be3d-2216-452a-b3a0-9da8046ed2f1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.125815 Mar 05 21:08:57.874725 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2265/4543] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:08:57.881042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9f575d70-5e3d-4f4b-a5ab-a5723c3929f7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:57.884549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9f575d70-5e3d-4f4b-a5ab-a5723c3929f7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:57.905533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f575d70-5e3d-4f4b-a5ab-a5723c3929f7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:57.922336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f575d70-5e3d-4f4b-a5ab-a5723c3929f7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:57.924111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f575d70-5e3d-4f4b-a5ab-a5723c3929f7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:57.924833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f575d70-5e3d-4f4b-a5ab-a5723c3929f7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:58.120202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fbc269ee-f0ab-4da0-b121-233f474d0036 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:58.132617 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fbc269ee-f0ab-4da0-b121-233f474d0036 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1527 microversion: 2.1 time: 2.788393 Mar 05 21:08:58.135556 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2279/4544] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:55 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1527 bytes in 2792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:58.143732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-55857bf3-272b-42dd-babb-0018d0d0ba83 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:58.150979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-55857bf3-272b-42dd-babb-0018d0d0ba83 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:58.180080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55857bf3-272b-42dd-babb-0018d0d0ba83 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:58.180665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55857bf3-272b-42dd-babb-0018d0d0ba83 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:58.181525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55857bf3-272b-42dd-babb-0018d0d0ba83 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:58.181976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55857bf3-272b-42dd-babb-0018d0d0ba83 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:59.424111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-55857bf3-272b-42dd-babb-0018d0d0ba83 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:59.461639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-55857bf3-272b-42dd-babb-0018d0d0ba83 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:59.468301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-55857bf3-272b-42dd-babb-0018d0d0ba83 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:59.472790 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-55857bf3-272b-42dd-babb-0018d0d0ba83 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 2918 microversion: 2.42 time: 1.334091 Mar 05 21:08:59.476446 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2280/4545] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:08:58 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 2918 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:08:59.496768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b9bfb0fe-c24a-4510-8237-cba036545719 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:59.517932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b9bfb0fe-c24a-4510-8237-cba036545719 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:59.543035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9bfb0fe-c24a-4510-8237-cba036545719 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:59.543570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9bfb0fe-c24a-4510-8237-cba036545719 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:59.544459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9bfb0fe-c24a-4510-8237-cba036545719 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:59.544910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9bfb0fe-c24a-4510-8237-cba036545719 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:59.709718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9f575d70-5e3d-4f4b-a5ab-a5723c3929f7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:08:59.721624 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9f575d70-5e3d-4f4b-a5ab-a5723c3929f7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1507 microversion: 2.1 time: 1.845504 Mar 05 21:08:59.722619 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2266/4546] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:57 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1507 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:08:59.737122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ce1f8b0b-20f7-4c48-a7fa-2e217762b9a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:08:59.741064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ce1f8b0b-20f7-4c48-a7fa-2e217762b9a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:08:59.760580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce1f8b0b-20f7-4c48-a7fa-2e217762b9a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:59.763923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce1f8b0b-20f7-4c48-a7fa-2e217762b9a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:08:59.765095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce1f8b0b-20f7-4c48-a7fa-2e217762b9a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:08:59.767911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce1f8b0b-20f7-4c48-a7fa-2e217762b9a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:00.742547 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ce1f8b0b-20f7-4c48-a7fa-2e217762b9a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:00.754757 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ce1f8b0b-20f7-4c48-a7fa-2e217762b9a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1527 microversion: 2.1 time: 1.030674 Mar 05 21:09:00.765799 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2267/4547] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:59 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1527 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:00.779463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-427a815e-7bae-4948-9d10-bd3c56580c55 req-16565240-7ea7-42e0-b469-01b9ee352ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-unplugged", "status": "completed", "tag": "d03778ff-0dff-4440-ad01-ea9b00fcbdae"}, {"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-unplugged", "status": "completed", "tag": "48f2f3bb-2642-4a75-8eb1-b1d8812cc628"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:00.806862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-427a815e-7bae-4948-9d10-bd3c56580c55 req-16565240-7ea7-42e0-b469-01b9ee352ca2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:00.808788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-427a815e-7bae-4948-9d10-bd3c56580c55 req-16565240-7ea7-42e0-b469-01b9ee352ca2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:00.850294 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-427a815e-7bae-4948-9d10-bd3c56580c55 req-16565240-7ea7-42e0-b469-01b9ee352ca2 service nova] Creating event network-vif-unplugged:d03778ff-0dff-4440-ad01-ea9b00fcbdae for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:09:00.852267 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-427a815e-7bae-4948-9d10-bd3c56580c55 req-16565240-7ea7-42e0-b469-01b9ee352ca2 service nova] Creating event network-vif-unplugged:48f2f3bb-2642-4a75-8eb1-b1d8812cc628 for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:09:00.866236 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-427a815e-7bae-4948-9d10-bd3c56580c55 req-16565240-7ea7-42e0-b469-01b9ee352ca2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.097495 Mar 05 21:09:00.867035 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2268/4548] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:09:00.875317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-58544761-5fd2-4152-a5fa-facdb692ec32 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:00.884925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-58544761-5fd2-4152-a5fa-facdb692ec32 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:00.894740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-58544761-5fd2-4152-a5fa-facdb692ec32 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:00.895198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-58544761-5fd2-4152-a5fa-facdb692ec32 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:00.896020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-58544761-5fd2-4152-a5fa-facdb692ec32 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:00.896460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-58544761-5fd2-4152-a5fa-facdb692ec32 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:01.593189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-58544761-5fd2-4152-a5fa-facdb692ec32 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:01.619611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-58544761-5fd2-4152-a5fa-facdb692ec32 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:01.621154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-58544761-5fd2-4152-a5fa-facdb692ec32 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:01.622447 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-58544761-5fd2-4152-a5fa-facdb692ec32 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 2871 microversion: 2.42 time: 0.754528 Mar 05 21:09:01.623010 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2269/4549] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:09:00 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 2871 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:09:01.639518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-79884d0d-e0ee-4b28-bd99-695d6e736e50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:01.642591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-79884d0d-e0ee-4b28-bd99-695d6e736e50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:01.658267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79884d0d-e0ee-4b28-bd99-695d6e736e50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:01.658847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79884d0d-e0ee-4b28-bd99-695d6e736e50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:01.666240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79884d0d-e0ee-4b28-bd99-695d6e736e50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:01.666715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79884d0d-e0ee-4b28-bd99-695d6e736e50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:01.759454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b9bfb0fe-c24a-4510-8237-cba036545719 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:01.780433 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b9bfb0fe-c24a-4510-8237-cba036545719 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1268 microversion: 2.1 time: 2.302620 Mar 05 21:09:01.781517 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2281/4550] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:08:59 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1268 bytes in 2304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:01.795731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f52c29e8-3d2a-4bd3-b231-dacd5f2a1744 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:01.801311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f52c29e8-3d2a-4bd3-b231-dacd5f2a1744 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:01.826809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f52c29e8-3d2a-4bd3-b231-dacd5f2a1744 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:01.827408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f52c29e8-3d2a-4bd3-b231-dacd5f2a1744 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:01.828461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f52c29e8-3d2a-4bd3-b231-dacd5f2a1744 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:01.829173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f52c29e8-3d2a-4bd3-b231-dacd5f2a1744 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:02.254671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-79884d0d-e0ee-4b28-bd99-695d6e736e50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:02.270847 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-79884d0d-e0ee-4b28-bd99-695d6e736e50 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1504 microversion: 2.1 time: 0.638655 Mar 05 21:09:02.273621 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2270/4551] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:01 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1504 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:02.589586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f52c29e8-3d2a-4bd3-b231-dacd5f2a1744 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:02.599710 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f52c29e8-3d2a-4bd3-b231-dacd5f2a1744 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1527 microversion: 2.1 time: 0.814185 Mar 05 21:09:02.621207 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2282/4552] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:01 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1527 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:02.648422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b58273a2-70b6-4519-8d03-60e91c6ae570 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:02.651247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b58273a2-70b6-4519-8d03-60e91c6ae570 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:02.667280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b58273a2-70b6-4519-8d03-60e91c6ae570 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:02.667990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b58273a2-70b6-4519-8d03-60e91c6ae570 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:02.668979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b58273a2-70b6-4519-8d03-60e91c6ae570 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:02.669607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b58273a2-70b6-4519-8d03-60e91c6ae570 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:02.797410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c313ee3b-ad50-4265-b022-717e92e635c1 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:02.799981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c313ee3b-ad50-4265-b022-717e92e635c1 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:02.813460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c313ee3b-ad50-4265-b022-717e92e635c1 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:02.816792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c313ee3b-ad50-4265-b022-717e92e635c1 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:02.818583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c313ee3b-ad50-4265-b022-717e92e635c1 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:02.821197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c313ee3b-ad50-4265-b022-717e92e635c1 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:03.425066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c313ee3b-ad50-4265-b022-717e92e635c1 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:03.449929 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c313ee3b-ad50-4265-b022-717e92e635c1 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1268 microversion: 2.1 time: 0.656318 Mar 05 21:09:03.452086 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2283/4553] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:02 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1268 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:03.464209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-7b6616f0-4d84-46df-a6b7-09f8473bea10 req-65b01892-19d7-4764-92e8-53edf5583b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-deleted", "tag": "2a2cb2ee-09d5-4c68-906a-931117ce5ea0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:03.481843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7b6616f0-4d84-46df-a6b7-09f8473bea10 req-65b01892-19d7-4764-92e8-53edf5583b9a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:03.482494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7b6616f0-4d84-46df-a6b7-09f8473bea10 req-65b01892-19d7-4764-92e8-53edf5583b9a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:03.505604 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-7b6616f0-4d84-46df-a6b7-09f8473bea10 req-65b01892-19d7-4764-92e8-53edf5583b9a service nova] Creating event network-vif-deleted:2a2cb2ee-09d5-4c68-906a-931117ce5ea0 for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:09:03.525170 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-7b6616f0-4d84-46df-a6b7-09f8473bea10 req-65b01892-19d7-4764-92e8-53edf5583b9a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071559 Mar 05 21:09:03.526344 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2284/4554] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:09:03.531630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c82bf878-0b44-407c-a445-b57768c38a3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:03.544716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c82bf878-0b44-407c-a445-b57768c38a3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:03.564093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c82bf878-0b44-407c-a445-b57768c38a3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:03.565856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c82bf878-0b44-407c-a445-b57768c38a3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:03.566855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c82bf878-0b44-407c-a445-b57768c38a3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:03.567472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c82bf878-0b44-407c-a445-b57768c38a3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:04.196699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b58273a2-70b6-4519-8d03-60e91c6ae570 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:04.209155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b58273a2-70b6-4519-8d03-60e91c6ae570 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:04.216081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b58273a2-70b6-4519-8d03-60e91c6ae570 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:04.218740 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b58273a2-70b6-4519-8d03-60e91c6ae570 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 2871 microversion: 2.42 time: 1.580139 Mar 05 21:09:04.220682 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2271/4555] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:09:02 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 2871 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:09:04.230888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b0df2e48-0aa7-499b-8fc8-8e6598363902 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:04.236811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b0df2e48-0aa7-499b-8fc8-8e6598363902 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:04.251407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0df2e48-0aa7-499b-8fc8-8e6598363902 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:04.252305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0df2e48-0aa7-499b-8fc8-8e6598363902 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:04.255567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0df2e48-0aa7-499b-8fc8-8e6598363902 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:04.257644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0df2e48-0aa7-499b-8fc8-8e6598363902 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:04.441648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c82bf878-0b44-407c-a445-b57768c38a3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:04.449448 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c82bf878-0b44-407c-a445-b57768c38a3c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1504 microversion: 2.1 time: 0.921779 Mar 05 21:09:04.458859 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2285/4556] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:03 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1504 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:04.473192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6ed97dbe-819c-47c6-abd9-20edac6d8759 req-bab74ca9-b781-4f81-9fee-03e6435f7ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4a47955-7a01-4ad3-bffa-719e3e892243", "name": "network-vif-plugged", "status": "completed", "tag": "e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:04.505849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6ed97dbe-819c-47c6-abd9-20edac6d8759 req-bab74ca9-b781-4f81-9fee-03e6435f7ddc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:04.511442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6ed97dbe-819c-47c6-abd9-20edac6d8759 req-bab74ca9-b781-4f81-9fee-03e6435f7ddc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:04.561326 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6ed97dbe-819c-47c6-abd9-20edac6d8759 req-bab74ca9-b781-4f81-9fee-03e6435f7ddc service nova] Creating event network-vif-plugged:e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2 for instance c4a47955-7a01-4ad3-bffa-719e3e892243 on nch1-master-1 Mar 05 21:09:04.575752 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6ed97dbe-819c-47c6-abd9-20edac6d8759 req-bab74ca9-b781-4f81-9fee-03e6435f7ddc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115499 Mar 05 21:09:04.583034 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2286/4557] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:09:04.593093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0715a9cd-25cb-4a52-9ced-300f00f1149f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:04.603301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0715a9cd-25cb-4a52-9ced-300f00f1149f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:04.632136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0715a9cd-25cb-4a52-9ced-300f00f1149f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:04.634108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0715a9cd-25cb-4a52-9ced-300f00f1149f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:04.638387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0715a9cd-25cb-4a52-9ced-300f00f1149f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:04.639810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0715a9cd-25cb-4a52-9ced-300f00f1149f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:05.158961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b0df2e48-0aa7-499b-8fc8-8e6598363902 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:05.171453 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b0df2e48-0aa7-499b-8fc8-8e6598363902 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1527 microversion: 2.1 time: 0.947678 Mar 05 21:09:05.173829 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2272/4558] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:04 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1527 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:05.245691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a5df8c2f-5fd2-425d-af58-c9fa119c3a0b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:05.246958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a5df8c2f-5fd2-425d-af58-c9fa119c3a0b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:05.263724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0715a9cd-25cb-4a52-9ced-300f00f1149f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:05.264313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5df8c2f-5fd2-425d-af58-c9fa119c3a0b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:05.267481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5df8c2f-5fd2-425d-af58-c9fa119c3a0b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:05.272817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5df8c2f-5fd2-425d-af58-c9fa119c3a0b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:05.273812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5df8c2f-5fd2-425d-af58-c9fa119c3a0b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:05.290346 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0715a9cd-25cb-4a52-9ced-300f00f1149f tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1268 microversion: 2.1 time: 0.701666 Mar 05 21:09:05.292505 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2287/4559] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:04 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1268 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:05.469075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b9f9e293-2522-4478-a391-67170aa5b627 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:05.470377 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b9f9e293-2522-4478-a391-67170aa5b627 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:05.490420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9f9e293-2522-4478-a391-67170aa5b627 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:05.490959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9f9e293-2522-4478-a391-67170aa5b627 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:05.495789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9f9e293-2522-4478-a391-67170aa5b627 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:05.496368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b9f9e293-2522-4478-a391-67170aa5b627 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:06.078136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a5df8c2f-5fd2-425d-af58-c9fa119c3a0b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:06.109318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a5df8c2f-5fd2-425d-af58-c9fa119c3a0b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:06.114275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a5df8c2f-5fd2-425d-af58-c9fa119c3a0b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:06.118850 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a5df8c2f-5fd2-425d-af58-c9fa119c3a0b tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 2532 microversion: 2.42 time: 0.875238 Mar 05 21:09:06.120955 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2273/4560] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:09:05 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 2532 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:09:06.133934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-cdacc80f-3430-441a-9be5-2e17750f82b1 req-5de20000-fe8f-4524-b3c3-2997771c220d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-deleted", "tag": "14f8b7cc-1e4e-4f90-b62b-841a16e0f7ac"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:06.143841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-cdacc80f-3430-441a-9be5-2e17750f82b1 req-5de20000-fe8f-4524-b3c3-2997771c220d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:06.144594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-cdacc80f-3430-441a-9be5-2e17750f82b1 req-5de20000-fe8f-4524-b3c3-2997771c220d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:06.162766 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-cdacc80f-3430-441a-9be5-2e17750f82b1 req-5de20000-fe8f-4524-b3c3-2997771c220d service nova] Creating event network-vif-deleted:14f8b7cc-1e4e-4f90-b62b-841a16e0f7ac for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:09:06.172010 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-cdacc80f-3430-441a-9be5-2e17750f82b1 req-5de20000-fe8f-4524-b3c3-2997771c220d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047255 Mar 05 21:09:06.174113 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2274/4561] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:09:06.197292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ad6ac702-a6bf-4350-bea8-5fc241fe44bd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:06.204945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ad6ac702-a6bf-4350-bea8-5fc241fe44bd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:06.230044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad6ac702-a6bf-4350-bea8-5fc241fe44bd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:06.233364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad6ac702-a6bf-4350-bea8-5fc241fe44bd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:06.234246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad6ac702-a6bf-4350-bea8-5fc241fe44bd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:06.234707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad6ac702-a6bf-4350-bea8-5fc241fe44bd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:06.706053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b9f9e293-2522-4478-a391-67170aa5b627 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:06.717872 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b9f9e293-2522-4478-a391-67170aa5b627 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 200 len: 1507 microversion: 2.1 time: 1.253375 Mar 05 21:09:06.718177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad6ac702-a6bf-4350-bea8-5fc241fe44bd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:06.719234 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2288/4562] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:05 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 1507 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:06.729593 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ad6ac702-a6bf-4350-bea8-5fc241fe44bd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1527 microversion: 2.1 time: 0.543139 Mar 05 21:09:06.732126 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2275/4563] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:06 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1527 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:06.736549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-87627944-eb71-499e-8720-9d7b910d1a56 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:06.737763 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-87627944-eb71-499e-8720-9d7b910d1a56 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:06.765135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87627944-eb71-499e-8720-9d7b910d1a56 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:06.772891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87627944-eb71-499e-8720-9d7b910d1a56 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:06.775818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87627944-eb71-499e-8720-9d7b910d1a56 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:06.776282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87627944-eb71-499e-8720-9d7b910d1a56 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:06.958283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f080ccbb-a3b3-4df7-a731-ff2499e47cd3 req-a7e79020-4be8-48e6-868f-28abb581b1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb113c5-40de-49b7-8f60-c10f275d42db", "name": "network-vif-unplugged", "status": "completed", "tag": "2de15539-9dfc-43c7-86e8-df851b4d8dbe"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:06.969926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f080ccbb-a3b3-4df7-a731-ff2499e47cd3 req-a7e79020-4be8-48e6-868f-28abb581b1d1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:06.970352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f080ccbb-a3b3-4df7-a731-ff2499e47cd3 req-a7e79020-4be8-48e6-868f-28abb581b1d1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:07.020557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.compute.server_external_events [req-f080ccbb-a3b3-4df7-a731-ff2499e47cd3 req-a7e79020-4be8-48e6-868f-28abb581b1d1 service nova] Unable to find a host for instance 7eb113c5-40de-49b7-8f60-c10f275d42db. Dropping event network-vif-unplugged {{(pid=141478) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 05 21:09:07.021731 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f080ccbb-a3b3-4df7-a731-ff2499e47cd3 req-a7e79020-4be8-48e6-868f-28abb581b1d1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.288623 Mar 05 21:09:07.024963 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2276/4564] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 292 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 05 21:09:07.039464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aa0e7d15-2dd9-473f-a984-321df47038c5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:07.040392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aa0e7d15-2dd9-473f-a984-321df47038c5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:07.055775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa0e7d15-2dd9-473f-a984-321df47038c5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:07.057029 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa0e7d15-2dd9-473f-a984-321df47038c5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:07.060357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa0e7d15-2dd9-473f-a984-321df47038c5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:07.061304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa0e7d15-2dd9-473f-a984-321df47038c5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:07.429743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-87627944-eb71-499e-8720-9d7b910d1a56 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:07.437322 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-87627944-eb71-499e-8720-9d7b910d1a56 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1268 microversion: 2.1 time: 0.712604 Mar 05 21:09:07.444064 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2289/4565] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:06 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1268 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:07.450759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-70b2471f-87eb-48fb-bf4c-ef5f90dc3576 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:07.451387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-70b2471f-87eb-48fb-bf4c-ef5f90dc3576 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:07.466871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aa0e7d15-2dd9-473f-a984-321df47038c5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:07.472585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70b2471f-87eb-48fb-bf4c-ef5f90dc3576 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:07.473049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70b2471f-87eb-48fb-bf4c-ef5f90dc3576 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:07.473852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70b2471f-87eb-48fb-bf4c-ef5f90dc3576 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:07.474312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70b2471f-87eb-48fb-bf4c-ef5f90dc3576 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:07.477245 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aa0e7d15-2dd9-473f-a984-321df47038c5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.451061 Mar 05 21:09:07.487663 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2277/4566] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:07 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:07.509265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8d046a79-2f52-4fb7-a780-e370102dd3bd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:07.510459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8d046a79-2f52-4fb7-a780-e370102dd3bd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:07.518716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d046a79-2f52-4fb7-a780-e370102dd3bd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:07.519614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d046a79-2f52-4fb7-a780-e370102dd3bd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:07.520895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d046a79-2f52-4fb7-a780-e370102dd3bd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:07.521601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8d046a79-2f52-4fb7-a780-e370102dd3bd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:08.303451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8d046a79-2f52-4fb7-a780-e370102dd3bd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:08.311059 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8d046a79-2f52-4fb7-a780-e370102dd3bd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.805844 Mar 05 21:09:08.311652 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2278/4567] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:07 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:08.336573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7e9d5d22-3daf-4f73-b6d0-58107318deb4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:08.337185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7e9d5d22-3daf-4f73-b6d0-58107318deb4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:08.351375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e9d5d22-3daf-4f73-b6d0-58107318deb4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:08.352891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e9d5d22-3daf-4f73-b6d0-58107318deb4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:08.353866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e9d5d22-3daf-4f73-b6d0-58107318deb4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:08.354535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e9d5d22-3daf-4f73-b6d0-58107318deb4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:08.454569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-70b2471f-87eb-48fb-bf4c-ef5f90dc3576 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:08.484673 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-70b2471f-87eb-48fb-bf4c-ef5f90dc3576 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:08.490048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-70b2471f-87eb-48fb-bf4c-ef5f90dc3576 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:08.491612 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-70b2471f-87eb-48fb-bf4c-ef5f90dc3576 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 2372 microversion: 2.42 time: 1.046533 Mar 05 21:09:08.494151 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2290/4568] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:09:07 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 2372 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:09:08.502570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0cf30a9-0379-414a-90f9-65258aee5ec9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:08.505398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a0cf30a9-0379-414a-90f9-65258aee5ec9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:08.526660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0cf30a9-0379-414a-90f9-65258aee5ec9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:08.527197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0cf30a9-0379-414a-90f9-65258aee5ec9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:08.540199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0cf30a9-0379-414a-90f9-65258aee5ec9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:08.540199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0cf30a9-0379-414a-90f9-65258aee5ec9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:09.199781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7e9d5d22-3daf-4f73-b6d0-58107318deb4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:09.221998 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7e9d5d22-3daf-4f73-b6d0-58107318deb4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1527 microversion: 2.1 time: 0.889154 Mar 05 21:09:09.242627 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2279/4569] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:08 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1527 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:09.265206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-24145cb9-c332-4ffc-b8f8-9051827c07f2 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:09.267414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-24145cb9-c332-4ffc-b8f8-9051827c07f2 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:09.287370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24145cb9-c332-4ffc-b8f8-9051827c07f2 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:09.290417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24145cb9-c332-4ffc-b8f8-9051827c07f2 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:09.292732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24145cb9-c332-4ffc-b8f8-9051827c07f2 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:09.299589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24145cb9-c332-4ffc-b8f8-9051827c07f2 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:09.471788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a0cf30a9-0379-414a-90f9-65258aee5ec9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:09.484445 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0cf30a9-0379-414a-90f9-65258aee5ec9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.988485 Mar 05 21:09:09.496460 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2291/4570] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:08 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:09.522470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-0e7085d6-5fbd-44e6-bca8-899ca8a3569c req-0ec787db-c18d-49d5-80ad-4e178818c5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-deleted", "tag": "d03778ff-0dff-4440-ad01-ea9b00fcbdae"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:09.552789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0e7085d6-5fbd-44e6-bca8-899ca8a3569c req-0ec787db-c18d-49d5-80ad-4e178818c5c8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:09.553158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0e7085d6-5fbd-44e6-bca8-899ca8a3569c req-0ec787db-c18d-49d5-80ad-4e178818c5c8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:09.614511 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0e7085d6-5fbd-44e6-bca8-899ca8a3569c req-0ec787db-c18d-49d5-80ad-4e178818c5c8 service nova] Creating event network-vif-deleted:d03778ff-0dff-4440-ad01-ea9b00fcbdae for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:09:09.663224 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-0e7085d6-5fbd-44e6-bca8-899ca8a3569c req-0ec787db-c18d-49d5-80ad-4e178818c5c8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153971 Mar 05 21:09:09.663964 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2292/4571] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:09:09.691645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e6e4cd46-3d6b-4616-b9df-ea4239bbb13c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:09.692401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e6e4cd46-3d6b-4616-b9df-ea4239bbb13c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:09.704669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6e4cd46-3d6b-4616-b9df-ea4239bbb13c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:09.705125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6e4cd46-3d6b-4616-b9df-ea4239bbb13c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:09.705917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6e4cd46-3d6b-4616-b9df-ea4239bbb13c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:09.706358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6e4cd46-3d6b-4616-b9df-ea4239bbb13c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:09.969827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-24145cb9-c332-4ffc-b8f8-9051827c07f2 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:09.984657 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-24145cb9-c332-4ffc-b8f8-9051827c07f2 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1455 microversion: 2.1 time: 0.738779 Mar 05 21:09:09.986198 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2280/4572] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:09 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1455 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:09.997119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8441f564-d3c5-4225-8adc-ab1a62b827af tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:09.998146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8441f564-d3c5-4225-8adc-ab1a62b827af tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:10.008161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8441f564-d3c5-4225-8adc-ab1a62b827af tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:10.014568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8441f564-d3c5-4225-8adc-ab1a62b827af tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:10.015550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8441f564-d3c5-4225-8adc-ab1a62b827af tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:10.016039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8441f564-d3c5-4225-8adc-ab1a62b827af tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:10.261523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e6e4cd46-3d6b-4616-b9df-ea4239bbb13c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:10.279356 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e6e4cd46-3d6b-4616-b9df-ea4239bbb13c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.614022 Mar 05 21:09:10.281597 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2293/4573] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:09 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:10.302386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-20e1c2ce-f12d-4a31-8871-73e57bfc66d4 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:10.307420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-20e1c2ce-f12d-4a31-8871-73e57bfc66d4 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:10.322363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20e1c2ce-f12d-4a31-8871-73e57bfc66d4 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:10.326714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20e1c2ce-f12d-4a31-8871-73e57bfc66d4 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:10.328549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20e1c2ce-f12d-4a31-8871-73e57bfc66d4 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:10.329169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20e1c2ce-f12d-4a31-8871-73e57bfc66d4 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:10.541341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8441f564-d3c5-4225-8adc-ab1a62b827af tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:10.555428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8441f564-d3c5-4225-8adc-ab1a62b827af tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:10.559256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8441f564-d3c5-4225-8adc-ab1a62b827af tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:10.562462 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8441f564-d3c5-4225-8adc-ab1a62b827af tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 2211 microversion: 2.42 time: 0.574897 Mar 05 21:09:10.563993 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2281/4574] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:09:09 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 2211 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:09:10.570077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ac38aa42-8676-4b81-ab7d-5771923ca2e0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:10.587957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ac38aa42-8676-4b81-ab7d-5771923ca2e0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:10.609566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac38aa42-8676-4b81-ab7d-5771923ca2e0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:10.612266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac38aa42-8676-4b81-ab7d-5771923ca2e0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:10.616811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac38aa42-8676-4b81-ab7d-5771923ca2e0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:10.617754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac38aa42-8676-4b81-ab7d-5771923ca2e0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:10.987244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-20e1c2ce-f12d-4a31-8871-73e57bfc66d4 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:10.998290 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-20e1c2ce-f12d-4a31-8871-73e57bfc66d4 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1455 microversion: 2.1 time: 0.705738 Mar 05 21:09:11.017235 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2294/4575] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:10 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1455 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:11.050987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-42e38ae0-0dad-4d30-a59b-943ce46f954c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:11.086761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42e38ae0-0dad-4d30-a59b-943ce46f954c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:11.087482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-42e38ae0-0dad-4d30-a59b-943ce46f954c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:11.220740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-42e38ae0-0dad-4d30-a59b-943ce46f954c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Going to try to stop instance {{(pid=141479) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 05 21:09:11.355089 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-42e38ae0-0dad-4d30-a59b-943ce46f954c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.334074 Mar 05 21:09:11.358599 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2295/4576] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:09:11 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:09:11.375352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c5af65b0-0f5f-4935-b8eb-c72499bca00c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:11.377664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c5af65b0-0f5f-4935-b8eb-c72499bca00c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:11.393423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5af65b0-0f5f-4935-b8eb-c72499bca00c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:11.393897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5af65b0-0f5f-4935-b8eb-c72499bca00c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:11.394695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5af65b0-0f5f-4935-b8eb-c72499bca00c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:11.400628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5af65b0-0f5f-4935-b8eb-c72499bca00c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:11.773396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ac38aa42-8676-4b81-ab7d-5771923ca2e0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:11.782655 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ac38aa42-8676-4b81-ab7d-5771923ca2e0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1527 microversion: 2.1 time: 1.215460 Mar 05 21:09:11.800691 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2282/4577] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:10 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1527 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:11.819020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-18815164-83cb-4395-be23-88b0ac191664 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:11.820039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-18815164-83cb-4395-be23-88b0ac191664 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:11.822906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c5af65b0-0f5f-4935-b8eb-c72499bca00c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:11.834930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-18815164-83cb-4395-be23-88b0ac191664 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:11.835378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-18815164-83cb-4395-be23-88b0ac191664 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:11.836216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-18815164-83cb-4395-be23-88b0ac191664 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:11.836675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-18815164-83cb-4395-be23-88b0ac191664 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:11.839808 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c5af65b0-0f5f-4935-b8eb-c72499bca00c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 0.476647 Mar 05 21:09:11.842473 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2296/4578] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:11 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:11.849548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-5829043f-b054-49f0-8090-eb6cf369f6c3 req-651fae6c-f80c-4da5-a0a6-55045b95c57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-deleted", "tag": "48f2f3bb-2642-4a75-8eb1-b1d8812cc628"}, {"server_uuid": "d50a5d07-345e-4ca6-b359-e63cc5d5e1d7", "name": "network-vif-deleted", "tag": "49b54a86-30ae-437a-8e99-4dbd8347c99d"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:11.883786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5829043f-b054-49f0-8090-eb6cf369f6c3 req-651fae6c-f80c-4da5-a0a6-55045b95c57d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:11.884614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5829043f-b054-49f0-8090-eb6cf369f6c3 req-651fae6c-f80c-4da5-a0a6-55045b95c57d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:11.930228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-18815164-83cb-4395-be23-88b0ac191664 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:11.931027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-18815164-83cb-4395-be23-88b0ac191664 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:11.932011 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-5829043f-b054-49f0-8090-eb6cf369f6c3 req-651fae6c-f80c-4da5-a0a6-55045b95c57d service nova] Creating event network-vif-deleted:48f2f3bb-2642-4a75-8eb1-b1d8812cc628 for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:09:11.932405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-18815164-83cb-4395-be23-88b0ac191664 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lazy-loading 'fault' on Instance uuid d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:09:11.934111 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-5829043f-b054-49f0-8090-eb6cf369f6c3 req-651fae6c-f80c-4da5-a0a6-55045b95c57d service nova] Creating event network-vif-deleted:49b54a86-30ae-437a-8e99-4dbd8347c99d for instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 on nch2-master-1 Mar 05 21:09:11.946963 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-5829043f-b054-49f0-8090-eb6cf369f6c3 req-651fae6c-f80c-4da5-a0a6-55045b95c57d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103028 Mar 05 21:09:11.950002 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2297/4579] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:09:12.264899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-18815164-83cb-4395-be23-88b0ac191664 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:12.281019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-18815164-83cb-4395-be23-88b0ac191664 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:12.293209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-18815164-83cb-4395-be23-88b0ac191664 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f63dccf0b4843cb8aaeee1070d1f82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784a2229e2b6445589597e5bf3be6344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:12.298216 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-18815164-83cb-4395-be23-88b0ac191664 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 200 len: 1371 microversion: 2.42 time: 0.495001 Mar 05 21:09:12.306077 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2283/4580] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:09:11 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 1371 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:09:12.805760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9a867fe7-bffa-421d-8b0d-d5e2d7bc1a71 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:12.806818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9a867fe7-bffa-421d-8b0d-d5e2d7bc1a71 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:12.822812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a867fe7-bffa-421d-8b0d-d5e2d7bc1a71 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:12.824649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a867fe7-bffa-421d-8b0d-d5e2d7bc1a71 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:12.831193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a867fe7-bffa-421d-8b0d-d5e2d7bc1a71 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:12.832099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a867fe7-bffa-421d-8b0d-d5e2d7bc1a71 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:12.859480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2d7affe9-b5f4-4994-bd8b-e54cf03a6b28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:12.860750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2d7affe9-b5f4-4994-bd8b-e54cf03a6b28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:12.879110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d7affe9-b5f4-4994-bd8b-e54cf03a6b28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:12.879855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d7affe9-b5f4-4994-bd8b-e54cf03a6b28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:12.880830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d7affe9-b5f4-4994-bd8b-e54cf03a6b28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:12.881285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d7affe9-b5f4-4994-bd8b-e54cf03a6b28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:13.769479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d7affe9-b5f4-4994-bd8b-e54cf03a6b28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:13.773726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9a867fe7-bffa-421d-8b0d-d5e2d7bc1a71 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:13.777861 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2d7affe9-b5f4-4994-bd8b-e54cf03a6b28 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 0.922177 Mar 05 21:09:13.784462 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2284/4581] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:12 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:13.784697 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9a867fe7-bffa-421d-8b0d-d5e2d7bc1a71 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1509 microversion: 2.1 time: 0.981612 Mar 05 21:09:13.786726 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2298/4582] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:12 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1509 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:13.797877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8f5b2203-07d7-4a21-be9e-7d1a8ff52336 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:13.798679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8f5b2203-07d7-4a21-be9e-7d1a8ff52336 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:13.815771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f5b2203-07d7-4a21-be9e-7d1a8ff52336 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:13.816587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f5b2203-07d7-4a21-be9e-7d1a8ff52336 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:13.817389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f5b2203-07d7-4a21-be9e-7d1a8ff52336 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:13.817900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8f5b2203-07d7-4a21-be9e-7d1a8ff52336 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:13.848335 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-8f5b2203-07d7-4a21-be9e-7d1a8ff52336 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] HTTP exception thrown: Instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 could not be found. Mar 05 21:09:13.850244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8f5b2203-07d7-4a21-be9e-7d1a8ff52336 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Returning 404 to user: Instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:09:13.851876 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8f5b2203-07d7-4a21-be9e-7d1a8ff52336 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 404 len: 111 microversion: 2.42 time: 0.065730 Mar 05 21:09:13.853393 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2285/4583] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:09:13 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:09:13.863335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-01031469-c0fb-4927-9acd-22125020f7f6 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '.version_select at 0x7fed4f5650d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:13.902350 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-01031469-c0fb-4927-9acd-22125020f7f6 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-431627319" status: 204 len: 0 microversion: 2.42 time: 0.044695 Mar 05 21:09:13.903020 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2299/4584] 10.222.0.15 () {60 vars in 1258 bytes} [Sat Mar 5 21:09:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-431627319 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:09:14.804184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ff70fb4-dc93-4761-a948-50d8558ecbe7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:14.804806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ff70fb4-dc93-4761-a948-50d8558ecbe7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:14.807709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-217debb3-ff3a-4b7a-871f-c7cf3911cb8d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:14.808530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-217debb3-ff3a-4b7a-871f-c7cf3911cb8d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:14.820138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ff70fb4-dc93-4761-a948-50d8558ecbe7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:14.820599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ff70fb4-dc93-4761-a948-50d8558ecbe7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:14.821405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ff70fb4-dc93-4761-a948-50d8558ecbe7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:14.822059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ff70fb4-dc93-4761-a948-50d8558ecbe7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:14.825619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-217debb3-ff3a-4b7a-871f-c7cf3911cb8d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:14.829214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-217debb3-ff3a-4b7a-871f-c7cf3911cb8d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:14.831587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-217debb3-ff3a-4b7a-871f-c7cf3911cb8d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:14.834262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-217debb3-ff3a-4b7a-871f-c7cf3911cb8d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:15.386754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4ff70fb4-dc93-4761-a948-50d8558ecbe7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:15.398681 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4ff70fb4-dc93-4761-a948-50d8558ecbe7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1509 microversion: 2.1 time: 0.598010 Mar 05 21:09:15.400054 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2300/4585] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:14 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1509 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:15.424989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-217debb3-ff3a-4b7a-871f-c7cf3911cb8d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:15.433140 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-217debb3-ff3a-4b7a-871f-c7cf3911cb8d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 0.633772 Mar 05 21:09:15.434046 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2286/4586] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:14 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:16.302045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-40b317e9-85d3-4a64-adaf-df08661963e3 req-01ddd1a8-b844-474c-a9ce-d6f323e7e587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bacfc2c-ea7e-43a5-b26d-af976d17edd9", "name": "network-vif-unplugged", "status": "completed", "tag": "94b1d404-120e-4570-9658-48bf6610ec97"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:16.321382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-40b317e9-85d3-4a64-adaf-df08661963e3 req-01ddd1a8-b844-474c-a9ce-d6f323e7e587 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:16.322088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-40b317e9-85d3-4a64-adaf-df08661963e3 req-01ddd1a8-b844-474c-a9ce-d6f323e7e587 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:16.358241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.compute.server_external_events [req-40b317e9-85d3-4a64-adaf-df08661963e3 req-01ddd1a8-b844-474c-a9ce-d6f323e7e587 service nova] Unable to find a host for instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9. Dropping event network-vif-unplugged {{(pid=141479) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 05 21:09:16.360193 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-40b317e9-85d3-4a64-adaf-df08661963e3 req-01ddd1a8-b844-474c-a9ce-d6f323e7e587 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.063231 Mar 05 21:09:16.361622 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2301/4587] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 66 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 05 21:09:16.416438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-870813eb-a019-4068-9e78-a0e9bde3de24 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:16.417102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-870813eb-a019-4068-9e78-a0e9bde3de24 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:16.435308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-870813eb-a019-4068-9e78-a0e9bde3de24 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:16.435797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-870813eb-a019-4068-9e78-a0e9bde3de24 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:16.436601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-870813eb-a019-4068-9e78-a0e9bde3de24 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:16.437057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-870813eb-a019-4068-9e78-a0e9bde3de24 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:16.454643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-438bba11-ba5e-41e8-bddf-6ff64cd8bba1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:16.457288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-438bba11-ba5e-41e8-bddf-6ff64cd8bba1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:16.470440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-438bba11-ba5e-41e8-bddf-6ff64cd8bba1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:16.471269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-438bba11-ba5e-41e8-bddf-6ff64cd8bba1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:16.472544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-438bba11-ba5e-41e8-bddf-6ff64cd8bba1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:16.474133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-438bba11-ba5e-41e8-bddf-6ff64cd8bba1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:16.946525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-438bba11-ba5e-41e8-bddf-6ff64cd8bba1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:16.966190 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-438bba11-ba5e-41e8-bddf-6ff64cd8bba1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 0.515428 Mar 05 21:09:16.971701 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2302/4588] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:16 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:16.997117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-4da2249d-2f1f-4679-9376-6f927578232b req-652b3719-3465-4297-93d4-92870f801037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a47955-7a01-4ad3-bffa-719e3e892243", "tag": "e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:17.029904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4da2249d-2f1f-4679-9376-6f927578232b req-652b3719-3465-4297-93d4-92870f801037 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:17.030700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4da2249d-2f1f-4679-9376-6f927578232b req-652b3719-3465-4297-93d4-92870f801037 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:17.046757 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-4da2249d-2f1f-4679-9376-6f927578232b req-652b3719-3465-4297-93d4-92870f801037 service nova] Creating event network-changed:e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2 for instance c4a47955-7a01-4ad3-bffa-719e3e892243 on nch1-master-1 Mar 05 21:09:17.054653 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-4da2249d-2f1f-4679-9376-6f927578232b req-652b3719-3465-4297-93d4-92870f801037 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068130 Mar 05 21:09:17.056128 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2303/4589] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:09:17.905737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-870813eb-a019-4068-9e78-a0e9bde3de24 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:17.934220 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-870813eb-a019-4068-9e78-a0e9bde3de24 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1452 microversion: 2.1 time: 1.521447 Mar 05 21:09:17.934960 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2287/4590] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:16 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1452 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:17.961044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-35f725e5-13bb-4414-98fa-bf04f3dd02cf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:17.974982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-35f725e5-13bb-4414-98fa-bf04f3dd02cf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:17.990548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-38f41d4b-e9e7-4cf3-930f-7c7c50e8b4ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:17.991147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-38f41d4b-e9e7-4cf3-930f-7c7c50e8b4ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:17.999832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38f41d4b-e9e7-4cf3-930f-7c7c50e8b4ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:18.000918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38f41d4b-e9e7-4cf3-930f-7c7c50e8b4ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:18.001868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38f41d4b-e9e7-4cf3-930f-7c7c50e8b4ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:18.002317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38f41d4b-e9e7-4cf3-930f-7c7c50e8b4ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:18.014206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35f725e5-13bb-4414-98fa-bf04f3dd02cf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:18.015014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35f725e5-13bb-4414-98fa-bf04f3dd02cf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:18.020186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35f725e5-13bb-4414-98fa-bf04f3dd02cf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:18.021407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35f725e5-13bb-4414-98fa-bf04f3dd02cf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:18.577444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-38f41d4b-e9e7-4cf3-930f-7c7c50e8b4ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:18.607061 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-38f41d4b-e9e7-4cf3-930f-7c7c50e8b4ff tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 0.622330 Mar 05 21:09:18.618765 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2288/4591] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:17 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:19.062138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-35f725e5-13bb-4414-98fa-bf04f3dd02cf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:19.076917 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-35f725e5-13bb-4414-98fa-bf04f3dd02cf tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1452 microversion: 2.1 time: 1.128541 Mar 05 21:09:19.085119 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2304/4592] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:17 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1452 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:19.144072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a45808fa-6e56-489a-8d6f-6acc8a8655f4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:19.145147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a45808fa-6e56-489a-8d6f-6acc8a8655f4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:19.154341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a45808fa-6e56-489a-8d6f-6acc8a8655f4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:19.154984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a45808fa-6e56-489a-8d6f-6acc8a8655f4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:19.155944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a45808fa-6e56-489a-8d6f-6acc8a8655f4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:19.157324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a45808fa-6e56-489a-8d6f-6acc8a8655f4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:19.192725 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-a45808fa-6e56-489a-8d6f-6acc8a8655f4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lazy-loading 'flavor' on Instance uuid 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:09:19.209646 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-a45808fa-6e56-489a-8d6f-6acc8a8655f4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Cannot 'shelve' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state shelved_offloaded Mar 05 21:09:19.211763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a45808fa-6e56-489a-8d6f-6acc8a8655f4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 409 to user: Cannot 'shelve' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state shelved_offloaded {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:09:19.213110 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a45808fa-6e56-489a-8d6f-6acc8a8655f4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action" status: 409 len: 155 microversion: 2.1 time: 0.077008 Mar 05 21:09:19.214144 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2289/4593] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:09:19 2022] POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action => generated 155 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:09:19.222826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ca271189-5b46-4a49-aedb-9b8e421f0b8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:19.223636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ca271189-5b46-4a49-aedb-9b8e421f0b8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:19.230397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca271189-5b46-4a49-aedb-9b8e421f0b8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:19.231081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca271189-5b46-4a49-aedb-9b8e421f0b8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:19.232041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca271189-5b46-4a49-aedb-9b8e421f0b8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:19.232630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca271189-5b46-4a49-aedb-9b8e421f0b8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:19.433395 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ca271189-5b46-4a49-aedb-9b8e421f0b8b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action" status: 202 len: 0 microversion: 2.1 time: 0.213722 Mar 05 21:09:19.444736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2c72d533-3536-4414-91df-e8998d4ca85a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:19.445768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2c72d533-3536-4414-91df-e8998d4ca85a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:19.466237 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2305/4594] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:09:19 2022] POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:09:19.479623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c72d533-3536-4414-91df-e8998d4ca85a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:19.482201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c72d533-3536-4414-91df-e8998d4ca85a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:19.483212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c72d533-3536-4414-91df-e8998d4ca85a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:19.489599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2c72d533-3536-4414-91df-e8998d4ca85a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:19.626940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f05e8195-346e-48ae-909e-a97a30cd9c25 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:19.628943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f05e8195-346e-48ae-909e-a97a30cd9c25 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:19.642353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f05e8195-346e-48ae-909e-a97a30cd9c25 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:19.644679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f05e8195-346e-48ae-909e-a97a30cd9c25 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:19.647825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f05e8195-346e-48ae-909e-a97a30cd9c25 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:19.648852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f05e8195-346e-48ae-909e-a97a30cd9c25 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:20.100782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2c72d533-3536-4414-91df-e8998d4ca85a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:20.111463 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2c72d533-3536-4414-91df-e8998d4ca85a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1460 microversion: 2.1 time: 0.671355 Mar 05 21:09:20.112123 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2290/4595] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:19 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1460 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:20.675062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f05e8195-346e-48ae-909e-a97a30cd9c25 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:20.690150 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f05e8195-346e-48ae-909e-a97a30cd9c25 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1679 microversion: 2.1 time: 1.067872 Mar 05 21:09:20.693115 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2306/4596] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:19 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1679 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:21.129721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b4bd31e0-dbfe-49f4-84b0-fb4c22e09be3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:21.130334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b4bd31e0-dbfe-49f4-84b0-fb4c22e09be3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:21.140150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4bd31e0-dbfe-49f4-84b0-fb4c22e09be3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:21.142222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4bd31e0-dbfe-49f4-84b0-fb4c22e09be3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:21.143844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4bd31e0-dbfe-49f4-84b0-fb4c22e09be3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:21.144928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4bd31e0-dbfe-49f4-84b0-fb4c22e09be3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:21.530542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-f8a53b8d-9256-4ad6-be65-ace49b47bbd7 req-6b5abbed-dd27-46f1-ad61-5a4b502fc4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a47955-7a01-4ad3-bffa-719e3e892243", "tag": "e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:21.550967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f8a53b8d-9256-4ad6-be65-ace49b47bbd7 req-6b5abbed-dd27-46f1-ad61-5a4b502fc4d1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:21.551453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f8a53b8d-9256-4ad6-be65-ace49b47bbd7 req-6b5abbed-dd27-46f1-ad61-5a4b502fc4d1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:21.574793 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-f8a53b8d-9256-4ad6-be65-ace49b47bbd7 req-6b5abbed-dd27-46f1-ad61-5a4b502fc4d1 service nova] Creating event network-changed:e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2 for instance c4a47955-7a01-4ad3-bffa-719e3e892243 on nch1-master-1 Mar 05 21:09:21.581628 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-f8a53b8d-9256-4ad6-be65-ace49b47bbd7 req-6b5abbed-dd27-46f1-ad61-5a4b502fc4d1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056703 Mar 05 21:09:21.582491 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2307/4597] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:09:21.728106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-73c4e357-406a-4106-bef9-02407a1b8991 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:21.731130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-73c4e357-406a-4106-bef9-02407a1b8991 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:21.744967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-73c4e357-406a-4106-bef9-02407a1b8991 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:21.745848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-73c4e357-406a-4106-bef9-02407a1b8991 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:21.749631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-73c4e357-406a-4106-bef9-02407a1b8991 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:21.752503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-73c4e357-406a-4106-bef9-02407a1b8991 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:22.218974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b4bd31e0-dbfe-49f4-84b0-fb4c22e09be3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:22.232887 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b4bd31e0-dbfe-49f4-84b0-fb4c22e09be3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1462 microversion: 2.1 time: 1.106752 Mar 05 21:09:22.247579 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2291/4598] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:21 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1462 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:22.290016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-73c4e357-406a-4106-bef9-02407a1b8991 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:22.309289 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-73c4e357-406a-4106-bef9-02407a1b8991 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1656 microversion: 2.1 time: 0.602335 Mar 05 21:09:22.333612 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2308/4599] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:21 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1656 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:22.336713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-15b67d77-0cef-4d37-933e-671d25f6a077 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:22.347291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15b67d77-0cef-4d37-933e-671d25f6a077 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:22.354721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15b67d77-0cef-4d37-933e-671d25f6a077 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:22.432889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-15b67d77-0cef-4d37-933e-671d25f6a077 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Going to try to start instance {{(pid=141478) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 05 21:09:22.523178 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-15b67d77-0cef-4d37-933e-671d25f6a077 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.196333 Mar 05 21:09:22.528879 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2292/4600] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:09:22 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:09:22.543008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4f368b26-0423-40b4-99c2-6a39ed9d8a32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:22.543220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4f368b26-0423-40b4-99c2-6a39ed9d8a32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:22.566916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f368b26-0423-40b4-99c2-6a39ed9d8a32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:22.569372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f368b26-0423-40b4-99c2-6a39ed9d8a32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:22.571933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f368b26-0423-40b4-99c2-6a39ed9d8a32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:22.572556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f368b26-0423-40b4-99c2-6a39ed9d8a32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:23.255685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-877decae-3629-45d4-b2cf-5ce86c1c8d16 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:23.257301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-877decae-3629-45d4-b2cf-5ce86c1c8d16 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:23.263922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-877decae-3629-45d4-b2cf-5ce86c1c8d16 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:23.264593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-877decae-3629-45d4-b2cf-5ce86c1c8d16 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:23.265389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-877decae-3629-45d4-b2cf-5ce86c1c8d16 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:23.266604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-877decae-3629-45d4-b2cf-5ce86c1c8d16 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:23.690893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4f368b26-0423-40b4-99c2-6a39ed9d8a32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:23.699581 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4f368b26-0423-40b4-99c2-6a39ed9d8a32 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1665 microversion: 2.1 time: 1.166777 Mar 05 21:09:23.710576 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2309/4601] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:22 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1665 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:23.982565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-877decae-3629-45d4-b2cf-5ce86c1c8d16 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:24.001941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-2720c241-6302-46c0-8853-27692e071d76 req-af05a176-ae88-4954-83b4-0a19b9be6711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a47955-7a01-4ad3-bffa-719e3e892243", "tag": "e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:24.018384 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-877decae-3629-45d4-b2cf-5ce86c1c8d16 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 0.766432 Mar 05 21:09:24.021839 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2293/4602] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:23 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:24.022517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2720c241-6302-46c0-8853-27692e071d76 req-af05a176-ae88-4954-83b4-0a19b9be6711 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:24.023358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2720c241-6302-46c0-8853-27692e071d76 req-af05a176-ae88-4954-83b4-0a19b9be6711 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:24.041403 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-2720c241-6302-46c0-8853-27692e071d76 req-af05a176-ae88-4954-83b4-0a19b9be6711 service nova] Creating event network-changed:e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2 for instance c4a47955-7a01-4ad3-bffa-719e3e892243 on nch1-master-1 Mar 05 21:09:24.050629 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-2720c241-6302-46c0-8853-27692e071d76 req-af05a176-ae88-4954-83b4-0a19b9be6711 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.332939 Mar 05 21:09:24.051901 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2310/4603] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:09:24.722851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-52215117-0ad4-446d-ac63-f63ee9430b06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:24.724429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-52215117-0ad4-446d-ac63-f63ee9430b06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:24.742612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52215117-0ad4-446d-ac63-f63ee9430b06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:24.743658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52215117-0ad4-446d-ac63-f63ee9430b06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:24.744821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52215117-0ad4-446d-ac63-f63ee9430b06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:24.745423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52215117-0ad4-446d-ac63-f63ee9430b06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:25.039274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3a3b7713-2b61-42b2-8039-7f3103b9d7b1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:25.040168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3a3b7713-2b61-42b2-8039-7f3103b9d7b1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:25.058623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a3b7713-2b61-42b2-8039-7f3103b9d7b1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:25.059170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a3b7713-2b61-42b2-8039-7f3103b9d7b1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:25.060445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a3b7713-2b61-42b2-8039-7f3103b9d7b1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:25.062250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a3b7713-2b61-42b2-8039-7f3103b9d7b1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:25.551999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3a3b7713-2b61-42b2-8039-7f3103b9d7b1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:25.572652 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3a3b7713-2b61-42b2-8039-7f3103b9d7b1 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 0.538438 Mar 05 21:09:25.587695 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2311/4604] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:25 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:26.383584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-52215117-0ad4-446d-ac63-f63ee9430b06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:26.394342 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-52215117-0ad4-446d-ac63-f63ee9430b06 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1665 microversion: 2.1 time: 1.679142 Mar 05 21:09:26.401521 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2294/4605] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:24 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1665 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:26.593745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-65784304-2dbf-4ef7-b3c9-4a7b66682653 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:26.594493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-65784304-2dbf-4ef7-b3c9-4a7b66682653 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:26.603656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65784304-2dbf-4ef7-b3c9-4a7b66682653 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:26.607760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65784304-2dbf-4ef7-b3c9-4a7b66682653 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:26.610545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65784304-2dbf-4ef7-b3c9-4a7b66682653 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:26.612576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-65784304-2dbf-4ef7-b3c9-4a7b66682653 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:26.959028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fa2d910c-6813-4ac8-bcc7-c688f22e1b51 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:26.959804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fa2d910c-6813-4ac8-bcc7-c688f22e1b51 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:26.979166 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa2d910c-6813-4ac8-bcc7-c688f22e1b51 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:26.986065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa2d910c-6813-4ac8-bcc7-c688f22e1b51 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:26.992754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa2d910c-6813-4ac8-bcc7-c688f22e1b51 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:26.993478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa2d910c-6813-4ac8-bcc7-c688f22e1b51 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:27.058387 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-fa2d910c-6813-4ac8-bcc7-c688f22e1b51 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] HTTP exception thrown: Instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 could not be found. Mar 05 21:09:27.061064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fa2d910c-6813-4ac8-bcc7-c688f22e1b51 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Returning 404 to user: Instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:09:27.065489 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fa2d910c-6813-4ac8-bcc7-c688f22e1b51 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 404 len: 111 microversion: 2.42 time: 0.112659 Mar 05 21:09:27.068563 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2295/4606] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:09:26 2022] DELETE /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 05 21:09:27.075599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-65784304-2dbf-4ef7-b3c9-4a7b66682653 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:27.081955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b7e792ac-6fc2-4968-a903-de0226be4c18 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:27.084174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b7e792ac-6fc2-4968-a903-de0226be4c18 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] [instance: d50a5d07-345e-4ca6-b359-e63cc5d5e1d7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:27.088818 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-65784304-2dbf-4ef7-b3c9-4a7b66682653 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 0.496891 Mar 05 21:09:27.091760 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2312/4607] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:26 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:27.112771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7e792ac-6fc2-4968-a903-de0226be4c18 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:27.113516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7e792ac-6fc2-4968-a903-de0226be4c18 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:27.116408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7e792ac-6fc2-4968-a903-de0226be4c18 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:27.117654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7e792ac-6fc2-4968-a903-de0226be4c18 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:27.159599 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-b7e792ac-6fc2-4968-a903-de0226be4c18 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] HTTP exception thrown: Instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 could not be found. Mar 05 21:09:27.161724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b7e792ac-6fc2-4968-a903-de0226be4c18 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] Returning 404 to user: Instance d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:09:27.166028 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b7e792ac-6fc2-4968-a903-de0226be4c18 tempest-TaggedBootDevicesTest_v242-1271501382 tempest-TaggedBootDevicesTest_v242-1271501382-project] 10.222.0.15 "GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7" status: 404 len: 111 microversion: 2.42 time: 0.090831 Mar 05 21:09:27.168056 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2296/4608] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:09:27 2022] GET /compute/v2.1/servers/d50a5d07-345e-4ca6-b359-e63cc5d5e1d7 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:09:27.413928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-825ce17a-028a-498c-8928-422698255633 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:27.414752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-825ce17a-028a-498c-8928-422698255633 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:27.427625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-825ce17a-028a-498c-8928-422698255633 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:27.428706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-825ce17a-028a-498c-8928-422698255633 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:27.430660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-825ce17a-028a-498c-8928-422698255633 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:27.433023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-825ce17a-028a-498c-8928-422698255633 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:28.112042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-22fb7feb-6274-4b05-877e-5cc493758504 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:28.112042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-22fb7feb-6274-4b05-877e-5cc493758504 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:28.145473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22fb7feb-6274-4b05-877e-5cc493758504 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:28.146319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22fb7feb-6274-4b05-877e-5cc493758504 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:28.147354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22fb7feb-6274-4b05-877e-5cc493758504 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:28.149211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22fb7feb-6274-4b05-877e-5cc493758504 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:28.263367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-825ce17a-028a-498c-8928-422698255633 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:28.275105 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-825ce17a-028a-498c-8928-422698255633 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.865115 Mar 05 21:09:28.279852 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2313/4609] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:27 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:28.294196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-38099c2e-3baa-41d8-83cc-c93099c031dd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:28.294905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-38099c2e-3baa-41d8-83cc-c93099c031dd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:28.318413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-38099c2e-3baa-41d8-83cc-c93099c031dd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:28.320494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-38099c2e-3baa-41d8-83cc-c93099c031dd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:28.325926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-38099c2e-3baa-41d8-83cc-c93099c031dd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:28.326613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-38099c2e-3baa-41d8-83cc-c93099c031dd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:29.466103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-22fb7feb-6274-4b05-877e-5cc493758504 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:29.474841 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-22fb7feb-6274-4b05-877e-5cc493758504 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 1.369647 Mar 05 21:09:29.493894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-38099c2e-3baa-41d8-83cc-c93099c031dd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:29.494505 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2297/4610] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:28 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:29.513301 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-38099c2e-3baa-41d8-83cc-c93099c031dd tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 1.224585 Mar 05 21:09:29.528807 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2314/4611] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:28 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:29.539242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e1c43d19-8c83-44d8-9d29-534dd31d6f12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:29.540046 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e1c43d19-8c83-44d8-9d29-534dd31d6f12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:29.550946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e1c43d19-8c83-44d8-9d29-534dd31d6f12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:29.551403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e1c43d19-8c83-44d8-9d29-534dd31d6f12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:29.554407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e1c43d19-8c83-44d8-9d29-534dd31d6f12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:29.556313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e1c43d19-8c83-44d8-9d29-534dd31d6f12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:30.496040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5f7e0abc-bf40-463a-8b6e-0db3faea1e53 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:30.497481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5f7e0abc-bf40-463a-8b6e-0db3faea1e53 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:30.529816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f7e0abc-bf40-463a-8b6e-0db3faea1e53 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:30.536198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f7e0abc-bf40-463a-8b6e-0db3faea1e53 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:30.540086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f7e0abc-bf40-463a-8b6e-0db3faea1e53 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:30.543230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f7e0abc-bf40-463a-8b6e-0db3faea1e53 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:30.863595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e1c43d19-8c83-44d8-9d29-534dd31d6f12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:30.883326 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e1c43d19-8c83-44d8-9d29-534dd31d6f12 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 1.348373 Mar 05 21:09:30.883950 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2298/4612] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:29 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:30.902488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b0608e92-4c62-46b4-9c4f-03bddeee22ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:30.916522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b0608e92-4c62-46b4-9c4f-03bddeee22ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:30.924201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0608e92-4c62-46b4-9c4f-03bddeee22ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:30.925077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0608e92-4c62-46b4-9c4f-03bddeee22ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:30.927523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0608e92-4c62-46b4-9c4f-03bddeee22ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:30.928314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0608e92-4c62-46b4-9c4f-03bddeee22ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:31.570982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5f7e0abc-bf40-463a-8b6e-0db3faea1e53 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:31.584082 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5f7e0abc-bf40-463a-8b6e-0db3faea1e53 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 1.092722 Mar 05 21:09:31.595511 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2315/4613] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:30 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:32.405890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b0608e92-4c62-46b4-9c4f-03bddeee22ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:32.440130 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b0608e92-4c62-46b4-9c4f-03bddeee22ec tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 1.541980 Mar 05 21:09:32.441428 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2299/4614] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:30 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:32.459403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cec8d9af-41c0-40df-9952-7a98b21df09e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:32.460088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cec8d9af-41c0-40df-9952-7a98b21df09e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:32.473500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cec8d9af-41c0-40df-9952-7a98b21df09e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:32.474114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cec8d9af-41c0-40df-9952-7a98b21df09e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:32.475036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cec8d9af-41c0-40df-9952-7a98b21df09e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:32.475426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cec8d9af-41c0-40df-9952-7a98b21df09e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:32.602102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5948aad6-c3d2-44ed-a7b4-285f608724c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:32.602728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5948aad6-c3d2-44ed-a7b4-285f608724c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:32.623686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5948aad6-c3d2-44ed-a7b4-285f608724c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:32.626086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5948aad6-c3d2-44ed-a7b4-285f608724c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:32.628868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5948aad6-c3d2-44ed-a7b4-285f608724c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:32.630581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5948aad6-c3d2-44ed-a7b4-285f608724c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:33.386358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cec8d9af-41c0-40df-9952-7a98b21df09e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:33.415247 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cec8d9af-41c0-40df-9952-7a98b21df09e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.956987 Mar 05 21:09:33.418155 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2316/4615] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:32 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:33.462794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-032c0b85-894d-497f-8ed2-c2ca4396625c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:33.464626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-032c0b85-894d-497f-8ed2-c2ca4396625c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:33.485386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-032c0b85-894d-497f-8ed2-c2ca4396625c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:33.489547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-032c0b85-894d-497f-8ed2-c2ca4396625c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:33.490757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-032c0b85-894d-497f-8ed2-c2ca4396625c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:33.492152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-032c0b85-894d-497f-8ed2-c2ca4396625c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:33.785492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5948aad6-c3d2-44ed-a7b4-285f608724c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:33.802189 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5948aad6-c3d2-44ed-a7b4-285f608724c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 1.201264 Mar 05 21:09:33.818678 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2300/4616] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:32 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:34.329544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-032c0b85-894d-497f-8ed2-c2ca4396625c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lazy-loading 'flavor' on Instance uuid dc548a05-5226-41f0-a34d-1d44defee56c {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:09:34.475875 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-032c0b85-894d-497f-8ed2-c2ca4396625c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 1.038452 Mar 05 21:09:34.481377 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2317/4617] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:09:33 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:09:34.488789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-35b20b78-84ae-4431-97f0-815787856cd5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:34.489702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-35b20b78-84ae-4431-97f0-815787856cd5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:34.498294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35b20b78-84ae-4431-97f0-815787856cd5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:34.499053 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35b20b78-84ae-4431-97f0-815787856cd5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:34.503007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35b20b78-84ae-4431-97f0-815787856cd5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:34.503798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35b20b78-84ae-4431-97f0-815787856cd5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:34.846015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a19e6357-f051-415e-851c-d6ecd022f7ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:34.850113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a19e6357-f051-415e-851c-d6ecd022f7ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:34.877182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a19e6357-f051-415e-851c-d6ecd022f7ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:34.879540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a19e6357-f051-415e-851c-d6ecd022f7ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:34.881753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a19e6357-f051-415e-851c-d6ecd022f7ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:34.885289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a19e6357-f051-415e-851c-d6ecd022f7ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:35.036902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-35b20b78-84ae-4431-97f0-815787856cd5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:35.051499 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-35b20b78-84ae-4431-97f0-815787856cd5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1677 microversion: 2.1 time: 0.568059 Mar 05 21:09:35.065106 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2301/4618] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:34 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1677 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:35.529593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a19e6357-f051-415e-851c-d6ecd022f7ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:35.542163 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a19e6357-f051-415e-851c-d6ecd022f7ae tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 0.714139 Mar 05 21:09:35.542646 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2318/4619] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:34 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:36.072855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-56200ba2-73d7-43e2-bb50-108b3b3f8971 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:36.073583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-56200ba2-73d7-43e2-bb50-108b3b3f8971 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:36.091220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-56200ba2-73d7-43e2-bb50-108b3b3f8971 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:36.094500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-56200ba2-73d7-43e2-bb50-108b3b3f8971 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:36.097811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-56200ba2-73d7-43e2-bb50-108b3b3f8971 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:36.133030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-56200ba2-73d7-43e2-bb50-108b3b3f8971 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:36.561262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7bdfe747-c5de-4096-ab73-e8fd4bf096cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:36.562904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7bdfe747-c5de-4096-ab73-e8fd4bf096cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:36.575242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7bdfe747-c5de-4096-ab73-e8fd4bf096cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:36.575645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7bdfe747-c5de-4096-ab73-e8fd4bf096cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:36.580172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7bdfe747-c5de-4096-ab73-e8fd4bf096cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:36.580716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7bdfe747-c5de-4096-ab73-e8fd4bf096cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:37.693995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7bdfe747-c5de-4096-ab73-e8fd4bf096cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:37.708471 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7bdfe747-c5de-4096-ab73-e8fd4bf096cd tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 1.152370 Mar 05 21:09:37.710750 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2319/4620] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:36 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:37.798003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-56200ba2-73d7-43e2-bb50-108b3b3f8971 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:37.808850 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-56200ba2-73d7-43e2-bb50-108b3b3f8971 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1660 microversion: 2.1 time: 1.741389 Mar 05 21:09:37.824139 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2302/4621] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:36 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1660 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:37.835233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-822e2536-a913-4ae0-8c63-1f8ff21840f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:37.836182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-822e2536-a913-4ae0-8c63-1f8ff21840f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:37.857811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-822e2536-a913-4ae0-8c63-1f8ff21840f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:37.858859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-822e2536-a913-4ae0-8c63-1f8ff21840f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:37.860608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-822e2536-a913-4ae0-8c63-1f8ff21840f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:37.861576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-822e2536-a913-4ae0-8c63-1f8ff21840f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:37.968087 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-822e2536-a913-4ae0-8c63-1f8ff21840f2 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action" status: 202 len: 0 microversion: 2.1 time: 0.140032 Mar 05 21:09:37.979982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fbd11087-e623-48dc-9a18-f779e7961dfc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:37.980622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fbd11087-e623-48dc-9a18-f779e7961dfc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:37.985317 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2320/4622] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:09:37 2022] POST /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:09:37.989472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbd11087-e623-48dc-9a18-f779e7961dfc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:37.990131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbd11087-e623-48dc-9a18-f779e7961dfc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:37.990939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbd11087-e623-48dc-9a18-f779e7961dfc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:37.991392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbd11087-e623-48dc-9a18-f779e7961dfc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:38.614373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fbd11087-e623-48dc-9a18-f779e7961dfc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:38.633605 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fbd11087-e623-48dc-9a18-f779e7961dfc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1666 microversion: 2.1 time: 0.658378 Mar 05 21:09:38.657774 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2303/4623] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:37 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1666 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:38.728589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fea7aa66-3ce1-4ff7-b4a6-68309a56264c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:38.729967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fea7aa66-3ce1-4ff7-b4a6-68309a56264c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:38.737041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fea7aa66-3ce1-4ff7-b4a6-68309a56264c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:38.737526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fea7aa66-3ce1-4ff7-b4a6-68309a56264c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:38.738614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fea7aa66-3ce1-4ff7-b4a6-68309a56264c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:38.739181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fea7aa66-3ce1-4ff7-b4a6-68309a56264c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:39.373170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fea7aa66-3ce1-4ff7-b4a6-68309a56264c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:39.399815 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fea7aa66-3ce1-4ff7-b4a6-68309a56264c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 0.676195 Mar 05 21:09:39.400739 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2321/4624] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:38 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:39.666638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-62dcc9ea-9ae2-48ed-bbff-2d5829e061c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:39.668095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-62dcc9ea-9ae2-48ed-bbff-2d5829e061c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:39.682936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62dcc9ea-9ae2-48ed-bbff-2d5829e061c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:39.684094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62dcc9ea-9ae2-48ed-bbff-2d5829e061c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:39.686333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62dcc9ea-9ae2-48ed-bbff-2d5829e061c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:39.688500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62dcc9ea-9ae2-48ed-bbff-2d5829e061c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:40.417851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8da398d6-fef5-406f-844e-7a4a5ae74fff tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:40.419063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8da398d6-fef5-406f-844e-7a4a5ae74fff tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:40.434406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8da398d6-fef5-406f-844e-7a4a5ae74fff tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:40.436675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8da398d6-fef5-406f-844e-7a4a5ae74fff tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:40.438057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8da398d6-fef5-406f-844e-7a4a5ae74fff tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:40.445856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8da398d6-fef5-406f-844e-7a4a5ae74fff tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:40.802695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8da398d6-fef5-406f-844e-7a4a5ae74fff tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:40.813846 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8da398d6-fef5-406f-844e-7a4a5ae74fff tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 0.399809 Mar 05 21:09:40.815199 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2322/4625] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:40 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:40.963540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-62dcc9ea-9ae2-48ed-bbff-2d5829e061c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:40.985722 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-62dcc9ea-9ae2-48ed-bbff-2d5829e061c4 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1666 microversion: 2.1 time: 1.319096 Mar 05 21:09:40.987138 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2304/4626] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:39 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1666 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:41.837138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3f6562a3-28e5-45cd-b82d-268fe30457e5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:41.840318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3f6562a3-28e5-45cd-b82d-268fe30457e5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:41.866710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f6562a3-28e5-45cd-b82d-268fe30457e5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:41.867557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f6562a3-28e5-45cd-b82d-268fe30457e5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:41.868782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f6562a3-28e5-45cd-b82d-268fe30457e5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:41.871112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f6562a3-28e5-45cd-b82d-268fe30457e5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:42.006926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e5c6d64b-ad84-4d3e-b14c-879a39ff36e7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:42.008249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e5c6d64b-ad84-4d3e-b14c-879a39ff36e7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:42.033173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5c6d64b-ad84-4d3e-b14c-879a39ff36e7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:42.034835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5c6d64b-ad84-4d3e-b14c-879a39ff36e7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:42.039263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5c6d64b-ad84-4d3e-b14c-879a39ff36e7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:42.040204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5c6d64b-ad84-4d3e-b14c-879a39ff36e7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:42.775236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e5c6d64b-ad84-4d3e-b14c-879a39ff36e7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:42.793136 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e5c6d64b-ad84-4d3e-b14c-879a39ff36e7 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.793437 Mar 05 21:09:42.794397 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2305/4627] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:41 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:42.815085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f383cf2f-82d0-4e15-8ed5-0952f0e1536c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:42.815837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f383cf2f-82d0-4e15-8ed5-0952f0e1536c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:42.825940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f383cf2f-82d0-4e15-8ed5-0952f0e1536c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:42.826404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f383cf2f-82d0-4e15-8ed5-0952f0e1536c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:42.827238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f383cf2f-82d0-4e15-8ed5-0952f0e1536c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:42.828541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f383cf2f-82d0-4e15-8ed5-0952f0e1536c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:43.022242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3f6562a3-28e5-45cd-b82d-268fe30457e5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:43.049001 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3f6562a3-28e5-45cd-b82d-268fe30457e5 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 1.208935 Mar 05 21:09:43.051601 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2323/4628] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:41 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:43.145184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f383cf2f-82d0-4e15-8ed5-0952f0e1536c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:43.161240 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f383cf2f-82d0-4e15-8ed5-0952f0e1536c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1669 microversion: 2.1 time: 0.349998 Mar 05 21:09:43.167319 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2306/4629] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:42 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1669 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:43.192891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:43.193647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:43.211777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:43.212488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:43.213487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:43.216098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:43.286276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:09:43.303060 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.compute.api [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Working on deleting snapshot 1f771853-1ef8-4e5d-94aa-fc2113242ef5 from shelved instance... Mar 05 21:09:44.070858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1ea964f4-d053-48e7-8d8d-1c97d36eb34a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:44.071488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1ea964f4-d053-48e7-8d8d-1c97d36eb34a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:44.084682 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ea964f4-d053-48e7-8d8d-1c97d36eb34a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:44.085148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ea964f4-d053-48e7-8d8d-1c97d36eb34a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:44.086045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ea964f4-d053-48e7-8d8d-1c97d36eb34a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:44.086491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ea964f4-d053-48e7-8d8d-1c97d36eb34a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:44.483553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1ea964f4-d053-48e7-8d8d-1c97d36eb34a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:44.502912 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1ea964f4-d053-48e7-8d8d-1c97d36eb34a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 0.438398 Mar 05 21:09:44.503594 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2307/4630] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:44 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:44.838223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Doing local delete in cell 591cc087-7d9b-4967-a4cd-9c96e8077593(cell1) {{(pid=141479) _delete /opt/stack/nova/nova/compute/api.py:2489}} Mar 05 21:09:44.840931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:44.842266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:44.845113 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.compute.api [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Mar 05 21:09:44.854393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] deallocate_for_instance() {{(pid=141479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Mar 05 21:09:45.521155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2104ec55-7239-4b22-af73-936dfc0c2063 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:45.521794 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2104ec55-7239-4b22-af73-936dfc0c2063 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:45.528410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2104ec55-7239-4b22-af73-936dfc0c2063 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:45.528885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2104ec55-7239-4b22-af73-936dfc0c2063 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:45.529703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2104ec55-7239-4b22-af73-936dfc0c2063 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:45.530106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2104ec55-7239-4b22-af73-936dfc0c2063 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:45.804818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2104ec55-7239-4b22-af73-936dfc0c2063 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:45.819744 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2104ec55-7239-4b22-af73-936dfc0c2063 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 0.302456 Mar 05 21:09:45.820463 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2308/4631] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:45 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:45.888791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-428570d7-eaca-4963-ae06-a9228e18705f req-7e94012d-1671-4f5d-87e0-96edc25afe13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bacfc2c-ea7e-43a5-b26d-af976d17edd9", "name": "network-vif-plugged", "status": "completed", "tag": "94b1d404-120e-4570-9658-48bf6610ec97"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:45.900280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-428570d7-eaca-4963-ae06-a9228e18705f req-7e94012d-1671-4f5d-87e0-96edc25afe13 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:45.900738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-428570d7-eaca-4963-ae06-a9228e18705f req-7e94012d-1671-4f5d-87e0-96edc25afe13 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:45.915171 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-428570d7-eaca-4963-ae06-a9228e18705f req-7e94012d-1671-4f5d-87e0-96edc25afe13 service nova] Creating event network-vif-plugged:94b1d404-120e-4570-9658-48bf6610ec97 for instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 on nch2-master-1 Mar 05 21:09:45.920999 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-428570d7-eaca-4963-ae06-a9228e18705f req-7e94012d-1671-4f5d-87e0-96edc25afe13 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038672 Mar 05 21:09:45.922504 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2309/4632] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:09:46.840686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1409a741-7870-454d-b74b-e10235e10975 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:46.841455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1409a741-7870-454d-b74b-e10235e10975 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:46.848760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1409a741-7870-454d-b74b-e10235e10975 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:46.849605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1409a741-7870-454d-b74b-e10235e10975 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:46.850632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1409a741-7870-454d-b74b-e10235e10975 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:46.851293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1409a741-7870-454d-b74b-e10235e10975 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:47.270766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Updating instance_info_cache with network_info: [] {{(pid=141479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 05 21:09:47.325999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1409a741-7870-454d-b74b-e10235e10975 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:47.349893 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1409a741-7870-454d-b74b-e10235e10975 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 0.513768 Mar 05 21:09:47.350446 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2310/4633] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:46 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:47.359862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-cb063677-0e53-4e4d-9862-57b1c044436c req-11a46356-8ced-4da8-966a-61f6e541a6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb113c5-40de-49b7-8f60-c10f275d42db", "name": "network-vif-deleted", "tag": "2de15539-9dfc-43c7-86e8-df851b4d8dbe"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:47.383887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-cb063677-0e53-4e4d-9862-57b1c044436c req-11a46356-8ced-4da8-966a-61f6e541a6e5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:47.387880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-cb063677-0e53-4e4d-9862-57b1c044436c req-11a46356-8ced-4da8-966a-61f6e541a6e5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:47.408828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.compute.server_external_events [req-cb063677-0e53-4e4d-9862-57b1c044436c req-11a46356-8ced-4da8-966a-61f6e541a6e5 service nova] Unable to find a host for instance 7eb113c5-40de-49b7-8f60-c10f275d42db. Dropping event network-vif-deleted {{(pid=141478) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 05 21:09:47.410046 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-cb063677-0e53-4e4d-9862-57b1c044436c req-11a46356-8ced-4da8-966a-61f6e541a6e5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.057049 Mar 05 21:09:47.411198 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2311/4634] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 05 21:09:47.802983 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8e9f61b7-a61c-4f57-ac08-9fe14c8150a0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 204 len: 0 microversion: 2.1 time: 4.616760 Mar 05 21:09:47.804406 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2324/4635] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:09:43 2022] DELETE /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 0 bytes in 4623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:09:47.813915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-144bb117-405a-4ce7-9d44-2d8d3a2e4edc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:47.814748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-144bb117-405a-4ce7-9d44-2d8d3a2e4edc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: 7eb113c5-40de-49b7-8f60-c10f275d42db] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:47.825452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-144bb117-405a-4ce7-9d44-2d8d3a2e4edc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:47.826075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-144bb117-405a-4ce7-9d44-2d8d3a2e4edc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:47.827030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-144bb117-405a-4ce7-9d44-2d8d3a2e4edc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:47.828636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-144bb117-405a-4ce7-9d44-2d8d3a2e4edc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:47.886266 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-144bb117-405a-4ce7-9d44-2d8d3a2e4edc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] HTTP exception thrown: Instance 7eb113c5-40de-49b7-8f60-c10f275d42db could not be found. Mar 05 21:09:47.886889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-144bb117-405a-4ce7-9d44-2d8d3a2e4edc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Returning 404 to user: Instance 7eb113c5-40de-49b7-8f60-c10f275d42db could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:09:47.887775 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-144bb117-405a-4ce7-9d44-2d8d3a2e4edc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db" status: 404 len: 111 microversion: 2.1 time: 0.078869 Mar 05 21:09:47.891923 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2312/4636] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:47 2022] GET /compute/v2.1/servers/7eb113c5-40de-49b7-8f60-c10f275d42db => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:09:47.909066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-16051781-98a6-4a98-985e-525023e6145e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:47.909721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-16051781-98a6-4a98-985e-525023e6145e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:47.934645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16051781-98a6-4a98-985e-525023e6145e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:47.937588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16051781-98a6-4a98-985e-525023e6145e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:47.942485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16051781-98a6-4a98-985e-525023e6145e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:47.946198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16051781-98a6-4a98-985e-525023e6145e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:48.029102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-16051781-98a6-4a98-985e-525023e6145e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:09:48.216229 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-16051781-98a6-4a98-985e-525023e6145e tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 204 len: 0 microversion: 2.1 time: 0.320697 Mar 05 21:09:48.219031 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2325/4637] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:09:47 2022] DELETE /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:09:48.227657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-560ebf99-3784-4d89-86d3-5c41cb7dcd2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:48.228666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-560ebf99-3784-4d89-86d3-5c41cb7dcd2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:48.236494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-560ebf99-3784-4d89-86d3-5c41cb7dcd2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:48.237450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-560ebf99-3784-4d89-86d3-5c41cb7dcd2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:48.238443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-560ebf99-3784-4d89-86d3-5c41cb7dcd2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:48.239357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-560ebf99-3784-4d89-86d3-5c41cb7dcd2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:48.377924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e5087ecc-da4b-4598-b583-60f84d8e1520 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:48.380840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e5087ecc-da4b-4598-b583-60f84d8e1520 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:48.412404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5087ecc-da4b-4598-b583-60f84d8e1520 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:48.413754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5087ecc-da4b-4598-b583-60f84d8e1520 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:48.415522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5087ecc-da4b-4598-b583-60f84d8e1520 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:48.418271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5087ecc-da4b-4598-b583-60f84d8e1520 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:49.229711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-560ebf99-3784-4d89-86d3-5c41cb7dcd2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:49.257701 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-560ebf99-3784-4d89-86d3-5c41cb7dcd2d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1464 microversion: 2.1 time: 1.030192 Mar 05 21:09:49.264056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e5087ecc-da4b-4598-b583-60f84d8e1520 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:49.270709 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2313/4638] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:48 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1464 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:49.276685 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e5087ecc-da4b-4598-b583-60f84d8e1520 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1518 microversion: 2.1 time: 0.909894 Mar 05 21:09:49.281128 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2326/4639] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:48 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1518 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:50.281990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7810c87d-8516-4cd5-958c-9db944c775bc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:50.282670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7810c87d-8516-4cd5-958c-9db944c775bc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:50.301201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-df3bb3db-0a4b-4771-80ed-2fdad404a96a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:50.302770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-df3bb3db-0a4b-4771-80ed-2fdad404a96a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:50.331227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7810c87d-8516-4cd5-958c-9db944c775bc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:50.332691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7810c87d-8516-4cd5-958c-9db944c775bc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:50.337012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7810c87d-8516-4cd5-958c-9db944c775bc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:50.337497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7810c87d-8516-4cd5-958c-9db944c775bc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:50.337658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-df3bb3db-0a4b-4771-80ed-2fdad404a96a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:50.338108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-df3bb3db-0a4b-4771-80ed-2fdad404a96a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:50.338996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-df3bb3db-0a4b-4771-80ed-2fdad404a96a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:50.339464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-df3bb3db-0a4b-4771-80ed-2fdad404a96a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:50.762015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7810c87d-8516-4cd5-958c-9db944c775bc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:50.773801 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7810c87d-8516-4cd5-958c-9db944c775bc tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1464 microversion: 2.1 time: 0.498765 Mar 05 21:09:50.774460 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2314/4640] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:50 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1464 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:51.072533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-df3bb3db-0a4b-4771-80ed-2fdad404a96a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:51.081670 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-df3bb3db-0a4b-4771-80ed-2fdad404a96a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.786817 Mar 05 21:09:51.082263 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2327/4641] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:50 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:51.101493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c5229407-f711-448e-b68f-1b791cb83533 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:51.102362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c5229407-f711-448e-b68f-1b791cb83533 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:51.110469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5229407-f711-448e-b68f-1b791cb83533 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:51.111250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5229407-f711-448e-b68f-1b791cb83533 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:51.112368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5229407-f711-448e-b68f-1b791cb83533 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:51.113150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c5229407-f711-448e-b68f-1b791cb83533 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:51.626991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c5229407-f711-448e-b68f-1b791cb83533 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:51.636377 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c5229407-f711-448e-b68f-1b791cb83533 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.539020 Mar 05 21:09:51.637262 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2315/4642] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:51 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:51.667579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c0aa27cd-d5a1-434d-99c5-759f6b3d9fdc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:51.669212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c0aa27cd-d5a1-434d-99c5-759f6b3d9fdc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:51.679982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c0aa27cd-d5a1-434d-99c5-759f6b3d9fdc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:51.680714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c0aa27cd-d5a1-434d-99c5-759f6b3d9fdc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:51.682334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c0aa27cd-d5a1-434d-99c5-759f6b3d9fdc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:51.684759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c0aa27cd-d5a1-434d-99c5-759f6b3d9fdc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:51.797022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9e4183e4-6b98-4f93-adb1-c24a91d071e5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:51.804551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9e4183e4-6b98-4f93-adb1-c24a91d071e5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:51.811327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e4183e4-6b98-4f93-adb1-c24a91d071e5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:51.812705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e4183e4-6b98-4f93-adb1-c24a91d071e5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:51.813828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e4183e4-6b98-4f93-adb1-c24a91d071e5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:51.814541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e4183e4-6b98-4f93-adb1-c24a91d071e5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:52.049312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9e4183e4-6b98-4f93-adb1-c24a91d071e5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:52.084306 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9e4183e4-6b98-4f93-adb1-c24a91d071e5 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 200 len: 1464 microversion: 2.1 time: 0.291711 Mar 05 21:09:52.085362 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2316/4643] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:51 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 1464 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:09:52.312078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-fce031e4-eef1-42f8-9773-dafa2f763803 req-5e2a0bfd-7627-4044-9ec7-49467a7d92cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aadfd70b-cacd-4483-9974-3190f70167c9", "name": "network-vif-deleted", "tag": "dd23e2dc-da6a-4c82-92a8-c32b30b75f06"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:52.334959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-fce031e4-eef1-42f8-9773-dafa2f763803 req-5e2a0bfd-7627-4044-9ec7-49467a7d92cb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:52.335941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-fce031e4-eef1-42f8-9773-dafa2f763803 req-5e2a0bfd-7627-4044-9ec7-49467a7d92cb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:52.361308 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-fce031e4-eef1-42f8-9773-dafa2f763803 req-5e2a0bfd-7627-4044-9ec7-49467a7d92cb service nova] Creating event network-vif-deleted:dd23e2dc-da6a-4c82-92a8-c32b30b75f06 for instance aadfd70b-cacd-4483-9974-3190f70167c9 on nch1-master-1 Mar 05 21:09:52.373103 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-fce031e4-eef1-42f8-9773-dafa2f763803 req-5e2a0bfd-7627-4044-9ec7-49467a7d92cb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066366 Mar 05 21:09:52.374128 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2317/4644] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:09:52.544807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c0aa27cd-d5a1-434d-99c5-759f6b3d9fdc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:52.555055 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c0aa27cd-d5a1-434d-99c5-759f6b3d9fdc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.894964 Mar 05 21:09:52.556424 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2328/4645] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:51 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:52.580658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-edb88260-f04f-4304-87d9-d4c5cdb9b140 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:52.595083 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-edb88260-f04f-4304-87d9-d4c5cdb9b140 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 9608f204-0c52-40ac-b0aa-30cf936cf7a4 has no mapping to a cell. Mar 05 21:09:52.596228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-edb88260-f04f-4304-87d9-d4c5cdb9b140 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 9608f204-0c52-40ac-b0aa-30cf936cf7a4 has no mapping to a cell. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:09:52.599663 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-edb88260-f04f-4304-87d9-d4c5cdb9b140 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9608f204-0c52-40ac-b0aa-30cf936cf7a4/action" status: 404 len: 117 microversion: 2.1 time: 0.030721 Mar 05 21:09:52.602066 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2318/4646] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:09:52 2022] POST /compute/v2.1/servers/9608f204-0c52-40ac-b0aa-30cf936cf7a4/action => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:09:52.613373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b8d30e81-1e57-4a42-aa40-a9fa77e1587b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:52.614835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b8d30e81-1e57-4a42-aa40-a9fa77e1587b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:52.626861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8d30e81-1e57-4a42-aa40-a9fa77e1587b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:52.631242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8d30e81-1e57-4a42-aa40-a9fa77e1587b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:52.632165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8d30e81-1e57-4a42-aa40-a9fa77e1587b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:52.632626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8d30e81-1e57-4a42-aa40-a9fa77e1587b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:53.081529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b8d30e81-1e57-4a42-aa40-a9fa77e1587b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:53.091992 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b8d30e81-1e57-4a42-aa40-a9fa77e1587b tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.485655 Mar 05 21:09:53.104275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ab3ee311-f0da-46aa-8064-4fe63fde5721 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:53.105044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ab3ee311-f0da-46aa-8064-4fe63fde5721 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: aadfd70b-cacd-4483-9974-3190f70167c9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:53.109516 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2329/4647] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:52 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:53.115502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f2cd59c9-23c1-4f43-a154-726233002bfc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:53.116493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f2cd59c9-23c1-4f43-a154-726233002bfc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:53.118026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab3ee311-f0da-46aa-8064-4fe63fde5721 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:53.120477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab3ee311-f0da-46aa-8064-4fe63fde5721 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:53.121480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab3ee311-f0da-46aa-8064-4fe63fde5721 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:53.125688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2cd59c9-23c1-4f43-a154-726233002bfc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:53.126549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2cd59c9-23c1-4f43-a154-726233002bfc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:53.127578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2cd59c9-23c1-4f43-a154-726233002bfc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:53.127919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab3ee311-f0da-46aa-8064-4fe63fde5721 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:53.128503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2cd59c9-23c1-4f43-a154-726233002bfc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:53.162782 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-ab3ee311-f0da-46aa-8064-4fe63fde5721 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] HTTP exception thrown: Instance aadfd70b-cacd-4483-9974-3190f70167c9 could not be found. Mar 05 21:09:53.163518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ab3ee311-f0da-46aa-8064-4fe63fde5721 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Returning 404 to user: Instance aadfd70b-cacd-4483-9974-3190f70167c9 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:09:53.165037 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ab3ee311-f0da-46aa-8064-4fe63fde5721 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9" status: 404 len: 111 microversion: 2.1 time: 0.065951 Mar 05 21:09:53.169584 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2319/4648] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:53 2022] GET /compute/v2.1/servers/aadfd70b-cacd-4483-9974-3190f70167c9 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:09:53.176068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a7ecb915-9621-4e3b-b41c-b7b09d0357f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:53.176699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a7ecb915-9621-4e3b-b41c-b7b09d0357f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:53.185372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7ecb915-9621-4e3b-b41c-b7b09d0357f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:53.185997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7ecb915-9621-4e3b-b41c-b7b09d0357f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:53.188388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7ecb915-9621-4e3b-b41c-b7b09d0357f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:53.188850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7ecb915-9621-4e3b-b41c-b7b09d0357f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:53.217170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a7ecb915-9621-4e3b-b41c-b7b09d0357f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:09:53.398178 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a7ecb915-9621-4e3b-b41c-b7b09d0357f9 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 204 len: 0 microversion: 2.1 time: 0.226581 Mar 05 21:09:53.401098 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2320/4649] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:09:53 2022] DELETE /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:09:53.417368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cf612f61-1c2b-493c-9791-13950a2c3c16 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:53.418313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cf612f61-1c2b-493c-9791-13950a2c3c16 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:53.427545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf612f61-1c2b-493c-9791-13950a2c3c16 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:53.428139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf612f61-1c2b-493c-9791-13950a2c3c16 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:53.429065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf612f61-1c2b-493c-9791-13950a2c3c16 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:53.429569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf612f61-1c2b-493c-9791-13950a2c3c16 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:53.592247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f2cd59c9-23c1-4f43-a154-726233002bfc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:53.601946 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f2cd59c9-23c1-4f43-a154-726233002bfc tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.490978 Mar 05 21:09:53.608643 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2330/4650] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:53 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:53.634168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ce64b421-f957-4d76-9623-e2f2cd940d99 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:53.635190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ce64b421-f957-4d76-9623-e2f2cd940d99 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 189adea1-d363-4789-8ab6-7a0cef5491f9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:53.652651 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-ce64b421-f957-4d76-9623-e2f2cd940d99 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 189adea1-d363-4789-8ab6-7a0cef5491f9 could not be found. Mar 05 21:09:53.653570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ce64b421-f957-4d76-9623-e2f2cd940d99 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 189adea1-d363-4789-8ab6-7a0cef5491f9 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:09:53.657509 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ce64b421-f957-4d76-9623-e2f2cd940d99 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/189adea1-d363-4789-8ab6-7a0cef5491f9/action" status: 404 len: 111 microversion: 2.1 time: 0.032415 Mar 05 21:09:53.669892 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2331/4651] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:09:53 2022] POST /compute/v2.1/servers/189adea1-d363-4789-8ab6-7a0cef5491f9/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:09:53.693964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9fb6f89c-ab03-4951-bd63-48fcbf85a212 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:53.694832 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9fb6f89c-ab03-4951-bd63-48fcbf85a212 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:53.704531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fb6f89c-ab03-4951-bd63-48fcbf85a212 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:53.705219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fb6f89c-ab03-4951-bd63-48fcbf85a212 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:53.706807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fb6f89c-ab03-4951-bd63-48fcbf85a212 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:53.707582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fb6f89c-ab03-4951-bd63-48fcbf85a212 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:53.828820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cf612f61-1c2b-493c-9791-13950a2c3c16 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:53.841283 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cf612f61-1c2b-493c-9791-13950a2c3c16 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1508 microversion: 2.1 time: 0.432439 Mar 05 21:09:53.844592 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2321/4652] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:53 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:54.238097 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9fb6f89c-ab03-4951-bd63-48fcbf85a212 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:54.262772 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9fb6f89c-ab03-4951-bd63-48fcbf85a212 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.580982 Mar 05 21:09:54.268789 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2332/4653] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:53 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:54.295309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9457d62f-a0f7-4504-a31f-6ae57aadda43 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:54.296118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9457d62f-a0f7-4504-a31f-6ae57aadda43 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:54.308136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9457d62f-a0f7-4504-a31f-6ae57aadda43 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:54.308854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9457d62f-a0f7-4504-a31f-6ae57aadda43 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:54.310114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9457d62f-a0f7-4504-a31f-6ae57aadda43 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:54.310675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9457d62f-a0f7-4504-a31f-6ae57aadda43 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:54.795462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9457d62f-a0f7-4504-a31f-6ae57aadda43 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:54.811269 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9457d62f-a0f7-4504-a31f-6ae57aadda43 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.522764 Mar 05 21:09:54.814090 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2322/4654] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:54 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:54.835898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e4abd82b-84a1-412d-931a-8445e34d7a15 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:54.838042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e4abd82b-84a1-412d-931a-8445e34d7a15 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:54.867358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4abd82b-84a1-412d-931a-8445e34d7a15 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:54.868109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4abd82b-84a1-412d-931a-8445e34d7a15 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:54.869132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4abd82b-84a1-412d-931a-8445e34d7a15 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:54.869735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4abd82b-84a1-412d-931a-8445e34d7a15 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:54.874344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-17604908-dc27-42bc-a32c-c1d1e6dfe352 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:54.891993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-17604908-dc27-42bc-a32c-c1d1e6dfe352 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:54.901877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-17604908-dc27-42bc-a32c-c1d1e6dfe352 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:54.902884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-17604908-dc27-42bc-a32c-c1d1e6dfe352 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:54.912811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-17604908-dc27-42bc-a32c-c1d1e6dfe352 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:54.913682 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-17604908-dc27-42bc-a32c-c1d1e6dfe352 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:54.969084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-e4abd82b-84a1-412d-931a-8445e34d7a15 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lazy-loading 'flavor' on Instance uuid 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:09:55.117225 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e4abd82b-84a1-412d-931a-8445e34d7a15 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action" status: 202 len: 0 microversion: 2.1 time: 0.289586 Mar 05 21:09:55.118104 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2333/4655] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:09:54 2022] POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:09:55.135427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-005ccc59-cf98-4652-a257-9c3acb5864a2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:55.136378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-005ccc59-cf98-4652-a257-9c3acb5864a2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:55.144310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-005ccc59-cf98-4652-a257-9c3acb5864a2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:55.145019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-005ccc59-cf98-4652-a257-9c3acb5864a2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:55.146133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-005ccc59-cf98-4652-a257-9c3acb5864a2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:55.146732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-005ccc59-cf98-4652-a257-9c3acb5864a2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:55.412860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-17604908-dc27-42bc-a32c-c1d1e6dfe352 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:55.423687 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-17604908-dc27-42bc-a32c-c1d1e6dfe352 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1508 microversion: 2.1 time: 0.565035 Mar 05 21:09:55.425265 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2323/4656] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:54 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1508 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:55.820145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-005ccc59-cf98-4652-a257-9c3acb5864a2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:55.843391 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-005ccc59-cf98-4652-a257-9c3acb5864a2 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1513 microversion: 2.1 time: 0.720126 Mar 05 21:09:55.844759 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2334/4657] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:55 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1513 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:56.446566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-011ea894-49da-400d-b314-747c14d0fa96 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:56.448033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-011ea894-49da-400d-b314-747c14d0fa96 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:56.457626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-011ea894-49da-400d-b314-747c14d0fa96 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:56.458379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-011ea894-49da-400d-b314-747c14d0fa96 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:56.459384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-011ea894-49da-400d-b314-747c14d0fa96 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:56.460048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-011ea894-49da-400d-b314-747c14d0fa96 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:56.869862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-095d4a93-ffc5-4d13-82b1-58642de62d27 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:56.871876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-095d4a93-ffc5-4d13-82b1-58642de62d27 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:56.895375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-095d4a93-ffc5-4d13-82b1-58642de62d27 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:56.898848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-095d4a93-ffc5-4d13-82b1-58642de62d27 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:56.900044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-095d4a93-ffc5-4d13-82b1-58642de62d27 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:56.900761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-095d4a93-ffc5-4d13-82b1-58642de62d27 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:57.459411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-011ea894-49da-400d-b314-747c14d0fa96 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:57.472274 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-011ea894-49da-400d-b314-747c14d0fa96 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 200 len: 1508 microversion: 2.1 time: 1.031828 Mar 05 21:09:57.485063 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2324/4658] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:56 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 1508 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:57.490221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-ab5caa51-4ada-4377-a91c-2ac5045012b0 req-4c32685d-dca7-4a82-b3cd-29b6407e375e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df", "name": "network-vif-deleted", "tag": "4c91a561-c474-4d92-b44b-1cbcce180e5e"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:57.507863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ab5caa51-4ada-4377-a91c-2ac5045012b0 req-4c32685d-dca7-4a82-b3cd-29b6407e375e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:57.508476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ab5caa51-4ada-4377-a91c-2ac5045012b0 req-4c32685d-dca7-4a82-b3cd-29b6407e375e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:57.537471 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ab5caa51-4ada-4377-a91c-2ac5045012b0 req-4c32685d-dca7-4a82-b3cd-29b6407e375e service nova] Creating event network-vif-deleted:4c91a561-c474-4d92-b44b-1cbcce180e5e for instance ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df on nch1-master-1 Mar 05 21:09:57.544389 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-ab5caa51-4ada-4377-a91c-2ac5045012b0 req-4c32685d-dca7-4a82-b3cd-29b6407e375e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057695 Mar 05 21:09:57.545575 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2325/4659] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:09:57.793841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-095d4a93-ffc5-4d13-82b1-58642de62d27 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:57.807763 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-095d4a93-ffc5-4d13-82b1-58642de62d27 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1496 microversion: 2.1 time: 0.948920 Mar 05 21:09:57.808830 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2335/4660] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:56 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1496 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:09:57.829411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3491288a-3580-415c-a6a5-54be81908e73 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:57.830399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3491288a-3580-415c-a6a5-54be81908e73 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:57.838478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3491288a-3580-415c-a6a5-54be81908e73 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:57.839303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3491288a-3580-415c-a6a5-54be81908e73 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:57.840354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3491288a-3580-415c-a6a5-54be81908e73 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:57.841061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3491288a-3580-415c-a6a5-54be81908e73 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:57.870647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-3491288a-3580-415c-a6a5-54be81908e73 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lazy-loading 'flavor' on Instance uuid 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:09:57.886334 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-3491288a-3580-415c-a6a5-54be81908e73 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Cannot 'suspend' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state suspended Mar 05 21:09:57.887826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3491288a-3580-415c-a6a5-54be81908e73 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 409 to user: Cannot 'suspend' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state suspended {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:09:57.888938 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3491288a-3580-415c-a6a5-54be81908e73 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action" status: 409 len: 148 microversion: 2.1 time: 0.065752 Mar 05 21:09:57.894675 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2326/4661] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:09:57 2022] POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action => generated 148 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 05 21:09:57.902710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-18abd34d-3c7f-44d1-91aa-83e61291d7a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:09:57.904054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-18abd34d-3c7f-44d1-91aa-83e61291d7a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:57.915623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18abd34d-3c7f-44d1-91aa-83e61291d7a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:57.916456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18abd34d-3c7f-44d1-91aa-83e61291d7a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:57.917456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18abd34d-3c7f-44d1-91aa-83e61291d7a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:57.918203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18abd34d-3c7f-44d1-91aa-83e61291d7a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:58.019165 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-18abd34d-3c7f-44d1-91aa-83e61291d7a7 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action" status: 202 len: 0 microversion: 2.1 time: 0.120887 Mar 05 21:09:58.024107 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2336/4662] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:09:57 2022] POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:09:58.029258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1882efb5-7438-4c02-bc8d-1c8dcee3292a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:58.029806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1882efb5-7438-4c02-bc8d-1c8dcee3292a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:58.043584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1882efb5-7438-4c02-bc8d-1c8dcee3292a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:58.047789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1882efb5-7438-4c02-bc8d-1c8dcee3292a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:58.048687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1882efb5-7438-4c02-bc8d-1c8dcee3292a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:58.049312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1882efb5-7438-4c02-bc8d-1c8dcee3292a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:58.494716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af79fe89-117f-47f2-829c-4e564662a80c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:58.496349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-af79fe89-117f-47f2-829c-4e564662a80c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:58.518358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af79fe89-117f-47f2-829c-4e564662a80c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:58.519145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af79fe89-117f-47f2-829c-4e564662a80c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:58.520743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af79fe89-117f-47f2-829c-4e564662a80c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:58.521199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af79fe89-117f-47f2-829c-4e564662a80c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:58.563755 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-af79fe89-117f-47f2-829c-4e564662a80c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] HTTP exception thrown: Instance ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df could not be found. Mar 05 21:09:58.569726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af79fe89-117f-47f2-829c-4e564662a80c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Returning 404 to user: Instance ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:09:58.572499 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-af79fe89-117f-47f2-829c-4e564662a80c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df" status: 404 len: 111 microversion: 2.1 time: 0.084921 Mar 05 21:09:58.575857 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2337/4663] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:58 2022] GET /compute/v2.1/servers/ecb2c0c3-03a0-4b2f-a2b8-d4dd54ad69df => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:09:58.608256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8cb65d15-fdc8-41d1-a804-1dee8dd1ee0c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:58.609016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8cb65d15-fdc8-41d1-a804-1dee8dd1ee0c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:58.634339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cb65d15-fdc8-41d1-a804-1dee8dd1ee0c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:58.638789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cb65d15-fdc8-41d1-a804-1dee8dd1ee0c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:58.640753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cb65d15-fdc8-41d1-a804-1dee8dd1ee0c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:58.641782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8cb65d15-fdc8-41d1-a804-1dee8dd1ee0c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:58.721462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8cb65d15-fdc8-41d1-a804-1dee8dd1ee0c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:09:58.866537 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8cb65d15-fdc8-41d1-a804-1dee8dd1ee0c tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 204 len: 0 microversion: 2.1 time: 0.286235 Mar 05 21:09:58.867137 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2338/4664] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:09:58 2022] DELETE /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:09:58.879077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-03d8cca7-3200-44a5-a902-e5d4491737f0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:09:58.880731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-03d8cca7-3200-44a5-a902-e5d4491737f0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:09:58.888655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03d8cca7-3200-44a5-a902-e5d4491737f0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:58.889164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03d8cca7-3200-44a5-a902-e5d4491737f0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:58.891199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03d8cca7-3200-44a5-a902-e5d4491737f0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:09:58.891938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03d8cca7-3200-44a5-a902-e5d4491737f0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:09:59.022925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1882efb5-7438-4c02-bc8d-1c8dcee3292a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:09:59.037740 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1882efb5-7438-4c02-bc8d-1c8dcee3292a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1502 microversion: 2.1 time: 1.012696 Mar 05 21:09:59.040047 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2327/4665] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:58 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1502 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:00.020610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-03d8cca7-3200-44a5-a902-e5d4491737f0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:00.033341 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-03d8cca7-3200-44a5-a902-e5d4491737f0 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1494 microversion: 2.1 time: 1.160285 Mar 05 21:10:00.034643 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2339/4666] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:09:58 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1494 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:10:00.060209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a69e5b49-b888-448c-aa60-517a7894e626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:00.062610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a69e5b49-b888-448c-aa60-517a7894e626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:00.082938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a69e5b49-b888-448c-aa60-517a7894e626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:00.083775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a69e5b49-b888-448c-aa60-517a7894e626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:00.084608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a69e5b49-b888-448c-aa60-517a7894e626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:00.085538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a69e5b49-b888-448c-aa60-517a7894e626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:00.620534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-3c68a45a-ccbe-4a8c-8e74-0b1402ac4f4b req-20ccad04-b7ba-4c64-ad13-904a04a9765c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b396188c-9bd6-472d-ae9d-86ea8b66a01c", "name": "network-vif-deleted", "tag": "67768743-b786-49b6-9794-7c55e5d612f7"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:00.634851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3c68a45a-ccbe-4a8c-8e74-0b1402ac4f4b req-20ccad04-b7ba-4c64-ad13-904a04a9765c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:00.636163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3c68a45a-ccbe-4a8c-8e74-0b1402ac4f4b req-20ccad04-b7ba-4c64-ad13-904a04a9765c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:00.658668 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-3c68a45a-ccbe-4a8c-8e74-0b1402ac4f4b req-20ccad04-b7ba-4c64-ad13-904a04a9765c service nova] Creating event network-vif-deleted:67768743-b786-49b6-9794-7c55e5d612f7 for instance b396188c-9bd6-472d-ae9d-86ea8b66a01c on nch2-master-1 Mar 05 21:10:00.668737 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-3c68a45a-ccbe-4a8c-8e74-0b1402ac4f4b req-20ccad04-b7ba-4c64-ad13-904a04a9765c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058519 Mar 05 21:10:00.670172 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2340/4667] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:10:01.051853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ba33b0a9-6edd-4474-b990-0be06ce14342 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:01.053535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ba33b0a9-6edd-4474-b990-0be06ce14342 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:01.064082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba33b0a9-6edd-4474-b990-0be06ce14342 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:01.065007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba33b0a9-6edd-4474-b990-0be06ce14342 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:01.066141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba33b0a9-6edd-4474-b990-0be06ce14342 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:01.066802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba33b0a9-6edd-4474-b990-0be06ce14342 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:01.153827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba33b0a9-6edd-4474-b990-0be06ce14342 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:01.156787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba33b0a9-6edd-4474-b990-0be06ce14342 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:01.159238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-ba33b0a9-6edd-4474-b990-0be06ce14342 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lazy-loading 'fault' on Instance uuid b396188c-9bd6-472d-ae9d-86ea8b66a01c {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:10:01.270053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ba33b0a9-6edd-4474-b990-0be06ce14342 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:01.278943 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ba33b0a9-6edd-4474-b990-0be06ce14342 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 200 len: 1305 microversion: 2.1 time: 0.232052 Mar 05 21:10:01.298481 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2341/4668] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:01 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 1305 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:10:01.448174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a69e5b49-b888-448c-aa60-517a7894e626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:01.460881 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a69e5b49-b888-448c-aa60-517a7894e626 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1502 microversion: 2.1 time: 1.406560 Mar 05 21:10:01.473917 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2328/4669] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:00 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1502 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:02.306003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bd0d624c-0d50-4936-809c-612fb389bb87 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:02.307560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bd0d624c-0d50-4936-809c-612fb389bb87 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: b396188c-9bd6-472d-ae9d-86ea8b66a01c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:02.323502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bd0d624c-0d50-4936-809c-612fb389bb87 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:02.323997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bd0d624c-0d50-4936-809c-612fb389bb87 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:02.328849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bd0d624c-0d50-4936-809c-612fb389bb87 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:02.329558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bd0d624c-0d50-4936-809c-612fb389bb87 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:02.361473 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-bd0d624c-0d50-4936-809c-612fb389bb87 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] HTTP exception thrown: Instance b396188c-9bd6-472d-ae9d-86ea8b66a01c could not be found. Mar 05 21:10:02.362766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bd0d624c-0d50-4936-809c-612fb389bb87 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Returning 404 to user: Instance b396188c-9bd6-472d-ae9d-86ea8b66a01c could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:02.364708 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bd0d624c-0d50-4936-809c-612fb389bb87 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c" status: 404 len: 111 microversion: 2.1 time: 0.062496 Mar 05 21:10:02.365721 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2342/4670] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:02 2022] GET /compute/v2.1/servers/b396188c-9bd6-472d-ae9d-86ea8b66a01c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:10:02.375820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7109b652-a792-4c1a-8cf0-0dcf1fe7b109 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:02.376317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7109b652-a792-4c1a-8cf0-0dcf1fe7b109 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:02.388444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7109b652-a792-4c1a-8cf0-0dcf1fe7b109 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:02.392794 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7109b652-a792-4c1a-8cf0-0dcf1fe7b109 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:02.394800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7109b652-a792-4c1a-8cf0-0dcf1fe7b109 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:02.396498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7109b652-a792-4c1a-8cf0-0dcf1fe7b109 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:02.432792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7109b652-a792-4c1a-8cf0-0dcf1fe7b109 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:10:02.484410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5c83b160-c0e0-46f1-81bb-00ba49d1873e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:02.485336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5c83b160-c0e0-46f1-81bb-00ba49d1873e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:02.497460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c83b160-c0e0-46f1-81bb-00ba49d1873e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:02.499435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c83b160-c0e0-46f1-81bb-00ba49d1873e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:02.502516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c83b160-c0e0-46f1-81bb-00ba49d1873e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:02.504610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c83b160-c0e0-46f1-81bb-00ba49d1873e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:02.643322 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7109b652-a792-4c1a-8cf0-0dcf1fe7b109 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 204 len: 0 microversion: 2.1 time: 0.271511 Mar 05 21:10:02.648465 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2329/4671] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:10:02 2022] DELETE /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:10:02.658268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-794e92e2-f2d2-4d0a-850e-97f81ef0a78b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:02.659633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-794e92e2-f2d2-4d0a-850e-97f81ef0a78b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:02.667866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-794e92e2-f2d2-4d0a-850e-97f81ef0a78b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:02.668801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-794e92e2-f2d2-4d0a-850e-97f81ef0a78b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:02.670002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-794e92e2-f2d2-4d0a-850e-97f81ef0a78b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:02.671232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-794e92e2-f2d2-4d0a-850e-97f81ef0a78b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:03.159619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5c83b160-c0e0-46f1-81bb-00ba49d1873e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:03.167866 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5c83b160-c0e0-46f1-81bb-00ba49d1873e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.688366 Mar 05 21:10:03.168422 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2343/4672] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:02 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:03.201948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-add9def0-ab83-4975-9670-868b3fd878fb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:03.202823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-add9def0-ab83-4975-9670-868b3fd878fb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:03.218384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-add9def0-ab83-4975-9670-868b3fd878fb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:03.222256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-add9def0-ab83-4975-9670-868b3fd878fb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:03.225424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-add9def0-ab83-4975-9670-868b3fd878fb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:03.226707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-add9def0-ab83-4975-9670-868b3fd878fb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:03.369650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-794e92e2-f2d2-4d0a-850e-97f81ef0a78b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:03.389141 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-794e92e2-f2d2-4d0a-850e-97f81ef0a78b tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1675 microversion: 2.1 time: 0.737148 Mar 05 21:10:03.390679 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2330/4673] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:02 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1675 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:03.774814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-add9def0-ab83-4975-9670-868b3fd878fb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:03.789812 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-add9def0-ab83-4975-9670-868b3fd878fb tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.600450 Mar 05 21:10:03.790762 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2344/4674] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:03 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:10:03.814010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-575b4c9a-5a8c-4e73-924b-391f33a5cf80 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:03.815766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-575b4c9a-5a8c-4e73-924b-391f33a5cf80 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: c818ca90-26a4-4429-8216-8ccadba9ea09] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:03.827648 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-575b4c9a-5a8c-4e73-924b-391f33a5cf80 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance c818ca90-26a4-4429-8216-8ccadba9ea09 could not be found. Mar 05 21:10:03.828703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-575b4c9a-5a8c-4e73-924b-391f33a5cf80 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance c818ca90-26a4-4429-8216-8ccadba9ea09 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:03.829825 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-575b4c9a-5a8c-4e73-924b-391f33a5cf80 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/c818ca90-26a4-4429-8216-8ccadba9ea09/action" status: 404 len: 111 microversion: 2.1 time: 0.026556 Mar 05 21:10:03.834062 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2331/4675] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:10:03 2022] POST /compute/v2.1/servers/c818ca90-26a4-4429-8216-8ccadba9ea09/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:10:03.841151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0871913-bfa9-4306-8787-13c036856ee0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:03.841797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a0871913-bfa9-4306-8787-13c036856ee0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:03.854885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0871913-bfa9-4306-8787-13c036856ee0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:03.855703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0871913-bfa9-4306-8787-13c036856ee0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:03.856900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0871913-bfa9-4306-8787-13c036856ee0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:03.857735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0871913-bfa9-4306-8787-13c036856ee0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:04.409971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bfe1de98-b8d0-41bb-9a56-213b44227aa1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:04.410893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bfe1de98-b8d0-41bb-9a56-213b44227aa1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:04.424972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfe1de98-b8d0-41bb-9a56-213b44227aa1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:04.428218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfe1de98-b8d0-41bb-9a56-213b44227aa1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:04.429069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfe1de98-b8d0-41bb-9a56-213b44227aa1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:04.429526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfe1de98-b8d0-41bb-9a56-213b44227aa1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:04.449745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a0871913-bfa9-4306-8787-13c036856ee0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:04.460096 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0871913-bfa9-4306-8787-13c036856ee0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.623722 Mar 05 21:10:04.470716 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2345/4676] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:03 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:04.482714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-44c0a1aa-88c1-4f87-a95f-b171c63a58e6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:04.483662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-44c0a1aa-88c1-4f87-a95f-b171c63a58e6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:04.500690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44c0a1aa-88c1-4f87-a95f-b171c63a58e6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:04.501514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44c0a1aa-88c1-4f87-a95f-b171c63a58e6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:04.502308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44c0a1aa-88c1-4f87-a95f-b171c63a58e6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:04.502749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44c0a1aa-88c1-4f87-a95f-b171c63a58e6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:04.932289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bfe1de98-b8d0-41bb-9a56-213b44227aa1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:04.945381 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bfe1de98-b8d0-41bb-9a56-213b44227aa1 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1675 microversion: 2.1 time: 0.537771 Mar 05 21:10:04.946031 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2332/4677] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:04 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1675 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:10:05.728393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-44c0a1aa-88c1-4f87-a95f-b171c63a58e6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:05.740242 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-44c0a1aa-88c1-4f87-a95f-b171c63a58e6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.261882 Mar 05 21:10:05.741476 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2346/4678] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:04 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:05.764193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd1fac10-ee73-4c8d-b368-03148e5f361a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:05.766305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd1fac10-ee73-4c8d-b368-03148e5f361a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:05.779603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1fac10-ee73-4c8d-b368-03148e5f361a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:05.781779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1fac10-ee73-4c8d-b368-03148e5f361a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:05.784819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1fac10-ee73-4c8d-b368-03148e5f361a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:05.787784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1fac10-ee73-4c8d-b368-03148e5f361a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:05.919602 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-fd1fac10-ee73-4c8d-b368-03148e5f361a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Cannot 'unpause' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state active Mar 05 21:10:05.924556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd1fac10-ee73-4c8d-b368-03148e5f361a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 409 to user: Cannot 'unpause' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state active {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:05.928551 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd1fac10-ee73-4c8d-b368-03148e5f361a tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action" status: 409 len: 145 microversion: 2.1 time: 0.170458 Mar 05 21:10:05.929899 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2333/4679] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:10:05 2022] POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action => generated 145 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:10:05.946412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0c4600cf-a358-407b-aea1-eabfb43ab286 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:05.950276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0c4600cf-a358-407b-aea1-eabfb43ab286 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:05.963811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-31531ce9-26de-4b0c-b7f8-cec96fc68b5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:05.965027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-31531ce9-26de-4b0c-b7f8-cec96fc68b5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:05.980739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c4600cf-a358-407b-aea1-eabfb43ab286 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:05.980982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31531ce9-26de-4b0c-b7f8-cec96fc68b5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:05.981419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c4600cf-a358-407b-aea1-eabfb43ab286 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:05.982244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c4600cf-a358-407b-aea1-eabfb43ab286 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:05.982699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c4600cf-a358-407b-aea1-eabfb43ab286 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:05.982944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31531ce9-26de-4b0c-b7f8-cec96fc68b5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:05.984605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31531ce9-26de-4b0c-b7f8-cec96fc68b5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:05.992598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31531ce9-26de-4b0c-b7f8-cec96fc68b5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:06.927291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0c4600cf-a358-407b-aea1-eabfb43ab286 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:06.938255 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0c4600cf-a358-407b-aea1-eabfb43ab286 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.001452 Mar 05 21:10:06.938901 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2347/4680] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:05 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:07.115147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-31531ce9-26de-4b0c-b7f8-cec96fc68b5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:07.130223 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-31531ce9-26de-4b0c-b7f8-cec96fc68b5a tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1675 microversion: 2.1 time: 1.170649 Mar 05 21:10:07.133162 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2334/4681] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:05 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1675 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:07.144601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-674205ae-2cac-4a52-8eb6-08a801d7582c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:07.145661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-674205ae-2cac-4a52-8eb6-08a801d7582c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:07.168653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-674205ae-2cac-4a52-8eb6-08a801d7582c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:07.179031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-674205ae-2cac-4a52-8eb6-08a801d7582c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:07.180133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-674205ae-2cac-4a52-8eb6-08a801d7582c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:07.180755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-674205ae-2cac-4a52-8eb6-08a801d7582c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:07.277173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-500040446", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "d529dc2d-7d4d-42cb-82ed-f2655cb4cb24"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:07.361636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] validate_networks() for [('d529dc2d-7d4d-42cb-82ed-f2655cb4cb24', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:10:07.636225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-674205ae-2cac-4a52-8eb6-08a801d7582c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:07.649096 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-674205ae-2cac-4a52-8eb6-08a801d7582c tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.514378 Mar 05 21:10:07.650204 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2335/4682] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:07 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:07.669366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4706d641-e7aa-40d8-9a26-3641e6e87b3e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:07.671914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4706d641-e7aa-40d8-9a26-3641e6e87b3e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: bf76fb5f-8c13-4172-b562-676801677d8a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:07.692424 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4706d641-e7aa-40d8-9a26-3641e6e87b3e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance bf76fb5f-8c13-4172-b562-676801677d8a could not be found. Mar 05 21:10:07.693340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4706d641-e7aa-40d8-9a26-3641e6e87b3e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance bf76fb5f-8c13-4172-b562-676801677d8a could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:07.697332 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4706d641-e7aa-40d8-9a26-3641e6e87b3e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/bf76fb5f-8c13-4172-b562-676801677d8a/action" status: 404 len: 111 microversion: 2.1 time: 0.033725 Mar 05 21:10:07.698116 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2336/4683] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:10:07 2022] POST /compute/v2.1/servers/bf76fb5f-8c13-4172-b562-676801677d8a/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:10:07.714392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bdaa341d-783c-4f28-a477-b1043bed72ac tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:07.719384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bdaa341d-783c-4f28-a477-b1043bed72ac tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:07.741700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bdaa341d-783c-4f28-a477-b1043bed72ac tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:07.744654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bdaa341d-783c-4f28-a477-b1043bed72ac tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:07.746186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bdaa341d-783c-4f28-a477-b1043bed72ac tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:07.748105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bdaa341d-783c-4f28-a477-b1043bed72ac tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:08.595603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bdaa341d-783c-4f28-a477-b1043bed72ac tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:08.605292 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bdaa341d-783c-4f28-a477-b1043bed72ac tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.902164 Mar 05 21:10:08.609016 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2337/4684] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:07 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:10:08.618858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1245094c-f8d2-4b58-9c87-e8f3258ba45d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:08.622819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1245094c-f8d2-4b58-9c87-e8f3258ba45d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:08.637715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1245094c-f8d2-4b58-9c87-e8f3258ba45d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:08.643313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1245094c-f8d2-4b58-9c87-e8f3258ba45d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:08.645406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1245094c-f8d2-4b58-9c87-e8f3258ba45d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:08.647638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1245094c-f8d2-4b58-9c87-e8f3258ba45d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:08.891033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1245094c-f8d2-4b58-9c87-e8f3258ba45d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2421fee8afc47ea822c5df54a095261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7fc33099aa4a2a9d459a269ac2e82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:08.908965 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1245094c-f8d2-4b58-9c87-e8f3258ba45d tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 200 len: 1608 microversion: 2.1 time: 0.295994 Mar 05 21:10:08.911909 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2338/4685] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:08 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 1608 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:08.919651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c6119ab-fd95-4e18-97a0-3546cc1b6768 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:08.920623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4c6119ab-fd95-4e18-97a0-3546cc1b6768 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:08.935908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c6119ab-fd95-4e18-97a0-3546cc1b6768 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:08.936494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c6119ab-fd95-4e18-97a0-3546cc1b6768 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:08.939253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c6119ab-fd95-4e18-97a0-3546cc1b6768 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:08.939741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c6119ab-fd95-4e18-97a0-3546cc1b6768 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:09.333768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4c6119ab-fd95-4e18-97a0-3546cc1b6768 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:09.343739 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4c6119ab-fd95-4e18-97a0-3546cc1b6768 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.430476 Mar 05 21:10:09.348629 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2339/4686] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:08 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:09.365916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-838108b0-c139-4ead-8d25-d1d250909716 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:09.366891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-838108b0-c139-4ead-8d25-d1d250909716 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:09.379492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-838108b0-c139-4ead-8d25-d1d250909716 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:09.385956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-838108b0-c139-4ead-8d25-d1d250909716 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:09.386927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-838108b0-c139-4ead-8d25-d1d250909716 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:09.387599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-838108b0-c139-4ead-8d25-d1d250909716 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:09.495542 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-838108b0-c139-4ead-8d25-d1d250909716 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Cannot 'unshelve' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state active Mar 05 21:10:09.496855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-838108b0-c139-4ead-8d25-d1d250909716 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 409 to user: Cannot 'unshelve' instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 while it is in vm_state active {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:09.497922 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-838108b0-c139-4ead-8d25-d1d250909716 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action" status: 409 len: 146 microversion: 2.1 time: 0.136577 Mar 05 21:10:09.502056 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2340/4687] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:10:09 2022] POST /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9/action => generated 146 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:10:09.508378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a0539206-8e76-4dcf-9e8d-9bbda57a8fd3 req-739bf4b8-66ea-471f-bcb8-76f8a482e9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc548a05-5226-41f0-a34d-1d44defee56c", "name": "network-vif-deleted", "tag": "30ad7984-3b01-4aac-9f3b-d69f10ea737a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:09.526414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a0539206-8e76-4dcf-9e8d-9bbda57a8fd3 req-739bf4b8-66ea-471f-bcb8-76f8a482e9bf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:09.527177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a0539206-8e76-4dcf-9e8d-9bbda57a8fd3 req-739bf4b8-66ea-471f-bcb8-76f8a482e9bf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:09.578182 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a0539206-8e76-4dcf-9e8d-9bbda57a8fd3 req-739bf4b8-66ea-471f-bcb8-76f8a482e9bf service nova] Creating event network-vif-deleted:30ad7984-3b01-4aac-9f3b-d69f10ea737a for instance dc548a05-5226-41f0-a34d-1d44defee56c on nch1-master-1 Mar 05 21:10:09.591772 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a0539206-8e76-4dcf-9e8d-9bbda57a8fd3 req-739bf4b8-66ea-471f-bcb8-76f8a482e9bf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087892 Mar 05 21:10:09.596462 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2341/4688] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:10:09.610246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a014d569-2464-42bc-8e97-a5be0d1702d6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:09.614652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a014d569-2464-42bc-8e97-a5be0d1702d6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:09.636310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a014d569-2464-42bc-8e97-a5be0d1702d6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:09.637288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a014d569-2464-42bc-8e97-a5be0d1702d6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:09.640031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a014d569-2464-42bc-8e97-a5be0d1702d6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:09.640808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a014d569-2464-42bc-8e97-a5be0d1702d6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:09.799198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:10:09.801756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:10:09.802594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:10:09.803429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:10:09.804177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:10:09.823067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:09.825319 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:09.826433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:09.829935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:09.880279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Getting quotas for project 6a8526bfe1734af7a05e8a6f22192cf0. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:10:09.925312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Getting quotas for user b805e2f2b9a94221af17f5c5f7778698 and project 6a8526bfe1734af7a05e8a6f22192cf0. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:10:09.959398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:10:09.970704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:10:10.094165 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-819ccf20-eb98-41da-8aad-196860c6356d tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.152967 Mar 05 21:10:10.102577 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2348/4689] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:10:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:10:10.114975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c318300-a6e7-424e-a89c-9ee83afa4402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:10.117150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3c318300-a6e7-424e-a89c-9ee83afa4402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] [instance: dc548a05-5226-41f0-a34d-1d44defee56c] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:10.133584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c318300-a6e7-424e-a89c-9ee83afa4402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:10.134133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c318300-a6e7-424e-a89c-9ee83afa4402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:10.143057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c318300-a6e7-424e-a89c-9ee83afa4402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:10.143971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c318300-a6e7-424e-a89c-9ee83afa4402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:10.177224 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-3c318300-a6e7-424e-a89c-9ee83afa4402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] HTTP exception thrown: Instance dc548a05-5226-41f0-a34d-1d44defee56c could not be found. Mar 05 21:10:10.180531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c318300-a6e7-424e-a89c-9ee83afa4402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Returning 404 to user: Instance dc548a05-5226-41f0-a34d-1d44defee56c could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:10.182037 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3c318300-a6e7-424e-a89c-9ee83afa4402 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c" status: 404 len: 111 microversion: 2.1 time: 0.078364 Mar 05 21:10:10.184060 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2349/4690] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:10 2022] GET /compute/v2.1/servers/dc548a05-5226-41f0-a34d-1d44defee56c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:10:10.193664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-430fc615-99ce-4a06-8061-6f91cfd7fcd0 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:10.200999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-430fc615-99ce-4a06-8061-6f91cfd7fcd0 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:10.332706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a014d569-2464-42bc-8e97-a5be0d1702d6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:10.356383 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a014d569-2464-42bc-8e97-a5be0d1702d6 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.756601 Mar 05 21:10:10.358359 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2342/4691] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:09 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:10.376152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-71fe4c78-e743-446a-891d-d7daefbba900 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] Calling method '.version_select at 0x7fed4ffaff70>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:10.423604 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-71fe4c78-e743-446a-891d-d7daefbba900 tempest-ServerActionsTestJSON-166095133 tempest-ServerActionsTestJSON-166095133-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507396363" status: 202 len: 0 microversion: 2.1 time: 0.062914 Mar 05 21:10:10.424299 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2343/4692] 10.222.0.15 () {58 vars in 1220 bytes} [Sat Mar 5 21:10:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507396363 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:10:10.437139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-47b2bb48-f516-4d32-b540-33cb2d45947e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:10.438063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-47b2bb48-f516-4d32-b540-33cb2d45947e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:10.451248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47b2bb48-f516-4d32-b540-33cb2d45947e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:10.453769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47b2bb48-f516-4d32-b540-33cb2d45947e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:10.458514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47b2bb48-f516-4d32-b540-33cb2d45947e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:10.460627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47b2bb48-f516-4d32-b540-33cb2d45947e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:10.461997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-430fc615-99ce-4a06-8061-6f91cfd7fcd0 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:10.475199 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-430fc615-99ce-4a06-8061-6f91cfd7fcd0 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1224 microversion: 2.1 time: 0.289238 Mar 05 21:10:10.492437 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2350/4693] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:10 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1224 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:11.243885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-47b2bb48-f516-4d32-b540-33cb2d45947e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:11.256886 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-47b2bb48-f516-4d32-b540-33cb2d45947e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.829973 Mar 05 21:10:11.259267 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2344/4694] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:10 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:11.278665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-57daee28-c2fa-46e8-8bf6-3e14d9a4ed96 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-658015171_updated"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:11.282341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-57daee28-c2fa-46e8-8bf6-3e14d9a4ed96 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 596ba1eb-8603-43bb-8531-61e31f8de3e5] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:11.297872 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-57daee28-c2fa-46e8-8bf6-3e14d9a4ed96 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 596ba1eb-8603-43bb-8531-61e31f8de3e5 could not be found. Mar 05 21:10:11.298497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-57daee28-c2fa-46e8-8bf6-3e14d9a4ed96 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 596ba1eb-8603-43bb-8531-61e31f8de3e5 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:11.300051 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-57daee28-c2fa-46e8-8bf6-3e14d9a4ed96 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "PUT /compute/v2.1/servers/596ba1eb-8603-43bb-8531-61e31f8de3e5" status: 404 len: 111 microversion: 2.1 time: 0.025429 Mar 05 21:10:11.301207 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2351/4695] 10.222.0.15 () {60 vars in 1255 bytes} [Sat Mar 5 21:10:11 2022] PUT /compute/v2.1/servers/596ba1eb-8603-43bb-8531-61e31f8de3e5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:10:11.310106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f86b8db3-c49c-4b8a-ad2c-e047d4d78a66 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:11.310746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f86b8db3-c49c-4b8a-ad2c-e047d4d78a66 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:11.325301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f86b8db3-c49c-4b8a-ad2c-e047d4d78a66 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:11.326279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f86b8db3-c49c-4b8a-ad2c-e047d4d78a66 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:11.328071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f86b8db3-c49c-4b8a-ad2c-e047d4d78a66 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:11.328757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f86b8db3-c49c-4b8a-ad2c-e047d4d78a66 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:11.499310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-02eba0ae-0114-4662-92f7-1fa9197e3461 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:11.500495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-02eba0ae-0114-4662-92f7-1fa9197e3461 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:11.514707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02eba0ae-0114-4662-92f7-1fa9197e3461 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:11.516159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02eba0ae-0114-4662-92f7-1fa9197e3461 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:11.518104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02eba0ae-0114-4662-92f7-1fa9197e3461 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:11.518971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02eba0ae-0114-4662-92f7-1fa9197e3461 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:11.678215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-02eba0ae-0114-4662-92f7-1fa9197e3461 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:11.696125 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-02eba0ae-0114-4662-92f7-1fa9197e3461 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1276 microversion: 2.1 time: 0.201526 Mar 05 21:10:11.707858 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2352/4696] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:11 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:10:12.654273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f86b8db3-c49c-4b8a-ad2c-e047d4d78a66 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:12.666888 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f86b8db3-c49c-4b8a-ad2c-e047d4d78a66 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.360970 Mar 05 21:10:12.667475 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2345/4697] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:11 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:12.685689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9c906c03-db3d-4299-8296-1b6f36094585 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:12.686810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9c906c03-db3d-4299-8296-1b6f36094585 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:12.693972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c906c03-db3d-4299-8296-1b6f36094585 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:12.694461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c906c03-db3d-4299-8296-1b6f36094585 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:12.695467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c906c03-db3d-4299-8296-1b6f36094585 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:12.695944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9c906c03-db3d-4299-8296-1b6f36094585 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:12.713887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c4b6603a-e075-4721-b260-1eb12f1ecf18 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:12.714743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c4b6603a-e075-4721-b260-1eb12f1ecf18 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:12.726081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4b6603a-e075-4721-b260-1eb12f1ecf18 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:12.726824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4b6603a-e075-4721-b260-1eb12f1ecf18 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:12.727683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4b6603a-e075-4721-b260-1eb12f1ecf18 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:12.729424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4b6603a-e075-4721-b260-1eb12f1ecf18 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:12.891729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c4b6603a-e075-4721-b260-1eb12f1ecf18 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:12.902266 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c4b6603a-e075-4721-b260-1eb12f1ecf18 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1282 microversion: 2.1 time: 0.192409 Mar 05 21:10:12.903457 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2346/4698] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:12 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1282 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:12.972216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9c906c03-db3d-4299-8296-1b6f36094585 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:12.982718 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9c906c03-db3d-4299-8296-1b6f36094585 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.301398 Mar 05 21:10:12.984825 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2353/4699] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:12 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:10:13.002805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-28e818e9-5514-4df4-9212-cf1f51f367f3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:13.005417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-28e818e9-5514-4df4-9212-cf1f51f367f3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:13.006548 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-28e818e9-5514-4df4-9212-cf1f51f367f3 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "PUT /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 400 len: 619 microversion: 2.1 time: 0.009763 Mar 05 21:10:13.008555 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2347/4700] 10.222.0.15 () {60 vars in 1256 bytes} [Sat Mar 5 21:10:12 2022] PUT /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:10:13.018530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d8aeacac-6a73-483b-aaaa-bc88a445be30 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:13.019810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d8aeacac-6a73-483b-aaaa-bc88a445be30 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:13.026761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8aeacac-6a73-483b-aaaa-bc88a445be30 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:13.027293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8aeacac-6a73-483b-aaaa-bc88a445be30 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:13.028198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8aeacac-6a73-483b-aaaa-bc88a445be30 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:13.028734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8aeacac-6a73-483b-aaaa-bc88a445be30 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:13.396282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d8aeacac-6a73-483b-aaaa-bc88a445be30 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:13.407624 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d8aeacac-6a73-483b-aaaa-bc88a445be30 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.394375 Mar 05 21:10:13.423317 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2354/4701] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:13 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:13.431706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9480ba75-ba9d-4570-afcf-7d291ec53f1f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:13.432627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9480ba75-ba9d-4570-afcf-7d291ec53f1f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:13.442564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9480ba75-ba9d-4570-afcf-7d291ec53f1f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:13.444331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9480ba75-ba9d-4570-afcf-7d291ec53f1f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:13.445148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9480ba75-ba9d-4570-afcf-7d291ec53f1f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:13.445613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9480ba75-ba9d-4570-afcf-7d291ec53f1f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:13.927125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8a86568f-2722-4258-b770-486c2d16d9c3 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:13.929258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8a86568f-2722-4258-b770-486c2d16d9c3 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:13.941070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a86568f-2722-4258-b770-486c2d16d9c3 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:13.941679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a86568f-2722-4258-b770-486c2d16d9c3 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:13.942712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a86568f-2722-4258-b770-486c2d16d9c3 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:13.944434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a86568f-2722-4258-b770-486c2d16d9c3 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:14.058190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8a86568f-2722-4258-b770-486c2d16d9c3 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:14.071335 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8a86568f-2722-4258-b770-486c2d16d9c3 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1282 microversion: 2.1 time: 0.153404 Mar 05 21:10:14.082715 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2355/4702] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:13 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1282 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:14.374072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9480ba75-ba9d-4570-afcf-7d291ec53f1f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:14.387496 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9480ba75-ba9d-4570-afcf-7d291ec53f1f tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 0.962242 Mar 05 21:10:14.387853 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2348/4703] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:13 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:14.412518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0771152b-cdbd-4849-a8e1-52db61ba26a0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:14.413839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0771152b-cdbd-4849-a8e1-52db61ba26a0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:14.414822 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0771152b-cdbd-4849-a8e1-52db61ba26a0 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "PUT /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 400 len: 108 microversion: 2.1 time: 0.007975 Mar 05 21:10:14.415784 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2356/4704] 10.222.0.15 () {60 vars in 1255 bytes} [Sat Mar 5 21:10:14 2022] PUT /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:10:14.424317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-50b804cd-eeee-45da-9a66-316d483a5586 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:14.425035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-50b804cd-eeee-45da-9a66-316d483a5586 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:14.438086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50b804cd-eeee-45da-9a66-316d483a5586 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:14.438554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50b804cd-eeee-45da-9a66-316d483a5586 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:14.439429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50b804cd-eeee-45da-9a66-316d483a5586 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:14.440078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50b804cd-eeee-45da-9a66-316d483a5586 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:15.091094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cfbed53b-b966-4bcc-824f-736e1c5d6f28 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:15.091738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cfbed53b-b966-4bcc-824f-736e1c5d6f28 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:15.103263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfbed53b-b966-4bcc-824f-736e1c5d6f28 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:15.103801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfbed53b-b966-4bcc-824f-736e1c5d6f28 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:15.104591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfbed53b-b966-4bcc-824f-736e1c5d6f28 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:15.105036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfbed53b-b966-4bcc-824f-736e1c5d6f28 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:15.697508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-50b804cd-eeee-45da-9a66-316d483a5586 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:15.711784 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-50b804cd-eeee-45da-9a66-316d483a5586 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1505 microversion: 2.1 time: 1.291774 Mar 05 21:10:15.713100 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2349/4705] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:14 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1505 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:15.994122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cfbed53b-b966-4bcc-824f-736e1c5d6f28 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:16.032068 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cfbed53b-b966-4bcc-824f-736e1c5d6f28 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1324 microversion: 2.1 time: 0.940995 Mar 05 21:10:16.034211 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2357/4706] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:15 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1324 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:17.056502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d903ed5d-2547-480c-b41c-5b9acbfd4337 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:17.058884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d903ed5d-2547-480c-b41c-5b9acbfd4337 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:17.072539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d903ed5d-2547-480c-b41c-5b9acbfd4337 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:17.074349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d903ed5d-2547-480c-b41c-5b9acbfd4337 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:17.075776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d903ed5d-2547-480c-b41c-5b9acbfd4337 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:17.076596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d903ed5d-2547-480c-b41c-5b9acbfd4337 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:17.509151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2d401b1e-57b2-4001-a602-cfa3b8adce24 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:17.509760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2d401b1e-57b2-4001-a602-cfa3b8adce24 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:17.526992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d401b1e-57b2-4001-a602-cfa3b8adce24 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:17.529976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d401b1e-57b2-4001-a602-cfa3b8adce24 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:17.531489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d401b1e-57b2-4001-a602-cfa3b8adce24 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:17.532163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d401b1e-57b2-4001-a602-cfa3b8adce24 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:17.599350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2d401b1e-57b2-4001-a602-cfa3b8adce24 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:10:17.814515 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2d401b1e-57b2-4001-a602-cfa3b8adce24 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 204 len: 0 microversion: 2.1 time: 0.305039 Mar 05 21:10:17.816361 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2358/4707] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:10:17 2022] DELETE /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:10:17.829862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9f6fa278-687f-46d8-b1e3-a02df28ac6af req-d26a3387-3cbb-4c7d-8674-6a44d1d735f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a47955-7a01-4ad3-bffa-719e3e892243", "tag": "e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:17.878356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9f6fa278-687f-46d8-b1e3-a02df28ac6af req-d26a3387-3cbb-4c7d-8674-6a44d1d735f5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:17.878965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9f6fa278-687f-46d8-b1e3-a02df28ac6af req-d26a3387-3cbb-4c7d-8674-6a44d1d735f5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:17.992094 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9f6fa278-687f-46d8-b1e3-a02df28ac6af req-d26a3387-3cbb-4c7d-8674-6a44d1d735f5 service nova] Creating event network-changed:e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2 for instance c4a47955-7a01-4ad3-bffa-719e3e892243 on nch1-master-1 Mar 05 21:10:18.009568 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9f6fa278-687f-46d8-b1e3-a02df28ac6af req-d26a3387-3cbb-4c7d-8674-6a44d1d735f5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187818 Mar 05 21:10:18.026599 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2359/4708] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:10:18.042667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-acb84dca-3043-4176-8d20-4da1903db4a6 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:18.042793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-acb84dca-3043-4176-8d20-4da1903db4a6 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:18.064105 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acb84dca-3043-4176-8d20-4da1903db4a6 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:18.066272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acb84dca-3043-4176-8d20-4da1903db4a6 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:18.067310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acb84dca-3043-4176-8d20-4da1903db4a6 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:18.067783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acb84dca-3043-4176-8d20-4da1903db4a6 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:18.089792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d903ed5d-2547-480c-b41c-5b9acbfd4337 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:18.100455 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d903ed5d-2547-480c-b41c-5b9acbfd4337 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1324 microversion: 2.1 time: 1.050048 Mar 05 21:10:18.101781 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2350/4709] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:17 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1324 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:19.117116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-acb84dca-3043-4176-8d20-4da1903db4a6 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:19.127639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-56acb628-133f-48db-b207-cc75c04b6da0 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:19.130989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-56acb628-133f-48db-b207-cc75c04b6da0 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:19.151821 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-acb84dca-3043-4176-8d20-4da1903db4a6 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1580 microversion: 2.1 time: 1.119702 Mar 05 21:10:19.153164 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2360/4710] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:18 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1580 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:19.185060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-56acb628-133f-48db-b207-cc75c04b6da0 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:19.185427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-56acb628-133f-48db-b207-cc75c04b6da0 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:19.186315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-56acb628-133f-48db-b207-cc75c04b6da0 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:19.186943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-56acb628-133f-48db-b207-cc75c04b6da0 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:19.341767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a4df7141-7d12-4bc8-bbfb-cddbaad6060e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:19.342587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a4df7141-7d12-4bc8-bbfb-cddbaad6060e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:19.360531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4df7141-7d12-4bc8-bbfb-cddbaad6060e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:19.361932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4df7141-7d12-4bc8-bbfb-cddbaad6060e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:19.366151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4df7141-7d12-4bc8-bbfb-cddbaad6060e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:19.371151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a4df7141-7d12-4bc8-bbfb-cddbaad6060e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:19.422936 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-a4df7141-7d12-4bc8-bbfb-cddbaad6060e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 16c1f962-469b-4cf5-9f61-a158b83a42a9 could not be found. Mar 05 21:10:19.423563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a4df7141-7d12-4bc8-bbfb-cddbaad6060e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 16c1f962-469b-4cf5-9f61-a158b83a42a9 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:19.424458 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a4df7141-7d12-4bc8-bbfb-cddbaad6060e tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "DELETE /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 404 len: 111 microversion: 2.1 time: 0.091343 Mar 05 21:10:19.425367 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2361/4711] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:10:19 2022] DELETE /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:10:19.434762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ee3eb0c-40c5-4df6-8af6-cafb29288573 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:19.436009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ee3eb0c-40c5-4df6-8af6-cafb29288573 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 16c1f962-469b-4cf5-9f61-a158b83a42a9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:19.452663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ee3eb0c-40c5-4df6-8af6-cafb29288573 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:19.453530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ee3eb0c-40c5-4df6-8af6-cafb29288573 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:19.454535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ee3eb0c-40c5-4df6-8af6-cafb29288573 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:19.457624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ee3eb0c-40c5-4df6-8af6-cafb29288573 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:19.505074 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-4ee3eb0c-40c5-4df6-8af6-cafb29288573 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 16c1f962-469b-4cf5-9f61-a158b83a42a9 could not be found. Mar 05 21:10:19.506820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ee3eb0c-40c5-4df6-8af6-cafb29288573 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 16c1f962-469b-4cf5-9f61-a158b83a42a9 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:19.510119 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4ee3eb0c-40c5-4df6-8af6-cafb29288573 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9" status: 404 len: 111 microversion: 2.1 time: 0.079469 Mar 05 21:10:19.513191 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2362/4712] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:19 2022] GET /compute/v2.1/servers/16c1f962-469b-4cf5-9f61-a158b83a42a9 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:10:19.523400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-40ea8fc1-4d41-426c-847f-9c9187a1a605 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:19.524000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-40ea8fc1-4d41-426c-847f-9c9187a1a605 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:19.538162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40ea8fc1-4d41-426c-847f-9c9187a1a605 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:19.538890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40ea8fc1-4d41-426c-847f-9c9187a1a605 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:19.541341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40ea8fc1-4d41-426c-847f-9c9187a1a605 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:19.544500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40ea8fc1-4d41-426c-847f-9c9187a1a605 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:19.605080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-40ea8fc1-4d41-426c-847f-9c9187a1a605 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:10:19.815375 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-40ea8fc1-4d41-426c-847f-9c9187a1a605 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 204 len: 0 microversion: 2.1 time: 0.297887 Mar 05 21:10:19.819190 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2363/4713] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:10:19 2022] DELETE /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:10:19.838444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fe7c9154-0483-41cc-a11e-d19dfd1eae45 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:19.839222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fe7c9154-0483-41cc-a11e-d19dfd1eae45 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:19.851058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe7c9154-0483-41cc-a11e-d19dfd1eae45 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:19.852651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe7c9154-0483-41cc-a11e-d19dfd1eae45 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:19.853898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe7c9154-0483-41cc-a11e-d19dfd1eae45 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:19.854594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe7c9154-0483-41cc-a11e-d19dfd1eae45 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:20.103016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-56acb628-133f-48db-b207-cc75c04b6da0 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:20.111913 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-56acb628-133f-48db-b207-cc75c04b6da0 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1324 microversion: 2.1 time: 0.992106 Mar 05 21:10:20.112627 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2351/4714] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:19 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1324 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:20.177678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1d542c14-c1ab-4578-920e-b88cdaeb1300 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:20.178551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1d542c14-c1ab-4578-920e-b88cdaeb1300 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:20.185630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d542c14-c1ab-4578-920e-b88cdaeb1300 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:20.186738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d542c14-c1ab-4578-920e-b88cdaeb1300 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:20.187580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d542c14-c1ab-4578-920e-b88cdaeb1300 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:20.188089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d542c14-c1ab-4578-920e-b88cdaeb1300 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:20.448934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fe7c9154-0483-41cc-a11e-d19dfd1eae45 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:20.459441 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fe7c9154-0483-41cc-a11e-d19dfd1eae45 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1511 microversion: 2.1 time: 0.629967 Mar 05 21:10:20.464325 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2364/4715] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:19 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1511 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:20.800436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-503ef10e-a840-4884-b071-43e87e3816b3 req-e4ad8c54-a124-4b5e-a76d-85168b6e9643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec66b4f-b6ad-405f-b2d1-c705f03b62fc", "tag": "10d4761c-eff3-4b89-8e69-a7c60e646059"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:20.815428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-503ef10e-a840-4884-b071-43e87e3816b3 req-e4ad8c54-a124-4b5e-a76d-85168b6e9643 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:20.816141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-503ef10e-a840-4884-b071-43e87e3816b3 req-e4ad8c54-a124-4b5e-a76d-85168b6e9643 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:20.830836 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-503ef10e-a840-4884-b071-43e87e3816b3 req-e4ad8c54-a124-4b5e-a76d-85168b6e9643 service nova] Creating event network-changed:10d4761c-eff3-4b89-8e69-a7c60e646059 for instance dec66b4f-b6ad-405f-b2d1-c705f03b62fc on nch2-master-1 Mar 05 21:10:20.838804 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-503ef10e-a840-4884-b071-43e87e3816b3 req-e4ad8c54-a124-4b5e-a76d-85168b6e9643 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267274 Mar 05 21:10:20.839862 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2365/4716] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:10:20.856337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1d542c14-c1ab-4578-920e-b88cdaeb1300 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:20.864709 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1d542c14-c1ab-4578-920e-b88cdaeb1300 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1580 microversion: 2.1 time: 0.696635 Mar 05 21:10:20.875081 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2352/4717] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:20 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1580 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:21.132534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c14ca318-15a3-4d69-8b2b-2c11bd9b20ba tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:21.133671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c14ca318-15a3-4d69-8b2b-2c11bd9b20ba tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:21.152148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c14ca318-15a3-4d69-8b2b-2c11bd9b20ba tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:21.152806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c14ca318-15a3-4d69-8b2b-2c11bd9b20ba tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:21.153818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c14ca318-15a3-4d69-8b2b-2c11bd9b20ba tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:21.155056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c14ca318-15a3-4d69-8b2b-2c11bd9b20ba tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:21.480815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-765e83ff-3bfc-439d-a083-922cf81eed09 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:21.481639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-765e83ff-3bfc-439d-a083-922cf81eed09 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:21.518883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-765e83ff-3bfc-439d-a083-922cf81eed09 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:21.519863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-765e83ff-3bfc-439d-a083-922cf81eed09 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:21.520680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-765e83ff-3bfc-439d-a083-922cf81eed09 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:21.521130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-765e83ff-3bfc-439d-a083-922cf81eed09 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:21.619945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c14ca318-15a3-4d69-8b2b-2c11bd9b20ba tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:21.630383 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c14ca318-15a3-4d69-8b2b-2c11bd9b20ba tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1324 microversion: 2.1 time: 0.501073 Mar 05 21:10:21.641029 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2366/4718] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:21 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1324 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:21.882923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-426f6dfb-050c-4f5d-a5f6-9d96932a3d54 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:21.883685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-426f6dfb-050c-4f5d-a5f6-9d96932a3d54 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:21.891662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-426f6dfb-050c-4f5d-a5f6-9d96932a3d54 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:21.896207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-426f6dfb-050c-4f5d-a5f6-9d96932a3d54 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:21.897179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-426f6dfb-050c-4f5d-a5f6-9d96932a3d54 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:21.897752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-426f6dfb-050c-4f5d-a5f6-9d96932a3d54 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:22.145837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-426f6dfb-050c-4f5d-a5f6-9d96932a3d54 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f84866b0f34e6da2d051b5b3583e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa71bdd8c3394c1ca9fb656a112d9349', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:22.153797 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-426f6dfb-050c-4f5d-a5f6-9d96932a3d54 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 200 len: 1228 microversion: 2.1 time: 0.274904 Mar 05 21:10:22.164019 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2367/4719] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:21 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 1228 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:22.197619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-765e83ff-3bfc-439d-a083-922cf81eed09 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:22.213590 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-765e83ff-3bfc-439d-a083-922cf81eed09 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1511 microversion: 2.1 time: 0.740583 Mar 05 21:10:22.214221 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2353/4720] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:21 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1511 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:22.648775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-620daf2e-e67f-4fc3-9452-d4cbe9a22c2a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:22.649419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-620daf2e-e67f-4fc3-9452-d4cbe9a22c2a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:22.665020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-620daf2e-e67f-4fc3-9452-d4cbe9a22c2a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:22.665488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-620daf2e-e67f-4fc3-9452-d4cbe9a22c2a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:22.666284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-620daf2e-e67f-4fc3-9452-d4cbe9a22c2a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:22.666731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-620daf2e-e67f-4fc3-9452-d4cbe9a22c2a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:22.914966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e146fbbc-2cc7-4690-a19d-38379f133269 req-bc849532-fb27-4815-a6d2-d3bb6cba36c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4a47955-7a01-4ad3-bffa-719e3e892243", "name": "network-vif-deleted", "tag": "e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:22.925795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e146fbbc-2cc7-4690-a19d-38379f133269 req-bc849532-fb27-4815-a6d2-d3bb6cba36c2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:22.926403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e146fbbc-2cc7-4690-a19d-38379f133269 req-bc849532-fb27-4815-a6d2-d3bb6cba36c2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:22.939148 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e146fbbc-2cc7-4690-a19d-38379f133269 req-bc849532-fb27-4815-a6d2-d3bb6cba36c2 service nova] Creating event network-vif-deleted:e8a06b6a-a2ba-4d68-bb19-fd7eaea0fee2 for instance c4a47955-7a01-4ad3-bffa-719e3e892243 on nch1-master-1 Mar 05 21:10:22.945317 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e146fbbc-2cc7-4690-a19d-38379f133269 req-bc849532-fb27-4815-a6d2-d3bb6cba36c2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044737 Mar 05 21:10:22.946341 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2354/4721] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:10:23.173402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d4b224f1-93e2-4c97-bcd5-710347b30959 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:23.174125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d4b224f1-93e2-4c97-bcd5-710347b30959 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] [instance: c4a47955-7a01-4ad3-bffa-719e3e892243] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:23.181813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4b224f1-93e2-4c97-bcd5-710347b30959 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:23.182664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4b224f1-93e2-4c97-bcd5-710347b30959 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:23.183765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4b224f1-93e2-4c97-bcd5-710347b30959 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:23.184799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4b224f1-93e2-4c97-bcd5-710347b30959 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:23.203445 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-d4b224f1-93e2-4c97-bcd5-710347b30959 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] HTTP exception thrown: Instance c4a47955-7a01-4ad3-bffa-719e3e892243 could not be found. Mar 05 21:10:23.204914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d4b224f1-93e2-4c97-bcd5-710347b30959 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Returning 404 to user: Instance c4a47955-7a01-4ad3-bffa-719e3e892243 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:23.206406 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d4b224f1-93e2-4c97-bcd5-710347b30959 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243" status: 404 len: 111 microversion: 2.1 time: 0.038137 Mar 05 21:10:23.207263 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2355/4722] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:23 2022] GET /compute/v2.1/servers/c4a47955-7a01-4ad3-bffa-719e3e892243 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:10:23.232459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-35cd4299-aea0-4db9-b484-7c75d5cde9c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:23.233554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-35cd4299-aea0-4db9-b484-7c75d5cde9c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:23.241070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35cd4299-aea0-4db9-b484-7c75d5cde9c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:23.242233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35cd4299-aea0-4db9-b484-7c75d5cde9c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:23.243395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35cd4299-aea0-4db9-b484-7c75d5cde9c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:23.244083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35cd4299-aea0-4db9-b484-7c75d5cde9c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:23.447857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-35cd4299-aea0-4db9-b484-7c75d5cde9c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:23.457440 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-35cd4299-aea0-4db9-b484-7c75d5cde9c4 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1511 microversion: 2.1 time: 0.230241 Mar 05 21:10:23.458149 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2356/4723] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:23 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:23.794597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-620daf2e-e67f-4fc3-9452-d4cbe9a22c2a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:23.804623 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-620daf2e-e67f-4fc3-9452-d4cbe9a22c2a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1324 microversion: 2.1 time: 1.159596 Mar 05 21:10:23.819851 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2368/4724] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:22 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1324 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:24.424041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-374eb4f7-54d6-43a8-8e7b-a18401a7744c req-3c10542d-47be-4ffb-a503-b1ee2ffa43d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bacfc2c-ea7e-43a5-b26d-af976d17edd9", "name": "network-vif-deleted", "tag": "94b1d404-120e-4570-9658-48bf6610ec97"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:24.439705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-374eb4f7-54d6-43a8-8e7b-a18401a7744c req-3c10542d-47be-4ffb-a503-b1ee2ffa43d3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:24.440740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-374eb4f7-54d6-43a8-8e7b-a18401a7744c req-3c10542d-47be-4ffb-a503-b1ee2ffa43d3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:24.465569 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-374eb4f7-54d6-43a8-8e7b-a18401a7744c req-3c10542d-47be-4ffb-a503-b1ee2ffa43d3 service nova] Creating event network-vif-deleted:94b1d404-120e-4570-9658-48bf6610ec97 for instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 on nch2-master-1 Mar 05 21:10:24.476778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91ad307b-2073-474d-b6b3-b8077dd93f26 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:24.477378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91ad307b-2073-474d-b6b3-b8077dd93f26 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:24.490676 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-374eb4f7-54d6-43a8-8e7b-a18401a7744c req-3c10542d-47be-4ffb-a503-b1ee2ffa43d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075699 Mar 05 21:10:24.490839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91ad307b-2073-474d-b6b3-b8077dd93f26 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:24.491307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91ad307b-2073-474d-b6b3-b8077dd93f26 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:24.491825 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2357/4725] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:10:24.492474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91ad307b-2073-474d-b6b3-b8077dd93f26 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:24.492929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91ad307b-2073-474d-b6b3-b8077dd93f26 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:24.520385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-64002076-9ea2-40b7-a585-ff5bda0273d0 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] Calling method '.version_select at 0x7fed61ab3040>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:24.561622 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-64002076-9ea2-40b7-a585-ff5bda0273d0 tempest-TestVolumeBackupRestore-590870803 tempest-TestVolumeBackupRestore-590870803-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-636395213" status: 202 len: 0 microversion: 2.1 time: 0.050729 Mar 05 21:10:24.562799 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2358/4726] 10.222.0.15 () {58 vars in 1265 bytes} [Sat Mar 5 21:10:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-636395213 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:10:24.659193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-91ad307b-2073-474d-b6b3-b8077dd93f26 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa54ee852c148f19a384be2177b19a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def4cea650ac491985dac1868ac5052a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:24.666903 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91ad307b-2073-474d-b6b3-b8077dd93f26 tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 200 len: 1301 microversion: 2.1 time: 0.195803 Mar 05 21:10:24.676045 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2369/4727] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:24 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 1301 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:24.830132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8fdac48e-ac8b-4879-a34f-d26db728f03b tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:24.832076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8fdac48e-ac8b-4879-a34f-d26db728f03b tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:24.843989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8fdac48e-ac8b-4879-a34f-d26db728f03b tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:24.844832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8fdac48e-ac8b-4879-a34f-d26db728f03b tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:24.847556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8fdac48e-ac8b-4879-a34f-d26db728f03b tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:24.848748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8fdac48e-ac8b-4879-a34f-d26db728f03b tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:25.088259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8fdac48e-ac8b-4879-a34f-d26db728f03b tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:25.097696 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8fdac48e-ac8b-4879-a34f-d26db728f03b tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1324 microversion: 2.1 time: 0.276393 Mar 05 21:10:25.098860 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2359/4728] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:24 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1324 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:25.334982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1642527436", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": "none"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:25.418614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:10:25.419149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:10:25.420553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:10:25.421150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:10:25.421863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:10:25.448966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:25.450041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:25.451719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:25.452716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:25.514628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Getting quotas for project 914909471bb5484e81c7e44e2ef33835. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:10:25.523483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Getting quotas for user 50763cc4dce0450598bac0a39d2de760 and project 914909471bb5484e81c7e44e2ef33835. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:10:25.546405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:10:25.551275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:10:25.631615 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d6168473-d176-4eb2-8670-3489bca2a99d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.420979 Mar 05 21:10:25.633216 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2370/4729] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 21:10:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 05 21:10:25.653836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fb8cf238-9420-47e6-b602-afc99a2248b6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:25.658165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fb8cf238-9420-47e6-b602-afc99a2248b6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:25.741035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-120fbf88-647a-433a-a9bf-5889886409da tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:25.748671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-120fbf88-647a-433a-a9bf-5889886409da tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] [instance: 9bacfc2c-ea7e-43a5-b26d-af976d17edd9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:25.775564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-120fbf88-647a-433a-a9bf-5889886409da tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:25.776263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-120fbf88-647a-433a-a9bf-5889886409da tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:25.784915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-120fbf88-647a-433a-a9bf-5889886409da tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:25.786181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-120fbf88-647a-433a-a9bf-5889886409da tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:25.831939 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-120fbf88-647a-433a-a9bf-5889886409da tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] HTTP exception thrown: Instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 could not be found. Mar 05 21:10:25.835209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-120fbf88-647a-433a-a9bf-5889886409da tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] Returning 404 to user: Instance 9bacfc2c-ea7e-43a5-b26d-af976d17edd9 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:25.843188 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-120fbf88-647a-433a-a9bf-5889886409da tempest-ServersNegativeTestJSON-876211055 tempest-ServersNegativeTestJSON-876211055-project] 10.222.0.15 "GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9" status: 404 len: 111 microversion: 2.1 time: 0.161201 Mar 05 21:10:25.845053 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2371/4730] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:25 2022] GET /compute/v2.1/servers/9bacfc2c-ea7e-43a5-b26d-af976d17edd9 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:10:26.019796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fb8cf238-9420-47e6-b602-afc99a2248b6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:26.032543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fb8cf238-9420-47e6-b602-afc99a2248b6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:26.043071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fb8cf238-9420-47e6-b602-afc99a2248b6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:26.044655 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fb8cf238-9420-47e6-b602-afc99a2248b6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1278 microversion: 2.54 time: 0.405251 Mar 05 21:10:26.045944 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2360/4731] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:25 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1278 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:26.119431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6fcd980a-9cd6-40e7-87ee-eeb1176f9c8f tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:26.121310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6fcd980a-9cd6-40e7-87ee-eeb1176f9c8f tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:26.158141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6fcd980a-9cd6-40e7-87ee-eeb1176f9c8f tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:26.158994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6fcd980a-9cd6-40e7-87ee-eeb1176f9c8f tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:26.164873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6fcd980a-9cd6-40e7-87ee-eeb1176f9c8f tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:26.167286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6fcd980a-9cd6-40e7-87ee-eeb1176f9c8f tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:26.511007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-14b93c58-f3d2-40fa-943e-bac2dd77001e req-e2fcca38-5da6-407d-9e13-94c4c405cc97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec66b4f-b6ad-405f-b2d1-c705f03b62fc", "name": "network-vif-plugged", "status": "completed", "tag": "10d4761c-eff3-4b89-8e69-a7c60e646059"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:26.536171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-14b93c58-f3d2-40fa-943e-bac2dd77001e req-e2fcca38-5da6-407d-9e13-94c4c405cc97 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:26.547308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-14b93c58-f3d2-40fa-943e-bac2dd77001e req-e2fcca38-5da6-407d-9e13-94c4c405cc97 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:26.581948 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-14b93c58-f3d2-40fa-943e-bac2dd77001e req-e2fcca38-5da6-407d-9e13-94c4c405cc97 service nova] Creating event network-vif-plugged:10d4761c-eff3-4b89-8e69-a7c60e646059 for instance dec66b4f-b6ad-405f-b2d1-c705f03b62fc on nch2-master-1 Mar 05 21:10:26.594198 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-14b93c58-f3d2-40fa-943e-bac2dd77001e req-e2fcca38-5da6-407d-9e13-94c4c405cc97 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089395 Mar 05 21:10:26.600392 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2361/4732] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:10:27.078537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d343c5eb-8a33-4d9a-b97d-8c3c1e7986c9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:27.079266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d343c5eb-8a33-4d9a-b97d-8c3c1e7986c9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:27.097171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d343c5eb-8a33-4d9a-b97d-8c3c1e7986c9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:27.108064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d343c5eb-8a33-4d9a-b97d-8c3c1e7986c9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:27.108754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6fcd980a-9cd6-40e7-87ee-eeb1176f9c8f tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:27.110001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d343c5eb-8a33-4d9a-b97d-8c3c1e7986c9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:27.110616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d343c5eb-8a33-4d9a-b97d-8c3c1e7986c9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:27.129494 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6fcd980a-9cd6-40e7-87ee-eeb1176f9c8f tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1324 microversion: 2.1 time: 1.010487 Mar 05 21:10:27.130647 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2372/4733] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:26 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1324 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:27.691984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d343c5eb-8a33-4d9a-b97d-8c3c1e7986c9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:27.708390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d343c5eb-8a33-4d9a-b97d-8c3c1e7986c9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:27.710413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d343c5eb-8a33-4d9a-b97d-8c3c1e7986c9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:27.711821 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d343c5eb-8a33-4d9a-b97d-8c3c1e7986c9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1330 microversion: 2.54 time: 0.641093 Mar 05 21:10:27.727327 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2362/4734] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:27 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1330 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:28.150286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fff5dd6c-ee27-46ef-be9e-e361ca53dd5a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:28.152061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fff5dd6c-ee27-46ef-be9e-e361ca53dd5a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:28.170920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fff5dd6c-ee27-46ef-be9e-e361ca53dd5a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:28.173282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fff5dd6c-ee27-46ef-be9e-e361ca53dd5a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:28.176744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fff5dd6c-ee27-46ef-be9e-e361ca53dd5a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:28.177269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fff5dd6c-ee27-46ef-be9e-e361ca53dd5a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:28.614844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fff5dd6c-ee27-46ef-be9e-e361ca53dd5a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:28.627604 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fff5dd6c-ee27-46ef-be9e-e361ca53dd5a tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1324 microversion: 2.1 time: 0.482781 Mar 05 21:10:28.630871 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2373/4735] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:28 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1324 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:28.751711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6e74aa82-8cc9-401c-9b6d-7319be5d9ced tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:28.752345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6e74aa82-8cc9-401c-9b6d-7319be5d9ced tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:28.772202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e74aa82-8cc9-401c-9b6d-7319be5d9ced tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:28.772969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e74aa82-8cc9-401c-9b6d-7319be5d9ced tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:28.773993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e74aa82-8cc9-401c-9b6d-7319be5d9ced tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:28.776044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e74aa82-8cc9-401c-9b6d-7319be5d9ced tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:28.961784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6e74aa82-8cc9-401c-9b6d-7319be5d9ced tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:28.974843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6e74aa82-8cc9-401c-9b6d-7319be5d9ced tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:28.985424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6e74aa82-8cc9-401c-9b6d-7319be5d9ced tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:28.993066 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6e74aa82-8cc9-401c-9b6d-7319be5d9ced tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1336 microversion: 2.54 time: 0.248504 Mar 05 21:10:29.009171 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2363/4736] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:28 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1336 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:29.649296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ac3abefd-4c60-4b15-8186-bf9e14da5ecf tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:29.649935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ac3abefd-4c60-4b15-8186-bf9e14da5ecf tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:29.663303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac3abefd-4c60-4b15-8186-bf9e14da5ecf tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:29.665274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac3abefd-4c60-4b15-8186-bf9e14da5ecf tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:29.666398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac3abefd-4c60-4b15-8186-bf9e14da5ecf tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:29.668020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ac3abefd-4c60-4b15-8186-bf9e14da5ecf tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:30.020234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4a396b12-b23b-4b14-8005-ff9bd9e3a56c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:30.021565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4a396b12-b23b-4b14-8005-ff9bd9e3a56c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:30.030750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4a396b12-b23b-4b14-8005-ff9bd9e3a56c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:30.031754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4a396b12-b23b-4b14-8005-ff9bd9e3a56c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:30.032753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4a396b12-b23b-4b14-8005-ff9bd9e3a56c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:30.037855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4a396b12-b23b-4b14-8005-ff9bd9e3a56c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:30.189446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4a396b12-b23b-4b14-8005-ff9bd9e3a56c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:30.211408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4a396b12-b23b-4b14-8005-ff9bd9e3a56c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:30.213645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4a396b12-b23b-4b14-8005-ff9bd9e3a56c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:30.215171 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4a396b12-b23b-4b14-8005-ff9bd9e3a56c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1357 microversion: 2.54 time: 0.199714 Mar 05 21:10:30.217741 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2364/4737] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:30 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:30.242495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d8079382-6298-4c2a-ba8e-20d3669ce82d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Action: 'create', calling method: .version_select at 0x7fed4f7920d0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-93918886"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:30.315214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d8079382-6298-4c2a-ba8e-20d3669ce82d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Getting quotas for project 914909471bb5484e81c7e44e2ef33835. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:10:30.367607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d8079382-6298-4c2a-ba8e-20d3669ce82d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Getting quotas for user 50763cc4dce0450598bac0a39d2de760 and project 914909471bb5484e81c7e44e2ef33835. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:10:30.925988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ac3abefd-4c60-4b15-8186-bf9e14da5ecf tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:30.934061 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ac3abefd-4c60-4b15-8186-bf9e14da5ecf tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1521 microversion: 2.1 time: 1.289567 Mar 05 21:10:30.934755 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2374/4738] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:29 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1521 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:30.955039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-82a57dca-6f64-4bd9-b308-9e4d795599fb tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:30.955714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-82a57dca-6f64-4bd9-b308-9e4d795599fb tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:30.965592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82a57dca-6f64-4bd9-b308-9e4d795599fb tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:30.967245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82a57dca-6f64-4bd9-b308-9e4d795599fb tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:30.969656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82a57dca-6f64-4bd9-b308-9e4d795599fb tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:30.970225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82a57dca-6f64-4bd9-b308-9e4d795599fb tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:31.055466 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-82a57dca-6f64-4bd9-b308-9e4d795599fb tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] HTTP exception thrown: Action 999 not found Mar 05 21:10:31.057277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-82a57dca-6f64-4bd9-b308-9e4d795599fb tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Returning 404 to user: Action 999 not found {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:31.059437 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-82a57dca-6f64-4bd9-b308-9e4d795599fb tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.108981 Mar 05 21:10:31.060569 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2375/4739] 10.222.0.15 () {58 vars in 1307 bytes} [Sat Mar 5 21:10:30 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc/os-instance-actions/999 => generated 66 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:10:31.084440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-30d6bf4a-4164-485b-a550-a5f0a7e29851 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '.version_select at 0x7fed61ad75e0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:31.087319 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-30d6bf4a-4164-485b-a550-a5f0a7e29851 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: 79b523e7-e222-4009-9a8e-c63597aa43e1] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:31.118962 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-30d6bf4a-4164-485b-a550-a5f0a7e29851 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] HTTP exception thrown: Instance 79b523e7-e222-4009-9a8e-c63597aa43e1 could not be found. Mar 05 21:10:31.120114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-30d6bf4a-4164-485b-a550-a5f0a7e29851 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Returning 404 to user: Instance 79b523e7-e222-4009-9a8e-c63597aa43e1 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:31.122254 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-30d6bf4a-4164-485b-a550-a5f0a7e29851 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/79b523e7-e222-4009-9a8e-c63597aa43e1/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.053835 Mar 05 21:10:31.125058 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2376/4740] 10.222.0.15 () {58 vars in 1295 bytes} [Sat Mar 5 21:10:31 2022] GET /compute/v2.1/servers/79b523e7-e222-4009-9a8e-c63597aa43e1/os-instance-actions => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:10:31.147080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ca5c3a78-9ef3-483d-be2c-9be6b3b330d5 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:31.148979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ca5c3a78-9ef3-483d-be2c-9be6b3b330d5 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:31.162076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca5c3a78-9ef3-483d-be2c-9be6b3b330d5 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:31.162923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca5c3a78-9ef3-483d-be2c-9be6b3b330d5 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:31.164221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca5c3a78-9ef3-483d-be2c-9be6b3b330d5 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:31.166605 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca5c3a78-9ef3-483d-be2c-9be6b3b330d5 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:31.204305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ca5c3a78-9ef3-483d-be2c-9be6b3b330d5 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:10:31.294596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d8079382-6298-4c2a-ba8e-20d3669ce82d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Getting quotas for project 914909471bb5484e81c7e44e2ef33835. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:10:31.305030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d8079382-6298-4c2a-ba8e-20d3669ce82d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Getting quotas for user 50763cc4dce0450598bac0a39d2de760 and project 914909471bb5484e81c7e44e2ef33835. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:10:31.325546 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d8079382-6298-4c2a-ba8e-20d3669ce82d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2337 microversion: 2.54 time: 1.090593 Mar 05 21:10:31.327124 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2365/4741] 10.222.0.15 () {62 vars in 1198 bytes} [Sat Mar 5 21:10:30 2022] POST /compute/v2.1/os-keypairs => generated 2337 bytes in 1094 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Mar 05 21:10:31.340124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-93918886", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:31.346597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:31.357841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:31.358390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:31.359757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:31.359757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:31.382987 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ca5c3a78-9ef3-483d-be2c-9be6b3b330d5 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 204 len: 0 microversion: 2.1 time: 0.252756 Mar 05 21:10:31.389994 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2377/4742] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:10:31 2022] DELETE /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:10:31.424641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5fe54a46-ecec-4f92-ad76-a53220a42df7 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:31.428072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5fe54a46-ecec-4f92-ad76-a53220a42df7 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:31.439928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5fe54a46-ecec-4f92-ad76-a53220a42df7 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:31.440618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5fe54a46-ecec-4f92-ad76-a53220a42df7 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:31.442068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5fe54a46-ecec-4f92-ad76-a53220a42df7 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:31.442701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5fe54a46-ecec-4f92-ad76-a53220a42df7 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:31.518933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:10:31.519942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:10:31.520438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:10:31.524797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:10:31.525577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:10:31.651366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:31.661976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:31.662865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:31.663730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:31.664460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:31.707221 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a09e72f3-d204-41dd-9ff4-e85306a016fb tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "POST /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609/action" status: 202 len: 1138 microversion: 2.54 time: 0.373297 Mar 05 21:10:31.709196 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2366/4743] 10.222.0.15 () {62 vars in 1319 bytes} [Sat Mar 5 21:10:31 2022] POST /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609/action => generated 1138 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 05 21:10:31.817247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5fe54a46-ecec-4f92-ad76-a53220a42df7 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:31.835247 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5fe54a46-ecec-4f92-ad76-a53220a42df7 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1527 microversion: 2.1 time: 0.442449 Mar 05 21:10:31.836727 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2378/4744] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:31 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1527 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:31.849810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6e4c3b17-2528-44e1-b9a6-4156133e8bdc tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:31.850761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6e4c3b17-2528-44e1-b9a6-4156133e8bdc tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:31.861254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e4c3b17-2528-44e1-b9a6-4156133e8bdc tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:31.871509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e4c3b17-2528-44e1-b9a6-4156133e8bdc tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:31.873378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e4c3b17-2528-44e1-b9a6-4156133e8bdc tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:31.876822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e4c3b17-2528-44e1-b9a6-4156133e8bdc tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:31.997833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6e4c3b17-2528-44e1-b9a6-4156133e8bdc tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:32.010240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6e4c3b17-2528-44e1-b9a6-4156133e8bdc tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:32.011425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6e4c3b17-2528-44e1-b9a6-4156133e8bdc tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:32.012862 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6e4c3b17-2528-44e1-b9a6-4156133e8bdc tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.174369 Mar 05 21:10:32.014272 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2379/4745] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:31 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:32.150710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-327db4a9-e4d2-403e-8727-31260c3d5d57 tempest-ExtensionsTest-1234624155 tempest-ExtensionsTest-1234624155-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:32.152973 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-327db4a9-e4d2-403e-8727-31260c3d5d57 tempest-ExtensionsTest-1234624155 tempest-ExtensionsTest-1234624155-project] 10.222.0.15 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.442197 Mar 05 21:10:32.153906 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2367/4746] 10.222.0.15 () {58 vars in 1169 bytes} [Sat Mar 5 21:10:31 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:10:32.164951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-13cb7195-36d7-42c6-9519-43fedaede5f3 tempest-ExtensionsTest-1234624155 tempest-ExtensionsTest-1234624155-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:32.167452 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-13cb7195-36d7-42c6-9519-43fedaede5f3 tempest-ExtensionsTest-1234624155 tempest-ExtensionsTest-1234624155-project] 10.222.0.15 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006799 Mar 05 21:10:32.179738 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2380/4747] 10.222.0.15 () {58 vars in 1133 bytes} [Sat Mar 5 21:10:32 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:10:32.854864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e80f04ba-fb38-4125-85ab-6a726c6f44da tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:32.855520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e80f04ba-fb38-4125-85ab-6a726c6f44da tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:32.868206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e80f04ba-fb38-4125-85ab-6a726c6f44da tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:32.872587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e80f04ba-fb38-4125-85ab-6a726c6f44da tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:32.874739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e80f04ba-fb38-4125-85ab-6a726c6f44da tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:32.875432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e80f04ba-fb38-4125-85ab-6a726c6f44da tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:33.035879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e1014e38-e1f6-4fe6-a6b0-36231926b8b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:33.036522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e1014e38-e1f6-4fe6-a6b0-36231926b8b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:33.045953 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1014e38-e1f6-4fe6-a6b0-36231926b8b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:33.047061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1014e38-e1f6-4fe6-a6b0-36231926b8b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:33.050210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1014e38-e1f6-4fe6-a6b0-36231926b8b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:33.051061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1014e38-e1f6-4fe6-a6b0-36231926b8b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:33.266649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e1014e38-e1f6-4fe6-a6b0-36231926b8b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:33.275580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e1014e38-e1f6-4fe6-a6b0-36231926b8b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:33.277354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e1014e38-e1f6-4fe6-a6b0-36231926b8b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:33.280524 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e1014e38-e1f6-4fe6-a6b0-36231926b8b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.249930 Mar 05 21:10:33.293101 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2381/4748] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:33 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:33.503915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e80f04ba-fb38-4125-85ab-6a726c6f44da tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:33.512451 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e80f04ba-fb38-4125-85ab-6a726c6f44da tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1527 microversion: 2.1 time: 0.662460 Mar 05 21:10:33.513368 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2368/4749] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:32 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1527 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:34.302755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bb1aef6f-4fd1-4108-ba34-a8ccedef28c6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:34.304680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bb1aef6f-4fd1-4108-ba34-a8ccedef28c6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:34.324643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb1aef6f-4fd1-4108-ba34-a8ccedef28c6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:34.325518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb1aef6f-4fd1-4108-ba34-a8ccedef28c6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:34.327946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb1aef6f-4fd1-4108-ba34-a8ccedef28c6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:34.332329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb1aef6f-4fd1-4108-ba34-a8ccedef28c6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:34.530827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-38cbd08d-6df0-4b0e-8aba-0bb13c0888a1 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:34.532567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-38cbd08d-6df0-4b0e-8aba-0bb13c0888a1 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:34.549630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38cbd08d-6df0-4b0e-8aba-0bb13c0888a1 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:34.550407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38cbd08d-6df0-4b0e-8aba-0bb13c0888a1 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:34.551380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38cbd08d-6df0-4b0e-8aba-0bb13c0888a1 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:34.552396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-38cbd08d-6df0-4b0e-8aba-0bb13c0888a1 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:34.768271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-38cbd08d-6df0-4b0e-8aba-0bb13c0888a1 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b805e2f2b9a94221af17f5c5f7778698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8526bfe1734af7a05e8a6f22192cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:34.781740 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-38cbd08d-6df0-4b0e-8aba-0bb13c0888a1 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 200 len: 1485 microversion: 2.1 time: 0.254719 Mar 05 21:10:34.796099 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2369/4750] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:34 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 1485 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:10:34.954316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb1aef6f-4fd1-4108-ba34-a8ccedef28c6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:34.968606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb1aef6f-4fd1-4108-ba34-a8ccedef28c6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:34.970185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb1aef6f-4fd1-4108-ba34-a8ccedef28c6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:34.971450 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bb1aef6f-4fd1-4108-ba34-a8ccedef28c6 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.673060 Mar 05 21:10:34.978098 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2382/4751] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:34 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:35.022108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f96ddab0-0f00-4a5b-99fa-5530fd459b92 req-ef8ed77f-5071-4e07-932e-b8da514ee5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec66b4f-b6ad-405f-b2d1-c705f03b62fc", "name": "network-vif-deleted", "tag": "10d4761c-eff3-4b89-8e69-a7c60e646059"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:35.048724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f96ddab0-0f00-4a5b-99fa-5530fd459b92 req-ef8ed77f-5071-4e07-932e-b8da514ee5b5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:35.050982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f96ddab0-0f00-4a5b-99fa-5530fd459b92 req-ef8ed77f-5071-4e07-932e-b8da514ee5b5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:35.095018 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f96ddab0-0f00-4a5b-99fa-5530fd459b92 req-ef8ed77f-5071-4e07-932e-b8da514ee5b5 service nova] Creating event network-vif-deleted:10d4761c-eff3-4b89-8e69-a7c60e646059 for instance dec66b4f-b6ad-405f-b2d1-c705f03b62fc on nch2-master-1 Mar 05 21:10:35.100811 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f96ddab0-0f00-4a5b-99fa-5530fd459b92 req-ef8ed77f-5071-4e07-932e-b8da514ee5b5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082211 Mar 05 21:10:35.102035 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2370/4752] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:10:35.799951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-04ef0f4b-0b5a-4fa3-85a5-5c2126fbf468 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:35.801375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-04ef0f4b-0b5a-4fa3-85a5-5c2126fbf468 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] [instance: dec66b4f-b6ad-405f-b2d1-c705f03b62fc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:35.815325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04ef0f4b-0b5a-4fa3-85a5-5c2126fbf468 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:35.816240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04ef0f4b-0b5a-4fa3-85a5-5c2126fbf468 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:35.817621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04ef0f4b-0b5a-4fa3-85a5-5c2126fbf468 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:35.819179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04ef0f4b-0b5a-4fa3-85a5-5c2126fbf468 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:35.894428 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-04ef0f4b-0b5a-4fa3-85a5-5c2126fbf468 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] HTTP exception thrown: Instance dec66b4f-b6ad-405f-b2d1-c705f03b62fc could not be found. Mar 05 21:10:35.895348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-04ef0f4b-0b5a-4fa3-85a5-5c2126fbf468 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] Returning 404 to user: Instance dec66b4f-b6ad-405f-b2d1-c705f03b62fc could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:10:35.897661 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-04ef0f4b-0b5a-4fa3-85a5-5c2126fbf468 tempest-InstanceActionsNegativeTestJSON-1373396958 tempest-InstanceActionsNegativeTestJSON-1373396958-project] 10.222.0.15 "GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc" status: 404 len: 111 microversion: 2.1 time: 0.103238 Mar 05 21:10:35.912968 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2383/4753] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:10:35 2022] GET /compute/v2.1/servers/dec66b4f-b6ad-405f-b2d1-c705f03b62fc => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:10:35.998313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1acca0bf-8ba3-4651-8322-2185f27dbe8d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:35.999948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1acca0bf-8ba3-4651-8322-2185f27dbe8d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:36.008182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1acca0bf-8ba3-4651-8322-2185f27dbe8d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:36.008984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1acca0bf-8ba3-4651-8322-2185f27dbe8d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:36.012757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1acca0bf-8ba3-4651-8322-2185f27dbe8d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:36.014054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1acca0bf-8ba3-4651-8322-2185f27dbe8d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:36.616833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1acca0bf-8ba3-4651-8322-2185f27dbe8d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:36.632857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1acca0bf-8ba3-4651-8322-2185f27dbe8d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:36.637828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1acca0bf-8ba3-4651-8322-2185f27dbe8d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:36.641174 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1acca0bf-8ba3-4651-8322-2185f27dbe8d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.649939 Mar 05 21:10:36.643251 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2371/4754] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:35 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:37.660934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-05e5bb46-0769-4bd0-89f9-5e46fbeec425 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:37.661566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-05e5bb46-0769-4bd0-89f9-5e46fbeec425 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:37.676380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05e5bb46-0769-4bd0-89f9-5e46fbeec425 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:37.677413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05e5bb46-0769-4bd0-89f9-5e46fbeec425 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:37.678432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05e5bb46-0769-4bd0-89f9-5e46fbeec425 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:37.679231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-05e5bb46-0769-4bd0-89f9-5e46fbeec425 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:37.963314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-05e5bb46-0769-4bd0-89f9-5e46fbeec425 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:37.974092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-05e5bb46-0769-4bd0-89f9-5e46fbeec425 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:37.981518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-05e5bb46-0769-4bd0-89f9-5e46fbeec425 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:37.983588 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-05e5bb46-0769-4bd0-89f9-5e46fbeec425 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.326599 Mar 05 21:10:37.984319 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2384/4755] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:37 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:10:39.004577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-75d0ed76-d3b2-4703-aa7b-af8044e5bc89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:39.005229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-75d0ed76-d3b2-4703-aa7b-af8044e5bc89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:39.014474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75d0ed76-d3b2-4703-aa7b-af8044e5bc89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:39.019694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75d0ed76-d3b2-4703-aa7b-af8044e5bc89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:39.022484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75d0ed76-d3b2-4703-aa7b-af8044e5bc89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:39.023639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75d0ed76-d3b2-4703-aa7b-af8044e5bc89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:39.200143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-75d0ed76-d3b2-4703-aa7b-af8044e5bc89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:39.211131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-75d0ed76-d3b2-4703-aa7b-af8044e5bc89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:39.212966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-75d0ed76-d3b2-4703-aa7b-af8044e5bc89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:39.217191 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-75d0ed76-d3b2-4703-aa7b-af8044e5bc89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.215615 Mar 05 21:10:39.225420 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2372/4756] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:38 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:40.244648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ee829edc-6cd7-40f0-b9f0-cab4910d7479 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:40.245433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ee829edc-6cd7-40f0-b9f0-cab4910d7479 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:40.259125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee829edc-6cd7-40f0-b9f0-cab4910d7479 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:40.262016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee829edc-6cd7-40f0-b9f0-cab4910d7479 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:40.265898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee829edc-6cd7-40f0-b9f0-cab4910d7479 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:40.270757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee829edc-6cd7-40f0-b9f0-cab4910d7479 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:40.403997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ee829edc-6cd7-40f0-b9f0-cab4910d7479 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:40.431055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ee829edc-6cd7-40f0-b9f0-cab4910d7479 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:40.432646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ee829edc-6cd7-40f0-b9f0-cab4910d7479 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:40.437621 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ee829edc-6cd7-40f0-b9f0-cab4910d7479 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.197600 Mar 05 21:10:40.441834 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2385/4757] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:40 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:41.476043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c15a7d34-eb50-457d-ade6-ec452076795e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:41.477373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c15a7d34-eb50-457d-ade6-ec452076795e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:41.487353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c15a7d34-eb50-457d-ade6-ec452076795e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:41.492423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c15a7d34-eb50-457d-ade6-ec452076795e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:41.493537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c15a7d34-eb50-457d-ade6-ec452076795e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:41.494487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c15a7d34-eb50-457d-ade6-ec452076795e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:41.709811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d5a393ec-8c8c-4892-a698-5e00ad1450cb tempest-QuotasTestJSON-900249474 tempest-QuotasTestJSON-900249474-project] Calling method '.version_select at 0x7fed4ffaf550>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:41.789584 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d5a393ec-8c8c-4892-a698-5e00ad1450cb tempest-QuotasTestJSON-900249474 tempest-QuotasTestJSON-900249474-project] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/c06d86a36b804f7a8147c07be3a4b6f8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.632243 Mar 05 21:10:41.790553 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2373/4758] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 21:10:41 2022] GET /compute/v2.1/os-quota-sets/c06d86a36b804f7a8147c07be3a4b6f8/defaults => generated 371 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:10:41.805632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6e273661-149e-4a5d-ac63-49f0a58cbb60 tempest-QuotasTestJSON-900249474 tempest-QuotasTestJSON-900249474-project] Calling method '.version_select at 0x7fed61ab3550>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:41.913861 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6e273661-149e-4a5d-ac63-49f0a58cbb60 tempest-QuotasTestJSON-900249474 tempest-QuotasTestJSON-900249474-project] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/c06d86a36b804f7a8147c07be3a4b6f8" status: 200 len: 371 microversion: 2.1 time: 0.113404 Mar 05 21:10:41.922655 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2374/4759] 10.222.0.15 () {58 vars in 1241 bytes} [Sat Mar 5 21:10:41 2022] GET /compute/v2.1/os-quota-sets/c06d86a36b804f7a8147c07be3a4b6f8 => generated 371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:10:41.932096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c583811-6e6d-4098-82f7-9095c668d87c tempest-QuotasTestJSON-900249474 tempest-QuotasTestJSON-900249474-project] Calling method '.version_select at 0x7fed4f9fc280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:42.032196 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4c583811-6e6d-4098-82f7-9095c668d87c tempest-QuotasTestJSON-900249474 tempest-QuotasTestJSON-900249474-project] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/c06d86a36b804f7a8147c07be3a4b6f8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.107796 Mar 05 21:10:42.033361 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2375/4760] 10.222.0.15 () {58 vars in 1268 bytes} [Sat Mar 5 21:10:41 2022] GET /compute/v2.1/os-quota-sets/c06d86a36b804f7a8147c07be3a4b6f8/defaults => generated 371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:10:42.046483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-345f3fa3-32c1-40a2-9538-eb6f9b6817aa tempest-QuotasTestJSON-900249474 tempest-QuotasTestJSON-900249474-project] Calling method '.version_select at 0x7fed61ab35e0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:42.077417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c15a7d34-eb50-457d-ade6-ec452076795e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:42.102597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c15a7d34-eb50-457d-ade6-ec452076795e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:42.105400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c15a7d34-eb50-457d-ade6-ec452076795e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:42.108251 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c15a7d34-eb50-457d-ade6-ec452076795e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.645678 Mar 05 21:10:42.112578 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2386/4761] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:41 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:42.158837 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-345f3fa3-32c1-40a2-9538-eb6f9b6817aa tempest-QuotasTestJSON-900249474 tempest-QuotasTestJSON-900249474-project] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/c06d86a36b804f7a8147c07be3a4b6f8" status: 200 len: 371 microversion: 2.1 time: 0.117542 Mar 05 21:10:42.165794 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2376/4762] 10.222.0.15 () {58 vars in 1241 bytes} [Sat Mar 5 21:10:42 2022] GET /compute/v2.1/os-quota-sets/c06d86a36b804f7a8147c07be3a4b6f8 => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:10:42.170148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67b76bd5-1485-4f43-8c34-f69fdfb74c9a tempest-QuotasTestJSON-900249474 tempest-QuotasTestJSON-900249474-project] Calling method '.version_select at 0x7fed61ad7040>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:42.294109 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67b76bd5-1485-4f43-8c34-f69fdfb74c9a tempest-QuotasTestJSON-900249474 tempest-QuotasTestJSON-900249474-project] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/c06d86a36b804f7a8147c07be3a4b6f8?user_id=e12449b6134f4ce8bc0abde2bc1d723f" status: 200 len: 371 microversion: 2.1 time: 0.127549 Mar 05 21:10:42.295392 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2387/4763] 10.222.0.15 () {58 vars in 1322 bytes} [Sat Mar 5 21:10:42 2022] GET /compute/v2.1/os-quota-sets/c06d86a36b804f7a8147c07be3a4b6f8?user_id=e12449b6134f4ce8bc0abde2bc1d723f => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:10:43.132012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-31148523-4d87-4586-a7e9-d203a83c96ea tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:43.133223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-31148523-4d87-4586-a7e9-d203a83c96ea tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:43.149585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31148523-4d87-4586-a7e9-d203a83c96ea tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:43.150334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31148523-4d87-4586-a7e9-d203a83c96ea tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:43.151297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31148523-4d87-4586-a7e9-d203a83c96ea tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:43.151930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-31148523-4d87-4586-a7e9-d203a83c96ea tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:43.444485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-31148523-4d87-4586-a7e9-d203a83c96ea tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:43.454062 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-31148523-4d87-4586-a7e9-d203a83c96ea tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:43.455589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-31148523-4d87-4586-a7e9-d203a83c96ea tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:43.456848 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-31148523-4d87-4586-a7e9-d203a83c96ea tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.329317 Mar 05 21:10:43.465194 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2377/4764] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:43 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:44.492757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b8c2a731-1a40-4996-9d49-2cef4f3a0a03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:44.493713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b8c2a731-1a40-4996-9d49-2cef4f3a0a03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:44.512834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8c2a731-1a40-4996-9d49-2cef4f3a0a03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:44.519140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8c2a731-1a40-4996-9d49-2cef4f3a0a03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:44.520487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8c2a731-1a40-4996-9d49-2cef4f3a0a03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:44.526021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8c2a731-1a40-4996-9d49-2cef4f3a0a03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:44.785197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b8c2a731-1a40-4996-9d49-2cef4f3a0a03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:44.798049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b8c2a731-1a40-4996-9d49-2cef4f3a0a03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:44.799719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b8c2a731-1a40-4996-9d49-2cef4f3a0a03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:44.801506 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b8c2a731-1a40-4996-9d49-2cef4f3a0a03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.321533 Mar 05 21:10:44.803126 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2388/4765] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:44 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:45.830769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2965f43a-a0b1-4977-bcb6-959675dcb2db tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:45.833695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2965f43a-a0b1-4977-bcb6-959675dcb2db tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:45.846436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2965f43a-a0b1-4977-bcb6-959675dcb2db tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:45.846898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2965f43a-a0b1-4977-bcb6-959675dcb2db tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:45.848196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2965f43a-a0b1-4977-bcb6-959675dcb2db tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:45.848920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2965f43a-a0b1-4977-bcb6-959675dcb2db tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:46.006494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2965f43a-a0b1-4977-bcb6-959675dcb2db tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:46.023052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2965f43a-a0b1-4977-bcb6-959675dcb2db tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:46.026911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2965f43a-a0b1-4977-bcb6-959675dcb2db tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:46.030861 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2965f43a-a0b1-4977-bcb6-959675dcb2db tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.207742 Mar 05 21:10:46.033973 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2378/4766] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:45 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:47.054154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eb7d74e0-a5db-454e-9f62-a94e397c47a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:47.055648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eb7d74e0-a5db-454e-9f62-a94e397c47a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:47.068217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb7d74e0-a5db-454e-9f62-a94e397c47a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:47.071627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb7d74e0-a5db-454e-9f62-a94e397c47a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:47.075317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb7d74e0-a5db-454e-9f62-a94e397c47a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:47.077486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb7d74e0-a5db-454e-9f62-a94e397c47a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:47.316402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eb7d74e0-a5db-454e-9f62-a94e397c47a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:47.334904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eb7d74e0-a5db-454e-9f62-a94e397c47a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:47.337341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eb7d74e0-a5db-454e-9f62-a94e397c47a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:47.342078 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eb7d74e0-a5db-454e-9f62-a94e397c47a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.291253 Mar 05 21:10:47.360541 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2389/4767] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:47 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:48.368350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dbe6f710-50a1-4a62-8844-5db0e802abac tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:48.369689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dbe6f710-50a1-4a62-8844-5db0e802abac tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:48.389318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dbe6f710-50a1-4a62-8844-5db0e802abac tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:48.393757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dbe6f710-50a1-4a62-8844-5db0e802abac tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:48.394967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dbe6f710-50a1-4a62-8844-5db0e802abac tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:48.396141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dbe6f710-50a1-4a62-8844-5db0e802abac tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:48.552374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dbe6f710-50a1-4a62-8844-5db0e802abac tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:48.571414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dbe6f710-50a1-4a62-8844-5db0e802abac tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:48.574616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dbe6f710-50a1-4a62-8844-5db0e802abac tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:48.581394 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dbe6f710-50a1-4a62-8844-5db0e802abac tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.216237 Mar 05 21:10:48.582022 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2379/4768] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:48 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:49.614345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3eab9b8e-8c9a-48dc-95d2-62ff0f76e0a9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:49.615086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3eab9b8e-8c9a-48dc-95d2-62ff0f76e0a9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:49.632639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3eab9b8e-8c9a-48dc-95d2-62ff0f76e0a9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:49.633894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3eab9b8e-8c9a-48dc-95d2-62ff0f76e0a9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:49.634945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3eab9b8e-8c9a-48dc-95d2-62ff0f76e0a9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:49.635571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3eab9b8e-8c9a-48dc-95d2-62ff0f76e0a9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:50.283436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3eab9b8e-8c9a-48dc-95d2-62ff0f76e0a9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:50.304205 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3eab9b8e-8c9a-48dc-95d2-62ff0f76e0a9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:50.313747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3eab9b8e-8c9a-48dc-95d2-62ff0f76e0a9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:50.318619 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3eab9b8e-8c9a-48dc-95d2-62ff0f76e0a9 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.713852 Mar 05 21:10:50.321376 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2390/4769] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:49 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:51.340700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eae359ab-bd57-4108-85b1-221fa5ca49a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:51.343065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eae359ab-bd57-4108-85b1-221fa5ca49a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:51.352309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eae359ab-bd57-4108-85b1-221fa5ca49a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:51.352940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eae359ab-bd57-4108-85b1-221fa5ca49a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:51.354522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eae359ab-bd57-4108-85b1-221fa5ca49a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:51.355115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eae359ab-bd57-4108-85b1-221fa5ca49a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:51.648601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eae359ab-bd57-4108-85b1-221fa5ca49a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:51.666379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eae359ab-bd57-4108-85b1-221fa5ca49a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:51.668271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eae359ab-bd57-4108-85b1-221fa5ca49a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:51.693833 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eae359ab-bd57-4108-85b1-221fa5ca49a8 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.357957 Mar 05 21:10:51.695751 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2380/4770] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:51 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:52.720306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9418c1cd-df8b-4021-b5ec-2200e0a0aa2d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:52.720942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9418c1cd-df8b-4021-b5ec-2200e0a0aa2d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:52.742748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9418c1cd-df8b-4021-b5ec-2200e0a0aa2d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:52.747137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9418c1cd-df8b-4021-b5ec-2200e0a0aa2d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:52.751469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9418c1cd-df8b-4021-b5ec-2200e0a0aa2d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:52.752557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9418c1cd-df8b-4021-b5ec-2200e0a0aa2d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:52.975795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9418c1cd-df8b-4021-b5ec-2200e0a0aa2d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:52.994952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9418c1cd-df8b-4021-b5ec-2200e0a0aa2d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:53.005253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9418c1cd-df8b-4021-b5ec-2200e0a0aa2d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:53.012600 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9418c1cd-df8b-4021-b5ec-2200e0a0aa2d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.301116 Mar 05 21:10:53.015937 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2391/4771] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:52 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:54.041481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d7b99497-28d7-4afc-9eb4-36af14a07a3d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:54.042111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d7b99497-28d7-4afc-9eb4-36af14a07a3d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:54.053627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7b99497-28d7-4afc-9eb4-36af14a07a3d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:54.068460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7b99497-28d7-4afc-9eb4-36af14a07a3d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:54.069627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7b99497-28d7-4afc-9eb4-36af14a07a3d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:54.070241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7b99497-28d7-4afc-9eb4-36af14a07a3d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:54.226099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d7b99497-28d7-4afc-9eb4-36af14a07a3d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:54.239068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d7b99497-28d7-4afc-9eb4-36af14a07a3d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:54.241079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d7b99497-28d7-4afc-9eb4-36af14a07a3d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:54.246139 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d7b99497-28d7-4afc-9eb4-36af14a07a3d tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.213021 Mar 05 21:10:54.258837 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2381/4772] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:54 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:55.266190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-62adb7f8-feb4-4212-ad59-f7df9157f863 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:55.267076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-62adb7f8-feb4-4212-ad59-f7df9157f863 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:55.280127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62adb7f8-feb4-4212-ad59-f7df9157f863 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:55.298154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62adb7f8-feb4-4212-ad59-f7df9157f863 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:55.299863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62adb7f8-feb4-4212-ad59-f7df9157f863 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:55.300516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62adb7f8-feb4-4212-ad59-f7df9157f863 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:55.787642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-62adb7f8-feb4-4212-ad59-f7df9157f863 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:55.799372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-62adb7f8-feb4-4212-ad59-f7df9157f863 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:55.805419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-62adb7f8-feb4-4212-ad59-f7df9157f863 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:55.815140 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-62adb7f8-feb4-4212-ad59-f7df9157f863 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.553201 Mar 05 21:10:55.816038 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2392/4773] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:55 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:56.836443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-013876f4-2c09-4ec8-929c-aa74979f1e03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:56.838270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-013876f4-2c09-4ec8-929c-aa74979f1e03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:56.851302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-013876f4-2c09-4ec8-929c-aa74979f1e03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:56.855061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-013876f4-2c09-4ec8-929c-aa74979f1e03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:56.855975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-013876f4-2c09-4ec8-929c-aa74979f1e03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:56.856957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-013876f4-2c09-4ec8-929c-aa74979f1e03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:57.110964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-013876f4-2c09-4ec8-929c-aa74979f1e03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:57.131217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-013876f4-2c09-4ec8-929c-aa74979f1e03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:57.144348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-013876f4-2c09-4ec8-929c-aa74979f1e03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:57.149546 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-013876f4-2c09-4ec8-929c-aa74979f1e03 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.318400 Mar 05 21:10:57.152936 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2382/4774] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:56 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:58.170505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3e546e46-705e-44e2-a727-cf67b72d62e3 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:58.171938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3e546e46-705e-44e2-a727-cf67b72d62e3 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:58.187226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e546e46-705e-44e2-a727-cf67b72d62e3 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:58.188371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e546e46-705e-44e2-a727-cf67b72d62e3 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:58.189503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e546e46-705e-44e2-a727-cf67b72d62e3 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:58.190107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e546e46-705e-44e2-a727-cf67b72d62e3 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:58.294592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3e546e46-705e-44e2-a727-cf67b72d62e3 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:58.308420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3e546e46-705e-44e2-a727-cf67b72d62e3 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:58.317297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3e546e46-705e-44e2-a727-cf67b72d62e3 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:10:58.319728 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3e546e46-705e-44e2-a727-cf67b72d62e3 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1407 microversion: 2.54 time: 0.154189 Mar 05 21:10:58.331833 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2393/4775] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:58 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:10:58.895302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-51c257f6-8bb8-451f-8a36-da9d3f67180d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Action: 'create', calling method: .version_select at 0x7fed5c21e1f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-573613390"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:58.915920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-51c257f6-8bb8-451f-8a36-da9d3f67180d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:10:58.930868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-51c257f6-8bb8-451f-8a36-da9d3f67180d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for user 76b63093654943e6ac89d2b22e4f756a and project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:10:59.141224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-51c257f6-8bb8-451f-8a36-da9d3f67180d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:10:59.156919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-51c257f6-8bb8-451f-8a36-da9d3f67180d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for user 76b63093654943e6ac89d2b22e4f756a and project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:10:59.220622 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-51c257f6-8bb8-451f-8a36-da9d3f67180d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.330086 Mar 05 21:10:59.228020 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2383/4776] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:10:58 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:10:59.344404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7c7ad73e-91ef-4132-a593-5595112529b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:10:59.346410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7c7ad73e-91ef-4132-a593-5595112529b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:10:59.358929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c7ad73e-91ef-4132-a593-5595112529b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:59.363213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c7ad73e-91ef-4132-a593-5595112529b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:59.364686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c7ad73e-91ef-4132-a593-5595112529b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:10:59.366230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c7ad73e-91ef-4132-a593-5595112529b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:10:59.386980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3926bc7f-89a3-46fb-866c-c72e71d65077 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Action: 'create', calling method: .version_select at 0x7fed61ad7160>, body: {"keypair": {"name": "tempest-keypair-1889518175"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:10:59.486604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-3926bc7f-89a3-46fb-866c-c72e71d65077 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:10:59.507314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-3926bc7f-89a3-46fb-866c-c72e71d65077 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for user 8bee90d7a5af4246b85ff0cb89217700 and project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:10:59.758264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-3926bc7f-89a3-46fb-866c-c72e71d65077 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:10:59.774015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-3926bc7f-89a3-46fb-866c-c72e71d65077 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for user 8bee90d7a5af4246b85ff0cb89217700 and project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:10:59.834649 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3926bc7f-89a3-46fb-866c-c72e71d65077 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.807713 Mar 05 21:10:59.839884 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2394/4777] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:10:59 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:11:00.449914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7c7ad73e-91ef-4132-a593-5595112529b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:00.496155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7c7ad73e-91ef-4132-a593-5595112529b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:00.501094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7c7ad73e-91ef-4132-a593-5595112529b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:00.505288 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7c7ad73e-91ef-4132-a593-5595112529b2 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1413 microversion: 2.54 time: 1.168403 Mar 05 21:11:00.516327 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2384/4778] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:10:59 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1413 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:01.537167 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7b9d971d-631b-43d9-8951-1a8e5ee84e89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:01.538733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7b9d971d-631b-43d9-8951-1a8e5ee84e89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:01.553449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b9d971d-631b-43d9-8951-1a8e5ee84e89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:01.554611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b9d971d-631b-43d9-8951-1a8e5ee84e89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:01.555946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b9d971d-631b-43d9-8951-1a8e5ee84e89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:01.556909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b9d971d-631b-43d9-8951-1a8e5ee84e89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:01.871485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7b9d971d-631b-43d9-8951-1a8e5ee84e89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:01.884749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7b9d971d-631b-43d9-8951-1a8e5ee84e89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:01.889285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7b9d971d-631b-43d9-8951-1a8e5ee84e89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:01.894188 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7b9d971d-631b-43d9-8951-1a8e5ee84e89 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1398 microversion: 2.54 time: 0.361021 Mar 05 21:11:01.895828 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2395/4779] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:01 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1398 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:01.914450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f33e3a3-2494-4b65-a773-3f69cd394bcc tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '.version_select at 0x7fed4f9fce50>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:01.949773 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5f33e3a3-2494-4b65-a773-3f69cd394bcc tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-93918886" status: 204 len: 0 microversion: 2.54 time: 0.038857 Mar 05 21:11:01.951387 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2385/4780] 10.222.0.15 () {60 vars in 1312 bytes} [Sat Mar 5 21:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-93918886 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:11:01.964277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-70525205-3d6f-42f7-9399-997fd3b099bf tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:01.964814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-70525205-3d6f-42f7-9399-997fd3b099bf tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:01.976526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70525205-3d6f-42f7-9399-997fd3b099bf tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:01.976917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70525205-3d6f-42f7-9399-997fd3b099bf tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:01.977721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70525205-3d6f-42f7-9399-997fd3b099bf tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:01.985077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-70525205-3d6f-42f7-9399-997fd3b099bf tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:02.059577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-70525205-3d6f-42f7-9399-997fd3b099bf tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:11:02.245606 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-70525205-3d6f-42f7-9399-997fd3b099bf tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 204 len: 0 microversion: 2.54 time: 0.286104 Mar 05 21:11:02.246499 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2396/4781] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:11:01 2022] DELETE /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:11:02.256742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0e429655-82d3-42ef-9a84-5de729c3ab2c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:02.257368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0e429655-82d3-42ef-9a84-5de729c3ab2c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:02.267852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e429655-82d3-42ef-9a84-5de729c3ab2c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:02.268196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e429655-82d3-42ef-9a84-5de729c3ab2c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:02.275554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e429655-82d3-42ef-9a84-5de729c3ab2c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:02.276437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0e429655-82d3-42ef-9a84-5de729c3ab2c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:02.509677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0e429655-82d3-42ef-9a84-5de729c3ab2c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:02.519628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0e429655-82d3-42ef-9a84-5de729c3ab2c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:02.525490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0e429655-82d3-42ef-9a84-5de729c3ab2c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:02.526820 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0e429655-82d3-42ef-9a84-5de729c3ab2c tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1404 microversion: 2.54 time: 0.275336 Mar 05 21:11:02.527383 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2386/4782] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:02 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1404 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:03.550373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6d00facf-55a8-4e76-87ad-371753af2562 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:03.551755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6d00facf-55a8-4e76-87ad-371753af2562 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:03.593688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d00facf-55a8-4e76-87ad-371753af2562 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:03.595430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d00facf-55a8-4e76-87ad-371753af2562 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:03.598998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d00facf-55a8-4e76-87ad-371753af2562 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:03.599902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d00facf-55a8-4e76-87ad-371753af2562 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:03.788187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6d00facf-55a8-4e76-87ad-371753af2562 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:03.813125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6d00facf-55a8-4e76-87ad-371753af2562 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:03.815144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6d00facf-55a8-4e76-87ad-371753af2562 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:03.820233 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6d00facf-55a8-4e76-87ad-371753af2562 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1404 microversion: 2.54 time: 0.276650 Mar 05 21:11:03.843872 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2397/4783] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:03 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1404 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:04.024090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1926698822", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "5d790b17-850c-4d1e-9bd5-defe0ee9f1b9"}], "key_name": "tempest-TestNetworkBasicOps-573613390", "security_groups": [{"name": "tempest-secgroup-smoke-1926126507"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:11:04.258122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] validate_networks() for [('5d790b17-850c-4d1e-9bd5-defe0ee9f1b9', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:11:04.860947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a826b2df-6621-4b28-a3b3-fccf013b1b9e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:04.862168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a826b2df-6621-4b28-a3b3-fccf013b1b9e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:04.876471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a826b2df-6621-4b28-a3b3-fccf013b1b9e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:04.878666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a826b2df-6621-4b28-a3b3-fccf013b1b9e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:04.879649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a826b2df-6621-4b28-a3b3-fccf013b1b9e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:04.880279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a826b2df-6621-4b28-a3b3-fccf013b1b9e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:04.957492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a826b2df-6621-4b28-a3b3-fccf013b1b9e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:04.958127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a826b2df-6621-4b28-a3b3-fccf013b1b9e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:04.959543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-a826b2df-6621-4b28-a3b3-fccf013b1b9e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lazy-loading 'fault' on Instance uuid 8c4d299a-10b8-4637-89ed-b4e95ae36609 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:11:05.187505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a826b2df-6621-4b28-a3b3-fccf013b1b9e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:05.203023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a826b2df-6621-4b28-a3b3-fccf013b1b9e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:05.217103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a826b2df-6621-4b28-a3b3-fccf013b1b9e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50763cc4dce0450598bac0a39d2de760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914909471bb5484e81c7e44e2ef33835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:05.221537 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a826b2df-6621-4b28-a3b3-fccf013b1b9e tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 200 len: 1409 microversion: 2.54 time: 0.376129 Mar 05 21:11:05.224511 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2398/4784] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:04 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 1409 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:06.244494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-26ccbcf9-e1db-45f1-8ec8-910ce48dc344 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:06.245122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-26ccbcf9-e1db-45f1-8ec8-910ce48dc344 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] [instance: 8c4d299a-10b8-4637-89ed-b4e95ae36609] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:06.262727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26ccbcf9-e1db-45f1-8ec8-910ce48dc344 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:06.264141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26ccbcf9-e1db-45f1-8ec8-910ce48dc344 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:06.265122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26ccbcf9-e1db-45f1-8ec8-910ce48dc344 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:06.265733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26ccbcf9-e1db-45f1-8ec8-910ce48dc344 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:06.299470 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-26ccbcf9-e1db-45f1-8ec8-910ce48dc344 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] HTTP exception thrown: Instance 8c4d299a-10b8-4637-89ed-b4e95ae36609 could not be found. Mar 05 21:11:06.300413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-26ccbcf9-e1db-45f1-8ec8-910ce48dc344 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] Returning 404 to user: Instance 8c4d299a-10b8-4637-89ed-b4e95ae36609 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:11:06.306876 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-26ccbcf9-e1db-45f1-8ec8-910ce48dc344 tempest-ServerShowV254Test-45596011 tempest-ServerShowV254Test-45596011-project] 10.222.0.15 "GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609" status: 404 len: 111 microversion: 2.54 time: 0.066240 Mar 05 21:11:06.308002 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2399/4785] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:06 2022] GET /compute/v2.1/servers/8c4d299a-10b8-4637-89ed-b4e95ae36609 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:11:06.313266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:11:06.314596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:11:06.315252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:11:06.316507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:11:06.317223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:11:06.333184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:06.333907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:06.336697 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:06.337334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:06.397708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-6901799", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b56f14b9-afc0-424d-b080-c31779583b66"}], "security_groups": [{"name": "tempest-securitygroup--1737963399"}], "key_name": "tempest-keypair-1889518175", "user_data": "}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:11:06.402480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:11:06.418757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for user 76b63093654943e6ac89d2b22e4f756a and project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:11:06.452463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:11:06.463209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:11:06.556909 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4c2394b5-6b6f-4ba9-956e-38c5ad4ea0d0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.536073 Mar 05 21:11:06.558084 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2387/4786] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:11:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 2539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:11:06.574123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-01be733a-f8f9-4363-b93a-d41acb30c849 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:06.581495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-01be733a-f8f9-4363-b93a-d41acb30c849 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:06.613064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] validate_networks() for [('b56f14b9-afc0-424d-b080-c31779583b66', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:11:06.766085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-01be733a-f8f9-4363-b93a-d41acb30c849 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:06.780324 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-01be733a-f8f9-4363-b93a-d41acb30c849 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1248 microversion: 2.1 time: 0.212454 Mar 05 21:11:06.781534 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2388/4787] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:06 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1248 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:07.799537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0214cc33-d671-4aec-b1fb-808313fc78e0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:07.800357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0214cc33-d671-4aec-b1fb-808313fc78e0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:07.814543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0214cc33-d671-4aec-b1fb-808313fc78e0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:07.815327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0214cc33-d671-4aec-b1fb-808313fc78e0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:07.816618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0214cc33-d671-4aec-b1fb-808313fc78e0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:07.819064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0214cc33-d671-4aec-b1fb-808313fc78e0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:07.964046 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0214cc33-d671-4aec-b1fb-808313fc78e0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:07.976816 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0214cc33-d671-4aec-b1fb-808313fc78e0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1244 microversion: 2.1 time: 0.181976 Mar 05 21:11:07.978380 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2389/4788] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:07 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1244 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:11:08.688005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:11:08.688975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:11:08.689802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:11:08.690386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:11:08.691160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:11:08.706061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:08.706906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:08.708011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:08.708684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:08.729831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for project f73f6888043940b9b1344c6998b423da. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:11:08.737234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for user 8bee90d7a5af4246b85ff0cb89217700 and project f73f6888043940b9b1344c6998b423da. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:11:08.754561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:11:08.758672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:11:08.871279 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-100af60e-7b81-46cc-991d-ff3987120685 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.478032 Mar 05 21:11:08.873157 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2400/4789] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:11:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:11:08.884507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-681c314f-cd5a-4145-b0c1-29af17fba74d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:08.885120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-681c314f-cd5a-4145-b0c1-29af17fba74d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:09.001028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-14b79efc-d6de-4ee4-bdb8-2748983cd1be tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:09.001521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-14b79efc-d6de-4ee4-bdb8-2748983cd1be tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:09.017517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14b79efc-d6de-4ee4-bdb8-2748983cd1be tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:09.022442 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14b79efc-d6de-4ee4-bdb8-2748983cd1be tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:09.025715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14b79efc-d6de-4ee4-bdb8-2748983cd1be tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:09.026100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14b79efc-d6de-4ee4-bdb8-2748983cd1be tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:09.075433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-681c314f-cd5a-4145-b0c1-29af17fba74d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:09.088624 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-681c314f-cd5a-4145-b0c1-29af17fba74d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1239 microversion: 2.1 time: 0.207605 Mar 05 21:11:09.091269 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2390/4790] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:08 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1239 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:09.180178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-14b79efc-d6de-4ee4-bdb8-2748983cd1be tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:09.194530 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-14b79efc-d6de-4ee4-bdb8-2748983cd1be tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1306 microversion: 2.1 time: 0.201616 Mar 05 21:11:09.199211 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2401/4791] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:08 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:11:10.111052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d534bba1-9cc0-432b-bc2e-e035e797eae0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:10.113309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d534bba1-9cc0-432b-bc2e-e035e797eae0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:10.131242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d534bba1-9cc0-432b-bc2e-e035e797eae0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:10.134290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d534bba1-9cc0-432b-bc2e-e035e797eae0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:10.136732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d534bba1-9cc0-432b-bc2e-e035e797eae0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:10.140489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d534bba1-9cc0-432b-bc2e-e035e797eae0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:10.218350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7fbb9cac-5f78-4d00-908f-b03a09b1963c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:10.220011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7fbb9cac-5f78-4d00-908f-b03a09b1963c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:10.234738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fbb9cac-5f78-4d00-908f-b03a09b1963c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:10.235221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fbb9cac-5f78-4d00-908f-b03a09b1963c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:10.236062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fbb9cac-5f78-4d00-908f-b03a09b1963c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:10.240027 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fbb9cac-5f78-4d00-908f-b03a09b1963c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:10.557053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7fbb9cac-5f78-4d00-908f-b03a09b1963c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:10.575893 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7fbb9cac-5f78-4d00-908f-b03a09b1963c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1306 microversion: 2.1 time: 0.363129 Mar 05 21:11:10.578504 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2402/4792] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:10 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1306 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:11:10.753010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d534bba1-9cc0-432b-bc2e-e035e797eae0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:10.762442 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d534bba1-9cc0-432b-bc2e-e035e797eae0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1291 microversion: 2.1 time: 0.657693 Mar 05 21:11:10.780816 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2391/4793] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:10 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1291 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:11.595064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-447c7615-d0c7-4e61-9fd5-c443f1481697 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:11.595740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-447c7615-d0c7-4e61-9fd5-c443f1481697 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:11.603057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-447c7615-d0c7-4e61-9fd5-c443f1481697 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:11.603527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-447c7615-d0c7-4e61-9fd5-c443f1481697 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:11.604363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-447c7615-d0c7-4e61-9fd5-c443f1481697 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:11.604817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-447c7615-d0c7-4e61-9fd5-c443f1481697 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:11.754406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-447c7615-d0c7-4e61-9fd5-c443f1481697 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:11.764055 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-447c7615-d0c7-4e61-9fd5-c443f1481697 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1306 microversion: 2.1 time: 0.173270 Mar 05 21:11:11.765198 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2403/4794] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:11 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1306 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:11.799352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0c758ea6-c823-4aaf-9a5c-730270bf0262 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:11.800952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0c758ea6-c823-4aaf-9a5c-730270bf0262 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:11.812075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c758ea6-c823-4aaf-9a5c-730270bf0262 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:11.813317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c758ea6-c823-4aaf-9a5c-730270bf0262 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:11.815729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c758ea6-c823-4aaf-9a5c-730270bf0262 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:11.816355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c758ea6-c823-4aaf-9a5c-730270bf0262 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:11.974115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0c758ea6-c823-4aaf-9a5c-730270bf0262 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:11.983597 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0c758ea6-c823-4aaf-9a5c-730270bf0262 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1297 microversion: 2.1 time: 0.190700 Mar 05 21:11:11.993864 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2392/4795] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:11 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1297 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:12.783043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-739aa8f7-6aff-482e-be7b-ef3a196c5baa tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:12.784006 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-739aa8f7-6aff-482e-be7b-ef3a196c5baa tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:12.796360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-739aa8f7-6aff-482e-be7b-ef3a196c5baa tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:12.797715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-739aa8f7-6aff-482e-be7b-ef3a196c5baa tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:12.800971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-739aa8f7-6aff-482e-be7b-ef3a196c5baa tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:12.801729 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-739aa8f7-6aff-482e-be7b-ef3a196c5baa tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:13.006668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cc12de6c-27fb-4551-928e-7f13e9d397d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:13.010349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cc12de6c-27fb-4551-928e-7f13e9d397d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:13.025307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc12de6c-27fb-4551-928e-7f13e9d397d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:13.026430 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc12de6c-27fb-4551-928e-7f13e9d397d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:13.027470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc12de6c-27fb-4551-928e-7f13e9d397d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:13.029253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc12de6c-27fb-4551-928e-7f13e9d397d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:13.248941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cc12de6c-27fb-4551-928e-7f13e9d397d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:13.280094 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cc12de6c-27fb-4551-928e-7f13e9d397d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1297 microversion: 2.1 time: 0.282972 Mar 05 21:11:13.291041 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2393/4796] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:12 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1297 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:13.329105 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-739aa8f7-6aff-482e-be7b-ef3a196c5baa tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:13.344198 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-739aa8f7-6aff-482e-be7b-ef3a196c5baa tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1374 microversion: 2.1 time: 0.560686 Mar 05 21:11:13.344866 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2404/4797] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:12 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1374 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:14.086334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-c1745384-0a40-4cb7-9d97-95e5d95059ff req-64c20cef-9c5b-490b-a07c-2d5ba185332e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0a57db-9d48-4aed-90ac-42492dda1a36", "tag": "ea1c2fe7-a4f7-4275-bd44-c9c3c90a0f5f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:11:14.100345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c1745384-0a40-4cb7-9d97-95e5d95059ff req-64c20cef-9c5b-490b-a07c-2d5ba185332e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:14.108750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c1745384-0a40-4cb7-9d97-95e5d95059ff req-64c20cef-9c5b-490b-a07c-2d5ba185332e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:14.128687 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-c1745384-0a40-4cb7-9d97-95e5d95059ff req-64c20cef-9c5b-490b-a07c-2d5ba185332e service nova] Creating event network-changed:ea1c2fe7-a4f7-4275-bd44-c9c3c90a0f5f for instance ce0a57db-9d48-4aed-90ac-42492dda1a36 on nch2-master-1 Mar 05 21:11:14.134378 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-c1745384-0a40-4cb7-9d97-95e5d95059ff req-64c20cef-9c5b-490b-a07c-2d5ba185332e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059436 Mar 05 21:11:14.136035 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2394/4798] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:11:14.300656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c97bc855-c91b-4fb3-8f57-13099d7a20cd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:14.301512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c97bc855-c91b-4fb3-8f57-13099d7a20cd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:14.308299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c97bc855-c91b-4fb3-8f57-13099d7a20cd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:14.317077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c97bc855-c91b-4fb3-8f57-13099d7a20cd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:14.318133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c97bc855-c91b-4fb3-8f57-13099d7a20cd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:14.318718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c97bc855-c91b-4fb3-8f57-13099d7a20cd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:14.363562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3eedb452-e6a2-402f-9fb4-be99b87b4cea tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:14.364408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3eedb452-e6a2-402f-9fb4-be99b87b4cea tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:14.385166 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3eedb452-e6a2-402f-9fb4-be99b87b4cea tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:14.385834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3eedb452-e6a2-402f-9fb4-be99b87b4cea tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:14.388314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3eedb452-e6a2-402f-9fb4-be99b87b4cea tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:14.391963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3eedb452-e6a2-402f-9fb4-be99b87b4cea tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:14.564823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c97bc855-c91b-4fb3-8f57-13099d7a20cd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:14.590020 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c97bc855-c91b-4fb3-8f57-13099d7a20cd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1297 microversion: 2.1 time: 0.293307 Mar 05 21:11:14.591881 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2405/4799] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:14 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1297 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:15.610549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b34b9ed3-21bf-45fc-a7e9-02db082a674d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:15.612707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b34b9ed3-21bf-45fc-a7e9-02db082a674d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:15.628988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b34b9ed3-21bf-45fc-a7e9-02db082a674d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:15.630266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b34b9ed3-21bf-45fc-a7e9-02db082a674d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:15.632394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b34b9ed3-21bf-45fc-a7e9-02db082a674d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:15.643514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b34b9ed3-21bf-45fc-a7e9-02db082a674d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:15.711900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3eedb452-e6a2-402f-9fb4-be99b87b4cea tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:15.732039 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3eedb452-e6a2-402f-9fb4-be99b87b4cea tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1374 microversion: 2.1 time: 1.372613 Mar 05 21:11:15.736296 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2395/4800] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:14 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1374 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:16.236437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b34b9ed3-21bf-45fc-a7e9-02db082a674d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:16.246936 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b34b9ed3-21bf-45fc-a7e9-02db082a674d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1365 microversion: 2.1 time: 0.642797 Mar 05 21:11:16.247368 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2406/4801] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:15 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1365 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:16.756041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e8bd5b3a-bc2e-49a8-976f-495c82cb03b0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:16.756655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e8bd5b3a-bc2e-49a8-976f-495c82cb03b0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:16.773643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8bd5b3a-bc2e-49a8-976f-495c82cb03b0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:16.774123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8bd5b3a-bc2e-49a8-976f-495c82cb03b0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:16.774944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8bd5b3a-bc2e-49a8-976f-495c82cb03b0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:16.775396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8bd5b3a-bc2e-49a8-976f-495c82cb03b0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:17.268064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8980ca8d-03d5-4834-9329-3d927891a53b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:17.268858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8980ca8d-03d5-4834-9329-3d927891a53b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:17.283245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8980ca8d-03d5-4834-9329-3d927891a53b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:17.286124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8980ca8d-03d5-4834-9329-3d927891a53b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:17.286987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8980ca8d-03d5-4834-9329-3d927891a53b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:17.287447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8980ca8d-03d5-4834-9329-3d927891a53b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:17.642725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8980ca8d-03d5-4834-9329-3d927891a53b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:17.650970 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8980ca8d-03d5-4834-9329-3d927891a53b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1365 microversion: 2.1 time: 0.390896 Mar 05 21:11:17.661669 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2407/4802] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:17 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1365 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:11:17.686311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e8bd5b3a-bc2e-49a8-976f-495c82cb03b0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:17.703098 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e8bd5b3a-bc2e-49a8-976f-495c82cb03b0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1374 microversion: 2.1 time: 0.956342 Mar 05 21:11:17.704154 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2396/4803] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:16 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1374 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:18.670272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-909266d5-8b57-4d47-a2d7-3ec5a74170a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:18.671390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-909266d5-8b57-4d47-a2d7-3ec5a74170a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:18.692235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-909266d5-8b57-4d47-a2d7-3ec5a74170a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:18.701134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-909266d5-8b57-4d47-a2d7-3ec5a74170a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:18.706109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-909266d5-8b57-4d47-a2d7-3ec5a74170a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:18.712267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-909266d5-8b57-4d47-a2d7-3ec5a74170a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:18.725962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a86ee098-51e0-41e1-8ae4-2cd75953272c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:18.726655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a86ee098-51e0-41e1-8ae4-2cd75953272c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:18.741396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a86ee098-51e0-41e1-8ae4-2cd75953272c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:18.743147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a86ee098-51e0-41e1-8ae4-2cd75953272c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:18.748172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a86ee098-51e0-41e1-8ae4-2cd75953272c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:18.753588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a86ee098-51e0-41e1-8ae4-2cd75953272c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:19.581820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-909266d5-8b57-4d47-a2d7-3ec5a74170a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:19.591262 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-909266d5-8b57-4d47-a2d7-3ec5a74170a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1365 microversion: 2.1 time: 0.925758 Mar 05 21:11:19.594587 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2408/4804] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:18 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1365 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:20.076968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a86ee098-51e0-41e1-8ae4-2cd75953272c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:20.086229 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a86ee098-51e0-41e1-8ae4-2cd75953272c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1374 microversion: 2.1 time: 1.369609 Mar 05 21:11:20.091792 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2397/4805] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:18 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1374 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:11:20.510679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-60c94cea-e94a-4aa3-8833-9f8ed312cec5 req-7d0068f3-2a27-46ce-bc8b-ac8f3fbec05f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "024b8477-8c82-4b91-879f-48b125f19e40", "tag": "dfe1078a-9630-493b-9b69-39e6676f5878"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:11:20.543036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-60c94cea-e94a-4aa3-8833-9f8ed312cec5 req-7d0068f3-2a27-46ce-bc8b-ac8f3fbec05f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:20.547542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-60c94cea-e94a-4aa3-8833-9f8ed312cec5 req-7d0068f3-2a27-46ce-bc8b-ac8f3fbec05f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:20.582592 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-60c94cea-e94a-4aa3-8833-9f8ed312cec5 req-7d0068f3-2a27-46ce-bc8b-ac8f3fbec05f service nova] Creating event network-changed:dfe1078a-9630-493b-9b69-39e6676f5878 for instance 024b8477-8c82-4b91-879f-48b125f19e40 on nch1-master-1 Mar 05 21:11:20.593523 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-60c94cea-e94a-4aa3-8833-9f8ed312cec5 req-7d0068f3-2a27-46ce-bc8b-ac8f3fbec05f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089331 Mar 05 21:11:20.596495 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2409/4806] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:11:20.611367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-35026e3f-d97f-477e-9252-ca3d65489751 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:20.612319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-35026e3f-d97f-477e-9252-ca3d65489751 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:20.628992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35026e3f-d97f-477e-9252-ca3d65489751 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:20.630681 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35026e3f-d97f-477e-9252-ca3d65489751 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:20.634797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35026e3f-d97f-477e-9252-ca3d65489751 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:20.635558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35026e3f-d97f-477e-9252-ca3d65489751 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:21.108065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b20afca4-9cc8-4ec1-bb24-713c91616f7e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:21.109068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b20afca4-9cc8-4ec1-bb24-713c91616f7e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:21.121129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b20afca4-9cc8-4ec1-bb24-713c91616f7e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:21.124240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b20afca4-9cc8-4ec1-bb24-713c91616f7e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:21.125311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b20afca4-9cc8-4ec1-bb24-713c91616f7e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:21.126016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b20afca4-9cc8-4ec1-bb24-713c91616f7e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:21.707725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b20afca4-9cc8-4ec1-bb24-713c91616f7e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:21.723201 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b20afca4-9cc8-4ec1-bb24-713c91616f7e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1374 microversion: 2.1 time: 0.620134 Mar 05 21:11:21.731953 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2410/4807] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:21 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1374 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:11:22.442770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-35026e3f-d97f-477e-9252-ca3d65489751 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:22.457109 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-35026e3f-d97f-477e-9252-ca3d65489751 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1365 microversion: 2.1 time: 1.849672 Mar 05 21:11:22.473299 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2398/4808] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:20 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1365 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:22.750382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2a21f307-2338-45a5-b315-85e3d6b37ef6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:22.751028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2a21f307-2338-45a5-b315-85e3d6b37ef6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:22.764489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a21f307-2338-45a5-b315-85e3d6b37ef6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:22.765045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a21f307-2338-45a5-b315-85e3d6b37ef6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:22.765859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a21f307-2338-45a5-b315-85e3d6b37ef6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:22.766562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2a21f307-2338-45a5-b315-85e3d6b37ef6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:23.476366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-527c7733-2827-400b-adbc-3f40614dcd36 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:23.477898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-527c7733-2827-400b-adbc-3f40614dcd36 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:23.489187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-527c7733-2827-400b-adbc-3f40614dcd36 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:23.493893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-527c7733-2827-400b-adbc-3f40614dcd36 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:23.494805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-527c7733-2827-400b-adbc-3f40614dcd36 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:23.495214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-527c7733-2827-400b-adbc-3f40614dcd36 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:24.252339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2a21f307-2338-45a5-b315-85e3d6b37ef6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:24.264954 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2a21f307-2338-45a5-b315-85e3d6b37ef6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1374 microversion: 2.1 time: 1.518695 Mar 05 21:11:24.279049 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2411/4809] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:22 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1374 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:24.645666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-527c7733-2827-400b-adbc-3f40614dcd36 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:24.662124 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-527c7733-2827-400b-adbc-3f40614dcd36 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1365 microversion: 2.1 time: 1.189696 Mar 05 21:11:24.663567 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2399/4810] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:23 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1365 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:11:25.289949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ae3f2ba-deb6-4a06-b5a3-033d8f1c6521 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:25.291562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ae3f2ba-deb6-4a06-b5a3-033d8f1c6521 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:25.303240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ae3f2ba-deb6-4a06-b5a3-033d8f1c6521 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:25.304104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ae3f2ba-deb6-4a06-b5a3-033d8f1c6521 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:25.306174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ae3f2ba-deb6-4a06-b5a3-033d8f1c6521 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:25.307108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ae3f2ba-deb6-4a06-b5a3-033d8f1c6521 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:25.684915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8b716552-4aa2-4ac9-ae18-56536270b415 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:25.686750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8b716552-4aa2-4ac9-ae18-56536270b415 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:25.707640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b716552-4aa2-4ac9-ae18-56536270b415 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:25.708493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b716552-4aa2-4ac9-ae18-56536270b415 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:25.709559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b716552-4aa2-4ac9-ae18-56536270b415 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:25.710763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b716552-4aa2-4ac9-ae18-56536270b415 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:26.087287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8b716552-4aa2-4ac9-ae18-56536270b415 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:26.101896 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8b716552-4aa2-4ac9-ae18-56536270b415 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1365 microversion: 2.1 time: 0.421906 Mar 05 21:11:26.114045 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2400/4811] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:25 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:26.453199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-10323ae3-e10a-4680-9b9e-d88a42dbafcd req-b7ed2544-9e39-47c0-ae85-62ace6de7e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0a57db-9d48-4aed-90ac-42492dda1a36", "name": "network-vif-plugged", "status": "completed", "tag": "ea1c2fe7-a4f7-4275-bd44-c9c3c90a0f5f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:11:26.471919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-10323ae3-e10a-4680-9b9e-d88a42dbafcd req-b7ed2544-9e39-47c0-ae85-62ace6de7e93 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:26.472400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-10323ae3-e10a-4680-9b9e-d88a42dbafcd req-b7ed2544-9e39-47c0-ae85-62ace6de7e93 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:26.500171 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-10323ae3-e10a-4680-9b9e-d88a42dbafcd req-b7ed2544-9e39-47c0-ae85-62ace6de7e93 service nova] Creating event network-vif-plugged:ea1c2fe7-a4f7-4275-bd44-c9c3c90a0f5f for instance ce0a57db-9d48-4aed-90ac-42492dda1a36 on nch2-master-1 Mar 05 21:11:26.537438 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-10323ae3-e10a-4680-9b9e-d88a42dbafcd req-b7ed2544-9e39-47c0-ae85-62ace6de7e93 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087749 Mar 05 21:11:26.543129 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2401/4812] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:11:26.645224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9ae3f2ba-deb6-4a06-b5a3-033d8f1c6521 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:26.659752 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ae3f2ba-deb6-4a06-b5a3-033d8f1c6521 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1374 microversion: 2.1 time: 1.374407 Mar 05 21:11:26.660418 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2412/4813] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:25 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1374 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:27.123543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-91337f43-82f1-4164-862a-cefb180fba82 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:27.126117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-91337f43-82f1-4164-862a-cefb180fba82 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:27.149072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91337f43-82f1-4164-862a-cefb180fba82 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:27.149685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91337f43-82f1-4164-862a-cefb180fba82 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:27.150534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91337f43-82f1-4164-862a-cefb180fba82 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:27.150980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-91337f43-82f1-4164-862a-cefb180fba82 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:27.795180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4930bae8-b0f5-40ab-be0b-536acf99f901 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:27.797015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4930bae8-b0f5-40ab-be0b-536acf99f901 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:27.813880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4930bae8-b0f5-40ab-be0b-536acf99f901 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:27.814545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4930bae8-b0f5-40ab-be0b-536acf99f901 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:27.815526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4930bae8-b0f5-40ab-be0b-536acf99f901 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:27.815986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4930bae8-b0f5-40ab-be0b-536acf99f901 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:27.847217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-91337f43-82f1-4164-862a-cefb180fba82 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:27.857651 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-91337f43-82f1-4164-862a-cefb180fba82 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1365 microversion: 2.1 time: 0.740573 Mar 05 21:11:27.857821 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2402/4814] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:27 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1365 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:11:28.237795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4930bae8-b0f5-40ab-be0b-536acf99f901 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:28.245259 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4930bae8-b0f5-40ab-be0b-536acf99f901 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1374 microversion: 2.1 time: 0.454677 Mar 05 21:11:28.254690 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2413/4815] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:27 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1374 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:28.526119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8082c150-e1e1-4e2c-a142-ca009c05c7fe tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Action: 'create', calling method: .version_select at 0x7fed4f93bf70>, body: {"keypair": {"name": "tempest-keypair-1998843121"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:11:28.549645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8082c150-e1e1-4e2c-a142-ca009c05c7fe tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Getting quotas for project 5c1b37634bef4eefa974dfc8912e8556. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:11:28.559971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8082c150-e1e1-4e2c-a142-ca009c05c7fe tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Getting quotas for user 469bc2b7ea9e4727a0f0356e9a08dcb2 and project 5c1b37634bef4eefa974dfc8912e8556. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:11:28.801816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8082c150-e1e1-4e2c-a142-ca009c05c7fe tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Getting quotas for project 5c1b37634bef4eefa974dfc8912e8556. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:11:28.809524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-8082c150-e1e1-4e2c-a142-ca009c05c7fe tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Getting quotas for user 469bc2b7ea9e4727a0f0356e9a08dcb2 and project 5c1b37634bef4eefa974dfc8912e8556. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:11:28.845123 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8082c150-e1e1-4e2c-a142-ca009c05c7fe tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.693191 Mar 05 21:11:28.853638 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2403/4816] 10.222.0.15 () {62 vars in 1198 bytes} [Sat Mar 5 21:11:28 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 705 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Mar 05 21:11:28.874326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e5ae0f5c-c40a-4d46-8710-a0f1767ad6ff tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:28.875077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e5ae0f5c-c40a-4d46-8710-a0f1767ad6ff tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:28.902547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5ae0f5c-c40a-4d46-8710-a0f1767ad6ff tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:28.904518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5ae0f5c-c40a-4d46-8710-a0f1767ad6ff tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:28.905896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5ae0f5c-c40a-4d46-8710-a0f1767ad6ff tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:28.912846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5ae0f5c-c40a-4d46-8710-a0f1767ad6ff tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:29.271178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b561208a-7ea1-4945-ab37-cf64fa64f23d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:29.272392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b561208a-7ea1-4945-ab37-cf64fa64f23d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:29.284379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b561208a-7ea1-4945-ab37-cf64fa64f23d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:29.285316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b561208a-7ea1-4945-ab37-cf64fa64f23d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:29.287137 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b561208a-7ea1-4945-ab37-cf64fa64f23d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:29.289987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b561208a-7ea1-4945-ab37-cf64fa64f23d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:29.705805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b561208a-7ea1-4945-ab37-cf64fa64f23d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:29.714209 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b561208a-7ea1-4945-ab37-cf64fa64f23d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1547 microversion: 2.1 time: 0.456627 Mar 05 21:11:29.714835 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2404/4817] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:29 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1547 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:11:29.731443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-47e29f8b-82ac-4e0f-99de-252f902a602d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:29.732341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-47e29f8b-82ac-4e0f-99de-252f902a602d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:29.744335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47e29f8b-82ac-4e0f-99de-252f902a602d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:29.744797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47e29f8b-82ac-4e0f-99de-252f902a602d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:29.748252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47e29f8b-82ac-4e0f-99de-252f902a602d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:29.748705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47e29f8b-82ac-4e0f-99de-252f902a602d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:29.935004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e5ae0f5c-c40a-4d46-8710-a0f1767ad6ff tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:29.948557 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e5ae0f5c-c40a-4d46-8710-a0f1767ad6ff tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1365 microversion: 2.1 time: 1.079010 Mar 05 21:11:29.949682 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2414/4818] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:28 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1365 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:30.327293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-47e29f8b-82ac-4e0f-99de-252f902a602d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:30.338292 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-47e29f8b-82ac-4e0f-99de-252f902a602d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1547 microversion: 2.1 time: 0.611342 Mar 05 21:11:30.339524 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2405/4819] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:29 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1547 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:30.469943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b8cc3d75-fd2a-429d-b350-4a122de0349c req-b4db493d-111d-461c-98a2-9fd71f294889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "024b8477-8c82-4b91-879f-48b125f19e40", "name": "network-vif-plugged", "status": "completed", "tag": "dfe1078a-9630-493b-9b69-39e6676f5878"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:11:30.487053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b8cc3d75-fd2a-429d-b350-4a122de0349c req-b4db493d-111d-461c-98a2-9fd71f294889 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:30.488914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b8cc3d75-fd2a-429d-b350-4a122de0349c req-b4db493d-111d-461c-98a2-9fd71f294889 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:30.534641 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b8cc3d75-fd2a-429d-b350-4a122de0349c req-b4db493d-111d-461c-98a2-9fd71f294889 service nova] Creating event network-vif-plugged:dfe1078a-9630-493b-9b69-39e6676f5878 for instance 024b8477-8c82-4b91-879f-48b125f19e40 on nch1-master-1 Mar 05 21:11:30.542402 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b8cc3d75-fd2a-429d-b350-4a122de0349c req-b4db493d-111d-461c-98a2-9fd71f294889 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077021 Mar 05 21:11:30.544638 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2415/4820] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:11:30.968804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2d54579e-1095-4d54-896a-f350a7a090de tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:30.969570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2d54579e-1095-4d54-896a-f350a7a090de tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:30.987391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d54579e-1095-4d54-896a-f350a7a090de tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:30.987942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d54579e-1095-4d54-896a-f350a7a090de tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:30.991084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d54579e-1095-4d54-896a-f350a7a090de tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:30.992873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d54579e-1095-4d54-896a-f350a7a090de tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:31.643163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d54579e-1095-4d54-896a-f350a7a090de tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:31.662937 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2d54579e-1095-4d54-896a-f350a7a090de tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1365 microversion: 2.1 time: 0.700163 Mar 05 21:11:31.670399 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2406/4821] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:30 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1365 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:32.684681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-93d65cd3-f9ff-4e76-b289-18f41f1c4a20 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:32.686170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-93d65cd3-f9ff-4e76-b289-18f41f1c4a20 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:32.704986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93d65cd3-f9ff-4e76-b289-18f41f1c4a20 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:32.705893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93d65cd3-f9ff-4e76-b289-18f41f1c4a20 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:32.706947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93d65cd3-f9ff-4e76-b289-18f41f1c4a20 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:32.708640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93d65cd3-f9ff-4e76-b289-18f41f1c4a20 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:33.718488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-93d65cd3-f9ff-4e76-b289-18f41f1c4a20 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:33.751189 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-93d65cd3-f9ff-4e76-b289-18f41f1c4a20 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1555 microversion: 2.1 time: 1.065509 Mar 05 21:11:33.754598 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2416/4822] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:11:32 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1555 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:11:33.772913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-17d98f1a-2a02-4052-9ae1-15a54e0b71ea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:33.773438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-17d98f1a-2a02-4052-9ae1-15a54e0b71ea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:33.788402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-17d98f1a-2a02-4052-9ae1-15a54e0b71ea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:33.788852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-17d98f1a-2a02-4052-9ae1-15a54e0b71ea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:33.792790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-17d98f1a-2a02-4052-9ae1-15a54e0b71ea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:33.794403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-17d98f1a-2a02-4052-9ae1-15a54e0b71ea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:34.033504 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-17d98f1a-2a02-4052-9ae1-15a54e0b71ea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.266151 Mar 05 21:11:34.034581 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2407/4823] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 21:11:33 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40/os-interface => generated 284 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:11:36.107070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-235432008", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4b93af7-4d00-486d-82f8-877eddb5d778"}], "security_groups": [{"name": "tempest-securitygroup--182788774"}], "key_name": "tempest-keypair-1998843121", "user_data": "}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:11:36.687144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] validate_networks() for [('f4b93af7-4d00-486d-82f8-877eddb5d778', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:11:37.334373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8a55dbb0-da59-43b2-af45-d592434612ec req-05ddc436-6322-420f-a539-a26259329dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "024b8477-8c82-4b91-879f-48b125f19e40", "tag": "dfe1078a-9630-493b-9b69-39e6676f5878"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:11:37.361174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8a55dbb0-da59-43b2-af45-d592434612ec req-05ddc436-6322-420f-a539-a26259329dc9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:37.368182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8a55dbb0-da59-43b2-af45-d592434612ec req-05ddc436-6322-420f-a539-a26259329dc9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:37.401827 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8a55dbb0-da59-43b2-af45-d592434612ec req-05ddc436-6322-420f-a539-a26259329dc9 service nova] Creating event network-changed:dfe1078a-9630-493b-9b69-39e6676f5878 for instance 024b8477-8c82-4b91-879f-48b125f19e40 on nch1-master-1 Mar 05 21:11:37.411933 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-8a55dbb0-da59-43b2-af45-d592434612ec req-05ddc436-6322-420f-a539-a26259329dc9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081089 Mar 05 21:11:37.422540 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2408/4824] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:11:39.191712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:11:39.192212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:11:39.192620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:11:39.193040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:11:39.193741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:11:39.210637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:39.211094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:39.218575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:39.221998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:39.268759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Getting quotas for project 5c1b37634bef4eefa974dfc8912e8556. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:11:39.283277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Getting quotas for user 469bc2b7ea9e4727a0f0356e9a08dcb2 and project 5c1b37634bef4eefa974dfc8912e8556. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:11:39.318895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:11:39.324519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:11:39.344433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-64e5a301-3801-4be7-98f3-89d75c92b285 req-d497c523-e4b7-47f0-885b-3efeaacef999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0a57db-9d48-4aed-90ac-42492dda1a36", "tag": "ea1c2fe7-a4f7-4275-bd44-c9c3c90a0f5f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:11:39.372260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-64e5a301-3801-4be7-98f3-89d75c92b285 req-d497c523-e4b7-47f0-885b-3efeaacef999 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:39.372721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-64e5a301-3801-4be7-98f3-89d75c92b285 req-d497c523-e4b7-47f0-885b-3efeaacef999 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:39.412080 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-64e5a301-3801-4be7-98f3-89d75c92b285 req-d497c523-e4b7-47f0-885b-3efeaacef999 service nova] Creating event network-changed:ea1c2fe7-a4f7-4275-bd44-c9c3c90a0f5f for instance ce0a57db-9d48-4aed-90ac-42492dda1a36 on nch2-master-1 Mar 05 21:11:39.436949 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-64e5a301-3801-4be7-98f3-89d75c92b285 req-d497c523-e4b7-47f0-885b-3efeaacef999 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099717 Mar 05 21:11:39.444971 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2409/4825] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:11:39.489293 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e1867c6e-8b01-4b08-8e62-1c725aecf47c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.385702 Mar 05 21:11:39.491409 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2417/4826] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 21:11:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 3390 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 05 21:11:39.502756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-87bbeec6-35d6-45eb-be95-31c283a22f00 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:39.503358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-87bbeec6-35d6-45eb-be95-31c283a22f00 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:39.850747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-87bbeec6-35d6-45eb-be95-31c283a22f00 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:39.859416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-87bbeec6-35d6-45eb-be95-31c283a22f00 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:39.860971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-87bbeec6-35d6-45eb-be95-31c283a22f00 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:39.871776 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-87bbeec6-35d6-45eb-be95-31c283a22f00 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1281 microversion: 2.20 time: 0.373269 Mar 05 21:11:39.872457 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2410/4827] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:39 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1281 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:11:40.891930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2f264eae-e3c3-4c62-8673-4c76a4b742a6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:40.894072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2f264eae-e3c3-4c62-8673-4c76a4b742a6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:40.905446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f264eae-e3c3-4c62-8673-4c76a4b742a6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:40.906787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f264eae-e3c3-4c62-8673-4c76a4b742a6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:40.908051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f264eae-e3c3-4c62-8673-4c76a4b742a6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:40.910610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f264eae-e3c3-4c62-8673-4c76a4b742a6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:41.232561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2f264eae-e3c3-4c62-8673-4c76a4b742a6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:41.254647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2f264eae-e3c3-4c62-8673-4c76a4b742a6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:41.263150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2f264eae-e3c3-4c62-8673-4c76a4b742a6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:41.267371 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2f264eae-e3c3-4c62-8673-4c76a4b742a6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1333 microversion: 2.20 time: 0.379948 Mar 05 21:11:41.270515 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2418/4828] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:40 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1333 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:42.290334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-08d38d6b-9384-4044-9a63-a024d7e10cb2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:42.291634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-08d38d6b-9384-4044-9a63-a024d7e10cb2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:42.309609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08d38d6b-9384-4044-9a63-a024d7e10cb2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:42.309905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08d38d6b-9384-4044-9a63-a024d7e10cb2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:42.314679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08d38d6b-9384-4044-9a63-a024d7e10cb2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:42.316034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08d38d6b-9384-4044-9a63-a024d7e10cb2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:43.005357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-08d38d6b-9384-4044-9a63-a024d7e10cb2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:43.040618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-08d38d6b-9384-4044-9a63-a024d7e10cb2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:43.043790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-08d38d6b-9384-4044-9a63-a024d7e10cb2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:43.057184 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-08d38d6b-9384-4044-9a63-a024d7e10cb2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1339 microversion: 2.20 time: 0.767879 Mar 05 21:11:43.061220 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2411/4829] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:42 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1339 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:44.079821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bdb11d2a-215c-48aa-808a-f940e68599d2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:44.081142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bdb11d2a-215c-48aa-808a-f940e68599d2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:44.098131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bdb11d2a-215c-48aa-808a-f940e68599d2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:44.100995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bdb11d2a-215c-48aa-808a-f940e68599d2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:44.104671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bdb11d2a-215c-48aa-808a-f940e68599d2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:44.106889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bdb11d2a-215c-48aa-808a-f940e68599d2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:44.638941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bdb11d2a-215c-48aa-808a-f940e68599d2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:44.648547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bdb11d2a-215c-48aa-808a-f940e68599d2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:44.650074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bdb11d2a-215c-48aa-808a-f940e68599d2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:44.662116 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bdb11d2a-215c-48aa-808a-f940e68599d2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1406 microversion: 2.20 time: 0.587026 Mar 05 21:11:44.663730 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2419/4830] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:44 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1406 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:45.681869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6e1b235c-9eba-4d34-a711-3b2b4e1e708e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:45.684128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6e1b235c-9eba-4d34-a711-3b2b4e1e708e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:45.696010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e1b235c-9eba-4d34-a711-3b2b4e1e708e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:45.697598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e1b235c-9eba-4d34-a711-3b2b4e1e708e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:45.698380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e1b235c-9eba-4d34-a711-3b2b4e1e708e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:45.698860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e1b235c-9eba-4d34-a711-3b2b4e1e708e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:46.121212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6e1b235c-9eba-4d34-a711-3b2b4e1e708e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:46.132696 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6e1b235c-9eba-4d34-a711-3b2b4e1e708e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:46.134283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6e1b235c-9eba-4d34-a711-3b2b4e1e708e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:46.135452 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6e1b235c-9eba-4d34-a711-3b2b4e1e708e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1406 microversion: 2.20 time: 0.458234 Mar 05 21:11:46.144215 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2412/4831] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:45 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:46.232554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-7b56a08a-13ed-4fc5-9b48-4582fb9b0c87 req-1cbac215-aa63-4c51-994e-52f164bf6c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba05bcb0-9bc3-42c9-a011-c592459cce1e", "tag": "a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:11:46.258869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7b56a08a-13ed-4fc5-9b48-4582fb9b0c87 req-1cbac215-aa63-4c51-994e-52f164bf6c76 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:46.263280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7b56a08a-13ed-4fc5-9b48-4582fb9b0c87 req-1cbac215-aa63-4c51-994e-52f164bf6c76 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:46.296661 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-7b56a08a-13ed-4fc5-9b48-4582fb9b0c87 req-1cbac215-aa63-4c51-994e-52f164bf6c76 service nova] Creating event network-changed:a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4 for instance ba05bcb0-9bc3-42c9-a011-c592459cce1e on nch1-master-1 Mar 05 21:11:46.312985 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-7b56a08a-13ed-4fc5-9b48-4582fb9b0c87 req-1cbac215-aa63-4c51-994e-52f164bf6c76 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083496 Mar 05 21:11:46.315897 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2420/4832] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:11:47.164259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c7487f2b-00ca-4750-a1eb-267937efa193 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:47.165071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c7487f2b-00ca-4750-a1eb-267937efa193 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:47.185258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7487f2b-00ca-4750-a1eb-267937efa193 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:47.185987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7487f2b-00ca-4750-a1eb-267937efa193 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:47.187694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7487f2b-00ca-4750-a1eb-267937efa193 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:47.188462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7487f2b-00ca-4750-a1eb-267937efa193 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:47.783021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c7487f2b-00ca-4750-a1eb-267937efa193 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:47.791829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c7487f2b-00ca-4750-a1eb-267937efa193 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:47.795580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c7487f2b-00ca-4750-a1eb-267937efa193 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:47.797033 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c7487f2b-00ca-4750-a1eb-267937efa193 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1406 microversion: 2.20 time: 0.638355 Mar 05 21:11:47.798182 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2413/4833] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:47 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1406 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:48.817797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0511bbfd-8963-47ae-a75d-e8e7c34b96f8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:48.817797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0511bbfd-8963-47ae-a75d-e8e7c34b96f8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:48.827526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0511bbfd-8963-47ae-a75d-e8e7c34b96f8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:48.830565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0511bbfd-8963-47ae-a75d-e8e7c34b96f8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:48.832215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0511bbfd-8963-47ae-a75d-e8e7c34b96f8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:48.833220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0511bbfd-8963-47ae-a75d-e8e7c34b96f8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:49.260111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0511bbfd-8963-47ae-a75d-e8e7c34b96f8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:49.279354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0511bbfd-8963-47ae-a75d-e8e7c34b96f8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:49.283598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0511bbfd-8963-47ae-a75d-e8e7c34b96f8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:49.303918 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0511bbfd-8963-47ae-a75d-e8e7c34b96f8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1406 microversion: 2.20 time: 0.491273 Mar 05 21:11:49.305554 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2421/4834] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:48 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1406 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:50.331135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b37ef611-0d7b-4701-b015-1bf54a4c5166 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:50.332370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b37ef611-0d7b-4701-b015-1bf54a4c5166 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:50.353865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b37ef611-0d7b-4701-b015-1bf54a4c5166 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:50.354513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b37ef611-0d7b-4701-b015-1bf54a4c5166 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:50.358348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b37ef611-0d7b-4701-b015-1bf54a4c5166 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:50.358348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b37ef611-0d7b-4701-b015-1bf54a4c5166 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:50.833117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b37ef611-0d7b-4701-b015-1bf54a4c5166 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:50.854053 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b37ef611-0d7b-4701-b015-1bf54a4c5166 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:50.857150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b37ef611-0d7b-4701-b015-1bf54a4c5166 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:50.860074 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b37ef611-0d7b-4701-b015-1bf54a4c5166 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1406 microversion: 2.20 time: 0.537095 Mar 05 21:11:50.864760 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2414/4835] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:50 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1406 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:51.880481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f77fca81-1a47-493b-8948-2d296ed8a9cd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:51.882049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f77fca81-1a47-493b-8948-2d296ed8a9cd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:51.908361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f77fca81-1a47-493b-8948-2d296ed8a9cd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:51.909203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f77fca81-1a47-493b-8948-2d296ed8a9cd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:51.910335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f77fca81-1a47-493b-8948-2d296ed8a9cd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:51.910999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f77fca81-1a47-493b-8948-2d296ed8a9cd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:52.296733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f77fca81-1a47-493b-8948-2d296ed8a9cd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:52.312764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f77fca81-1a47-493b-8948-2d296ed8a9cd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:52.318125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f77fca81-1a47-493b-8948-2d296ed8a9cd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:52.323185 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f77fca81-1a47-493b-8948-2d296ed8a9cd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1406 microversion: 2.20 time: 0.447034 Mar 05 21:11:52.337348 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2422/4836] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:51 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1406 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:53.343829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ce62ca83-d284-4ee1-aab6-fe58da238c0d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:53.344556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ce62ca83-d284-4ee1-aab6-fe58da238c0d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:53.355807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce62ca83-d284-4ee1-aab6-fe58da238c0d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:53.358655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce62ca83-d284-4ee1-aab6-fe58da238c0d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:53.359617 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce62ca83-d284-4ee1-aab6-fe58da238c0d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:53.360104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce62ca83-d284-4ee1-aab6-fe58da238c0d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:53.458135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e8a9624b-91f1-4079-8605-c3b548619f21 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:11:53.459603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e8a9624b-91f1-4079-8605-c3b548619f21 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:53.474000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8a9624b-91f1-4079-8605-c3b548619f21 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:53.484495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8a9624b-91f1-4079-8605-c3b548619f21 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:53.485662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8a9624b-91f1-4079-8605-c3b548619f21 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:53.486282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8a9624b-91f1-4079-8605-c3b548619f21 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:53.573573 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e8a9624b-91f1-4079-8605-c3b548619f21 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "POST /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36/action" status: 200 len: 24563 microversion: 2.1 time: 0.119125 Mar 05 21:11:53.574950 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2423/4837] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:11:53 2022] POST /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36/action => generated 24563 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:11:53.663046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-cd540b46-c204-433f-902c-9612984f08fd req-8d970fab-3fe9-4315-a1c9-40a6771e374d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba05bcb0-9bc3-42c9-a011-c592459cce1e", "name": "network-vif-plugged", "status": "completed", "tag": "a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:11:53.681009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-cd540b46-c204-433f-902c-9612984f08fd req-8d970fab-3fe9-4315-a1c9-40a6771e374d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:53.681468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-cd540b46-c204-433f-902c-9612984f08fd req-8d970fab-3fe9-4315-a1c9-40a6771e374d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:53.712040 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-cd540b46-c204-433f-902c-9612984f08fd req-8d970fab-3fe9-4315-a1c9-40a6771e374d service nova] Creating event network-vif-plugged:a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4 for instance ba05bcb0-9bc3-42c9-a011-c592459cce1e on nch1-master-1 Mar 05 21:11:53.727123 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-cd540b46-c204-433f-902c-9612984f08fd req-8d970fab-3fe9-4315-a1c9-40a6771e374d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075610 Mar 05 21:11:53.728287 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2424/4838] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:11:54.155480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ce62ca83-d284-4ee1-aab6-fe58da238c0d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:54.181089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ce62ca83-d284-4ee1-aab6-fe58da238c0d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:54.185985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ce62ca83-d284-4ee1-aab6-fe58da238c0d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:54.187467 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ce62ca83-d284-4ee1-aab6-fe58da238c0d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1406 microversion: 2.20 time: 0.848865 Mar 05 21:11:54.198048 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2415/4839] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:53 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1406 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:55.207768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-01a44d9d-58ee-4a29-9a5b-bd4dc9a0182c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:55.208704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-01a44d9d-58ee-4a29-9a5b-bd4dc9a0182c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:55.225759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01a44d9d-58ee-4a29-9a5b-bd4dc9a0182c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:55.226235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01a44d9d-58ee-4a29-9a5b-bd4dc9a0182c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:55.227051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01a44d9d-58ee-4a29-9a5b-bd4dc9a0182c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:55.227506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01a44d9d-58ee-4a29-9a5b-bd4dc9a0182c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:55.614336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-01a44d9d-58ee-4a29-9a5b-bd4dc9a0182c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:55.630632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-01a44d9d-58ee-4a29-9a5b-bd4dc9a0182c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:55.634659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-01a44d9d-58ee-4a29-9a5b-bd4dc9a0182c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:55.641552 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-01a44d9d-58ee-4a29-9a5b-bd4dc9a0182c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1406 microversion: 2.20 time: 0.437989 Mar 05 21:11:55.642414 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2425/4840] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:55 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1406 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:56.663479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ed39b76b-f35e-4b3f-98e9-1def5cbf22d6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:56.664216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ed39b76b-f35e-4b3f-98e9-1def5cbf22d6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:56.683548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed39b76b-f35e-4b3f-98e9-1def5cbf22d6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:56.686790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed39b76b-f35e-4b3f-98e9-1def5cbf22d6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:56.688431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed39b76b-f35e-4b3f-98e9-1def5cbf22d6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:56.693362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed39b76b-f35e-4b3f-98e9-1def5cbf22d6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:57.219273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ed39b76b-f35e-4b3f-98e9-1def5cbf22d6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:57.232402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ed39b76b-f35e-4b3f-98e9-1def5cbf22d6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:57.234247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ed39b76b-f35e-4b3f-98e9-1def5cbf22d6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:11:57.235639 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ed39b76b-f35e-4b3f-98e9-1def5cbf22d6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1598 microversion: 2.20 time: 0.578193 Mar 05 21:11:57.250795 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2416/4841] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:11:56 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1598 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:11:57.259356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-198fb27e-83ee-4f13-80f0-4122d0e616fa tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:11:57.260675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-198fb27e-83ee-4f13-80f0-4122d0e616fa tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:11:57.269401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-198fb27e-83ee-4f13-80f0-4122d0e616fa tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:57.270273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-198fb27e-83ee-4f13-80f0-4122d0e616fa tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:57.271910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-198fb27e-83ee-4f13-80f0-4122d0e616fa tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:11:57.272589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-198fb27e-83ee-4f13-80f0-4122d0e616fa tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:11:57.458742 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-198fb27e-83ee-4f13-80f0-4122d0e616fa tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.208396 Mar 05 21:11:57.460914 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2426/4842] 10.222.0.15 () {60 vars in 1315 bytes} [Sat Mar 5 21:11:57 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/os-interface => generated 285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 21:12:00.530700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-602cefa5-9440-4a06-8c2b-13bc027c43cb req-d23cfc38-a652-4531-9e36-44c41320ed55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba05bcb0-9bc3-42c9-a011-c592459cce1e", "tag": "a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:12:00.550084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-602cefa5-9440-4a06-8c2b-13bc027c43cb req-d23cfc38-a652-4531-9e36-44c41320ed55 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:00.550866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-602cefa5-9440-4a06-8c2b-13bc027c43cb req-d23cfc38-a652-4531-9e36-44c41320ed55 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:00.564625 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-602cefa5-9440-4a06-8c2b-13bc027c43cb req-d23cfc38-a652-4531-9e36-44c41320ed55 service nova] Creating event network-changed:a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4 for instance ba05bcb0-9bc3-42c9-a011-c592459cce1e on nch1-master-1 Mar 05 21:12:00.574261 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-602cefa5-9440-4a06-8c2b-13bc027c43cb req-d23cfc38-a652-4531-9e36-44c41320ed55 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046075 Mar 05 21:12:00.574972 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2417/4843] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:12:10.463960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1214ca7a-db20-4a18-8757-58d172fe3c0d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Action: 'create', calling method: .version_select at 0x7fed4f5cfa60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-635318835"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:12:10.501707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-1214ca7a-db20-4a18-8757-58d172fe3c0d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:12:10.510993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-1214ca7a-db20-4a18-8757-58d172fe3c0d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for user 76b63093654943e6ac89d2b22e4f756a and project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:12:10.696672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-1214ca7a-db20-4a18-8757-58d172fe3c0d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:12:10.706715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-1214ca7a-db20-4a18-8757-58d172fe3c0d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for user 76b63093654943e6ac89d2b22e4f756a and project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:12:10.728420 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1214ca7a-db20-4a18-8757-58d172fe3c0d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.273540 Mar 05 21:12:10.734281 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2427/4844] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:12:10 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:11.016413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-352b6096-5274-4b12-8e6f-1246735c6b8a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:11.018516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-352b6096-5274-4b12-8e6f-1246735c6b8a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:11.034614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-352b6096-5274-4b12-8e6f-1246735c6b8a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:11.035316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-352b6096-5274-4b12-8e6f-1246735c6b8a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:11.038616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-352b6096-5274-4b12-8e6f-1246735c6b8a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:11.039053 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-352b6096-5274-4b12-8e6f-1246735c6b8a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:11.095376 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-352b6096-5274-4b12-8e6f-1246735c6b8a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40/ips" status: 200 len: 150 microversion: 2.1 time: 0.094646 Mar 05 21:12:11.110910 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2418/4845] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 21:12:10 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40/ips => generated 150 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:12:12.906638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4635e491-1666-4ff9-b5f8-b1ce92b7ffa2 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a4054d8-18e9-4856-b7b4-20817b2ed9e5"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:12:12.907798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4635e491-1666-4ff9-b5f8-b1ce92b7ffa2 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:12.931241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4635e491-1666-4ff9-b5f8-b1ce92b7ffa2 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:12.931743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4635e491-1666-4ff9-b5f8-b1ce92b7ffa2 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:12.935842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4635e491-1666-4ff9-b5f8-b1ce92b7ffa2 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:12.941802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4635e491-1666-4ff9-b5f8-b1ce92b7ffa2 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:13.465857 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4635e491-1666-4ff9-b5f8-b1ce92b7ffa2 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "POST /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.567982 Mar 05 21:12:13.466487 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2428/4846] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:12:12 2022] POST /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40/os-volume_attachments => generated 194 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:12:13.681177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1452628859", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "a4cf4a57-5d55-469c-b3fc-5734b4a78c6a"}], "key_name": "tempest-TestNetworkBasicOps-635318835", "security_groups": [{"name": "tempest-secgroup-smoke-1415654954"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:12:14.109606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] validate_networks() for [('a4cf4a57-5d55-469c-b3fc-5734b4a78c6a', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:12:15.450703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:12:15.451311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:12:15.451601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:12:15.452043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:12:15.452461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:12:15.477175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:15.480327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:15.489873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:15.490730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:15.538632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:12:15.547766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for user 76b63093654943e6ac89d2b22e4f756a and project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:12:15.577906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:12:15.581461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:12:15.653001 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a34248f1-1169-40f1-a904-95654ecdf98d tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.976233 Mar 05 21:12:15.653763 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2419/4847] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:12:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:12:15.666388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-47ffad17-575b-4db2-b689-15890e4a7ac2 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:15.668612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-47ffad17-575b-4db2-b689-15890e4a7ac2 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:15.841994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-47ffad17-575b-4db2-b689-15890e4a7ac2 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:15.855904 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-47ffad17-575b-4db2-b689-15890e4a7ac2 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1248 microversion: 2.1 time: 0.192304 Mar 05 21:12:15.857033 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2429/4848] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:15 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1248 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:16.874340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d6b9f83d-884a-439f-b3cb-7b5bc92806ba tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:16.875257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d6b9f83d-884a-439f-b3cb-7b5bc92806ba tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:16.888672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6b9f83d-884a-439f-b3cb-7b5bc92806ba tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:16.890829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6b9f83d-884a-439f-b3cb-7b5bc92806ba tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:16.893178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6b9f83d-884a-439f-b3cb-7b5bc92806ba tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:16.895386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6b9f83d-884a-439f-b3cb-7b5bc92806ba tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:16.954851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dbcf200c-7743-48d1-9d2a-e47e8605ff1c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Action: 'create', calling method: .version_select at 0x7fed5c23e820>, body: {"keypair": {"name": "tempest-keypair-985483286"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:12:16.973418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-dbcf200c-7743-48d1-9d2a-e47e8605ff1c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:12:16.979975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-dbcf200c-7743-48d1-9d2a-e47e8605ff1c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for user 8bee90d7a5af4246b85ff0cb89217700 and project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:12:17.020275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d6b9f83d-884a-439f-b3cb-7b5bc92806ba tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:17.032919 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d6b9f83d-884a-439f-b3cb-7b5bc92806ba tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1300 microversion: 2.1 time: 0.163201 Mar 05 21:12:17.046447 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2420/4849] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:16 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1300 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:17.357636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-dbcf200c-7743-48d1-9d2a-e47e8605ff1c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:12:17.366338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-dbcf200c-7743-48d1-9d2a-e47e8605ff1c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for user 8bee90d7a5af4246b85ff0cb89217700 and project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:12:17.395840 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dbcf200c-7743-48d1-9d2a-e47e8605ff1c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.443913 Mar 05 21:12:17.397354 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2430/4850] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:12:16 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:12:18.063553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3fe254b9-e00e-4e9f-b8e5-61167a8895c1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:18.064196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3fe254b9-e00e-4e9f-b8e5-61167a8895c1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:18.070941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3fe254b9-e00e-4e9f-b8e5-61167a8895c1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:18.071399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3fe254b9-e00e-4e9f-b8e5-61167a8895c1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:18.081601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3fe254b9-e00e-4e9f-b8e5-61167a8895c1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:18.082078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3fe254b9-e00e-4e9f-b8e5-61167a8895c1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:18.394449 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3fe254b9-e00e-4e9f-b8e5-61167a8895c1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:18.407167 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3fe254b9-e00e-4e9f-b8e5-61167a8895c1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1306 microversion: 2.1 time: 0.347405 Mar 05 21:12:18.409692 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2421/4851] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:18 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1306 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:19.427395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dbf389d7-5cdf-485f-99bd-3d289c821736 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:19.428715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dbf389d7-5cdf-485f-99bd-3d289c821736 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:19.439906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dbf389d7-5cdf-485f-99bd-3d289c821736 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:19.441592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dbf389d7-5cdf-485f-99bd-3d289c821736 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:19.442607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dbf389d7-5cdf-485f-99bd-3d289c821736 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:19.446752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dbf389d7-5cdf-485f-99bd-3d289c821736 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:19.990888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dbf389d7-5cdf-485f-99bd-3d289c821736 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:20.000191 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dbf389d7-5cdf-485f-99bd-3d289c821736 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1374 microversion: 2.1 time: 0.577538 Mar 05 21:12:20.001110 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2431/4852] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:19 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1374 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:21.017785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45625a08-a7e4-497b-9b32-ad343028bae3 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:21.018382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-45625a08-a7e4-497b-9b32-ad343028bae3 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:21.028676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45625a08-a7e4-497b-9b32-ad343028bae3 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:21.028676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45625a08-a7e4-497b-9b32-ad343028bae3 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:21.028676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45625a08-a7e4-497b-9b32-ad343028bae3 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:21.028676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45625a08-a7e4-497b-9b32-ad343028bae3 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:21.473733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-8a0910bb-8699-417f-9216-1e99493301e8 req-8a463474-6a21-4764-b49f-696569977c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e713812-42a7-4df0-aac0-fbd1bcfb9746", "tag": "00257fe1-6170-49e1-85e0-c4c078a18a37"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:12:21.493001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8a0910bb-8699-417f-9216-1e99493301e8 req-8a463474-6a21-4764-b49f-696569977c55 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:21.493497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8a0910bb-8699-417f-9216-1e99493301e8 req-8a463474-6a21-4764-b49f-696569977c55 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:21.506932 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-8a0910bb-8699-417f-9216-1e99493301e8 req-8a463474-6a21-4764-b49f-696569977c55 service nova] Creating event network-changed:00257fe1-6170-49e1-85e0-c4c078a18a37 for instance 2e713812-42a7-4df0-aac0-fbd1bcfb9746 on nch2-master-1 Mar 05 21:12:21.513590 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-8a0910bb-8699-417f-9216-1e99493301e8 req-8a463474-6a21-4764-b49f-696569977c55 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044115 Mar 05 21:12:21.514577 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2432/4853] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:12:21.588157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-45625a08-a7e4-497b-9b32-ad343028bae3 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:21.605614 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45625a08-a7e4-497b-9b32-ad343028bae3 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1374 microversion: 2.1 time: 0.585628 Mar 05 21:12:21.617602 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2422/4854] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:21 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1374 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:22.236492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2134693931", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b56f14b9-afc0-424d-b080-c31779583b66"}], "security_groups": [{"name": "tempest-securitygroup--312919515"}], "key_name": "tempest-keypair-985483286", "user_data": "}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:12:22.429477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] validate_networks() for [('b56f14b9-afc0-424d-b080-c31779583b66', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:12:22.623022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9b5e465a-e6a6-4aa3-a574-7a72aed99c22 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:22.623646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9b5e465a-e6a6-4aa3-a574-7a72aed99c22 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:22.632633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b5e465a-e6a6-4aa3-a574-7a72aed99c22 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:22.633223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b5e465a-e6a6-4aa3-a574-7a72aed99c22 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:22.634291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b5e465a-e6a6-4aa3-a574-7a72aed99c22 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:22.634873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b5e465a-e6a6-4aa3-a574-7a72aed99c22 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:22.966104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9b5e465a-e6a6-4aa3-a574-7a72aed99c22 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:22.974856 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9b5e465a-e6a6-4aa3-a574-7a72aed99c22 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1374 microversion: 2.1 time: 0.355618 Mar 05 21:12:22.985352 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2423/4855] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:22 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1374 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:12:23.503743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:12:23.505249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:12:23.506280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:12:23.506787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:12:23.507528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:12:23.534751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:23.535211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:23.536086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:23.536602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:23.559291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for project f73f6888043940b9b1344c6998b423da. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:12:23.565300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for user 8bee90d7a5af4246b85ff0cb89217700 and project f73f6888043940b9b1344c6998b423da. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:12:23.590902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:12:23.594753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:12:23.654964 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-df9b9290-95c0-498d-93da-8e85b20dbe28 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.423837 Mar 05 21:12:23.656046 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2433/4856] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:12:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 21:12:23.669524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-24bb0d50-5201-4cb4-a11f-e5d95c29baa8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:23.670149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-24bb0d50-5201-4cb4-a11f-e5d95c29baa8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:23.874344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-24bb0d50-5201-4cb4-a11f-e5d95c29baa8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:23.889784 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-24bb0d50-5201-4cb4-a11f-e5d95c29baa8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1241 microversion: 2.1 time: 0.227035 Mar 05 21:12:23.903627 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2424/4857] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:23 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1241 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:24.001310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af3ed127-7883-4282-ba5a-1c7b6f9dae29 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:24.002293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-af3ed127-7883-4282-ba5a-1c7b6f9dae29 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:24.013561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af3ed127-7883-4282-ba5a-1c7b6f9dae29 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:24.014203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af3ed127-7883-4282-ba5a-1c7b6f9dae29 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:24.015015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af3ed127-7883-4282-ba5a-1c7b6f9dae29 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:24.015796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af3ed127-7883-4282-ba5a-1c7b6f9dae29 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:24.230284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-af3ed127-7883-4282-ba5a-1c7b6f9dae29 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:24.240371 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-af3ed127-7883-4282-ba5a-1c7b6f9dae29 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1374 microversion: 2.1 time: 0.248741 Mar 05 21:12:24.250783 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2434/4858] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:23 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1374 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:24.907846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8e2327d4-373a-4d74-bc54-ad984c6caba9 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:24.909738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8e2327d4-373a-4d74-bc54-ad984c6caba9 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:24.920871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e2327d4-373a-4d74-bc54-ad984c6caba9 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:24.921589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e2327d4-373a-4d74-bc54-ad984c6caba9 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:24.922593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e2327d4-373a-4d74-bc54-ad984c6caba9 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:24.923250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e2327d4-373a-4d74-bc54-ad984c6caba9 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:25.021800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8e2327d4-373a-4d74-bc54-ad984c6caba9 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:25.034193 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8e2327d4-373a-4d74-bc54-ad984c6caba9 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1293 microversion: 2.1 time: 0.130570 Mar 05 21:12:25.045194 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2425/4859] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:24 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1293 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:25.258917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b6dc352c-995e-4d32-b57f-9cab2dfb620e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:25.259765 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b6dc352c-995e-4d32-b57f-9cab2dfb620e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:25.273905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6dc352c-995e-4d32-b57f-9cab2dfb620e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:25.274756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6dc352c-995e-4d32-b57f-9cab2dfb620e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:25.276273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6dc352c-995e-4d32-b57f-9cab2dfb620e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:25.279203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6dc352c-995e-4d32-b57f-9cab2dfb620e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:25.544597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b6dc352c-995e-4d32-b57f-9cab2dfb620e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:25.555558 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b6dc352c-995e-4d32-b57f-9cab2dfb620e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1374 microversion: 2.1 time: 0.301085 Mar 05 21:12:25.565441 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2435/4860] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:25 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1374 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:26.054846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f1b5fb31-39a9-47af-8ebd-d4e45a189113 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:26.056301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f1b5fb31-39a9-47af-8ebd-d4e45a189113 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:26.066452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1b5fb31-39a9-47af-8ebd-d4e45a189113 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:26.067691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1b5fb31-39a9-47af-8ebd-d4e45a189113 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:26.069257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1b5fb31-39a9-47af-8ebd-d4e45a189113 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:26.069948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f1b5fb31-39a9-47af-8ebd-d4e45a189113 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:26.175387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f1b5fb31-39a9-47af-8ebd-d4e45a189113 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:26.188870 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f1b5fb31-39a9-47af-8ebd-d4e45a189113 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1299 microversion: 2.1 time: 0.136060 Mar 05 21:12:26.216267 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2426/4861] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:26 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:26.578965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-209f9c8f-3ce5-48a8-92eb-490279047167 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:26.581384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-209f9c8f-3ce5-48a8-92eb-490279047167 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:26.594811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-209f9c8f-3ce5-48a8-92eb-490279047167 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:26.595589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-209f9c8f-3ce5-48a8-92eb-490279047167 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:26.597785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-209f9c8f-3ce5-48a8-92eb-490279047167 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:26.598736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-209f9c8f-3ce5-48a8-92eb-490279047167 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:26.723933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d7067f9f-a8ec-4cd0-81c2-c89f5f4c8911 req-e4c613f6-df87-4d5a-aaaf-929bcfac081e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e713812-42a7-4df0-aac0-fbd1bcfb9746", "name": "network-vif-plugged", "status": "completed", "tag": "00257fe1-6170-49e1-85e0-c4c078a18a37"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:12:26.749039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d7067f9f-a8ec-4cd0-81c2-c89f5f4c8911 req-e4c613f6-df87-4d5a-aaaf-929bcfac081e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:26.749699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d7067f9f-a8ec-4cd0-81c2-c89f5f4c8911 req-e4c613f6-df87-4d5a-aaaf-929bcfac081e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:26.777847 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d7067f9f-a8ec-4cd0-81c2-c89f5f4c8911 req-e4c613f6-df87-4d5a-aaaf-929bcfac081e service nova] Creating event network-vif-plugged:00257fe1-6170-49e1-85e0-c4c078a18a37 for instance 2e713812-42a7-4df0-aac0-fbd1bcfb9746 on nch2-master-1 Mar 05 21:12:26.789886 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d7067f9f-a8ec-4cd0-81c2-c89f5f4c8911 req-e4c613f6-df87-4d5a-aaaf-929bcfac081e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071368 Mar 05 21:12:26.794803 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2427/4862] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:12:27.197229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-209f9c8f-3ce5-48a8-92eb-490279047167 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:27.238002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c7f3b826-3255-41a1-a1c8-53aab28b4f59 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:27.241639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c7f3b826-3255-41a1-a1c8-53aab28b4f59 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:27.253265 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-209f9c8f-3ce5-48a8-92eb-490279047167 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1374 microversion: 2.1 time: 0.681896 Mar 05 21:12:27.268667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7f3b826-3255-41a1-a1c8-53aab28b4f59 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:27.269131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7f3b826-3255-41a1-a1c8-53aab28b4f59 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:27.269927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7f3b826-3255-41a1-a1c8-53aab28b4f59 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:27.270116 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2436/4863] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:26 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1374 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:27.276751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7f3b826-3255-41a1-a1c8-53aab28b4f59 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:27.902788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c7f3b826-3255-41a1-a1c8-53aab28b4f59 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:27.920844 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c7f3b826-3255-41a1-a1c8-53aab28b4f59 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1366 microversion: 2.1 time: 0.688130 Mar 05 21:12:27.921513 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2428/4864] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:27 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1366 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:12:28.257710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-0d05e12a-a738-4b13-a99d-61e609dd9c5b req-8aca755b-20b2-4175-bdce-5a484649704b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0612a448-c43d-402f-892e-e1f1ec0575c6", "tag": "0ad03e45-ef52-4008-85cc-7d447f1a7efe"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:12:28.283042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-76c07103-db0c-4cf4-be05-943125f44e53 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:28.284057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-76c07103-db0c-4cf4-be05-943125f44e53 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:28.324530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76c07103-db0c-4cf4-be05-943125f44e53 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:28.325146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76c07103-db0c-4cf4-be05-943125f44e53 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:28.326003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76c07103-db0c-4cf4-be05-943125f44e53 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:28.326451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76c07103-db0c-4cf4-be05-943125f44e53 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:28.333529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0d05e12a-a738-4b13-a99d-61e609dd9c5b req-8aca755b-20b2-4175-bdce-5a484649704b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:28.334013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0d05e12a-a738-4b13-a99d-61e609dd9c5b req-8aca755b-20b2-4175-bdce-5a484649704b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:28.354345 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0d05e12a-a738-4b13-a99d-61e609dd9c5b req-8aca755b-20b2-4175-bdce-5a484649704b service nova] Creating event network-changed:0ad03e45-ef52-4008-85cc-7d447f1a7efe for instance 0612a448-c43d-402f-892e-e1f1ec0575c6 on nch1-master-1 Mar 05 21:12:28.385530 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-0d05e12a-a738-4b13-a99d-61e609dd9c5b req-8aca755b-20b2-4175-bdce-5a484649704b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137085 Mar 05 21:12:28.396616 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2437/4865] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:12:28.667366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-76c07103-db0c-4cf4-be05-943125f44e53 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:28.676271 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-76c07103-db0c-4cf4-be05-943125f44e53 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1374 microversion: 2.1 time: 0.409017 Mar 05 21:12:28.677470 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2429/4866] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:28 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1374 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:28.939116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-28387fa0-2fad-44ca-a1da-b797718230c8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:28.940078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-28387fa0-2fad-44ca-a1da-b797718230c8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:28.946702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28387fa0-2fad-44ca-a1da-b797718230c8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:28.948010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28387fa0-2fad-44ca-a1da-b797718230c8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:28.949170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28387fa0-2fad-44ca-a1da-b797718230c8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:28.949776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28387fa0-2fad-44ca-a1da-b797718230c8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:29.194118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-28387fa0-2fad-44ca-a1da-b797718230c8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:29.234144 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-28387fa0-2fad-44ca-a1da-b797718230c8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1366 microversion: 2.1 time: 0.283690 Mar 05 21:12:29.236928 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2438/4867] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:28 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:29.694662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ac19bc36-2c94-48ab-b892-d83e82b37e80 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:29.695329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ac19bc36-2c94-48ab-b892-d83e82b37e80 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:29.702898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac19bc36-2c94-48ab-b892-d83e82b37e80 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:29.703371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac19bc36-2c94-48ab-b892-d83e82b37e80 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:29.704206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac19bc36-2c94-48ab-b892-d83e82b37e80 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:29.704657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac19bc36-2c94-48ab-b892-d83e82b37e80 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:29.853249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ac19bc36-2c94-48ab-b892-d83e82b37e80 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:29.862174 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ac19bc36-2c94-48ab-b892-d83e82b37e80 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1547 microversion: 2.1 time: 0.171520 Mar 05 21:12:29.862775 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2430/4868] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:29 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1547 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:29.879856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c4526e7a-5a30-4513-ba20-e61724226467 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:29.880507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c4526e7a-5a30-4513-ba20-e61724226467 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:29.888554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4526e7a-5a30-4513-ba20-e61724226467 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:29.889016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4526e7a-5a30-4513-ba20-e61724226467 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:29.889805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4526e7a-5a30-4513-ba20-e61724226467 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:29.890497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4526e7a-5a30-4513-ba20-e61724226467 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:30.254669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8b3d4b9f-9f8d-4ef1-b6a8-3ea4dfa6ad78 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:30.255513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8b3d4b9f-9f8d-4ef1-b6a8-3ea4dfa6ad78 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:30.262652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b3d4b9f-9f8d-4ef1-b6a8-3ea4dfa6ad78 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:30.263230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b3d4b9f-9f8d-4ef1-b6a8-3ea4dfa6ad78 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:30.264119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b3d4b9f-9f8d-4ef1-b6a8-3ea4dfa6ad78 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:30.264662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b3d4b9f-9f8d-4ef1-b6a8-3ea4dfa6ad78 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:30.302637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c4526e7a-5a30-4513-ba20-e61724226467 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:30.309951 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c4526e7a-5a30-4513-ba20-e61724226467 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1547 microversion: 2.1 time: 0.434047 Mar 05 21:12:30.311093 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2439/4869] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:29 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1547 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:30.544954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8b3d4b9f-9f8d-4ef1-b6a8-3ea4dfa6ad78 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:30.575590 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8b3d4b9f-9f8d-4ef1-b6a8-3ea4dfa6ad78 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1366 microversion: 2.1 time: 0.316932 Mar 05 21:12:30.577123 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2431/4870] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:30 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:12:31.593690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8d3209a3-010e-4ee9-a7c2-d51c71b18fd0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:31.594397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8d3209a3-010e-4ee9-a7c2-d51c71b18fd0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:31.607622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d3209a3-010e-4ee9-a7c2-d51c71b18fd0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:31.608126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d3209a3-010e-4ee9-a7c2-d51c71b18fd0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:31.608926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d3209a3-010e-4ee9-a7c2-d51c71b18fd0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:31.609916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8d3209a3-010e-4ee9-a7c2-d51c71b18fd0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:32.035737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8d3209a3-010e-4ee9-a7c2-d51c71b18fd0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:32.059136 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8d3209a3-010e-4ee9-a7c2-d51c71b18fd0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1366 microversion: 2.1 time: 0.463915 Mar 05 21:12:32.060994 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2440/4871] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:31 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1366 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:32.374936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-482557a9-b79e-4562-9eae-536b1e64a983 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:32.374936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-482557a9-b79e-4562-9eae-536b1e64a983 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:32.387731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-482557a9-b79e-4562-9eae-536b1e64a983 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:32.389184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-482557a9-b79e-4562-9eae-536b1e64a983 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:32.390373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-482557a9-b79e-4562-9eae-536b1e64a983 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:32.391889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-482557a9-b79e-4562-9eae-536b1e64a983 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:32.437399 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-482557a9-b79e-4562-9eae-536b1e64a983 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/ips" status: 200 len: 152 microversion: 2.20 time: 0.069438 Mar 05 21:12:32.438570 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2432/4872] 10.222.0.15 () {60 vars in 1288 bytes} [Sat Mar 5 21:12:32 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/ips => generated 152 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:12:33.080790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8df125ef-9c68-40ff-ac4f-be8f7814cf5a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:33.081414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8df125ef-9c68-40ff-ac4f-be8f7814cf5a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:33.091565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8df125ef-9c68-40ff-ac4f-be8f7814cf5a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:33.092103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8df125ef-9c68-40ff-ac4f-be8f7814cf5a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:33.092926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8df125ef-9c68-40ff-ac4f-be8f7814cf5a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:33.093375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8df125ef-9c68-40ff-ac4f-be8f7814cf5a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:33.134602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-2ed2a9bb-5086-43ed-a8be-5eda8241325a req-de27a66d-b4b8-487d-9727-567038d04da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0612a448-c43d-402f-892e-e1f1ec0575c6", "name": "network-vif-plugged", "status": "completed", "tag": "0ad03e45-ef52-4008-85cc-7d447f1a7efe"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:12:33.149082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-2ed2a9bb-5086-43ed-a8be-5eda8241325a req-de27a66d-b4b8-487d-9727-567038d04da8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:33.149749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-2ed2a9bb-5086-43ed-a8be-5eda8241325a req-de27a66d-b4b8-487d-9727-567038d04da8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:33.177530 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-2ed2a9bb-5086-43ed-a8be-5eda8241325a req-de27a66d-b4b8-487d-9727-567038d04da8 service nova] Creating event network-vif-plugged:0ad03e45-ef52-4008-85cc-7d447f1a7efe for instance 0612a448-c43d-402f-892e-e1f1ec0575c6 on nch1-master-1 Mar 05 21:12:33.181215 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-2ed2a9bb-5086-43ed-a8be-5eda8241325a req-de27a66d-b4b8-487d-9727-567038d04da8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050602 Mar 05 21:12:33.182725 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2433/4873] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:12:33.494809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8df125ef-9c68-40ff-ac4f-be8f7814cf5a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:33.506577 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8df125ef-9c68-40ff-ac4f-be8f7814cf5a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1366 microversion: 2.1 time: 0.430330 Mar 05 21:12:33.509106 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2441/4874] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:33 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1366 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:34.528622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c4d75c9c-dc6f-47fb-aba1-81e68448462a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:34.529923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c4d75c9c-dc6f-47fb-aba1-81e68448462a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:34.548498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cb1dee6a-e3b0-4034-9c26-7d62b6a5ac34 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:12:34.550024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cb1dee6a-e3b0-4034-9c26-7d62b6a5ac34 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:34.559930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4d75c9c-dc6f-47fb-aba1-81e68448462a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:34.561915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb1dee6a-e3b0-4034-9c26-7d62b6a5ac34 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:34.562559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4d75c9c-dc6f-47fb-aba1-81e68448462a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:34.563223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb1dee6a-e3b0-4034-9c26-7d62b6a5ac34 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:34.564226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb1dee6a-e3b0-4034-9c26-7d62b6a5ac34 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:34.565201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4d75c9c-dc6f-47fb-aba1-81e68448462a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:34.565802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4d75c9c-dc6f-47fb-aba1-81e68448462a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:34.566418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb1dee6a-e3b0-4034-9c26-7d62b6a5ac34 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:34.631768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-cb1dee6a-e3b0-4034-9c26-7d62b6a5ac34 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lazy-loading 'flavor' on Instance uuid ba05bcb0-9bc3-42c9-a011-c592459cce1e {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:12:35.075448 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cb1dee6a-e3b0-4034-9c26-7d62b6a5ac34 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "POST /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/action" status: 202 len: 0 microversion: 2.20 time: 0.530936 Mar 05 21:12:35.076149 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2442/4875] 10.222.0.15 () {62 vars in 1318 bytes} [Sat Mar 5 21:12:34 2022] POST /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:12:35.089484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d2a4106e-1e31-4034-a373-c5676c8acec6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:35.093696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d2a4106e-1e31-4034-a373-c5676c8acec6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:35.105642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2a4106e-1e31-4034-a373-c5676c8acec6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:35.106115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2a4106e-1e31-4034-a373-c5676c8acec6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:35.110213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2a4106e-1e31-4034-a373-c5676c8acec6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:35.115569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2a4106e-1e31-4034-a373-c5676c8acec6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:35.346157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d2a4106e-1e31-4034-a373-c5676c8acec6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:35.364857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d2a4106e-1e31-4034-a373-c5676c8acec6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:35.370802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d2a4106e-1e31-4034-a373-c5676c8acec6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:35.372964 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d2a4106e-1e31-4034-a373-c5676c8acec6 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1723 microversion: 2.20 time: 0.290703 Mar 05 21:12:35.374001 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2443/4876] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:35 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:35.379832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c4d75c9c-dc6f-47fb-aba1-81e68448462a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:35.394306 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c4d75c9c-dc6f-47fb-aba1-81e68448462a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1366 microversion: 2.1 time: 0.872023 Mar 05 21:12:35.395105 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2434/4877] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:34 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1366 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:36.391252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e214931c-7481-4649-a324-dbd242165e4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:36.392468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e214931c-7481-4649-a324-dbd242165e4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:36.411739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b62e4820-fe7d-495e-86ff-eb697beddb73 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:36.412474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b62e4820-fe7d-495e-86ff-eb697beddb73 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:36.419463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b62e4820-fe7d-495e-86ff-eb697beddb73 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:36.420061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e214931c-7481-4649-a324-dbd242165e4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:36.420787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e214931c-7481-4649-a324-dbd242165e4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:36.421787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e214931c-7481-4649-a324-dbd242165e4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:36.422390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e214931c-7481-4649-a324-dbd242165e4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:36.428569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b62e4820-fe7d-495e-86ff-eb697beddb73 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:36.429731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b62e4820-fe7d-495e-86ff-eb697beddb73 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:36.430338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b62e4820-fe7d-495e-86ff-eb697beddb73 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:36.706099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e214931c-7481-4649-a324-dbd242165e4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:36.718668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e214931c-7481-4649-a324-dbd242165e4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:36.724221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e214931c-7481-4649-a324-dbd242165e4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:36.727067 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e214931c-7481-4649-a324-dbd242165e4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1723 microversion: 2.20 time: 0.340089 Mar 05 21:12:36.730527 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2444/4878] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:36 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:36.915346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b62e4820-fe7d-495e-86ff-eb697beddb73 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:36.924046 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b62e4820-fe7d-495e-86ff-eb697beddb73 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1556 microversion: 2.1 time: 0.516200 Mar 05 21:12:36.929406 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2435/4879] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:36 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1556 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:12:36.946802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4119be24-81ee-4202-a303-813482f806b3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:36.947850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4119be24-81ee-4202-a303-813482f806b3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:36.956022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4119be24-81ee-4202-a303-813482f806b3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:36.956786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4119be24-81ee-4202-a303-813482f806b3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:36.958378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4119be24-81ee-4202-a303-813482f806b3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:36.959061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4119be24-81ee-4202-a303-813482f806b3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:37.120876 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4119be24-81ee-4202-a303-813482f806b3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.178424 Mar 05 21:12:37.121708 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2445/4880] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 21:12:36 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:12:37.749862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dc034393-051a-4d30-8437-24b119b50e04 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:37.750819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dc034393-051a-4d30-8437-24b119b50e04 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:37.770765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc034393-051a-4d30-8437-24b119b50e04 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:37.774480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc034393-051a-4d30-8437-24b119b50e04 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:37.785227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc034393-051a-4d30-8437-24b119b50e04 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:37.785913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc034393-051a-4d30-8437-24b119b50e04 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:38.670543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dc034393-051a-4d30-8437-24b119b50e04 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:38.680413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dc034393-051a-4d30-8437-24b119b50e04 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:38.694710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dc034393-051a-4d30-8437-24b119b50e04 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:38.701522 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dc034393-051a-4d30-8437-24b119b50e04 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1723 microversion: 2.20 time: 0.957524 Mar 05 21:12:38.715200 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2436/4881] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:37 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1723 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:39.704126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-3ad0b60b-5469-416b-8c18-b3a6ef4b6630 req-6c23d687-a18f-4841-873f-b41ea7fa3e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0612a448-c43d-402f-892e-e1f1ec0575c6", "tag": "0ad03e45-ef52-4008-85cc-7d447f1a7efe"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:12:39.727083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-46b5b44b-1696-43a9-b9ef-e30ffabc6ff2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:39.727603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3ad0b60b-5469-416b-8c18-b3a6ef4b6630 req-6c23d687-a18f-4841-873f-b41ea7fa3e5a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:39.729634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-46b5b44b-1696-43a9-b9ef-e30ffabc6ff2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:39.730975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3ad0b60b-5469-416b-8c18-b3a6ef4b6630 req-6c23d687-a18f-4841-873f-b41ea7fa3e5a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:39.742896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46b5b44b-1696-43a9-b9ef-e30ffabc6ff2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:39.748098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46b5b44b-1696-43a9-b9ef-e30ffabc6ff2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:39.751386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46b5b44b-1696-43a9-b9ef-e30ffabc6ff2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:39.758026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-46b5b44b-1696-43a9-b9ef-e30ffabc6ff2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:39.770084 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-3ad0b60b-5469-416b-8c18-b3a6ef4b6630 req-6c23d687-a18f-4841-873f-b41ea7fa3e5a service nova] Creating event network-changed:0ad03e45-ef52-4008-85cc-7d447f1a7efe for instance 0612a448-c43d-402f-892e-e1f1ec0575c6 on nch1-master-1 Mar 05 21:12:39.795646 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-3ad0b60b-5469-416b-8c18-b3a6ef4b6630 req-6c23d687-a18f-4841-873f-b41ea7fa3e5a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094786 Mar 05 21:12:39.813950 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2446/4882] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:12:40.806105 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-46b5b44b-1696-43a9-b9ef-e30ffabc6ff2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:40.815993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-46b5b44b-1696-43a9-b9ef-e30ffabc6ff2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:40.824811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-46b5b44b-1696-43a9-b9ef-e30ffabc6ff2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:40.826061 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-46b5b44b-1696-43a9-b9ef-e30ffabc6ff2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1723 microversion: 2.20 time: 1.103470 Mar 05 21:12:40.833125 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2437/4883] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:39 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1723 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:41.858074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9f02ebde-c5cf-4069-87e2-efc2df5ff1d9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:41.858074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9f02ebde-c5cf-4069-87e2-efc2df5ff1d9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:41.867944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f02ebde-c5cf-4069-87e2-efc2df5ff1d9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:41.868595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f02ebde-c5cf-4069-87e2-efc2df5ff1d9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:41.870424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f02ebde-c5cf-4069-87e2-efc2df5ff1d9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:41.871526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f02ebde-c5cf-4069-87e2-efc2df5ff1d9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:42.295727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9f02ebde-c5cf-4069-87e2-efc2df5ff1d9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:42.304803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9f02ebde-c5cf-4069-87e2-efc2df5ff1d9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:42.318788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9f02ebde-c5cf-4069-87e2-efc2df5ff1d9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:42.323075 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9f02ebde-c5cf-4069-87e2-efc2df5ff1d9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1723 microversion: 2.20 time: 0.474087 Mar 05 21:12:42.339063 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2447/4884] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:41 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1723 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:43.350857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-879e78a7-88a9-4f3f-b49c-460cd4d8cfff tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:43.351463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-879e78a7-88a9-4f3f-b49c-460cd4d8cfff tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:43.371413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-879e78a7-88a9-4f3f-b49c-460cd4d8cfff tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:43.371904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-879e78a7-88a9-4f3f-b49c-460cd4d8cfff tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:43.372694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-879e78a7-88a9-4f3f-b49c-460cd4d8cfff tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:43.376334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-879e78a7-88a9-4f3f-b49c-460cd4d8cfff tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:43.662549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-879e78a7-88a9-4f3f-b49c-460cd4d8cfff tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:43.671490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-879e78a7-88a9-4f3f-b49c-460cd4d8cfff tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:43.673890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-879e78a7-88a9-4f3f-b49c-460cd4d8cfff tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:43.675526 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-879e78a7-88a9-4f3f-b49c-460cd4d8cfff tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1723 microversion: 2.20 time: 0.330133 Mar 05 21:12:43.687216 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2438/4885] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:43 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:44.696572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5df8df30-11e1-4d84-b1a1-134f37d1847d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:44.698389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5df8df30-11e1-4d84-b1a1-134f37d1847d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:44.713470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5df8df30-11e1-4d84-b1a1-134f37d1847d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:44.715137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5df8df30-11e1-4d84-b1a1-134f37d1847d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:44.719031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5df8df30-11e1-4d84-b1a1-134f37d1847d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:44.725310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5df8df30-11e1-4d84-b1a1-134f37d1847d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:45.147619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5df8df30-11e1-4d84-b1a1-134f37d1847d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:45.160661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5df8df30-11e1-4d84-b1a1-134f37d1847d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:45.174569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5df8df30-11e1-4d84-b1a1-134f37d1847d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:45.177491 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5df8df30-11e1-4d84-b1a1-134f37d1847d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1723 microversion: 2.20 time: 0.487046 Mar 05 21:12:45.178096 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2448/4886] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:44 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1723 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:46.199278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d6b2e371-fc04-4879-a06b-8929c2f3a30c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:46.200072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d6b2e371-fc04-4879-a06b-8929c2f3a30c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:46.218653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6b2e371-fc04-4879-a06b-8929c2f3a30c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:46.219225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6b2e371-fc04-4879-a06b-8929c2f3a30c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:46.220316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6b2e371-fc04-4879-a06b-8929c2f3a30c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:46.224812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d6b2e371-fc04-4879-a06b-8929c2f3a30c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:46.608235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d6b2e371-fc04-4879-a06b-8929c2f3a30c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:46.620982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d6b2e371-fc04-4879-a06b-8929c2f3a30c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:46.623045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d6b2e371-fc04-4879-a06b-8929c2f3a30c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:46.624379 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d6b2e371-fc04-4879-a06b-8929c2f3a30c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1744 microversion: 2.20 time: 0.429988 Mar 05 21:12:46.624918 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2439/4887] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:46 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1744 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:47.644014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e06a98b1-cbd3-4dd5-ab0f-ea586d6ed070 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:47.645265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e06a98b1-cbd3-4dd5-ab0f-ea586d6ed070 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:47.658762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e06a98b1-cbd3-4dd5-ab0f-ea586d6ed070 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:47.660612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e06a98b1-cbd3-4dd5-ab0f-ea586d6ed070 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:47.661445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e06a98b1-cbd3-4dd5-ab0f-ea586d6ed070 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:47.661893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e06a98b1-cbd3-4dd5-ab0f-ea586d6ed070 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:48.550295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e06a98b1-cbd3-4dd5-ab0f-ea586d6ed070 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:48.562435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e06a98b1-cbd3-4dd5-ab0f-ea586d6ed070 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:48.564060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e06a98b1-cbd3-4dd5-ab0f-ea586d6ed070 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:48.570998 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e06a98b1-cbd3-4dd5-ab0f-ea586d6ed070 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1744 microversion: 2.20 time: 0.928554 Mar 05 21:12:48.595143 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2449/4888] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:47 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1744 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:49.590593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9beedac7-1ea2-4393-a21b-eedd1169479c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:49.591315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9beedac7-1ea2-4393-a21b-eedd1169479c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:49.597995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9beedac7-1ea2-4393-a21b-eedd1169479c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:49.599791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9beedac7-1ea2-4393-a21b-eedd1169479c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:49.602735 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9beedac7-1ea2-4393-a21b-eedd1169479c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:49.604193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9beedac7-1ea2-4393-a21b-eedd1169479c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:49.963624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9beedac7-1ea2-4393-a21b-eedd1169479c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:49.979054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9beedac7-1ea2-4393-a21b-eedd1169479c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:49.987747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9beedac7-1ea2-4393-a21b-eedd1169479c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:49.989779 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9beedac7-1ea2-4393-a21b-eedd1169479c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1739 microversion: 2.20 time: 0.403748 Mar 05 21:12:49.993907 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2440/4889] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:49 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1739 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:12:51.014573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7642b62c-64cc-4698-b946-c8362973430e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:51.016273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7642b62c-64cc-4698-b946-c8362973430e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:51.028878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7642b62c-64cc-4698-b946-c8362973430e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:51.031030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7642b62c-64cc-4698-b946-c8362973430e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:51.032149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7642b62c-64cc-4698-b946-c8362973430e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:51.034321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7642b62c-64cc-4698-b946-c8362973430e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:51.415134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7642b62c-64cc-4698-b946-c8362973430e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:51.430978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7642b62c-64cc-4698-b946-c8362973430e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:51.437148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7642b62c-64cc-4698-b946-c8362973430e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:51.439574 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7642b62c-64cc-4698-b946-c8362973430e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1739 microversion: 2.20 time: 0.431702 Mar 05 21:12:51.463819 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2450/4890] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:51 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1739 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:52.122769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-08cc047c-3d75-4098-a116-4f50f0310248 req-a546773f-4346-4992-8600-8c88412b60c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba05bcb0-9bc3-42c9-a011-c592459cce1e", "name": "network-vif-plugged", "status": "completed", "tag": "a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:12:52.151036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-08cc047c-3d75-4098-a116-4f50f0310248 req-a546773f-4346-4992-8600-8c88412b60c2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:52.162425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-08cc047c-3d75-4098-a116-4f50f0310248 req-a546773f-4346-4992-8600-8c88412b60c2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:52.187554 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-08cc047c-3d75-4098-a116-4f50f0310248 req-a546773f-4346-4992-8600-8c88412b60c2 service nova] Creating event network-vif-plugged:a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4 for instance ba05bcb0-9bc3-42c9-a011-c592459cce1e on nch1-master-1 Mar 05 21:12:52.199073 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-08cc047c-3d75-4098-a116-4f50f0310248 req-a546773f-4346-4992-8600-8c88412b60c2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080996 Mar 05 21:12:52.203987 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2441/4891] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:12:52.463263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7babb9a7-7fbd-4d02-a70e-22765ad4ce41 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:52.464579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7babb9a7-7fbd-4d02-a70e-22765ad4ce41 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:52.477689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7babb9a7-7fbd-4d02-a70e-22765ad4ce41 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:52.482844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7babb9a7-7fbd-4d02-a70e-22765ad4ce41 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:52.487140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7babb9a7-7fbd-4d02-a70e-22765ad4ce41 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:52.487693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7babb9a7-7fbd-4d02-a70e-22765ad4ce41 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:52.936354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7babb9a7-7fbd-4d02-a70e-22765ad4ce41 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:52.947562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7babb9a7-7fbd-4d02-a70e-22765ad4ce41 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:52.949937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7babb9a7-7fbd-4d02-a70e-22765ad4ce41 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:52.951471 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7babb9a7-7fbd-4d02-a70e-22765ad4ce41 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1739 microversion: 2.20 time: 0.493087 Mar 05 21:12:52.965624 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2451/4892] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:52 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1739 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:53.973118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-809787fd-5b32-44af-be63-839ecb936e49 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:53.974714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-809787fd-5b32-44af-be63-839ecb936e49 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:53.994821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-809787fd-5b32-44af-be63-839ecb936e49 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:53.997285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-809787fd-5b32-44af-be63-839ecb936e49 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:53.998720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-809787fd-5b32-44af-be63-839ecb936e49 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:54.002837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-809787fd-5b32-44af-be63-839ecb936e49 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:54.791514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-809787fd-5b32-44af-be63-839ecb936e49 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:54.827958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-809787fd-5b32-44af-be63-839ecb936e49 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:54.827958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-809787fd-5b32-44af-be63-839ecb936e49 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:54.827958 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-809787fd-5b32-44af-be63-839ecb936e49 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1739 microversion: 2.20 time: 0.857970 Mar 05 21:12:54.844578 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2442/4893] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:53 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1739 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:55.848340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d3d2a09d-0e9c-442a-adb3-c3101b770ba3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:55.849838 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d3d2a09d-0e9c-442a-adb3-c3101b770ba3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:55.878862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3d2a09d-0e9c-442a-adb3-c3101b770ba3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:55.880141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3d2a09d-0e9c-442a-adb3-c3101b770ba3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:55.880939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3d2a09d-0e9c-442a-adb3-c3101b770ba3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:55.881388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3d2a09d-0e9c-442a-adb3-c3101b770ba3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:56.986643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d3d2a09d-0e9c-442a-adb3-c3101b770ba3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:56.998972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d3d2a09d-0e9c-442a-adb3-c3101b770ba3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:57.000571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d3d2a09d-0e9c-442a-adb3-c3101b770ba3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:57.001794 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d3d2a09d-0e9c-442a-adb3-c3101b770ba3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1739 microversion: 2.20 time: 1.158980 Mar 05 21:12:57.002375 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2452/4894] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:55 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1739 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:58.022819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-02affcb3-5fae-4e33-993e-d939969c1022 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:58.025528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-02affcb3-5fae-4e33-993e-d939969c1022 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:58.045853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-02affcb3-5fae-4e33-993e-d939969c1022 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:58.051088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-02affcb3-5fae-4e33-993e-d939969c1022 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:58.054644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-02affcb3-5fae-4e33-993e-d939969c1022 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:58.057472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-02affcb3-5fae-4e33-993e-d939969c1022 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:58.396759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-88e5a50c-da75-454e-ae72-f4ff756b40ad tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:58.398417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-88e5a50c-da75-454e-ae72-f4ff756b40ad tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:58.418914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88e5a50c-da75-454e-ae72-f4ff756b40ad tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:58.418914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88e5a50c-da75-454e-ae72-f4ff756b40ad tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:58.424130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88e5a50c-da75-454e-ae72-f4ff756b40ad tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:58.424776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88e5a50c-da75-454e-ae72-f4ff756b40ad tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:58.503925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-88e5a50c-da75-454e-ae72-f4ff756b40ad tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:12:58.581490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-02affcb3-5fae-4e33-993e-d939969c1022 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:58.598985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-02affcb3-5fae-4e33-993e-d939969c1022 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:58.608518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-02affcb3-5fae-4e33-993e-d939969c1022 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:58.617565 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-02affcb3-5fae-4e33-993e-d939969c1022 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1739 microversion: 2.20 time: 0.595749 Mar 05 21:12:58.635945 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2443/4895] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:58 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1739 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:12:58.685679 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-88e5a50c-da75-454e-ae72-f4ff756b40ad tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 204 len: 0 microversion: 2.1 time: 0.297250 Mar 05 21:12:58.686461 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2453/4896] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:12:58 2022] DELETE /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:12:58.695361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a3804046-d976-46a2-aca3-1584a360fb45 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:58.697100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a3804046-d976-46a2-aca3-1584a360fb45 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:58.713286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3804046-d976-46a2-aca3-1584a360fb45 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:58.716249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3804046-d976-46a2-aca3-1584a360fb45 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:58.717284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3804046-d976-46a2-aca3-1584a360fb45 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:58.719300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3804046-d976-46a2-aca3-1584a360fb45 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:59.056977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a3804046-d976-46a2-aca3-1584a360fb45 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:12:59.065050 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a3804046-d976-46a2-aca3-1584a360fb45 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1553 microversion: 2.1 time: 0.374227 Mar 05 21:12:59.067323 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2444/4897] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:12:58 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1553 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:12:59.641392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ab649836-8e3d-4fbc-88d7-f049fb00dc93 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:12:59.642804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ab649836-8e3d-4fbc-88d7-f049fb00dc93 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:12:59.669473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab649836-8e3d-4fbc-88d7-f049fb00dc93 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:59.670327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab649836-8e3d-4fbc-88d7-f049fb00dc93 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:12:59.671387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab649836-8e3d-4fbc-88d7-f049fb00dc93 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:12:59.672037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ab649836-8e3d-4fbc-88d7-f049fb00dc93 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:00.092241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7571f20d-fe4c-440f-a816-a1c8219a535f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:00.093025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7571f20d-fe4c-440f-a816-a1c8219a535f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:00.107912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7571f20d-fe4c-440f-a816-a1c8219a535f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:00.111573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7571f20d-fe4c-440f-a816-a1c8219a535f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:00.116959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7571f20d-fe4c-440f-a816-a1c8219a535f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:00.117609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7571f20d-fe4c-440f-a816-a1c8219a535f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:00.457463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7571f20d-fe4c-440f-a816-a1c8219a535f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:00.469606 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7571f20d-fe4c-440f-a816-a1c8219a535f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1553 microversion: 2.1 time: 0.387653 Mar 05 21:13:00.471294 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2445/4898] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:00 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1553 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:00.803567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ab649836-8e3d-4fbc-88d7-f049fb00dc93 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:00.837499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ab649836-8e3d-4fbc-88d7-f049fb00dc93 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:00.842216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ab649836-8e3d-4fbc-88d7-f049fb00dc93 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:00.851949 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ab649836-8e3d-4fbc-88d7-f049fb00dc93 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1739 microversion: 2.20 time: 1.216094 Mar 05 21:13:00.870855 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2454/4899] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:12:59 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1739 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:01.490887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-43f04ee9-ab15-45bc-a712-60fe214cd50e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:01.494317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-43f04ee9-ab15-45bc-a712-60fe214cd50e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:01.530157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43f04ee9-ab15-45bc-a712-60fe214cd50e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:01.534477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43f04ee9-ab15-45bc-a712-60fe214cd50e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:01.537209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43f04ee9-ab15-45bc-a712-60fe214cd50e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:01.538426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43f04ee9-ab15-45bc-a712-60fe214cd50e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:01.896858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c878a44e-0123-469c-bbd9-104bd628d680 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:01.897696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c878a44e-0123-469c-bbd9-104bd628d680 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:01.961523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c878a44e-0123-469c-bbd9-104bd628d680 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:01.962025 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c878a44e-0123-469c-bbd9-104bd628d680 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:01.962845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c878a44e-0123-469c-bbd9-104bd628d680 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:01.963302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c878a44e-0123-469c-bbd9-104bd628d680 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:02.070956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-43f04ee9-ab15-45bc-a712-60fe214cd50e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:02.103116 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-43f04ee9-ab15-45bc-a712-60fe214cd50e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1553 microversion: 2.1 time: 0.615895 Mar 05 21:13:02.111191 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2446/4900] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:01 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1553 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:02.579952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-0a34110a-2ef2-4a65-a3f1-f3134f9e2a5c req-61563250-fcce-4a7e-b8ef-043f7ed0ea30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e713812-42a7-4df0-aac0-fbd1bcfb9746", "name": "network-vif-deleted", "tag": "00257fe1-6170-49e1-85e0-c4c078a18a37"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:02.606005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-0a34110a-2ef2-4a65-a3f1-f3134f9e2a5c req-61563250-fcce-4a7e-b8ef-043f7ed0ea30 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:02.606362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-0a34110a-2ef2-4a65-a3f1-f3134f9e2a5c req-61563250-fcce-4a7e-b8ef-043f7ed0ea30 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:02.708925 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-0a34110a-2ef2-4a65-a3f1-f3134f9e2a5c req-61563250-fcce-4a7e-b8ef-043f7ed0ea30 service nova] Creating event network-vif-deleted:00257fe1-6170-49e1-85e0-c4c078a18a37 for instance 2e713812-42a7-4df0-aac0-fbd1bcfb9746 on nch2-master-1 Mar 05 21:13:02.734379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c878a44e-0123-469c-bbd9-104bd628d680 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:02.739465 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-0a34110a-2ef2-4a65-a3f1-f3134f9e2a5c req-61563250-fcce-4a7e-b8ef-043f7ed0ea30 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164324 Mar 05 21:13:02.752519 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2447/4901] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:02.753144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c878a44e-0123-469c-bbd9-104bd628d680 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:02.754927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c878a44e-0123-469c-bbd9-104bd628d680 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:02.763224 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c878a44e-0123-469c-bbd9-104bd628d680 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1739 microversion: 2.20 time: 0.870835 Mar 05 21:13:02.768037 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2455/4902] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:01 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1739 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:13:03.129885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-52a8a4ec-0ee8-4794-b5dd-ae9890df0560 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:03.130613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-52a8a4ec-0ee8-4794-b5dd-ae9890df0560 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:03.145602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a8a4ec-0ee8-4794-b5dd-ae9890df0560 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:03.147336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a8a4ec-0ee8-4794-b5dd-ae9890df0560 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:03.150060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a8a4ec-0ee8-4794-b5dd-ae9890df0560 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:03.151220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a8a4ec-0ee8-4794-b5dd-ae9890df0560 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:03.269217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a8a4ec-0ee8-4794-b5dd-ae9890df0560 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:03.272143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52a8a4ec-0ee8-4794-b5dd-ae9890df0560 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:03.273707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-52a8a4ec-0ee8-4794-b5dd-ae9890df0560 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lazy-loading 'fault' on Instance uuid 2e713812-42a7-4df0-aac0-fbd1bcfb9746 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:13:03.775510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-52a8a4ec-0ee8-4794-b5dd-ae9890df0560 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:03.785731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d23a1257-f537-4a81-9ff1-3635d5fea4ea tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:03.787081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d23a1257-f537-4a81-9ff1-3635d5fea4ea tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:03.793813 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-52a8a4ec-0ee8-4794-b5dd-ae9890df0560 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 200 len: 1338 microversion: 2.1 time: 0.667537 Mar 05 21:13:03.807388 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2448/4903] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:03 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 1338 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:03.811700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d23a1257-f537-4a81-9ff1-3635d5fea4ea tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:03.820411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d23a1257-f537-4a81-9ff1-3635d5fea4ea tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:03.821812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d23a1257-f537-4a81-9ff1-3635d5fea4ea tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:03.824400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d23a1257-f537-4a81-9ff1-3635d5fea4ea tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:04.127167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-854691513", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "7b01390b-af80-47c7-b861-6f85f06d7866"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:04.232166 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] validate_networks() for [('7b01390b-af80-47c7-b861-6f85f06d7866', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:13:04.298550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d23a1257-f537-4a81-9ff1-3635d5fea4ea tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:04.318010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d23a1257-f537-4a81-9ff1-3635d5fea4ea tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:04.331231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d23a1257-f537-4a81-9ff1-3635d5fea4ea tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:04.333944 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d23a1257-f537-4a81-9ff1-3635d5fea4ea tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1739 microversion: 2.20 time: 0.553168 Mar 05 21:13:04.341517 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2456/4904] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:03 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1739 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:13:04.815086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1de8ada4-43b6-491a-8550-8b004637f69c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:04.815855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1de8ada4-43b6-491a-8550-8b004637f69c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: 2e713812-42a7-4df0-aac0-fbd1bcfb9746] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:04.833987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1de8ada4-43b6-491a-8550-8b004637f69c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:04.835616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1de8ada4-43b6-491a-8550-8b004637f69c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:04.837335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1de8ada4-43b6-491a-8550-8b004637f69c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:04.838965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1de8ada4-43b6-491a-8550-8b004637f69c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:04.886083 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-1de8ada4-43b6-491a-8550-8b004637f69c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] HTTP exception thrown: Instance 2e713812-42a7-4df0-aac0-fbd1bcfb9746 could not be found. Mar 05 21:13:04.888746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1de8ada4-43b6-491a-8550-8b004637f69c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Returning 404 to user: Instance 2e713812-42a7-4df0-aac0-fbd1bcfb9746 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:13:04.894029 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1de8ada4-43b6-491a-8550-8b004637f69c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746" status: 404 len: 111 microversion: 2.1 time: 0.084340 Mar 05 21:13:04.898284 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2457/4905] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:04 2022] GET /compute/v2.1/servers/2e713812-42a7-4df0-aac0-fbd1bcfb9746 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:13:05.033521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:13:05.034931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:13:05.035624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:13:05.036458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:13:05.037137 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:13:05.052321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:05.053077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:05.054724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:05.055418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:05.081730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Getting quotas for project 7a6813d01c694475a2a3645008b1c369. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:13:05.090399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Getting quotas for user 9a5fca5fc43f4bd5971397ba20da0bbd and project 7a6813d01c694475a2a3645008b1c369. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:13:05.108051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:13:05.110707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:13:05.194650 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a42ab425-80be-44d3-9722-ed79a21a5ac7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.070656 Mar 05 21:13:05.203882 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2449/4906] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:13:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:13:05.207445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d4e4efb9-57f0-493d-84e5-30aeeb7243cb tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:05.208119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d4e4efb9-57f0-493d-84e5-30aeeb7243cb tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:05.359886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-14ef298b-4cd3-418f-b4b6-4732965a60f9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:05.360527 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-14ef298b-4cd3-418f-b4b6-4732965a60f9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:05.378915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14ef298b-4cd3-418f-b4b6-4732965a60f9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:05.381677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14ef298b-4cd3-418f-b4b6-4732965a60f9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:05.386345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14ef298b-4cd3-418f-b4b6-4732965a60f9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:05.386840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-14ef298b-4cd3-418f-b4b6-4732965a60f9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:05.537655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d4e4efb9-57f0-493d-84e5-30aeeb7243cb tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:05.545452 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d4e4efb9-57f0-493d-84e5-30aeeb7243cb tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1213 microversion: 2.1 time: 0.341885 Mar 05 21:13:05.553049 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2458/4907] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:05 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1213 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:05.824448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-14ef298b-4cd3-418f-b4b6-4732965a60f9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:05.850100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-14ef298b-4cd3-418f-b4b6-4732965a60f9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:05.862250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-14ef298b-4cd3-418f-b4b6-4732965a60f9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:05.863279 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-14ef298b-4cd3-418f-b4b6-4732965a60f9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1739 microversion: 2.20 time: 0.507727 Mar 05 21:13:05.866888 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2450/4908] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:05 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1739 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:13:05.952173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-09f418fa-ec66-4525-9036-f759d6a2ddaf tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '.version_select at 0x7fed4f787790>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:06.035250 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-09f418fa-ec66-4525-9036-f759d6a2ddaf tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-635318835" status: 202 len: 0 microversion: 2.1 time: 0.086674 Mar 05 21:13:06.041710 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2459/4909] 10.222.0.15 () {58 vars in 1253 bytes} [Sat Mar 5 21:13:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-635318835 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:13:06.568255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ef74cfce-123d-435d-b280-9d16e66b3b6f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:06.569091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ef74cfce-123d-435d-b280-9d16e66b3b6f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:06.582666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef74cfce-123d-435d-b280-9d16e66b3b6f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:06.583412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef74cfce-123d-435d-b280-9d16e66b3b6f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:06.586869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef74cfce-123d-435d-b280-9d16e66b3b6f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:06.590207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef74cfce-123d-435d-b280-9d16e66b3b6f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:06.889362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-864af557-2640-4b93-b124-a4a2493fdfe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:06.891175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-864af557-2640-4b93-b124-a4a2493fdfe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:06.903764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-864af557-2640-4b93-b124-a4a2493fdfe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:06.904517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-864af557-2640-4b93-b124-a4a2493fdfe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:06.907367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-864af557-2640-4b93-b124-a4a2493fdfe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:06.908118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-864af557-2640-4b93-b124-a4a2493fdfe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:07.010827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ef74cfce-123d-435d-b280-9d16e66b3b6f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:07.031181 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ef74cfce-123d-435d-b280-9d16e66b3b6f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1209 microversion: 2.1 time: 0.464400 Mar 05 21:13:07.037499 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2451/4910] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:06 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1209 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:08.010059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-864af557-2640-4b93-b124-a4a2493fdfe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:08.041885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-864af557-2640-4b93-b124-a4a2493fdfe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:08.047545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-864af557-2640-4b93-b124-a4a2493fdfe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:08.052201 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-864af557-2640-4b93-b124-a4a2493fdfe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1739 microversion: 2.20 time: 1.166360 Mar 05 21:13:08.053691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f9a8fbfa-6a5f-41a2-9166-ba3be086abfe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:08.054514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f9a8fbfa-6a5f-41a2-9166-ba3be086abfe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:08.055362 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2460/4911] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:06 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1739 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:08.076309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9a8fbfa-6a5f-41a2-9166-ba3be086abfe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:08.077361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9a8fbfa-6a5f-41a2-9166-ba3be086abfe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:08.078515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9a8fbfa-6a5f-41a2-9166-ba3be086abfe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:08.088084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9a8fbfa-6a5f-41a2-9166-ba3be086abfe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:08.234326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f9a8fbfa-6a5f-41a2-9166-ba3be086abfe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:08.242546 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f9a8fbfa-6a5f-41a2-9166-ba3be086abfe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1271 microversion: 2.1 time: 0.192936 Mar 05 21:13:08.244504 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2452/4912] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:08 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:09.081283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a6b8e384-7f35-402f-9dfd-053f51b3dd53 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:09.088400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a6b8e384-7f35-402f-9dfd-053f51b3dd53 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:09.140530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6b8e384-7f35-402f-9dfd-053f51b3dd53 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:09.141272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6b8e384-7f35-402f-9dfd-053f51b3dd53 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:09.143784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6b8e384-7f35-402f-9dfd-053f51b3dd53 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:09.145187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6b8e384-7f35-402f-9dfd-053f51b3dd53 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:09.271022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b44323ab-59b0-4fd7-9789-81a8f3bf4c6b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:09.271685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b44323ab-59b0-4fd7-9789-81a8f3bf4c6b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:09.296155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b44323ab-59b0-4fd7-9789-81a8f3bf4c6b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:09.296738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b44323ab-59b0-4fd7-9789-81a8f3bf4c6b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:09.297793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b44323ab-59b0-4fd7-9789-81a8f3bf4c6b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:09.298443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b44323ab-59b0-4fd7-9789-81a8f3bf4c6b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:09.808947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b44323ab-59b0-4fd7-9789-81a8f3bf4c6b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:09.819922 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b44323ab-59b0-4fd7-9789-81a8f3bf4c6b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1313 microversion: 2.1 time: 0.557670 Mar 05 21:13:09.820043 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2453/4913] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:09 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:10.045729 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a6b8e384-7f35-402f-9dfd-053f51b3dd53 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:10.057907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a6b8e384-7f35-402f-9dfd-053f51b3dd53 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:10.063042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a6b8e384-7f35-402f-9dfd-053f51b3dd53 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:10.069691 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a6b8e384-7f35-402f-9dfd-053f51b3dd53 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1739 microversion: 2.20 time: 0.992918 Mar 05 21:13:10.072541 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2461/4914] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:09 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1739 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:10.838259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2a71b83a-917a-4afa-a5e2-60452ca97fd8 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:10.838897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2a71b83a-917a-4afa-a5e2-60452ca97fd8 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:10.861608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a71b83a-917a-4afa-a5e2-60452ca97fd8 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:10.862126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a71b83a-917a-4afa-a5e2-60452ca97fd8 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:10.863015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a71b83a-917a-4afa-a5e2-60452ca97fd8 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:10.863503 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a71b83a-917a-4afa-a5e2-60452ca97fd8 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:11.092410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6bac7dc8-9147-4459-b205-f407aeceb4f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:11.093733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6bac7dc8-9147-4459-b205-f407aeceb4f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:11.109545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bac7dc8-9147-4459-b205-f407aeceb4f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:11.124177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bac7dc8-9147-4459-b205-f407aeceb4f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:11.125275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bac7dc8-9147-4459-b205-f407aeceb4f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:11.125718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bac7dc8-9147-4459-b205-f407aeceb4f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:11.626759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2a71b83a-917a-4afa-a5e2-60452ca97fd8 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:11.639891 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2a71b83a-917a-4afa-a5e2-60452ca97fd8 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1313 microversion: 2.1 time: 0.804598 Mar 05 21:13:11.641798 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2454/4915] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:10 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1313 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:11.737062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6bac7dc8-9147-4459-b205-f407aeceb4f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:11.747839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6bac7dc8-9147-4459-b205-f407aeceb4f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:11.749901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6bac7dc8-9147-4459-b205-f407aeceb4f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:11.753170 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6bac7dc8-9147-4459-b205-f407aeceb4f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1739 microversion: 2.20 time: 0.667038 Mar 05 21:13:11.757777 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2462/4916] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:11 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1739 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:11.924808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a7acd7e2-7c02-475a-ad4d-ac4967c26e85 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:11.926350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a7acd7e2-7c02-475a-ad4d-ac4967c26e85 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:11.946971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-86f34d43-3012-42e4-aa72-ed4003382ff0 req-bb73f6b3-d0d1-4177-b5c3-f2540d8cfc6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eade4ef9-e6d1-4f9c-82be-8616813b5aef", "tag": "7760e862-823a-4806-9c12-ad39ee170581"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:11.950858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7acd7e2-7c02-475a-ad4d-ac4967c26e85 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:11.954744 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7acd7e2-7c02-475a-ad4d-ac4967c26e85 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:11.958122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7acd7e2-7c02-475a-ad4d-ac4967c26e85 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:11.958895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7acd7e2-7c02-475a-ad4d-ac4967c26e85 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:11.967764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-86f34d43-3012-42e4-aa72-ed4003382ff0 req-bb73f6b3-d0d1-4177-b5c3-f2540d8cfc6c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:11.971314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-86f34d43-3012-42e4-aa72-ed4003382ff0 req-bb73f6b3-d0d1-4177-b5c3-f2540d8cfc6c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:11.998258 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-86f34d43-3012-42e4-aa72-ed4003382ff0 req-bb73f6b3-d0d1-4177-b5c3-f2540d8cfc6c service nova] Creating event network-changed:7760e862-823a-4806-9c12-ad39ee170581 for instance eade4ef9-e6d1-4f9c-82be-8616813b5aef on nch2-master-1 Mar 05 21:13:12.010873 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-86f34d43-3012-42e4-aa72-ed4003382ff0 req-bb73f6b3-d0d1-4177-b5c3-f2540d8cfc6c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069271 Mar 05 21:13:12.020048 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2463/4917] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:13:12.026509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-0e0a9ce9-0ee8-49f4-adce-9568fecacd42 req-01b2940a-c3ef-4edf-8e39-e2c0ef4d0b97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0a57db-9d48-4aed-90ac-42492dda1a36", "tag": "ea1c2fe7-a4f7-4275-bd44-c9c3c90a0f5f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:12.058365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0e0a9ce9-0ee8-49f4-adce-9568fecacd42 req-01b2940a-c3ef-4edf-8e39-e2c0ef4d0b97 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:12.058856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0e0a9ce9-0ee8-49f4-adce-9568fecacd42 req-01b2940a-c3ef-4edf-8e39-e2c0ef4d0b97 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:12.094021 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0e0a9ce9-0ee8-49f4-adce-9568fecacd42 req-01b2940a-c3ef-4edf-8e39-e2c0ef4d0b97 service nova] Creating event network-changed:ea1c2fe7-a4f7-4275-bd44-c9c3c90a0f5f for instance ce0a57db-9d48-4aed-90ac-42492dda1a36 on nch2-master-1 Mar 05 21:13:12.097229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a7acd7e2-7c02-475a-ad4d-ac4967c26e85 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:13:12.099425 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-0e0a9ce9-0ee8-49f4-adce-9568fecacd42 req-01b2940a-c3ef-4edf-8e39-e2c0ef4d0b97 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077939 Mar 05 21:13:12.100093 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2464/4918] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:12.291188 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a7acd7e2-7c02-475a-ad4d-ac4967c26e85 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 204 len: 0 microversion: 2.1 time: 0.370328 Mar 05 21:13:12.294774 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2455/4919] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:13:11 2022] DELETE /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:13:12.309549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5f16ad05-81af-4363-b41f-aabb50221fac tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:12.310490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5f16ad05-81af-4363-b41f-aabb50221fac tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:12.332533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f16ad05-81af-4363-b41f-aabb50221fac tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:12.332994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f16ad05-81af-4363-b41f-aabb50221fac tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:12.333782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f16ad05-81af-4363-b41f-aabb50221fac tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:12.334227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5f16ad05-81af-4363-b41f-aabb50221fac tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:12.667118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4cef4efc-443b-45c6-85a2-672a730ac703 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:12.668571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4cef4efc-443b-45c6-85a2-672a730ac703 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:12.681475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cef4efc-443b-45c6-85a2-672a730ac703 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:12.683153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cef4efc-443b-45c6-85a2-672a730ac703 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:12.686158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cef4efc-443b-45c6-85a2-672a730ac703 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:12.687917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cef4efc-443b-45c6-85a2-672a730ac703 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:12.906774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5f16ad05-81af-4363-b41f-aabb50221fac tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:12.916637 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5f16ad05-81af-4363-b41f-aabb50221fac tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1672 microversion: 2.1 time: 0.614138 Mar 05 21:13:12.923112 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2465/4920] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:12 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1672 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:12.939651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-48996ab8-015b-4075-8443-f2c15007a61f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:12.944788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-48996ab8-015b-4075-8443-f2c15007a61f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:12.967901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48996ab8-015b-4075-8443-f2c15007a61f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:12.970600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48996ab8-015b-4075-8443-f2c15007a61f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:12.971951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48996ab8-015b-4075-8443-f2c15007a61f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:12.977327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48996ab8-015b-4075-8443-f2c15007a61f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:13.421898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-48996ab8-015b-4075-8443-f2c15007a61f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:13.436572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-48996ab8-015b-4075-8443-f2c15007a61f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:13.441576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-48996ab8-015b-4075-8443-f2c15007a61f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:13.443267 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-48996ab8-015b-4075-8443-f2c15007a61f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1721 microversion: 2.20 time: 0.518847 Mar 05 21:13:13.449563 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2466/4921] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:12 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1721 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:13.942740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d84836f3-d0d6-4538-9e49-59da209c9b48 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:13.943911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d84836f3-d0d6-4538-9e49-59da209c9b48 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:13.953397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d84836f3-d0d6-4538-9e49-59da209c9b48 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:13.954624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d84836f3-d0d6-4538-9e49-59da209c9b48 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:13.955802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d84836f3-d0d6-4538-9e49-59da209c9b48 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:13.957302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d84836f3-d0d6-4538-9e49-59da209c9b48 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:14.131822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4cef4efc-443b-45c6-85a2-672a730ac703 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:14.154504 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4cef4efc-443b-45c6-85a2-672a730ac703 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1313 microversion: 2.1 time: 1.500633 Mar 05 21:13:14.155630 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2456/4922] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:12 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1313 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:14.465020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-316227b2-807b-4adc-9d32-950e41803e1f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:14.466100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-316227b2-807b-4adc-9d32-950e41803e1f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:14.478122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d84836f3-d0d6-4538-9e49-59da209c9b48 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:14.486031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-316227b2-807b-4adc-9d32-950e41803e1f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:14.486680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-316227b2-807b-4adc-9d32-950e41803e1f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:14.487655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-316227b2-807b-4adc-9d32-950e41803e1f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:14.488194 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d84836f3-d0d6-4538-9e49-59da209c9b48 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1672 microversion: 2.1 time: 0.551273 Mar 05 21:13:14.488517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-316227b2-807b-4adc-9d32-950e41803e1f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:14.502977 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2467/4923] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:13 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1672 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:15.022600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6df683b2-ff4e-4831-a705-870b3c8c2743 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:15.023285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6df683b2-ff4e-4831-a705-870b3c8c2743 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:15.036256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6df683b2-ff4e-4831-a705-870b3c8c2743 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.037402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6df683b2-ff4e-4831-a705-870b3c8c2743 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.038586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6df683b2-ff4e-4831-a705-870b3c8c2743 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.041086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6df683b2-ff4e-4831-a705-870b3c8c2743 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.108871 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6df683b2-ff4e-4831-a705-870b3c8c2743 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6/ips" status: 200 len: 149 microversion: 2.1 time: 0.090304 Mar 05 21:13:15.109691 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2468/4924] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 21:13:15 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6/ips => generated 149 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:15.114204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-2614ee94-777f-402d-9998-2a79cd1e001b req-3c16db11-3a7c-4b85-a86b-b4fbd8dc9b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0a57db-9d48-4aed-90ac-42492dda1a36", "name": "network-vif-deleted", "tag": "ea1c2fe7-a4f7-4275-bd44-c9c3c90a0f5f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:15.124053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2614ee94-777f-402d-9998-2a79cd1e001b req-3c16db11-3a7c-4b85-a86b-b4fbd8dc9b84 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.124754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2614ee94-777f-402d-9998-2a79cd1e001b req-3c16db11-3a7c-4b85-a86b-b4fbd8dc9b84 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.138170 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-2614ee94-777f-402d-9998-2a79cd1e001b req-3c16db11-3a7c-4b85-a86b-b4fbd8dc9b84 service nova] Creating event network-vif-deleted:ea1c2fe7-a4f7-4275-bd44-c9c3c90a0f5f for instance ce0a57db-9d48-4aed-90ac-42492dda1a36 on nch2-master-1 Mar 05 21:13:15.148405 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-2614ee94-777f-402d-9998-2a79cd1e001b req-3c16db11-3a7c-4b85-a86b-b4fbd8dc9b84 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035447 Mar 05 21:13:15.150721 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2469/4925] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:15.163483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-31df83fd-5413-44fb-b105-767c60abd0fb tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a4054d8-18e9-4856-b7b4-20817b2ed9e5"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:15.165439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-31df83fd-5413-44fb-b105-767c60abd0fb tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:15.176217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31df83fd-5413-44fb-b105-767c60abd0fb tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.177108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31df83fd-5413-44fb-b105-767c60abd0fb tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.178691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31df83fd-5413-44fb-b105-767c60abd0fb tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.179646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31df83fd-5413-44fb-b105-767c60abd0fb tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.331884 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-31df83fd-5413-44fb-b105-767c60abd0fb tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Invalid volume: volume 0a4054d8-18e9-4856-b7b4-20817b2ed9e5 is already attached to instances: 024b8477-8c82-4b91-879f-48b125f19e40 Mar 05 21:13:15.332623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-31df83fd-5413-44fb-b105-767c60abd0fb tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 400 to user: Invalid volume: volume 0a4054d8-18e9-4856-b7b4-20817b2ed9e5 is already attached to instances: 024b8477-8c82-4b91-879f-48b125f19e40 {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:13:15.333342 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-31df83fd-5413-44fb-b105-767c60abd0fb tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "POST /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.176300 Mar 05 21:13:15.333941 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2470/4926] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:13:15 2022] POST /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6/os-volume_attachments => generated 174 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:13:15.346712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-50422143-c508-467e-ae7b-14b742abab57 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:15.349692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-50422143-c508-467e-ae7b-14b742abab57 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:15.350840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-316227b2-807b-4adc-9d32-950e41803e1f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:15.368525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-50422143-c508-467e-ae7b-14b742abab57 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.371817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-50422143-c508-467e-ae7b-14b742abab57 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.373163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-316227b2-807b-4adc-9d32-950e41803e1f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:15.374823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-316227b2-807b-4adc-9d32-950e41803e1f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:15.375132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-50422143-c508-467e-ae7b-14b742abab57 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.376320 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-316227b2-807b-4adc-9d32-950e41803e1f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1721 microversion: 2.20 time: 0.917010 Mar 05 21:13:15.377505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-50422143-c508-467e-ae7b-14b742abab57 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.386139 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2457/4927] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:14 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1721 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:15.402220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b962fea5-834c-44ae-8a09-9e3d29203f2a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:15.412172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b962fea5-834c-44ae-8a09-9e3d29203f2a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:15.443745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b962fea5-834c-44ae-8a09-9e3d29203f2a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.444446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b962fea5-834c-44ae-8a09-9e3d29203f2a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.445495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b962fea5-834c-44ae-8a09-9e3d29203f2a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.447360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b962fea5-834c-44ae-8a09-9e3d29203f2a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.518765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b962fea5-834c-44ae-8a09-9e3d29203f2a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:13:15.662358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-50422143-c508-467e-ae7b-14b742abab57 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:15.672749 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-50422143-c508-467e-ae7b-14b742abab57 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1313 microversion: 2.1 time: 0.337759 Mar 05 21:13:15.674019 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2471/4928] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:15 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:15.684412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e73677b7-0e7d-46d2-af05-677130db60ce req-9217959b-4d13-4ffb-aadd-d7bda3ec008a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba05bcb0-9bc3-42c9-a011-c592459cce1e", "name": "network-vif-unplugged", "status": "completed", "tag": "a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:15.694996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e73677b7-0e7d-46d2-af05-677130db60ce req-9217959b-4d13-4ffb-aadd-d7bda3ec008a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.695744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e73677b7-0e7d-46d2-af05-677130db60ce req-9217959b-4d13-4ffb-aadd-d7bda3ec008a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.718860 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e73677b7-0e7d-46d2-af05-677130db60ce req-9217959b-4d13-4ffb-aadd-d7bda3ec008a service nova] Creating event network-vif-unplugged:a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4 for instance ba05bcb0-9bc3-42c9-a011-c592459cce1e on nch1-master-1 Mar 05 21:13:15.732870 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e73677b7-0e7d-46d2-af05-677130db60ce req-9217959b-4d13-4ffb-aadd-d7bda3ec008a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046323 Mar 05 21:13:15.733299 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b962fea5-834c-44ae-8a09-9e3d29203f2a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 204 len: 0 microversion: 2.1 time: 0.335451 Mar 05 21:13:15.733993 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2458/4929] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:13:15 2022] DELETE /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:13:15.742387 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2472/4930] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:15.743153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cecc8e4a-d202-4fb5-a078-9dfc2d5885a5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:15.743931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cecc8e4a-d202-4fb5-a078-9dfc2d5885a5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:15.752384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d4e00354-4968-4fc8-9b6f-39d77297334c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:15.752384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d4e00354-4968-4fc8-9b6f-39d77297334c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:15.778669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cecc8e4a-d202-4fb5-a078-9dfc2d5885a5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.782337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cecc8e4a-d202-4fb5-a078-9dfc2d5885a5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.790203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4e00354-4968-4fc8-9b6f-39d77297334c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.790928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4e00354-4968-4fc8-9b6f-39d77297334c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.792278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cecc8e4a-d202-4fb5-a078-9dfc2d5885a5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.792743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cecc8e4a-d202-4fb5-a078-9dfc2d5885a5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.793868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4e00354-4968-4fc8-9b6f-39d77297334c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.796072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4e00354-4968-4fc8-9b6f-39d77297334c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.861350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cecc8e4a-d202-4fb5-a078-9dfc2d5885a5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:15.862442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cecc8e4a-d202-4fb5-a078-9dfc2d5885a5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:15.862995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-cecc8e4a-d202-4fb5-a078-9dfc2d5885a5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lazy-loading 'fault' on Instance uuid ce0a57db-9d48-4aed-90ac-42492dda1a36 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:13:15.923691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cecc8e4a-d202-4fb5-a078-9dfc2d5885a5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:15.955186 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cecc8e4a-d202-4fb5-a078-9dfc2d5885a5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 200 len: 1490 microversion: 2.1 time: 0.219846 Mar 05 21:13:15.958683 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2459/4931] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:15 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 1490 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:16.088982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d4e00354-4968-4fc8-9b6f-39d77297334c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:16.096775 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d4e00354-4968-4fc8-9b6f-39d77297334c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1680 microversion: 2.1 time: 0.352396 Mar 05 21:13:16.097358 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2473/4932] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:15 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1680 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:16.405322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd1aa3a1-fa8c-43af-bc5b-50bc0d63af77 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:16.406620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd1aa3a1-fa8c-43af-bc5b-50bc0d63af77 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:16.413032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1aa3a1-fa8c-43af-bc5b-50bc0d63af77 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:16.413473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1aa3a1-fa8c-43af-bc5b-50bc0d63af77 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:16.414496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1aa3a1-fa8c-43af-bc5b-50bc0d63af77 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:16.414915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1aa3a1-fa8c-43af-bc5b-50bc0d63af77 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:16.678650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd1aa3a1-fa8c-43af-bc5b-50bc0d63af77 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:16.690444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dcb8ad6c-6260-4af6-a2d0-a1e0731fd608 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:16.693050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dcb8ad6c-6260-4af6-a2d0-a1e0731fd608 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:16.701879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcb8ad6c-6260-4af6-a2d0-a1e0731fd608 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:16.702579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcb8ad6c-6260-4af6-a2d0-a1e0731fd608 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:16.703608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcb8ad6c-6260-4af6-a2d0-a1e0731fd608 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:16.704287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dcb8ad6c-6260-4af6-a2d0-a1e0731fd608 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:16.708483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd1aa3a1-fa8c-43af-bc5b-50bc0d63af77 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:16.710008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd1aa3a1-fa8c-43af-bc5b-50bc0d63af77 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:16.711223 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd1aa3a1-fa8c-43af-bc5b-50bc0d63af77 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1721 microversion: 2.20 time: 0.309861 Mar 05 21:13:16.739248 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2460/4933] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:16 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1721 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:13:16.974358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4cbca003-ea6b-4ce9-806f-a5265547a344 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:16.974976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4cbca003-ea6b-4ce9-806f-a5265547a344 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: ce0a57db-9d48-4aed-90ac-42492dda1a36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:16.982018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cbca003-ea6b-4ce9-806f-a5265547a344 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:16.982820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cbca003-ea6b-4ce9-806f-a5265547a344 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:16.983846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cbca003-ea6b-4ce9-806f-a5265547a344 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:16.984518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cbca003-ea6b-4ce9-806f-a5265547a344 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:17.003425 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4cbca003-ea6b-4ce9-806f-a5265547a344 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] HTTP exception thrown: Instance ce0a57db-9d48-4aed-90ac-42492dda1a36 could not be found. Mar 05 21:13:17.004428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4cbca003-ea6b-4ce9-806f-a5265547a344 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Returning 404 to user: Instance ce0a57db-9d48-4aed-90ac-42492dda1a36 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:13:17.005355 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4cbca003-ea6b-4ce9-806f-a5265547a344 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36" status: 404 len: 111 microversion: 2.1 time: 0.034894 Mar 05 21:13:17.010608 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2461/4934] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:16 2022] GET /compute/v2.1/servers/ce0a57db-9d48-4aed-90ac-42492dda1a36 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:13:17.038068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dcb8ad6c-6260-4af6-a2d0-a1e0731fd608 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:17.049405 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dcb8ad6c-6260-4af6-a2d0-a1e0731fd608 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1313 microversion: 2.1 time: 0.362923 Mar 05 21:13:17.052684 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2474/4935] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:16 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:17.116935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2a1eab97-b166-4bf3-9a58-87cfa27a97ef tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:17.117572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2a1eab97-b166-4bf3-9a58-87cfa27a97ef tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:17.131315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a1eab97-b166-4bf3-9a58-87cfa27a97ef tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:17.131893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a1eab97-b166-4bf3-9a58-87cfa27a97ef tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:17.132953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a1eab97-b166-4bf3-9a58-87cfa27a97ef tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:17.136238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a1eab97-b166-4bf3-9a58-87cfa27a97ef tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:17.480041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5a472d23-f2cc-46c0-86d1-94cfd0587566 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '.version_select at 0x7fed4f7b9a60>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:17.500594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2a1eab97-b166-4bf3-9a58-87cfa27a97ef tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:17.508917 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2a1eab97-b166-4bf3-9a58-87cfa27a97ef tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1680 microversion: 2.1 time: 0.396766 Mar 05 21:13:17.512653 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2462/4936] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:17 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1680 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:17.525619 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5a472d23-f2cc-46c0-86d1-94cfd0587566 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-573613390" status: 202 len: 0 microversion: 2.1 time: 0.048163 Mar 05 21:13:17.526407 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2475/4937] 10.222.0.15 () {58 vars in 1253 bytes} [Sat Mar 5 21:13:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-573613390 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:13:17.747196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1acf0c83-68a3-474f-99c6-48c9f448ac4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:17.748450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1acf0c83-68a3-474f-99c6-48c9f448ac4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:17.769408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1acf0c83-68a3-474f-99c6-48c9f448ac4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:17.770538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1acf0c83-68a3-474f-99c6-48c9f448ac4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:17.773193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1acf0c83-68a3-474f-99c6-48c9f448ac4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:17.775393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1acf0c83-68a3-474f-99c6-48c9f448ac4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:18.076485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6df118be-3106-441a-9ee0-ded02e556976 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:18.077232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6df118be-3106-441a-9ee0-ded02e556976 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:18.084632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6df118be-3106-441a-9ee0-ded02e556976 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:18.085173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6df118be-3106-441a-9ee0-ded02e556976 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:18.086038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6df118be-3106-441a-9ee0-ded02e556976 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:18.087199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6df118be-3106-441a-9ee0-ded02e556976 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:18.382924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1acf0c83-68a3-474f-99c6-48c9f448ac4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:18.414290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1acf0c83-68a3-474f-99c6-48c9f448ac4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:18.418966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1acf0c83-68a3-474f-99c6-48c9f448ac4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:18.422919 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1acf0c83-68a3-474f-99c6-48c9f448ac4b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1664 microversion: 2.20 time: 0.680635 Mar 05 21:13:18.424319 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2463/4938] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:17 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1664 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:13:18.429110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6df118be-3106-441a-9ee0-ded02e556976 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:18.437982 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6df118be-3106-441a-9ee0-ded02e556976 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1313 microversion: 2.1 time: 0.368241 Mar 05 21:13:18.441764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82a6292d-8690-4a64-ba45-2f0c23d9b00d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e28a20a7-45f6-4921-9f87-076085057103"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:18.443988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-82a6292d-8690-4a64-ba45-2f0c23d9b00d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:18.451262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82a6292d-8690-4a64-ba45-2f0c23d9b00d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:18.451920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82a6292d-8690-4a64-ba45-2f0c23d9b00d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:18.452108 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2476/4939] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:18 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:18.453192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82a6292d-8690-4a64-ba45-2f0c23d9b00d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:18.453847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82a6292d-8690-4a64-ba45-2f0c23d9b00d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:18.532190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4d804977-af28-40ac-9715-be89f9bf43f1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:18.533330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4d804977-af28-40ac-9715-be89f9bf43f1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:18.544391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d804977-af28-40ac-9715-be89f9bf43f1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:18.545160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d804977-af28-40ac-9715-be89f9bf43f1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:18.546307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d804977-af28-40ac-9715-be89f9bf43f1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:18.547126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d804977-af28-40ac-9715-be89f9bf43f1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:18.856245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4d804977-af28-40ac-9715-be89f9bf43f1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:18.865863 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4d804977-af28-40ac-9715-be89f9bf43f1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1680 microversion: 2.1 time: 0.337609 Mar 05 21:13:18.867045 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2477/4940] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:18 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1680 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:18.872589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-5175b1b8-d7c9-4621-85ac-728b4c5e2af2 req-1d185577-28fc-44f8-ba55-1446e8e84fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eade4ef9-e6d1-4f9c-82be-8616813b5aef", "name": "network-vif-plugged", "status": "completed", "tag": "7760e862-823a-4806-9c12-ad39ee170581"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:18.882258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5175b1b8-d7c9-4621-85ac-728b4c5e2af2 req-1d185577-28fc-44f8-ba55-1446e8e84fc1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:18.882970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5175b1b8-d7c9-4621-85ac-728b4c5e2af2 req-1d185577-28fc-44f8-ba55-1446e8e84fc1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:18.931442 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-5175b1b8-d7c9-4621-85ac-728b4c5e2af2 req-1d185577-28fc-44f8-ba55-1446e8e84fc1 service nova] Creating event network-vif-plugged:7760e862-823a-4806-9c12-ad39ee170581 for instance eade4ef9-e6d1-4f9c-82be-8616813b5aef on nch2-master-1 Mar 05 21:13:18.947331 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-5175b1b8-d7c9-4621-85ac-728b4c5e2af2 req-1d185577-28fc-44f8-ba55-1446e8e84fc1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077999 Mar 05 21:13:18.952789 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2478/4941] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:19.033040 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-82a6292d-8690-4a64-ba45-2f0c23d9b00d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "POST /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.594796 Mar 05 21:13:19.038177 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2464/4942] 10.222.0.15 () {62 vars in 1363 bytes} [Sat Mar 5 21:13:18 2022] POST /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/os-volume_attachments => generated 188 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 21:13:19.185056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e9f51d6c-0fd9-489d-aacb-a86ccab332f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:19.186411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e9f51d6c-0fd9-489d-aacb-a86ccab332f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:19.196564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e9f51d6c-0fd9-489d-aacb-a86ccab332f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:19.197685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e9f51d6c-0fd9-489d-aacb-a86ccab332f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:19.198963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e9f51d6c-0fd9-489d-aacb-a86ccab332f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:19.199659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e9f51d6c-0fd9-489d-aacb-a86ccab332f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:19.362129 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e9f51d6c-0fd9-489d-aacb-a86ccab332f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "POST /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/action" status: 202 len: 0 microversion: 2.20 time: 0.184579 Mar 05 21:13:19.366150 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2479/4943] 10.222.0.15 () {62 vars in 1318 bytes} [Sat Mar 5 21:13:19 2022] POST /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:13:19.373145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-675e8689-6f4c-4a51-ab3f-5ad31a5c24f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:19.374764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-675e8689-6f4c-4a51-ab3f-5ad31a5c24f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:19.383051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-675e8689-6f4c-4a51-ab3f-5ad31a5c24f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:19.384711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-675e8689-6f4c-4a51-ab3f-5ad31a5c24f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:19.385959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-675e8689-6f4c-4a51-ab3f-5ad31a5c24f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:19.386764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-675e8689-6f4c-4a51-ab3f-5ad31a5c24f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:19.462466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b1e7ac5e-c75c-40bc-8533-ebd46a297b03 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:19.463215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b1e7ac5e-c75c-40bc-8533-ebd46a297b03 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:19.473997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1e7ac5e-c75c-40bc-8533-ebd46a297b03 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:19.476494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1e7ac5e-c75c-40bc-8533-ebd46a297b03 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:19.480010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1e7ac5e-c75c-40bc-8533-ebd46a297b03 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:19.481719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1e7ac5e-c75c-40bc-8533-ebd46a297b03 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:19.851724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-675e8689-6f4c-4a51-ab3f-5ad31a5c24f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:19.870584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-675e8689-6f4c-4a51-ab3f-5ad31a5c24f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:19.876768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b1e7ac5e-c75c-40bc-8533-ebd46a297b03 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:19.885527 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b1e7ac5e-c75c-40bc-8533-ebd46a297b03 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1313 microversion: 2.1 time: 0.431829 Mar 05 21:13:19.895344 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2480/4944] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:19 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:19.895344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-630fc646-201f-4a71-8556-40bc6fe45900 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:19.895851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-675e8689-6f4c-4a51-ab3f-5ad31a5c24f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:19.895851 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-675e8689-6f4c-4a51-ab3f-5ad31a5c24f3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1750 microversion: 2.20 time: 0.527058 Mar 05 21:13:19.896037 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2465/4945] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:19 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1750 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:19.899294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-630fc646-201f-4a71-8556-40bc6fe45900 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:19.923354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-630fc646-201f-4a71-8556-40bc6fe45900 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:19.923857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-630fc646-201f-4a71-8556-40bc6fe45900 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:19.924876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-630fc646-201f-4a71-8556-40bc6fe45900 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:19.925420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-630fc646-201f-4a71-8556-40bc6fe45900 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:20.040974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-630fc646-201f-4a71-8556-40bc6fe45900 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:20.061481 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-630fc646-201f-4a71-8556-40bc6fe45900 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 200 len: 1613 microversion: 2.1 time: 0.174185 Mar 05 21:13:20.063292 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2481/4946] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:19 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 1613 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:20.151776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-37d26bbe-d26f-472a-8273-640850a92fd7 req-b01d3f52-c73d-467d-9951-0e7587a5f53a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0612a448-c43d-402f-892e-e1f1ec0575c6", "name": "network-vif-deleted", "tag": "0ad03e45-ef52-4008-85cc-7d447f1a7efe"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:20.176513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-37d26bbe-d26f-472a-8273-640850a92fd7 req-b01d3f52-c73d-467d-9951-0e7587a5f53a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:20.178252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-37d26bbe-d26f-472a-8273-640850a92fd7 req-b01d3f52-c73d-467d-9951-0e7587a5f53a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:20.205559 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-37d26bbe-d26f-472a-8273-640850a92fd7 req-b01d3f52-c73d-467d-9951-0e7587a5f53a service nova] Creating event network-vif-deleted:0ad03e45-ef52-4008-85cc-7d447f1a7efe for instance 0612a448-c43d-402f-892e-e1f1ec0575c6 on nch1-master-1 Mar 05 21:13:20.214076 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-37d26bbe-d26f-472a-8273-640850a92fd7 req-b01d3f52-c73d-467d-9951-0e7587a5f53a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066564 Mar 05 21:13:20.219007 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2466/4947] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:20.904908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0e0be2ab-dd4c-4ee5-9115-149af7008c8f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:20.907306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0e0be2ab-dd4c-4ee5-9115-149af7008c8f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:20.918407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c367c5ed-3862-4b63-b2c3-86ca8c2d37cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:20.925542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c367c5ed-3862-4b63-b2c3-86ca8c2d37cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:20.944663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c367c5ed-3862-4b63-b2c3-86ca8c2d37cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:20.946164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e0be2ab-dd4c-4ee5-9115-149af7008c8f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:20.950291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e0be2ab-dd4c-4ee5-9115-149af7008c8f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:20.950674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c367c5ed-3862-4b63-b2c3-86ca8c2d37cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:20.952693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c367c5ed-3862-4b63-b2c3-86ca8c2d37cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:20.954855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e0be2ab-dd4c-4ee5-9115-149af7008c8f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:20.955656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c367c5ed-3862-4b63-b2c3-86ca8c2d37cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:20.960127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e0be2ab-dd4c-4ee5-9115-149af7008c8f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:21.223482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0e0be2ab-dd4c-4ee5-9115-149af7008c8f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:21.233104 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0e0be2ab-dd4c-4ee5-9115-149af7008c8f tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1498 microversion: 2.1 time: 0.333201 Mar 05 21:13:21.234222 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2482/4948] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:20 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1498 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:21.251295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9afa6005-4d25-424f-8dc2-bf5a69c7cb6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:21.252048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9afa6005-4d25-424f-8dc2-bf5a69c7cb6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:21.259060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9afa6005-4d25-424f-8dc2-bf5a69c7cb6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:21.259557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9afa6005-4d25-424f-8dc2-bf5a69c7cb6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:21.260387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9afa6005-4d25-424f-8dc2-bf5a69c7cb6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:21.260829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9afa6005-4d25-424f-8dc2-bf5a69c7cb6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:21.277730 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-9afa6005-4d25-424f-8dc2-bf5a69c7cb6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Instance 0612a448-c43d-402f-892e-e1f1ec0575c6 could not be found. Mar 05 21:13:21.278349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9afa6005-4d25-424f-8dc2-bf5a69c7cb6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 404 to user: Instance 0612a448-c43d-402f-892e-e1f1ec0575c6 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:13:21.279200 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9afa6005-4d25-424f-8dc2-bf5a69c7cb6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 404 len: 111 microversion: 2.1 time: 0.043643 Mar 05 21:13:21.280359 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2483/4949] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:21 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:13:21.291687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-408fc30c-a5e1-4082-a20b-8db0f3a0a130 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '.version_select at 0x7fed61affd30>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:21.315887 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-408fc30c-a5e1-4082-a20b-8db0f3a0a130 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-985483286" status: 202 len: 0 microversion: 2.1 time: 0.031070 Mar 05 21:13:21.317946 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2484/4950] 10.222.0.15 () {58 vars in 1217 bytes} [Sat Mar 5 21:13:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-985483286 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:13:21.599854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c367c5ed-3862-4b63-b2c3-86ca8c2d37cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:21.613996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c367c5ed-3862-4b63-b2c3-86ca8c2d37cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:21.619799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c367c5ed-3862-4b63-b2c3-86ca8c2d37cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:21.621551 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c367c5ed-3862-4b63-b2c3-86ca8c2d37cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1750 microversion: 2.20 time: 0.710693 Mar 05 21:13:21.622277 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2467/4951] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:20 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1750 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:13:21.957620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-911bad93-669e-4d21-a5e4-9d4c5bf4b47b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:21.958162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-911bad93-669e-4d21-a5e4-9d4c5bf4b47b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:21.965956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-911bad93-669e-4d21-a5e4-9d4c5bf4b47b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:21.966426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-911bad93-669e-4d21-a5e4-9d4c5bf4b47b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:21.967372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-911bad93-669e-4d21-a5e4-9d4c5bf4b47b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:21.976248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-911bad93-669e-4d21-a5e4-9d4c5bf4b47b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:22.033603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-911bad93-669e-4d21-a5e4-9d4c5bf4b47b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:13:22.199773 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-911bad93-669e-4d21-a5e4-9d4c5bf4b47b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "DELETE /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 204 len: 0 microversion: 2.1 time: 0.245868 Mar 05 21:13:22.204544 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2485/4952] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:13:21 2022] DELETE /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:13:22.214839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f22d8a08-3833-4dd5-ba13-692bb30d66a3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:22.215785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f22d8a08-3833-4dd5-ba13-692bb30d66a3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:22.249165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f22d8a08-3833-4dd5-ba13-692bb30d66a3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:22.249715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f22d8a08-3833-4dd5-ba13-692bb30d66a3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:22.256221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f22d8a08-3833-4dd5-ba13-692bb30d66a3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:22.257979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f22d8a08-3833-4dd5-ba13-692bb30d66a3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:22.640793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bea6d90f-c66b-4553-8ee7-37437e28798d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:22.641495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bea6d90f-c66b-4553-8ee7-37437e28798d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:22.644517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f22d8a08-3833-4dd5-ba13-692bb30d66a3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:22.650899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bea6d90f-c66b-4553-8ee7-37437e28798d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:22.654610 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f22d8a08-3833-4dd5-ba13-692bb30d66a3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1504 microversion: 2.1 time: 0.447915 Mar 05 21:13:22.655426 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2468/4953] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:22 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:22.659873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bea6d90f-c66b-4553-8ee7-37437e28798d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:22.660953 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bea6d90f-c66b-4553-8ee7-37437e28798d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:22.661590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bea6d90f-c66b-4553-8ee7-37437e28798d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:23.198255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bea6d90f-c66b-4553-8ee7-37437e28798d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:23.212922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bea6d90f-c66b-4553-8ee7-37437e28798d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:23.221277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bea6d90f-c66b-4553-8ee7-37437e28798d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:23.224055 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bea6d90f-c66b-4553-8ee7-37437e28798d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1752 microversion: 2.20 time: 0.587903 Mar 05 21:13:23.238346 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2486/4954] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:22 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1752 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:23.434293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2b8adbd6-e22a-49cf-847b-2eb31aa68bea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:23.435993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2b8adbd6-e22a-49cf-847b-2eb31aa68bea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:23.446480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b8adbd6-e22a-49cf-847b-2eb31aa68bea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:23.447788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b8adbd6-e22a-49cf-847b-2eb31aa68bea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:23.449044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b8adbd6-e22a-49cf-847b-2eb31aa68bea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:23.449704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b8adbd6-e22a-49cf-847b-2eb31aa68bea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:23.603626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-2b8adbd6-e22a-49cf-847b-2eb31aa68bea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lazy-loading 'services' on Instance uuid 024b8477-8c82-4b91-879f-48b125f19e40 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:13:23.673415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-45f2a93e-968a-4463-9faa-cc22a1934522 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:23.674192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-45f2a93e-968a-4463-9faa-cc22a1934522 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:23.683044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45f2a93e-968a-4463-9faa-cc22a1934522 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:23.694176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45f2a93e-968a-4463-9faa-cc22a1934522 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:23.695197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45f2a93e-968a-4463-9faa-cc22a1934522 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:23.696368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45f2a93e-968a-4463-9faa-cc22a1934522 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:23.771990 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2b8adbd6-e22a-49cf-847b-2eb31aa68bea tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40/os-volume_attachments/0a4054d8-18e9-4856-b7b4-20817b2ed9e5" status: 202 len: 0 microversion: 2.1 time: 0.342714 Mar 05 21:13:23.783846 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2469/4955] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 21:13:23 2022] DELETE /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40/os-volume_attachments/0a4054d8-18e9-4856-b7b4-20817b2ed9e5 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:13:23.802916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-22533763-535b-4ef2-a8ee-df6400adbe53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:23.806415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-22533763-535b-4ef2-a8ee-df6400adbe53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:23.822512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22533763-535b-4ef2-a8ee-df6400adbe53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:23.831549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22533763-535b-4ef2-a8ee-df6400adbe53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:23.834428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22533763-535b-4ef2-a8ee-df6400adbe53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:23.837652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22533763-535b-4ef2-a8ee-df6400adbe53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:23.913051 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-22533763-535b-4ef2-a8ee-df6400adbe53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127396 Mar 05 21:13:23.917239 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2470/4956] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:13:23 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:24.130626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-45f2a93e-968a-4463-9faa-cc22a1934522 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:24.146882 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-45f2a93e-968a-4463-9faa-cc22a1934522 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1504 microversion: 2.1 time: 0.477763 Mar 05 21:13:24.148277 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2487/4957] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:23 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1504 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:24.245481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f79be065-7101-4357-bffb-ff20d6b82830 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:24.246984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f79be065-7101-4357-bffb-ff20d6b82830 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:24.278761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f79be065-7101-4357-bffb-ff20d6b82830 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:24.279639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f79be065-7101-4357-bffb-ff20d6b82830 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:24.282135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f79be065-7101-4357-bffb-ff20d6b82830 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:24.284187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f79be065-7101-4357-bffb-ff20d6b82830 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:24.931595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a7cc0408-7a4c-4611-94af-042c735190ce tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:24.933029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a7cc0408-7a4c-4611-94af-042c735190ce tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:24.952576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7cc0408-7a4c-4611-94af-042c735190ce tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:24.953448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7cc0408-7a4c-4611-94af-042c735190ce tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:24.954636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7cc0408-7a4c-4611-94af-042c735190ce tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:24.956837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7cc0408-7a4c-4611-94af-042c735190ce tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:25.008049 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a7cc0408-7a4c-4611-94af-042c735190ce tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082453 Mar 05 21:13:25.009609 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2488/4958] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:13:24 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 05 21:13:25.091857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-381ab054-5d03-45d0-b018-5d5b8f6d3d9e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:25.092737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-381ab054-5d03-45d0-b018-5d5b8f6d3d9e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:25.111571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f79be065-7101-4357-bffb-ff20d6b82830 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:25.118045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-381ab054-5d03-45d0-b018-5d5b8f6d3d9e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:25.118792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-381ab054-5d03-45d0-b018-5d5b8f6d3d9e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:25.119608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-381ab054-5d03-45d0-b018-5d5b8f6d3d9e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:25.120083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-381ab054-5d03-45d0-b018-5d5b8f6d3d9e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:25.129237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f79be065-7101-4357-bffb-ff20d6b82830 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:25.133729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f79be065-7101-4357-bffb-ff20d6b82830 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:25.153495 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f79be065-7101-4357-bffb-ff20d6b82830 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 0.912628 Mar 05 21:13:25.173583 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2471/4959] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:24 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:25.186345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3a6505e7-c9e1-4ac8-84e0-e5215030062c tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:25.187174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3a6505e7-c9e1-4ac8-84e0-e5215030062c tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:25.202396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a6505e7-c9e1-4ac8-84e0-e5215030062c tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:25.206869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a6505e7-c9e1-4ac8-84e0-e5215030062c tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:25.208102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a6505e7-c9e1-4ac8-84e0-e5215030062c tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:25.210893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a6505e7-c9e1-4ac8-84e0-e5215030062c tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:25.230314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-381ab054-5d03-45d0-b018-5d5b8f6d3d9e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:13:25.402997 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-381ab054-5d03-45d0-b018-5d5b8f6d3d9e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 204 len: 0 microversion: 2.1 time: 0.316345 Mar 05 21:13:25.406680 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2489/4960] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:13:25 2022] DELETE /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:13:25.413847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9912cbbc-b5a2-4c1d-ba48-de138178c2a1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:25.415339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9912cbbc-b5a2-4c1d-ba48-de138178c2a1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:25.425236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9912cbbc-b5a2-4c1d-ba48-de138178c2a1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:25.425975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9912cbbc-b5a2-4c1d-ba48-de138178c2a1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:25.427090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9912cbbc-b5a2-4c1d-ba48-de138178c2a1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:25.428176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9912cbbc-b5a2-4c1d-ba48-de138178c2a1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:25.731759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9912cbbc-b5a2-4c1d-ba48-de138178c2a1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:25.741135 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9912cbbc-b5a2-4c1d-ba48-de138178c2a1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1680 microversion: 2.1 time: 0.332779 Mar 05 21:13:25.741961 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2490/4961] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:25 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1680 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:25.839200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3a6505e7-c9e1-4ac8-84e0-e5215030062c tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:25.847198 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3a6505e7-c9e1-4ac8-84e0-e5215030062c tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1504 microversion: 2.1 time: 0.671732 Mar 05 21:13:25.848285 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2472/4962] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:25 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1504 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:26.183315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a01420bf-6f14-4047-87d1-04e86ea36652 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:26.184697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a01420bf-6f14-4047-87d1-04e86ea36652 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:26.196467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a01420bf-6f14-4047-87d1-04e86ea36652 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:26.197517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a01420bf-6f14-4047-87d1-04e86ea36652 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:26.198860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a01420bf-6f14-4047-87d1-04e86ea36652 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:26.199448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a01420bf-6f14-4047-87d1-04e86ea36652 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:26.326509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a9a587a3-785c-480b-bb86-f154af0ff229 req-3a34a42c-0646-4a21-93b1-10023816a884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eade4ef9-e6d1-4f9c-82be-8616813b5aef", "name": "network-vif-deleted", "tag": "7760e862-823a-4806-9c12-ad39ee170581"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:26.356590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a9a587a3-785c-480b-bb86-f154af0ff229 req-3a34a42c-0646-4a21-93b1-10023816a884 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:26.357708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a9a587a3-785c-480b-bb86-f154af0ff229 req-3a34a42c-0646-4a21-93b1-10023816a884 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:26.380397 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a9a587a3-785c-480b-bb86-f154af0ff229 req-3a34a42c-0646-4a21-93b1-10023816a884 service nova] Creating event network-vif-deleted:7760e862-823a-4806-9c12-ad39ee170581 for instance eade4ef9-e6d1-4f9c-82be-8616813b5aef on nch2-master-1 Mar 05 21:13:26.388268 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a9a587a3-785c-480b-bb86-f154af0ff229 req-3a34a42c-0646-4a21-93b1-10023816a884 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069934 Mar 05 21:13:26.390211 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2473/4963] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:26.588978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a01420bf-6f14-4047-87d1-04e86ea36652 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:26.599171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a01420bf-6f14-4047-87d1-04e86ea36652 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:26.602038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a01420bf-6f14-4047-87d1-04e86ea36652 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:26.604234 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a01420bf-6f14-4047-87d1-04e86ea36652 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 0.428842 Mar 05 21:13:26.605384 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2491/4964] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:26 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:26.767897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6c48c63-60e5-41e4-9356-11e78a806d92 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:26.771012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6c48c63-60e5-41e4-9356-11e78a806d92 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:26.781735 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6c48c63-60e5-41e4-9356-11e78a806d92 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:26.782611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6c48c63-60e5-41e4-9356-11e78a806d92 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:26.793381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6c48c63-60e5-41e4-9356-11e78a806d92 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:26.794466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6c48c63-60e5-41e4-9356-11e78a806d92 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:26.875146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bce1e5dc-ab11-42d8-96e2-126e11f8aabe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:26.876136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bce1e5dc-ab11-42d8-96e2-126e11f8aabe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:26.898864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bce1e5dc-ab11-42d8-96e2-126e11f8aabe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:26.900017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bce1e5dc-ab11-42d8-96e2-126e11f8aabe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:26.901451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bce1e5dc-ab11-42d8-96e2-126e11f8aabe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:26.903810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bce1e5dc-ab11-42d8-96e2-126e11f8aabe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:26.970898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bce1e5dc-ab11-42d8-96e2-126e11f8aabe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:26.974350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bce1e5dc-ab11-42d8-96e2-126e11f8aabe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:26.975661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-bce1e5dc-ab11-42d8-96e2-126e11f8aabe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lazy-loading 'fault' on Instance uuid eade4ef9-e6d1-4f9c-82be-8616813b5aef {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:13:27.059285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bce1e5dc-ab11-42d8-96e2-126e11f8aabe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:27.073647 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bce1e5dc-ab11-42d8-96e2-126e11f8aabe tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 200 len: 1303 microversion: 2.1 time: 0.211108 Mar 05 21:13:27.087264 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2492/4965] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:26 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 1303 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:27.624665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-82a78824-f881-46ba-a8a0-cabfabc39db5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:27.638845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-82a78824-f881-46ba-a8a0-cabfabc39db5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:27.663999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82a78824-f881-46ba-a8a0-cabfabc39db5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:27.668391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82a78824-f881-46ba-a8a0-cabfabc39db5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:27.670100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82a78824-f881-46ba-a8a0-cabfabc39db5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:27.672524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82a78824-f881-46ba-a8a0-cabfabc39db5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:27.936412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6c48c63-60e5-41e4-9356-11e78a806d92 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:27.961951 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6c48c63-60e5-41e4-9356-11e78a806d92 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1680 microversion: 2.1 time: 1.203123 Mar 05 21:13:27.987208 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2474/4966] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:26 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1680 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:28.099848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-11849cbd-1dc8-4c85-b25c-0f1eee0857ae tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:28.100950 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-11849cbd-1dc8-4c85-b25c-0f1eee0857ae tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: eade4ef9-e6d1-4f9c-82be-8616813b5aef] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:28.141256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11849cbd-1dc8-4c85-b25c-0f1eee0857ae tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:28.143828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11849cbd-1dc8-4c85-b25c-0f1eee0857ae tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:28.157114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11849cbd-1dc8-4c85-b25c-0f1eee0857ae tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:28.157920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11849cbd-1dc8-4c85-b25c-0f1eee0857ae tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:28.276295 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-11849cbd-1dc8-4c85-b25c-0f1eee0857ae tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] HTTP exception thrown: Instance eade4ef9-e6d1-4f9c-82be-8616813b5aef could not be found. Mar 05 21:13:28.307064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-11849cbd-1dc8-4c85-b25c-0f1eee0857ae tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Returning 404 to user: Instance eade4ef9-e6d1-4f9c-82be-8616813b5aef could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:13:28.316323 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-11849cbd-1dc8-4c85-b25c-0f1eee0857ae tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef" status: 404 len: 111 microversion: 2.1 time: 0.225297 Mar 05 21:13:28.321295 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2475/4967] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:28 2022] GET /compute/v2.1/servers/eade4ef9-e6d1-4f9c-82be-8616813b5aef => generated 111 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:13:28.382712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-82a78824-f881-46ba-a8a0-cabfabc39db5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:28.420350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-82a78824-f881-46ba-a8a0-cabfabc39db5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:28.428934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-82a78824-f881-46ba-a8a0-cabfabc39db5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:28.433217 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-82a78824-f881-46ba-a8a0-cabfabc39db5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 0.813570 Mar 05 21:13:28.434933 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2493/4968] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:27 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:13:28.645489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2033126243", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "7b01390b-af80-47c7-b861-6f85f06d7866"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:28.819353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] validate_networks() for [('7b01390b-af80-47c7-b861-6f85f06d7866', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:13:29.004703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1cf5330a-d43c-4b0e-bfc7-6b9da16a8ad0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:29.006986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1cf5330a-d43c-4b0e-bfc7-6b9da16a8ad0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:29.043509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cf5330a-d43c-4b0e-bfc7-6b9da16a8ad0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:29.044779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cf5330a-d43c-4b0e-bfc7-6b9da16a8ad0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:29.046453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cf5330a-d43c-4b0e-bfc7-6b9da16a8ad0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:29.048455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cf5330a-d43c-4b0e-bfc7-6b9da16a8ad0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:29.335373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1cf5330a-d43c-4b0e-bfc7-6b9da16a8ad0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:29.344426 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1cf5330a-d43c-4b0e-bfc7-6b9da16a8ad0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1680 microversion: 2.1 time: 0.347033 Mar 05 21:13:29.345891 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2494/4969] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:28 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1680 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:29.456815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-83e1b1f4-126b-49bd-bb44-f2326822d4ba tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:29.457823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-83e1b1f4-126b-49bd-bb44-f2326822d4ba tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:29.468638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83e1b1f4-126b-49bd-bb44-f2326822d4ba tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:29.472425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83e1b1f4-126b-49bd-bb44-f2326822d4ba tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:29.473441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83e1b1f4-126b-49bd-bb44-f2326822d4ba tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:29.477770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83e1b1f4-126b-49bd-bb44-f2326822d4ba tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:29.792052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-83e1b1f4-126b-49bd-bb44-f2326822d4ba tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:29.804194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-83e1b1f4-126b-49bd-bb44-f2326822d4ba tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:29.811931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-83e1b1f4-126b-49bd-bb44-f2326822d4ba tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:29.813717 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-83e1b1f4-126b-49bd-bb44-f2326822d4ba tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 0.361395 Mar 05 21:13:29.814830 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2495/4970] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:29 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:30.364124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-245ede1c-ce55-49e1-a038-d767003d28a0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:30.366371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-245ede1c-ce55-49e1-a038-d767003d28a0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:30.381222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-245ede1c-ce55-49e1-a038-d767003d28a0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:30.381616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-245ede1c-ce55-49e1-a038-d767003d28a0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:30.382404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-245ede1c-ce55-49e1-a038-d767003d28a0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:30.388055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-245ede1c-ce55-49e1-a038-d767003d28a0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:30.730828 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-245ede1c-ce55-49e1-a038-d767003d28a0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:30.762867 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-245ede1c-ce55-49e1-a038-d767003d28a0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1680 microversion: 2.1 time: 0.402955 Mar 05 21:13:30.765731 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2496/4971] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:30 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1680 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:30.837528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b817f3a1-7b7f-4dce-ba96-100d8c4dd8da tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:30.838359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b817f3a1-7b7f-4dce-ba96-100d8c4dd8da tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:30.862790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b817f3a1-7b7f-4dce-ba96-100d8c4dd8da tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:30.863426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b817f3a1-7b7f-4dce-ba96-100d8c4dd8da tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:30.871419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b817f3a1-7b7f-4dce-ba96-100d8c4dd8da tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:30.875336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b817f3a1-7b7f-4dce-ba96-100d8c4dd8da tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:31.378784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b817f3a1-7b7f-4dce-ba96-100d8c4dd8da tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:31.391971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b817f3a1-7b7f-4dce-ba96-100d8c4dd8da tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:31.393776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b817f3a1-7b7f-4dce-ba96-100d8c4dd8da tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:31.395288 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b817f3a1-7b7f-4dce-ba96-100d8c4dd8da tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 0.566376 Mar 05 21:13:31.407728 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2497/4972] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:30 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:31.480715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:13:31.481756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:13:31.487856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:13:31.493887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:13:31.494604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:13:31.548676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:31.553849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:31.553849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:31.553849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:31.648178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Getting quotas for project 7a6813d01c694475a2a3645008b1c369. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:13:31.669124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Getting quotas for user 9a5fca5fc43f4bd5971397ba20da0bbd and project 7a6813d01c694475a2a3645008b1c369. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:13:31.719771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:13:31.728408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:13:31.746723 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:13:31.746968 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 21:13:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Mar 05 21:13:31.782895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-28896694-12aa-4d2b-8e52-f8d3740cab94 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:31.783530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-28896694-12aa-4d2b-8e52-f8d3740cab94 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:31.793981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28896694-12aa-4d2b-8e52-f8d3740cab94 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:31.794277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28896694-12aa-4d2b-8e52-f8d3740cab94 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:31.802882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28896694-12aa-4d2b-8e52-f8d3740cab94 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:31.803559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28896694-12aa-4d2b-8e52-f8d3740cab94 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:31.848909 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a1e724fc-c819-494f-8a68-04863cf37ef3 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.209198 Mar 05 21:13:31.855258 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2476/4973] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:13:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:13:31.874743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2ea463e5-fd38-4be9-bcb6-f1972c770f3e tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:31.875816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2ea463e5-fd38-4be9-bcb6-f1972c770f3e tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:32.041545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2ea463e5-fd38-4be9-bcb6-f1972c770f3e tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:32.052793 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2ea463e5-fd38-4be9-bcb6-f1972c770f3e tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1214 microversion: 2.1 time: 0.195038 Mar 05 21:13:32.053364 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2477/4974] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:31 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1214 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:32.416253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-707d4b6f-723d-4504-8d8a-527dd213593b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:32.416904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-707d4b6f-723d-4504-8d8a-527dd213593b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:32.430254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-707d4b6f-723d-4504-8d8a-527dd213593b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:32.432863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-707d4b6f-723d-4504-8d8a-527dd213593b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:32.434021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-707d4b6f-723d-4504-8d8a-527dd213593b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:32.436884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-707d4b6f-723d-4504-8d8a-527dd213593b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:32.443569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-28896694-12aa-4d2b-8e52-f8d3740cab94 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:32.468679 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-28896694-12aa-4d2b-8e52-f8d3740cab94 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1612 microversion: 2.1 time: 0.689907 Mar 05 21:13:32.473509 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2498/4975] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:31 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1612 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:32.816631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-fee82ac5-c691-4e05-bc89-1fa7f97496f0 req-ea32c93b-4547-4d4a-b132-72b553ce6836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "024b8477-8c82-4b91-879f-48b125f19e40", "name": "network-vif-deleted", "tag": "dfe1078a-9630-493b-9b69-39e6676f5878"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:32.842957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fee82ac5-c691-4e05-bc89-1fa7f97496f0 req-ea32c93b-4547-4d4a-b132-72b553ce6836 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:32.851306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fee82ac5-c691-4e05-bc89-1fa7f97496f0 req-ea32c93b-4547-4d4a-b132-72b553ce6836 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:32.931649 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-fee82ac5-c691-4e05-bc89-1fa7f97496f0 req-ea32c93b-4547-4d4a-b132-72b553ce6836 service nova] Creating event network-vif-deleted:dfe1078a-9630-493b-9b69-39e6676f5878 for instance 024b8477-8c82-4b91-879f-48b125f19e40 on nch1-master-1 Mar 05 21:13:32.950900 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-fee82ac5-c691-4e05-bc89-1fa7f97496f0 req-ea32c93b-4547-4d4a-b132-72b553ce6836 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138023 Mar 05 21:13:32.972433 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2499/4976] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:33.073266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-44f4abca-b6a0-4e33-824e-07a2913612c9 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:33.074003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-44f4abca-b6a0-4e33-824e-07a2913612c9 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:33.099101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44f4abca-b6a0-4e33-824e-07a2913612c9 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:33.104341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44f4abca-b6a0-4e33-824e-07a2913612c9 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:33.106378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44f4abca-b6a0-4e33-824e-07a2913612c9 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:33.107530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-44f4abca-b6a0-4e33-824e-07a2913612c9 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:33.368324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-44f4abca-b6a0-4e33-824e-07a2913612c9 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:33.395532 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-44f4abca-b6a0-4e33-824e-07a2913612c9 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1210 microversion: 2.1 time: 0.328042 Mar 05 21:13:33.408073 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2500/4977] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:33 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1210 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:33.494687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-17271820-e07f-4ef7-92dc-21cfe16b0060 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:33.496303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-17271820-e07f-4ef7-92dc-21cfe16b0060 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:33.502749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-707d4b6f-723d-4504-8d8a-527dd213593b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:33.528062 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-707d4b6f-723d-4504-8d8a-527dd213593b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:33.532769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-707d4b6f-723d-4504-8d8a-527dd213593b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:33.536270 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-707d4b6f-723d-4504-8d8a-527dd213593b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 1.125649 Mar 05 21:13:33.536901 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2478/4978] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:32 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:13:33.540289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17271820-e07f-4ef7-92dc-21cfe16b0060 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:33.545752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17271820-e07f-4ef7-92dc-21cfe16b0060 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:33.548506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17271820-e07f-4ef7-92dc-21cfe16b0060 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:33.556031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17271820-e07f-4ef7-92dc-21cfe16b0060 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:33.704459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17271820-e07f-4ef7-92dc-21cfe16b0060 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:33.704919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17271820-e07f-4ef7-92dc-21cfe16b0060 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:33.705392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-17271820-e07f-4ef7-92dc-21cfe16b0060 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lazy-loading 'fault' on Instance uuid 024b8477-8c82-4b91-879f-48b125f19e40 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:13:33.811281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-17271820-e07f-4ef7-92dc-21cfe16b0060 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:33.829031 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-17271820-e07f-4ef7-92dc-21cfe16b0060 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 200 len: 1329 microversion: 2.1 time: 0.341109 Mar 05 21:13:33.844235 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2501/4979] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:33 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 1329 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:34.417142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c8ce3068-4835-4382-9a12-c991314dd206 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:34.418137 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c8ce3068-4835-4382-9a12-c991314dd206 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:34.442797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8ce3068-4835-4382-9a12-c991314dd206 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:34.447353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8ce3068-4835-4382-9a12-c991314dd206 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:34.451146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8ce3068-4835-4382-9a12-c991314dd206 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:34.455071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8ce3068-4835-4382-9a12-c991314dd206 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:34.555089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3785d7c7-b421-4054-9e0c-6813d1716ad8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:34.555796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3785d7c7-b421-4054-9e0c-6813d1716ad8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:34.565965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3785d7c7-b421-4054-9e0c-6813d1716ad8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:34.566424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3785d7c7-b421-4054-9e0c-6813d1716ad8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:34.567318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3785d7c7-b421-4054-9e0c-6813d1716ad8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:34.567648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3785d7c7-b421-4054-9e0c-6813d1716ad8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:34.843491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c8ce3068-4835-4382-9a12-c991314dd206 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:34.869744 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c8ce3068-4835-4382-9a12-c991314dd206 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1272 microversion: 2.1 time: 0.458597 Mar 05 21:13:34.886474 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2479/4980] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:34 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1272 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:34.908903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-75a2d661-3c65-46e2-8dca-aecbbd6edacc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:34.909602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-75a2d661-3c65-46e2-8dca-aecbbd6edacc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:34.958628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75a2d661-3c65-46e2-8dca-aecbbd6edacc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:34.959607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75a2d661-3c65-46e2-8dca-aecbbd6edacc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:34.962334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75a2d661-3c65-46e2-8dca-aecbbd6edacc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:34.962848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75a2d661-3c65-46e2-8dca-aecbbd6edacc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:35.022008 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-75a2d661-3c65-46e2-8dca-aecbbd6edacc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Instance 024b8477-8c82-4b91-879f-48b125f19e40 could not be found. Mar 05 21:13:35.027952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-75a2d661-3c65-46e2-8dca-aecbbd6edacc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 404 to user: Instance 024b8477-8c82-4b91-879f-48b125f19e40 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:13:35.032865 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-75a2d661-3c65-46e2-8dca-aecbbd6edacc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 404 len: 111 microversion: 2.1 time: 0.142707 Mar 05 21:13:35.035655 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2480/4981] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:34 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:13:35.072182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1e894529-e06c-4f56-a251-ff95046498c9 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '.version_select at 0x7fed5c903af0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:35.131258 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1e894529-e06c-4f56-a251-ff95046498c9 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889518175" status: 202 len: 0 microversion: 2.1 time: 0.088336 Mar 05 21:13:35.136327 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2481/4982] 10.222.0.15 () {58 vars in 1220 bytes} [Sat Mar 5 21:13:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889518175 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:13:35.204010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3785d7c7-b421-4054-9e0c-6813d1716ad8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:35.257408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3785d7c7-b421-4054-9e0c-6813d1716ad8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:35.259858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3785d7c7-b421-4054-9e0c-6813d1716ad8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:35.268649 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3785d7c7-b421-4054-9e0c-6813d1716ad8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 0.717978 Mar 05 21:13:35.278833 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2502/4983] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:34 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:35.906532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-08b15e98-ca69-4ddb-80ef-a6f416f3da4e tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:35.907888 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-08b15e98-ca69-4ddb-80ef-a6f416f3da4e tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:35.939887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08b15e98-ca69-4ddb-80ef-a6f416f3da4e tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:35.941348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08b15e98-ca69-4ddb-80ef-a6f416f3da4e tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:35.947422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08b15e98-ca69-4ddb-80ef-a6f416f3da4e tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:35.950479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08b15e98-ca69-4ddb-80ef-a6f416f3da4e tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:36.295132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5657a669-f11b-410f-b240-9a17270c2fe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:36.295791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5657a669-f11b-410f-b240-9a17270c2fe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:36.317553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5657a669-f11b-410f-b240-9a17270c2fe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:36.320799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5657a669-f11b-410f-b240-9a17270c2fe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:36.321782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5657a669-f11b-410f-b240-9a17270c2fe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:36.322221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5657a669-f11b-410f-b240-9a17270c2fe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:36.679103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-08b15e98-ca69-4ddb-80ef-a6f416f3da4e tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:36.705677 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-08b15e98-ca69-4ddb-80ef-a6f416f3da4e tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1272 microversion: 2.1 time: 0.804211 Mar 05 21:13:36.707438 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2482/4984] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:35 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1272 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:37.464879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5657a669-f11b-410f-b240-9a17270c2fe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:37.499152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5657a669-f11b-410f-b240-9a17270c2fe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:37.500577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5657a669-f11b-410f-b240-9a17270c2fe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:37.504556 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5657a669-f11b-410f-b240-9a17270c2fe2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 1.212187 Mar 05 21:13:37.507025 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2503/4985] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:36 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:13:37.724058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fe8408f8-f0c2-480c-a58f-d0a271ec0f9b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:37.724586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fe8408f8-f0c2-480c-a58f-d0a271ec0f9b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:37.736984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe8408f8-f0c2-480c-a58f-d0a271ec0f9b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:37.737371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe8408f8-f0c2-480c-a58f-d0a271ec0f9b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:37.738170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe8408f8-f0c2-480c-a58f-d0a271ec0f9b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:37.738618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe8408f8-f0c2-480c-a58f-d0a271ec0f9b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:38.053417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fe8408f8-f0c2-480c-a58f-d0a271ec0f9b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:38.090039 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fe8408f8-f0c2-480c-a58f-d0a271ec0f9b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1272 microversion: 2.1 time: 0.367939 Mar 05 21:13:38.097917 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2483/4986] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:37 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1272 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:38.380168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ace19a4f-a2c0-4fd8-ba64-4be7dd6c6160 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Action: 'create', calling method: .version_select at 0x7fed61ada940>, body: {"keypair": {"name": "tempest-keypair-2132487854"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:38.413067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-ace19a4f-a2c0-4fd8-ba64-4be7dd6c6160 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:13:38.434441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-ace19a4f-a2c0-4fd8-ba64-4be7dd6c6160 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for user 8bee90d7a5af4246b85ff0cb89217700 and project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:13:38.526921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1c5c4049-5010-420d-a7c7-3f0ddcb081fd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:38.527538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1c5c4049-5010-420d-a7c7-3f0ddcb081fd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:38.541166 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c5c4049-5010-420d-a7c7-3f0ddcb081fd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:38.545361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c5c4049-5010-420d-a7c7-3f0ddcb081fd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:38.546457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c5c4049-5010-420d-a7c7-3f0ddcb081fd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:38.565058 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1c5c4049-5010-420d-a7c7-3f0ddcb081fd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:39.072849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-ace19a4f-a2c0-4fd8-ba64-4be7dd6c6160 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:13:39.096512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-ace19a4f-a2c0-4fd8-ba64-4be7dd6c6160 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for user 8bee90d7a5af4246b85ff0cb89217700 and project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:13:39.143816 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ace19a4f-a2c0-4fd8-ba64-4be7dd6c6160 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.767040 Mar 05 21:13:39.153104 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2504/4987] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:13:38 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:39.160190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-597d70d9-63c3-4251-9b66-d95355ac10df tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:39.161066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-597d70d9-63c3-4251-9b66-d95355ac10df tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:39.168986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-597d70d9-63c3-4251-9b66-d95355ac10df tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:39.169678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-597d70d9-63c3-4251-9b66-d95355ac10df tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:39.170633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-597d70d9-63c3-4251-9b66-d95355ac10df tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:39.171221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-597d70d9-63c3-4251-9b66-d95355ac10df tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:39.562001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-597d70d9-63c3-4251-9b66-d95355ac10df tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:39.580718 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-597d70d9-63c3-4251-9b66-d95355ac10df tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1314 microversion: 2.1 time: 0.425822 Mar 05 21:13:39.601236 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2505/4988] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:39 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:40.162584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1c5c4049-5010-420d-a7c7-3f0ddcb081fd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:40.180008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1c5c4049-5010-420d-a7c7-3f0ddcb081fd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:40.182126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1c5c4049-5010-420d-a7c7-3f0ddcb081fd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:40.183496 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1c5c4049-5010-420d-a7c7-3f0ddcb081fd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 1.660903 Mar 05 21:13:40.186316 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2484/4989] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:38 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:40.598787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d7daf2c8-60f3-4493-9ae9-ad6b18c63776 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:40.604406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d7daf2c8-60f3-4493-9ae9-ad6b18c63776 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:40.643475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7daf2c8-60f3-4493-9ae9-ad6b18c63776 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:40.646973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7daf2c8-60f3-4493-9ae9-ad6b18c63776 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:40.648180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7daf2c8-60f3-4493-9ae9-ad6b18c63776 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:40.651024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7daf2c8-60f3-4493-9ae9-ad6b18c63776 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:41.206699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ccbce85c-288a-4986-babd-ddf8ef5a7d4e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:41.207331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ccbce85c-288a-4986-babd-ddf8ef5a7d4e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:41.233832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ccbce85c-288a-4986-babd-ddf8ef5a7d4e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:41.234289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ccbce85c-288a-4986-babd-ddf8ef5a7d4e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:41.235337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ccbce85c-288a-4986-babd-ddf8ef5a7d4e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:41.236085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ccbce85c-288a-4986-babd-ddf8ef5a7d4e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:41.444632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d7daf2c8-60f3-4493-9ae9-ad6b18c63776 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:41.461331 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d7daf2c8-60f3-4493-9ae9-ad6b18c63776 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1314 microversion: 2.1 time: 0.865902 Mar 05 21:13:41.466262 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2506/4990] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:40 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:41.962104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ccbce85c-288a-4986-babd-ddf8ef5a7d4e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:41.976185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ccbce85c-288a-4986-babd-ddf8ef5a7d4e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:41.980262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ccbce85c-288a-4986-babd-ddf8ef5a7d4e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:41.981528 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ccbce85c-288a-4986-babd-ddf8ef5a7d4e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 0.780664 Mar 05 21:13:41.991926 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2485/4991] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:41 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:42.483028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9fceb96b-e8d7-49b7-a6d1-2880d86909bc tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:42.483648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9fceb96b-e8d7-49b7-a6d1-2880d86909bc tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:42.497673 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fceb96b-e8d7-49b7-a6d1-2880d86909bc tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:42.498237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fceb96b-e8d7-49b7-a6d1-2880d86909bc tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:42.499148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fceb96b-e8d7-49b7-a6d1-2880d86909bc tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:42.502069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fceb96b-e8d7-49b7-a6d1-2880d86909bc tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:42.513159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-3d838643-cd09-4cf1-b363-245689c000a1 req-6e2bc7e9-dfe3-47a9-ba8e-fd2f3d96e895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd96e93-68e0-4a43-a639-f7687e332e17", "tag": "01a57961-fbe3-4574-8e1d-4266a150ade8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:42.529534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3d838643-cd09-4cf1-b363-245689c000a1 req-6e2bc7e9-dfe3-47a9-ba8e-fd2f3d96e895 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:42.530373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3d838643-cd09-4cf1-b363-245689c000a1 req-6e2bc7e9-dfe3-47a9-ba8e-fd2f3d96e895 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:42.560115 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-3d838643-cd09-4cf1-b363-245689c000a1 req-6e2bc7e9-dfe3-47a9-ba8e-fd2f3d96e895 service nova] Creating event network-changed:01a57961-fbe3-4574-8e1d-4266a150ade8 for instance 6cd96e93-68e0-4a43-a639-f7687e332e17 on nch2-master-1 Mar 05 21:13:42.569122 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-3d838643-cd09-4cf1-b363-245689c000a1 req-6e2bc7e9-dfe3-47a9-ba8e-fd2f3d96e895 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059802 Mar 05 21:13:42.570790 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2486/4992] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:42.870308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9fceb96b-e8d7-49b7-a6d1-2880d86909bc tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:42.882473 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9fceb96b-e8d7-49b7-a6d1-2880d86909bc tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1314 microversion: 2.1 time: 0.402633 Mar 05 21:13:42.883549 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2507/4993] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:42 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:43.006725 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8417dce8-d3bd-4382-bb5a-b416817b5078 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:43.008580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8417dce8-d3bd-4382-bb5a-b416817b5078 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:43.017244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8417dce8-d3bd-4382-bb5a-b416817b5078 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:43.021266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8417dce8-d3bd-4382-bb5a-b416817b5078 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:43.022465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8417dce8-d3bd-4382-bb5a-b416817b5078 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:43.025284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8417dce8-d3bd-4382-bb5a-b416817b5078 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:43.900610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af43f00a-943b-47df-9834-8c06b9910a58 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:43.901044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8417dce8-d3bd-4382-bb5a-b416817b5078 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:43.901401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-af43f00a-943b-47df-9834-8c06b9910a58 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:43.908958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8417dce8-d3bd-4382-bb5a-b416817b5078 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:43.910477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8417dce8-d3bd-4382-bb5a-b416817b5078 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:43.913383 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8417dce8-d3bd-4382-bb5a-b416817b5078 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 0.915142 Mar 05 21:13:43.922285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af43f00a-943b-47df-9834-8c06b9910a58 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:43.924032 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2487/4994] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:42 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:43.924164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af43f00a-943b-47df-9834-8c06b9910a58 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:43.925004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af43f00a-943b-47df-9834-8c06b9910a58 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:43.930239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af43f00a-943b-47df-9834-8c06b9910a58 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:44.240533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-af43f00a-943b-47df-9834-8c06b9910a58 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:44.262926 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-af43f00a-943b-47df-9834-8c06b9910a58 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1314 microversion: 2.1 time: 0.361011 Mar 05 21:13:44.264630 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2508/4995] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:43 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:44.933155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-79dc527d-fc6d-4f08-b5f5-d896675b8d29 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:44.933775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-79dc527d-fc6d-4f08-b5f5-d896675b8d29 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:44.948094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79dc527d-fc6d-4f08-b5f5-d896675b8d29 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:44.948659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79dc527d-fc6d-4f08-b5f5-d896675b8d29 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:44.952947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79dc527d-fc6d-4f08-b5f5-d896675b8d29 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:44.953958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79dc527d-fc6d-4f08-b5f5-d896675b8d29 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:45.282466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-34bc3281-678f-4868-bc3c-5373266b7f6d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:45.284932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-34bc3281-678f-4868-bc3c-5373266b7f6d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:45.292504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34bc3281-678f-4868-bc3c-5373266b7f6d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:45.293289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34bc3281-678f-4868-bc3c-5373266b7f6d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:45.294601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34bc3281-678f-4868-bc3c-5373266b7f6d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:45.295292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34bc3281-678f-4868-bc3c-5373266b7f6d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:45.600709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-79dc527d-fc6d-4f08-b5f5-d896675b8d29 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:45.617891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-79dc527d-fc6d-4f08-b5f5-d896675b8d29 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:45.620208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-79dc527d-fc6d-4f08-b5f5-d896675b8d29 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:45.621916 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-79dc527d-fc6d-4f08-b5f5-d896675b8d29 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 0.692733 Mar 05 21:13:45.622742 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2488/4996] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:44 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:45.641354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f424e88e-415e-4e0c-bfcc-b3a8f8770ee5 req-1c14a0a8-f333-43d1-84eb-ae9d67eaa6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba05bcb0-9bc3-42c9-a011-c592459cce1e", "name": "network-vif-plugged", "status": "completed", "tag": "a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:45.651914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f424e88e-415e-4e0c-bfcc-b3a8f8770ee5 req-1c14a0a8-f333-43d1-84eb-ae9d67eaa6ee service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:45.652769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f424e88e-415e-4e0c-bfcc-b3a8f8770ee5 req-1c14a0a8-f333-43d1-84eb-ae9d67eaa6ee service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:45.675166 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f424e88e-415e-4e0c-bfcc-b3a8f8770ee5 req-1c14a0a8-f333-43d1-84eb-ae9d67eaa6ee service nova] Creating event network-vif-plugged:a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4 for instance ba05bcb0-9bc3-42c9-a011-c592459cce1e on nch1-master-1 Mar 05 21:13:45.688401 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f424e88e-415e-4e0c-bfcc-b3a8f8770ee5 req-1c14a0a8-f333-43d1-84eb-ae9d67eaa6ee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050533 Mar 05 21:13:45.690766 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2489/4997] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:45.938608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1517201039", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b56f14b9-afc0-424d-b080-c31779583b66"}], "security_groups": [{"name": "tempest-securitygroup--1332902829"}], "key_name": "tempest-keypair-2132487854", "user_data": "}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:46.202047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-34bc3281-678f-4868-bc3c-5373266b7f6d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:46.216549 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-34bc3281-678f-4868-bc3c-5373266b7f6d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1314 microversion: 2.1 time: 0.938639 Mar 05 21:13:46.217195 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2509/4998] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:45 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1314 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:46.373221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] validate_networks() for [('b56f14b9-afc0-424d-b080-c31779583b66', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:13:46.646976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5a676f86-e91c-4775-939c-709110d8ec2e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:46.648766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5a676f86-e91c-4775-939c-709110d8ec2e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:46.660145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a676f86-e91c-4775-939c-709110d8ec2e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:46.660616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a676f86-e91c-4775-939c-709110d8ec2e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:46.661728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a676f86-e91c-4775-939c-709110d8ec2e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:46.662388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a676f86-e91c-4775-939c-709110d8ec2e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:46.895858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5a676f86-e91c-4775-939c-709110d8ec2e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:46.911815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5a676f86-e91c-4775-939c-709110d8ec2e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:46.913517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5a676f86-e91c-4775-939c-709110d8ec2e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:46.916189 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5a676f86-e91c-4775-939c-709110d8ec2e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 0.276581 Mar 05 21:13:46.917011 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2510/4999] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:46 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:13:47.234236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-69ec2c1b-a096-4e4c-94c2-e5bd67b4ef3b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:47.234958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-69ec2c1b-a096-4e4c-94c2-e5bd67b4ef3b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:47.243111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69ec2c1b-a096-4e4c-94c2-e5bd67b4ef3b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:47.246392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69ec2c1b-a096-4e4c-94c2-e5bd67b4ef3b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:47.247813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69ec2c1b-a096-4e4c-94c2-e5bd67b4ef3b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:47.252150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69ec2c1b-a096-4e4c-94c2-e5bd67b4ef3b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:47.767200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-69ec2c1b-a096-4e4c-94c2-e5bd67b4ef3b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:47.782044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:13:47.782470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:13:47.782951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:13:47.783368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:13:47.783818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:13:47.794300 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-69ec2c1b-a096-4e4c-94c2-e5bd67b4ef3b tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1314 microversion: 2.1 time: 0.563555 Mar 05 21:13:47.795972 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2511/5000] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:47 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:47.802319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:47.802782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:47.803595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:47.804085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:47.855787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for project f73f6888043940b9b1344c6998b423da. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:13:47.879306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for user 8bee90d7a5af4246b85ff0cb89217700 and project f73f6888043940b9b1344c6998b423da. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:13:47.918911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:13:47.922351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:13:47.937204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a6d97b2e-37a7-4707-8955-664098d0d698 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:47.937840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a6d97b2e-37a7-4707-8955-664098d0d698 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:47.952326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6d97b2e-37a7-4707-8955-664098d0d698 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:47.952829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6d97b2e-37a7-4707-8955-664098d0d698 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:47.953662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6d97b2e-37a7-4707-8955-664098d0d698 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:47.954122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a6d97b2e-37a7-4707-8955-664098d0d698 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:48.016373 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-244ffde7-be1c-4fdd-a0af-e9d484fd8c6d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.083017 Mar 05 21:13:48.028100 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2490/5001] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:13:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 2100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:13:48.066758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b4a816d5-83de-49ca-9075-fd7067787517 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:48.074031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b4a816d5-83de-49ca-9075-fd7067787517 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:48.212723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b4a816d5-83de-49ca-9075-fd7067787517 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:48.224979 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b4a816d5-83de-49ca-9075-fd7067787517 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1242 microversion: 2.1 time: 0.194709 Mar 05 21:13:48.225590 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2491/5002] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:48 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1242 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:48.422944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-990623fc-3947-4597-9533-d5ecf60ad25f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Action: 'create', calling method: .version_select at 0x7fed5c6c0310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2067475600"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:48.514068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a6d97b2e-37a7-4707-8955-664098d0d698 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:48.522081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-990623fc-3947-4597-9533-d5ecf60ad25f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:13:48.534708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-990623fc-3947-4597-9533-d5ecf60ad25f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for user 76b63093654943e6ac89d2b22e4f756a and project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:13:48.540960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a6d97b2e-37a7-4707-8955-664098d0d698 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:48.542621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a6d97b2e-37a7-4707-8955-664098d0d698 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:48.543923 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a6d97b2e-37a7-4707-8955-664098d0d698 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1808 microversion: 2.20 time: 0.611968 Mar 05 21:13:48.544519 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2512/5003] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:47 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1808 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:48.808095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-990623fc-3947-4597-9533-d5ecf60ad25f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:13:48.812226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e10a2adb-7f78-4546-af96-d9fc4468ff75 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:48.812859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e10a2adb-7f78-4546-af96-d9fc4468ff75 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:48.816152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-990623fc-3947-4597-9533-d5ecf60ad25f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for user 76b63093654943e6ac89d2b22e4f756a and project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:13:48.825051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e10a2adb-7f78-4546-af96-d9fc4468ff75 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:48.828374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e10a2adb-7f78-4546-af96-d9fc4468ff75 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:48.829386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e10a2adb-7f78-4546-af96-d9fc4468ff75 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:48.829896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e10a2adb-7f78-4546-af96-d9fc4468ff75 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:48.841731 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-990623fc-3947-4597-9533-d5ecf60ad25f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.432248 Mar 05 21:13:48.843693 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2492/5004] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:13:48 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:49.145636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e10a2adb-7f78-4546-af96-d9fc4468ff75 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:49.163638 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e10a2adb-7f78-4546-af96-d9fc4468ff75 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1314 microversion: 2.1 time: 0.355308 Mar 05 21:13:49.164610 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2513/5005] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:48 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:49.253576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fa183775-99b3-4d7e-9177-531fd09e10e6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:49.254406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fa183775-99b3-4d7e-9177-531fd09e10e6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:49.279786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa183775-99b3-4d7e-9177-531fd09e10e6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:49.282393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa183775-99b3-4d7e-9177-531fd09e10e6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:49.284090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa183775-99b3-4d7e-9177-531fd09e10e6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:49.286394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fa183775-99b3-4d7e-9177-531fd09e10e6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:49.447432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fa183775-99b3-4d7e-9177-531fd09e10e6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:49.459706 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fa183775-99b3-4d7e-9177-531fd09e10e6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1294 microversion: 2.1 time: 0.220334 Mar 05 21:13:49.460760 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2493/5006] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:49 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1294 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:49.564230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9a0712dd-17dd-4497-8f53-25d613c1cd64 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:49.565757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9a0712dd-17dd-4497-8f53-25d613c1cd64 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:49.579453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a0712dd-17dd-4497-8f53-25d613c1cd64 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:49.580273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a0712dd-17dd-4497-8f53-25d613c1cd64 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:49.581460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a0712dd-17dd-4497-8f53-25d613c1cd64 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:49.583406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a0712dd-17dd-4497-8f53-25d613c1cd64 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:49.817886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b91a9077-e867-4e11-8d02-81a4b7cf0f0b req-ab4ef4a3-3766-427a-b553-6686761636b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd96e93-68e0-4a43-a639-f7687e332e17", "name": "network-vif-plugged", "status": "completed", "tag": "01a57961-fbe3-4574-8e1d-4266a150ade8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:49.839103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b91a9077-e867-4e11-8d02-81a4b7cf0f0b req-ab4ef4a3-3766-427a-b553-6686761636b3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:49.840213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b91a9077-e867-4e11-8d02-81a4b7cf0f0b req-ab4ef4a3-3766-427a-b553-6686761636b3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:49.864515 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-b91a9077-e867-4e11-8d02-81a4b7cf0f0b req-ab4ef4a3-3766-427a-b553-6686761636b3 service nova] Creating event network-vif-plugged:01a57961-fbe3-4574-8e1d-4266a150ade8 for instance 6cd96e93-68e0-4a43-a639-f7687e332e17 on nch2-master-1 Mar 05 21:13:49.873834 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b91a9077-e867-4e11-8d02-81a4b7cf0f0b req-ab4ef4a3-3766-427a-b553-6686761636b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060212 Mar 05 21:13:49.874683 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2494/5007] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:13:49.976909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9a0712dd-17dd-4497-8f53-25d613c1cd64 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:49.993358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9a0712dd-17dd-4497-8f53-25d613c1cd64 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:49.995623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9a0712dd-17dd-4497-8f53-25d613c1cd64 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:49.997515 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9a0712dd-17dd-4497-8f53-25d613c1cd64 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1795 microversion: 2.20 time: 0.438451 Mar 05 21:13:49.999439 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2514/5008] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:13:49 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1795 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:13:50.185189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ff84f5e1-39ea-41dc-b2a5-cbeb3c296f93 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:50.186300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ff84f5e1-39ea-41dc-b2a5-cbeb3c296f93 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:50.205877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff84f5e1-39ea-41dc-b2a5-cbeb3c296f93 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:50.206344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff84f5e1-39ea-41dc-b2a5-cbeb3c296f93 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:50.207598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff84f5e1-39ea-41dc-b2a5-cbeb3c296f93 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:50.208493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff84f5e1-39ea-41dc-b2a5-cbeb3c296f93 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:50.478839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d2f0dba2-e814-4970-9c58-649ccedbf8d4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:50.479794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d2f0dba2-e814-4970-9c58-649ccedbf8d4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:50.485936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ff84f5e1-39ea-41dc-b2a5-cbeb3c296f93 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:50.486738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2f0dba2-e814-4970-9c58-649ccedbf8d4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:50.487394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2f0dba2-e814-4970-9c58-649ccedbf8d4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:50.488989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2f0dba2-e814-4970-9c58-649ccedbf8d4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:50.493011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2f0dba2-e814-4970-9c58-649ccedbf8d4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:50.500158 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ff84f5e1-39ea-41dc-b2a5-cbeb3c296f93 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1314 microversion: 2.1 time: 0.322666 Mar 05 21:13:50.516846 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2495/5009] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:50 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:50.628540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d2f0dba2-e814-4970-9c58-649ccedbf8d4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:50.642220 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d2f0dba2-e814-4970-9c58-649ccedbf8d4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1300 microversion: 2.1 time: 0.168798 Mar 05 21:13:50.642965 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2515/5010] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:50 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1300 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:51.306981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1749347856", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "d9b9f3d8-89cc-4d64-807e-aa00ac579414"}], "key_name": "tempest-TestNetworkBasicOps-2067475600", "security_groups": [{"name": "tempest-secgroup-smoke-74062424"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:51.526842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-acbfb265-6382-413f-834f-5f4adc62df4d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:51.527508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-acbfb265-6382-413f-834f-5f4adc62df4d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:51.537731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acbfb265-6382-413f-834f-5f4adc62df4d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:51.538924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acbfb265-6382-413f-834f-5f4adc62df4d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:51.540724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acbfb265-6382-413f-834f-5f4adc62df4d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:51.543784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acbfb265-6382-413f-834f-5f4adc62df4d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:51.562049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] validate_networks() for [('d9b9f3d8-89cc-4d64-807e-aa00ac579414', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:13:52.076319 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-acbfb265-6382-413f-834f-5f4adc62df4d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:52.095498 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-acbfb265-6382-413f-834f-5f4adc62df4d tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1499 microversion: 2.1 time: 0.580650 Mar 05 21:13:52.108393 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2516/5011] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:51 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1499 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:52.127347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-16584a29-c959-4900-a200-17f1492006f7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:52.128018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-16584a29-c959-4900-a200-17f1492006f7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:52.146342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:13:52.148528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:13:52.150327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:13:52.150939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:13:52.151637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:13:52.153042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16584a29-c959-4900-a200-17f1492006f7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:52.156900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16584a29-c959-4900-a200-17f1492006f7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:52.157998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16584a29-c959-4900-a200-17f1492006f7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:52.159664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16584a29-c959-4900-a200-17f1492006f7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:52.173425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:52.173891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:52.174699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:52.175142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:52.196988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:13:52.203751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Getting quotas for user 76b63093654943e6ac89d2b22e4f756a and project 632d8e2bf65b468e975ce9ac5869f2ad. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:13:52.231382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:13:52.237308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:13:52.344318 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9660f39b-9ca0-4ab2-b4bd-6e1ac1410f03 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.040928 Mar 05 21:13:52.346633 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2496/5012] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:13:51 2022] POST /compute/v2.1/servers => generated 404 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:13:52.381615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3aaa8631-8c1d-4067-979d-a8e5fb19ba4b tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:52.382661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3aaa8631-8c1d-4067-979d-a8e5fb19ba4b tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:52.541099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3aaa8631-8c1d-4067-979d-a8e5fb19ba4b tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:52.569582 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3aaa8631-8c1d-4067-979d-a8e5fb19ba4b tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1249 microversion: 2.1 time: 0.212480 Mar 05 21:13:52.576951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2497/5013] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:52 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1249 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:52.591189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-16584a29-c959-4900-a200-17f1492006f7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:52.602706 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-16584a29-c959-4900-a200-17f1492006f7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1368 microversion: 2.1 time: 0.492466 Mar 05 21:13:52.607207 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2517/5014] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:52 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1368 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:52.947957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ee410a6e-797d-4ed5-b239-65aba0f0aa07 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:52.948877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ee410a6e-797d-4ed5-b239-65aba0f0aa07 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:52.959582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee410a6e-797d-4ed5-b239-65aba0f0aa07 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:52.961342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee410a6e-797d-4ed5-b239-65aba0f0aa07 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:52.962791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee410a6e-797d-4ed5-b239-65aba0f0aa07 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:52.965000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee410a6e-797d-4ed5-b239-65aba0f0aa07 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:53.010581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ee410a6e-797d-4ed5-b239-65aba0f0aa07 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:13:53.130951 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ee410a6e-797d-4ed5-b239-65aba0f0aa07 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 204 len: 0 microversion: 2.1 time: 0.188868 Mar 05 21:13:53.132886 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2498/5015] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:13:52 2022] DELETE /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:13:53.141746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fb245f13-9282-417d-8a1e-7afb9c2cf6f7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:53.142463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fb245f13-9282-417d-8a1e-7afb9c2cf6f7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:53.158957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb245f13-9282-417d-8a1e-7afb9c2cf6f7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:53.159645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb245f13-9282-417d-8a1e-7afb9c2cf6f7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:53.160681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb245f13-9282-417d-8a1e-7afb9c2cf6f7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:53.161139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb245f13-9282-417d-8a1e-7afb9c2cf6f7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:53.414028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-3e974e29-771a-48be-82e3-748cdd3bdf0a req-9de47ffa-b363-49f4-9026-419606f699c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e1c081-b0e2-40b8-81bb-d8b68af010dd", "tag": "71b7c409-e98e-4866-bf19-79f1bddce767"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:53.451360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fb245f13-9282-417d-8a1e-7afb9c2cf6f7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:53.453905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3e974e29-771a-48be-82e3-748cdd3bdf0a req-9de47ffa-b363-49f4-9026-419606f699c0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:53.455041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3e974e29-771a-48be-82e3-748cdd3bdf0a req-9de47ffa-b363-49f4-9026-419606f699c0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:53.459021 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fb245f13-9282-417d-8a1e-7afb9c2cf6f7 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1505 microversion: 2.1 time: 0.321550 Mar 05 21:13:53.459616 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2518/5016] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:53 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:53.473667 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-3e974e29-771a-48be-82e3-748cdd3bdf0a req-9de47ffa-b363-49f4-9026-419606f699c0 service nova] Creating event network-changed:71b7c409-e98e-4866-bf19-79f1bddce767 for instance 11e1c081-b0e2-40b8-81bb-d8b68af010dd on nch1-master-1 Mar 05 21:13:53.479753 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-3e974e29-771a-48be-82e3-748cdd3bdf0a req-9de47ffa-b363-49f4-9026-419606f699c0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071912 Mar 05 21:13:53.480544 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2499/5017] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:53.592606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ef3ef9c7-95d1-411a-8cbb-adb7230b6ac6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:53.593236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ef3ef9c7-95d1-411a-8cbb-adb7230b6ac6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:53.607378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef3ef9c7-95d1-411a-8cbb-adb7230b6ac6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:53.608115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef3ef9c7-95d1-411a-8cbb-adb7230b6ac6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:53.609210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef3ef9c7-95d1-411a-8cbb-adb7230b6ac6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:53.609835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef3ef9c7-95d1-411a-8cbb-adb7230b6ac6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:53.622636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1ce0c1cd-152c-43a3-bdde-aa6aa49e20a4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:53.623591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1ce0c1cd-152c-43a3-bdde-aa6aa49e20a4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:53.640333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ce0c1cd-152c-43a3-bdde-aa6aa49e20a4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:53.641571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ce0c1cd-152c-43a3-bdde-aa6aa49e20a4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:53.643762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ce0c1cd-152c-43a3-bdde-aa6aa49e20a4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:53.645157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ce0c1cd-152c-43a3-bdde-aa6aa49e20a4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:53.779804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ef3ef9c7-95d1-411a-8cbb-adb7230b6ac6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:53.794795 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ef3ef9c7-95d1-411a-8cbb-adb7230b6ac6 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1301 microversion: 2.1 time: 0.206069 Mar 05 21:13:53.797477 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2519/5018] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:53 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1301 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:54.129563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1ce0c1cd-152c-43a3-bdde-aa6aa49e20a4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:54.140864 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1ce0c1cd-152c-43a3-bdde-aa6aa49e20a4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1368 microversion: 2.1 time: 0.524495 Mar 05 21:13:54.142895 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2500/5019] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:53 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1368 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:54.498742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5a46a95a-2875-4238-84b6-8ea8685142cb tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:54.500026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5a46a95a-2875-4238-84b6-8ea8685142cb tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:54.516897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a46a95a-2875-4238-84b6-8ea8685142cb tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:54.521101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a46a95a-2875-4238-84b6-8ea8685142cb tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:54.523801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a46a95a-2875-4238-84b6-8ea8685142cb tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:54.524659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a46a95a-2875-4238-84b6-8ea8685142cb tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:54.813436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f53cb3d9-2adb-4f27-bef1-3aa0b03e36d5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:54.814302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f53cb3d9-2adb-4f27-bef1-3aa0b03e36d5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:54.822125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f53cb3d9-2adb-4f27-bef1-3aa0b03e36d5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:54.823001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f53cb3d9-2adb-4f27-bef1-3aa0b03e36d5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:54.824287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f53cb3d9-2adb-4f27-bef1-3aa0b03e36d5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:54.824652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f53cb3d9-2adb-4f27-bef1-3aa0b03e36d5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:54.954617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5a46a95a-2875-4238-84b6-8ea8685142cb tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:54.964029 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5a46a95a-2875-4238-84b6-8ea8685142cb tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1505 microversion: 2.1 time: 0.478320 Mar 05 21:13:54.965119 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2520/5020] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:54 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:54.967197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f53cb3d9-2adb-4f27-bef1-3aa0b03e36d5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:54.980157 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f53cb3d9-2adb-4f27-bef1-3aa0b03e36d5 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1307 microversion: 2.1 time: 0.170563 Mar 05 21:13:54.987854 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2501/5021] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:54 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1307 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:55.165056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f3686441-bd4f-4722-b194-dead623ebbd3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:55.165579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f3686441-bd4f-4722-b194-dead623ebbd3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:55.176553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3686441-bd4f-4722-b194-dead623ebbd3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:55.179165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3686441-bd4f-4722-b194-dead623ebbd3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:55.180389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3686441-bd4f-4722-b194-dead623ebbd3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:55.181004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f3686441-bd4f-4722-b194-dead623ebbd3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:55.538637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f3686441-bd4f-4722-b194-dead623ebbd3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:55.546360 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f3686441-bd4f-4722-b194-dead623ebbd3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1368 microversion: 2.1 time: 0.389796 Mar 05 21:13:55.546953 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2521/5022] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:55 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1368 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:55.932769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-df746789-84e2-49f1-aeae-7a4400d5466a req-2378dbd6-03a3-405c-851e-963ceb17d9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd96e93-68e0-4a43-a639-f7687e332e17", "name": "network-vif-deleted", "tag": "01a57961-fbe3-4574-8e1d-4266a150ade8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:55.946910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-df746789-84e2-49f1-aeae-7a4400d5466a req-2378dbd6-03a3-405c-851e-963ceb17d9ca service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:55.947622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-df746789-84e2-49f1-aeae-7a4400d5466a req-2378dbd6-03a3-405c-851e-963ceb17d9ca service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:55.982610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5d8966fd-2ba3-4173-8343-492ae537d4a4 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:55.983945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5d8966fd-2ba3-4173-8343-492ae537d4a4 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:56.007726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d8966fd-2ba3-4173-8343-492ae537d4a4 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:56.008430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d8966fd-2ba3-4173-8343-492ae537d4a4 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:56.009257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d8966fd-2ba3-4173-8343-492ae537d4a4 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:56.009702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d8966fd-2ba3-4173-8343-492ae537d4a4 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:56.010271 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-df746789-84e2-49f1-aeae-7a4400d5466a req-2378dbd6-03a3-405c-851e-963ceb17d9ca service nova] Creating event network-vif-deleted:01a57961-fbe3-4574-8e1d-4266a150ade8 for instance 6cd96e93-68e0-4a43-a639-f7687e332e17 on nch2-master-1 Mar 05 21:13:56.020538 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-df746789-84e2-49f1-aeae-7a4400d5466a req-2378dbd6-03a3-405c-851e-963ceb17d9ca service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096487 Mar 05 21:13:56.021151 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2502/5023] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:56.041850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d0d9ce74-a8f5-417d-8558-3902ae20be8a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:56.049336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d0d9ce74-a8f5-417d-8558-3902ae20be8a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:56.070604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d0d9ce74-a8f5-417d-8558-3902ae20be8a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:56.082478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d0d9ce74-a8f5-417d-8558-3902ae20be8a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:56.084512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d0d9ce74-a8f5-417d-8558-3902ae20be8a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:56.086286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d0d9ce74-a8f5-417d-8558-3902ae20be8a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:56.097534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d8966fd-2ba3-4173-8343-492ae537d4a4 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:56.099230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d8966fd-2ba3-4173-8343-492ae537d4a4 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:56.110663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-5d8966fd-2ba3-4173-8343-492ae537d4a4 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lazy-loading 'fault' on Instance uuid 6cd96e93-68e0-4a43-a639-f7687e332e17 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:13:56.183195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5d8966fd-2ba3-4173-8343-492ae537d4a4 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5fca5fc43f4bd5971397ba20da0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6813d01c694475a2a3645008b1c369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:56.196456 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5d8966fd-2ba3-4173-8343-492ae537d4a4 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 200 len: 1304 microversion: 2.1 time: 0.218589 Mar 05 21:13:56.199723 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2522/5024] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:55 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 1304 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:56.467458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d0d9ce74-a8f5-417d-8558-3902ae20be8a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:56.478604 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d0d9ce74-a8f5-417d-8558-3902ae20be8a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1373 microversion: 2.1 time: 0.450833 Mar 05 21:13:56.479803 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2503/5025] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:56 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1373 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:56.564966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-06f7467e-43da-48ea-9506-3f51b4dd4213 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:56.566054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-06f7467e-43da-48ea-9506-3f51b4dd4213 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:56.578422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06f7467e-43da-48ea-9506-3f51b4dd4213 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:56.580744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06f7467e-43da-48ea-9506-3f51b4dd4213 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:56.582560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06f7467e-43da-48ea-9506-3f51b4dd4213 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:56.583534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06f7467e-43da-48ea-9506-3f51b4dd4213 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:56.943892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-61d27385-d9f5-466a-803d-b7fee48ca5d9 req-87052f29-26ca-4062-899d-ef8a5323bf19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be1cc11e-904c-4874-89b9-5e9bbef55b40", "tag": "b8192733-a028-48b7-97f6-9d039ff8a5d8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:56.958836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-61d27385-d9f5-466a-803d-b7fee48ca5d9 req-87052f29-26ca-4062-899d-ef8a5323bf19 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:56.959239 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-61d27385-d9f5-466a-803d-b7fee48ca5d9 req-87052f29-26ca-4062-899d-ef8a5323bf19 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:56.977344 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-61d27385-d9f5-466a-803d-b7fee48ca5d9 req-87052f29-26ca-4062-899d-ef8a5323bf19 service nova] Creating event network-changed:b8192733-a028-48b7-97f6-9d039ff8a5d8 for instance be1cc11e-904c-4874-89b9-5e9bbef55b40 on nch2-master-1 Mar 05 21:13:56.982445 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-61d27385-d9f5-466a-803d-b7fee48ca5d9 req-87052f29-26ca-4062-899d-ef8a5323bf19 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042221 Mar 05 21:13:56.983210 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2504/5026] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:13:56.994489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-06f7467e-43da-48ea-9506-3f51b4dd4213 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:57.002190 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-06f7467e-43da-48ea-9506-3f51b4dd4213 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1368 microversion: 2.1 time: 0.441749 Mar 05 21:13:57.002794 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2523/5027] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:56 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1368 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:57.216642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f4df430d-12f7-443a-b363-a45dcc9f2aa5 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:57.218117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f4df430d-12f7-443a-b363-a45dcc9f2aa5 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] [instance: 6cd96e93-68e0-4a43-a639-f7687e332e17] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:57.231083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4df430d-12f7-443a-b363-a45dcc9f2aa5 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:57.231479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4df430d-12f7-443a-b363-a45dcc9f2aa5 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:57.232320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4df430d-12f7-443a-b363-a45dcc9f2aa5 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:57.233532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4df430d-12f7-443a-b363-a45dcc9f2aa5 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:57.271096 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-f4df430d-12f7-443a-b363-a45dcc9f2aa5 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] HTTP exception thrown: Instance 6cd96e93-68e0-4a43-a639-f7687e332e17 could not be found. Mar 05 21:13:57.273069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f4df430d-12f7-443a-b363-a45dcc9f2aa5 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] Returning 404 to user: Instance 6cd96e93-68e0-4a43-a639-f7687e332e17 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:13:57.274661 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f4df430d-12f7-443a-b363-a45dcc9f2aa5 tempest-VolumesActionsTest-1075133775 tempest-VolumesActionsTest-1075133775-project] 10.222.0.15 "GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17" status: 404 len: 111 microversion: 2.1 time: 0.064336 Mar 05 21:13:57.275899 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2505/5028] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:57 2022] GET /compute/v2.1/servers/6cd96e93-68e0-4a43-a639-f7687e332e17 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:13:57.430801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-0bc55edc-87ec-4314-803f-3fade1b0d353 req-27389ece-ea2b-4301-adf5-12b6a22caaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e1c081-b0e2-40b8-81bb-d8b68af010dd", "name": "network-vif-plugged", "status": "completed", "tag": "71b7c409-e98e-4866-bf19-79f1bddce767"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:13:57.443157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0bc55edc-87ec-4314-803f-3fade1b0d353 req-27389ece-ea2b-4301-adf5-12b6a22caaf8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:57.444280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0bc55edc-87ec-4314-803f-3fade1b0d353 req-27389ece-ea2b-4301-adf5-12b6a22caaf8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:57.469166 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0bc55edc-87ec-4314-803f-3fade1b0d353 req-27389ece-ea2b-4301-adf5-12b6a22caaf8 service nova] Creating event network-vif-plugged:71b7c409-e98e-4866-bf19-79f1bddce767 for instance 11e1c081-b0e2-40b8-81bb-d8b68af010dd on nch1-master-1 Mar 05 21:13:57.485661 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-0bc55edc-87ec-4314-803f-3fade1b0d353 req-27389ece-ea2b-4301-adf5-12b6a22caaf8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062708 Mar 05 21:13:57.496637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-719c1ef4-638f-4e2c-8c5c-1ba231049f6c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:57.497535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-719c1ef4-638f-4e2c-8c5c-1ba231049f6c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:57.505250 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2524/5029] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:13:57.506091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-719c1ef4-638f-4e2c-8c5c-1ba231049f6c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:57.506779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-719c1ef4-638f-4e2c-8c5c-1ba231049f6c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:57.508352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-719c1ef4-638f-4e2c-8c5c-1ba231049f6c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:57.509197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-719c1ef4-638f-4e2c-8c5c-1ba231049f6c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:58.021248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-32491306-eb95-44c0-8779-1748f6d21fe5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:58.022015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-32491306-eb95-44c0-8779-1748f6d21fe5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:58.033341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32491306-eb95-44c0-8779-1748f6d21fe5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:58.033895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32491306-eb95-44c0-8779-1748f6d21fe5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:58.036009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32491306-eb95-44c0-8779-1748f6d21fe5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:58.036503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32491306-eb95-44c0-8779-1748f6d21fe5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:58.236112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-32491306-eb95-44c0-8779-1748f6d21fe5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:58.245842 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-32491306-eb95-44c0-8779-1748f6d21fe5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1368 microversion: 2.1 time: 0.229433 Mar 05 21:13:58.246446 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2525/5030] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:58 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:58.328907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-719c1ef4-638f-4e2c-8c5c-1ba231049f6c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:58.352995 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-719c1ef4-638f-4e2c-8c5c-1ba231049f6c tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1373 microversion: 2.1 time: 0.860975 Mar 05 21:13:58.356713 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2506/5031] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:57 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1373 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:13:59.262869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-02ddff43-a85e-4d76-8a14-8a6e68ca885c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:59.264593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-02ddff43-a85e-4d76-8a14-8a6e68ca885c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:59.272166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02ddff43-a85e-4d76-8a14-8a6e68ca885c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:59.273400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02ddff43-a85e-4d76-8a14-8a6e68ca885c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:59.274853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02ddff43-a85e-4d76-8a14-8a6e68ca885c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:59.275468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02ddff43-a85e-4d76-8a14-8a6e68ca885c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:59.370230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-62035cb2-ea4e-4f6e-af56-67b0bf45181a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:59.372006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-62035cb2-ea4e-4f6e-af56-67b0bf45181a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:59.380298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62035cb2-ea4e-4f6e-af56-67b0bf45181a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:59.381000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62035cb2-ea4e-4f6e-af56-67b0bf45181a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:59.382322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62035cb2-ea4e-4f6e-af56-67b0bf45181a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:59.382997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62035cb2-ea4e-4f6e-af56-67b0bf45181a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:59.611295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-62035cb2-ea4e-4f6e-af56-67b0bf45181a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:59.628295 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-62035cb2-ea4e-4f6e-af56-67b0bf45181a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1373 microversion: 2.1 time: 0.262397 Mar 05 21:13:59.629265 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2507/5032] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:59 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1373 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:59.632678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-02ddff43-a85e-4d76-8a14-8a6e68ca885c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:13:59.645570 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-02ddff43-a85e-4d76-8a14-8a6e68ca885c tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1559 microversion: 2.1 time: 0.386366 Mar 05 21:13:59.647101 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2526/5033] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:13:59 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1559 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:13:59.685415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-171d49ec-9177-423e-8517-fdb0437ac715 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:13:59.685940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-171d49ec-9177-423e-8517-fdb0437ac715 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:13:59.711881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-171d49ec-9177-423e-8517-fdb0437ac715 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:59.713858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-171d49ec-9177-423e-8517-fdb0437ac715 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:59.715043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-171d49ec-9177-423e-8517-fdb0437ac715 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:13:59.718956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-171d49ec-9177-423e-8517-fdb0437ac715 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:13:59.873230 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-171d49ec-9177-423e-8517-fdb0437ac715 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.203038 Mar 05 21:13:59.874032 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2508/5034] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 21:13:59 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:00.650841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-32ef17ff-b300-43bd-84dc-fe41e4748e37 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:00.652182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-32ef17ff-b300-43bd-84dc-fe41e4748e37 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:00.681311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32ef17ff-b300-43bd-84dc-fe41e4748e37 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:00.686558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32ef17ff-b300-43bd-84dc-fe41e4748e37 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:00.690211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32ef17ff-b300-43bd-84dc-fe41e4748e37 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:00.691246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32ef17ff-b300-43bd-84dc-fe41e4748e37 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:01.066523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-32ef17ff-b300-43bd-84dc-fe41e4748e37 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:01.090495 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-32ef17ff-b300-43bd-84dc-fe41e4748e37 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1373 microversion: 2.1 time: 0.448146 Mar 05 21:14:01.093988 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2527/5035] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:00 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1373 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:02.112390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b084ed20-c284-4bf5-89eb-2d8dcba48f46 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:02.113970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b084ed20-c284-4bf5-89eb-2d8dcba48f46 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:02.141465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b084ed20-c284-4bf5-89eb-2d8dcba48f46 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:02.142250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b084ed20-c284-4bf5-89eb-2d8dcba48f46 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:02.145544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b084ed20-c284-4bf5-89eb-2d8dcba48f46 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:02.151107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b084ed20-c284-4bf5-89eb-2d8dcba48f46 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:02.986764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-23eb6b94-e737-4069-ab06-adf15209f7d7 req-59fccde0-0724-4f32-80f8-ec132999695c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e1c081-b0e2-40b8-81bb-d8b68af010dd", "tag": "71b7c409-e98e-4866-bf19-79f1bddce767"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:03.013043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-23eb6b94-e737-4069-ab06-adf15209f7d7 req-59fccde0-0724-4f32-80f8-ec132999695c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:03.013974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-23eb6b94-e737-4069-ab06-adf15209f7d7 req-59fccde0-0724-4f32-80f8-ec132999695c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:03.062078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b084ed20-c284-4bf5-89eb-2d8dcba48f46 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:03.066084 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-23eb6b94-e737-4069-ab06-adf15209f7d7 req-59fccde0-0724-4f32-80f8-ec132999695c service nova] Creating event network-changed:71b7c409-e98e-4866-bf19-79f1bddce767 for instance 11e1c081-b0e2-40b8-81bb-d8b68af010dd on nch1-master-1 Mar 05 21:14:03.071929 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b084ed20-c284-4bf5-89eb-2d8dcba48f46 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1373 microversion: 2.1 time: 0.965277 Mar 05 21:14:03.087080 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2509/5036] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:02 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1373 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:03.103503 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-23eb6b94-e737-4069-ab06-adf15209f7d7 req-59fccde0-0724-4f32-80f8-ec132999695c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115597 Mar 05 21:14:03.107332 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2528/5037] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:14:03.160992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-91f750c0-a97d-4087-83a1-538c27d1a669 req-0fa8df75-f46e-4b13-89c0-c62726749818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be1cc11e-904c-4874-89b9-5e9bbef55b40", "name": "network-vif-plugged", "status": "completed", "tag": "b8192733-a028-48b7-97f6-9d039ff8a5d8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:03.180568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-91f750c0-a97d-4087-83a1-538c27d1a669 req-0fa8df75-f46e-4b13-89c0-c62726749818 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:03.184388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-91f750c0-a97d-4087-83a1-538c27d1a669 req-0fa8df75-f46e-4b13-89c0-c62726749818 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:03.210550 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-91f750c0-a97d-4087-83a1-538c27d1a669 req-0fa8df75-f46e-4b13-89c0-c62726749818 service nova] Creating event network-vif-plugged:b8192733-a028-48b7-97f6-9d039ff8a5d8 for instance be1cc11e-904c-4874-89b9-5e9bbef55b40 on nch2-master-1 Mar 05 21:14:03.222042 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-91f750c0-a97d-4087-83a1-538c27d1a669 req-0fa8df75-f46e-4b13-89c0-c62726749818 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064936 Mar 05 21:14:03.231027 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2510/5038] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:04.091280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-21f54c70-1622-48a4-b03a-b5e0b7d1b2c9 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:04.092647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-21f54c70-1622-48a4-b03a-b5e0b7d1b2c9 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:04.120283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21f54c70-1622-48a4-b03a-b5e0b7d1b2c9 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:04.120735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21f54c70-1622-48a4-b03a-b5e0b7d1b2c9 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:04.128327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21f54c70-1622-48a4-b03a-b5e0b7d1b2c9 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:04.131788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21f54c70-1622-48a4-b03a-b5e0b7d1b2c9 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:05.026925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-21f54c70-1622-48a4-b03a-b5e0b7d1b2c9 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:05.040498 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-21f54c70-1622-48a4-b03a-b5e0b7d1b2c9 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1373 microversion: 2.1 time: 0.955117 Mar 05 21:14:05.045245 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2529/5039] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:04 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1373 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:06.064838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-83eca2b7-6694-4fa2-a90e-3412cfbecab0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:06.065560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-83eca2b7-6694-4fa2-a90e-3412cfbecab0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:06.081232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-83eca2b7-6694-4fa2-a90e-3412cfbecab0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:06.081903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-83eca2b7-6694-4fa2-a90e-3412cfbecab0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:06.082910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-83eca2b7-6694-4fa2-a90e-3412cfbecab0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:06.083358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-83eca2b7-6694-4fa2-a90e-3412cfbecab0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:06.461002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-83eca2b7-6694-4fa2-a90e-3412cfbecab0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:06.473841 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-83eca2b7-6694-4fa2-a90e-3412cfbecab0 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1544 microversion: 2.1 time: 0.416595 Mar 05 21:14:06.474748 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2511/5040] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:06 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1544 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:06.497969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2e048ee4-2834-4715-a2c3-65258f4414a8 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:06.499551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2e048ee4-2834-4715-a2c3-65258f4414a8 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:06.512558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e048ee4-2834-4715-a2c3-65258f4414a8 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:06.513377 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e048ee4-2834-4715-a2c3-65258f4414a8 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:06.514846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e048ee4-2834-4715-a2c3-65258f4414a8 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:06.515474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e048ee4-2834-4715-a2c3-65258f4414a8 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:06.737743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2e048ee4-2834-4715-a2c3-65258f4414a8 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:06.747432 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2e048ee4-2834-4715-a2c3-65258f4414a8 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1544 microversion: 2.1 time: 0.254141 Mar 05 21:14:06.749319 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2530/5041] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:06 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1544 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:09.660175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-9d66a2f9-3e91-4aa2-b7ea-972278d5715d req-4258f4fb-7f54-44ed-87a0-1156400b5eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be1cc11e-904c-4874-89b9-5e9bbef55b40", "tag": "b8192733-a028-48b7-97f6-9d039ff8a5d8"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:09.687738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9d66a2f9-3e91-4aa2-b7ea-972278d5715d req-4258f4fb-7f54-44ed-87a0-1156400b5eb0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:09.690902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9d66a2f9-3e91-4aa2-b7ea-972278d5715d req-4258f4fb-7f54-44ed-87a0-1156400b5eb0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:09.733530 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-9d66a2f9-3e91-4aa2-b7ea-972278d5715d req-4258f4fb-7f54-44ed-87a0-1156400b5eb0 service nova] Creating event network-changed:b8192733-a028-48b7-97f6-9d039ff8a5d8 for instance be1cc11e-904c-4874-89b9-5e9bbef55b40 on nch2-master-1 Mar 05 21:14:09.754910 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-9d66a2f9-3e91-4aa2-b7ea-972278d5715d req-4258f4fb-7f54-44ed-87a0-1156400b5eb0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095690 Mar 05 21:14:09.756478 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2512/5042] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:20.907781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5e142c25-685f-4176-84c7-b67d718a84f1 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:20.915596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5e142c25-685f-4176-84c7-b67d718a84f1 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:20.932265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e142c25-685f-4176-84c7-b67d718a84f1 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:20.932608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e142c25-685f-4176-84c7-b67d718a84f1 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:20.933407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e142c25-685f-4176-84c7-b67d718a84f1 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:20.933868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e142c25-685f-4176-84c7-b67d718a84f1 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:21.144380 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5e142c25-685f-4176-84c7-b67d718a84f1 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/os-volume_attachments/e28a20a7-45f6-4921-9f87-076085057103" status: 200 len: 194 microversion: 2.20 time: 0.242847 Mar 05 21:14:21.156606 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2531/5043] 10.222.0.15 () {60 vars in 1453 bytes} [Sat Mar 5 21:14:20 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/os-volume_attachments/e28a20a7-45f6-4921-9f87-076085057103 => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:14:21.333165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c29dae9d-38ac-4176-b5b8-634ea6392047 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:21.334602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c29dae9d-38ac-4176-b5b8-634ea6392047 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:21.353287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c29dae9d-38ac-4176-b5b8-634ea6392047 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:21.355962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c29dae9d-38ac-4176-b5b8-634ea6392047 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:21.356994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c29dae9d-38ac-4176-b5b8-634ea6392047 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:21.360583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c29dae9d-38ac-4176-b5b8-634ea6392047 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:21.616194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-c29dae9d-38ac-4176-b5b8-634ea6392047 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lazy-loading 'services' on Instance uuid ba05bcb0-9bc3-42c9-a011-c592459cce1e {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:14:21.823484 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c29dae9d-38ac-4176-b5b8-634ea6392047 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/os-volume_attachments/e28a20a7-45f6-4921-9f87-076085057103" status: 202 len: 0 microversion: 2.20 time: 0.492404 Mar 05 21:14:21.825397 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2513/5044] 10.222.0.15 () {60 vars in 1456 bytes} [Sat Mar 5 21:14:21 2022] DELETE /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/os-volume_attachments/e28a20a7-45f6-4921-9f87-076085057103 => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:14:21.853028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6a58cc66-ef80-4fd3-a30f-099466b786d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:21.855128 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6a58cc66-ef80-4fd3-a30f-099466b786d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:21.894454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a58cc66-ef80-4fd3-a30f-099466b786d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:21.908163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a58cc66-ef80-4fd3-a30f-099466b786d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:21.914366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a58cc66-ef80-4fd3-a30f-099466b786d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:21.917059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a58cc66-ef80-4fd3-a30f-099466b786d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:22.061112 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6a58cc66-ef80-4fd3-a30f-099466b786d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.228105 Mar 05 21:14:22.074732 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2532/5045] 10.222.0.15 () {60 vars in 1342 bytes} [Sat Mar 5 21:14:21 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/os-volume_attachments => generated 197 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:14:23.092280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-262ec358-ea19-4d76-85bd-ec688648ea3e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:23.094901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-262ec358-ea19-4d76-85bd-ec688648ea3e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:23.120504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-262ec358-ea19-4d76-85bd-ec688648ea3e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:23.126408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-262ec358-ea19-4d76-85bd-ec688648ea3e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:23.134009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-262ec358-ea19-4d76-85bd-ec688648ea3e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:23.135186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-262ec358-ea19-4d76-85bd-ec688648ea3e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:23.221506 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-262ec358-ea19-4d76-85bd-ec688648ea3e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.136214 Mar 05 21:14:23.224118 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2514/5046] 10.222.0.15 () {60 vars in 1342 bytes} [Sat Mar 5 21:14:23 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:23.329822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ea36bce2-1db6-42b6-8fb9-477a646a40dc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:23.331050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ea36bce2-1db6-42b6-8fb9-477a646a40dc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:23.349612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea36bce2-1db6-42b6-8fb9-477a646a40dc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:23.351107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea36bce2-1db6-42b6-8fb9-477a646a40dc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:23.352565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea36bce2-1db6-42b6-8fb9-477a646a40dc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:23.353663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea36bce2-1db6-42b6-8fb9-477a646a40dc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:23.412468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ea36bce2-1db6-42b6-8fb9-477a646a40dc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:14:23.672976 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ea36bce2-1db6-42b6-8fb9-477a646a40dc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 204 len: 0 microversion: 2.20 time: 0.348971 Mar 05 21:14:23.678067 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2533/5047] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:14:23 2022] DELETE /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:14:23.701544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4fd99471-dcdd-455c-9582-6b46b74bf4a9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:23.702384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4fd99471-dcdd-455c-9582-6b46b74bf4a9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:23.739742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4fd99471-dcdd-455c-9582-6b46b74bf4a9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:23.740201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4fd99471-dcdd-455c-9582-6b46b74bf4a9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:23.741977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4fd99471-dcdd-455c-9582-6b46b74bf4a9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:23.742367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4fd99471-dcdd-455c-9582-6b46b74bf4a9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:24.273193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4fd99471-dcdd-455c-9582-6b46b74bf4a9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:24.289990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4fd99471-dcdd-455c-9582-6b46b74bf4a9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:24.295308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4fd99471-dcdd-455c-9582-6b46b74bf4a9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:24.301460 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4fd99471-dcdd-455c-9582-6b46b74bf4a9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1723 microversion: 2.20 time: 0.619508 Mar 05 21:14:24.306365 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2515/5048] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:23 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1723 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:14:25.327809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-88cf2822-f353-43fc-9696-59728a683264 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:25.329191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-88cf2822-f353-43fc-9696-59728a683264 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:25.343359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88cf2822-f353-43fc-9696-59728a683264 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:25.344143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88cf2822-f353-43fc-9696-59728a683264 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:25.347805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88cf2822-f353-43fc-9696-59728a683264 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:25.348480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88cf2822-f353-43fc-9696-59728a683264 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:25.729389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-88cf2822-f353-43fc-9696-59728a683264 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:25.742005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-88cf2822-f353-43fc-9696-59728a683264 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:25.748665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-88cf2822-f353-43fc-9696-59728a683264 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:25.749853 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-88cf2822-f353-43fc-9696-59728a683264 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1723 microversion: 2.20 time: 0.427289 Mar 05 21:14:25.752666 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2534/5049] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:25 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1723 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:14:26.774199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-22489ae2-5108-43bd-8d95-21e8a47a1c28 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:26.775870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-22489ae2-5108-43bd-8d95-21e8a47a1c28 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:26.803157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22489ae2-5108-43bd-8d95-21e8a47a1c28 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:26.812303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22489ae2-5108-43bd-8d95-21e8a47a1c28 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:26.816859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22489ae2-5108-43bd-8d95-21e8a47a1c28 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:26.818012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22489ae2-5108-43bd-8d95-21e8a47a1c28 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:27.170837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-22489ae2-5108-43bd-8d95-21e8a47a1c28 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:27.196932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-22489ae2-5108-43bd-8d95-21e8a47a1c28 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:27.206259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-22489ae2-5108-43bd-8d95-21e8a47a1c28 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:27.251506 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-22489ae2-5108-43bd-8d95-21e8a47a1c28 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1656 microversion: 2.20 time: 0.446840 Mar 05 21:14:27.258905 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2516/5050] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:26 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1656 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:14:28.274891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85637b3d-1d46-4552-9e8e-9578d88291a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:28.276565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-85637b3d-1d46-4552-9e8e-9578d88291a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:28.311097 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85637b3d-1d46-4552-9e8e-9578d88291a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:28.312323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85637b3d-1d46-4552-9e8e-9578d88291a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:28.317361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85637b3d-1d46-4552-9e8e-9578d88291a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:28.325164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85637b3d-1d46-4552-9e8e-9578d88291a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:28.446727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85637b3d-1d46-4552-9e8e-9578d88291a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:28.455234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85637b3d-1d46-4552-9e8e-9578d88291a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:28.456299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-85637b3d-1d46-4552-9e8e-9578d88291a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lazy-loading 'fault' on Instance uuid ba05bcb0-9bc3-42c9-a011-c592459cce1e {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:14:28.605125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-fe8d37e0-fe66-4cef-a380-688d950ff06e req-31c3a234-1758-4e8a-82e1-1dc54df8e571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba05bcb0-9bc3-42c9-a011-c592459cce1e", "name": "network-vif-deleted", "tag": "a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:28.626906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fe8d37e0-fe66-4cef-a380-688d950ff06e req-31c3a234-1758-4e8a-82e1-1dc54df8e571 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:28.635728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fe8d37e0-fe66-4cef-a380-688d950ff06e req-31c3a234-1758-4e8a-82e1-1dc54df8e571 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:28.650559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-85637b3d-1d46-4552-9e8e-9578d88291a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:28.663545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-85637b3d-1d46-4552-9e8e-9578d88291a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:28.673754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-85637b3d-1d46-4552-9e8e-9578d88291a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:28.679495 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-85637b3d-1d46-4552-9e8e-9578d88291a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 200 len: 1371 microversion: 2.20 time: 0.410979 Mar 05 21:14:28.681137 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-fe8d37e0-fe66-4cef-a380-688d950ff06e req-31c3a234-1758-4e8a-82e1-1dc54df8e571 service nova] Creating event network-vif-deleted:a3a33f68-d1b3-4ae0-8e0d-4d70f68f2ac4 for instance ba05bcb0-9bc3-42c9-a011-c592459cce1e on nch1-master-1 Mar 05 21:14:28.685005 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2517/5051] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:28 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 1371 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:14:28.713262 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-fe8d37e0-fe66-4cef-a380-688d950ff06e req-31c3a234-1758-4e8a-82e1-1dc54df8e571 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.758083 Mar 05 21:14:28.719580 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2535/5052] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:28.795992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bc7ce66f-61d0-4cb1-808a-e00c3af3f35f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:28.797403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bc7ce66f-61d0-4cb1-808a-e00c3af3f35f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:28.814241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc7ce66f-61d0-4cb1-808a-e00c3af3f35f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:28.814707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc7ce66f-61d0-4cb1-808a-e00c3af3f35f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:28.815522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc7ce66f-61d0-4cb1-808a-e00c3af3f35f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:28.816024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc7ce66f-61d0-4cb1-808a-e00c3af3f35f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:28.945348 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bc7ce66f-61d0-4cb1-808a-e00c3af3f35f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "POST /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40/action" status: 200 len: 24564 microversion: 2.1 time: 0.155100 Mar 05 21:14:28.959697 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2518/5053] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:14:28 2022] POST /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40/action => generated 24564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:14:29.701840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7eec3f57-8556-4ef1-9ff2-1865ceac7597 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:29.702563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7eec3f57-8556-4ef1-9ff2-1865ceac7597 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:29.737148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7eec3f57-8556-4ef1-9ff2-1865ceac7597 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:29.744521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7eec3f57-8556-4ef1-9ff2-1865ceac7597 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:29.753326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7eec3f57-8556-4ef1-9ff2-1865ceac7597 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:29.761261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7eec3f57-8556-4ef1-9ff2-1865ceac7597 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:29.798772 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-7eec3f57-8556-4ef1-9ff2-1865ceac7597 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] HTTP exception thrown: Instance ba05bcb0-9bc3-42c9-a011-c592459cce1e could not be found. Mar 05 21:14:29.802337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7eec3f57-8556-4ef1-9ff2-1865ceac7597 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Returning 404 to user: Instance ba05bcb0-9bc3-42c9-a011-c592459cce1e could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:14:29.812446 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7eec3f57-8556-4ef1-9ff2-1865ceac7597 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 404 len: 111 microversion: 2.20 time: 0.115985 Mar 05 21:14:29.813877 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2536/5054] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:29 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:14:29.825148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-94b6d0d6-acf6-4463-89e5-94f6607ac205 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '.version_select at 0x7fed5c7d4d30>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:29.872282 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-94b6d0d6-acf6-4463-89e5-94f6607ac205 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998843121" status: 204 len: 0 microversion: 2.20 time: 0.052601 Mar 05 21:14:29.874898 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2519/5055] 10.222.0.15 () {60 vars in 1261 bytes} [Sat Mar 5 21:14:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998843121 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:14:32.461500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-889bb93b-77cf-4ea1-99d8-61f49eecbe2f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Action: 'create', calling method: .version_select at 0x7fed61b77b80>, body: {"keypair": {"name": "tempest-keypair-46430123"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:32.489326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-889bb93b-77cf-4ea1-99d8-61f49eecbe2f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Getting quotas for project 5c1b37634bef4eefa974dfc8912e8556. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:14:32.499838 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-889bb93b-77cf-4ea1-99d8-61f49eecbe2f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Getting quotas for user 469bc2b7ea9e4727a0f0356e9a08dcb2 and project 5c1b37634bef4eefa974dfc8912e8556. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:14:33.197207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-889bb93b-77cf-4ea1-99d8-61f49eecbe2f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Getting quotas for project 5c1b37634bef4eefa974dfc8912e8556. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:14:33.207583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-889bb93b-77cf-4ea1-99d8-61f49eecbe2f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Getting quotas for user 469bc2b7ea9e4727a0f0356e9a08dcb2 and project 5c1b37634bef4eefa974dfc8912e8556. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:14:33.246448 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-889bb93b-77cf-4ea1-99d8-61f49eecbe2f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 0.793859 Mar 05 21:14:33.256112 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2537/5056] 10.222.0.15 () {62 vars in 1198 bytes} [Sat Mar 5 21:14:32 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 804 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:14:36.406151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f4698012-0bce-465e-a044-017bb8ea4142 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:36.406777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f4698012-0bce-465e-a044-017bb8ea4142 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:36.422873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4698012-0bce-465e-a044-017bb8ea4142 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:36.423336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4698012-0bce-465e-a044-017bb8ea4142 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:36.429869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4698012-0bce-465e-a044-017bb8ea4142 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:36.430393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4698012-0bce-465e-a044-017bb8ea4142 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:36.503049 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f4698012-0bce-465e-a044-017bb8ea4142 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/ips" status: 200 len: 151 microversion: 2.1 time: 0.101284 Mar 05 21:14:36.503700 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2520/5057] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 21:14:36 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/ips => generated 151 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:14:38.194904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6e719e22-5497-4301-bd5e-fea74fa52592 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:38.196104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6e719e22-5497-4301-bd5e-fea74fa52592 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:38.216879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e719e22-5497-4301-bd5e-fea74fa52592 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:38.217269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e719e22-5497-4301-bd5e-fea74fa52592 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:38.218137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e719e22-5497-4301-bd5e-fea74fa52592 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:38.218588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6e719e22-5497-4301-bd5e-fea74fa52592 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:38.311170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-630881840", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4b93af7-4d00-486d-82f8-877eddb5d778"}], "security_groups": [{"name": "tempest-securitygroup--498006019"}], "key_name": "tempest-keypair-46430123", "user_data": "}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:38.533807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] validate_networks() for [('f4b93af7-4d00-486d-82f8-877eddb5d778', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:14:38.636668 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6e719e22-5497-4301-bd5e-fea74fa52592 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "POST /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.447184 Mar 05 21:14:38.674984 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2538/5058] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:14:38 2022] POST /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:39.687486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1081003225", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2ca037da-0a96-4563-a9e2-280545ea1442", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "82b49213-810d-43f2-9dca-5a622352a45d"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:40.048199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:14:40.048699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:14:40.049101 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:14:40.049730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:14:40.050413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:14:40.072463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] validate_networks() for [('82b49213-810d-43f2-9dca-5a622352a45d', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:14:40.073133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:40.074004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:40.075736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:40.079013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:40.121213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Getting quotas for project 5c1b37634bef4eefa974dfc8912e8556. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:14:40.135060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Getting quotas for user 469bc2b7ea9e4727a0f0356e9a08dcb2 and project 5c1b37634bef4eefa974dfc8912e8556. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:14:40.165703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:14:40.173949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:14:40.298136 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-44b5c0af-aaf0-4ae4-b226-6bd3d61ee281 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.991966 Mar 05 21:14:40.300725 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2521/5059] 10.222.0.15 () {62 vars in 1187 bytes} [Sat Mar 5 21:14:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1999 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 05 21:14:40.325995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-96b3803f-7303-4002-bfa7-b654d9641907 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:40.326578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-96b3803f-7303-4002-bfa7-b654d9641907 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:40.468869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-96b3803f-7303-4002-bfa7-b654d9641907 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:40.483347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-96b3803f-7303-4002-bfa7-b654d9641907 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:40.487134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-96b3803f-7303-4002-bfa7-b654d9641907 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:40.488599 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-96b3803f-7303-4002-bfa7-b654d9641907 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1279 microversion: 2.20 time: 0.179971 Mar 05 21:14:40.489735 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2522/5060] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:40 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1279 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:14:40.556343 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b7deb700-182d-4e1f-a1b4-e604f8a9468e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:40.559620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b7deb700-182d-4e1f-a1b4-e604f8a9468e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:40.575438 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7deb700-182d-4e1f-a1b4-e604f8a9468e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:40.575935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7deb700-182d-4e1f-a1b4-e604f8a9468e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:40.576732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7deb700-182d-4e1f-a1b4-e604f8a9468e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:40.577177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7deb700-182d-4e1f-a1b4-e604f8a9468e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:40.674062 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b7deb700-182d-4e1f-a1b4-e604f8a9468e tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "POST /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40/action" status: 200 len: 32633 microversion: 2.1 time: 0.122413 Mar 05 21:14:40.674746 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2523/5061] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:14:40 2022] POST /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40/action => generated 32633 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 21:14:41.096706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:14:41.097285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:14:41.098054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:14:41.098570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:14:41.099107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:14:41.113785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:41.114244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:41.115214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:41.116001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:41.142198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for project cdcb29011e61419981c5bfc5f10677c5. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:14:41.149415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for user 0c07bd2946594c3e8848bca133da0d90 and project cdcb29011e61419981c5bfc5f10677c5. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:14:41.165925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:14:41.168348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2ca037da-0a96-4563-a9e2-280545ea1442',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:14:41.255484 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-157c2f72-096d-4f9b-8003-afd775fcfdde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.579433 Mar 05 21:14:41.256462 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2539/5062] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:14:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:14:41.268214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9af2d99e-6990-4598-9758-2bd0ab63bc20 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:41.269842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9af2d99e-6990-4598-9758-2bd0ab63bc20 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:41.462566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9af2d99e-6990-4598-9758-2bd0ab63bc20 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:41.474367 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9af2d99e-6990-4598-9758-2bd0ab63bc20 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1057 microversion: 2.1 time: 0.210294 Mar 05 21:14:41.479845 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2524/5063] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:41 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1057 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:41.508120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-21e90892-ca1c-493b-bffb-4d53380276e7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:41.508812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-21e90892-ca1c-493b-bffb-4d53380276e7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:41.522484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21e90892-ca1c-493b-bffb-4d53380276e7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:41.522866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21e90892-ca1c-493b-bffb-4d53380276e7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:41.532561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21e90892-ca1c-493b-bffb-4d53380276e7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:41.533012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21e90892-ca1c-493b-bffb-4d53380276e7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:41.728644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-21e90892-ca1c-493b-bffb-4d53380276e7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:41.761312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-21e90892-ca1c-493b-bffb-4d53380276e7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:41.766249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-21e90892-ca1c-493b-bffb-4d53380276e7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:41.776408 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-21e90892-ca1c-493b-bffb-4d53380276e7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1283 microversion: 2.20 time: 0.273576 Mar 05 21:14:41.779581 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2540/5064] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:41 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1283 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:14:42.289659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a244cc31-2944-4b2d-870f-ed9e8e4b6ea3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:42.290815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a244cc31-2944-4b2d-870f-ed9e8e4b6ea3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:42.308195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a244cc31-2944-4b2d-870f-ed9e8e4b6ea3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:42.309201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a244cc31-2944-4b2d-870f-ed9e8e4b6ea3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:42.310905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a244cc31-2944-4b2d-870f-ed9e8e4b6ea3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:42.311569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a244cc31-2944-4b2d-870f-ed9e8e4b6ea3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:42.474954 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-a244cc31-2944-4b2d-870f-ed9e8e4b6ea3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Invalid volume: volume 1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f is already attached to instances: 11e1c081-b0e2-40b8-81bb-d8b68af010dd Mar 05 21:14:42.476978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a244cc31-2944-4b2d-870f-ed9e8e4b6ea3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 400 to user: Invalid volume: volume 1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f is already attached to instances: 11e1c081-b0e2-40b8-81bb-d8b68af010dd {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:14:42.480504 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a244cc31-2944-4b2d-870f-ed9e8e4b6ea3 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "POST /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.197089 Mar 05 21:14:42.481235 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2525/5065] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:14:42 2022] POST /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/os-volume_attachments => generated 174 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 05 21:14:42.497198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4e2a5655-bd64-4ee4-a5dc-808398f31cdc tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:42.498460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4e2a5655-bd64-4ee4-a5dc-808398f31cdc tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:42.512481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e2a5655-bd64-4ee4-a5dc-808398f31cdc tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:42.513621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e2a5655-bd64-4ee4-a5dc-808398f31cdc tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:42.515734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e2a5655-bd64-4ee4-a5dc-808398f31cdc tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:42.516433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e2a5655-bd64-4ee4-a5dc-808398f31cdc tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:42.589762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f6b531d0-f007-4560-9001-ba385732bc53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:42.591388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f6b531d0-f007-4560-9001-ba385732bc53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:42.598544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6b531d0-f007-4560-9001-ba385732bc53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:42.600841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6b531d0-f007-4560-9001-ba385732bc53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:42.601819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6b531d0-f007-4560-9001-ba385732bc53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:42.602394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6b531d0-f007-4560-9001-ba385732bc53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:42.669448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4e2a5655-bd64-4ee4-a5dc-808398f31cdc tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:42.677240 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4e2a5655-bd64-4ee4-a5dc-808398f31cdc tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1109 microversion: 2.1 time: 0.186080 Mar 05 21:14:42.682577 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2541/5066] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:42 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1109 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:42.714644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af84587a-f45c-4eda-b2ed-40bfeb9b1f54 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:42.715156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-af84587a-f45c-4eda-b2ed-40bfeb9b1f54 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:42.721664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af84587a-f45c-4eda-b2ed-40bfeb9b1f54 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:42.722125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af84587a-f45c-4eda-b2ed-40bfeb9b1f54 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:42.722903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af84587a-f45c-4eda-b2ed-40bfeb9b1f54 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:42.723344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af84587a-f45c-4eda-b2ed-40bfeb9b1f54 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:42.735016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-f6b531d0-f007-4560-9001-ba385732bc53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lazy-loading 'services' on Instance uuid 11e1c081-b0e2-40b8-81bb-d8b68af010dd {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:14:42.768021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-af84587a-f45c-4eda-b2ed-40bfeb9b1f54 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:14:42.892845 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-af84587a-f45c-4eda-b2ed-40bfeb9b1f54 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "DELETE /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 204 len: 0 microversion: 2.1 time: 0.182083 Mar 05 21:14:42.897313 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2542/5067] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:14:42 2022] DELETE /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:14:42.905382 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f6b531d0-f007-4560-9001-ba385732bc53 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/os-volume_attachments/1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f" status: 202 len: 0 microversion: 2.1 time: 0.321272 Mar 05 21:14:42.907639 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2526/5068] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 21:14:42 2022] DELETE /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/os-volume_attachments/1f6ab5bd-f05a-4853-b1c7-d900d0a2af1f => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 21:14:42.925992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b7df22ac-1251-410b-943b-7884b221ec03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:42.928488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b7df22ac-1251-410b-943b-7884b221ec03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:42.929388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-f08e2e56-3862-483d-8001-0f75b7f52483 req-26e4c431-8e43-4aa8-91ba-eabb70ca13ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be1cc11e-904c-4874-89b9-5e9bbef55b40", "tag": "b8192733-a028-48b7-97f6-9d039ff8a5d8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:42.948848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7df22ac-1251-410b-943b-7884b221ec03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:42.950753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7df22ac-1251-410b-943b-7884b221ec03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:42.952712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7df22ac-1251-410b-943b-7884b221ec03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:42.953263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f08e2e56-3862-483d-8001-0f75b7f52483 req-26e4c431-8e43-4aa8-91ba-eabb70ca13ef service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:42.955318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f08e2e56-3862-483d-8001-0f75b7f52483 req-26e4c431-8e43-4aa8-91ba-eabb70ca13ef service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:42.955573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b7df22ac-1251-410b-943b-7884b221ec03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:42.989776 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-f08e2e56-3862-483d-8001-0f75b7f52483 req-26e4c431-8e43-4aa8-91ba-eabb70ca13ef service nova] Creating event network-changed:b8192733-a028-48b7-97f6-9d039ff8a5d8 for instance be1cc11e-904c-4874-89b9-5e9bbef55b40 on nch2-master-1 Mar 05 21:14:43.006422 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-f08e2e56-3862-483d-8001-0f75b7f52483 req-26e4c431-8e43-4aa8-91ba-eabb70ca13ef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088213 Mar 05 21:14:43.007606 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2543/5069] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:43.026489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-00a3be33-7491-4028-9937-c1e6cc6aa317 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:43.028514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-00a3be33-7491-4028-9937-c1e6cc6aa317 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:43.067997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00a3be33-7491-4028-9937-c1e6cc6aa317 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:43.067997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00a3be33-7491-4028-9937-c1e6cc6aa317 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:43.071524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00a3be33-7491-4028-9937-c1e6cc6aa317 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:43.071968 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00a3be33-7491-4028-9937-c1e6cc6aa317 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:43.198797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b7df22ac-1251-410b-943b-7884b221ec03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:43.214400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b7df22ac-1251-410b-943b-7884b221ec03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:43.218790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b7df22ac-1251-410b-943b-7884b221ec03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:43.221542 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b7df22ac-1251-410b-943b-7884b221ec03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1337 microversion: 2.20 time: 0.307173 Mar 05 21:14:43.223048 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2527/5070] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:42 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1337 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:14:43.237031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-180ed6f8-d5d8-4e55-bf50-f22b552f1dc0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:43.238590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-180ed6f8-d5d8-4e55-bf50-f22b552f1dc0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:43.248356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-180ed6f8-d5d8-4e55-bf50-f22b552f1dc0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:43.248997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-180ed6f8-d5d8-4e55-bf50-f22b552f1dc0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:43.250384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-180ed6f8-d5d8-4e55-bf50-f22b552f1dc0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:43.250932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-180ed6f8-d5d8-4e55-bf50-f22b552f1dc0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:43.290609 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-180ed6f8-d5d8-4e55-bf50-f22b552f1dc0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063189 Mar 05 21:14:43.292716 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2528/5071] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:14:43 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:43.298169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1434020739", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:43.375785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:14:43.938232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-00a3be33-7491-4028-9937-c1e6cc6aa317 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:43.958764 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-00a3be33-7491-4028-9937-c1e6cc6aa317 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1669 microversion: 2.1 time: 0.948128 Mar 05 21:14:43.960488 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2544/5072] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:43 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1669 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:43.973613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d22ae28e-6364-46b4-984d-40c1683f3da7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:43.976899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d22ae28e-6364-46b4-984d-40c1683f3da7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:43.994521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d22ae28e-6364-46b4-984d-40c1683f3da7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:43.995315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d22ae28e-6364-46b4-984d-40c1683f3da7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:43.996486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d22ae28e-6364-46b4-984d-40c1683f3da7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:43.998043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d22ae28e-6364-46b4-984d-40c1683f3da7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:44.288742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d22ae28e-6364-46b4-984d-40c1683f3da7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:44.307758 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d22ae28e-6364-46b4-984d-40c1683f3da7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1127 microversion: 2.1 time: 0.345881 Mar 05 21:14:44.321314 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2545/5073] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:43 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1127 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:44.342670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7f20d93c-9223-4e1b-8603-09b6010feafb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:44.366190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7f20d93c-9223-4e1b-8603-09b6010feafb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:44.398750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f20d93c-9223-4e1b-8603-09b6010feafb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:44.399584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f20d93c-9223-4e1b-8603-09b6010feafb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:44.400998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f20d93c-9223-4e1b-8603-09b6010feafb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:44.403810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f20d93c-9223-4e1b-8603-09b6010feafb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:44.847007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:14:44.847503 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:14:44.847947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:14:44.848940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:14:44.848940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:14:44.858989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:44.859450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:44.860518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:44.861182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:44.884826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Getting quotas for project 0bc2945ca7204c80907515ca0c271337. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:14:44.890938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Getting quotas for user f82efe872057495292d8e41f987c48a4 and project 0bc2945ca7204c80907515ca0c271337. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:14:44.908313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:14:44.912707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:14:44.966441 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-991adbe8-70d1-447e-a51c-2eb7539005af tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.672365 Mar 05 21:14:44.967213 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2529/5074] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:14:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:14:44.973719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-98ed12f4-0ec7-485f-be51-818e4846dc6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:44.974858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-98ed12f4-0ec7-485f-be51-818e4846dc6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:44.982327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98ed12f4-0ec7-485f-be51-818e4846dc6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:44.982872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98ed12f4-0ec7-485f-be51-818e4846dc6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:44.983975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98ed12f4-0ec7-485f-be51-818e4846dc6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:44.984491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98ed12f4-0ec7-485f-be51-818e4846dc6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:45.020821 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-98ed12f4-0ec7-485f-be51-818e4846dc6e tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052232 Mar 05 21:14:45.022703 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2530/5075] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:14:44 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:14:45.039918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7458cf8d-9923-483b-b976-ae5dc8476f65 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:45.041680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7458cf8d-9923-483b-b976-ae5dc8476f65 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:45.058614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7458cf8d-9923-483b-b976-ae5dc8476f65 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:45.062448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7458cf8d-9923-483b-b976-ae5dc8476f65 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:45.064254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7458cf8d-9923-483b-b976-ae5dc8476f65 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:45.068737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7458cf8d-9923-483b-b976-ae5dc8476f65 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:45.077061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7f20d93c-9223-4e1b-8603-09b6010feafb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:45.091526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7f20d93c-9223-4e1b-8603-09b6010feafb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:45.098214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7f20d93c-9223-4e1b-8603-09b6010feafb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:45.102153 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7f20d93c-9223-4e1b-8603-09b6010feafb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1404 microversion: 2.20 time: 0.778117 Mar 05 21:14:45.104921 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2546/5076] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:44 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1404 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:14:45.111642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0c7bd685-d733-40c3-bd50-0b7c4e8c5ae7 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:45.116354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0c7bd685-d733-40c3-bd50-0b7c4e8c5ae7 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:45.221058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0c7bd685-d733-40c3-bd50-0b7c4e8c5ae7 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82efe872057495292d8e41f987c48a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc2945ca7204c80907515ca0c271337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:45.232457 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0c7bd685-d733-40c3-bd50-0b7c4e8c5ae7 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 200 len: 1214 microversion: 2.1 time: 0.126373 Mar 05 21:14:45.235330 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2547/5077] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:45 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:45.246739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d7a1ac79-0ff8-4fcc-8b40-40c4618ba905 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:45.247663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d7a1ac79-0ff8-4fcc-8b40-40c4618ba905 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:45.258754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7a1ac79-0ff8-4fcc-8b40-40c4618ba905 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:45.259625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7a1ac79-0ff8-4fcc-8b40-40c4618ba905 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:45.262715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7a1ac79-0ff8-4fcc-8b40-40c4618ba905 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:45.263761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7a1ac79-0ff8-4fcc-8b40-40c4618ba905 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:45.304827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d7a1ac79-0ff8-4fcc-8b40-40c4618ba905 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:14:45.426756 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d7a1ac79-0ff8-4fcc-8b40-40c4618ba905 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 204 len: 0 microversion: 2.1 time: 0.188538 Mar 05 21:14:45.429931 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2548/5078] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:14:45 2022] DELETE /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:14:45.440455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-52577d1b-0117-410c-b7ec-39f68af6666a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:45.442286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-52577d1b-0117-410c-b7ec-39f68af6666a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:45.450806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52577d1b-0117-410c-b7ec-39f68af6666a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:45.451771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52577d1b-0117-410c-b7ec-39f68af6666a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:45.452830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52577d1b-0117-410c-b7ec-39f68af6666a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:45.453641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-52577d1b-0117-410c-b7ec-39f68af6666a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:45.523240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7458cf8d-9923-483b-b976-ae5dc8476f65 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:45.533982 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7458cf8d-9923-483b-b976-ae5dc8476f65 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1669 microversion: 2.1 time: 0.508920 Mar 05 21:14:45.535880 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2531/5079] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:45 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1669 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:45.547956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45df8b4a-ec38-4611-8bb8-71b8848aedc8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:45.550681 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-45df8b4a-ec38-4611-8bb8-71b8848aedc8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:45.558644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45df8b4a-ec38-4611-8bb8-71b8848aedc8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:45.559218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45df8b4a-ec38-4611-8bb8-71b8848aedc8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:45.560266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45df8b4a-ec38-4611-8bb8-71b8848aedc8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:45.560925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45df8b4a-ec38-4611-8bb8-71b8848aedc8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:45.601160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-52577d1b-0117-410c-b7ec-39f68af6666a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:45.637249 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-52577d1b-0117-410c-b7ec-39f68af6666a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1127 microversion: 2.1 time: 0.205225 Mar 05 21:14:45.639726 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2549/5080] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:45 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1127 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:45.836772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-45df8b4a-ec38-4611-8bb8-71b8848aedc8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:45.847633 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45df8b4a-ec38-4611-8bb8-71b8848aedc8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1684 microversion: 2.1 time: 0.310382 Mar 05 21:14:45.849511 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2532/5081] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:45 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1684 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:46.058959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e1be85ad-45a5-4dcf-a2a4-e300d0018311 req-ae76c09e-a9ed-4ee1-9f0b-f745cd8854a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be1cc11e-904c-4874-89b9-5e9bbef55b40", "name": "network-vif-deleted", "tag": "b8192733-a028-48b7-97f6-9d039ff8a5d8"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:46.122934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-71bc9bd1-d6f4-4354-8639-c29134ae9ad0 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:46.123557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-71bc9bd1-d6f4-4354-8639-c29134ae9ad0 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:46.145562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71bc9bd1-d6f4-4354-8639-c29134ae9ad0 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:46.145866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e1be85ad-45a5-4dcf-a2a4-e300d0018311 req-ae76c09e-a9ed-4ee1-9f0b-f745cd8854a9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:46.146964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e1be85ad-45a5-4dcf-a2a4-e300d0018311 req-ae76c09e-a9ed-4ee1-9f0b-f745cd8854a9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:46.148786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71bc9bd1-d6f4-4354-8639-c29134ae9ad0 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:46.149802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71bc9bd1-d6f4-4354-8639-c29134ae9ad0 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:46.153942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-71bc9bd1-d6f4-4354-8639-c29134ae9ad0 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:46.213293 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e1be85ad-45a5-4dcf-a2a4-e300d0018311 req-ae76c09e-a9ed-4ee1-9f0b-f745cd8854a9 service nova] Creating event network-vif-deleted:b8192733-a028-48b7-97f6-9d039ff8a5d8 for instance be1cc11e-904c-4874-89b9-5e9bbef55b40 on nch2-master-1 Mar 05 21:14:46.230348 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e1be85ad-45a5-4dcf-a2a4-e300d0018311 req-ae76c09e-a9ed-4ee1-9f0b-f745cd8854a9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180428 Mar 05 21:14:46.235603 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2550/5082] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:46.258193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5650e179-27c4-464d-bd27-d54b5328ca7b tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:46.259487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5650e179-27c4-464d-bd27-d54b5328ca7b tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:46.275229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5650e179-27c4-464d-bd27-d54b5328ca7b tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:46.275696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5650e179-27c4-464d-bd27-d54b5328ca7b tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:46.276515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5650e179-27c4-464d-bd27-d54b5328ca7b tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:46.276959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5650e179-27c4-464d-bd27-d54b5328ca7b tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:46.603142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5650e179-27c4-464d-bd27-d54b5328ca7b tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82efe872057495292d8e41f987c48a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc2945ca7204c80907515ca0c271337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:46.614699 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5650e179-27c4-464d-bd27-d54b5328ca7b tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 200 len: 1274 microversion: 2.1 time: 0.363619 Mar 05 21:14:46.625277 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2551/5083] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:46 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 1274 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:14:46.630371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-71a38970-fdc1-40e8-9410-56adb4e118a1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:46.631781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-71a38970-fdc1-40e8-9410-56adb4e118a1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:46.648022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71a38970-fdc1-40e8-9410-56adb4e118a1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:46.648749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71a38970-fdc1-40e8-9410-56adb4e118a1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:46.650411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71a38970-fdc1-40e8-9410-56adb4e118a1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:46.651390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71a38970-fdc1-40e8-9410-56adb4e118a1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:46.700076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71a38970-fdc1-40e8-9410-56adb4e118a1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:46.702260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71a38970-fdc1-40e8-9410-56adb4e118a1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:46.704648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-71a38970-fdc1-40e8-9410-56adb4e118a1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lazy-loading 'fault' on Instance uuid be1cc11e-904c-4874-89b9-5e9bbef55b40 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:14:46.900981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-71a38970-fdc1-40e8-9410-56adb4e118a1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63093654943e6ac89d2b22e4f756a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d8e2bf65b468e975ce9ac5869f2ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:46.912914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-71bc9bd1-d6f4-4354-8639-c29134ae9ad0 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:46.918180 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-71a38970-fdc1-40e8-9410-56adb4e118a1 tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 200 len: 1339 microversion: 2.1 time: 0.290555 Mar 05 21:14:46.922437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-71bc9bd1-d6f4-4354-8639-c29134ae9ad0 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:46.924253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-71bc9bd1-d6f4-4354-8639-c29134ae9ad0 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:46.925580 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-71bc9bd1-d6f4-4354-8639-c29134ae9ad0 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1404 microversion: 2.20 time: 0.807064 Mar 05 21:14:46.936343 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2552/5084] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:46 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 1339 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:46.936343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0eb372f8-adb7-47ea-9aca-aae907e6d682 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:46.936343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0eb372f8-adb7-47ea-9aca-aae907e6d682 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:46.937247 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2533/5085] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:46 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1404 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:14:46.942104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0eb372f8-adb7-47ea-9aca-aae907e6d682 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:46.942539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4d821f35-0414-4aea-86a0-56138e81f6b4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:46.942704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0eb372f8-adb7-47ea-9aca-aae907e6d682 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:46.943936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0eb372f8-adb7-47ea-9aca-aae907e6d682 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:46.944743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0eb372f8-adb7-47ea-9aca-aae907e6d682 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:46.945304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4d821f35-0414-4aea-86a0-56138e81f6b4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:46.955387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d821f35-0414-4aea-86a0-56138e81f6b4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:46.956610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d821f35-0414-4aea-86a0-56138e81f6b4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:46.960006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d821f35-0414-4aea-86a0-56138e81f6b4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:46.961924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d821f35-0414-4aea-86a0-56138e81f6b4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:47.437936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0eb372f8-adb7-47ea-9aca-aae907e6d682 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:47.447526 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0eb372f8-adb7-47ea-9aca-aae907e6d682 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1169 microversion: 2.1 time: 0.516817 Mar 05 21:14:47.448854 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2553/5086] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:46 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1169 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:47.634897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-01cb026f-4020-4a59-97b4-ae562d9a2216 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:47.635635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-01cb026f-4020-4a59-97b4-ae562d9a2216 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:47.644354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01cb026f-4020-4a59-97b4-ae562d9a2216 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:47.645188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01cb026f-4020-4a59-97b4-ae562d9a2216 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:47.646611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01cb026f-4020-4a59-97b4-ae562d9a2216 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:47.647551 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01cb026f-4020-4a59-97b4-ae562d9a2216 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:47.758357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-01cb026f-4020-4a59-97b4-ae562d9a2216 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82efe872057495292d8e41f987c48a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc2945ca7204c80907515ca0c271337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:47.767164 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-01cb026f-4020-4a59-97b4-ae562d9a2216 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 200 len: 1272 microversion: 2.1 time: 0.137788 Mar 05 21:14:47.773357 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2554/5087] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:47 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:47.800245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4d821f35-0414-4aea-86a0-56138e81f6b4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:47.809793 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4d821f35-0414-4aea-86a0-56138e81f6b4 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1684 microversion: 2.1 time: 0.871224 Mar 05 21:14:47.825494 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2534/5088] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:46 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1684 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:47.935687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9a05c482-45b5-4120-87db-f95f0e6a516a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:47.936328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9a05c482-45b5-4120-87db-f95f0e6a516a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] [instance: be1cc11e-904c-4874-89b9-5e9bbef55b40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:47.942411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a05c482-45b5-4120-87db-f95f0e6a516a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:47.942909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a05c482-45b5-4120-87db-f95f0e6a516a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:47.943702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a05c482-45b5-4120-87db-f95f0e6a516a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:47.944151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a05c482-45b5-4120-87db-f95f0e6a516a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:47.944867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c08b496-4d39-414a-b7ed-2bfa15c9390b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:47.945498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c08b496-4d39-414a-b7ed-2bfa15c9390b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:47.956712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c08b496-4d39-414a-b7ed-2bfa15c9390b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:47.957173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c08b496-4d39-414a-b7ed-2bfa15c9390b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:47.957965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c08b496-4d39-414a-b7ed-2bfa15c9390b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:47.958421 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c08b496-4d39-414a-b7ed-2bfa15c9390b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:47.981217 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-9a05c482-45b5-4120-87db-f95f0e6a516a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] HTTP exception thrown: Instance be1cc11e-904c-4874-89b9-5e9bbef55b40 could not be found. Mar 05 21:14:47.982188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9a05c482-45b5-4120-87db-f95f0e6a516a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Returning 404 to user: Instance be1cc11e-904c-4874-89b9-5e9bbef55b40 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:14:47.983779 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9a05c482-45b5-4120-87db-f95f0e6a516a tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40" status: 404 len: 111 microversion: 2.1 time: 0.051541 Mar 05 21:14:47.984905 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2555/5089] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:47 2022] GET /compute/v2.1/servers/be1cc11e-904c-4874-89b9-5e9bbef55b40 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:14:48.301786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-f388e662-d479-48a9-8ded-912d07c3031e req-1814402c-301c-4286-acba-112fc2fb75e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51aeb9d2-5c35-4841-bcb2-7162b1f8752a", "tag": "c9af0a09-36af-49e5-919a-b3687886298b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:48.349508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f388e662-d479-48a9-8ded-912d07c3031e req-1814402c-301c-4286-acba-112fc2fb75e0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:48.351307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f388e662-d479-48a9-8ded-912d07c3031e req-1814402c-301c-4286-acba-112fc2fb75e0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:48.387307 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-f388e662-d479-48a9-8ded-912d07c3031e req-1814402c-301c-4286-acba-112fc2fb75e0 service nova] Creating event network-changed:c9af0a09-36af-49e5-919a-b3687886298b for instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a on nch1-master-1 Mar 05 21:14:48.399801 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-f388e662-d479-48a9-8ded-912d07c3031e req-1814402c-301c-4286-acba-112fc2fb75e0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103279 Mar 05 21:14:48.400898 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2556/5090] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:48.471041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e8972ce0-c4c9-4ad5-b9f4-035dc695917c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:48.475192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e8972ce0-c4c9-4ad5-b9f4-035dc695917c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:48.487202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8972ce0-c4c9-4ad5-b9f4-035dc695917c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:48.487877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8972ce0-c4c9-4ad5-b9f4-035dc695917c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:48.489105 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8972ce0-c4c9-4ad5-b9f4-035dc695917c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:48.489960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8972ce0-c4c9-4ad5-b9f4-035dc695917c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:48.715341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8c08b496-4d39-414a-b7ed-2bfa15c9390b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:48.727563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8c08b496-4d39-414a-b7ed-2bfa15c9390b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:48.729016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8c08b496-4d39-414a-b7ed-2bfa15c9390b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:48.734449 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8c08b496-4d39-414a-b7ed-2bfa15c9390b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1404 microversion: 2.20 time: 0.794349 Mar 05 21:14:48.735099 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2535/5091] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:47 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1404 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:14:48.751591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3e8ab76c-5096-4e5b-aec7-f9eee18d766f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] Calling method '.version_select at 0x7fed5c9031f0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:48.792619 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3e8ab76c-5096-4e5b-aec7-f9eee18d766f tempest-TestNetworkBasicOps-145740570 tempest-TestNetworkBasicOps-145740570-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2067475600" status: 202 len: 0 microversion: 2.1 time: 0.045206 Mar 05 21:14:48.793239 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2536/5092] 10.222.0.15 () {58 vars in 1256 bytes} [Sat Mar 5 21:14:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2067475600 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 21:14:48.802683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a8ccd1d2-6b2c-48e3-b812-d13d5966682f tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:48.803647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a8ccd1d2-6b2c-48e3-b812-d13d5966682f tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:48.817868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a8ccd1d2-6b2c-48e3-b812-d13d5966682f tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:48.829409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a8ccd1d2-6b2c-48e3-b812-d13d5966682f tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:48.830424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a8ccd1d2-6b2c-48e3-b812-d13d5966682f tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:48.831620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a8ccd1d2-6b2c-48e3-b812-d13d5966682f tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:49.259002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e8972ce0-c4c9-4ad5-b9f4-035dc695917c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:49.267238 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e8972ce0-c4c9-4ad5-b9f4-035dc695917c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1215 microversion: 2.1 time: 0.804004 Mar 05 21:14:49.267846 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2557/5093] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:48 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1215 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:49.292457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fb98dbf7-3a85-41d0-9a4a-238a74970414 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:49.293087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fb98dbf7-3a85-41d0-9a4a-238a74970414 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:49.309053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb98dbf7-3a85-41d0-9a4a-238a74970414 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:49.309443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb98dbf7-3a85-41d0-9a4a-238a74970414 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:49.310227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb98dbf7-3a85-41d0-9a4a-238a74970414 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:49.310668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb98dbf7-3a85-41d0-9a4a-238a74970414 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:49.761050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fb98dbf7-3a85-41d0-9a4a-238a74970414 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:49.769794 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fb98dbf7-3a85-41d0-9a4a-238a74970414 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1684 microversion: 2.1 time: 0.481195 Mar 05 21:14:49.770388 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2558/5094] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:49 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1684 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:49.785525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6e265b29-1496-4078-9fc4-0e81c351e1a9 req-9d20d2fd-da9d-4f32-8d59-d9c6fbd4ac80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a71f065-9364-461c-8d0d-017f9286b0fb", "tag": "81efe88f-6b43-4bc3-93d8-d47bb3bc1e79"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:49.797110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6e265b29-1496-4078-9fc4-0e81c351e1a9 req-9d20d2fd-da9d-4f32-8d59-d9c6fbd4ac80 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:49.797837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6e265b29-1496-4078-9fc4-0e81c351e1a9 req-9d20d2fd-da9d-4f32-8d59-d9c6fbd4ac80 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:49.813627 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6e265b29-1496-4078-9fc4-0e81c351e1a9 req-9d20d2fd-da9d-4f32-8d59-d9c6fbd4ac80 service nova] Creating event network-changed:81efe88f-6b43-4bc3-93d8-d47bb3bc1e79 for instance 4a71f065-9364-461c-8d0d-017f9286b0fb on nch1-master-1 Mar 05 21:14:49.819833 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6e265b29-1496-4078-9fc4-0e81c351e1a9 req-9d20d2fd-da9d-4f32-8d59-d9c6fbd4ac80 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038310 Mar 05 21:14:49.820822 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2559/5095] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:50.010140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a8ccd1d2-6b2c-48e3-b812-d13d5966682f tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82efe872057495292d8e41f987c48a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc2945ca7204c80907515ca0c271337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:50.026724 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a8ccd1d2-6b2c-48e3-b812-d13d5966682f tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 200 len: 1314 microversion: 2.1 time: 1.228358 Mar 05 21:14:50.040484 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2537/5096] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:48 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 1314 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:50.048243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-54e2ec4d-217b-42e2-805d-e5f0267d07ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:50.049826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-54e2ec4d-217b-42e2-805d-e5f0267d07ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:50.058406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54e2ec4d-217b-42e2-805d-e5f0267d07ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:50.059170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54e2ec4d-217b-42e2-805d-e5f0267d07ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:50.061554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54e2ec4d-217b-42e2-805d-e5f0267d07ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:50.062982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-54e2ec4d-217b-42e2-805d-e5f0267d07ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:50.089721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-20ae8213-7c64-49f1-bf9a-b86f544e25be req-ee3315b9-a8ff-4bec-94ee-294268d5ce02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e1c081-b0e2-40b8-81bb-d8b68af010dd", "name": "network-vif-unplugged", "status": "completed", "tag": "71b7c409-e98e-4866-bf19-79f1bddce767"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:50.129255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-20ae8213-7c64-49f1-bf9a-b86f544e25be req-ee3315b9-a8ff-4bec-94ee-294268d5ce02 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:50.131045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-20ae8213-7c64-49f1-bf9a-b86f544e25be req-ee3315b9-a8ff-4bec-94ee-294268d5ce02 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:50.167917 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-20ae8213-7c64-49f1-bf9a-b86f544e25be req-ee3315b9-a8ff-4bec-94ee-294268d5ce02 service nova] Creating event network-vif-unplugged:71b7c409-e98e-4866-bf19-79f1bddce767 for instance 11e1c081-b0e2-40b8-81bb-d8b68af010dd on nch1-master-1 Mar 05 21:14:50.182945 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-20ae8213-7c64-49f1-bf9a-b86f544e25be req-ee3315b9-a8ff-4bec-94ee-294268d5ce02 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.359383 Mar 05 21:14:50.185713 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2560/5097] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:50.287486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-32c17c9b-7f9f-46e6-83c1-7600dd9a817a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:50.288831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-32c17c9b-7f9f-46e6-83c1-7600dd9a817a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:50.300210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32c17c9b-7f9f-46e6-83c1-7600dd9a817a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:50.300983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32c17c9b-7f9f-46e6-83c1-7600dd9a817a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:50.302109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32c17c9b-7f9f-46e6-83c1-7600dd9a817a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:50.303502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32c17c9b-7f9f-46e6-83c1-7600dd9a817a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:50.605346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-32c17c9b-7f9f-46e6-83c1-7600dd9a817a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:50.622470 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-32c17c9b-7f9f-46e6-83c1-7600dd9a817a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1203 microversion: 2.1 time: 0.340692 Mar 05 21:14:50.623803 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2561/5098] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:50 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1203 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:50.629000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-8dd8f185-5a1d-44d4-9cf7-8f4e25b77cb5 req-c4e6daad-995e-4ec2-b1c9-36e6b0e1549e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0289f80e-1b60-4efd-a464-5aeec336dc25", "tag": "6ff52e50-b035-4ee4-b9dc-f2f404617341"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:50.643156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8dd8f185-5a1d-44d4-9cf7-8f4e25b77cb5 req-c4e6daad-995e-4ec2-b1c9-36e6b0e1549e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:50.643990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8dd8f185-5a1d-44d4-9cf7-8f4e25b77cb5 req-c4e6daad-995e-4ec2-b1c9-36e6b0e1549e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:50.660773 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-8dd8f185-5a1d-44d4-9cf7-8f4e25b77cb5 req-c4e6daad-995e-4ec2-b1c9-36e6b0e1549e service nova] Creating event network-changed:6ff52e50-b035-4ee4-b9dc-f2f404617341 for instance 0289f80e-1b60-4efd-a464-5aeec336dc25 on nch2-master-1 Mar 05 21:14:50.668290 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-8dd8f185-5a1d-44d4-9cf7-8f4e25b77cb5 req-c4e6daad-995e-4ec2-b1c9-36e6b0e1549e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042911 Mar 05 21:14:50.669692 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2562/5099] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:50.766862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-54e2ec4d-217b-42e2-805d-e5f0267d07ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:50.777546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-54e2ec4d-217b-42e2-805d-e5f0267d07ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:50.779299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-54e2ec4d-217b-42e2-805d-e5f0267d07ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:50.796306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1ab24cfe-e3c0-408a-9add-792cd6b8710a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:50.799369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1ab24cfe-e3c0-408a-9add-792cd6b8710a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:50.806503 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-54e2ec4d-217b-42e2-805d-e5f0267d07ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1404 microversion: 2.20 time: 0.760847 Mar 05 21:14:50.809981 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2538/5100] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:50 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1404 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:14:50.814394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ab24cfe-e3c0-408a-9add-792cd6b8710a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:50.816059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ab24cfe-e3c0-408a-9add-792cd6b8710a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:50.817506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ab24cfe-e3c0-408a-9add-792cd6b8710a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:50.818367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ab24cfe-e3c0-408a-9add-792cd6b8710a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:50.926703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1ab24cfe-e3c0-408a-9add-792cd6b8710a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:50.935255 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1ab24cfe-e3c0-408a-9add-792cd6b8710a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1616 microversion: 2.1 time: 0.149929 Mar 05 21:14:50.946156 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2563/5101] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:50 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1616 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:51.046020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c88e7cd0-51d1-4181-a766-ca2698e0c7b9 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:51.048772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c88e7cd0-51d1-4181-a766-ca2698e0c7b9 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:51.057710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c88e7cd0-51d1-4181-a766-ca2698e0c7b9 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:51.058477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c88e7cd0-51d1-4181-a766-ca2698e0c7b9 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:51.059454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c88e7cd0-51d1-4181-a766-ca2698e0c7b9 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:51.060117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c88e7cd0-51d1-4181-a766-ca2698e0c7b9 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:51.641065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-97c61b23-8cd7-4e90-ace0-d4138400a127 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:51.642014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-97c61b23-8cd7-4e90-ace0-d4138400a127 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:51.648994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97c61b23-8cd7-4e90-ace0-d4138400a127 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:51.649754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97c61b23-8cd7-4e90-ace0-d4138400a127 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:51.650764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97c61b23-8cd7-4e90-ace0-d4138400a127 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:51.651432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97c61b23-8cd7-4e90-ace0-d4138400a127 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:51.717155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c88e7cd0-51d1-4181-a766-ca2698e0c7b9 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82efe872057495292d8e41f987c48a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc2945ca7204c80907515ca0c271337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:51.729402 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c88e7cd0-51d1-4181-a766-ca2698e0c7b9 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 200 len: 1314 microversion: 2.1 time: 0.689760 Mar 05 21:14:51.740035 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2539/5102] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:51 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 1314 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:51.824406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9a5e414a-6dfb-429e-8ef4-f68b3b3afbc8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:51.825155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9a5e414a-6dfb-429e-8ef4-f68b3b3afbc8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:51.835988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a5e414a-6dfb-429e-8ef4-f68b3b3afbc8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:51.836453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a5e414a-6dfb-429e-8ef4-f68b3b3afbc8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:51.837466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a5e414a-6dfb-429e-8ef4-f68b3b3afbc8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:51.837915 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a5e414a-6dfb-429e-8ef4-f68b3b3afbc8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:52.002333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-97c61b23-8cd7-4e90-ace0-d4138400a127 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:52.017887 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-97c61b23-8cd7-4e90-ace0-d4138400a127 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1203 microversion: 2.1 time: 0.380924 Mar 05 21:14:52.018789 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2564/5103] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:51 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1203 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:14:52.030388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d3c9df35-ba53-4a36-b1f5-767e81442252 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:52.031030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d3c9df35-ba53-4a36-b1f5-767e81442252 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:52.042036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3c9df35-ba53-4a36-b1f5-767e81442252 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:52.043107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3c9df35-ba53-4a36-b1f5-767e81442252 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:52.049013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3c9df35-ba53-4a36-b1f5-767e81442252 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:52.049744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d3c9df35-ba53-4a36-b1f5-767e81442252 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:52.188911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d3c9df35-ba53-4a36-b1f5-767e81442252 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:52.197738 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d3c9df35-ba53-4a36-b1f5-767e81442252 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 200 len: 1616 microversion: 2.1 time: 0.177651 Mar 05 21:14:52.208014 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2565/5104] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:52 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 1616 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:52.418228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-954f5ccc-ec61-4a21-a2a6-3a9b94c52b14 req-24c93198-31a1-4a17-89a8-44d71463a6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e1c081-b0e2-40b8-81bb-d8b68af010dd", "name": "network-vif-deleted", "tag": "71b7c409-e98e-4866-bf19-79f1bddce767"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:52.426115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-954f5ccc-ec61-4a21-a2a6-3a9b94c52b14 req-24c93198-31a1-4a17-89a8-44d71463a6a4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:52.427096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-954f5ccc-ec61-4a21-a2a6-3a9b94c52b14 req-24c93198-31a1-4a17-89a8-44d71463a6a4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:52.441308 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-954f5ccc-ec61-4a21-a2a6-3a9b94c52b14 req-24c93198-31a1-4a17-89a8-44d71463a6a4 service nova] Creating event network-vif-deleted:71b7c409-e98e-4866-bf19-79f1bddce767 for instance 11e1c081-b0e2-40b8-81bb-d8b68af010dd on nch1-master-1 Mar 05 21:14:52.448500 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-954f5ccc-ec61-4a21-a2a6-3a9b94c52b14 req-24c93198-31a1-4a17-89a8-44d71463a6a4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033949 Mar 05 21:14:52.449781 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2566/5105] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:52.667879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9a5e414a-6dfb-429e-8ef4-f68b3b3afbc8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:52.677928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9a5e414a-6dfb-429e-8ef4-f68b3b3afbc8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:52.679664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9a5e414a-6dfb-429e-8ef4-f68b3b3afbc8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:52.681105 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9a5e414a-6dfb-429e-8ef4-f68b3b3afbc8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1404 microversion: 2.20 time: 0.860816 Mar 05 21:14:52.692145 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2540/5106] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:51 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1404 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:14:52.748573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b894e780-c993-4523-97d1-cff8ac64c303 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:52.749688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b894e780-c993-4523-97d1-cff8ac64c303 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:52.759940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b894e780-c993-4523-97d1-cff8ac64c303 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:52.760680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b894e780-c993-4523-97d1-cff8ac64c303 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:52.762014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b894e780-c993-4523-97d1-cff8ac64c303 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:52.762642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b894e780-c993-4523-97d1-cff8ac64c303 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:52.989380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b894e780-c993-4523-97d1-cff8ac64c303 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82efe872057495292d8e41f987c48a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc2945ca7204c80907515ca0c271337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:53.000599 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b894e780-c993-4523-97d1-cff8ac64c303 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 200 len: 1314 microversion: 2.1 time: 0.257067 Mar 05 21:14:53.005780 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2567/5107] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:52 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:53.038758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7566cfee-0299-4212-9d67-31c61038137c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:53.039460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7566cfee-0299-4212-9d67-31c61038137c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:53.051264 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7566cfee-0299-4212-9d67-31c61038137c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:53.054376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7566cfee-0299-4212-9d67-31c61038137c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:53.055483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7566cfee-0299-4212-9d67-31c61038137c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:53.057564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7566cfee-0299-4212-9d67-31c61038137c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:53.216203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7220b869-651a-4a40-a405-7e15045b883d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:53.217358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7220b869-651a-4a40-a405-7e15045b883d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:53.230626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7220b869-651a-4a40-a405-7e15045b883d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:53.231091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7220b869-651a-4a40-a405-7e15045b883d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:53.233584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7220b869-651a-4a40-a405-7e15045b883d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:53.234052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7220b869-651a-4a40-a405-7e15045b883d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:53.268653 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-7220b869-651a-4a40-a405-7e15045b883d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Instance 11e1c081-b0e2-40b8-81bb-d8b68af010dd could not be found. Mar 05 21:14:53.271161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7220b869-651a-4a40-a405-7e15045b883d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 404 to user: Instance 11e1c081-b0e2-40b8-81bb-d8b68af010dd could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:14:53.274451 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7220b869-651a-4a40-a405-7e15045b883d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 404 len: 111 microversion: 2.1 time: 0.063528 Mar 05 21:14:53.278524 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2568/5108] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:53 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:14:53.287852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c20e8d8e-098f-412e-9531-fd9be75acef7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '.version_select at 0x7fed5c35bd30>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:53.310260 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c20e8d8e-098f-412e-9531-fd9be75acef7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132487854" status: 202 len: 0 microversion: 2.1 time: 0.026670 Mar 05 21:14:53.314686 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2569/5109] 10.222.0.15 () {58 vars in 1220 bytes} [Sat Mar 5 21:14:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132487854 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:14:53.637034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7566cfee-0299-4212-9d67-31c61038137c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:53.649880 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7566cfee-0299-4212-9d67-31c61038137c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1203 microversion: 2.1 time: 0.613261 Mar 05 21:14:53.651578 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2541/5110] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:53 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1203 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:53.707755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-99a25f64-1d5c-4738-8df8-c80707175328 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:53.708804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-99a25f64-1d5c-4738-8df8-c80707175328 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:53.723748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5d81d577-af91-48e0-88a1-8c167dc386a0 req-13eaae0b-1908-4901-9e31-79efbebef067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51aeb9d2-5c35-4841-bcb2-7162b1f8752a", "name": "network-vif-plugged", "status": "completed", "tag": "c9af0a09-36af-49e5-919a-b3687886298b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:53.735869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99a25f64-1d5c-4738-8df8-c80707175328 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:53.736447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99a25f64-1d5c-4738-8df8-c80707175328 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:53.738107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99a25f64-1d5c-4738-8df8-c80707175328 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:53.740045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5d81d577-af91-48e0-88a1-8c167dc386a0 req-13eaae0b-1908-4901-9e31-79efbebef067 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:53.740853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99a25f64-1d5c-4738-8df8-c80707175328 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:53.743579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5d81d577-af91-48e0-88a1-8c167dc386a0 req-13eaae0b-1908-4901-9e31-79efbebef067 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:53.774453 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-5d81d577-af91-48e0-88a1-8c167dc386a0 req-13eaae0b-1908-4901-9e31-79efbebef067 service nova] Creating event network-vif-plugged:c9af0a09-36af-49e5-919a-b3687886298b for instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a on nch1-master-1 Mar 05 21:14:53.784263 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5d81d577-af91-48e0-88a1-8c167dc386a0 req-13eaae0b-1908-4901-9e31-79efbebef067 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063755 Mar 05 21:14:53.790353 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2542/5111] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:14:54.023211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7d3f05ed-27db-40ea-b89d-d497d9eadd3d tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:54.023968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7d3f05ed-27db-40ea-b89d-d497d9eadd3d tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:54.037400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d3f05ed-27db-40ea-b89d-d497d9eadd3d tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:54.037862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d3f05ed-27db-40ea-b89d-d497d9eadd3d tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:54.038656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d3f05ed-27db-40ea-b89d-d497d9eadd3d tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:54.039099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d3f05ed-27db-40ea-b89d-d497d9eadd3d tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:54.232010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-99a25f64-1d5c-4738-8df8-c80707175328 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:54.244183 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-99a25f64-1d5c-4738-8df8-c80707175328 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:54.246199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-99a25f64-1d5c-4738-8df8-c80707175328 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:54.248201 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-99a25f64-1d5c-4738-8df8-c80707175328 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1404 microversion: 2.20 time: 0.551741 Mar 05 21:14:54.249378 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2570/5112] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:53 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1404 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:14:54.432621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7d3f05ed-27db-40ea-b89d-d497d9eadd3d tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82efe872057495292d8e41f987c48a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc2945ca7204c80907515ca0c271337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:54.442517 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7d3f05ed-27db-40ea-b89d-d497d9eadd3d tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 200 len: 1314 microversion: 2.1 time: 0.424121 Mar 05 21:14:54.443982 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2543/5113] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:54 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:14:54.667844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-afd0b6c5-7951-413b-a0d4-4fd2134da90e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:54.668826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-afd0b6c5-7951-413b-a0d4-4fd2134da90e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:54.675289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afd0b6c5-7951-413b-a0d4-4fd2134da90e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:54.676037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afd0b6c5-7951-413b-a0d4-4fd2134da90e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:54.677068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afd0b6c5-7951-413b-a0d4-4fd2134da90e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:54.677689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afd0b6c5-7951-413b-a0d4-4fd2134da90e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:54.988834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c0ed1ee1-6f63-41a2-9a2c-3c51c82ef0fe tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Action: 'create', calling method: .version_select at 0x7fed61b90160>, body: {"keypair": {"name": "tempest-keypair-1822223499"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:55.014558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-c0ed1ee1-6f63-41a2-9a2c-3c51c82ef0fe tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:14:55.029855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-c0ed1ee1-6f63-41a2-9a2c-3c51c82ef0fe tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for user 8bee90d7a5af4246b85ff0cb89217700 and project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:14:55.070126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-afd0b6c5-7951-413b-a0d4-4fd2134da90e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:55.082589 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-afd0b6c5-7951-413b-a0d4-4fd2134da90e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1203 microversion: 2.1 time: 0.418559 Mar 05 21:14:55.084069 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2571/5114] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:54 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1203 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:55.267388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2cb20149-4478-4fbe-8305-e5c8348bcc90 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:55.268115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2cb20149-4478-4fbe-8305-e5c8348bcc90 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:55.298816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2cb20149-4478-4fbe-8305-e5c8348bcc90 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:55.299287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2cb20149-4478-4fbe-8305-e5c8348bcc90 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:55.307524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2cb20149-4478-4fbe-8305-e5c8348bcc90 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:55.308145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2cb20149-4478-4fbe-8305-e5c8348bcc90 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:55.344062 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-c0ed1ee1-6f63-41a2-9a2c-3c51c82ef0fe tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:14:55.350863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-c0ed1ee1-6f63-41a2-9a2c-3c51c82ef0fe tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for user 8bee90d7a5af4246b85ff0cb89217700 and project f73f6888043940b9b1344c6998b423da. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:14:55.371528 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c0ed1ee1-6f63-41a2-9a2c-3c51c82ef0fe tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.387733 Mar 05 21:14:55.373160 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2544/5115] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:14:54 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:55.460378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e4216bf2-950e-4baf-9b94-09e82dd101a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:55.461513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e4216bf2-950e-4baf-9b94-09e82dd101a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:55.468668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e4216bf2-950e-4baf-9b94-09e82dd101a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:55.469485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e4216bf2-950e-4baf-9b94-09e82dd101a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:55.470602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e4216bf2-950e-4baf-9b94-09e82dd101a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:55.471481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e4216bf2-950e-4baf-9b94-09e82dd101a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:56.039150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2cb20149-4478-4fbe-8305-e5c8348bcc90 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:56.057991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2cb20149-4478-4fbe-8305-e5c8348bcc90 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:56.061869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2cb20149-4478-4fbe-8305-e5c8348bcc90 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:56.064683 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2cb20149-4478-4fbe-8305-e5c8348bcc90 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1404 microversion: 2.20 time: 0.800324 Mar 05 21:14:56.080893 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2572/5116] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:55 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1404 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:14:56.090548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-892fae63-7095-493a-848b-8fd666d26113 req-757e3608-5ae1-44b9-a2c8-c38766eabb65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0289f80e-1b60-4efd-a464-5aeec336dc25", "name": "network-vif-plugged", "status": "completed", "tag": "6ff52e50-b035-4ee4-b9dc-f2f404617341"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:56.110948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-892fae63-7095-493a-848b-8fd666d26113 req-757e3608-5ae1-44b9-a2c8-c38766eabb65 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:56.112525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-892fae63-7095-493a-848b-8fd666d26113 req-757e3608-5ae1-44b9-a2c8-c38766eabb65 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:56.134462 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-892fae63-7095-493a-848b-8fd666d26113 req-757e3608-5ae1-44b9-a2c8-c38766eabb65 service nova] Creating event network-vif-plugged:6ff52e50-b035-4ee4-b9dc-f2f404617341 for instance 0289f80e-1b60-4efd-a464-5aeec336dc25 on nch2-master-1 Mar 05 21:14:56.141572 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-892fae63-7095-493a-848b-8fd666d26113 req-757e3608-5ae1-44b9-a2c8-c38766eabb65 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059039 Mar 05 21:14:56.142933 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2573/5117] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:14:56.163281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1868f504-64c5-4ee9-b6b0-849bde9e8842 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:56.164289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1868f504-64c5-4ee9-b6b0-849bde9e8842 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:56.207589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1868f504-64c5-4ee9-b6b0-849bde9e8842 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:56.211338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1868f504-64c5-4ee9-b6b0-849bde9e8842 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:56.212882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1868f504-64c5-4ee9-b6b0-849bde9e8842 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:56.213445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1868f504-64c5-4ee9-b6b0-849bde9e8842 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:56.316251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e4216bf2-950e-4baf-9b94-09e82dd101a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82efe872057495292d8e41f987c48a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc2945ca7204c80907515ca0c271337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:56.331492 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e4216bf2-950e-4baf-9b94-09e82dd101a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 200 len: 1314 microversion: 2.1 time: 0.874920 Mar 05 21:14:56.332931 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2545/5118] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:55 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 1314 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:14:56.649040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1868f504-64c5-4ee9-b6b0-849bde9e8842 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:56.658263 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1868f504-64c5-4ee9-b6b0-849bde9e8842 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1203 microversion: 2.1 time: 0.513751 Mar 05 21:14:56.668971 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2574/5119] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:56 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1203 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:57.094708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2e072374-35f0-44d0-86d2-0b8a64b19bdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:57.095465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2e072374-35f0-44d0-86d2-0b8a64b19bdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:57.105696 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e072374-35f0-44d0-86d2-0b8a64b19bdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:57.106582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e072374-35f0-44d0-86d2-0b8a64b19bdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:57.107398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e072374-35f0-44d0-86d2-0b8a64b19bdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:57.107883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2e072374-35f0-44d0-86d2-0b8a64b19bdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:57.351143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f601131b-cfdf-4508-a094-7f9013e9af79 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:57.352073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f601131b-cfdf-4508-a094-7f9013e9af79 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:57.380878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f601131b-cfdf-4508-a094-7f9013e9af79 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:57.385207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f601131b-cfdf-4508-a094-7f9013e9af79 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:57.386182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f601131b-cfdf-4508-a094-7f9013e9af79 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:57.386987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f601131b-cfdf-4508-a094-7f9013e9af79 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:57.571175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2e072374-35f0-44d0-86d2-0b8a64b19bdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:57.581712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2e072374-35f0-44d0-86d2-0b8a64b19bdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:57.583918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2e072374-35f0-44d0-86d2-0b8a64b19bdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:57.585136 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2e072374-35f0-44d0-86d2-0b8a64b19bdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1595 microversion: 2.20 time: 0.494699 Mar 05 21:14:57.593422 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2546/5120] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:14:57 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1595 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:14:57.611848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f4e0fd31-bc84-47cd-91e1-ad693cc1fd66 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:57.612762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f4e0fd31-bc84-47cd-91e1-ad693cc1fd66 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:57.621313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4e0fd31-bc84-47cd-91e1-ad693cc1fd66 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:57.622059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4e0fd31-bc84-47cd-91e1-ad693cc1fd66 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:57.623032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4e0fd31-bc84-47cd-91e1-ad693cc1fd66 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:57.623726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4e0fd31-bc84-47cd-91e1-ad693cc1fd66 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:57.873336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f601131b-cfdf-4508-a094-7f9013e9af79 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82efe872057495292d8e41f987c48a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc2945ca7204c80907515ca0c271337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:57.926542 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f601131b-cfdf-4508-a094-7f9013e9af79 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 200 len: 1314 microversion: 2.1 time: 0.579684 Mar 05 21:14:57.927537 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2575/5121] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:57 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:57.933901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1d74ee56-9d9a-4434-972d-21efd8e7593f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:57.934929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1d74ee56-9d9a-4434-972d-21efd8e7593f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:57.942686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d74ee56-9d9a-4434-972d-21efd8e7593f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:57.943381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d74ee56-9d9a-4434-972d-21efd8e7593f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:57.944357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d74ee56-9d9a-4434-972d-21efd8e7593f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:57.944978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d74ee56-9d9a-4434-972d-21efd8e7593f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:57.979777 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f4e0fd31-bc84-47cd-91e1-ad693cc1fd66 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.372516 Mar 05 21:14:57.981401 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2547/5122] 10.222.0.15 () {60 vars in 1315 bytes} [Sat Mar 5 21:14:57 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/os-interface => generated 284 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 21:14:58.245667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1d74ee56-9d9a-4434-972d-21efd8e7593f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:58.259235 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1d74ee56-9d9a-4434-972d-21efd8e7593f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1203 microversion: 2.1 time: 0.329199 Mar 05 21:14:58.260086 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2576/5123] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:57 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1203 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:58.289769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8d20488a-be78-46c8-ad82-4df415dcf646 req-b572aa2d-5cd4-4d8e-83a5-8d72c04de5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a71f065-9364-461c-8d0d-017f9286b0fb", "name": "network-vif-plugged", "status": "completed", "tag": "81efe88f-6b43-4bc3-93d8-d47bb3bc1e79"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:58.301544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8d20488a-be78-46c8-ad82-4df415dcf646 req-b572aa2d-5cd4-4d8e-83a5-8d72c04de5dc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:58.303267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8d20488a-be78-46c8-ad82-4df415dcf646 req-b572aa2d-5cd4-4d8e-83a5-8d72c04de5dc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:58.319627 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8d20488a-be78-46c8-ad82-4df415dcf646 req-b572aa2d-5cd4-4d8e-83a5-8d72c04de5dc service nova] Creating event network-vif-plugged:81efe88f-6b43-4bc3-93d8-d47bb3bc1e79 for instance 4a71f065-9364-461c-8d0d-017f9286b0fb on nch1-master-1 Mar 05 21:14:58.325500 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-8d20488a-be78-46c8-ad82-4df415dcf646 req-b572aa2d-5cd4-4d8e-83a5-8d72c04de5dc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040620 Mar 05 21:14:58.329784 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2548/5124] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:14:58.690473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2138935757", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b56f14b9-afc0-424d-b080-c31779583b66"}], "security_groups": [{"name": "tempest-securitygroup--460893554"}], "key_name": "tempest-keypair-1822223499", "user_data": "}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:58.805699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] validate_networks() for [('b56f14b9-afc0-424d-b080-c31779583b66', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:14:58.945590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c2181823-65b1-428e-884f-0384a0ac57bd tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:58.946398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c2181823-65b1-428e-884f-0384a0ac57bd tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:58.953262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2181823-65b1-428e-884f-0384a0ac57bd tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:58.953736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2181823-65b1-428e-884f-0384a0ac57bd tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:58.954515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2181823-65b1-428e-884f-0384a0ac57bd tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:58.954962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2181823-65b1-428e-884f-0384a0ac57bd tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:59.425660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c2181823-65b1-428e-884f-0384a0ac57bd tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82efe872057495292d8e41f987c48a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc2945ca7204c80907515ca0c271337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:59.438907 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c2181823-65b1-428e-884f-0384a0ac57bd tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 200 len: 1463 microversion: 2.1 time: 0.497603 Mar 05 21:14:59.440217 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2549/5125] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:58 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 1463 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:14:59.448853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-933f3ff2-b189-40a8-8330-d2be5e949a01 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:59.449695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-933f3ff2-b189-40a8-8330-d2be5e949a01 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:59.460756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-933f3ff2-b189-40a8-8330-d2be5e949a01 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:59.461285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-933f3ff2-b189-40a8-8330-d2be5e949a01 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:59.462314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-933f3ff2-b189-40a8-8330-d2be5e949a01 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:59.462835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-933f3ff2-b189-40a8-8330-d2be5e949a01 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:59.665515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:14:59.666073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:14:59.666466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:14:59.666803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:14:59.667225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:14:59.684158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:59.684619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:59.685425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:59.685959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:59.711405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for project f73f6888043940b9b1344c6998b423da. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:14:59.717619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Getting quotas for user 8bee90d7a5af4246b85ff0cb89217700 and project f73f6888043940b9b1344c6998b423da. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:14:59.733792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:14:59.736187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:14:59.808339 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-036e033c-6805-4784-81a0-35cb85bce710 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.122180 Mar 05 21:14:59.812796 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2577/5126] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:14:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 21:14:59.824180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d44eae7e-0560-40a1-a256-dbde3d36bdab tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2de60bd3-fd9c-4cf2-a463-7d2086df54a0", "device": "/dev/sdb"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:14:59.826062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d44eae7e-0560-40a1-a256-dbde3d36bdab tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:14:59.836273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d44eae7e-0560-40a1-a256-dbde3d36bdab tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:59.840568 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d44eae7e-0560-40a1-a256-dbde3d36bdab tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:59.843655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d44eae7e-0560-40a1-a256-dbde3d36bdab tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:14:59.844827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d44eae7e-0560-40a1-a256-dbde3d36bdab tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:14:59.864974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-933f3ff2-b189-40a8-8330-d2be5e949a01 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:14:59.878374 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-933f3ff2-b189-40a8-8330-d2be5e949a01 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1203 microversion: 2.1 time: 0.436702 Mar 05 21:14:59.892141 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2550/5127] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:59 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1203 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:14:59.916612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4ce33edd-f9b4-47a3-955d-aa24b3bf95bd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:14:59.917462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4ce33edd-f9b4-47a3-955d-aa24b3bf95bd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:00.096282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4ce33edd-f9b4-47a3-955d-aa24b3bf95bd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:00.110934 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4ce33edd-f9b4-47a3-955d-aa24b3bf95bd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 200 len: 1242 microversion: 2.1 time: 0.217527 Mar 05 21:15:00.116559 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2551/5128] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:14:59 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 1242 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:00.243859 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d44eae7e-0560-40a1-a256-dbde3d36bdab tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "POST /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429384 Mar 05 21:15:00.245171 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2578/5129] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:14:59 2022] POST /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25/os-volume_attachments => generated 194 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:00.604533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8e37b3ad-e155-4ae2-be22-8bb4dd2ffd4e req-1368ca24-7e3c-4739-8823-6d795b6e8cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51aeb9d2-5c35-4841-bcb2-7162b1f8752a", "tag": "c9af0a09-36af-49e5-919a-b3687886298b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:00.618698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8e37b3ad-e155-4ae2-be22-8bb4dd2ffd4e req-1368ca24-7e3c-4739-8823-6d795b6e8cda service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:00.621255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8e37b3ad-e155-4ae2-be22-8bb4dd2ffd4e req-1368ca24-7e3c-4739-8823-6d795b6e8cda service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:00.656759 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8e37b3ad-e155-4ae2-be22-8bb4dd2ffd4e req-1368ca24-7e3c-4739-8823-6d795b6e8cda service nova] Creating event network-changed:c9af0a09-36af-49e5-919a-b3687886298b for instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a on nch1-master-1 Mar 05 21:15:00.692327 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-8e37b3ad-e155-4ae2-be22-8bb4dd2ffd4e req-1368ca24-7e3c-4739-8823-6d795b6e8cda service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095283 Mar 05 21:15:00.698268 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2552/5130] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:00.901496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3cee1fab-3cc2-4518-aa9c-d1f424018dc2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:00.908878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3cee1fab-3cc2-4518-aa9c-d1f424018dc2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:00.917845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3cee1fab-3cc2-4518-aa9c-d1f424018dc2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:00.918760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3cee1fab-3cc2-4518-aa9c-d1f424018dc2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:00.919743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3cee1fab-3cc2-4518-aa9c-d1f424018dc2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:00.920354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3cee1fab-3cc2-4518-aa9c-d1f424018dc2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:01.133240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-784cbd0c-53fd-4bbe-af16-64e0fc9fc288 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:01.134025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-784cbd0c-53fd-4bbe-af16-64e0fc9fc288 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:01.157061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-784cbd0c-53fd-4bbe-af16-64e0fc9fc288 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:01.159297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-784cbd0c-53fd-4bbe-af16-64e0fc9fc288 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:01.164525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-784cbd0c-53fd-4bbe-af16-64e0fc9fc288 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:01.167998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-784cbd0c-53fd-4bbe-af16-64e0fc9fc288 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:01.454268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-784cbd0c-53fd-4bbe-af16-64e0fc9fc288 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:01.466559 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-784cbd0c-53fd-4bbe-af16-64e0fc9fc288 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 200 len: 1294 microversion: 2.1 time: 0.337822 Mar 05 21:15:01.467865 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2553/5131] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:01 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 1294 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:15:01.701831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3cee1fab-3cc2-4518-aa9c-d1f424018dc2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:01.710253 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3cee1fab-3cc2-4518-aa9c-d1f424018dc2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1390 microversion: 2.1 time: 0.815501 Mar 05 21:15:01.710859 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2579/5132] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:00 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1390 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:01.730028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-be03b66e-ceff-4c0e-8b74-509bb8ab62b6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:01.730963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-be03b66e-ceff-4c0e-8b74-509bb8ab62b6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:01.752537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be03b66e-ceff-4c0e-8b74-509bb8ab62b6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:01.759239 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be03b66e-ceff-4c0e-8b74-509bb8ab62b6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:01.760567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be03b66e-ceff-4c0e-8b74-509bb8ab62b6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:01.761033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be03b66e-ceff-4c0e-8b74-509bb8ab62b6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:01.965269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-be03b66e-ceff-4c0e-8b74-509bb8ab62b6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:01.973487 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-be03b66e-ceff-4c0e-8b74-509bb8ab62b6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1390 microversion: 2.1 time: 0.247786 Mar 05 21:15:01.974244 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2554/5133] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:01 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1390 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:01.990168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f4ed211c-91e7-4b9c-b013-572bd4dd4c35 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:01.991522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f4ed211c-91e7-4b9c-b013-572bd4dd4c35 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:01.999488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f4ed211c-91e7-4b9c-b013-572bd4dd4c35 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:01.999987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f4ed211c-91e7-4b9c-b013-572bd4dd4c35 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:02.000793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f4ed211c-91e7-4b9c-b013-572bd4dd4c35 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:02.001244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f4ed211c-91e7-4b9c-b013-572bd4dd4c35 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:02.345321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f4ed211c-91e7-4b9c-b013-572bd4dd4c35 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:02.354081 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f4ed211c-91e7-4b9c-b013-572bd4dd4c35 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1390 microversion: 2.1 time: 0.368270 Mar 05 21:15:02.354689 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2580/5134] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:01 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1390 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:02.439963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-22679092-2ae4-48f6-926c-8d646f2fb8f3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:02.441142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-22679092-2ae4-48f6-926c-8d646f2fb8f3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:02.457687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22679092-2ae4-48f6-926c-8d646f2fb8f3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:02.459152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22679092-2ae4-48f6-926c-8d646f2fb8f3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:02.460258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22679092-2ae4-48f6-926c-8d646f2fb8f3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:02.460918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22679092-2ae4-48f6-926c-8d646f2fb8f3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:02.492959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6ca05b17-94dc-4284-bf5e-14edbafd46b1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:02.494081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6ca05b17-94dc-4284-bf5e-14edbafd46b1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:02.502897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-22679092-2ae4-48f6-926c-8d646f2fb8f3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:15:02.504785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ca05b17-94dc-4284-bf5e-14edbafd46b1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:02.508216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ca05b17-94dc-4284-bf5e-14edbafd46b1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:02.509329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ca05b17-94dc-4284-bf5e-14edbafd46b1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:02.510335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6ca05b17-94dc-4284-bf5e-14edbafd46b1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:02.679779 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-22679092-2ae4-48f6-926c-8d646f2fb8f3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 204 len: 0 microversion: 2.1 time: 0.243614 Mar 05 21:15:02.684214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6ca05b17-94dc-4284-bf5e-14edbafd46b1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:02.684689 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2555/5135] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:15:02 2022] DELETE /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:15:02.691002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0fb0a781-1bee-4ed0-9e1b-ca797ff237a2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:02.691733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0fb0a781-1bee-4ed0-9e1b-ca797ff237a2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:02.699759 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6ca05b17-94dc-4284-bf5e-14edbafd46b1 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 200 len: 1300 microversion: 2.1 time: 0.211669 Mar 05 21:15:02.710205 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2581/5136] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:02 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 1300 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:15:02.712533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fb0a781-1bee-4ed0-9e1b-ca797ff237a2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:02.714133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fb0a781-1bee-4ed0-9e1b-ca797ff237a2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:02.714650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fb0a781-1bee-4ed0-9e1b-ca797ff237a2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:02.715569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fb0a781-1bee-4ed0-9e1b-ca797ff237a2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:02.954962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0fb0a781-1bee-4ed0-9e1b-ca797ff237a2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:02.969408 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0fb0a781-1bee-4ed0-9e1b-ca797ff237a2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1396 microversion: 2.1 time: 0.283358 Mar 05 21:15:02.970658 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2556/5137] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:02 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1396 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:03.726122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-07ac1d0e-dd9b-4b32-8b29-905cd46fc4b7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:03.726609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-07ac1d0e-dd9b-4b32-8b29-905cd46fc4b7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:03.736162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07ac1d0e-dd9b-4b32-8b29-905cd46fc4b7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:03.736932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07ac1d0e-dd9b-4b32-8b29-905cd46fc4b7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:03.738952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07ac1d0e-dd9b-4b32-8b29-905cd46fc4b7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:03.739684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07ac1d0e-dd9b-4b32-8b29-905cd46fc4b7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:03.989708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fc257626-f501-48b6-814d-a37f51ed1007 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:03.991075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fc257626-f501-48b6-814d-a37f51ed1007 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:04.004235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fc257626-f501-48b6-814d-a37f51ed1007 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:04.004480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fc257626-f501-48b6-814d-a37f51ed1007 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:04.006074 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fc257626-f501-48b6-814d-a37f51ed1007 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:04.006516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fc257626-f501-48b6-814d-a37f51ed1007 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:04.253629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-07ac1d0e-dd9b-4b32-8b29-905cd46fc4b7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:04.274680 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-07ac1d0e-dd9b-4b32-8b29-905cd46fc4b7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 200 len: 1367 microversion: 2.1 time: 0.553446 Mar 05 21:15:04.287260 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2582/5138] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:03 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 1367 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:04.457737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-1ed8a87f-c2f6-440d-be69-bc1c9988578f req-6d7aa00a-6da4-4dab-890e-bd180ddd3bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "792eb61e-229f-4cb7-a709-179922039250", "tag": "68a3695d-1e5b-431b-9bfd-992a7e3c692f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:04.479714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1ed8a87f-c2f6-440d-be69-bc1c9988578f req-6d7aa00a-6da4-4dab-890e-bd180ddd3bab service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:04.480792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1ed8a87f-c2f6-440d-be69-bc1c9988578f req-6d7aa00a-6da4-4dab-890e-bd180ddd3bab service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:04.496459 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-1ed8a87f-c2f6-440d-be69-bc1c9988578f req-6d7aa00a-6da4-4dab-890e-bd180ddd3bab service nova] Creating event network-changed:68a3695d-1e5b-431b-9bfd-992a7e3c692f for instance 792eb61e-229f-4cb7-a709-179922039250 on nch2-master-1 Mar 05 21:15:04.503831 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-1ed8a87f-c2f6-440d-be69-bc1c9988578f req-6d7aa00a-6da4-4dab-890e-bd180ddd3bab service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052305 Mar 05 21:15:04.505545 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2583/5139] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:04.532801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fc257626-f501-48b6-814d-a37f51ed1007 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:04.549226 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fc257626-f501-48b6-814d-a37f51ed1007 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1396 microversion: 2.1 time: 0.564034 Mar 05 21:15:04.549947 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2557/5140] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:03 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1396 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:15:05.299223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c8bdc9ec-c3b2-494e-b595-aaebb6b929d0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:05.303817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c8bdc9ec-c3b2-494e-b595-aaebb6b929d0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:05.322759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8bdc9ec-c3b2-494e-b595-aaebb6b929d0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:05.323499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8bdc9ec-c3b2-494e-b595-aaebb6b929d0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:05.324444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8bdc9ec-c3b2-494e-b595-aaebb6b929d0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:05.327623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8bdc9ec-c3b2-494e-b595-aaebb6b929d0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:05.570266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-89015f2d-f62d-4308-afb1-c9c94c2b9d64 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:05.571778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-89015f2d-f62d-4308-afb1-c9c94c2b9d64 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:05.579846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89015f2d-f62d-4308-afb1-c9c94c2b9d64 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:05.584320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89015f2d-f62d-4308-afb1-c9c94c2b9d64 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:05.585497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89015f2d-f62d-4308-afb1-c9c94c2b9d64 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:05.586128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-89015f2d-f62d-4308-afb1-c9c94c2b9d64 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:05.670949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-89015f2d-f62d-4308-afb1-c9c94c2b9d64 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:05.680656 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-89015f2d-f62d-4308-afb1-c9c94c2b9d64 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 200 len: 1354 microversion: 2.1 time: 0.117848 Mar 05 21:15:05.681065 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2558/5141] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:05 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 1354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:05.696145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-86655124-2773-4fe2-8b1b-ba1e558a5d81 req-e0a0fda6-9986-48d3-86cb-1faf2ff1b852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a71f065-9364-461c-8d0d-017f9286b0fb", "name": "network-vif-deleted", "tag": "81efe88f-6b43-4bc3-93d8-d47bb3bc1e79"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:05.706257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-86655124-2773-4fe2-8b1b-ba1e558a5d81 req-e0a0fda6-9986-48d3-86cb-1faf2ff1b852 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:05.707259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-86655124-2773-4fe2-8b1b-ba1e558a5d81 req-e0a0fda6-9986-48d3-86cb-1faf2ff1b852 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:05.729043 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-86655124-2773-4fe2-8b1b-ba1e558a5d81 req-e0a0fda6-9986-48d3-86cb-1faf2ff1b852 service nova] Creating event network-vif-deleted:81efe88f-6b43-4bc3-93d8-d47bb3bc1e79 for instance 4a71f065-9364-461c-8d0d-017f9286b0fb on nch1-master-1 Mar 05 21:15:05.760788 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-86655124-2773-4fe2-8b1b-ba1e558a5d81 req-e0a0fda6-9986-48d3-86cb-1faf2ff1b852 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070504 Mar 05 21:15:05.761937 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2559/5142] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:05.897678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c8bdc9ec-c3b2-494e-b595-aaebb6b929d0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:05.916255 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c8bdc9ec-c3b2-494e-b595-aaebb6b929d0 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 200 len: 1367 microversion: 2.1 time: 0.626657 Mar 05 21:15:05.919132 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2584/5143] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:05 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 1367 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:06.697717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ab96ac13-7431-46f0-9ad0-47fdf706ebed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:06.698619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ab96ac13-7431-46f0-9ad0-47fdf706ebed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:06.711522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab96ac13-7431-46f0-9ad0-47fdf706ebed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:06.712344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab96ac13-7431-46f0-9ad0-47fdf706ebed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:06.712937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab96ac13-7431-46f0-9ad0-47fdf706ebed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:06.713636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab96ac13-7431-46f0-9ad0-47fdf706ebed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:06.732955 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-ab96ac13-7431-46f0-9ad0-47fdf706ebed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance 4a71f065-9364-461c-8d0d-017f9286b0fb could not be found. Mar 05 21:15:06.733563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ab96ac13-7431-46f0-9ad0-47fdf706ebed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance 4a71f065-9364-461c-8d0d-017f9286b0fb could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:15:06.734773 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ab96ac13-7431-46f0-9ad0-47fdf706ebed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 404 len: 111 microversion: 2.1 time: 0.041367 Mar 05 21:15:06.736132 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2560/5144] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:06 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:15:06.772100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6eb89857-ffe0-49d9-9621-fac5ec54ff8a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:06.773194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6eb89857-ffe0-49d9-9621-fac5ec54ff8a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:06.780462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6eb89857-ffe0-49d9-9621-fac5ec54ff8a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:06.780926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6eb89857-ffe0-49d9-9621-fac5ec54ff8a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:06.781949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6eb89857-ffe0-49d9-9621-fac5ec54ff8a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:06.782407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6eb89857-ffe0-49d9-9621-fac5ec54ff8a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:06.797582 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-6eb89857-ffe0-49d9-9621-fac5ec54ff8a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance 4a71f065-9364-461c-8d0d-017f9286b0fb could not be found. Mar 05 21:15:06.798083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6eb89857-ffe0-49d9-9621-fac5ec54ff8a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance 4a71f065-9364-461c-8d0d-017f9286b0fb could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:15:06.798939 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6eb89857-ffe0-49d9-9621-fac5ec54ff8a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 404 len: 111 microversion: 2.1 time: 0.032901 Mar 05 21:15:06.799524 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2585/5145] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:15:06 2022] DELETE /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:15:06.810071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7ef3bd6c-0e45-4a82-a242-7168f8f826e5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:06.810809 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7ef3bd6c-0e45-4a82-a242-7168f8f826e5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 4a71f065-9364-461c-8d0d-017f9286b0fb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:06.819574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ef3bd6c-0e45-4a82-a242-7168f8f826e5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:06.820431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ef3bd6c-0e45-4a82-a242-7168f8f826e5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:06.821733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ef3bd6c-0e45-4a82-a242-7168f8f826e5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:06.822251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ef3bd6c-0e45-4a82-a242-7168f8f826e5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:06.846025 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-7ef3bd6c-0e45-4a82-a242-7168f8f826e5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance 4a71f065-9364-461c-8d0d-017f9286b0fb could not be found. Mar 05 21:15:06.846647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7ef3bd6c-0e45-4a82-a242-7168f8f826e5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance 4a71f065-9364-461c-8d0d-017f9286b0fb could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:15:06.847511 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7ef3bd6c-0e45-4a82-a242-7168f8f826e5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb" status: 404 len: 111 microversion: 2.1 time: 0.042923 Mar 05 21:15:06.848129 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2561/5146] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:06 2022] GET /compute/v2.1/servers/4a71f065-9364-461c-8d0d-017f9286b0fb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:15:06.934284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-373930b4-8b4d-478e-8ddd-fecf88339de7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:06.935001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-373930b4-8b4d-478e-8ddd-fecf88339de7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:06.941155 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-373930b4-8b4d-478e-8ddd-fecf88339de7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:06.941695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-373930b4-8b4d-478e-8ddd-fecf88339de7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:06.942616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-373930b4-8b4d-478e-8ddd-fecf88339de7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:06.943152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-373930b4-8b4d-478e-8ddd-fecf88339de7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:07.148288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-373930b4-8b4d-478e-8ddd-fecf88339de7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:07.162870 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-373930b4-8b4d-478e-8ddd-fecf88339de7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 200 len: 1367 microversion: 2.1 time: 0.232660 Mar 05 21:15:07.164132 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2586/5147] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:06 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:08.180653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ea7d4b22-3c84-45fa-b269-6d2e4944f33a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:08.183989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ea7d4b22-3c84-45fa-b269-6d2e4944f33a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:08.198311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ea7d4b22-3c84-45fa-b269-6d2e4944f33a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:08.199182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ea7d4b22-3c84-45fa-b269-6d2e4944f33a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:08.201146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ea7d4b22-3c84-45fa-b269-6d2e4944f33a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:08.201601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ea7d4b22-3c84-45fa-b269-6d2e4944f33a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:08.482203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ea7d4b22-3c84-45fa-b269-6d2e4944f33a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:08.490253 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ea7d4b22-3c84-45fa-b269-6d2e4944f33a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 200 len: 1367 microversion: 2.1 time: 0.313829 Mar 05 21:15:08.490858 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2562/5148] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:08 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:09.358885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-0bf9f9f3-570f-41da-91c7-186b0549af12 req-3cd62319-a7ef-4062-8303-7fcefe0ea7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "792eb61e-229f-4cb7-a709-179922039250", "name": "network-vif-plugged", "status": "completed", "tag": "68a3695d-1e5b-431b-9bfd-992a7e3c692f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:09.369856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0bf9f9f3-570f-41da-91c7-186b0549af12 req-3cd62319-a7ef-4062-8303-7fcefe0ea7e4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:09.370507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0bf9f9f3-570f-41da-91c7-186b0549af12 req-3cd62319-a7ef-4062-8303-7fcefe0ea7e4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:09.400926 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0bf9f9f3-570f-41da-91c7-186b0549af12 req-3cd62319-a7ef-4062-8303-7fcefe0ea7e4 service nova] Creating event network-vif-plugged:68a3695d-1e5b-431b-9bfd-992a7e3c692f for instance 792eb61e-229f-4cb7-a709-179922039250 on nch2-master-1 Mar 05 21:15:09.415315 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-0bf9f9f3-570f-41da-91c7-186b0549af12 req-3cd62319-a7ef-4062-8303-7fcefe0ea7e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061819 Mar 05 21:15:09.416169 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2587/5149] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:15:09.509131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4ba4e1ae-7760-4361-b0e9-41bce0d70c37 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:09.509911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4ba4e1ae-7760-4361-b0e9-41bce0d70c37 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:09.519359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ba4e1ae-7760-4361-b0e9-41bce0d70c37 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:09.520385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ba4e1ae-7760-4361-b0e9-41bce0d70c37 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:09.521427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ba4e1ae-7760-4361-b0e9-41bce0d70c37 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:09.522287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ba4e1ae-7760-4361-b0e9-41bce0d70c37 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:09.743694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4ba4e1ae-7760-4361-b0e9-41bce0d70c37 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:09.754524 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4ba4e1ae-7760-4361-b0e9-41bce0d70c37 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 200 len: 1367 microversion: 2.1 time: 0.248133 Mar 05 21:15:09.755425 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2563/5150] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:09 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:15:10.339606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6f9db4a7-6d14-4416-80b9-3b350fe01f3e tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:10.340221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6f9db4a7-6d14-4416-80b9-3b350fe01f3e tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:10.346792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f9db4a7-6d14-4416-80b9-3b350fe01f3e tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:10.347458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f9db4a7-6d14-4416-80b9-3b350fe01f3e tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:10.349076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f9db4a7-6d14-4416-80b9-3b350fe01f3e tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:10.349711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6f9db4a7-6d14-4416-80b9-3b350fe01f3e tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:10.434163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-6f9db4a7-6d14-4416-80b9-3b350fe01f3e tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lazy-loading 'services' on Instance uuid 0289f80e-1b60-4efd-a464-5aeec336dc25 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:15:10.530579 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6f9db4a7-6d14-4416-80b9-3b350fe01f3e tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25/os-volume_attachments/2de60bd3-fd9c-4cf2-a463-7d2086df54a0" status: 202 len: 0 microversion: 2.1 time: 0.195089 Mar 05 21:15:10.531238 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2588/5151] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 21:15:10 2022] DELETE /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25/os-volume_attachments/2de60bd3-fd9c-4cf2-a463-7d2086df54a0 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:15:10.771962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e5747b4b-4b85-491c-ae25-67c5dbac25c5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:10.773328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e5747b4b-4b85-491c-ae25-67c5dbac25c5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:10.780790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5747b4b-4b85-491c-ae25-67c5dbac25c5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:10.781244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5747b4b-4b85-491c-ae25-67c5dbac25c5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:10.782069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5747b4b-4b85-491c-ae25-67c5dbac25c5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:10.782505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5747b4b-4b85-491c-ae25-67c5dbac25c5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:11.082406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e5747b4b-4b85-491c-ae25-67c5dbac25c5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:11.099906 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e5747b4b-4b85-491c-ae25-67c5dbac25c5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 200 len: 1367 microversion: 2.1 time: 0.331304 Mar 05 21:15:11.100688 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2564/5152] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:10 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:11.670627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e28db75f-256c-4b40-9d7d-fec1e331130a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:11.671227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e28db75f-256c-4b40-9d7d-fec1e331130a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:11.678368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e28db75f-256c-4b40-9d7d-fec1e331130a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:11.678827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e28db75f-256c-4b40-9d7d-fec1e331130a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:11.679615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e28db75f-256c-4b40-9d7d-fec1e331130a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:11.680081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e28db75f-256c-4b40-9d7d-fec1e331130a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:11.714163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e28db75f-256c-4b40-9d7d-fec1e331130a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:15:11.842048 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e28db75f-256c-4b40-9d7d-fec1e331130a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 204 len: 0 microversion: 2.1 time: 0.176516 Mar 05 21:15:11.845951 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2589/5153] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:15:11 2022] DELETE /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:15:11.852482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-84220113-977e-4720-896c-abd7678b2ae2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:11.853439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-84220113-977e-4720-896c-abd7678b2ae2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:11.860781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84220113-977e-4720-896c-abd7678b2ae2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:11.862921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84220113-977e-4720-896c-abd7678b2ae2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:11.865787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84220113-977e-4720-896c-abd7678b2ae2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:11.870261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84220113-977e-4720-896c-abd7678b2ae2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:12.033928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-84220113-977e-4720-896c-abd7678b2ae2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82efe872057495292d8e41f987c48a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc2945ca7204c80907515ca0c271337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:12.043012 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-84220113-977e-4720-896c-abd7678b2ae2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 200 len: 1469 microversion: 2.1 time: 0.195743 Mar 05 21:15:12.043959 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2565/5154] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:11 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 1469 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:15:12.117857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2c652290-fe27-496c-a554-1ea775e3a451 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:12.118820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2c652290-fe27-496c-a554-1ea775e3a451 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:12.126757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c652290-fe27-496c-a554-1ea775e3a451 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:12.127240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c652290-fe27-496c-a554-1ea775e3a451 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:12.128145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c652290-fe27-496c-a554-1ea775e3a451 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:12.129770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c652290-fe27-496c-a554-1ea775e3a451 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:12.204172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-810499012", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bfb78306-e19f-4d73-9333-7d277b32418e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "82b49213-810d-43f2-9dca-5a622352a45d"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:12.271278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] validate_networks() for [('82b49213-810d-43f2-9dca-5a622352a45d', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:15:12.376895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2c652290-fe27-496c-a554-1ea775e3a451 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:12.385781 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2c652290-fe27-496c-a554-1ea775e3a451 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 200 len: 1557 microversion: 2.1 time: 0.272332 Mar 05 21:15:12.386698 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2590/5155] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:12 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 1557 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:12.402839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0e76a1e3-2f23-4678-bcf8-a14ca1826cbc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:12.403352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0e76a1e3-2f23-4678-bcf8-a14ca1826cbc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:12.409412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e76a1e3-2f23-4678-bcf8-a14ca1826cbc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:12.409875 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e76a1e3-2f23-4678-bcf8-a14ca1826cbc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:12.410659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e76a1e3-2f23-4678-bcf8-a14ca1826cbc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:12.411908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e76a1e3-2f23-4678-bcf8-a14ca1826cbc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:12.560956 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0e76a1e3-2f23-4678-bcf8-a14ca1826cbc tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162117 Mar 05 21:15:12.571149 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2591/5156] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 21:15:12 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:15:12.898242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:15:12.899810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:15:12.900572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:15:12.901268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:15:12.901989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:15:12.920250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:12.920809 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:12.921821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:12.922540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:12.948877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for project cdcb29011e61419981c5bfc5f10677c5. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:15:12.957013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for user 0c07bd2946594c3e8848bca133da0d90 and project cdcb29011e61419981c5bfc5f10677c5. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:15:13.056311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:15:13.058940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bfb78306-e19f-4d73-9333-7d277b32418e',volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:15:13.062655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5e0b272a-e502-4951-ac24-a7294a428f10 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:13.063892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5e0b272a-e502-4951-ac24-a7294a428f10 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:13.072795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e0b272a-e502-4951-ac24-a7294a428f10 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:13.073466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e0b272a-e502-4951-ac24-a7294a428f10 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:13.074449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e0b272a-e502-4951-ac24-a7294a428f10 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:13.075060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e0b272a-e502-4951-ac24-a7294a428f10 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:13.257005 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3a6b3e05-4637-4235-8d63-070ec6cbe7f5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.058212 Mar 05 21:15:13.258013 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2566/5157] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:15:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 21:15:13.274472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-78bf26d3-aaf0-489d-902b-2ec45cec8125 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:13.276186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-78bf26d3-aaf0-489d-902b-2ec45cec8125 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:13.527138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5e0b272a-e502-4951-ac24-a7294a428f10 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82efe872057495292d8e41f987c48a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc2945ca7204c80907515ca0c271337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:13.533087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-78bf26d3-aaf0-489d-902b-2ec45cec8125 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:13.548371 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-78bf26d3-aaf0-489d-902b-2ec45cec8125 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1070 microversion: 2.1 time: 0.280094 Mar 05 21:15:13.551925 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2567/5158] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:13 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1070 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:15:13.553411 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5e0b272a-e502-4951-ac24-a7294a428f10 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 200 len: 1469 microversion: 2.1 time: 0.495295 Mar 05 21:15:13.554222 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2592/5159] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:13 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 1469 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:13.996421 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b88fcbfc-60aa-4077-86ae-3ba44379f715 req-71c3789f-0ab4-4127-bee1-e732e6595c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "792eb61e-229f-4cb7-a709-179922039250", "tag": "68a3695d-1e5b-431b-9bfd-992a7e3c692f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:14.006884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b88fcbfc-60aa-4077-86ae-3ba44379f715 req-71c3789f-0ab4-4127-bee1-e732e6595c5e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:14.007922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b88fcbfc-60aa-4077-86ae-3ba44379f715 req-71c3789f-0ab4-4127-bee1-e732e6595c5e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:14.022219 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-b88fcbfc-60aa-4077-86ae-3ba44379f715 req-71c3789f-0ab4-4127-bee1-e732e6595c5e service nova] Creating event network-changed:68a3695d-1e5b-431b-9bfd-992a7e3c692f for instance 792eb61e-229f-4cb7-a709-179922039250 on nch2-master-1 Mar 05 21:15:14.033317 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b88fcbfc-60aa-4077-86ae-3ba44379f715 req-71c3789f-0ab4-4127-bee1-e732e6595c5e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040559 Mar 05 21:15:14.035348 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2568/5160] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:14.531914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-4196e850-50be-492d-8bd2-133a3efdd947 req-ece34a8d-4873-4897-a3a6-a2323e56fa10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0289f80e-1b60-4efd-a464-5aeec336dc25", "name": "network-vif-deleted", "tag": "6ff52e50-b035-4ee4-b9dc-f2f404617341"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:14.551831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4196e850-50be-492d-8bd2-133a3efdd947 req-ece34a8d-4873-4897-a3a6-a2323e56fa10 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:14.552456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4196e850-50be-492d-8bd2-133a3efdd947 req-ece34a8d-4873-4897-a3a6-a2323e56fa10 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:14.569553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6eaadcd-c07c-4d3d-ac36-f9e236df2cd2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:14.570267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c6eaadcd-c07c-4d3d-ac36-f9e236df2cd2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:14.574791 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-4196e850-50be-492d-8bd2-133a3efdd947 req-ece34a8d-4873-4897-a3a6-a2323e56fa10 service nova] Creating event network-vif-deleted:6ff52e50-b035-4ee4-b9dc-f2f404617341 for instance 0289f80e-1b60-4efd-a464-5aeec336dc25 on nch2-master-1 Mar 05 21:15:14.581270 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-4196e850-50be-492d-8bd2-133a3efdd947 req-ece34a8d-4873-4897-a3a6-a2323e56fa10 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060339 Mar 05 21:15:14.582471 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2593/5161] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:15:14.589898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6eaadcd-c07c-4d3d-ac36-f9e236df2cd2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:14.590446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6eaadcd-c07c-4d3d-ac36-f9e236df2cd2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:14.591054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c530f21d-8b05-46ff-a611-6912f9e625a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:14.591277 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6eaadcd-c07c-4d3d-ac36-f9e236df2cd2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:14.591747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6eaadcd-c07c-4d3d-ac36-f9e236df2cd2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:14.592630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c530f21d-8b05-46ff-a611-6912f9e625a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:14.599926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c530f21d-8b05-46ff-a611-6912f9e625a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:14.600638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c530f21d-8b05-46ff-a611-6912f9e625a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:14.601650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c530f21d-8b05-46ff-a611-6912f9e625a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:14.602269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c530f21d-8b05-46ff-a611-6912f9e625a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:14.702757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c530f21d-8b05-46ff-a611-6912f9e625a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82efe872057495292d8e41f987c48a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc2945ca7204c80907515ca0c271337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:14.711816 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c530f21d-8b05-46ff-a611-6912f9e625a2 tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 200 len: 1427 microversion: 2.1 time: 0.127032 Mar 05 21:15:14.712933 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2594/5162] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:14 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:14.797745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c6eaadcd-c07c-4d3d-ac36-f9e236df2cd2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:14.806893 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c6eaadcd-c07c-4d3d-ac36-f9e236df2cd2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1168 microversion: 2.1 time: 0.242044 Mar 05 21:15:14.807511 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2569/5163] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:14 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1168 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:15.729642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0c3a9f7-66c8-4198-b7e7-879fd102614a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:15.730414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a0c3a9f7-66c8-4198-b7e7-879fd102614a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] [instance: 0289f80e-1b60-4efd-a464-5aeec336dc25] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:15.742913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0c3a9f7-66c8-4198-b7e7-879fd102614a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:15.743695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0c3a9f7-66c8-4198-b7e7-879fd102614a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:15.745480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0c3a9f7-66c8-4198-b7e7-879fd102614a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:15.746173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0c3a9f7-66c8-4198-b7e7-879fd102614a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:15.800950 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-a0c3a9f7-66c8-4198-b7e7-879fd102614a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] HTTP exception thrown: Instance 0289f80e-1b60-4efd-a464-5aeec336dc25 could not be found. Mar 05 21:15:15.803268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0c3a9f7-66c8-4198-b7e7-879fd102614a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] Returning 404 to user: Instance 0289f80e-1b60-4efd-a464-5aeec336dc25 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:15:15.804387 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0c3a9f7-66c8-4198-b7e7-879fd102614a tempest-VolumesBackupsTest-1617152067 tempest-VolumesBackupsTest-1617152067-project] 10.222.0.15 "GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25" status: 404 len: 111 microversion: 2.1 time: 0.078851 Mar 05 21:15:15.805478 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2595/5164] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:15 2022] GET /compute/v2.1/servers/0289f80e-1b60-4efd-a464-5aeec336dc25 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:15:15.829080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8779999d-5c4f-4295-a240-ed7b9fbdac2c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:15.830469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8779999d-5c4f-4295-a240-ed7b9fbdac2c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:15.843196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8779999d-5c4f-4295-a240-ed7b9fbdac2c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:15.849633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8779999d-5c4f-4295-a240-ed7b9fbdac2c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:15.850592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8779999d-5c4f-4295-a240-ed7b9fbdac2c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:15.853767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8779999d-5c4f-4295-a240-ed7b9fbdac2c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:16.397252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8779999d-5c4f-4295-a240-ed7b9fbdac2c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:16.405595 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8779999d-5c4f-4295-a240-ed7b9fbdac2c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1228 microversion: 2.1 time: 0.585035 Mar 05 21:15:16.406507 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2570/5165] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:15 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1228 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:17.423983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-79700d3c-b819-409d-93f2-f52c940ff207 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:17.424867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-79700d3c-b819-409d-93f2-f52c940ff207 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:17.440474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-79700d3c-b819-409d-93f2-f52c940ff207 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:17.440888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-79700d3c-b819-409d-93f2-f52c940ff207 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:17.442089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-79700d3c-b819-409d-93f2-f52c940ff207 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:17.442857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-79700d3c-b819-409d-93f2-f52c940ff207 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:17.536373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-c68b5836-c5dc-4018-a5ed-0abbc4da13fa req-40545437-93f2-4d38-b7da-27735aab57c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b376f64c-c544-44c9-ba8f-a87b086d4183", "tag": "a2f5025e-fc06-4c7b-b8d0-9d503e54b32c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:17.546808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c68b5836-c5dc-4018-a5ed-0abbc4da13fa req-40545437-93f2-4d38-b7da-27735aab57c7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:17.547503 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c68b5836-c5dc-4018-a5ed-0abbc4da13fa req-40545437-93f2-4d38-b7da-27735aab57c7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:17.566242 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-c68b5836-c5dc-4018-a5ed-0abbc4da13fa req-40545437-93f2-4d38-b7da-27735aab57c7 service nova] Creating event network-changed:a2f5025e-fc06-4c7b-b8d0-9d503e54b32c for instance b376f64c-c544-44c9-ba8f-a87b086d4183 on nch1-master-1 Mar 05 21:15:17.571433 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-c68b5836-c5dc-4018-a5ed-0abbc4da13fa req-40545437-93f2-4d38-b7da-27735aab57c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038750 Mar 05 21:15:17.576188 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2571/5166] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:17.746100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-79700d3c-b819-409d-93f2-f52c940ff207 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:17.759567 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-79700d3c-b819-409d-93f2-f52c940ff207 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1228 microversion: 2.1 time: 0.340845 Mar 05 21:15:17.764045 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2596/5167] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:17 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1228 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:18.779833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-65727e30-766e-45b3-914a-969155c94ea8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:18.781705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-65727e30-766e-45b3-914a-969155c94ea8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:18.794215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65727e30-766e-45b3-914a-969155c94ea8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:18.795017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65727e30-766e-45b3-914a-969155c94ea8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:18.796436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65727e30-766e-45b3-914a-969155c94ea8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:18.797214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65727e30-766e-45b3-914a-969155c94ea8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:18.978995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-65727e30-766e-45b3-914a-969155c94ea8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:18.986400 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-65727e30-766e-45b3-914a-969155c94ea8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1216 microversion: 2.1 time: 0.212702 Mar 05 21:15:18.986989 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2572/5168] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:18 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1216 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:20.004735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1f534c87-b017-4220-9bca-376e1393dbe3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:20.005613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1f534c87-b017-4220-9bca-376e1393dbe3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:20.012852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f534c87-b017-4220-9bca-376e1393dbe3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:20.013314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f534c87-b017-4220-9bca-376e1393dbe3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:20.014107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f534c87-b017-4220-9bca-376e1393dbe3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:20.014566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1f534c87-b017-4220-9bca-376e1393dbe3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:20.198955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1f534c87-b017-4220-9bca-376e1393dbe3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:20.207393 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1f534c87-b017-4220-9bca-376e1393dbe3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1216 microversion: 2.1 time: 0.206951 Mar 05 21:15:20.215796 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2597/5169] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:19 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1216 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:21.226148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-85d9c654-2532-4645-b9ac-4e109e0a1371 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:21.226763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-85d9c654-2532-4645-b9ac-4e109e0a1371 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:21.235728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85d9c654-2532-4645-b9ac-4e109e0a1371 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:21.236434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85d9c654-2532-4645-b9ac-4e109e0a1371 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:21.237311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85d9c654-2532-4645-b9ac-4e109e0a1371 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:21.237735 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-85d9c654-2532-4645-b9ac-4e109e0a1371 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:21.393787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-85d9c654-2532-4645-b9ac-4e109e0a1371 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:21.402493 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-85d9c654-2532-4645-b9ac-4e109e0a1371 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1216 microversion: 2.1 time: 0.181169 Mar 05 21:15:21.403078 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2573/5170] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:21 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:22.420360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6c597cf4-9eb9-45b3-a8a3-98d41e444f04 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:22.420977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6c597cf4-9eb9-45b3-a8a3-98d41e444f04 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:22.431562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c597cf4-9eb9-45b3-a8a3-98d41e444f04 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:22.432200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c597cf4-9eb9-45b3-a8a3-98d41e444f04 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:22.432889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c597cf4-9eb9-45b3-a8a3-98d41e444f04 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:22.433634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c597cf4-9eb9-45b3-a8a3-98d41e444f04 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:22.597773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6c597cf4-9eb9-45b3-a8a3-98d41e444f04 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:22.608421 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6c597cf4-9eb9-45b3-a8a3-98d41e444f04 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1216 microversion: 2.1 time: 0.191969 Mar 05 21:15:22.609819 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2598/5171] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:22 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:23.628717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-849c701e-1fc5-4c59-a4af-1ce2e3175e61 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:23.629553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-849c701e-1fc5-4c59-a4af-1ce2e3175e61 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:23.638931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-849c701e-1fc5-4c59-a4af-1ce2e3175e61 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:23.639796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-849c701e-1fc5-4c59-a4af-1ce2e3175e61 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:23.640916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-849c701e-1fc5-4c59-a4af-1ce2e3175e61 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:23.641765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-849c701e-1fc5-4c59-a4af-1ce2e3175e61 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:23.847594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-849c701e-1fc5-4c59-a4af-1ce2e3175e61 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:23.856788 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-849c701e-1fc5-4c59-a4af-1ce2e3175e61 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1216 microversion: 2.1 time: 0.231893 Mar 05 21:15:23.858079 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2574/5172] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:23 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1216 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:24.877507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-34bb9e5f-2d23-4227-89f8-34d03d31d1fa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:24.878560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-34bb9e5f-2d23-4227-89f8-34d03d31d1fa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:24.898136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34bb9e5f-2d23-4227-89f8-34d03d31d1fa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:24.898943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34bb9e5f-2d23-4227-89f8-34d03d31d1fa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:24.914076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34bb9e5f-2d23-4227-89f8-34d03d31d1fa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:24.914886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-34bb9e5f-2d23-4227-89f8-34d03d31d1fa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:25.119298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-34bb9e5f-2d23-4227-89f8-34d03d31d1fa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:25.131712 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-34bb9e5f-2d23-4227-89f8-34d03d31d1fa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1216 microversion: 2.1 time: 0.259591 Mar 05 21:15:25.141669 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2599/5173] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:24 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1216 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:25.671903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8c715162-1c16-47df-b498-18aa89416173 req-5d912cf1-d05a-41bc-b5e6-a3d9d6d0001b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b376f64c-c544-44c9-ba8f-a87b086d4183", "name": "network-vif-plugged", "status": "completed", "tag": "a2f5025e-fc06-4c7b-b8d0-9d503e54b32c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:25.681036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8c715162-1c16-47df-b498-18aa89416173 req-5d912cf1-d05a-41bc-b5e6-a3d9d6d0001b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:25.681521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8c715162-1c16-47df-b498-18aa89416173 req-5d912cf1-d05a-41bc-b5e6-a3d9d6d0001b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:25.702210 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8c715162-1c16-47df-b498-18aa89416173 req-5d912cf1-d05a-41bc-b5e6-a3d9d6d0001b service nova] Creating event network-vif-plugged:a2f5025e-fc06-4c7b-b8d0-9d503e54b32c for instance b376f64c-c544-44c9-ba8f-a87b086d4183 on nch1-master-1 Mar 05 21:15:25.708619 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-8c715162-1c16-47df-b498-18aa89416173 req-5d912cf1-d05a-41bc-b5e6-a3d9d6d0001b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039719 Mar 05 21:15:25.709243 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2575/5174] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:26.150275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3a5c4946-f11e-4592-ac3b-fea592bb3525 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:26.150926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3a5c4946-f11e-4592-ac3b-fea592bb3525 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:26.157791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a5c4946-f11e-4592-ac3b-fea592bb3525 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:26.158254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a5c4946-f11e-4592-ac3b-fea592bb3525 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:26.159034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a5c4946-f11e-4592-ac3b-fea592bb3525 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:26.159481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3a5c4946-f11e-4592-ac3b-fea592bb3525 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:26.345295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3a5c4946-f11e-4592-ac3b-fea592bb3525 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:26.357982 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3a5c4946-f11e-4592-ac3b-fea592bb3525 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1216 microversion: 2.1 time: 0.212117 Mar 05 21:15:26.358612 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2600/5175] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:26 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1216 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:27.375704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd51cc20-57df-4312-b370-7a136b508024 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:27.376451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd51cc20-57df-4312-b370-7a136b508024 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:27.383798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd51cc20-57df-4312-b370-7a136b508024 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:27.384263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd51cc20-57df-4312-b370-7a136b508024 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:27.385106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd51cc20-57df-4312-b370-7a136b508024 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:27.385539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd51cc20-57df-4312-b370-7a136b508024 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:27.542751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd51cc20-57df-4312-b370-7a136b508024 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:27.557566 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd51cc20-57df-4312-b370-7a136b508024 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1402 microversion: 2.1 time: 0.186809 Mar 05 21:15:27.558183 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2576/5176] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:27 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1402 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:27.575568 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-edf179a8-0dba-4c94-9625-5e47277c4ad3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:27.576233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-edf179a8-0dba-4c94-9625-5e47277c4ad3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:27.585382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-edf179a8-0dba-4c94-9625-5e47277c4ad3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:27.586206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-edf179a8-0dba-4c94-9625-5e47277c4ad3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:27.587489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-edf179a8-0dba-4c94-9625-5e47277c4ad3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:27.588070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-edf179a8-0dba-4c94-9625-5e47277c4ad3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:27.714170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1fb034b9-d9c1-4f0c-97d8-77f73b42f1bc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:27.714851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1fb034b9-d9c1-4f0c-97d8-77f73b42f1bc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:27.721767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1fb034b9-d9c1-4f0c-97d8-77f73b42f1bc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:27.722171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1fb034b9-d9c1-4f0c-97d8-77f73b42f1bc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:27.724526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1fb034b9-d9c1-4f0c-97d8-77f73b42f1bc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:27.724986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1fb034b9-d9c1-4f0c-97d8-77f73b42f1bc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:27.752026 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1fb034b9-d9c1-4f0c-97d8-77f73b42f1bc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/ips" status: 200 len: 151 microversion: 2.20 time: 0.042548 Mar 05 21:15:27.753078 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2577/5177] 10.222.0.15 () {60 vars in 1288 bytes} [Sat Mar 5 21:15:27 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:15:27.754523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-edf179a8-0dba-4c94-9625-5e47277c4ad3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:27.765756 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-edf179a8-0dba-4c94-9625-5e47277c4ad3 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1402 microversion: 2.1 time: 0.193179 Mar 05 21:15:27.767755 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2601/5178] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:27 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1402 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:27.786599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3e48dc46-2b1c-40e9-b975-be0adf56f360 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1023782788"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:27.787638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3e48dc46-2b1c-40e9-b975-be0adf56f360 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:27.797622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e48dc46-2b1c-40e9-b975-be0adf56f360 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:27.798273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e48dc46-2b1c-40e9-b975-be0adf56f360 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:27.799575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e48dc46-2b1c-40e9-b975-be0adf56f360 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:27.800070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e48dc46-2b1c-40e9-b975-be0adf56f360 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:27.909424 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.compute.api [None req-3e48dc46-2b1c-40e9-b975-be0adf56f360 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Attempting to quiesce instance before volume snapshot. Mar 05 21:15:27.985803 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.compute.api [None req-3e48dc46-2b1c-40e9-b975-be0adf56f360 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Mar 05 21:15:28.102298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3e48dc46-2b1c-40e9-b975-be0adf56f360 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Creating snapshot from volume bfb78306-e19f-4d73-9333-7d277b32418e. {{(pid=141478) snapshot_instance /opt/stack/nova/nova/compute/api.py:3452}} Mar 05 21:15:29.103782 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3e48dc46-2b1c-40e9-b975-be0adf56f360 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "POST /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183/action" status: 202 len: 0 microversion: 2.1 time: 1.322348 Mar 05 21:15:29.104535 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2578/5179] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:15:27 2022] POST /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183/action => generated 0 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 21:15:29.289557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-864280100", "imageRef": "869fd24a-602e-4df8-9575-2507d7bab552", "flavorRef": "452", "networks": [{"uuid": "82b49213-810d-43f2-9dca-5a622352a45d"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:29.345952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] validate_networks() for [('82b49213-810d-43f2-9dca-5a622352a45d', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:15:29.851020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:15:29.851521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:15:29.852230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:15:29.852908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:15:29.853593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:15:29.864245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:29.864801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:29.865698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:29.866211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:29.891627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for project cdcb29011e61419981c5bfc5f10677c5. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:15:29.898337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for user 0c07bd2946594c3e8848bca133da0d90 and project cdcb29011e61419981c5bfc5f10677c5. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:15:29.912666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:15:29.915211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='aa3b08df-4433-4b4f-ad93-0796031774bf',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:15:30.022798 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-365eb6a1-1ce5-4f71-88b4-6a792bacbffd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738086 Mar 05 21:15:30.023774 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2602/5180] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:15:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:15:30.033981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c769f6ba-209e-4855-8a74-f09a72a7ab96 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:30.034965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c769f6ba-209e-4855-8a74-f09a72a7ab96 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:30.093695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c769f6ba-209e-4855-8a74-f09a72a7ab96 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:30.101291 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c769f6ba-209e-4855-8a74-f09a72a7ab96 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1229 microversion: 2.1 time: 0.071356 Mar 05 21:15:30.110711 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2579/5181] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:30 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1229 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:30.353878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-73b34414-31d3-4020-bd9f-9c95373883a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:30.354492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-73b34414-31d3-4020-bd9f-9c95373883a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:30.362286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-73b34414-31d3-4020-bd9f-9c95373883a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:30.363152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-73b34414-31d3-4020-bd9f-9c95373883a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:30.364413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-73b34414-31d3-4020-bd9f-9c95373883a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:30.365233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-73b34414-31d3-4020-bd9f-9c95373883a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:30.398295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-73b34414-31d3-4020-bd9f-9c95373883a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lazy-loading 'flavor' on Instance uuid 51aeb9d2-5c35-4841-bcb2-7162b1f8752a {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:15:30.731961 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-73b34414-31d3-4020-bd9f-9c95373883a3 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "POST /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/action" status: 202 len: 0 microversion: 2.20 time: 0.382457 Mar 05 21:15:30.735952 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2603/5182] 10.222.0.15 () {62 vars in 1318 bytes} [Sat Mar 5 21:15:30 2022] POST /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:15:30.741536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6a99fea4-b016-4937-bfac-80b67778d1f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:30.742166 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6a99fea4-b016-4937-bfac-80b67778d1f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:30.750120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6a99fea4-b016-4937-bfac-80b67778d1f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:30.750584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6a99fea4-b016-4937-bfac-80b67778d1f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:30.751410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6a99fea4-b016-4937-bfac-80b67778d1f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:30.751895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6a99fea4-b016-4937-bfac-80b67778d1f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:30.922350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6a99fea4-b016-4937-bfac-80b67778d1f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:30.932779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6a99fea4-b016-4937-bfac-80b67778d1f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:30.934685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6a99fea4-b016-4937-bfac-80b67778d1f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:30.936294 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6a99fea4-b016-4937-bfac-80b67778d1f2 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1720 microversion: 2.20 time: 0.199330 Mar 05 21:15:30.937429 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2580/5183] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:30 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1720 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:15:31.119996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-01963c29-5d15-4f28-b818-dcc11ebf0c0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:31.120775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-01963c29-5d15-4f28-b818-dcc11ebf0c0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:31.132946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01963c29-5d15-4f28-b818-dcc11ebf0c0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:31.136163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01963c29-5d15-4f28-b818-dcc11ebf0c0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:31.137851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01963c29-5d15-4f28-b818-dcc11ebf0c0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:31.138425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01963c29-5d15-4f28-b818-dcc11ebf0c0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:31.312656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-01963c29-5d15-4f28-b818-dcc11ebf0c0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:31.322716 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-01963c29-5d15-4f28-b818-dcc11ebf0c0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1289 microversion: 2.1 time: 0.208236 Mar 05 21:15:31.323524 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2604/5184] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:31 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1289 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:31.968219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c27d72a3-cd4c-4325-98be-ef8a0459ce2a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:31.969329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c27d72a3-cd4c-4325-98be-ef8a0459ce2a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:31.984904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c27d72a3-cd4c-4325-98be-ef8a0459ce2a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:31.985942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c27d72a3-cd4c-4325-98be-ef8a0459ce2a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:31.986856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c27d72a3-cd4c-4325-98be-ef8a0459ce2a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:31.987849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c27d72a3-cd4c-4325-98be-ef8a0459ce2a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:32.292466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c27d72a3-cd4c-4325-98be-ef8a0459ce2a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:32.314686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c27d72a3-cd4c-4325-98be-ef8a0459ce2a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:32.318173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c27d72a3-cd4c-4325-98be-ef8a0459ce2a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:32.319730 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c27d72a3-cd4c-4325-98be-ef8a0459ce2a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1720 microversion: 2.20 time: 0.367294 Mar 05 21:15:32.320831 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2581/5185] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:31 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1720 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:32.353202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1966c13e-7319-4a06-bf17-4aa52ce782cf tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:32.353963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1966c13e-7319-4a06-bf17-4aa52ce782cf tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:32.369127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1966c13e-7319-4a06-bf17-4aa52ce782cf tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:32.373385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1966c13e-7319-4a06-bf17-4aa52ce782cf tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:32.377041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1966c13e-7319-4a06-bf17-4aa52ce782cf tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:32.382403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1966c13e-7319-4a06-bf17-4aa52ce782cf tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:32.719378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1966c13e-7319-4a06-bf17-4aa52ce782cf tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:32.736263 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1966c13e-7319-4a06-bf17-4aa52ce782cf tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1341 microversion: 2.1 time: 0.396724 Mar 05 21:15:32.736843 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2605/5186] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:32 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1341 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:33.343967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3914462b-96c6-490d-8039-057d09c5dec8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:33.360936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3914462b-96c6-490d-8039-057d09c5dec8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:33.381536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3914462b-96c6-490d-8039-057d09c5dec8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:33.382327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3914462b-96c6-490d-8039-057d09c5dec8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:33.383427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3914462b-96c6-490d-8039-057d09c5dec8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:33.384182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3914462b-96c6-490d-8039-057d09c5dec8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:33.736082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3914462b-96c6-490d-8039-057d09c5dec8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:33.748069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3914462b-96c6-490d-8039-057d09c5dec8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:33.756181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7207d6a1-4afe-4666-a549-cf357e4135db tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:33.758571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7207d6a1-4afe-4666-a549-cf357e4135db tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:33.765031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3914462b-96c6-490d-8039-057d09c5dec8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:33.774998 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3914462b-96c6-490d-8039-057d09c5dec8 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1720 microversion: 2.20 time: 0.432891 Mar 05 21:15:33.776549 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2582/5187] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:33 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1720 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:33.778812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7207d6a1-4afe-4666-a549-cf357e4135db tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:33.779249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7207d6a1-4afe-4666-a549-cf357e4135db tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:33.780450 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7207d6a1-4afe-4666-a549-cf357e4135db tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:33.781079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7207d6a1-4afe-4666-a549-cf357e4135db tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:34.293804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7207d6a1-4afe-4666-a549-cf357e4135db tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:34.305946 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7207d6a1-4afe-4666-a549-cf357e4135db tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1341 microversion: 2.1 time: 0.554808 Mar 05 21:15:34.306857 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2606/5188] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:33 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1341 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:15:34.758484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-bbf0783b-635d-458b-88d3-4e34e94ac892 req-7ffd84d7-7ef5-4780-94d1-baeab6cd4cca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91c07ccc-b0d2-4cea-81b3-bbd995a7ece9", "tag": "37fe9d6d-c19c-46d3-8d3f-9f5248dd1889"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:34.772430 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-bbf0783b-635d-458b-88d3-4e34e94ac892 req-7ffd84d7-7ef5-4780-94d1-baeab6cd4cca service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:34.773208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-bbf0783b-635d-458b-88d3-4e34e94ac892 req-7ffd84d7-7ef5-4780-94d1-baeab6cd4cca service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:34.797681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ddaef705-a7f9-436c-a3a0-39eb37a504cb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:34.800097 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ddaef705-a7f9-436c-a3a0-39eb37a504cb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:34.804129 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-bbf0783b-635d-458b-88d3-4e34e94ac892 req-7ffd84d7-7ef5-4780-94d1-baeab6cd4cca service nova] Creating event network-changed:37fe9d6d-c19c-46d3-8d3f-9f5248dd1889 for instance 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 on nch2-master-1 Mar 05 21:15:34.808308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ddaef705-a7f9-436c-a3a0-39eb37a504cb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:34.809417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ddaef705-a7f9-436c-a3a0-39eb37a504cb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:34.810612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ddaef705-a7f9-436c-a3a0-39eb37a504cb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:34.811371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ddaef705-a7f9-436c-a3a0-39eb37a504cb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:34.813172 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-bbf0783b-635d-458b-88d3-4e34e94ac892 req-7ffd84d7-7ef5-4780-94d1-baeab6cd4cca service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352914 Mar 05 21:15:34.813916 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2583/5189] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:35.108666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ddaef705-a7f9-436c-a3a0-39eb37a504cb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:35.124319 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ddaef705-a7f9-436c-a3a0-39eb37a504cb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:35.128480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ddaef705-a7f9-436c-a3a0-39eb37a504cb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:35.129799 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ddaef705-a7f9-436c-a3a0-39eb37a504cb tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1720 microversion: 2.20 time: 0.339113 Mar 05 21:15:35.130361 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2607/5190] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:34 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1720 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:15:35.326340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-384c7b63-9c92-4bec-9adc-1a5f7c102574 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:35.327559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-384c7b63-9c92-4bec-9adc-1a5f7c102574 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:35.341582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-384c7b63-9c92-4bec-9adc-1a5f7c102574 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:35.344817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-384c7b63-9c92-4bec-9adc-1a5f7c102574 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:35.347163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-384c7b63-9c92-4bec-9adc-1a5f7c102574 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:35.348643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-384c7b63-9c92-4bec-9adc-1a5f7c102574 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:35.753872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-384c7b63-9c92-4bec-9adc-1a5f7c102574 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:35.771444 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-384c7b63-9c92-4bec-9adc-1a5f7c102574 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1341 microversion: 2.1 time: 0.452141 Mar 05 21:15:35.775976 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2584/5191] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:35 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1341 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:36.158996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8721d623-09ff-46c9-bb05-3f2858b4bd03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:36.159867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8721d623-09ff-46c9-bb05-3f2858b4bd03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:36.169546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8721d623-09ff-46c9-bb05-3f2858b4bd03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:36.170017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8721d623-09ff-46c9-bb05-3f2858b4bd03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:36.170807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8721d623-09ff-46c9-bb05-3f2858b4bd03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:36.171254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8721d623-09ff-46c9-bb05-3f2858b4bd03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:36.391988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8721d623-09ff-46c9-bb05-3f2858b4bd03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:36.401893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8721d623-09ff-46c9-bb05-3f2858b4bd03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:36.404720 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8721d623-09ff-46c9-bb05-3f2858b4bd03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:36.406263 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8721d623-09ff-46c9-bb05-3f2858b4bd03 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1720 microversion: 2.20 time: 0.252355 Mar 05 21:15:36.408070 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2608/5192] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:36 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:36.792938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a45bc3d1-75d3-47ab-a687-303125f1e141 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:36.793663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a45bc3d1-75d3-47ab-a687-303125f1e141 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:36.800320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a45bc3d1-75d3-47ab-a687-303125f1e141 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:36.800791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a45bc3d1-75d3-47ab-a687-303125f1e141 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:36.801765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a45bc3d1-75d3-47ab-a687-303125f1e141 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:36.802219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a45bc3d1-75d3-47ab-a687-303125f1e141 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:36.945248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a45bc3d1-75d3-47ab-a687-303125f1e141 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:36.952605 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a45bc3d1-75d3-47ab-a687-303125f1e141 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1375 microversion: 2.1 time: 0.163583 Mar 05 21:15:36.953184 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2585/5193] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:36 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:37.426561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b5e3f805-b562-4e43-9184-97c839fc60ca tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:37.427081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b5e3f805-b562-4e43-9184-97c839fc60ca tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:37.434078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5e3f805-b562-4e43-9184-97c839fc60ca tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:37.434533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5e3f805-b562-4e43-9184-97c839fc60ca tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:37.435340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5e3f805-b562-4e43-9184-97c839fc60ca tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:37.435875 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5e3f805-b562-4e43-9184-97c839fc60ca tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:37.580922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b5e3f805-b562-4e43-9184-97c839fc60ca tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:37.589741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b5e3f805-b562-4e43-9184-97c839fc60ca tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:37.591273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b5e3f805-b562-4e43-9184-97c839fc60ca tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:37.592482 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b5e3f805-b562-4e43-9184-97c839fc60ca tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1720 microversion: 2.20 time: 0.170249 Mar 05 21:15:37.593189 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2609/5194] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:37 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:37.970645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d08ee477-6ad0-4727-8373-19a18e7397ed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:37.971279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d08ee477-6ad0-4727-8373-19a18e7397ed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:37.979074 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d08ee477-6ad0-4727-8373-19a18e7397ed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:37.979609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d08ee477-6ad0-4727-8373-19a18e7397ed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:37.992479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d08ee477-6ad0-4727-8373-19a18e7397ed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:37.992968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d08ee477-6ad0-4727-8373-19a18e7397ed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:38.196014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d08ee477-6ad0-4727-8373-19a18e7397ed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:38.209192 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d08ee477-6ad0-4727-8373-19a18e7397ed tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1375 microversion: 2.1 time: 0.241774 Mar 05 21:15:38.219861 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2586/5195] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:37 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1375 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:38.612383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d27f2504-dda0-45cc-8391-7e1a5aadc0ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:38.613192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d27f2504-dda0-45cc-8391-7e1a5aadc0ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:38.627538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d27f2504-dda0-45cc-8391-7e1a5aadc0ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:38.628274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d27f2504-dda0-45cc-8391-7e1a5aadc0ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:38.629424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d27f2504-dda0-45cc-8391-7e1a5aadc0ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:38.629901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d27f2504-dda0-45cc-8391-7e1a5aadc0ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:38.788305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d27f2504-dda0-45cc-8391-7e1a5aadc0ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:38.799074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d27f2504-dda0-45cc-8391-7e1a5aadc0ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:38.800933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d27f2504-dda0-45cc-8391-7e1a5aadc0ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:38.802352 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d27f2504-dda0-45cc-8391-7e1a5aadc0ac tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1720 microversion: 2.20 time: 0.194777 Mar 05 21:15:38.803195 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2610/5196] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:38 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:39.227758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ff4907d4-e719-4988-a79d-aa1f4f3321a4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:39.228408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ff4907d4-e719-4988-a79d-aa1f4f3321a4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:39.236850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff4907d4-e719-4988-a79d-aa1f4f3321a4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:39.237481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff4907d4-e719-4988-a79d-aa1f4f3321a4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:39.239211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff4907d4-e719-4988-a79d-aa1f4f3321a4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:39.240178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff4907d4-e719-4988-a79d-aa1f4f3321a4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:39.453580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ff4907d4-e719-4988-a79d-aa1f4f3321a4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:39.464277 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ff4907d4-e719-4988-a79d-aa1f4f3321a4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1375 microversion: 2.1 time: 0.240554 Mar 05 21:15:39.464981 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2587/5197] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:39 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1375 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:39.821247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3e075c21-b252-46f5-a707-7286340f444b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:39.822029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3e075c21-b252-46f5-a707-7286340f444b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:39.829202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e075c21-b252-46f5-a707-7286340f444b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:39.829667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e075c21-b252-46f5-a707-7286340f444b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:39.830463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e075c21-b252-46f5-a707-7286340f444b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:39.830895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e075c21-b252-46f5-a707-7286340f444b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:39.977680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3e075c21-b252-46f5-a707-7286340f444b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:39.985533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3e075c21-b252-46f5-a707-7286340f444b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:39.987043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3e075c21-b252-46f5-a707-7286340f444b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:39.989035 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3e075c21-b252-46f5-a707-7286340f444b tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1720 microversion: 2.20 time: 0.172409 Mar 05 21:15:39.989605 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2611/5198] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:39 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:40.482629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e90d9222-a741-4e19-9059-29305d10f2f2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:40.484094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e90d9222-a741-4e19-9059-29305d10f2f2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:40.492610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e90d9222-a741-4e19-9059-29305d10f2f2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:40.493163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e90d9222-a741-4e19-9059-29305d10f2f2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:40.494036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e90d9222-a741-4e19-9059-29305d10f2f2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:40.494608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e90d9222-a741-4e19-9059-29305d10f2f2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:40.645801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e90d9222-a741-4e19-9059-29305d10f2f2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:40.653822 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e90d9222-a741-4e19-9059-29305d10f2f2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1375 microversion: 2.1 time: 0.175726 Mar 05 21:15:40.654411 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2588/5199] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:40 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:41.008327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d3170ff-d6d2-4d7f-bb3a-1f31d3cee9cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:41.008898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7d3170ff-d6d2-4d7f-bb3a-1f31d3cee9cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:41.016031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d3170ff-d6d2-4d7f-bb3a-1f31d3cee9cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:41.016497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d3170ff-d6d2-4d7f-bb3a-1f31d3cee9cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:41.017286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d3170ff-d6d2-4d7f-bb3a-1f31d3cee9cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:41.017733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d3170ff-d6d2-4d7f-bb3a-1f31d3cee9cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:41.167039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d3170ff-d6d2-4d7f-bb3a-1f31d3cee9cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:41.176972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d3170ff-d6d2-4d7f-bb3a-1f31d3cee9cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:41.178752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d3170ff-d6d2-4d7f-bb3a-1f31d3cee9cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:41.180537 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7d3170ff-d6d2-4d7f-bb3a-1f31d3cee9cf tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1720 microversion: 2.20 time: 0.177266 Mar 05 21:15:41.181272 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2612/5200] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:41 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:41.258517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a9919f78-029c-46e4-987c-d489af3b9645 req-9f625b83-f5c3-492a-b3a1-e0f9b3d0c546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91c07ccc-b0d2-4cea-81b3-bbd995a7ece9", "name": "network-vif-plugged", "status": "completed", "tag": "37fe9d6d-c19c-46d3-8d3f-9f5248dd1889"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:41.270653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a9919f78-029c-46e4-987c-d489af3b9645 req-9f625b83-f5c3-492a-b3a1-e0f9b3d0c546 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:41.271441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a9919f78-029c-46e4-987c-d489af3b9645 req-9f625b83-f5c3-492a-b3a1-e0f9b3d0c546 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:41.284736 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a9919f78-029c-46e4-987c-d489af3b9645 req-9f625b83-f5c3-492a-b3a1-e0f9b3d0c546 service nova] Creating event network-vif-plugged:37fe9d6d-c19c-46d3-8d3f-9f5248dd1889 for instance 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 on nch2-master-1 Mar 05 21:15:41.290749 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a9919f78-029c-46e4-987c-d489af3b9645 req-9f625b83-f5c3-492a-b3a1-e0f9b3d0c546 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037261 Mar 05 21:15:41.291555 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2589/5201] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:41.670472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e5367e5d-897a-403b-9b9f-9b76e55af35f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:41.671089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e5367e5d-897a-403b-9b9f-9b76e55af35f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:41.677994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5367e5d-897a-403b-9b9f-9b76e55af35f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:41.678894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5367e5d-897a-403b-9b9f-9b76e55af35f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:41.679955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5367e5d-897a-403b-9b9f-9b76e55af35f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:41.680567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5367e5d-897a-403b-9b9f-9b76e55af35f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:41.821011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e5367e5d-897a-403b-9b9f-9b76e55af35f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:41.829112 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e5367e5d-897a-403b-9b9f-9b76e55af35f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1375 microversion: 2.1 time: 0.162721 Mar 05 21:15:41.829699 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2613/5202] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:41 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:42.199344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fe9ff774-bf9a-41e1-9804-a7f16b857c33 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:42.200089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fe9ff774-bf9a-41e1-9804-a7f16b857c33 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:42.207806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe9ff774-bf9a-41e1-9804-a7f16b857c33 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:42.208253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe9ff774-bf9a-41e1-9804-a7f16b857c33 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:42.209045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe9ff774-bf9a-41e1-9804-a7f16b857c33 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:42.209497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe9ff774-bf9a-41e1-9804-a7f16b857c33 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:42.362299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fe9ff774-bf9a-41e1-9804-a7f16b857c33 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:42.372539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fe9ff774-bf9a-41e1-9804-a7f16b857c33 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:42.374108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fe9ff774-bf9a-41e1-9804-a7f16b857c33 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:42.375311 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fe9ff774-bf9a-41e1-9804-a7f16b857c33 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1741 microversion: 2.20 time: 0.180490 Mar 05 21:15:42.375913 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2590/5203] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:42 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:42.846518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7c4b60b5-0e6b-483e-bb23-ecda03f471e2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:42.847135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7c4b60b5-0e6b-483e-bb23-ecda03f471e2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:42.853952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c4b60b5-0e6b-483e-bb23-ecda03f471e2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:42.854408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c4b60b5-0e6b-483e-bb23-ecda03f471e2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:42.855187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c4b60b5-0e6b-483e-bb23-ecda03f471e2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:42.855690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c4b60b5-0e6b-483e-bb23-ecda03f471e2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:42.995701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7c4b60b5-0e6b-483e-bb23-ecda03f471e2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:43.003123 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7c4b60b5-0e6b-483e-bb23-ecda03f471e2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1561 microversion: 2.1 time: 0.160525 Mar 05 21:15:43.003796 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2614/5204] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:42 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:43.020124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8cf09f38-d719-41ac-baa2-b3550ededa68 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:43.020831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8cf09f38-d719-41ac-baa2-b3550ededa68 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:43.026963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cf09f38-d719-41ac-baa2-b3550ededa68 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:43.027432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cf09f38-d719-41ac-baa2-b3550ededa68 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:43.028286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cf09f38-d719-41ac-baa2-b3550ededa68 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:43.028770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cf09f38-d719-41ac-baa2-b3550ededa68 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:43.170882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8cf09f38-d719-41ac-baa2-b3550ededa68 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:43.178451 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8cf09f38-d719-41ac-baa2-b3550ededa68 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1561 microversion: 2.1 time: 0.162899 Mar 05 21:15:43.179128 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2591/5205] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:43 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:43.249244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c10b46ef-c568-44a4-8115-8b8732dec398 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:43.249843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c10b46ef-c568-44a4-8115-8b8732dec398 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:43.265996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c10b46ef-c568-44a4-8115-8b8732dec398 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:43.266935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c10b46ef-c568-44a4-8115-8b8732dec398 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:43.268399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c10b46ef-c568-44a4-8115-8b8732dec398 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:43.270499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c10b46ef-c568-44a4-8115-8b8732dec398 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:43.301567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c10b46ef-c568-44a4-8115-8b8732dec398 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:15:43.394410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8bd1a27d-4f62-4476-a2ac-3a6a4eb58b09 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:43.396590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8bd1a27d-4f62-4476-a2ac-3a6a4eb58b09 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:43.401630 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c10b46ef-c568-44a4-8115-8b8732dec398 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "DELETE /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 204 len: 0 microversion: 2.1 time: 0.142334 Mar 05 21:15:43.404502 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2615/5206] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:15:43 2022] DELETE /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:15:43.413745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ef1fde87-0ce1-4c52-8b9b-2349dc2dc01c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:43.413945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bd1a27d-4f62-4476-a2ac-3a6a4eb58b09 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:43.414184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bd1a27d-4f62-4476-a2ac-3a6a4eb58b09 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:43.414548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ef1fde87-0ce1-4c52-8b9b-2349dc2dc01c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:43.417925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bd1a27d-4f62-4476-a2ac-3a6a4eb58b09 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:43.418914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8bd1a27d-4f62-4476-a2ac-3a6a4eb58b09 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:43.420889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef1fde87-0ce1-4c52-8b9b-2349dc2dc01c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:43.421359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef1fde87-0ce1-4c52-8b9b-2349dc2dc01c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:43.422147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef1fde87-0ce1-4c52-8b9b-2349dc2dc01c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:43.422593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ef1fde87-0ce1-4c52-8b9b-2349dc2dc01c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:43.607269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ef1fde87-0ce1-4c52-8b9b-2349dc2dc01c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:43.618533 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ef1fde87-0ce1-4c52-8b9b-2349dc2dc01c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1567 microversion: 2.1 time: 0.209562 Mar 05 21:15:43.619631 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2616/5207] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:43 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:15:43.658084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8bd1a27d-4f62-4476-a2ac-3a6a4eb58b09 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:43.672145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8bd1a27d-4f62-4476-a2ac-3a6a4eb58b09 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:43.674307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8bd1a27d-4f62-4476-a2ac-3a6a4eb58b09 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:43.678110 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8bd1a27d-4f62-4476-a2ac-3a6a4eb58b09 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1736 microversion: 2.20 time: 0.287701 Mar 05 21:15:43.680467 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2592/5208] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:43 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1736 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:15:44.637783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4bf48047-1b42-409e-a254-8d1ded49059d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:44.638583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4bf48047-1b42-409e-a254-8d1ded49059d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:44.651501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bf48047-1b42-409e-a254-8d1ded49059d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:44.652365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bf48047-1b42-409e-a254-8d1ded49059d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:44.654856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bf48047-1b42-409e-a254-8d1ded49059d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:44.655703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bf48047-1b42-409e-a254-8d1ded49059d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:44.700417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9de6de00-cd1c-472e-95cf-6b2d60bd2987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:44.702962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9de6de00-cd1c-472e-95cf-6b2d60bd2987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:44.713244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9de6de00-cd1c-472e-95cf-6b2d60bd2987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:44.713995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9de6de00-cd1c-472e-95cf-6b2d60bd2987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:44.715081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9de6de00-cd1c-472e-95cf-6b2d60bd2987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:44.715797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9de6de00-cd1c-472e-95cf-6b2d60bd2987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:44.917478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4bf48047-1b42-409e-a254-8d1ded49059d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:44.929322 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4bf48047-1b42-409e-a254-8d1ded49059d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1567 microversion: 2.1 time: 0.296860 Mar 05 21:15:44.933323 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2617/5209] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:44 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1567 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:44.968128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9de6de00-cd1c-472e-95cf-6b2d60bd2987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:44.985815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9de6de00-cd1c-472e-95cf-6b2d60bd2987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:44.990020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9de6de00-cd1c-472e-95cf-6b2d60bd2987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:44.991555 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9de6de00-cd1c-472e-95cf-6b2d60bd2987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1736 microversion: 2.20 time: 0.297097 Mar 05 21:15:44.993483 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2593/5210] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:44 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1736 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:15:45.807795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-0398a902-4ace-4d63-82d3-5688cdaa3a89 req-cf8dc269-259b-4a4e-9525-4d716cc63d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91c07ccc-b0d2-4cea-81b3-bbd995a7ece9", "name": "network-vif-deleted", "tag": "37fe9d6d-c19c-46d3-8d3f-9f5248dd1889"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:45.823933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0398a902-4ace-4d63-82d3-5688cdaa3a89 req-cf8dc269-259b-4a4e-9525-4d716cc63d53 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:45.826999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0398a902-4ace-4d63-82d3-5688cdaa3a89 req-cf8dc269-259b-4a4e-9525-4d716cc63d53 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:45.862026 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0398a902-4ace-4d63-82d3-5688cdaa3a89 req-cf8dc269-259b-4a4e-9525-4d716cc63d53 service nova] Creating event network-vif-deleted:37fe9d6d-c19c-46d3-8d3f-9f5248dd1889 for instance 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 on nch2-master-1 Mar 05 21:15:45.880421 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-0398a902-4ace-4d63-82d3-5688cdaa3a89 req-cf8dc269-259b-4a4e-9525-4d716cc63d53 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075140 Mar 05 21:15:45.883716 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2618/5211] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:45.950861 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82fa4502-c4ff-414c-b0d9-6b63352b0a2b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:45.951636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-82fa4502-c4ff-414c-b0d9-6b63352b0a2b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:45.966786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82fa4502-c4ff-414c-b0d9-6b63352b0a2b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:45.967731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82fa4502-c4ff-414c-b0d9-6b63352b0a2b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:45.968651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82fa4502-c4ff-414c-b0d9-6b63352b0a2b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:45.969373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82fa4502-c4ff-414c-b0d9-6b63352b0a2b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:46.013189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-78e11414-6c96-4e49-ba67-0f4d4fb62987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:46.013942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-78e11414-6c96-4e49-ba67-0f4d4fb62987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:46.041766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78e11414-6c96-4e49-ba67-0f4d4fb62987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:46.042163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78e11414-6c96-4e49-ba67-0f4d4fb62987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:46.042992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78e11414-6c96-4e49-ba67-0f4d4fb62987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:46.043506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-78e11414-6c96-4e49-ba67-0f4d4fb62987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:46.134413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-82fa4502-c4ff-414c-b0d9-6b63352b0a2b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:46.153559 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-82fa4502-c4ff-414c-b0d9-6b63352b0a2b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 200 len: 1360 microversion: 2.1 time: 0.206550 Mar 05 21:15:46.158267 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2594/5212] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:45 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 1360 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:46.292605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-4f97d986-0490-4c25-a9bf-66667475430c req-9894e3fd-201f-4705-a504-88f1dd42341d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51aeb9d2-5c35-4841-bcb2-7162b1f8752a", "name": "network-vif-plugged", "status": "completed", "tag": "c9af0a09-36af-49e5-919a-b3687886298b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:46.327917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4f97d986-0490-4c25-a9bf-66667475430c req-9894e3fd-201f-4705-a504-88f1dd42341d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:46.328450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4f97d986-0490-4c25-a9bf-66667475430c req-9894e3fd-201f-4705-a504-88f1dd42341d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:46.351179 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-4f97d986-0490-4c25-a9bf-66667475430c req-9894e3fd-201f-4705-a504-88f1dd42341d service nova] Creating event network-vif-plugged:c9af0a09-36af-49e5-919a-b3687886298b for instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a on nch1-master-1 Mar 05 21:15:46.356462 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-4f97d986-0490-4c25-a9bf-66667475430c req-9894e3fd-201f-4705-a504-88f1dd42341d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069079 Mar 05 21:15:46.357697 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2595/5213] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:46.487361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-78e11414-6c96-4e49-ba67-0f4d4fb62987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:46.528331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-78e11414-6c96-4e49-ba67-0f4d4fb62987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:46.541191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-78e11414-6c96-4e49-ba67-0f4d4fb62987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:46.546170 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-78e11414-6c96-4e49-ba67-0f4d4fb62987 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1736 microversion: 2.20 time: 0.538011 Mar 05 21:15:46.569438 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2619/5214] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:46 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1736 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:47.180821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4272949f-5543-4ea2-94d6-ef23133a5f88 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:47.181704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4272949f-5543-4ea2-94d6-ef23133a5f88 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:47.191356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4272949f-5543-4ea2-94d6-ef23133a5f88 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:47.192090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4272949f-5543-4ea2-94d6-ef23133a5f88 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:47.193908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4272949f-5543-4ea2-94d6-ef23133a5f88 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:47.194595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4272949f-5543-4ea2-94d6-ef23133a5f88 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:47.211328 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4272949f-5543-4ea2-94d6-ef23133a5f88 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 could not be found. Mar 05 21:15:47.212119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4272949f-5543-4ea2-94d6-ef23133a5f88 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:15:47.213249 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4272949f-5543-4ea2-94d6-ef23133a5f88 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 404 len: 111 microversion: 2.1 time: 0.038711 Mar 05 21:15:47.214580 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2596/5215] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:47 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:15:47.574734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bb053933-beba-4806-930b-0e43db1dc28c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:47.577009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bb053933-beba-4806-930b-0e43db1dc28c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:47.586364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb053933-beba-4806-930b-0e43db1dc28c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:47.587571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb053933-beba-4806-930b-0e43db1dc28c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:47.589308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb053933-beba-4806-930b-0e43db1dc28c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:47.590257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb053933-beba-4806-930b-0e43db1dc28c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:47.824523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1818058052", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:47.888802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb053933-beba-4806-930b-0e43db1dc28c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:47.899080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb053933-beba-4806-930b-0e43db1dc28c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:47.901547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb053933-beba-4806-930b-0e43db1dc28c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:47.903240 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bb053933-beba-4806-930b-0e43db1dc28c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1736 microversion: 2.20 time: 0.335118 Mar 05 21:15:47.907726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] validate_networks() for None {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:15:47.907931 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2620/5216] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:47 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1736 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:48.468777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:15:48.469485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:15:48.469598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:15:48.470590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:15:48.471168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:15:48.489407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:48.490149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:48.491170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:48.492208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:48.510397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Getting quotas for project 0b535d20f00c4006a3dab8344bf4b2d6. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:15:48.519980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Getting quotas for user c38e82a671f243b39615cd0cc9828531 and project 0b535d20f00c4006a3dab8344bf4b2d6. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:15:48.538536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:15:48.541670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:15:48.568306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e571f517-f302-4e43-91ba-cb9a4a1fdfe8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:48.569195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e571f517-f302-4e43-91ba-cb9a4a1fdfe8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:48.577487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e571f517-f302-4e43-91ba-cb9a4a1fdfe8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:48.578782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e571f517-f302-4e43-91ba-cb9a4a1fdfe8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:48.580026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e571f517-f302-4e43-91ba-cb9a4a1fdfe8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:48.580779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e571f517-f302-4e43-91ba-cb9a4a1fdfe8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:48.593983 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-80199928-10cc-4687-acba-bbe2e624fd0b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774073 Mar 05 21:15:48.594820 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2597/5217] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:15:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 21:15:48.610974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-793dd2e8-e254-4d81-93d0-baeb480124ae tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:48.611939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-793dd2e8-e254-4d81-93d0-baeb480124ae tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:48.635370 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e571f517-f302-4e43-91ba-cb9a4a1fdfe8 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250/ips" status: 200 len: 149 microversion: 2.1 time: 0.072054 Mar 05 21:15:48.636633 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2621/5218] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 21:15:48 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250/ips => generated 149 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:15:48.699626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-793dd2e8-e254-4d81-93d0-baeb480124ae tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:48.708603 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-793dd2e8-e254-4d81-93d0-baeb480124ae tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1215 microversion: 2.1 time: 0.106873 Mar 05 21:15:48.711721 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2598/5219] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:48 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:48.923847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8f6b758b-2558-456a-b3f7-a71c33b5ebdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:48.924474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8f6b758b-2558-456a-b3f7-a71c33b5ebdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:48.941227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f6b758b-2558-456a-b3f7-a71c33b5ebdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:48.941882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f6b758b-2558-456a-b3f7-a71c33b5ebdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:48.950848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f6b758b-2558-456a-b3f7-a71c33b5ebdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:48.953014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f6b758b-2558-456a-b3f7-a71c33b5ebdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:49.297064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8f6b758b-2558-456a-b3f7-a71c33b5ebdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:49.320484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8f6b758b-2558-456a-b3f7-a71c33b5ebdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:49.324176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8f6b758b-2558-456a-b3f7-a71c33b5ebdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:49.331583 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8f6b758b-2558-456a-b3f7-a71c33b5ebdd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1736 microversion: 2.20 time: 0.410742 Mar 05 21:15:49.333182 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2622/5220] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:48 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1736 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:49.728564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b1a0c041-8a71-4850-9463-27fb2deac77d tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:49.731394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b1a0c041-8a71-4850-9463-27fb2deac77d tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:49.755844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1a0c041-8a71-4850-9463-27fb2deac77d tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:49.760142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1a0c041-8a71-4850-9463-27fb2deac77d tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:49.761330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1a0c041-8a71-4850-9463-27fb2deac77d tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:49.764847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1a0c041-8a71-4850-9463-27fb2deac77d tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:49.888286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b1a0c041-8a71-4850-9463-27fb2deac77d tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:49.904565 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b1a0c041-8a71-4850-9463-27fb2deac77d tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1267 microversion: 2.1 time: 0.181276 Mar 05 21:15:49.905742 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2599/5221] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:49 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:50.186726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a3ff13e9-3539-4732-931e-bcefd7f06098 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "402482a3-a7f5-4c5a-9cb4-3a46f827c903"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:50.189860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a3ff13e9-3539-4732-931e-bcefd7f06098 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:50.221271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3ff13e9-3539-4732-931e-bcefd7f06098 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:50.222557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3ff13e9-3539-4732-931e-bcefd7f06098 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:50.225084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3ff13e9-3539-4732-931e-bcefd7f06098 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:50.225787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a3ff13e9-3539-4732-931e-bcefd7f06098 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:50.356267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-94bb7a93-fff1-4b91-ade9-8d6ebc816bde tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:50.356882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-94bb7a93-fff1-4b91-ade9-8d6ebc816bde tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:50.377747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94bb7a93-fff1-4b91-ade9-8d6ebc816bde tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:50.382186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94bb7a93-fff1-4b91-ade9-8d6ebc816bde tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:50.383874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94bb7a93-fff1-4b91-ade9-8d6ebc816bde tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:50.385031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94bb7a93-fff1-4b91-ade9-8d6ebc816bde tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:50.723614 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a3ff13e9-3539-4732-931e-bcefd7f06098 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "POST /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539695 Mar 05 21:15:50.724366 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2623/5222] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:15:50 2022] POST /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250/os-volume_attachments => generated 194 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:50.932978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e1988f93-e37f-45a9-b31a-c8ba50e475ef tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:50.933925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e1988f93-e37f-45a9-b31a-c8ba50e475ef tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:50.937735 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-94bb7a93-fff1-4b91-ade9-8d6ebc816bde tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:50.952988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-94bb7a93-fff1-4b91-ade9-8d6ebc816bde tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:50.954670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1988f93-e37f-45a9-b31a-c8ba50e475ef tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:50.955239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1988f93-e37f-45a9-b31a-c8ba50e475ef tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:50.957925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1988f93-e37f-45a9-b31a-c8ba50e475ef tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:50.958080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-94bb7a93-fff1-4b91-ade9-8d6ebc816bde tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:50.958903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e1988f93-e37f-45a9-b31a-c8ba50e475ef tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:50.961908 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-94bb7a93-fff1-4b91-ade9-8d6ebc816bde tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1736 microversion: 2.20 time: 0.614024 Mar 05 21:15:50.974897 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2600/5223] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:50 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1736 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:51.133368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e1988f93-e37f-45a9-b31a-c8ba50e475ef tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:51.146215 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e1988f93-e37f-45a9-b31a-c8ba50e475ef tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1273 microversion: 2.1 time: 0.226255 Mar 05 21:15:51.149106 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2624/5224] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:50 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:15:51.982757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d8f4d0f6-1fb2-46b5-a9c1-31199b6daebd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:51.983828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d8f4d0f6-1fb2-46b5-a9c1-31199b6daebd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:52.008390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d8f4d0f6-1fb2-46b5-a9c1-31199b6daebd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:52.009310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d8f4d0f6-1fb2-46b5-a9c1-31199b6daebd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:52.010619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d8f4d0f6-1fb2-46b5-a9c1-31199b6daebd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:52.011266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d8f4d0f6-1fb2-46b5-a9c1-31199b6daebd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:52.164573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3ce05c9c-6867-4a53-98db-104cc0ad9110 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:52.165363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3ce05c9c-6867-4a53-98db-104cc0ad9110 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:52.180103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3ce05c9c-6867-4a53-98db-104cc0ad9110 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:52.188845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3ce05c9c-6867-4a53-98db-104cc0ad9110 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:52.189741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3ce05c9c-6867-4a53-98db-104cc0ad9110 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:52.190195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3ce05c9c-6867-4a53-98db-104cc0ad9110 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:52.284445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d8f4d0f6-1fb2-46b5-a9c1-31199b6daebd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:52.298599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d8f4d0f6-1fb2-46b5-a9c1-31199b6daebd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:52.300823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d8f4d0f6-1fb2-46b5-a9c1-31199b6daebd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:52.302623 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d8f4d0f6-1fb2-46b5-a9c1-31199b6daebd tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1736 microversion: 2.20 time: 0.325109 Mar 05 21:15:52.303412 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2601/5225] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:51 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1736 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:52.473327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3ce05c9c-6867-4a53-98db-104cc0ad9110 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:52.487530 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3ce05c9c-6867-4a53-98db-104cc0ad9110 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1315 microversion: 2.1 time: 0.322469 Mar 05 21:15:52.492400 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2625/5226] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:52 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:53.185581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e3040190-898e-4b85-8190-1b3562a4a949 req-da885ee6-c1af-466d-8c10-440d3ad87cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dba065a-8782-4ec2-acb4-0b5f3902eadc", "tag": "5dfcca6a-a2df-4fef-a218-5dbe26210b32"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:53.202598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e3040190-898e-4b85-8190-1b3562a4a949 req-da885ee6-c1af-466d-8c10-440d3ad87cc8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:53.203068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e3040190-898e-4b85-8190-1b3562a4a949 req-da885ee6-c1af-466d-8c10-440d3ad87cc8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:53.236522 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e3040190-898e-4b85-8190-1b3562a4a949 req-da885ee6-c1af-466d-8c10-440d3ad87cc8 service nova] Creating event network-changed:5dfcca6a-a2df-4fef-a218-5dbe26210b32 for instance 4dba065a-8782-4ec2-acb4-0b5f3902eadc on nch2-master-1 Mar 05 21:15:53.254921 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e3040190-898e-4b85-8190-1b3562a4a949 req-da885ee6-c1af-466d-8c10-440d3ad87cc8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074545 Mar 05 21:15:53.256262 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2602/5227] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:53.324368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b817feef-16c1-49ef-b4ea-2315ce4a94ce tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:53.325424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b817feef-16c1-49ef-b4ea-2315ce4a94ce tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:53.342222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b817feef-16c1-49ef-b4ea-2315ce4a94ce tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:53.342692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b817feef-16c1-49ef-b4ea-2315ce4a94ce tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:53.352787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b817feef-16c1-49ef-b4ea-2315ce4a94ce tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:53.353409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b817feef-16c1-49ef-b4ea-2315ce4a94ce tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:53.506906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b8e0ff02-e6ce-46dd-b236-1b553cc51d72 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:53.508121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b8e0ff02-e6ce-46dd-b236-1b553cc51d72 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:53.528191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8e0ff02-e6ce-46dd-b236-1b553cc51d72 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:53.528808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8e0ff02-e6ce-46dd-b236-1b553cc51d72 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:53.529659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8e0ff02-e6ce-46dd-b236-1b553cc51d72 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:53.534291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8e0ff02-e6ce-46dd-b236-1b553cc51d72 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:53.649927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b817feef-16c1-49ef-b4ea-2315ce4a94ce tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:53.658900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b817feef-16c1-49ef-b4ea-2315ce4a94ce tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:53.661491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b817feef-16c1-49ef-b4ea-2315ce4a94ce tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:53.664565 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b817feef-16c1-49ef-b4ea-2315ce4a94ce tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1736 microversion: 2.20 time: 0.346029 Mar 05 21:15:53.665175 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2626/5228] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:53 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1736 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:53.961891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b8e0ff02-e6ce-46dd-b236-1b553cc51d72 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:53.994986 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b8e0ff02-e6ce-46dd-b236-1b553cc51d72 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1315 microversion: 2.1 time: 0.493262 Mar 05 21:15:53.996249 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2603/5229] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:53 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:15:54.457776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2d688b95-3dca-447b-b4eb-560c0b753e81 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:54.458884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2d688b95-3dca-447b-b4eb-560c0b753e81 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:54.466928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d688b95-3dca-447b-b4eb-560c0b753e81 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:54.467737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d688b95-3dca-447b-b4eb-560c0b753e81 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:54.468820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d688b95-3dca-447b-b4eb-560c0b753e81 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:54.469476 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d688b95-3dca-447b-b4eb-560c0b753e81 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:54.626833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-2d688b95-3dca-447b-b4eb-560c0b753e81 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lazy-loading 'services' on Instance uuid 792eb61e-229f-4cb7-a709-179922039250 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:15:54.687916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9b0e0720-5564-4239-8237-71ef8fd51861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:54.688758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9b0e0720-5564-4239-8237-71ef8fd51861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:54.702977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b0e0720-5564-4239-8237-71ef8fd51861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:54.704018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b0e0720-5564-4239-8237-71ef8fd51861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:54.706721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b0e0720-5564-4239-8237-71ef8fd51861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:54.707640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9b0e0720-5564-4239-8237-71ef8fd51861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:54.739972 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2d688b95-3dca-447b-b4eb-560c0b753e81 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250/os-volume_attachments/402482a3-a7f5-4c5a-9cb4-3a46f827c903" status: 202 len: 0 microversion: 2.1 time: 0.290951 Mar 05 21:15:54.741148 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2627/5230] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 21:15:54 2022] DELETE /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250/os-volume_attachments/402482a3-a7f5-4c5a-9cb4-3a46f827c903 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:15:54.795067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-62750c8d-f7fb-4091-a7f2-755b5f6a7847 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:54.796924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-62750c8d-f7fb-4091-a7f2-755b5f6a7847 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:54.822252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62750c8d-f7fb-4091-a7f2-755b5f6a7847 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:54.822986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62750c8d-f7fb-4091-a7f2-755b5f6a7847 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:54.829382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62750c8d-f7fb-4091-a7f2-755b5f6a7847 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:54.830421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62750c8d-f7fb-4091-a7f2-755b5f6a7847 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:54.884243 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-62750c8d-f7fb-4091-a7f2-755b5f6a7847 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110726 Mar 05 21:15:54.885481 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2628/5231] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:15:54 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:15:55.016232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fd10a300-5f59-4578-a07d-30c7b33981c9 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:55.018142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fd10a300-5f59-4578-a07d-30c7b33981c9 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:55.035419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd10a300-5f59-4578-a07d-30c7b33981c9 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:55.036621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd10a300-5f59-4578-a07d-30c7b33981c9 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:55.040037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd10a300-5f59-4578-a07d-30c7b33981c9 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:55.042232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd10a300-5f59-4578-a07d-30c7b33981c9 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:55.092507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9b0e0720-5564-4239-8237-71ef8fd51861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:55.105894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9b0e0720-5564-4239-8237-71ef8fd51861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:55.114634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9b0e0720-5564-4239-8237-71ef8fd51861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:55.117950 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9b0e0720-5564-4239-8237-71ef8fd51861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1736 microversion: 2.20 time: 0.436152 Mar 05 21:15:55.118575 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2604/5232] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:54 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1736 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:15:55.294562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fd10a300-5f59-4578-a07d-30c7b33981c9 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:55.306721 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fd10a300-5f59-4578-a07d-30c7b33981c9 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1315 microversion: 2.1 time: 0.295739 Mar 05 21:15:55.309025 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2629/5233] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:55 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:15:55.898284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f5003046-5365-4e21-b390-d53022a0fc47 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:55.900293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f5003046-5365-4e21-b390-d53022a0fc47 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:55.911758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5003046-5365-4e21-b390-d53022a0fc47 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:55.912542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5003046-5365-4e21-b390-d53022a0fc47 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:55.913580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5003046-5365-4e21-b390-d53022a0fc47 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:55.914617 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5003046-5365-4e21-b390-d53022a0fc47 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:55.954620 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f5003046-5365-4e21-b390-d53022a0fc47 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060845 Mar 05 21:15:55.955854 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2605/5234] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:15:55 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:15:56.031263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ac0c839-037a-4e85-880a-d7e47b1d2315 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:56.037284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ac0c839-037a-4e85-880a-d7e47b1d2315 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:56.046231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ac0c839-037a-4e85-880a-d7e47b1d2315 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:56.047393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ac0c839-037a-4e85-880a-d7e47b1d2315 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:56.049437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ac0c839-037a-4e85-880a-d7e47b1d2315 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:56.050546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ac0c839-037a-4e85-880a-d7e47b1d2315 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:56.087983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ac0c839-037a-4e85-880a-d7e47b1d2315 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:15:56.139434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-baacecd9-a509-48bb-a546-b148db18e0f4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:56.140507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-baacecd9-a509-48bb-a546-b148db18e0f4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:56.155477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-baacecd9-a509-48bb-a546-b148db18e0f4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:56.155978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-baacecd9-a509-48bb-a546-b148db18e0f4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:56.162288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-baacecd9-a509-48bb-a546-b148db18e0f4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:56.162963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-baacecd9-a509-48bb-a546-b148db18e0f4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:56.246146 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ac0c839-037a-4e85-880a-d7e47b1d2315 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 204 len: 0 microversion: 2.1 time: 0.221792 Mar 05 21:15:56.248631 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2630/5235] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:15:56 2022] DELETE /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:15:56.264073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c94e5a9d-aa5d-46be-919b-afbadf77a306 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:56.267326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c94e5a9d-aa5d-46be-919b-afbadf77a306 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:56.290097 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c94e5a9d-aa5d-46be-919b-afbadf77a306 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:56.290564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c94e5a9d-aa5d-46be-919b-afbadf77a306 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:56.291396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c94e5a9d-aa5d-46be-919b-afbadf77a306 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:56.291909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c94e5a9d-aa5d-46be-919b-afbadf77a306 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:56.493028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c94e5a9d-aa5d-46be-919b-afbadf77a306 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:56.511368 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c94e5a9d-aa5d-46be-919b-afbadf77a306 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 200 len: 1681 microversion: 2.1 time: 0.254889 Mar 05 21:15:56.522975 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2631/5236] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:56 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:56.522975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d6be55ca-ce3e-4cb1-a30b-d7f52d4b4b51 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:56.522975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d6be55ca-ce3e-4cb1-a30b-d7f52d4b4b51 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:56.527835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6be55ca-ce3e-4cb1-a30b-d7f52d4b4b51 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:56.528375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6be55ca-ce3e-4cb1-a30b-d7f52d4b4b51 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:56.529463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6be55ca-ce3e-4cb1-a30b-d7f52d4b4b51 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:56.529977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d6be55ca-ce3e-4cb1-a30b-d7f52d4b4b51 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:56.540884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-baacecd9-a509-48bb-a546-b148db18e0f4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:56.552413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-baacecd9-a509-48bb-a546-b148db18e0f4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:56.554451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-baacecd9-a509-48bb-a546-b148db18e0f4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:56.555915 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-baacecd9-a509-48bb-a546-b148db18e0f4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1736 microversion: 2.20 time: 0.422189 Mar 05 21:15:56.556770 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2606/5237] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:56 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1736 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:56.738888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d6be55ca-ce3e-4cb1-a30b-d7f52d4b4b51 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:56.750646 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d6be55ca-ce3e-4cb1-a30b-d7f52d4b4b51 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1315 microversion: 2.1 time: 0.236468 Mar 05 21:15:56.762789 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2632/5238] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:56 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:57.533165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-65111028-609b-4851-90ae-cbcb5041896d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:57.534043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-65111028-609b-4851-90ae-cbcb5041896d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:57.555356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65111028-609b-4851-90ae-cbcb5041896d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:57.556223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65111028-609b-4851-90ae-cbcb5041896d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:57.559714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65111028-609b-4851-90ae-cbcb5041896d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:57.560385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65111028-609b-4851-90ae-cbcb5041896d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:57.577896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c2c103e3-c6c2-45ad-af20-e6bfe9064498 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:57.578527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c2c103e3-c6c2-45ad-af20-e6bfe9064498 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:57.588824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2c103e3-c6c2-45ad-af20-e6bfe9064498 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:57.589543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2c103e3-c6c2-45ad-af20-e6bfe9064498 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:57.590507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2c103e3-c6c2-45ad-af20-e6bfe9064498 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:57.599023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2c103e3-c6c2-45ad-af20-e6bfe9064498 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:57.728610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-65111028-609b-4851-90ae-cbcb5041896d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:57.738843 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-65111028-609b-4851-90ae-cbcb5041896d tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 200 len: 1681 microversion: 2.1 time: 0.209046 Mar 05 21:15:57.740486 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2607/5239] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:57 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:57.773257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6edafa23-7518-4f78-b195-12d2c335425c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:57.774233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6edafa23-7518-4f78-b195-12d2c335425c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:57.791116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6edafa23-7518-4f78-b195-12d2c335425c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:57.793677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6edafa23-7518-4f78-b195-12d2c335425c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:57.795847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6edafa23-7518-4f78-b195-12d2c335425c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:57.798269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6edafa23-7518-4f78-b195-12d2c335425c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:57.824226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c2c103e3-c6c2-45ad-af20-e6bfe9064498 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:57.840194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c2c103e3-c6c2-45ad-af20-e6bfe9064498 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:57.842431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c2c103e3-c6c2-45ad-af20-e6bfe9064498 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:57.844045 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c2c103e3-c6c2-45ad-af20-e6bfe9064498 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1736 microversion: 2.20 time: 0.272243 Mar 05 21:15:57.857634 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2633/5240] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:57 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:58.173231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6edafa23-7518-4f78-b195-12d2c335425c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:58.197314 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6edafa23-7518-4f78-b195-12d2c335425c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1315 microversion: 2.1 time: 0.429906 Mar 05 21:15:58.198223 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2608/5241] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:57 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:58.758615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-efb09e09-3283-47ef-a570-a663048b2b56 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:58.759908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-efb09e09-3283-47ef-a570-a663048b2b56 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:58.767748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efb09e09-3283-47ef-a570-a663048b2b56 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:58.768292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efb09e09-3283-47ef-a570-a663048b2b56 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:58.770272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efb09e09-3283-47ef-a570-a663048b2b56 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:58.770796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efb09e09-3283-47ef-a570-a663048b2b56 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:58.844249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-efb09e09-3283-47ef-a570-a663048b2b56 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee90d7a5af4246b85ff0cb89217700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6888043940b9b1344c6998b423da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:58.853790 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-efb09e09-3283-47ef-a570-a663048b2b56 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 200 len: 1614 microversion: 2.1 time: 0.099342 Mar 05 21:15:58.854394 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2634/5242] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:58 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 1614 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:58.863830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4adc3077-49e3-4c4f-b359-8c22221d70b9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:58.864449 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4adc3077-49e3-4c4f-b359-8c22221d70b9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:58.872165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4adc3077-49e3-4c4f-b359-8c22221d70b9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:58.872741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4adc3077-49e3-4c4f-b359-8c22221d70b9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:58.873496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4adc3077-49e3-4c4f-b359-8c22221d70b9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:58.874238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4adc3077-49e3-4c4f-b359-8c22221d70b9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:59.051174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-de1745ae-213a-48ec-8b0b-260437d55681 req-bf5e3138-60d0-46aa-bd43-8a4e970aad0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "792eb61e-229f-4cb7-a709-179922039250", "name": "network-vif-deleted", "tag": "68a3695d-1e5b-431b-9bfd-992a7e3c692f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:59.064536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-de1745ae-213a-48ec-8b0b-260437d55681 req-bf5e3138-60d0-46aa-bd43-8a4e970aad0d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:59.067055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-de1745ae-213a-48ec-8b0b-260437d55681 req-bf5e3138-60d0-46aa-bd43-8a4e970aad0d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:59.085458 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-de1745ae-213a-48ec-8b0b-260437d55681 req-bf5e3138-60d0-46aa-bd43-8a4e970aad0d service nova] Creating event network-vif-deleted:68a3695d-1e5b-431b-9bfd-992a7e3c692f for instance 792eb61e-229f-4cb7-a709-179922039250 on nch2-master-1 Mar 05 21:15:59.093131 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-de1745ae-213a-48ec-8b0b-260437d55681 req-bf5e3138-60d0-46aa-bd43-8a4e970aad0d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048150 Mar 05 21:15:59.094268 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2635/5243] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:15:59.111397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4adc3077-49e3-4c4f-b359-8c22221d70b9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:59.121997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4adc3077-49e3-4c4f-b359-8c22221d70b9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:59.125622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4adc3077-49e3-4c4f-b359-8c22221d70b9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:59.127271 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4adc3077-49e3-4c4f-b359-8c22221d70b9 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1736 microversion: 2.20 time: 0.267632 Mar 05 21:15:59.139281 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2609/5244] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:15:58 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1736 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:15:59.215496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e98a2a5c-483d-4b02-9e77-f82f4d37556e tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:15:59.216325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e98a2a5c-483d-4b02-9e77-f82f4d37556e tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:15:59.224117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e98a2a5c-483d-4b02-9e77-f82f4d37556e tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:59.224587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e98a2a5c-483d-4b02-9e77-f82f4d37556e tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:59.225467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e98a2a5c-483d-4b02-9e77-f82f4d37556e tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:59.225981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e98a2a5c-483d-4b02-9e77-f82f4d37556e tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:59.464911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e98a2a5c-483d-4b02-9e77-f82f4d37556e tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:15:59.473622 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e98a2a5c-483d-4b02-9e77-f82f4d37556e tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1315 microversion: 2.1 time: 0.262688 Mar 05 21:15:59.475066 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2636/5245] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:59 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:15:59.841142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-0f4e74d5-f54d-4be4-acf0-052446c0f239 req-7d992877-5c59-4f88-b70b-45189c276b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dba065a-8782-4ec2-acb4-0b5f3902eadc", "name": "network-vif-plugged", "status": "completed", "tag": "5dfcca6a-a2df-4fef-a218-5dbe26210b32"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:15:59.852973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-0f4e74d5-f54d-4be4-acf0-052446c0f239 req-7d992877-5c59-4f88-b70b-45189c276b80 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:15:59.853362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-0f4e74d5-f54d-4be4-acf0-052446c0f239 req-7d992877-5c59-4f88-b70b-45189c276b80 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:15:59.872601 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-0f4e74d5-f54d-4be4-acf0-052446c0f239 req-7d992877-5c59-4f88-b70b-45189c276b80 service nova] Creating event network-vif-plugged:5dfcca6a-a2df-4fef-a218-5dbe26210b32 for instance 4dba065a-8782-4ec2-acb4-0b5f3902eadc on nch2-master-1 Mar 05 21:15:59.884109 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-0f4e74d5-f54d-4be4-acf0-052446c0f239 req-7d992877-5c59-4f88-b70b-45189c276b80 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046063 Mar 05 21:15:59.885964 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2610/5246] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:16:00.148829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1cb70fec-345d-488b-afc3-3198d1cb77d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:00.149547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2e41fada-9c4a-4c11-8a0d-343ae5c6c92a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:00.150017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1cb70fec-345d-488b-afc3-3198d1cb77d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:00.150193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2e41fada-9c4a-4c11-8a0d-343ae5c6c92a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:00.157205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1cb70fec-345d-488b-afc3-3198d1cb77d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:00.157543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e41fada-9c4a-4c11-8a0d-343ae5c6c92a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:00.157726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1cb70fec-345d-488b-afc3-3198d1cb77d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:00.158150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e41fada-9c4a-4c11-8a0d-343ae5c6c92a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:00.158518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1cb70fec-345d-488b-afc3-3198d1cb77d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:00.158956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1cb70fec-345d-488b-afc3-3198d1cb77d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:00.159187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e41fada-9c4a-4c11-8a0d-343ae5c6c92a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:00.159781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e41fada-9c4a-4c11-8a0d-343ae5c6c92a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:00.178277 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-2e41fada-9c4a-4c11-8a0d-343ae5c6c92a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Instance 792eb61e-229f-4cb7-a709-179922039250 could not be found. Mar 05 21:16:00.179001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2e41fada-9c4a-4c11-8a0d-343ae5c6c92a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 404 to user: Instance 792eb61e-229f-4cb7-a709-179922039250 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:00.180407 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2e41fada-9c4a-4c11-8a0d-343ae5c6c92a tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 404 len: 111 microversion: 2.1 time: 0.311105 Mar 05 21:16:00.181354 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2637/5247] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:15:59 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 111 bytes in 313 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:16:00.192333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-373fcb79-92d5-4aac-b3de-73a1020e7633 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '.version_select at 0x7fed5caffb80>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:00.219492 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-373fcb79-92d5-4aac-b3de-73a1020e7633 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822223499" status: 202 len: 0 microversion: 2.1 time: 0.031560 Mar 05 21:16:00.220705 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2638/5248] 10.222.0.15 () {58 vars in 1220 bytes} [Sat Mar 5 21:16:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822223499 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:16:00.333928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1cb70fec-345d-488b-afc3-3198d1cb77d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:00.345128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1cb70fec-345d-488b-afc3-3198d1cb77d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:00.347845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1cb70fec-345d-488b-afc3-3198d1cb77d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:00.349386 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1cb70fec-345d-488b-afc3-3198d1cb77d4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1718 microversion: 2.20 time: 0.206605 Mar 05 21:16:00.350422 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2611/5249] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:00 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1718 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:00.494393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a37be777-212b-4282-b3bb-629668b1bfea tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:00.496124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a37be777-212b-4282-b3bb-629668b1bfea tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:00.505457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a37be777-212b-4282-b3bb-629668b1bfea tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:00.506004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a37be777-212b-4282-b3bb-629668b1bfea tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:00.507158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a37be777-212b-4282-b3bb-629668b1bfea tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:00.507502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a37be777-212b-4282-b3bb-629668b1bfea tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:00.705434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a37be777-212b-4282-b3bb-629668b1bfea tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:00.716449 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a37be777-212b-4282-b3bb-629668b1bfea tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1315 microversion: 2.1 time: 0.227660 Mar 05 21:16:00.717563 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2639/5250] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:00 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:01.372207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6e6deefe-b1e0-4269-9697-a18fd2a5775f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:01.372854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6e6deefe-b1e0-4269-9697-a18fd2a5775f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:01.379933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e6deefe-b1e0-4269-9697-a18fd2a5775f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:01.380558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e6deefe-b1e0-4269-9697-a18fd2a5775f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:01.381373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e6deefe-b1e0-4269-9697-a18fd2a5775f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:01.382165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e6deefe-b1e0-4269-9697-a18fd2a5775f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:01.599775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6e6deefe-b1e0-4269-9697-a18fd2a5775f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:01.615124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6e6deefe-b1e0-4269-9697-a18fd2a5775f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:01.618063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6e6deefe-b1e0-4269-9697-a18fd2a5775f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:01.619595 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6e6deefe-b1e0-4269-9697-a18fd2a5775f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1718 microversion: 2.20 time: 0.253350 Mar 05 21:16:01.620630 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2612/5251] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:01 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1718 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:01.734126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-704836ab-11e8-4d53-b8d9-0b512c8039fe tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:01.734745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-704836ab-11e8-4d53-b8d9-0b512c8039fe tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:01.741695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-704836ab-11e8-4d53-b8d9-0b512c8039fe tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:01.742384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-704836ab-11e8-4d53-b8d9-0b512c8039fe tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:01.743172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-704836ab-11e8-4d53-b8d9-0b512c8039fe tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:01.743820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-704836ab-11e8-4d53-b8d9-0b512c8039fe tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:01.926567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-704836ab-11e8-4d53-b8d9-0b512c8039fe tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:01.928149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-01daddcf-0779-4f03-8905-8f1811febd6b req-c932d849-2223-404e-a7cf-6707b6ef3a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51aeb9d2-5c35-4841-bcb2-7162b1f8752a", "name": "network-vif-unplugged", "status": "completed", "tag": "c9af0a09-36af-49e5-919a-b3687886298b"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:01.935579 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-704836ab-11e8-4d53-b8d9-0b512c8039fe tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1465 microversion: 2.1 time: 0.204733 Mar 05 21:16:01.936278 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2640/5252] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:01 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1465 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:01.941764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-01daddcf-0779-4f03-8905-8f1811febd6b req-c932d849-2223-404e-a7cf-6707b6ef3a5a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:01.942797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-01daddcf-0779-4f03-8905-8f1811febd6b req-c932d849-2223-404e-a7cf-6707b6ef3a5a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:01.960395 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-01daddcf-0779-4f03-8905-8f1811febd6b req-c932d849-2223-404e-a7cf-6707b6ef3a5a service nova] Creating event network-vif-unplugged:c9af0a09-36af-49e5-919a-b3687886298b for instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a on nch1-master-1 Mar 05 21:16:01.965982 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-01daddcf-0779-4f03-8905-8f1811febd6b req-c932d849-2223-404e-a7cf-6707b6ef3a5a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041657 Mar 05 21:16:01.966679 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2613/5253] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:16:01.992313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-89f456d4-0a5d-4cd7-b107-6b148d5d269b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:01.992956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-89f456d4-0a5d-4cd7-b107-6b148d5d269b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:02.000522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89f456d4-0a5d-4cd7-b107-6b148d5d269b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:02.001533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89f456d4-0a5d-4cd7-b107-6b148d5d269b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:02.002437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89f456d4-0a5d-4cd7-b107-6b148d5d269b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:02.003517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89f456d4-0a5d-4cd7-b107-6b148d5d269b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:02.036684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-89f456d4-0a5d-4cd7-b107-6b148d5d269b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:16:02.143147 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-89f456d4-0a5d-4cd7-b107-6b148d5d269b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 204 len: 0 microversion: 2.1 time: 0.155208 Mar 05 21:16:02.147711 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2641/5254] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:16:01 2022] DELETE /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:16:02.154210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d1db9067-85aa-4002-bde4-098941db72e2 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:02.155015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d1db9067-85aa-4002-bde4-098941db72e2 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:02.162205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1db9067-85aa-4002-bde4-098941db72e2 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:02.162804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1db9067-85aa-4002-bde4-098941db72e2 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:02.164060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1db9067-85aa-4002-bde4-098941db72e2 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:02.164580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1db9067-85aa-4002-bde4-098941db72e2 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:02.320140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d1db9067-85aa-4002-bde4-098941db72e2 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:02.329819 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d1db9067-85aa-4002-bde4-098941db72e2 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1471 microversion: 2.1 time: 0.180204 Mar 05 21:16:02.330610 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2614/5255] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:02 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:02.526819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-432c0e12-9a5e-48ee-9b10-070dbafda416 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:02.527435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-432c0e12-9a5e-48ee-9b10-070dbafda416 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:02.534236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-432c0e12-9a5e-48ee-9b10-070dbafda416 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:02.534917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-432c0e12-9a5e-48ee-9b10-070dbafda416 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:02.535486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-432c0e12-9a5e-48ee-9b10-070dbafda416 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:02.535978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-432c0e12-9a5e-48ee-9b10-070dbafda416 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:02.551895 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-432c0e12-9a5e-48ee-9b10-070dbafda416 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Instance 792eb61e-229f-4cb7-a709-179922039250 could not be found. Mar 05 21:16:02.552525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-432c0e12-9a5e-48ee-9b10-070dbafda416 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 404 to user: Instance 792eb61e-229f-4cb7-a709-179922039250 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:02.553410 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-432c0e12-9a5e-48ee-9b10-070dbafda416 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 404 len: 111 microversion: 2.1 time: 0.031113 Mar 05 21:16:02.554015 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2642/5256] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:16:02 2022] DELETE /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:16:02.562880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1119ad34-e7f3-4fa3-a744-5c8c995c61e5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:02.563514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1119ad34-e7f3-4fa3-a744-5c8c995c61e5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 792eb61e-229f-4cb7-a709-179922039250] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:02.571354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1119ad34-e7f3-4fa3-a744-5c8c995c61e5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:02.571864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1119ad34-e7f3-4fa3-a744-5c8c995c61e5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:02.572701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1119ad34-e7f3-4fa3-a744-5c8c995c61e5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:02.573151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1119ad34-e7f3-4fa3-a744-5c8c995c61e5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:02.588118 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-1119ad34-e7f3-4fa3-a744-5c8c995c61e5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Instance 792eb61e-229f-4cb7-a709-179922039250 could not be found. Mar 05 21:16:02.588738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1119ad34-e7f3-4fa3-a744-5c8c995c61e5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 404 to user: Instance 792eb61e-229f-4cb7-a709-179922039250 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:02.589718 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1119ad34-e7f3-4fa3-a744-5c8c995c61e5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250" status: 404 len: 111 microversion: 2.1 time: 0.031477 Mar 05 21:16:02.590499 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2615/5257] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:02 2022] GET /compute/v2.1/servers/792eb61e-229f-4cb7-a709-179922039250 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:16:02.644397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7c8e673a-4952-4720-86a5-c76e484feb76 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:02.645334 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7c8e673a-4952-4720-86a5-c76e484feb76 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:02.653122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c8e673a-4952-4720-86a5-c76e484feb76 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:02.653688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c8e673a-4952-4720-86a5-c76e484feb76 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:02.654595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c8e673a-4952-4720-86a5-c76e484feb76 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:02.659017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c8e673a-4952-4720-86a5-c76e484feb76 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:02.844315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7c8e673a-4952-4720-86a5-c76e484feb76 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:02.856782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7c8e673a-4952-4720-86a5-c76e484feb76 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:02.860223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7c8e673a-4952-4720-86a5-c76e484feb76 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:02.861834 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7c8e673a-4952-4720-86a5-c76e484feb76 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1661 microversion: 2.20 time: 0.221484 Mar 05 21:16:02.866001 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2643/5258] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:02 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1661 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:02.882838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1ab3ca08-ba26-4e2d-8179-7d3f67486c8d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c43501d-253b-49b5-9c77-8a8e525b5831"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:02.884321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1ab3ca08-ba26-4e2d-8179-7d3f67486c8d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:02.892859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ab3ca08-ba26-4e2d-8179-7d3f67486c8d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:02.893606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ab3ca08-ba26-4e2d-8179-7d3f67486c8d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:02.897522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ab3ca08-ba26-4e2d-8179-7d3f67486c8d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:02.898167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ab3ca08-ba26-4e2d-8179-7d3f67486c8d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:03.268372 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1ab3ca08-ba26-4e2d-8179-7d3f67486c8d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "POST /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.389594 Mar 05 21:16:03.269691 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2616/5259] 10.222.0.15 () {62 vars in 1363 bytes} [Sat Mar 5 21:16:02 2022] POST /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/os-volume_attachments => generated 188 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:16:03.355827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3deb6fba-4af5-433c-87bb-34b177aca89b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:03.356771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3deb6fba-4af5-433c-87bb-34b177aca89b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:03.365363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3deb6fba-4af5-433c-87bb-34b177aca89b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:03.365836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3deb6fba-4af5-433c-87bb-34b177aca89b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:03.366717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3deb6fba-4af5-433c-87bb-34b177aca89b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:03.367201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3deb6fba-4af5-433c-87bb-34b177aca89b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:03.428728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f19f8fe3-66fb-4ab7-8c07-f9c4b5faa6e5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:03.429256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f19f8fe3-66fb-4ab7-8c07-f9c4b5faa6e5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:03.436238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f19f8fe3-66fb-4ab7-8c07-f9c4b5faa6e5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:03.436978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f19f8fe3-66fb-4ab7-8c07-f9c4b5faa6e5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:03.437973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f19f8fe3-66fb-4ab7-8c07-f9c4b5faa6e5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:03.438599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f19f8fe3-66fb-4ab7-8c07-f9c4b5faa6e5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:03.578834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3deb6fba-4af5-433c-87bb-34b177aca89b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:03.593778 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3deb6fba-4af5-433c-87bb-34b177aca89b tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1471 microversion: 2.1 time: 0.241840 Mar 05 21:16:03.594965 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2644/5260] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:03 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1471 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:03.828805 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f19f8fe3-66fb-4ab7-8c07-f9c4b5faa6e5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "DELETE /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/os-volume_attachments/2c43501d-253b-49b5-9c77-8a8e525b5831" status: 202 len: 0 microversion: 2.20 time: 0.405164 Mar 05 21:16:03.829613 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2617/5261] 10.222.0.15 () {60 vars in 1456 bytes} [Sat Mar 5 21:16:03 2022] DELETE /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/os-volume_attachments/2c43501d-253b-49b5-9c77-8a8e525b5831 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:16:03.921688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3feda01c-a666-4180-a5c6-0558884cd60a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:03.923070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3feda01c-a666-4180-a5c6-0558884cd60a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:03.930575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3feda01c-a666-4180-a5c6-0558884cd60a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:03.931156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3feda01c-a666-4180-a5c6-0558884cd60a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:03.932067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3feda01c-a666-4180-a5c6-0558884cd60a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:03.932585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3feda01c-a666-4180-a5c6-0558884cd60a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:04.029183 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3feda01c-a666-4180-a5c6-0558884cd60a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "POST /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/action" status: 202 len: 0 microversion: 2.20 time: 0.111477 Mar 05 21:16:04.047548 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2645/5262] 10.222.0.15 () {62 vars in 1318 bytes} [Sat Mar 5 21:16:03 2022] POST /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:16:04.057212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f5604c37-58e8-4a04-96b7-02654fe82d6a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:04.057683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f5604c37-58e8-4a04-96b7-02654fe82d6a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:04.066643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5604c37-58e8-4a04-96b7-02654fe82d6a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:04.070618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5604c37-58e8-4a04-96b7-02654fe82d6a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:04.078218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5604c37-58e8-4a04-96b7-02654fe82d6a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:04.078944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5604c37-58e8-4a04-96b7-02654fe82d6a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:04.230160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-fe8562f5-9cb3-4bcf-bafa-400bf5e1eec6 req-64127cd9-bc6b-4977-953f-af56f9879dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dba065a-8782-4ec2-acb4-0b5f3902eadc", "name": "network-vif-deleted", "tag": "5dfcca6a-a2df-4fef-a218-5dbe26210b32"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:04.246070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fe8562f5-9cb3-4bcf-bafa-400bf5e1eec6 req-64127cd9-bc6b-4977-953f-af56f9879dae service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:04.246633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fe8562f5-9cb3-4bcf-bafa-400bf5e1eec6 req-64127cd9-bc6b-4977-953f-af56f9879dae service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:04.290044 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-fe8562f5-9cb3-4bcf-bafa-400bf5e1eec6 req-64127cd9-bc6b-4977-953f-af56f9879dae service nova] Creating event network-vif-deleted:5dfcca6a-a2df-4fef-a218-5dbe26210b32 for instance 4dba065a-8782-4ec2-acb4-0b5f3902eadc on nch2-master-1 Mar 05 21:16:04.307619 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-fe8562f5-9cb3-4bcf-bafa-400bf5e1eec6 req-64127cd9-bc6b-4977-953f-af56f9879dae service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088257 Mar 05 21:16:04.308517 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2646/5263] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:16:04.400544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f5604c37-58e8-4a04-96b7-02654fe82d6a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:04.414986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f5604c37-58e8-4a04-96b7-02654fe82d6a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:04.416728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f5604c37-58e8-4a04-96b7-02654fe82d6a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:04.419917 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f5604c37-58e8-4a04-96b7-02654fe82d6a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1669 microversion: 2.20 time: 0.365843 Mar 05 21:16:04.419917 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2618/5264] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:04 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1669 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:04.624068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0e1bda0c-a5dd-46e6-a39e-5bb85ee3632c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:04.624978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0e1bda0c-a5dd-46e6-a39e-5bb85ee3632c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:04.635878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e1bda0c-a5dd-46e6-a39e-5bb85ee3632c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:04.636481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e1bda0c-a5dd-46e6-a39e-5bb85ee3632c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:04.638304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e1bda0c-a5dd-46e6-a39e-5bb85ee3632c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:04.638848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e1bda0c-a5dd-46e6-a39e-5bb85ee3632c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:04.694196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e1bda0c-a5dd-46e6-a39e-5bb85ee3632c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:04.694849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e1bda0c-a5dd-46e6-a39e-5bb85ee3632c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:04.695793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-0e1bda0c-a5dd-46e6-a39e-5bb85ee3632c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lazy-loading 'fault' on Instance uuid 4dba065a-8782-4ec2-acb4-0b5f3902eadc {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:16:04.773086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0e1bda0c-a5dd-46e6-a39e-5bb85ee3632c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38e82a671f243b39615cd0cc9828531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b535d20f00c4006a3dab8344bf4b2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:04.782406 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0e1bda0c-a5dd-46e6-a39e-5bb85ee3632c tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 200 len: 1305 microversion: 2.1 time: 0.168595 Mar 05 21:16:04.793946 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2647/5265] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:04 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 1305 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:04.871072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1b3b3f87-1178-493f-aab1-254a0fc377a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:04.871757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1b3b3f87-1178-493f-aab1-254a0fc377a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:04.897170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f87-1178-493f-aab1-254a0fc377a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:04.898952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f87-1178-493f-aab1-254a0fc377a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:04.902350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f87-1178-493f-aab1-254a0fc377a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:04.902836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f87-1178-493f-aab1-254a0fc377a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:04.924751 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-1b3b3f87-1178-493f-aab1-254a0fc377a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Instance 11e1c081-b0e2-40b8-81bb-d8b68af010dd could not be found. Mar 05 21:16:04.926188 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1b3b3f87-1178-493f-aab1-254a0fc377a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 404 to user: Instance 11e1c081-b0e2-40b8-81bb-d8b68af010dd could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:04.927138 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1b3b3f87-1178-493f-aab1-254a0fc377a7 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 404 len: 111 microversion: 2.1 time: 0.069701 Mar 05 21:16:04.927780 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2619/5266] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:16:04 2022] DELETE /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:16:04.937202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6150fced-4cf5-4c21-8aff-eeacd9526afd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:04.938319 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6150fced-4cf5-4c21-8aff-eeacd9526afd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 11e1c081-b0e2-40b8-81bb-d8b68af010dd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:04.946405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6150fced-4cf5-4c21-8aff-eeacd9526afd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:04.947378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6150fced-4cf5-4c21-8aff-eeacd9526afd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:04.948558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6150fced-4cf5-4c21-8aff-eeacd9526afd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:04.949193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6150fced-4cf5-4c21-8aff-eeacd9526afd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:04.965606 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-6150fced-4cf5-4c21-8aff-eeacd9526afd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Instance 11e1c081-b0e2-40b8-81bb-d8b68af010dd could not be found. Mar 05 21:16:04.966206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6150fced-4cf5-4c21-8aff-eeacd9526afd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 404 to user: Instance 11e1c081-b0e2-40b8-81bb-d8b68af010dd could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:04.967130 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6150fced-4cf5-4c21-8aff-eeacd9526afd tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd" status: 404 len: 111 microversion: 2.1 time: 0.034670 Mar 05 21:16:04.967991 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2648/5267] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:04 2022] GET /compute/v2.1/servers/11e1c081-b0e2-40b8-81bb-d8b68af010dd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:16:04.977008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ed1d7573-16a5-4453-a9c8-3910559d1ef6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:04.978401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ed1d7573-16a5-4453-a9c8-3910559d1ef6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:04.986091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed1d7573-16a5-4453-a9c8-3910559d1ef6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:04.986626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed1d7573-16a5-4453-a9c8-3910559d1ef6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:04.987512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed1d7573-16a5-4453-a9c8-3910559d1ef6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:04.988247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed1d7573-16a5-4453-a9c8-3910559d1ef6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:05.008603 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-ed1d7573-16a5-4453-a9c8-3910559d1ef6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Instance 0612a448-c43d-402f-892e-e1f1ec0575c6 could not be found. Mar 05 21:16:05.009476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ed1d7573-16a5-4453-a9c8-3910559d1ef6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 404 to user: Instance 0612a448-c43d-402f-892e-e1f1ec0575c6 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:05.010410 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ed1d7573-16a5-4453-a9c8-3910559d1ef6 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 404 len: 111 microversion: 2.1 time: 0.037810 Mar 05 21:16:05.011481 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2620/5268] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:16:04 2022] DELETE /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:16:05.025086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-22d477cf-c766-412f-b1fb-6aca658b5c96 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:05.025842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-22d477cf-c766-412f-b1fb-6aca658b5c96 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 0612a448-c43d-402f-892e-e1f1ec0575c6] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:05.033582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22d477cf-c766-412f-b1fb-6aca658b5c96 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:05.034082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22d477cf-c766-412f-b1fb-6aca658b5c96 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:05.036266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22d477cf-c766-412f-b1fb-6aca658b5c96 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:05.036920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-22d477cf-c766-412f-b1fb-6aca658b5c96 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:05.058428 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-22d477cf-c766-412f-b1fb-6aca658b5c96 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Instance 0612a448-c43d-402f-892e-e1f1ec0575c6 could not be found. Mar 05 21:16:05.059762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-22d477cf-c766-412f-b1fb-6aca658b5c96 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 404 to user: Instance 0612a448-c43d-402f-892e-e1f1ec0575c6 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:05.060172 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-22d477cf-c766-412f-b1fb-6aca658b5c96 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6" status: 404 len: 111 microversion: 2.1 time: 0.044691 Mar 05 21:16:05.061149 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2649/5269] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:05 2022] GET /compute/v2.1/servers/0612a448-c43d-402f-892e-e1f1ec0575c6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:16:05.440168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-10438954-2152-439e-81f6-86d6d42c7a4f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:05.442312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-10438954-2152-439e-81f6-86d6d42c7a4f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:05.451003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-10438954-2152-439e-81f6-86d6d42c7a4f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:05.451462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-10438954-2152-439e-81f6-86d6d42c7a4f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:05.452517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-10438954-2152-439e-81f6-86d6d42c7a4f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:05.452932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-10438954-2152-439e-81f6-86d6d42c7a4f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:05.647740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-10438954-2152-439e-81f6-86d6d42c7a4f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:05.657664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-10438954-2152-439e-81f6-86d6d42c7a4f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:05.659826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-10438954-2152-439e-81f6-86d6d42c7a4f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:05.661277 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-10438954-2152-439e-81f6-86d6d42c7a4f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1671 microversion: 2.20 time: 0.227105 Mar 05 21:16:05.662138 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2621/5270] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:05 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1671 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:05.803852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8db329cd-8a1d-478f-9c9e-bc969104bd52 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:05.805100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8db329cd-8a1d-478f-9c9e-bc969104bd52 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] [instance: 4dba065a-8782-4ec2-acb4-0b5f3902eadc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:05.826894 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8db329cd-8a1d-478f-9c9e-bc969104bd52 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:05.827394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8db329cd-8a1d-478f-9c9e-bc969104bd52 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:05.829620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8db329cd-8a1d-478f-9c9e-bc969104bd52 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:05.830147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8db329cd-8a1d-478f-9c9e-bc969104bd52 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:05.857506 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-8db329cd-8a1d-478f-9c9e-bc969104bd52 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] HTTP exception thrown: Instance 4dba065a-8782-4ec2-acb4-0b5f3902eadc could not be found. Mar 05 21:16:05.858818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8db329cd-8a1d-478f-9c9e-bc969104bd52 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] Returning 404 to user: Instance 4dba065a-8782-4ec2-acb4-0b5f3902eadc could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:05.859948 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8db329cd-8a1d-478f-9c9e-bc969104bd52 tempest-VolumesNegativeTest-1852983499 tempest-VolumesNegativeTest-1852983499-project] 10.222.0.15 "GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc" status: 404 len: 111 microversion: 2.1 time: 0.062672 Mar 05 21:16:05.861349 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2650/5271] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:05 2022] GET /compute/v2.1/servers/4dba065a-8782-4ec2-acb4-0b5f3902eadc => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:16:06.277038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3126b81d-9132-4b1e-8f91-adca97951c1b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:06.278396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3126b81d-9132-4b1e-8f91-adca97951c1b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:06.293693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3126b81d-9132-4b1e-8f91-adca97951c1b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:06.295642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3126b81d-9132-4b1e-8f91-adca97951c1b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:06.299128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3126b81d-9132-4b1e-8f91-adca97951c1b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:06.300660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3126b81d-9132-4b1e-8f91-adca97951c1b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:06.324093 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-3126b81d-9132-4b1e-8f91-adca97951c1b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Instance 024b8477-8c82-4b91-879f-48b125f19e40 could not be found. Mar 05 21:16:06.324752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3126b81d-9132-4b1e-8f91-adca97951c1b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 404 to user: Instance 024b8477-8c82-4b91-879f-48b125f19e40 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:06.325654 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3126b81d-9132-4b1e-8f91-adca97951c1b tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "DELETE /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 404 len: 111 microversion: 2.1 time: 0.054873 Mar 05 21:16:06.329949 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2622/5272] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:16:06 2022] DELETE /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:16:06.338499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c5c7b5c6-6414-4879-a2d5-221cb659a7d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:06.340267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c5c7b5c6-6414-4879-a2d5-221cb659a7d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] [instance: 024b8477-8c82-4b91-879f-48b125f19e40] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:06.351370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5c7b5c6-6414-4879-a2d5-221cb659a7d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:06.351898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5c7b5c6-6414-4879-a2d5-221cb659a7d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:06.362879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5c7b5c6-6414-4879-a2d5-221cb659a7d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:06.364668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c5c7b5c6-6414-4879-a2d5-221cb659a7d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:06.389718 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-c5c7b5c6-6414-4879-a2d5-221cb659a7d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] HTTP exception thrown: Instance 024b8477-8c82-4b91-879f-48b125f19e40 could not be found. Mar 05 21:16:06.390326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c5c7b5c6-6414-4879-a2d5-221cb659a7d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] Returning 404 to user: Instance 024b8477-8c82-4b91-879f-48b125f19e40 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:06.391213 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c5c7b5c6-6414-4879-a2d5-221cb659a7d5 tempest-AttachVolumeNegativeTest-1565771773 tempest-AttachVolumeNegativeTest-1565771773-project] 10.222.0.15 "GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40" status: 404 len: 111 microversion: 2.1 time: 0.057762 Mar 05 21:16:06.391864 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2651/5273] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:06 2022] GET /compute/v2.1/servers/024b8477-8c82-4b91-879f-48b125f19e40 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:16:06.685086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1d993da2-615b-430d-8654-f402020179b4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:06.686141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1d993da2-615b-430d-8654-f402020179b4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:06.695502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d993da2-615b-430d-8654-f402020179b4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:06.696387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d993da2-615b-430d-8654-f402020179b4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:06.698324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d993da2-615b-430d-8654-f402020179b4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:06.710506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1d993da2-615b-430d-8654-f402020179b4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:07.191578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1d993da2-615b-430d-8654-f402020179b4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:07.204708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1d993da2-615b-430d-8654-f402020179b4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:07.207689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1d993da2-615b-430d-8654-f402020179b4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:07.209701 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1d993da2-615b-430d-8654-f402020179b4 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.529233 Mar 05 21:16:07.210981 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2623/5274] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:06 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:07.481810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-f8469999-69a8-47f5-997d-c4077c870818 req-190c750c-66d2-4614-874b-46adf9cb6edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51aeb9d2-5c35-4841-bcb2-7162b1f8752a", "tag": "c9af0a09-36af-49e5-919a-b3687886298b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:07.510007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f8469999-69a8-47f5-997d-c4077c870818 req-190c750c-66d2-4614-874b-46adf9cb6edb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:07.510963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f8469999-69a8-47f5-997d-c4077c870818 req-190c750c-66d2-4614-874b-46adf9cb6edb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:07.547353 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-f8469999-69a8-47f5-997d-c4077c870818 req-190c750c-66d2-4614-874b-46adf9cb6edb service nova] Creating event network-changed:c9af0a09-36af-49e5-919a-b3687886298b for instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a on nch2-master-1 Mar 05 21:16:07.568386 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-f8469999-69a8-47f5-997d-c4077c870818 req-190c750c-66d2-4614-874b-46adf9cb6edb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091486 Mar 05 21:16:07.569095 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2652/5275] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:16:08.239706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-af2f977e-9e7d-4ebe-8bf4-97f650c7768d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:08.240779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-af2f977e-9e7d-4ebe-8bf4-97f650c7768d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:08.257247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-af2f977e-9e7d-4ebe-8bf4-97f650c7768d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:08.258366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-af2f977e-9e7d-4ebe-8bf4-97f650c7768d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:08.259757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-af2f977e-9e7d-4ebe-8bf4-97f650c7768d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:08.260531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-af2f977e-9e7d-4ebe-8bf4-97f650c7768d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:08.584795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-af2f977e-9e7d-4ebe-8bf4-97f650c7768d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:08.595104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-af2f977e-9e7d-4ebe-8bf4-97f650c7768d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:08.596333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-af2f977e-9e7d-4ebe-8bf4-97f650c7768d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:08.597824 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-af2f977e-9e7d-4ebe-8bf4-97f650c7768d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.370876 Mar 05 21:16:08.599359 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2624/5276] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:08 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:09.623303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-25ecab8d-834b-4c17-a757-d4f4ce07117a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:09.624585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-25ecab8d-834b-4c17-a757-d4f4ce07117a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:09.645872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-25ecab8d-834b-4c17-a757-d4f4ce07117a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:09.657453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-25ecab8d-834b-4c17-a757-d4f4ce07117a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:09.665812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-25ecab8d-834b-4c17-a757-d4f4ce07117a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:09.667201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-25ecab8d-834b-4c17-a757-d4f4ce07117a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:10.210193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-25ecab8d-834b-4c17-a757-d4f4ce07117a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:10.224818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-25ecab8d-834b-4c17-a757-d4f4ce07117a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:10.230075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-25ecab8d-834b-4c17-a757-d4f4ce07117a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:10.231797 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-25ecab8d-834b-4c17-a757-d4f4ce07117a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.616482 Mar 05 21:16:10.243736 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2653/5277] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:09 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:16:11.262759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c2010a37-3e92-431f-a160-70d6da969c4c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:11.263394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c2010a37-3e92-431f-a160-70d6da969c4c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:11.285261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2010a37-3e92-431f-a160-70d6da969c4c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:11.288398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2010a37-3e92-431f-a160-70d6da969c4c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:11.294653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2010a37-3e92-431f-a160-70d6da969c4c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:11.295407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2010a37-3e92-431f-a160-70d6da969c4c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:12.043271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c2010a37-3e92-431f-a160-70d6da969c4c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:12.071990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c2010a37-3e92-431f-a160-70d6da969c4c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:12.075071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c2010a37-3e92-431f-a160-70d6da969c4c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:12.078467 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c2010a37-3e92-431f-a160-70d6da969c4c tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.819848 Mar 05 21:16:12.087748 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2625/5278] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:11 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:13.107794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b85ae9d0-cf7f-4e7b-b0d4-35ba7493851d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:13.109038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b85ae9d0-cf7f-4e7b-b0d4-35ba7493851d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:13.118845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b85ae9d0-cf7f-4e7b-b0d4-35ba7493851d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:13.119864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b85ae9d0-cf7f-4e7b-b0d4-35ba7493851d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:13.120999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b85ae9d0-cf7f-4e7b-b0d4-35ba7493851d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:13.121873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b85ae9d0-cf7f-4e7b-b0d4-35ba7493851d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:13.495077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b85ae9d0-cf7f-4e7b-b0d4-35ba7493851d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:13.515784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b85ae9d0-cf7f-4e7b-b0d4-35ba7493851d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:13.523422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b85ae9d0-cf7f-4e7b-b0d4-35ba7493851d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:13.524792 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b85ae9d0-cf7f-4e7b-b0d4-35ba7493851d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.421668 Mar 05 21:16:13.531652 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2654/5279] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:13 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:14.550694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-98d7b212-a158-4c82-934f-83617b95887f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:14.551536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-98d7b212-a158-4c82-934f-83617b95887f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:14.565721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98d7b212-a158-4c82-934f-83617b95887f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:14.566657 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98d7b212-a158-4c82-934f-83617b95887f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:14.567964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98d7b212-a158-4c82-934f-83617b95887f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:14.568719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98d7b212-a158-4c82-934f-83617b95887f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:15.002197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-98d7b212-a158-4c82-934f-83617b95887f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:15.030138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-98d7b212-a158-4c82-934f-83617b95887f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:15.036855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-98d7b212-a158-4c82-934f-83617b95887f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:15.042311 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-98d7b212-a158-4c82-934f-83617b95887f tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.495968 Mar 05 21:16:15.044315 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2626/5280] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:14 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:16.068596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4cfc7c90-c3b8-4091-948a-b60aa1951d44 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:16.069280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4cfc7c90-c3b8-4091-948a-b60aa1951d44 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:16.086592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4cfc7c90-c3b8-4091-948a-b60aa1951d44 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:16.089076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4cfc7c90-c3b8-4091-948a-b60aa1951d44 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:16.092824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4cfc7c90-c3b8-4091-948a-b60aa1951d44 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:16.093618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4cfc7c90-c3b8-4091-948a-b60aa1951d44 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:16.439918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4cfc7c90-c3b8-4091-948a-b60aa1951d44 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:16.451292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4cfc7c90-c3b8-4091-948a-b60aa1951d44 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:16.456829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4cfc7c90-c3b8-4091-948a-b60aa1951d44 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:16.461022 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4cfc7c90-c3b8-4091-948a-b60aa1951d44 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.402276 Mar 05 21:16:16.476518 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2655/5281] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:16 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:17.489951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-60eef339-c2fd-4ad9-9c82-dadbfc15c753 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:17.492295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-60eef339-c2fd-4ad9-9c82-dadbfc15c753 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:17.524123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60eef339-c2fd-4ad9-9c82-dadbfc15c753 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:17.529161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60eef339-c2fd-4ad9-9c82-dadbfc15c753 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:17.531728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60eef339-c2fd-4ad9-9c82-dadbfc15c753 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:17.531926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60eef339-c2fd-4ad9-9c82-dadbfc15c753 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:17.970555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-60eef339-c2fd-4ad9-9c82-dadbfc15c753 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:17.994186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-60eef339-c2fd-4ad9-9c82-dadbfc15c753 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:17.995850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-60eef339-c2fd-4ad9-9c82-dadbfc15c753 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:17.997305 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-60eef339-c2fd-4ad9-9c82-dadbfc15c753 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.512399 Mar 05 21:16:17.998330 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2627/5282] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:17 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:19.021465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-db49a94d-15c6-407f-8fc5-fce86b5765b7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:19.022475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-db49a94d-15c6-407f-8fc5-fce86b5765b7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:19.037306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-db49a94d-15c6-407f-8fc5-fce86b5765b7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:19.038886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-db49a94d-15c6-407f-8fc5-fce86b5765b7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:19.044215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-db49a94d-15c6-407f-8fc5-fce86b5765b7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:19.047577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-db49a94d-15c6-407f-8fc5-fce86b5765b7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:19.189522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2040675304", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "68508e58-0d99-4ada-84a1-f7bc3c01d9c6"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:19.328269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] validate_networks() for [('68508e58-0d99-4ada-84a1-f7bc3c01d9c6', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:16:19.624077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-db49a94d-15c6-407f-8fc5-fce86b5765b7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:19.651498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-db49a94d-15c6-407f-8fc5-fce86b5765b7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:19.653437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-db49a94d-15c6-407f-8fc5-fce86b5765b7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:19.660665 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-db49a94d-15c6-407f-8fc5-fce86b5765b7 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.645517 Mar 05 21:16:19.673813 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2656/5283] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:19 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:19.680572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-97c14861-775c-4505-9dd2-d67b74859a45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:19.685673 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-97c14861-775c-4505-9dd2-d67b74859a45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:19.688463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97c14861-775c-4505-9dd2-d67b74859a45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:19.689382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97c14861-775c-4505-9dd2-d67b74859a45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:19.691811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97c14861-775c-4505-9dd2-d67b74859a45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:19.693832 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-97c14861-775c-4505-9dd2-d67b74859a45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:19.735135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-97c14861-775c-4505-9dd2-d67b74859a45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:16:19.965647 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-97c14861-775c-4505-9dd2-d67b74859a45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 204 len: 0 microversion: 2.1 time: 0.296187 Mar 05 21:16:19.970016 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2657/5284] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:16:19 2022] DELETE /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:16:19.981798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f1e6a96c-136a-4c03-8235-67ce72923f9e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:19.993921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f1e6a96c-136a-4c03-8235-67ce72923f9e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:19.993921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1e6a96c-136a-4c03-8235-67ce72923f9e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:19.993921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1e6a96c-136a-4c03-8235-67ce72923f9e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:19.993921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1e6a96c-136a-4c03-8235-67ce72923f9e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:19.995122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1e6a96c-136a-4c03-8235-67ce72923f9e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:20.302910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:16:20.305250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:16:20.305613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:16:20.306484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:16:20.307146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:16:20.321643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:20.322619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:20.326742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:20.327754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:20.373665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Getting quotas for project 46aa322abe044eb7baa1f99f151b28cc. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:16:20.394334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Getting quotas for user 2b581b22102f425daee098c1318c506e and project 46aa322abe044eb7baa1f99f151b28cc. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:16:20.434666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:16:20.438206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:16:20.582392 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-04896438-977e-4907-a77a-180557756063 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.398889 Mar 05 21:16:20.584170 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2628/5285] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:16:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:16:20.600811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e26732df-5803-4ad1-a4cb-810e2db095de tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:20.602527 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e26732df-5803-4ad1-a4cb-810e2db095de tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:20.765782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f1e6a96c-136a-4c03-8235-67ce72923f9e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:20.784903 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f1e6a96c-136a-4c03-8235-67ce72923f9e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1408 microversion: 2.1 time: 0.803335 Mar 05 21:16:20.802114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e26732df-5803-4ad1-a4cb-810e2db095de tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:20.804057 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2658/5286] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:19 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1408 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:20.817745 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e26732df-5803-4ad1-a4cb-810e2db095de tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 200 len: 1219 microversion: 2.1 time: 0.227083 Mar 05 21:16:20.818354 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2629/5287] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:20 2022] GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 1219 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:16:20.837107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-faac440c-2a3b-4622-8080-aee7abeba57e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:20.837780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-faac440c-2a3b-4622-8080-aee7abeba57e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:20.845272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-faac440c-2a3b-4622-8080-aee7abeba57e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:20.845898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-faac440c-2a3b-4622-8080-aee7abeba57e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:20.846747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-faac440c-2a3b-4622-8080-aee7abeba57e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:20.847505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-faac440c-2a3b-4622-8080-aee7abeba57e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:21.810384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e5fb0a9d-8e02-49f3-9370-819f2ef92016 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:21.811132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e5fb0a9d-8e02-49f3-9370-819f2ef92016 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:21.856812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5fb0a9d-8e02-49f3-9370-819f2ef92016 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:21.874966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5fb0a9d-8e02-49f3-9370-819f2ef92016 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:21.883799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5fb0a9d-8e02-49f3-9370-819f2ef92016 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:21.887383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e5fb0a9d-8e02-49f3-9370-819f2ef92016 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:21.912451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-faac440c-2a3b-4622-8080-aee7abeba57e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:21.922338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-faac440c-2a3b-4622-8080-aee7abeba57e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:21.923901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-faac440c-2a3b-4622-8080-aee7abeba57e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:21.925625 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-faac440c-2a3b-4622-8080-aee7abeba57e tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 1.120188 Mar 05 21:16:21.926194 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2659/5288] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:20 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:21.959259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-840367cf-841a-43fd-8209-b6387c149234 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:21.963467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-840367cf-841a-43fd-8209-b6387c149234 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:21.976554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-840367cf-841a-43fd-8209-b6387c149234 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:21.977330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-840367cf-841a-43fd-8209-b6387c149234 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:21.978428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-840367cf-841a-43fd-8209-b6387c149234 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:21.981750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-840367cf-841a-43fd-8209-b6387c149234 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:22.296495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-840367cf-841a-43fd-8209-b6387c149234 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:22.304757 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-840367cf-841a-43fd-8209-b6387c149234 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 200 len: 1215 microversion: 2.1 time: 0.354218 Mar 05 21:16:22.308236 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2660/5289] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:21 2022] GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 1215 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:22.451887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e5fb0a9d-8e02-49f3-9370-819f2ef92016 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:22.460881 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e5fb0a9d-8e02-49f3-9370-819f2ef92016 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1408 microversion: 2.1 time: 0.655294 Mar 05 21:16:22.461914 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2630/5290] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:21 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1408 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:22.947699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fbf69b63-c9a9-448e-ae8c-293581b39ca5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:22.948438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fbf69b63-c9a9-448e-ae8c-293581b39ca5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:22.966819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbf69b63-c9a9-448e-ae8c-293581b39ca5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:22.967776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbf69b63-c9a9-448e-ae8c-293581b39ca5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:22.968801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbf69b63-c9a9-448e-ae8c-293581b39ca5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:22.969410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbf69b63-c9a9-448e-ae8c-293581b39ca5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:23.046044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-952a545d-9716-4bdb-970d-55f05802cc48 req-124c9865-d92f-4d6f-aab7-6dc98ceaf48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b376f64c-c544-44c9-ba8f-a87b086d4183", "name": "network-vif-deleted", "tag": "a2f5025e-fc06-4c7b-b8d0-9d503e54b32c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:23.075964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-952a545d-9716-4bdb-970d-55f05802cc48 req-124c9865-d92f-4d6f-aab7-6dc98ceaf48a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:23.076844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-952a545d-9716-4bdb-970d-55f05802cc48 req-124c9865-d92f-4d6f-aab7-6dc98ceaf48a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:23.092716 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-952a545d-9716-4bdb-970d-55f05802cc48 req-124c9865-d92f-4d6f-aab7-6dc98ceaf48a service nova] Creating event network-vif-deleted:a2f5025e-fc06-4c7b-b8d0-9d503e54b32c for instance b376f64c-c544-44c9-ba8f-a87b086d4183 on nch1-master-1 Mar 05 21:16:23.103520 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-952a545d-9716-4bdb-970d-55f05802cc48 req-124c9865-d92f-4d6f-aab7-6dc98ceaf48a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060732 Mar 05 21:16:23.105004 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2631/5291] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:16:23.329726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0ceb2df5-5660-4cda-ab50-ca750dcbdef5 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:23.331840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0ceb2df5-5660-4cda-ab50-ca750dcbdef5 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:23.338177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fbf69b63-c9a9-448e-ae8c-293581b39ca5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:23.373826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fbf69b63-c9a9-448e-ae8c-293581b39ca5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:23.375743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ceb2df5-5660-4cda-ab50-ca750dcbdef5 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:23.389425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ceb2df5-5660-4cda-ab50-ca750dcbdef5 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:23.389967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fbf69b63-c9a9-448e-ae8c-293581b39ca5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:23.391419 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fbf69b63-c9a9-448e-ae8c-293581b39ca5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.447858 Mar 05 21:16:23.392443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ceb2df5-5660-4cda-ab50-ca750dcbdef5 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:23.405532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0ceb2df5-5660-4cda-ab50-ca750dcbdef5 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:23.405813 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2661/5292] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:22 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:23.478978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0ef09edf-95a9-476a-a545-f1ddc42bd53b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:23.479786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0ef09edf-95a9-476a-a545-f1ddc42bd53b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:23.498835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0ef09edf-95a9-476a-a545-f1ddc42bd53b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:23.499866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0ef09edf-95a9-476a-a545-f1ddc42bd53b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:23.509893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0ef09edf-95a9-476a-a545-f1ddc42bd53b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:23.512050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0ef09edf-95a9-476a-a545-f1ddc42bd53b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:23.606301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0ef09edf-95a9-476a-a545-f1ddc42bd53b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:23.606978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0ef09edf-95a9-476a-a545-f1ddc42bd53b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:23.611387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-0ef09edf-95a9-476a-a545-f1ddc42bd53b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lazy-loading 'fault' on Instance uuid b376f64c-c544-44c9-ba8f-a87b086d4183 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:16:23.632129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0ceb2df5-5660-4cda-ab50-ca750dcbdef5 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:23.641858 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0ceb2df5-5660-4cda-ab50-ca750dcbdef5 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 200 len: 1277 microversion: 2.1 time: 0.319423 Mar 05 21:16:23.652920 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2632/5293] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:23 2022] GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 1277 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:23.712089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0ef09edf-95a9-476a-a545-f1ddc42bd53b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:23.741555 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0ef09edf-95a9-476a-a545-f1ddc42bd53b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 200 len: 1206 microversion: 2.1 time: 0.250666 Mar 05 21:16:23.757678 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2662/5294] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:23 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 1206 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:16:24.414829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a5286aa2-b7ae-42a4-9f3b-a9217ffaf861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:24.415538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a5286aa2-b7ae-42a4-9f3b-a9217ffaf861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:24.432659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5286aa2-b7ae-42a4-9f3b-a9217ffaf861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:24.433143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5286aa2-b7ae-42a4-9f3b-a9217ffaf861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:24.433927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5286aa2-b7ae-42a4-9f3b-a9217ffaf861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:24.434379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5286aa2-b7ae-42a4-9f3b-a9217ffaf861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:24.661949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4326f3d3-e5d4-4c4d-ae57-07448c3d4a09 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:24.662635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4326f3d3-e5d4-4c4d-ae57-07448c3d4a09 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:24.676449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4326f3d3-e5d4-4c4d-ae57-07448c3d4a09 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:24.680869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4326f3d3-e5d4-4c4d-ae57-07448c3d4a09 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:24.681778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4326f3d3-e5d4-4c4d-ae57-07448c3d4a09 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:24.684910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4326f3d3-e5d4-4c4d-ae57-07448c3d4a09 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:24.786339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a5286aa2-b7ae-42a4-9f3b-a9217ffaf861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:24.803110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a5286aa2-b7ae-42a4-9f3b-a9217ffaf861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:24.810837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a5286aa2-b7ae-42a4-9f3b-a9217ffaf861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:24.813731 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a5286aa2-b7ae-42a4-9f3b-a9217ffaf861 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.402397 Mar 05 21:16:24.814763 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2633/5295] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:24 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:24.827407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-49e6793e-a2cf-4b2d-94aa-564d8dbb9758 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:24.829028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-49e6793e-a2cf-4b2d-94aa-564d8dbb9758 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:24.840642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49e6793e-a2cf-4b2d-94aa-564d8dbb9758 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:24.841838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49e6793e-a2cf-4b2d-94aa-564d8dbb9758 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:24.842662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49e6793e-a2cf-4b2d-94aa-564d8dbb9758 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:24.843377 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49e6793e-a2cf-4b2d-94aa-564d8dbb9758 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:24.873540 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-49e6793e-a2cf-4b2d-94aa-564d8dbb9758 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance b376f64c-c544-44c9-ba8f-a87b086d4183 could not be found. Mar 05 21:16:24.874436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-49e6793e-a2cf-4b2d-94aa-564d8dbb9758 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance b376f64c-c544-44c9-ba8f-a87b086d4183 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:24.875715 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-49e6793e-a2cf-4b2d-94aa-564d8dbb9758 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 404 len: 111 microversion: 2.1 time: 0.057362 Mar 05 21:16:24.908008 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2634/5296] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:24 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:16:25.072581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4326f3d3-e5d4-4c4d-ae57-07448c3d4a09 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:25.083961 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4326f3d3-e5d4-4c4d-ae57-07448c3d4a09 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 200 len: 1319 microversion: 2.1 time: 0.427840 Mar 05 21:16:25.089543 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2663/5297] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:24 2022] GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:25.186143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-81f43f90-bc6c-4ca4-bc46-e86a1c0e7abe req-fa86d01c-fe91-4f80-b09b-508db6b73e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049d553c-3a59-45b8-81e9-7f1164dab605", "tag": "7203ecdd-79fa-473e-bc83-438be5adebd9"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:25.231790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-81f43f90-bc6c-4ca4-bc46-e86a1c0e7abe req-fa86d01c-fe91-4f80-b09b-508db6b73e1a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:25.233446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-81f43f90-bc6c-4ca4-bc46-e86a1c0e7abe req-fa86d01c-fe91-4f80-b09b-508db6b73e1a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:25.272046 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-81f43f90-bc6c-4ca4-bc46-e86a1c0e7abe req-fa86d01c-fe91-4f80-b09b-508db6b73e1a service nova] Creating event network-changed:7203ecdd-79fa-473e-bc83-438be5adebd9 for instance 049d553c-3a59-45b8-81e9-7f1164dab605 on nch1-master-1 Mar 05 21:16:25.286183 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-81f43f90-bc6c-4ca4-bc46-e86a1c0e7abe req-fa86d01c-fe91-4f80-b09b-508db6b73e1a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105710 Mar 05 21:16:25.289079 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2635/5298] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:16:25.837640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a15a31d7-2861-4212-9755-4be567e07450 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:25.838498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a15a31d7-2861-4212-9755-4be567e07450 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:25.854374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a15a31d7-2861-4212-9755-4be567e07450 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:25.855111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a15a31d7-2861-4212-9755-4be567e07450 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:25.858632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a15a31d7-2861-4212-9755-4be567e07450 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:25.859650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a15a31d7-2861-4212-9755-4be567e07450 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:26.010638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f644662c-d84a-43fa-992a-a919fb9b79f6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:26.011519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f644662c-d84a-43fa-992a-a919fb9b79f6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:26.052913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f644662c-d84a-43fa-992a-a919fb9b79f6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:26.053796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f644662c-d84a-43fa-992a-a919fb9b79f6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:26.054853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f644662c-d84a-43fa-992a-a919fb9b79f6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:26.055490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f644662c-d84a-43fa-992a-a919fb9b79f6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:26.120792 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-f644662c-d84a-43fa-992a-a919fb9b79f6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 could not be found. Mar 05 21:16:26.121467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f644662c-d84a-43fa-992a-a919fb9b79f6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:26.124240 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f644662c-d84a-43fa-992a-a919fb9b79f6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "DELETE /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 404 len: 111 microversion: 2.1 time: 0.120343 Mar 05 21:16:26.130518 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2636/5299] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:16:26 2022] DELETE /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:16:26.138693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f8abda56-edef-40eb-91be-94f23298b5b4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:26.144516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f8abda56-edef-40eb-91be-94f23298b5b4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:26.160827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8abda56-edef-40eb-91be-94f23298b5b4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:26.161975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8abda56-edef-40eb-91be-94f23298b5b4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:26.164911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8abda56-edef-40eb-91be-94f23298b5b4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:26.166858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8abda56-edef-40eb-91be-94f23298b5b4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:26.198625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a15a31d7-2861-4212-9755-4be567e07450 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:26.214134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a15a31d7-2861-4212-9755-4be567e07450 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:26.228115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a15a31d7-2861-4212-9755-4be567e07450 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:26.229458 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a15a31d7-2861-4212-9755-4be567e07450 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.398971 Mar 05 21:16:26.230058 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2664/5300] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:25 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:26.254292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-88273629-189c-40c0-a288-d7d3a8881f50 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:26.254938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-88273629-189c-40c0-a288-d7d3a8881f50 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:26.266596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88273629-189c-40c0-a288-d7d3a8881f50 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:26.267088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88273629-189c-40c0-a288-d7d3a8881f50 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:26.272657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88273629-189c-40c0-a288-d7d3a8881f50 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:26.273127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88273629-189c-40c0-a288-d7d3a8881f50 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:26.310973 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-88273629-189c-40c0-a288-d7d3a8881f50 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 could not be found. Mar 05 21:16:26.313756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-88273629-189c-40c0-a288-d7d3a8881f50 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance 91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:26.324887 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-88273629-189c-40c0-a288-d7d3a8881f50 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9" status: 404 len: 111 microversion: 2.1 time: 0.089048 Mar 05 21:16:26.326882 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2665/5301] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:26 2022] GET /compute/v2.1/servers/91c07ccc-b0d2-4cea-81b3-bbd995a7ece9 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:16:26.492952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f8abda56-edef-40eb-91be-94f23298b5b4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:26.501589 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f8abda56-edef-40eb-91be-94f23298b5b4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 200 len: 1319 microversion: 2.1 time: 0.369682 Mar 05 21:16:26.507942 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2637/5302] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:26 2022] GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:27.237665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ce275625-b516-4299-9726-57e2fdbb0c94 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:27.238327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ce275625-b516-4299-9726-57e2fdbb0c94 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:27.248658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce275625-b516-4299-9726-57e2fdbb0c94 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:27.249585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-80e58082-38b9-41e5-808d-b925113100a5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:27.250712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-80e58082-38b9-41e5-808d-b925113100a5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:27.254468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce275625-b516-4299-9726-57e2fdbb0c94 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:27.256769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce275625-b516-4299-9726-57e2fdbb0c94 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:27.259079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce275625-b516-4299-9726-57e2fdbb0c94 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:27.266309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80e58082-38b9-41e5-808d-b925113100a5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:27.266793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80e58082-38b9-41e5-808d-b925113100a5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:27.267641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80e58082-38b9-41e5-808d-b925113100a5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:27.270848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-80e58082-38b9-41e5-808d-b925113100a5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:27.278406 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-ce275625-b516-4299-9726-57e2fdbb0c94 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance b376f64c-c544-44c9-ba8f-a87b086d4183 could not be found. Mar 05 21:16:27.279619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ce275625-b516-4299-9726-57e2fdbb0c94 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance b376f64c-c544-44c9-ba8f-a87b086d4183 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:27.282034 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ce275625-b516-4299-9726-57e2fdbb0c94 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 404 len: 111 microversion: 2.1 time: 0.047582 Mar 05 21:16:27.282766 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2666/5303] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:16:27 2022] DELETE /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:16:27.292201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3219d1b9-c6f9-4022-a3b1-f9c8a96fade6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:27.293087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3219d1b9-c6f9-4022-a3b1-f9c8a96fade6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: b376f64c-c544-44c9-ba8f-a87b086d4183] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:27.301235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3219d1b9-c6f9-4022-a3b1-f9c8a96fade6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:27.301717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3219d1b9-c6f9-4022-a3b1-f9c8a96fade6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:27.302613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3219d1b9-c6f9-4022-a3b1-f9c8a96fade6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:27.303154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3219d1b9-c6f9-4022-a3b1-f9c8a96fade6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:27.323259 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-3219d1b9-c6f9-4022-a3b1-f9c8a96fade6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance b376f64c-c544-44c9-ba8f-a87b086d4183 could not be found. Mar 05 21:16:27.324069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3219d1b9-c6f9-4022-a3b1-f9c8a96fade6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance b376f64c-c544-44c9-ba8f-a87b086d4183 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:16:27.325239 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3219d1b9-c6f9-4022-a3b1-f9c8a96fade6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183" status: 404 len: 111 microversion: 2.1 time: 0.037464 Mar 05 21:16:27.329995 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2667/5304] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:27 2022] GET /compute/v2.1/servers/b376f64c-c544-44c9-ba8f-a87b086d4183 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:16:27.467431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3682b891-1fdd-4b48-8b36-b6e309f404aa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Action: 'create', calling method: .version_select at 0x7fed5c50a790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1698875555"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:27.489752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-3682b891-1fdd-4b48-8b36-b6e309f404aa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for project cdcb29011e61419981c5bfc5f10677c5. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:16:27.495341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-3682b891-1fdd-4b48-8b36-b6e309f404aa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for user 0c07bd2946594c3e8848bca133da0d90 and project cdcb29011e61419981c5bfc5f10677c5. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:16:27.579054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-80e58082-38b9-41e5-808d-b925113100a5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:27.589832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-80e58082-38b9-41e5-808d-b925113100a5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:27.596722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-80e58082-38b9-41e5-808d-b925113100a5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:27.598113 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-80e58082-38b9-41e5-808d-b925113100a5 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.353257 Mar 05 21:16:27.618778 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2638/5305] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:27 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 21:16:27.629444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c96b58b-7f16-4b39-be8b-bc77e79325d3 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:27.630098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4c96b58b-7f16-4b39-be8b-bc77e79325d3 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:27.647898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c96b58b-7f16-4b39-be8b-bc77e79325d3 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:27.648378 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c96b58b-7f16-4b39-be8b-bc77e79325d3 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:27.649198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c96b58b-7f16-4b39-be8b-bc77e79325d3 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:27.649668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c96b58b-7f16-4b39-be8b-bc77e79325d3 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:27.962738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-3682b891-1fdd-4b48-8b36-b6e309f404aa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for project cdcb29011e61419981c5bfc5f10677c5. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:16:27.973152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-3682b891-1fdd-4b48-8b36-b6e309f404aa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for user 0c07bd2946594c3e8848bca133da0d90 and project cdcb29011e61419981c5bfc5f10677c5. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:16:28.004480 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3682b891-1fdd-4b48-8b36-b6e309f404aa tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.541528 Mar 05 21:16:28.005695 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2668/5306] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:16:27 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:16:28.012655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-d58758eb-5c8d-4e8c-9a6c-279e789ce8b9 req-f78c76de-6676-4623-ae10-651891079a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51aeb9d2-5c35-4841-bcb2-7162b1f8752a", "name": "network-vif-plugged", "status": "completed", "tag": "c9af0a09-36af-49e5-919a-b3687886298b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:28.023341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d58758eb-5c8d-4e8c-9a6c-279e789ce8b9 req-f78c76de-6676-4623-ae10-651891079a3c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:28.024799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d58758eb-5c8d-4e8c-9a6c-279e789ce8b9 req-f78c76de-6676-4623-ae10-651891079a3c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:28.042883 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-d58758eb-5c8d-4e8c-9a6c-279e789ce8b9 req-f78c76de-6676-4623-ae10-651891079a3c service nova] Creating event network-vif-plugged:c9af0a09-36af-49e5-919a-b3687886298b for instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a on nch2-master-1 Mar 05 21:16:28.048656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4c96b58b-7f16-4b39-be8b-bc77e79325d3 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:28.060462 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4c96b58b-7f16-4b39-be8b-bc77e79325d3 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 200 len: 1319 microversion: 2.1 time: 0.439972 Mar 05 21:16:28.066063 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2639/5307] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:27 2022] GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 1319 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:28.098879 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-d58758eb-5c8d-4e8c-9a6c-279e789ce8b9 req-f78c76de-6676-4623-ae10-651891079a3c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088959 Mar 05 21:16:28.101787 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2669/5308] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:16:28.983855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-501aa792-2560-4112-a48f-b84e5d7be347 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:28.984612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-501aa792-2560-4112-a48f-b84e5d7be347 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:28.992208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-501aa792-2560-4112-a48f-b84e5d7be347 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:28.992988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-501aa792-2560-4112-a48f-b84e5d7be347 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:28.994061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-501aa792-2560-4112-a48f-b84e5d7be347 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:28.994758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-501aa792-2560-4112-a48f-b84e5d7be347 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:29.085730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e7b8aa13-d84a-40b7-b335-a4dc3a0f09af tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:29.086546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e7b8aa13-d84a-40b7-b335-a4dc3a0f09af tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:29.101726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7b8aa13-d84a-40b7-b335-a4dc3a0f09af tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:29.102191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7b8aa13-d84a-40b7-b335-a4dc3a0f09af tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:29.103010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7b8aa13-d84a-40b7-b335-a4dc3a0f09af tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:29.103460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7b8aa13-d84a-40b7-b335-a4dc3a0f09af tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:29.302206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-501aa792-2560-4112-a48f-b84e5d7be347 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:29.313802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-501aa792-2560-4112-a48f-b84e5d7be347 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:29.316676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-501aa792-2560-4112-a48f-b84e5d7be347 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:29.336492 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-501aa792-2560-4112-a48f-b84e5d7be347 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.716676 Mar 05 21:16:29.338060 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2640/5309] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:28 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:29.860076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e7b8aa13-d84a-40b7-b335-a4dc3a0f09af tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:29.876628 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e7b8aa13-d84a-40b7-b335-a4dc3a0f09af tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 200 len: 1319 microversion: 2.1 time: 0.796636 Mar 05 21:16:29.880090 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2670/5310] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:29 2022] GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 1319 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:16:30.358296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a89d239d-f286-4909-9413-a529004fa449 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:30.365855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a89d239d-f286-4909-9413-a529004fa449 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:30.373851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a89d239d-f286-4909-9413-a529004fa449 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:30.374467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a89d239d-f286-4909-9413-a529004fa449 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:30.375726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a89d239d-f286-4909-9413-a529004fa449 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:30.376365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a89d239d-f286-4909-9413-a529004fa449 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:30.762556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a89d239d-f286-4909-9413-a529004fa449 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:30.791316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a89d239d-f286-4909-9413-a529004fa449 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:30.792895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a89d239d-f286-4909-9413-a529004fa449 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:30.810982 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a89d239d-f286-4909-9413-a529004fa449 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1727 microversion: 2.20 time: 0.439929 Mar 05 21:16:30.812104 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2641/5311] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:30 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1727 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:30.901027 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-589d125b-471c-40d9-a57c-acedfe646d7d tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:30.901928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-589d125b-471c-40d9-a57c-acedfe646d7d tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:30.915201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-589d125b-471c-40d9-a57c-acedfe646d7d tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:30.915908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-589d125b-471c-40d9-a57c-acedfe646d7d tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:30.918046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-589d125b-471c-40d9-a57c-acedfe646d7d tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:30.919048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-589d125b-471c-40d9-a57c-acedfe646d7d tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:31.220691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-589d125b-471c-40d9-a57c-acedfe646d7d tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:31.230347 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-589d125b-471c-40d9-a57c-acedfe646d7d tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 200 len: 1319 microversion: 2.1 time: 0.339477 Mar 05 21:16:31.231020 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2671/5312] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:30 2022] GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:31.848555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5040895f-3455-49a2-977d-c475a046c45a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:31.849616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5040895f-3455-49a2-977d-c475a046c45a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:31.865032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5040895f-3455-49a2-977d-c475a046c45a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:31.865737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5040895f-3455-49a2-977d-c475a046c45a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:31.867084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5040895f-3455-49a2-977d-c475a046c45a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:31.867736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5040895f-3455-49a2-977d-c475a046c45a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:31.958936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ebcfb92a-fe23-46ff-8e07-3bc550e311ed req-92010206-fc13-4731-af6f-90b6a677e4bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049d553c-3a59-45b8-81e9-7f1164dab605", "name": "network-vif-plugged", "status": "completed", "tag": "7203ecdd-79fa-473e-bc83-438be5adebd9"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:31.973278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ebcfb92a-fe23-46ff-8e07-3bc550e311ed req-92010206-fc13-4731-af6f-90b6a677e4bb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:31.975304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ebcfb92a-fe23-46ff-8e07-3bc550e311ed req-92010206-fc13-4731-af6f-90b6a677e4bb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:31.997671 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ebcfb92a-fe23-46ff-8e07-3bc550e311ed req-92010206-fc13-4731-af6f-90b6a677e4bb service nova] Creating event network-vif-plugged:7203ecdd-79fa-473e-bc83-438be5adebd9 for instance 049d553c-3a59-45b8-81e9-7f1164dab605 on nch1-master-1 Mar 05 21:16:32.013054 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ebcfb92a-fe23-46ff-8e07-3bc550e311ed req-92010206-fc13-4731-af6f-90b6a677e4bb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059521 Mar 05 21:16:32.014264 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2672/5313] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:16:32.159382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5040895f-3455-49a2-977d-c475a046c45a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:32.176385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5040895f-3455-49a2-977d-c475a046c45a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:32.180250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5040895f-3455-49a2-977d-c475a046c45a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:32.183361 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5040895f-3455-49a2-977d-c475a046c45a tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1714 microversion: 2.20 time: 0.340228 Mar 05 21:16:32.184879 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2642/5314] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:16:31 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1714 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:16:32.256505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d8eacfc-0856-4229-8cc1-f32b65276474 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:32.258350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7d8eacfc-0856-4229-8cc1-f32b65276474 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:32.268938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d8eacfc-0856-4229-8cc1-f32b65276474 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:32.269691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d8eacfc-0856-4229-8cc1-f32b65276474 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:32.270919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d8eacfc-0856-4229-8cc1-f32b65276474 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:32.271617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d8eacfc-0856-4229-8cc1-f32b65276474 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:32.512861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d8eacfc-0856-4229-8cc1-f32b65276474 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:32.522116 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7d8eacfc-0856-4229-8cc1-f32b65276474 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 200 len: 1319 microversion: 2.1 time: 0.277520 Mar 05 21:16:32.531524 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2673/5315] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:32 2022] GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:33.310003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1254023882", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1698875555", "security_groups": [{"name": "tempest-secgroup-smoke-108176879"}], "block_device_mapping_v2": [{"uuid": "d12389cd-038b-48ad-9624-b01e46ae00b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "82b49213-810d-43f2-9dca-5a622352a45d"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:33.456548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] validate_networks() for [('82b49213-810d-43f2-9dca-5a622352a45d', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:16:33.539694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9d593a14-1e93-4030-ac7d-3ff0cd8c5fc2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:33.540975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9d593a14-1e93-4030-ac7d-3ff0cd8c5fc2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:33.547898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d593a14-1e93-4030-ac7d-3ff0cd8c5fc2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:33.548358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d593a14-1e93-4030-ac7d-3ff0cd8c5fc2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:33.550706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d593a14-1e93-4030-ac7d-3ff0cd8c5fc2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:33.551341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d593a14-1e93-4030-ac7d-3ff0cd8c5fc2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:33.760428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9d593a14-1e93-4030-ac7d-3ff0cd8c5fc2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:33.772088 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9d593a14-1e93-4030-ac7d-3ff0cd8c5fc2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 200 len: 1507 microversion: 2.1 time: 0.236571 Mar 05 21:16:33.773830 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2674/5316] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:33 2022] GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:16:34.316146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:16:34.316669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:16:34.317068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:16:34.317496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:16:34.318074 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:16:34.333125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:34.333589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:34.334534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:34.334858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:34.366660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for project cdcb29011e61419981c5bfc5f10677c5. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:16:34.373522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for user 0c07bd2946594c3e8848bca133da0d90 and project cdcb29011e61419981c5bfc5f10677c5. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:16:34.451592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:16:34.453931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d12389cd-038b-48ad-9624-b01e46ae00b5',volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:16:34.663195 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-79aa95f1-2b28-4803-9245-6192bc0a4e06 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.356998 Mar 05 21:16:34.670348 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2643/5317] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:16:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:16:34.680255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-731340dc-20a3-4647-ad0f-aa91b45db5f2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:34.680895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-731340dc-20a3-4647-ad0f-aa91b45db5f2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:34.866359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-731340dc-20a3-4647-ad0f-aa91b45db5f2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:34.875460 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-731340dc-20a3-4647-ad0f-aa91b45db5f2 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1095 microversion: 2.1 time: 0.203915 Mar 05 21:16:34.879419 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2675/5318] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:34 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1095 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:16:35.903813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1aa42243-21a3-4027-a7e6-d6023647637f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:35.905934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1aa42243-21a3-4027-a7e6-d6023647637f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:35.914328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1aa42243-21a3-4027-a7e6-d6023647637f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:35.915170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1aa42243-21a3-4027-a7e6-d6023647637f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:35.920713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1aa42243-21a3-4027-a7e6-d6023647637f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:35.921185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1aa42243-21a3-4027-a7e6-d6023647637f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:36.010191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1aa42243-21a3-4027-a7e6-d6023647637f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:36.019425 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1aa42243-21a3-4027-a7e6-d6023647637f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1201 microversion: 2.1 time: 0.119512 Mar 05 21:16:36.020603 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2644/5319] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:35 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1201 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:36.482945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b2afebde-a501-4030-ac14-d07de4b2cba8 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2406c7fe-3a07-47be-8091-9b368ce0b6e5", "device": "/dev/sdb"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:36.484266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b2afebde-a501-4030-ac14-d07de4b2cba8 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:36.493720 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2afebde-a501-4030-ac14-d07de4b2cba8 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:36.494314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2afebde-a501-4030-ac14-d07de4b2cba8 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:36.495328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2afebde-a501-4030-ac14-d07de4b2cba8 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:36.496013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b2afebde-a501-4030-ac14-d07de4b2cba8 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:36.823596 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b2afebde-a501-4030-ac14-d07de4b2cba8 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "POST /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344619 Mar 05 21:16:36.824330 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2676/5320] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:16:36 2022] POST /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:16:37.053576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2796a0d1-cf81-4c1e-9b8e-ab246f6622c0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:37.054803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2796a0d1-cf81-4c1e-9b8e-ab246f6622c0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:37.080259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2796a0d1-cf81-4c1e-9b8e-ab246f6622c0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:37.087344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2796a0d1-cf81-4c1e-9b8e-ab246f6622c0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:37.088426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2796a0d1-cf81-4c1e-9b8e-ab246f6622c0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:37.089143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2796a0d1-cf81-4c1e-9b8e-ab246f6622c0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:37.389272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2796a0d1-cf81-4c1e-9b8e-ab246f6622c0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:37.400233 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2796a0d1-cf81-4c1e-9b8e-ab246f6622c0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1278 microversion: 2.1 time: 0.358000 Mar 05 21:16:37.401459 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2645/5321] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:37 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1278 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:37.805390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-4fdb080a-5784-4d77-b1d7-c24df0db7964 req-38e6a0bf-afcb-4194-b60e-fe9e96300045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc84e1f0-ab0d-4abb-94af-c4a562afe24f", "tag": "e8eb19ff-b6cd-4017-b224-013f848e1e14"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:37.826515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4fdb080a-5784-4d77-b1d7-c24df0db7964 req-38e6a0bf-afcb-4194-b60e-fe9e96300045 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:37.826996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4fdb080a-5784-4d77-b1d7-c24df0db7964 req-38e6a0bf-afcb-4194-b60e-fe9e96300045 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:37.859157 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-4fdb080a-5784-4d77-b1d7-c24df0db7964 req-38e6a0bf-afcb-4194-b60e-fe9e96300045 service nova] Creating event network-changed:e8eb19ff-b6cd-4017-b224-013f848e1e14 for instance dc84e1f0-ab0d-4abb-94af-c4a562afe24f on nch2-master-1 Mar 05 21:16:37.865919 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-4fdb080a-5784-4d77-b1d7-c24df0db7964 req-38e6a0bf-afcb-4194-b60e-fe9e96300045 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069721 Mar 05 21:16:37.867076 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2677/5322] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:16:38.418631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a9a79ef7-aa02-45d7-a461-5f9c709b7dde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:38.419274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a9a79ef7-aa02-45d7-a461-5f9c709b7dde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:38.427687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9a79ef7-aa02-45d7-a461-5f9c709b7dde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:38.428167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9a79ef7-aa02-45d7-a461-5f9c709b7dde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:38.429171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9a79ef7-aa02-45d7-a461-5f9c709b7dde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:38.429843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a9a79ef7-aa02-45d7-a461-5f9c709b7dde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:38.711854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a9a79ef7-aa02-45d7-a461-5f9c709b7dde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:38.719922 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a9a79ef7-aa02-45d7-a461-5f9c709b7dde tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1266 microversion: 2.1 time: 0.305217 Mar 05 21:16:38.721040 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2646/5323] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:38 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:39.739205 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f16ed682-da36-43a9-9fed-ecf3ffd6d0be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:39.739984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f16ed682-da36-43a9-9fed-ecf3ffd6d0be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:39.747111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f16ed682-da36-43a9-9fed-ecf3ffd6d0be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:39.747569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f16ed682-da36-43a9-9fed-ecf3ffd6d0be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:39.748388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f16ed682-da36-43a9-9fed-ecf3ffd6d0be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:39.748832 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f16ed682-da36-43a9-9fed-ecf3ffd6d0be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:39.900240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f16ed682-da36-43a9-9fed-ecf3ffd6d0be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:39.907928 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f16ed682-da36-43a9-9fed-ecf3ffd6d0be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1266 microversion: 2.1 time: 0.174432 Mar 05 21:16:39.917421 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2678/5324] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:39 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:40.925478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-70a24920-7931-404d-92c3-13a9afc07715 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:40.926208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-70a24920-7931-404d-92c3-13a9afc07715 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:40.934522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70a24920-7931-404d-92c3-13a9afc07715 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:40.935089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70a24920-7931-404d-92c3-13a9afc07715 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:40.935914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70a24920-7931-404d-92c3-13a9afc07715 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:40.936369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70a24920-7931-404d-92c3-13a9afc07715 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:41.091177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-70a24920-7931-404d-92c3-13a9afc07715 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:41.101523 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-70a24920-7931-404d-92c3-13a9afc07715 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1266 microversion: 2.1 time: 0.180195 Mar 05 21:16:41.102200 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2647/5325] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:40 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:42.119747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0f33d7ab-53e9-40bb-99e9-f87ac4b899a8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:42.120533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0f33d7ab-53e9-40bb-99e9-f87ac4b899a8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:42.128744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f33d7ab-53e9-40bb-99e9-f87ac4b899a8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:42.129248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f33d7ab-53e9-40bb-99e9-f87ac4b899a8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:42.130389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f33d7ab-53e9-40bb-99e9-f87ac4b899a8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:42.131038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f33d7ab-53e9-40bb-99e9-f87ac4b899a8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:42.306272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0f33d7ab-53e9-40bb-99e9-f87ac4b899a8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:42.313632 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0f33d7ab-53e9-40bb-99e9-f87ac4b899a8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1266 microversion: 2.1 time: 0.198429 Mar 05 21:16:42.314254 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2679/5326] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:42 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:43.331354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-39318154-3c01-45b7-bafb-64662a77a1cd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:43.332021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-39318154-3c01-45b7-bafb-64662a77a1cd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:43.338653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39318154-3c01-45b7-bafb-64662a77a1cd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:43.339117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39318154-3c01-45b7-bafb-64662a77a1cd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:43.339927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39318154-3c01-45b7-bafb-64662a77a1cd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:43.340380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39318154-3c01-45b7-bafb-64662a77a1cd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:43.497198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-39318154-3c01-45b7-bafb-64662a77a1cd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:43.507758 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-39318154-3c01-45b7-bafb-64662a77a1cd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1266 microversion: 2.1 time: 0.180824 Mar 05 21:16:43.508354 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2648/5327] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:43 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:43.575201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-90ba99ff-6219-40f0-aa7f-ad515dfc62b8 req-215f5841-b0a2-48e3-8e03-5b117f858937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc84e1f0-ab0d-4abb-94af-c4a562afe24f", "name": "network-vif-plugged", "status": "completed", "tag": "e8eb19ff-b6cd-4017-b224-013f848e1e14"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:43.584957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-90ba99ff-6219-40f0-aa7f-ad515dfc62b8 req-215f5841-b0a2-48e3-8e03-5b117f858937 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:43.585412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-90ba99ff-6219-40f0-aa7f-ad515dfc62b8 req-215f5841-b0a2-48e3-8e03-5b117f858937 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:43.597306 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-90ba99ff-6219-40f0-aa7f-ad515dfc62b8 req-215f5841-b0a2-48e3-8e03-5b117f858937 service nova] Creating event network-vif-plugged:e8eb19ff-b6cd-4017-b224-013f848e1e14 for instance dc84e1f0-ab0d-4abb-94af-c4a562afe24f on nch2-master-1 Mar 05 21:16:43.602260 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-90ba99ff-6219-40f0-aa7f-ad515dfc62b8 req-215f5841-b0a2-48e3-8e03-5b117f858937 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031289 Mar 05 21:16:43.602869 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2680/5328] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:16:44.525561 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a0f2aa63-14c9-4eb2-9bb1-c3b7a19d89be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:44.526231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a0f2aa63-14c9-4eb2-9bb1-c3b7a19d89be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:44.532721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0f2aa63-14c9-4eb2-9bb1-c3b7a19d89be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:44.534113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0f2aa63-14c9-4eb2-9bb1-c3b7a19d89be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:44.534595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0f2aa63-14c9-4eb2-9bb1-c3b7a19d89be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:44.535047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0f2aa63-14c9-4eb2-9bb1-c3b7a19d89be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:44.677550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a0f2aa63-14c9-4eb2-9bb1-c3b7a19d89be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:44.685047 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a0f2aa63-14c9-4eb2-9bb1-c3b7a19d89be tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1266 microversion: 2.1 time: 0.163402 Mar 05 21:16:44.685627 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2649/5329] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:44 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:45.708325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c3c581fd-c450-4056-9bd4-f84a2ff7af3d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:45.710399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c3c581fd-c450-4056-9bd4-f84a2ff7af3d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:45.723631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3c581fd-c450-4056-9bd4-f84a2ff7af3d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:45.724508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3c581fd-c450-4056-9bd4-f84a2ff7af3d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:45.726008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3c581fd-c450-4056-9bd4-f84a2ff7af3d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:45.726831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3c581fd-c450-4056-9bd4-f84a2ff7af3d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:45.891256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c3c581fd-c450-4056-9bd4-f84a2ff7af3d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:45.902474 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c3c581fd-c450-4056-9bd4-f84a2ff7af3d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1452 microversion: 2.1 time: 0.202849 Mar 05 21:16:45.907940 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2681/5330] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:45 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:45.925705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-707dbe67-f6e3-4fc2-90e0-4b2526b63f55 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:16:45.926339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-707dbe67-f6e3-4fc2-90e0-4b2526b63f55 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:16:45.933759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-707dbe67-f6e3-4fc2-90e0-4b2526b63f55 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:45.934242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-707dbe67-f6e3-4fc2-90e0-4b2526b63f55 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:45.935131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-707dbe67-f6e3-4fc2-90e0-4b2526b63f55 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:45.935596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-707dbe67-f6e3-4fc2-90e0-4b2526b63f55 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:46.080352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-707dbe67-f6e3-4fc2-90e0-4b2526b63f55 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:16:46.088573 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-707dbe67-f6e3-4fc2-90e0-4b2526b63f55 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1452 microversion: 2.1 time: 0.167398 Mar 05 21:16:46.089148 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2650/5331] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:16:45 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:16:48.405490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b314dc57-fe38-417f-948c-960fd9aef03c req-fa439e10-e90b-4ca0-a114-294b58208cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc84e1f0-ab0d-4abb-94af-c4a562afe24f", "tag": "e8eb19ff-b6cd-4017-b224-013f848e1e14"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:16:48.415057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b314dc57-fe38-417f-948c-960fd9aef03c req-fa439e10-e90b-4ca0-a114-294b58208cb8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:16:48.415521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b314dc57-fe38-417f-948c-960fd9aef03c req-fa439e10-e90b-4ca0-a114-294b58208cb8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:16:48.427574 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b314dc57-fe38-417f-948c-960fd9aef03c req-fa439e10-e90b-4ca0-a114-294b58208cb8 service nova] Creating event network-changed:e8eb19ff-b6cd-4017-b224-013f848e1e14 for instance dc84e1f0-ab0d-4abb-94af-c4a562afe24f on nch2-master-1 Mar 05 21:16:48.432802 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b314dc57-fe38-417f-948c-960fd9aef03c req-fa439e10-e90b-4ca0-a114-294b58208cb8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031143 Mar 05 21:16:48.433593 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2682/5332] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:17:02.821106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f322dd83-abe6-461a-84c6-41550413cace tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:02.822111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f322dd83-abe6-461a-84c6-41550413cace tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:02.828877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f322dd83-abe6-461a-84c6-41550413cace tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:02.829418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f322dd83-abe6-461a-84c6-41550413cace tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:02.830222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f322dd83-abe6-461a-84c6-41550413cace tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:02.830687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f322dd83-abe6-461a-84c6-41550413cace tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:02.866679 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f322dd83-abe6-461a-84c6-41550413cace tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049646 Mar 05 21:17:02.867267 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2651/5333] 10.222.0.15 () {60 vars in 1342 bytes} [Sat Mar 5 21:17:02 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:17:02.940182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a114fae9-801e-4a86-8045-ec517e2c0c85 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:02.940796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a114fae9-801e-4a86-8045-ec517e2c0c85 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:02.947632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a114fae9-801e-4a86-8045-ec517e2c0c85 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:02.948303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a114fae9-801e-4a86-8045-ec517e2c0c85 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:02.949366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a114fae9-801e-4a86-8045-ec517e2c0c85 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:02.949949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a114fae9-801e-4a86-8045-ec517e2c0c85 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:02.995423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a114fae9-801e-4a86-8045-ec517e2c0c85 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:17:03.088055 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a114fae9-801e-4a86-8045-ec517e2c0c85 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "DELETE /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 204 len: 0 microversion: 2.20 time: 0.154496 Mar 05 21:17:03.088929 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2683/5334] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:17:02 2022] DELETE /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:17:03.099011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1450866d-e5e5-45b5-a35f-7674eb934c15 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:03.100115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1450866d-e5e5-45b5-a35f-7674eb934c15 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:03.106813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1450866d-e5e5-45b5-a35f-7674eb934c15 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:03.107552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1450866d-e5e5-45b5-a35f-7674eb934c15 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:03.108652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1450866d-e5e5-45b5-a35f-7674eb934c15 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:03.109173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1450866d-e5e5-45b5-a35f-7674eb934c15 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:03.275010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1450866d-e5e5-45b5-a35f-7674eb934c15 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:17:03.283400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1450866d-e5e5-45b5-a35f-7674eb934c15 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:17:03.286399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1450866d-e5e5-45b5-a35f-7674eb934c15 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:17:03.288577 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1450866d-e5e5-45b5-a35f-7674eb934c15 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1720 microversion: 2.20 time: 0.193998 Mar 05 21:17:03.289177 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2652/5335] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:17:03 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:17:04.309142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a96bd847-1dd0-44b3-b706-e1051c678adc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:04.310239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a96bd847-1dd0-44b3-b706-e1051c678adc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:04.321488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a96bd847-1dd0-44b3-b706-e1051c678adc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:04.322782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a96bd847-1dd0-44b3-b706-e1051c678adc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:04.324476 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a96bd847-1dd0-44b3-b706-e1051c678adc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:04.328568 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a96bd847-1dd0-44b3-b706-e1051c678adc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:04.528208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a96bd847-1dd0-44b3-b706-e1051c678adc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:17:04.539178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a96bd847-1dd0-44b3-b706-e1051c678adc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:17:04.541147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a96bd847-1dd0-44b3-b706-e1051c678adc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:17:04.542521 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a96bd847-1dd0-44b3-b706-e1051c678adc tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1720 microversion: 2.20 time: 0.238118 Mar 05 21:17:04.543860 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2684/5336] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:17:04 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:17:05.561185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a91b7bbb-c35d-46af-9a39-0041b3fd2144 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:05.561867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a91b7bbb-c35d-46af-9a39-0041b3fd2144 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:05.572076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a91b7bbb-c35d-46af-9a39-0041b3fd2144 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:05.573008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a91b7bbb-c35d-46af-9a39-0041b3fd2144 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:05.573961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a91b7bbb-c35d-46af-9a39-0041b3fd2144 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:05.574556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a91b7bbb-c35d-46af-9a39-0041b3fd2144 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:05.663703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a91b7bbb-c35d-46af-9a39-0041b3fd2144 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:17:05.674815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a91b7bbb-c35d-46af-9a39-0041b3fd2144 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:17:05.676390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a91b7bbb-c35d-46af-9a39-0041b3fd2144 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '469bc2b7ea9e4727a0f0356e9a08dcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b37634bef4eefa974dfc8912e8556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:17:05.677751 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a91b7bbb-c35d-46af-9a39-0041b3fd2144 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 200 len: 1653 microversion: 2.20 time: 0.121125 Mar 05 21:17:05.678801 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2653/5337] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:17:05 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 1653 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 21:17:06.103077 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-1d5cc346-aa0b-4bac-93d4-56921bcf27b7 req-7b56eae2-a8c2-4c72-aefe-ec5cb8e439e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51aeb9d2-5c35-4841-bcb2-7162b1f8752a", "name": "network-vif-deleted", "tag": "c9af0a09-36af-49e5-919a-b3687886298b"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:17:06.128622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1d5cc346-aa0b-4bac-93d4-56921bcf27b7 req-7b56eae2-a8c2-4c72-aefe-ec5cb8e439e7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:06.129068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1d5cc346-aa0b-4bac-93d4-56921bcf27b7 req-7b56eae2-a8c2-4c72-aefe-ec5cb8e439e7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:06.152435 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-1d5cc346-aa0b-4bac-93d4-56921bcf27b7 req-7b56eae2-a8c2-4c72-aefe-ec5cb8e439e7 service nova] Creating event network-vif-deleted:c9af0a09-36af-49e5-919a-b3687886298b for instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a on nch2-master-1 Mar 05 21:17:06.163125 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-1d5cc346-aa0b-4bac-93d4-56921bcf27b7 req-7b56eae2-a8c2-4c72-aefe-ec5cb8e439e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064012 Mar 05 21:17:06.164390 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2685/5338] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:17:06.697540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-388a9adb-a905-4f63-bad0-65da806db958 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:06.698247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-388a9adb-a905-4f63-bad0-65da806db958 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:06.710451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-388a9adb-a905-4f63-bad0-65da806db958 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:06.711172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-388a9adb-a905-4f63-bad0-65da806db958 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:06.712146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-388a9adb-a905-4f63-bad0-65da806db958 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:06.712773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-388a9adb-a905-4f63-bad0-65da806db958 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:06.734965 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-388a9adb-a905-4f63-bad0-65da806db958 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] HTTP exception thrown: Instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a could not be found. Mar 05 21:17:06.736216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-388a9adb-a905-4f63-bad0-65da806db958 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Returning 404 to user: Instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:17:06.737553 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-388a9adb-a905-4f63-bad0-65da806db958 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 404 len: 111 microversion: 2.20 time: 0.044620 Mar 05 21:17:06.738136 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2654/5339] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:17:06 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 05 21:17:06.748275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f3497dab-d3ac-4fdf-b101-570854b72195 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '.version_select at 0x7fed4f6aa9d0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:06.772684 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f3497dab-d3ac-4fdf-b101-570854b72195 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46430123" status: 204 len: 0 microversion: 2.20 time: 0.029208 Mar 05 21:17:06.778315 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2686/5340] 10.222.0.15 () {60 vars in 1255 bytes} [Sat Mar 5 21:17:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46430123 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 21:17:09.148250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23029a87-6244-46ba-b0aa-6cbb416f4476 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:09.154980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-23029a87-6244-46ba-b0aa-6cbb416f4476 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:09.164830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23029a87-6244-46ba-b0aa-6cbb416f4476 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:09.165607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23029a87-6244-46ba-b0aa-6cbb416f4476 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:09.166544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23029a87-6244-46ba-b0aa-6cbb416f4476 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:09.167141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-23029a87-6244-46ba-b0aa-6cbb416f4476 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:09.183563 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-23029a87-6244-46ba-b0aa-6cbb416f4476 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] HTTP exception thrown: Instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a could not be found. Mar 05 21:17:09.184557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-23029a87-6244-46ba-b0aa-6cbb416f4476 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Returning 404 to user: Instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:17:09.185940 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-23029a87-6244-46ba-b0aa-6cbb416f4476 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "DELETE /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 404 len: 111 microversion: 2.20 time: 0.041513 Mar 05 21:17:09.186837 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2655/5341] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:17:09 2022] DELETE /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:17:09.196652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-126807f1-39ec-48b1-bd9f-5d561d2cc023 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:09.198051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-126807f1-39ec-48b1-bd9f-5d561d2cc023 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: 51aeb9d2-5c35-4841-bcb2-7162b1f8752a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:09.207129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-126807f1-39ec-48b1-bd9f-5d561d2cc023 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:09.207918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-126807f1-39ec-48b1-bd9f-5d561d2cc023 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:09.208912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-126807f1-39ec-48b1-bd9f-5d561d2cc023 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:09.209563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-126807f1-39ec-48b1-bd9f-5d561d2cc023 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:09.224895 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-126807f1-39ec-48b1-bd9f-5d561d2cc023 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] HTTP exception thrown: Instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a could not be found. Mar 05 21:17:09.225897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-126807f1-39ec-48b1-bd9f-5d561d2cc023 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Returning 404 to user: Instance 51aeb9d2-5c35-4841-bcb2-7162b1f8752a could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:17:09.226867 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-126807f1-39ec-48b1-bd9f-5d561d2cc023 tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a" status: 404 len: 111 microversion: 2.20 time: 0.035395 Mar 05 21:17:09.227537 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2687/5342] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:17:09 2022] GET /compute/v2.1/servers/51aeb9d2-5c35-4841-bcb2-7162b1f8752a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:17:10.389455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0db93684-8158-4e2e-a6a3-21a06541c0ae tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:10.390634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0db93684-8158-4e2e-a6a3-21a06541c0ae tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:10.400222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0db93684-8158-4e2e-a6a3-21a06541c0ae tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:10.400713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0db93684-8158-4e2e-a6a3-21a06541c0ae tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:10.401804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0db93684-8158-4e2e-a6a3-21a06541c0ae tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:10.402531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0db93684-8158-4e2e-a6a3-21a06541c0ae tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:10.421276 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-0db93684-8158-4e2e-a6a3-21a06541c0ae tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] HTTP exception thrown: Instance ba05bcb0-9bc3-42c9-a011-c592459cce1e could not be found. Mar 05 21:17:10.421916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0db93684-8158-4e2e-a6a3-21a06541c0ae tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Returning 404 to user: Instance ba05bcb0-9bc3-42c9-a011-c592459cce1e could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:17:10.423394 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0db93684-8158-4e2e-a6a3-21a06541c0ae tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 404 len: 111 microversion: 2.20 time: 0.045395 Mar 05 21:17:10.424014 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2656/5343] 10.222.0.15 () {60 vars in 1279 bytes} [Sat Mar 5 21:17:10 2022] DELETE /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:17:10.433422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-80b96d10-d2e1-418d-b875-7cc08aea672d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:10.434751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-80b96d10-d2e1-418d-b875-7cc08aea672d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] [instance: ba05bcb0-9bc3-42c9-a011-c592459cce1e] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:10.442503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80b96d10-d2e1-418d-b875-7cc08aea672d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:10.443004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80b96d10-d2e1-418d-b875-7cc08aea672d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:10.443928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80b96d10-d2e1-418d-b875-7cc08aea672d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:10.444410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80b96d10-d2e1-418d-b875-7cc08aea672d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:10.459900 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-80b96d10-d2e1-418d-b875-7cc08aea672d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] HTTP exception thrown: Instance ba05bcb0-9bc3-42c9-a011-c592459cce1e could not be found. Mar 05 21:17:10.460773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-80b96d10-d2e1-418d-b875-7cc08aea672d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] Returning 404 to user: Instance ba05bcb0-9bc3-42c9-a011-c592459cce1e could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:17:10.461689 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-80b96d10-d2e1-418d-b875-7cc08aea672d tempest-AttachVolumeShelveTestJSON-1318940295 tempest-AttachVolumeShelveTestJSON-1318940295-project] 10.222.0.15 "GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e" status: 404 len: 111 microversion: 2.20 time: 0.032815 Mar 05 21:17:10.462269 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2688/5344] 10.222.0.15 () {60 vars in 1276 bytes} [Sat Mar 5 21:17:10 2022] GET /compute/v2.1/servers/ba05bcb0-9bc3-42c9-a011-c592459cce1e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:17:16.845551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45750f10-8688-4956-bddb-4496ab9e33a2 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] Action: 'create', calling method: .version_select at 0x7fed4f9b11f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1555042271", "metadata": {"Type": "work"}}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:17:16.847403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45750f10-8688-4956-bddb-4496ab9e33a2 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:17:16.848481 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45750f10-8688-4956-bddb-4496ab9e33a2 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.145645 Mar 05 21:17:16.849098 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2657/5345] 10.222.0.15 () {60 vars in 1155 bytes} [Sat Mar 5 21:17:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 05 21:17:16.862010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d8daed89-2331-416a-ba1b-6764badfc60a tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] Action: 'create', calling method: .version_select at 0x7fed4f89bd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2139656539", "metadata": {"Type": "work"}}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:17:16.864042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d8daed89-2331-416a-ba1b-6764badfc60a tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:17:16.865448 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d8daed89-2331-416a-ba1b-6764badfc60a tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008991 Mar 05 21:17:16.866402 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2689/5346] 10.222.0.15 () {60 vars in 1155 bytes} [Sat Mar 5 21:17:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:17:16.877795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-afde77c5-40b9-4595-bb22-d63441dc1234 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] Action: 'create', calling method: .version_select at 0x7fed61a854c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-381365223", "metadata": {"Type": "work"}}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:17:16.880432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-afde77c5-40b9-4595-bb22-d63441dc1234 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:17:16.881361 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-afde77c5-40b9-4595-bb22-d63441dc1234 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008271 Mar 05 21:17:16.881951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2658/5347] 10.222.0.15 () {60 vars in 1155 bytes} [Sat Mar 5 21:17:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:17:16.902736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7319e28c-bb45-4c2e-9de2-931b28147bc8 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] Calling method '.version_select at 0x7fed5c4c44c0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:16.941321 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-7319e28c-bb45-4c2e-9de2-931b28147bc8 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] HTTP exception thrown: Volume tempest-invalid-2090130506 could not be found. Mar 05 21:17:16.941925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7319e28c-bb45-4c2e-9de2-931b28147bc8 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] Returning 404 to user: Volume tempest-invalid-2090130506 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:17:16.942759 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7319e28c-bb45-4c2e-9de2-931b28147bc8 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2090130506" status: 404 len: 99 microversion: 2.1 time: 0.047272 Mar 05 21:17:16.943317 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2690/5348] 10.222.0.15 () {58 vars in 1217 bytes} [Sat Mar 5 21:17:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2090130506 => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 21:17:16.952409 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7fdddbe4-7742-4119-a0c4-d56d908f8d6d tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003829 Mar 05 21:17:16.952967 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2659/5349] 10.222.0.15 () {58 vars in 1139 bytes} [Sat Mar 5 21:17:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Mar 05 21:17:16.963564 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-769e6762-2288-4aab-be46-32e7ffa20a63 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004222 Mar 05 21:17:16.964485 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2691/5350] 10.222.0.15 () {58 vars in 1136 bytes} [Sat Mar 5 21:17:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Mar 05 21:17:16.974885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0704f285-1001-4537-829a-d73729d4d23b tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] Calling method '.version_select at 0x7fed4f9b1160>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:17.007238 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-0704f285-1001-4537-829a-d73729d4d23b tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] HTTP exception thrown: Volume d69cac72-edb1-48af-aa69-3232cf18c5d1 could not be found. Mar 05 21:17:17.007909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0704f285-1001-4537-829a-d73729d4d23b tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] Returning 404 to user: Volume d69cac72-edb1-48af-aa69-3232cf18c5d1 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:17:17.010061 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0704f285-1001-4537-829a-d73729d4d23b tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/d69cac72-edb1-48af-aa69-3232cf18c5d1" status: 404 len: 109 microversion: 2.1 time: 0.040754 Mar 05 21:17:17.010881 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2660/5351] 10.222.0.15 () {58 vars in 1247 bytes} [Sat Mar 5 21:17:16 2022] DELETE /compute/v2.1/os-volumes/d69cac72-edb1-48af-aa69-3232cf18c5d1 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:17:17.020192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ec113060-4aaa-4375-8e34-d407df7ae536 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] Calling method '.version_select at 0x7fed4f89bf70>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:17.048357 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-ec113060-4aaa-4375-8e34-d407df7ae536 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] HTTP exception thrown: Volume c7efcd83-3464-4e2c-8d35-e4a89f09d2c1 could not be found. Mar 05 21:17:17.049075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ec113060-4aaa-4375-8e34-d407df7ae536 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] Returning 404 to user: Volume c7efcd83-3464-4e2c-8d35-e4a89f09d2c1 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:17:17.050078 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ec113060-4aaa-4375-8e34-d407df7ae536 tempest-VolumesNegativeTest-1057609658 tempest-VolumesNegativeTest-1057609658-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c7efcd83-3464-4e2c-8d35-e4a89f09d2c1" status: 404 len: 109 microversion: 2.1 time: 0.034071 Mar 05 21:17:17.050711 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2692/5352] 10.222.0.15 () {58 vars in 1244 bytes} [Sat Mar 5 21:17:17 2022] GET /compute/v2.1/os-volumes/c7efcd83-3464-4e2c-8d35-e4a89f09d2c1 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:17:55.519482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-972637948", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "ea5887a4-145c-4e15-a815-e64b031aee42"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:17:55.573245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] validate_networks() for [('ea5887a4-145c-4e15-a815-e64b031aee42', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:17:55.993490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:17:55.994563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:17:55.995344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:17:55.996033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:17:55.996445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:17:56.006833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:56.007466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:56.009072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:56.009531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:56.032483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Getting quotas for project eab95caff9f845b1951f04a7a03185a1. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:17:56.037664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Getting quotas for user 96ec8e4bd1044eb286b5427f02a1f4b1 and project eab95caff9f845b1951f04a7a03185a1. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:17:56.051386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:17:56.053848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:17:56.100559 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6417f4bf-c11e-417c-a299-ac28e707b217 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717018 Mar 05 21:17:56.106102 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2661/5353] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:17:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:17:56.113940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-76fe4994-0d7a-4b7b-b0bf-d693a71d79ca tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:56.114709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-76fe4994-0d7a-4b7b-b0bf-d693a71d79ca tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:56.170159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-76fe4994-0d7a-4b7b-b0bf-d693a71d79ca tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ec8e4bd1044eb286b5427f02a1f4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab95caff9f845b1951f04a7a03185a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:17:56.178115 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-76fe4994-0d7a-4b7b-b0bf-d693a71d79ca tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d" status: 200 len: 1213 microversion: 2.1 time: 0.069646 Mar 05 21:17:56.178921 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2693/5354] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:17:56 2022] GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:17:57.196506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-333264cb-37fe-4c59-81bc-5d32fd08b62b tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:57.197133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-333264cb-37fe-4c59-81bc-5d32fd08b62b tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:57.206094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-333264cb-37fe-4c59-81bc-5d32fd08b62b tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:57.206567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-333264cb-37fe-4c59-81bc-5d32fd08b62b tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:57.207373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-333264cb-37fe-4c59-81bc-5d32fd08b62b tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:57.207850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-333264cb-37fe-4c59-81bc-5d32fd08b62b tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:57.287589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-333264cb-37fe-4c59-81bc-5d32fd08b62b tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ec8e4bd1044eb286b5427f02a1f4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab95caff9f845b1951f04a7a03185a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:17:57.298108 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-333264cb-37fe-4c59-81bc-5d32fd08b62b tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d" status: 200 len: 1271 microversion: 2.1 time: 0.106498 Mar 05 21:17:57.299453 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2662/5355] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:17:57 2022] GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:17:58.318304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fdbeadd1-bd29-4ec1-bb5f-fe2c83480884 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:58.319466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fdbeadd1-bd29-4ec1-bb5f-fe2c83480884 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:58.329899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fdbeadd1-bd29-4ec1-bb5f-fe2c83480884 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:58.330383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fdbeadd1-bd29-4ec1-bb5f-fe2c83480884 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:58.331365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fdbeadd1-bd29-4ec1-bb5f-fe2c83480884 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:58.332165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fdbeadd1-bd29-4ec1-bb5f-fe2c83480884 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:58.523158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fdbeadd1-bd29-4ec1-bb5f-fe2c83480884 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ec8e4bd1044eb286b5427f02a1f4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab95caff9f845b1951f04a7a03185a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:17:58.531202 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fdbeadd1-bd29-4ec1-bb5f-fe2c83480884 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d" status: 200 len: 1313 microversion: 2.1 time: 0.217502 Mar 05 21:17:58.533838 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2694/5356] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:17:58 2022] GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:17:58.612474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-11e1599b-c882-40e6-be41-d658b3aaa78b req-a9588063-ea78-4cb6-8c6b-6a280abb8c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a6ec84-62d0-4cc5-817f-b5ec9c37b03d", "tag": "bf298e9c-ffdd-4ce0-b069-7ac7be0fa01a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:17:58.623964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-11e1599b-c882-40e6-be41-d658b3aaa78b req-a9588063-ea78-4cb6-8c6b-6a280abb8c2e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:58.624687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-11e1599b-c882-40e6-be41-d658b3aaa78b req-a9588063-ea78-4cb6-8c6b-6a280abb8c2e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:58.641095 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-11e1599b-c882-40e6-be41-d658b3aaa78b req-a9588063-ea78-4cb6-8c6b-6a280abb8c2e service nova] Creating event network-changed:bf298e9c-ffdd-4ce0-b069-7ac7be0fa01a for instance 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d on nch1-master-1 Mar 05 21:17:58.647917 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-11e1599b-c882-40e6-be41-d658b3aaa78b req-a9588063-ea78-4cb6-8c6b-6a280abb8c2e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041739 Mar 05 21:17:58.648642 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2663/5357] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:17:59.551060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f5bc5967-97f1-4cf6-8ea1-56c87b150a0e tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:17:59.560266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f5bc5967-97f1-4cf6-8ea1-56c87b150a0e tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:17:59.571294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f5bc5967-97f1-4cf6-8ea1-56c87b150a0e tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:59.571790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f5bc5967-97f1-4cf6-8ea1-56c87b150a0e tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:59.572597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f5bc5967-97f1-4cf6-8ea1-56c87b150a0e tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:17:59.573222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f5bc5967-97f1-4cf6-8ea1-56c87b150a0e tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:17:59.720542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f5bc5967-97f1-4cf6-8ea1-56c87b150a0e tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ec8e4bd1044eb286b5427f02a1f4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab95caff9f845b1951f04a7a03185a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:17:59.728456 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f5bc5967-97f1-4cf6-8ea1-56c87b150a0e tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d" status: 200 len: 1313 microversion: 2.1 time: 0.181956 Mar 05 21:17:59.729035 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2695/5358] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:17:59 2022] GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:00.748112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4ca2f0c6-6b0a-4946-8c0a-85703d6da8f0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:00.748844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4ca2f0c6-6b0a-4946-8c0a-85703d6da8f0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:00.756244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ca2f0c6-6b0a-4946-8c0a-85703d6da8f0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:00.756715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ca2f0c6-6b0a-4946-8c0a-85703d6da8f0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:00.757504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ca2f0c6-6b0a-4946-8c0a-85703d6da8f0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:00.757969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4ca2f0c6-6b0a-4946-8c0a-85703d6da8f0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:00.900036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4ca2f0c6-6b0a-4946-8c0a-85703d6da8f0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ec8e4bd1044eb286b5427f02a1f4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab95caff9f845b1951f04a7a03185a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:00.907625 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4ca2f0c6-6b0a-4946-8c0a-85703d6da8f0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d" status: 200 len: 1313 microversion: 2.1 time: 0.164851 Mar 05 21:18:00.908238 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2664/5359] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:00 2022] GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:01.924215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-50acd988-f8ee-4570-93de-0712dbb980a4 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:01.924839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-50acd988-f8ee-4570-93de-0712dbb980a4 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:01.931604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-50acd988-f8ee-4570-93de-0712dbb980a4 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:01.932106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-50acd988-f8ee-4570-93de-0712dbb980a4 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:01.932884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-50acd988-f8ee-4570-93de-0712dbb980a4 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:01.933328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-50acd988-f8ee-4570-93de-0712dbb980a4 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:02.072803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-50acd988-f8ee-4570-93de-0712dbb980a4 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ec8e4bd1044eb286b5427f02a1f4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab95caff9f845b1951f04a7a03185a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:02.081204 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-50acd988-f8ee-4570-93de-0712dbb980a4 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d" status: 200 len: 1313 microversion: 2.1 time: 0.160894 Mar 05 21:18:02.081832 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2696/5360] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:01 2022] GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:03.098231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1b2fe353-08bc-4d3d-bb85-ce68efa50579 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:03.098971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1b2fe353-08bc-4d3d-bb85-ce68efa50579 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:03.105857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b2fe353-08bc-4d3d-bb85-ce68efa50579 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:03.106492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b2fe353-08bc-4d3d-bb85-ce68efa50579 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:03.107388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b2fe353-08bc-4d3d-bb85-ce68efa50579 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:03.107936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b2fe353-08bc-4d3d-bb85-ce68efa50579 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:03.259184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1b2fe353-08bc-4d3d-bb85-ce68efa50579 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ec8e4bd1044eb286b5427f02a1f4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab95caff9f845b1951f04a7a03185a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:03.266953 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1b2fe353-08bc-4d3d-bb85-ce68efa50579 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d" status: 200 len: 1313 microversion: 2.1 time: 0.172818 Mar 05 21:18:03.267532 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2665/5361] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:03 2022] GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:04.172092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-1900c3b5-fb80-468e-9771-0bc9a6b1fe1e req-3492b06d-bbf8-477a-aa08-2eec9dde256f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a6ec84-62d0-4cc5-817f-b5ec9c37b03d", "name": "network-vif-plugged", "status": "completed", "tag": "bf298e9c-ffdd-4ce0-b069-7ac7be0fa01a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:18:04.182526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1900c3b5-fb80-468e-9771-0bc9a6b1fe1e req-3492b06d-bbf8-477a-aa08-2eec9dde256f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:04.182968 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1900c3b5-fb80-468e-9771-0bc9a6b1fe1e req-3492b06d-bbf8-477a-aa08-2eec9dde256f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:04.200455 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-1900c3b5-fb80-468e-9771-0bc9a6b1fe1e req-3492b06d-bbf8-477a-aa08-2eec9dde256f service nova] Creating event network-vif-plugged:bf298e9c-ffdd-4ce0-b069-7ac7be0fa01a for instance 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d on nch1-master-1 Mar 05 21:18:04.207375 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-1900c3b5-fb80-468e-9771-0bc9a6b1fe1e req-3492b06d-bbf8-477a-aa08-2eec9dde256f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039970 Mar 05 21:18:04.208774 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2697/5362] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:18:04.283794 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3892aed7-5746-4a7d-95a7-f8d0be25c76f tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:04.285076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3892aed7-5746-4a7d-95a7-f8d0be25c76f tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:04.292802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3892aed7-5746-4a7d-95a7-f8d0be25c76f tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:04.293279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3892aed7-5746-4a7d-95a7-f8d0be25c76f tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:04.294257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3892aed7-5746-4a7d-95a7-f8d0be25c76f tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:04.294722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3892aed7-5746-4a7d-95a7-f8d0be25c76f tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:04.464391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3892aed7-5746-4a7d-95a7-f8d0be25c76f tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ec8e4bd1044eb286b5427f02a1f4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab95caff9f845b1951f04a7a03185a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:04.473555 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3892aed7-5746-4a7d-95a7-f8d0be25c76f tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d" status: 200 len: 1313 microversion: 2.1 time: 0.193811 Mar 05 21:18:04.474141 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2666/5363] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:04 2022] GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:05.492766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7a8366ec-4de7-4a52-857e-e27067a54ae8 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:05.493503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7a8366ec-4de7-4a52-857e-e27067a54ae8 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:05.499789 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a8366ec-4de7-4a52-857e-e27067a54ae8 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:05.500265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a8366ec-4de7-4a52-857e-e27067a54ae8 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:05.501597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a8366ec-4de7-4a52-857e-e27067a54ae8 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:05.502061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a8366ec-4de7-4a52-857e-e27067a54ae8 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:05.641176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7a8366ec-4de7-4a52-857e-e27067a54ae8 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ec8e4bd1044eb286b5427f02a1f4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab95caff9f845b1951f04a7a03185a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:05.648763 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7a8366ec-4de7-4a52-857e-e27067a54ae8 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d" status: 200 len: 1496 microversion: 2.1 time: 0.161525 Mar 05 21:18:05.649356 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2698/5364] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:05 2022] GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d => generated 1496 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:07.810425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-09ef7dd2-969d-49cc-bfe6-b55084f81e37 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:07.811482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-09ef7dd2-969d-49cc-bfe6-b55084f81e37 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:07.819129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09ef7dd2-969d-49cc-bfe6-b55084f81e37 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:07.819601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09ef7dd2-969d-49cc-bfe6-b55084f81e37 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:07.820844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09ef7dd2-969d-49cc-bfe6-b55084f81e37 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:07.821489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-09ef7dd2-969d-49cc-bfe6-b55084f81e37 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:07.848471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-09ef7dd2-969d-49cc-bfe6-b55084f81e37 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:18:07.964172 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-09ef7dd2-969d-49cc-bfe6-b55084f81e37 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "DELETE /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d" status: 204 len: 0 microversion: 2.1 time: 0.157078 Mar 05 21:18:07.964775 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2667/5365] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:18:07 2022] DELETE /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:18:07.974597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-95e022fb-6f98-48c5-8e43-53e759f1fc81 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:07.975212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-95e022fb-6f98-48c5-8e43-53e759f1fc81 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:07.982216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95e022fb-6f98-48c5-8e43-53e759f1fc81 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:07.982674 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95e022fb-6f98-48c5-8e43-53e759f1fc81 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:07.983457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95e022fb-6f98-48c5-8e43-53e759f1fc81 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:07.983927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95e022fb-6f98-48c5-8e43-53e759f1fc81 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:08.128410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-95e022fb-6f98-48c5-8e43-53e759f1fc81 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ec8e4bd1044eb286b5427f02a1f4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab95caff9f845b1951f04a7a03185a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:08.136314 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-95e022fb-6f98-48c5-8e43-53e759f1fc81 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d" status: 200 len: 1502 microversion: 2.1 time: 0.166415 Mar 05 21:18:08.136903 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2699/5366] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:07 2022] GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:09.155481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82645d0b-d4c3-4576-94aa-93313b5217c0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:09.156252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-82645d0b-d4c3-4576-94aa-93313b5217c0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:09.163903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82645d0b-d4c3-4576-94aa-93313b5217c0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:09.164419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82645d0b-d4c3-4576-94aa-93313b5217c0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:09.165363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82645d0b-d4c3-4576-94aa-93313b5217c0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:09.165944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82645d0b-d4c3-4576-94aa-93313b5217c0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:09.335020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-82645d0b-d4c3-4576-94aa-93313b5217c0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ec8e4bd1044eb286b5427f02a1f4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab95caff9f845b1951f04a7a03185a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:09.342707 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-82645d0b-d4c3-4576-94aa-93313b5217c0 tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d" status: 200 len: 1502 microversion: 2.1 time: 0.192472 Mar 05 21:18:09.343241 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2668/5367] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:09 2022] GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:09.790025 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-3778db5a-0d6a-4dd0-9bd2-1f200c9c0d41 req-99465e51-4647-40b2-b18b-3b687cce65b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a6ec84-62d0-4cc5-817f-b5ec9c37b03d", "name": "network-vif-deleted", "tag": "bf298e9c-ffdd-4ce0-b069-7ac7be0fa01a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:18:09.798749 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3778db5a-0d6a-4dd0-9bd2-1f200c9c0d41 req-99465e51-4647-40b2-b18b-3b687cce65b7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:09.799231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3778db5a-0d6a-4dd0-9bd2-1f200c9c0d41 req-99465e51-4647-40b2-b18b-3b687cce65b7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:09.811072 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-3778db5a-0d6a-4dd0-9bd2-1f200c9c0d41 req-99465e51-4647-40b2-b18b-3b687cce65b7 service nova] Creating event network-vif-deleted:bf298e9c-ffdd-4ce0-b069-7ac7be0fa01a for instance 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d on nch1-master-1 Mar 05 21:18:09.816696 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-3778db5a-0d6a-4dd0-9bd2-1f200c9c0d41 req-99465e51-4647-40b2-b18b-3b687cce65b7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030421 Mar 05 21:18:09.817530 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2700/5368] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:18:10.361275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-64c1ecca-5f78-41ed-ad17-ba94991774ce tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:10.361913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-64c1ecca-5f78-41ed-ad17-ba94991774ce tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] [instance: 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:10.369875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64c1ecca-5f78-41ed-ad17-ba94991774ce tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:10.370465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64c1ecca-5f78-41ed-ad17-ba94991774ce tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:10.371276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64c1ecca-5f78-41ed-ad17-ba94991774ce tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:10.371755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-64c1ecca-5f78-41ed-ad17-ba94991774ce tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:10.389367 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-64c1ecca-5f78-41ed-ad17-ba94991774ce tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] HTTP exception thrown: Instance 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d could not be found. Mar 05 21:18:10.389996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-64c1ecca-5f78-41ed-ad17-ba94991774ce tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] Returning 404 to user: Instance 48a6ec84-62d0-4cc5-817f-b5ec9c37b03d could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:18:10.390865 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-64c1ecca-5f78-41ed-ad17-ba94991774ce tempest-VolumesActionsTest-1079041022 tempest-VolumesActionsTest-1079041022-project] 10.222.0.15 "GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d" status: 404 len: 111 microversion: 2.1 time: 0.034243 Mar 05 21:18:10.391438 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2669/5369] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:10 2022] GET /compute/v2.1/servers/48a6ec84-62d0-4cc5-817f-b5ec9c37b03d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:18:17.201852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ce80fda-2ee2-4d94-8d8b-11ea3f6b0a8b tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:17.202576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ce80fda-2ee2-4d94-8d8b-11ea3f6b0a8b tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:17.209959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ce80fda-2ee2-4d94-8d8b-11ea3f6b0a8b tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:17.210489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ce80fda-2ee2-4d94-8d8b-11ea3f6b0a8b tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:17.211268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ce80fda-2ee2-4d94-8d8b-11ea3f6b0a8b tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:17.211800 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ce80fda-2ee2-4d94-8d8b-11ea3f6b0a8b tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:17.312871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-9ce80fda-2ee2-4d94-8d8b-11ea3f6b0a8b tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lazy-loading 'services' on Instance uuid 049d553c-3a59-45b8-81e9-7f1164dab605 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:18:17.404363 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ce80fda-2ee2-4d94-8d8b-11ea3f6b0a8b tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "DELETE /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605/os-volume_attachments/2406c7fe-3a07-47be-8091-9b368ce0b6e5" status: 202 len: 0 microversion: 2.1 time: 0.207426 Mar 05 21:18:17.404964 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2701/5370] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 21:18:17 2022] DELETE /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605/os-volume_attachments/2406c7fe-3a07-47be-8091-9b368ce0b6e5 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:18:18.526678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b9fade10-d3d2-449b-a625-6b0f43902750 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:18.527490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b9fade10-d3d2-449b-a625-6b0f43902750 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:18.535808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b9fade10-d3d2-449b-a625-6b0f43902750 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:18.536301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b9fade10-d3d2-449b-a625-6b0f43902750 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:18.537986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b9fade10-d3d2-449b-a625-6b0f43902750 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:18.538492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b9fade10-d3d2-449b-a625-6b0f43902750 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:18.567921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b9fade10-d3d2-449b-a625-6b0f43902750 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:18:18.647180 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b9fade10-d3d2-449b-a625-6b0f43902750 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "DELETE /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 204 len: 0 microversion: 2.1 time: 0.125951 Mar 05 21:18:18.648413 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2670/5371] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:18:18 2022] DELETE /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:18:18.657756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-29226dfc-8446-42f6-86f5-edde4ba41614 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:18.658497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-29226dfc-8446-42f6-86f5-edde4ba41614 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:18.666016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29226dfc-8446-42f6-86f5-edde4ba41614 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:18.666478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29226dfc-8446-42f6-86f5-edde4ba41614 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:18.667282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29226dfc-8446-42f6-86f5-edde4ba41614 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:18.667745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29226dfc-8446-42f6-86f5-edde4ba41614 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:18.802648 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-29226dfc-8446-42f6-86f5-edde4ba41614 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:18.810085 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-29226dfc-8446-42f6-86f5-edde4ba41614 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 200 len: 1513 microversion: 2.1 time: 0.157492 Mar 05 21:18:18.810660 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2702/5372] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:18 2022] GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:19.828413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41c37552-2d2f-4916-a370-7284cbdc842c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:19.829138 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-41c37552-2d2f-4916-a370-7284cbdc842c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:19.836361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41c37552-2d2f-4916-a370-7284cbdc842c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:19.836836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41c37552-2d2f-4916-a370-7284cbdc842c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:19.837789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41c37552-2d2f-4916-a370-7284cbdc842c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:19.838411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41c37552-2d2f-4916-a370-7284cbdc842c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:20.012116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-41c37552-2d2f-4916-a370-7284cbdc842c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:20.022063 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-41c37552-2d2f-4916-a370-7284cbdc842c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 200 len: 1513 microversion: 2.1 time: 0.197448 Mar 05 21:18:20.022731 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2671/5373] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:19 2022] GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:20.558678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-06a35de5-01aa-4d32-a675-2ac38b4321f7 req-b480d62c-ab55-4ce9-8e64-b994c8ca4558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049d553c-3a59-45b8-81e9-7f1164dab605", "name": "network-vif-deleted", "tag": "7203ecdd-79fa-473e-bc83-438be5adebd9"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:18:20.574692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-06a35de5-01aa-4d32-a675-2ac38b4321f7 req-b480d62c-ab55-4ce9-8e64-b994c8ca4558 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:20.575320 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-06a35de5-01aa-4d32-a675-2ac38b4321f7 req-b480d62c-ab55-4ce9-8e64-b994c8ca4558 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:20.594530 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-06a35de5-01aa-4d32-a675-2ac38b4321f7 req-b480d62c-ab55-4ce9-8e64-b994c8ca4558 service nova] Creating event network-vif-deleted:7203ecdd-79fa-473e-bc83-438be5adebd9 for instance 049d553c-3a59-45b8-81e9-7f1164dab605 on nch1-master-1 Mar 05 21:18:20.600689 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-06a35de5-01aa-4d32-a675-2ac38b4321f7 req-b480d62c-ab55-4ce9-8e64-b994c8ca4558 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045832 Mar 05 21:18:20.601619 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2703/5374] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:18:21.040488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e7d27704-388d-4a24-a12e-729494cebaa7 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:21.041135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e7d27704-388d-4a24-a12e-729494cebaa7 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 049d553c-3a59-45b8-81e9-7f1164dab605] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:21.053654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7d27704-388d-4a24-a12e-729494cebaa7 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:21.054388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7d27704-388d-4a24-a12e-729494cebaa7 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:21.055402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7d27704-388d-4a24-a12e-729494cebaa7 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:21.056334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7d27704-388d-4a24-a12e-729494cebaa7 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:21.073427 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-e7d27704-388d-4a24-a12e-729494cebaa7 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] HTTP exception thrown: Instance 049d553c-3a59-45b8-81e9-7f1164dab605 could not be found. Mar 05 21:18:21.074120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e7d27704-388d-4a24-a12e-729494cebaa7 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Returning 404 to user: Instance 049d553c-3a59-45b8-81e9-7f1164dab605 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:18:21.075196 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e7d27704-388d-4a24-a12e-729494cebaa7 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605" status: 404 len: 111 microversion: 2.1 time: 0.039267 Mar 05 21:18:21.075922 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2672/5375] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:21 2022] GET /compute/v2.1/servers/049d553c-3a59-45b8-81e9-7f1164dab605 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:18:25.897821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-286571551", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "68508e58-0d99-4ada-84a1-f7bc3c01d9c6"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:18:25.952810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] validate_networks() for [('68508e58-0d99-4ada-84a1-f7bc3c01d9c6', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:18:26.489232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:18:26.490022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:18:26.490710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:18:26.491308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:18:26.491914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:18:26.501150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:26.501604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:26.502582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:26.503933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:26.525710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Getting quotas for project 46aa322abe044eb7baa1f99f151b28cc. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:18:26.531301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Getting quotas for user 2b581b22102f425daee098c1318c506e and project 46aa322abe044eb7baa1f99f151b28cc. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:18:26.544056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:18:26.546684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:18:26.594990 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-be9b4df0-71ca-46b4-938c-4ef721a9a2fd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702813 Mar 05 21:18:26.595687 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2704/5376] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:18:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:18:26.606570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b6427e8e-8ca8-4ffa-be0d-763527d76ca7 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:26.607791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b6427e8e-8ca8-4ffa-be0d-763527d76ca7 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:26.668426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b6427e8e-8ca8-4ffa-be0d-763527d76ca7 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:26.694001 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b6427e8e-8ca8-4ffa-be0d-763527d76ca7 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 200 len: 1218 microversion: 2.1 time: 0.091413 Mar 05 21:18:26.708156 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2673/5377] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:26 2022] GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:27.713572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-31fe1137-8281-441b-9b14-0e4fca02c2d4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:27.714202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-31fe1137-8281-441b-9b14-0e4fca02c2d4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:27.720832 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31fe1137-8281-441b-9b14-0e4fca02c2d4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:27.721580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31fe1137-8281-441b-9b14-0e4fca02c2d4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:27.722359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31fe1137-8281-441b-9b14-0e4fca02c2d4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:27.723007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31fe1137-8281-441b-9b14-0e4fca02c2d4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:27.803154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-31fe1137-8281-441b-9b14-0e4fca02c2d4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:27.813665 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-31fe1137-8281-441b-9b14-0e4fca02c2d4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 200 len: 1276 microversion: 2.1 time: 0.104618 Mar 05 21:18:27.814383 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2705/5378] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:27 2022] GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:28.834371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-47cf2736-be93-4f11-92c4-07621658cd60 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:28.835006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-47cf2736-be93-4f11-92c4-07621658cd60 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:28.842552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47cf2736-be93-4f11-92c4-07621658cd60 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:28.843022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47cf2736-be93-4f11-92c4-07621658cd60 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:28.843847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47cf2736-be93-4f11-92c4-07621658cd60 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:28.844305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47cf2736-be93-4f11-92c4-07621658cd60 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:29.012595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-35c8e094-1d37-4944-88df-79b8e0179185 req-0cd2d580-b03f-41ee-b0f1-b2295b385f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131", "tag": "d32a51ba-1b83-4ea7-8689-d48596dd2ff0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:18:29.028060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-35c8e094-1d37-4944-88df-79b8e0179185 req-0cd2d580-b03f-41ee-b0f1-b2295b385f52 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:29.036550 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-35c8e094-1d37-4944-88df-79b8e0179185 req-0cd2d580-b03f-41ee-b0f1-b2295b385f52 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:29.061316 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-35c8e094-1d37-4944-88df-79b8e0179185 req-0cd2d580-b03f-41ee-b0f1-b2295b385f52 service nova] Creating event network-changed:d32a51ba-1b83-4ea7-8689-d48596dd2ff0 for instance 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 on nch1-master-1 Mar 05 21:18:29.069991 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-35c8e094-1d37-4944-88df-79b8e0179185 req-0cd2d580-b03f-41ee-b0f1-b2295b385f52 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063681 Mar 05 21:18:29.070895 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2706/5379] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:18:29.097251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-47cf2736-be93-4f11-92c4-07621658cd60 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:29.105658 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-47cf2736-be93-4f11-92c4-07621658cd60 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 200 len: 1318 microversion: 2.1 time: 0.276717 Mar 05 21:18:29.106383 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2674/5380] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:28 2022] GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:30.124491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2203d948-2215-444a-a7cb-41ee8139c885 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:30.125202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2203d948-2215-444a-a7cb-41ee8139c885 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:30.132451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2203d948-2215-444a-a7cb-41ee8139c885 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:30.132910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2203d948-2215-444a-a7cb-41ee8139c885 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:30.133688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2203d948-2215-444a-a7cb-41ee8139c885 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:30.134133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2203d948-2215-444a-a7cb-41ee8139c885 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:30.298090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2203d948-2215-444a-a7cb-41ee8139c885 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:30.307085 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2203d948-2215-444a-a7cb-41ee8139c885 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 200 len: 1318 microversion: 2.1 time: 0.187623 Mar 05 21:18:30.307707 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2707/5381] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:30 2022] GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:31.326464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0c94c158-224a-47cf-aa9b-3fbd76d4ca95 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:31.327119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0c94c158-224a-47cf-aa9b-3fbd76d4ca95 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:31.334317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c94c158-224a-47cf-aa9b-3fbd76d4ca95 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:31.334773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c94c158-224a-47cf-aa9b-3fbd76d4ca95 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:31.335551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c94c158-224a-47cf-aa9b-3fbd76d4ca95 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:31.336190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c94c158-224a-47cf-aa9b-3fbd76d4ca95 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:31.476465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0c94c158-224a-47cf-aa9b-3fbd76d4ca95 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:31.485092 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0c94c158-224a-47cf-aa9b-3fbd76d4ca95 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 200 len: 1318 microversion: 2.1 time: 0.163116 Mar 05 21:18:31.485720 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2675/5382] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:31 2022] GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:32.503130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f72ac7c7-4014-4ae1-baa1-0af18c97f1fc tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:32.503886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f72ac7c7-4014-4ae1-baa1-0af18c97f1fc tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:32.510939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f72ac7c7-4014-4ae1-baa1-0af18c97f1fc tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:32.517103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f72ac7c7-4014-4ae1-baa1-0af18c97f1fc tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:32.521588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f72ac7c7-4014-4ae1-baa1-0af18c97f1fc tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:32.522053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f72ac7c7-4014-4ae1-baa1-0af18c97f1fc tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:32.668670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f72ac7c7-4014-4ae1-baa1-0af18c97f1fc tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:32.677088 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f72ac7c7-4014-4ae1-baa1-0af18c97f1fc tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 200 len: 1318 microversion: 2.1 time: 0.178414 Mar 05 21:18:32.677681 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2708/5383] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:32 2022] GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:33.694893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1ff576b2-ebaa-411e-ac73-08b543e6ee7c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:33.695486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1ff576b2-ebaa-411e-ac73-08b543e6ee7c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:33.703633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ff576b2-ebaa-411e-ac73-08b543e6ee7c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:33.704140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ff576b2-ebaa-411e-ac73-08b543e6ee7c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:33.705361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ff576b2-ebaa-411e-ac73-08b543e6ee7c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:33.705932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ff576b2-ebaa-411e-ac73-08b543e6ee7c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:34.221633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1ff576b2-ebaa-411e-ac73-08b543e6ee7c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:34.229460 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1ff576b2-ebaa-411e-ac73-08b543e6ee7c tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 200 len: 1318 microversion: 2.1 time: 0.539579 Mar 05 21:18:34.230432 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2676/5384] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:33 2022] GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:34.335423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-d1ef71cc-3477-42e9-98c9-a8957fa63632 req-ee74bae8-a69d-4f63-911a-f01416d0e9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131", "name": "network-vif-plugged", "status": "completed", "tag": "d32a51ba-1b83-4ea7-8689-d48596dd2ff0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:18:34.344764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d1ef71cc-3477-42e9-98c9-a8957fa63632 req-ee74bae8-a69d-4f63-911a-f01416d0e9bd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:34.345318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d1ef71cc-3477-42e9-98c9-a8957fa63632 req-ee74bae8-a69d-4f63-911a-f01416d0e9bd service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:34.362601 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-d1ef71cc-3477-42e9-98c9-a8957fa63632 req-ee74bae8-a69d-4f63-911a-f01416d0e9bd service nova] Creating event network-vif-plugged:d32a51ba-1b83-4ea7-8689-d48596dd2ff0 for instance 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 on nch1-master-1 Mar 05 21:18:34.369804 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-d1ef71cc-3477-42e9-98c9-a8957fa63632 req-ee74bae8-a69d-4f63-911a-f01416d0e9bd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037900 Mar 05 21:18:34.370805 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2709/5385] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:18:35.246470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eb103dd1-0b3a-4c37-837d-3bf010065137 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:35.246980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eb103dd1-0b3a-4c37-837d-3bf010065137 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:35.254521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb103dd1-0b3a-4c37-837d-3bf010065137 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:35.254992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb103dd1-0b3a-4c37-837d-3bf010065137 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:35.255805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb103dd1-0b3a-4c37-837d-3bf010065137 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:35.256254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb103dd1-0b3a-4c37-837d-3bf010065137 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:35.396234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eb103dd1-0b3a-4c37-837d-3bf010065137 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:35.404061 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eb103dd1-0b3a-4c37-837d-3bf010065137 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 200 len: 1318 microversion: 2.1 time: 0.161582 Mar 05 21:18:35.404653 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2677/5386] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:35 2022] GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:36.426434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ade79b4c-b9bd-4425-af84-96685aa8903f tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:18:36.427147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ade79b4c-b9bd-4425-af84-96685aa8903f tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:36.434092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ade79b4c-b9bd-4425-af84-96685aa8903f tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:36.434601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ade79b4c-b9bd-4425-af84-96685aa8903f tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:36.435702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ade79b4c-b9bd-4425-af84-96685aa8903f tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:36.436282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ade79b4c-b9bd-4425-af84-96685aa8903f tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:36.743228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ade79b4c-b9bd-4425-af84-96685aa8903f tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:18:36.751220 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ade79b4c-b9bd-4425-af84-96685aa8903f tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 200 len: 1507 microversion: 2.1 time: 0.333590 Mar 05 21:18:36.752002 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2710/5387] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:18:36 2022] GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:18:36.768823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-53e626c2-9dd1-4229-bb48-f8c610db2291 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b235070-e46f-4802-b5ac-7531e3c2899c", "device": "/dev/sdb"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:18:36.770121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-53e626c2-9dd1-4229-bb48-f8c610db2291 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:18:36.777516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53e626c2-9dd1-4229-bb48-f8c610db2291 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:36.777981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53e626c2-9dd1-4229-bb48-f8c610db2291 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:36.778765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53e626c2-9dd1-4229-bb48-f8c610db2291 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:18:36.779214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-53e626c2-9dd1-4229-bb48-f8c610db2291 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:18:37.058167 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-53e626c2-9dd1-4229-bb48-f8c610db2291 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "POST /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293351 Mar 05 21:18:37.059728 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2678/5388] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:18:36 2022] POST /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:18:56.742067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9114198c-bbeb-491f-8195-d1fe2b8f2488 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'create', calling method: .version_select at 0x7fed4f6d08b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-604599963"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:18:56.756671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9114198c-bbeb-491f-8195-d1fe2b8f2488 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:18:56.762766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9114198c-bbeb-491f-8195-d1fe2b8f2488 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for user f9a39fb8a8fe498db9a98166acf96d0d and project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:18:56.984540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9114198c-bbeb-491f-8195-d1fe2b8f2488 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:18:56.990427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-9114198c-bbeb-491f-8195-d1fe2b8f2488 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for user f9a39fb8a8fe498db9a98166acf96d0d and project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:18:57.006168 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9114198c-bbeb-491f-8195-d1fe2b8f2488 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.434245 Mar 05 21:18:57.006864 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2711/5389] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:18:56 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:03.114332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-44817f74-0731-4d74-b99a-445d73954ee4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:03.116680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-44817f74-0731-4d74-b99a-445d73954ee4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:03.132756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44817f74-0731-4d74-b99a-445d73954ee4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:03.133229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44817f74-0731-4d74-b99a-445d73954ee4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:03.134291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44817f74-0731-4d74-b99a-445d73954ee4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:03.134745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-44817f74-0731-4d74-b99a-445d73954ee4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:03.178166 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-44817f74-0731-4d74-b99a-445d73954ee4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:19:03.351468 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-44817f74-0731-4d74-b99a-445d73954ee4 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 204 len: 0 microversion: 2.1 time: 0.247663 Mar 05 21:19:03.352202 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2679/5390] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:19:03 2022] DELETE /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:19:03.362459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6c3ec5b7-9359-464b-a209-084c17a8463c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:03.363845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6c3ec5b7-9359-464b-a209-084c17a8463c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:03.376374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c3ec5b7-9359-464b-a209-084c17a8463c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:03.378773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c3ec5b7-9359-464b-a209-084c17a8463c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:03.383967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c3ec5b7-9359-464b-a209-084c17a8463c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:03.387011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6c3ec5b7-9359-464b-a209-084c17a8463c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:03.810961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6c3ec5b7-9359-464b-a209-084c17a8463c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:03.832165 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6c3ec5b7-9359-464b-a209-084c17a8463c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1577 microversion: 2.1 time: 0.475382 Mar 05 21:19:03.832853 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2712/5391] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:03 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1577 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:04.850698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-206a5ce2-8c7d-42a6-ad3d-27496d88a931 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:04.851439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-206a5ce2-8c7d-42a6-ad3d-27496d88a931 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:04.870174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-206a5ce2-8c7d-42a6-ad3d-27496d88a931 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:04.870678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-206a5ce2-8c7d-42a6-ad3d-27496d88a931 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:04.871507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-206a5ce2-8c7d-42a6-ad3d-27496d88a931 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:04.873764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-206a5ce2-8c7d-42a6-ad3d-27496d88a931 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:05.354522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-206a5ce2-8c7d-42a6-ad3d-27496d88a931 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:05.368820 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-206a5ce2-8c7d-42a6-ad3d-27496d88a931 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1577 microversion: 2.1 time: 0.518735 Mar 05 21:19:05.372046 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2680/5392] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:04 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1577 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:06.386316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-26fe56d9-b0ef-4148-bed7-aada1ccbab3f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:06.387220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-26fe56d9-b0ef-4148-bed7-aada1ccbab3f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:06.397609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26fe56d9-b0ef-4148-bed7-aada1ccbab3f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:06.403458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26fe56d9-b0ef-4148-bed7-aada1ccbab3f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:06.403458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26fe56d9-b0ef-4148-bed7-aada1ccbab3f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:06.403458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-26fe56d9-b0ef-4148-bed7-aada1ccbab3f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:06.414826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1196703342", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "a5399919-6239-42a8-a7ad-9bd3aa6faa48"}], "key_name": "tempest-TestNetworkAdvancedServerOps-604599963", "security_groups": [{"name": "tempest-secgroup-smoke-895966642"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:06.651129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] validate_networks() for [('a5399919-6239-42a8-a7ad-9bd3aa6faa48', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:19:06.689444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-26fe56d9-b0ef-4148-bed7-aada1ccbab3f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:06.697210 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-26fe56d9-b0ef-4148-bed7-aada1ccbab3f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1577 microversion: 2.1 time: 0.315197 Mar 05 21:19:06.707886 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2713/5393] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:06 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1577 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:07.715610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bc7550b1-f2f4-4f4c-abf7-dcbcc8e943b9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:07.722580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bc7550b1-f2f4-4f4c-abf7-dcbcc8e943b9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:07.731841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc7550b1-f2f4-4f4c-abf7-dcbcc8e943b9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:07.732614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc7550b1-f2f4-4f4c-abf7-dcbcc8e943b9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:07.733664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc7550b1-f2f4-4f4c-abf7-dcbcc8e943b9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:07.734308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bc7550b1-f2f4-4f4c-abf7-dcbcc8e943b9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:07.845098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bc7550b1-f2f4-4f4c-abf7-dcbcc8e943b9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:07.866838 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bc7550b1-f2f4-4f4c-abf7-dcbcc8e943b9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 200 len: 1510 microversion: 2.1 time: 0.149274 Mar 05 21:19:07.868880 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2714/5394] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:07 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:07.914783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-3203805e-ee7e-4628-b679-8f0419c6ef83 req-42e73151-d190-4b51-bb00-8cb8b2cf1d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc84e1f0-ab0d-4abb-94af-c4a562afe24f", "name": "network-vif-deleted", "tag": "e8eb19ff-b6cd-4017-b224-013f848e1e14"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:07.939878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3203805e-ee7e-4628-b679-8f0419c6ef83 req-42e73151-d190-4b51-bb00-8cb8b2cf1d93 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:07.940513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3203805e-ee7e-4628-b679-8f0419c6ef83 req-42e73151-d190-4b51-bb00-8cb8b2cf1d93 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:07.982693 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-3203805e-ee7e-4628-b679-8f0419c6ef83 req-42e73151-d190-4b51-bb00-8cb8b2cf1d93 service nova] Creating event network-vif-deleted:e8eb19ff-b6cd-4017-b224-013f848e1e14 for instance dc84e1f0-ab0d-4abb-94af-c4a562afe24f on nch2-master-1 Mar 05 21:19:07.993210 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-3203805e-ee7e-4628-b679-8f0419c6ef83 req-42e73151-d190-4b51-bb00-8cb8b2cf1d93 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086022 Mar 05 21:19:07.996757 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2715/5395] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:19:08.613192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:19:08.614429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:19:08.615104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:19:08.615699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:19:08.616320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:19:08.655802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:08.656692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:08.658901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:08.661600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:08.707552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for project 7be8dce4a165431c8a7279be20d99612. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:19:08.713742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for user f9a39fb8a8fe498db9a98166acf96d0d and project 7be8dce4a165431c8a7279be20d99612. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:19:08.734323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:19:08.739121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:19:08.803929 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bc072904-60c5-4d53-802c-4e0b0af182b0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.393856 Mar 05 21:19:08.805198 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2681/5396] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:19:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 2396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:19:08.820736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-716d3fd4-55e7-4b9f-b1d0-21ff42112726 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:08.824326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-716d3fd4-55e7-4b9f-b1d0-21ff42112726 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:08.889013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2cef4cfb-bc2a-41b4-be0c-66302f7e0058 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:08.889990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2cef4cfb-bc2a-41b4-be0c-66302f7e0058 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:08.907157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2cef4cfb-bc2a-41b4-be0c-66302f7e0058 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:08.916664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2cef4cfb-bc2a-41b4-be0c-66302f7e0058 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:08.922354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2cef4cfb-bc2a-41b4-be0c-66302f7e0058 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:08.923095 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2cef4cfb-bc2a-41b4-be0c-66302f7e0058 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:08.951432 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-2cef4cfb-bc2a-41b4-be0c-66302f7e0058 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance dc84e1f0-ab0d-4abb-94af-c4a562afe24f could not be found. Mar 05 21:19:08.952556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2cef4cfb-bc2a-41b4-be0c-66302f7e0058 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance dc84e1f0-ab0d-4abb-94af-c4a562afe24f could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:19:08.953855 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2cef4cfb-bc2a-41b4-be0c-66302f7e0058 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 404 len: 111 microversion: 2.1 time: 0.071684 Mar 05 21:19:08.954994 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2682/5397] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:08 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:19:08.960112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-716d3fd4-55e7-4b9f-b1d0-21ff42112726 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:08.967749 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-716d3fd4-55e7-4b9f-b1d0-21ff42112726 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1266 microversion: 2.1 time: 0.156442 Mar 05 21:19:08.980817 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2716/5398] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:08 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:09.147247 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-997099501", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1698875555", "security_groups": [{"name": "tempest-secgroup-smoke-108176879"}], "block_device_mapping_v2": [{"uuid": "d12389cd-038b-48ad-9624-b01e46ae00b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "82b49213-810d-43f2-9dca-5a622352a45d"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:09.445422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] validate_networks() for [('82b49213-810d-43f2-9dca-5a622352a45d', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:19:09.990620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b6254ebf-7841-4771-aca0-8d52ecc2c151 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:09.991446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b6254ebf-7841-4771-aca0-8d52ecc2c151 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:10.003213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6254ebf-7841-4771-aca0-8d52ecc2c151 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:10.003707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6254ebf-7841-4771-aca0-8d52ecc2c151 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:10.005705 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6254ebf-7841-4771-aca0-8d52ecc2c151 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:10.008368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6254ebf-7841-4771-aca0-8d52ecc2c151 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:10.110569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b6254ebf-7841-4771-aca0-8d52ecc2c151 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:10.121942 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b6254ebf-7841-4771-aca0-8d52ecc2c151 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1318 microversion: 2.1 time: 0.140045 Mar 05 21:19:10.122566 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2717/5399] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:09 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:19:10.269511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:19:10.271585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:19:10.272451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:19:10.273024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:19:10.273743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:19:10.288049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:10.290699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:10.298112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:10.298758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:10.331976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for project cdcb29011e61419981c5bfc5f10677c5. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:19:10.344113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for user 0c07bd2946594c3e8848bca133da0d90 and project cdcb29011e61419981c5bfc5f10677c5. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:19:10.501612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:19:10.503645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d12389cd-038b-48ad-9624-b01e46ae00b5',volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:19:10.768833 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eba53568-3ec7-4e37-9af6-81e8fec6ab16 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.626635 Mar 05 21:19:10.772618 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2683/5400] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:19:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:19:10.783007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b2a34187-2ba0-4139-9f1d-79dedd7b1672 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:10.783636 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b2a34187-2ba0-4139-9f1d-79dedd7b1672 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:10.856499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b2a34187-2ba0-4139-9f1d-79dedd7b1672 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:10.867102 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b2a34187-2ba0-4139-9f1d-79dedd7b1672 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1094 microversion: 2.1 time: 0.087893 Mar 05 21:19:10.878747 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2718/5401] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:10 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:11.141399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-39813ea9-c49f-4b1a-9a56-e0bdd04846a5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:11.142038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-39813ea9-c49f-4b1a-9a56-e0bdd04846a5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:11.161708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39813ea9-c49f-4b1a-9a56-e0bdd04846a5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:11.162616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39813ea9-c49f-4b1a-9a56-e0bdd04846a5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:11.163793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39813ea9-c49f-4b1a-9a56-e0bdd04846a5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:11.164477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39813ea9-c49f-4b1a-9a56-e0bdd04846a5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:11.284540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-39813ea9-c49f-4b1a-9a56-e0bdd04846a5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:11.307196 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-39813ea9-c49f-4b1a-9a56-e0bdd04846a5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1324 microversion: 2.1 time: 0.168471 Mar 05 21:19:11.309860 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2684/5402] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:11 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1324 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:11.896694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-de7b0979-841d-4319-b3c1-33a80449dc7f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:11.897914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-de7b0979-841d-4319-b3c1-33a80449dc7f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:11.914657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de7b0979-841d-4319-b3c1-33a80449dc7f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:11.915176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de7b0979-841d-4319-b3c1-33a80449dc7f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:11.916020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de7b0979-841d-4319-b3c1-33a80449dc7f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:11.916640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de7b0979-841d-4319-b3c1-33a80449dc7f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:12.091104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-de7b0979-841d-4319-b3c1-33a80449dc7f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:12.100282 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-de7b0979-841d-4319-b3c1-33a80449dc7f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1192 microversion: 2.1 time: 0.207969 Mar 05 21:19:12.106017 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2719/5403] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:11 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1192 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:12.328074 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bfa9d1a9-dcbf-4b5a-bbca-84daf7f714a6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:12.328927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bfa9d1a9-dcbf-4b5a-bbca-84daf7f714a6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:12.345013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfa9d1a9-dcbf-4b5a-bbca-84daf7f714a6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:12.345498 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfa9d1a9-dcbf-4b5a-bbca-84daf7f714a6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:12.346324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfa9d1a9-dcbf-4b5a-bbca-84daf7f714a6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:12.346789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bfa9d1a9-dcbf-4b5a-bbca-84daf7f714a6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:13.124655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-31a5f367-55c1-467f-9311-c3b4a57c3ec7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:13.125827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-31a5f367-55c1-467f-9311-c3b4a57c3ec7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:13.163270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31a5f367-55c1-467f-9311-c3b4a57c3ec7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:13.164102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31a5f367-55c1-467f-9311-c3b4a57c3ec7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:13.167864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31a5f367-55c1-467f-9311-c3b4a57c3ec7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:13.168362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-31a5f367-55c1-467f-9311-c3b4a57c3ec7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:13.297113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-31a5f367-55c1-467f-9311-c3b4a57c3ec7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:13.306532 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-31a5f367-55c1-467f-9311-c3b4a57c3ec7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1210 microversion: 2.1 time: 0.186166 Mar 05 21:19:13.307690 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2720/5404] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:13 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1210 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:13.561947 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bfa9d1a9-dcbf-4b5a-bbca-84daf7f714a6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:13.570756 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bfa9d1a9-dcbf-4b5a-bbca-84daf7f714a6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1391 microversion: 2.1 time: 1.246635 Mar 05 21:19:13.571897 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2685/5405] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:12 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1391 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:14.192015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f79dc845-c41a-4b8d-b324-4bb8ef18fd8b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:14.194286 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:19:14.194286 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 21:19:14.196859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f79dc845-c41a-4b8d-b324-4bb8ef18fd8b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:14.197543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f79dc845-c41a-4b8d-b324-4bb8ef18fd8b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:14.198586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f79dc845-c41a-4b8d-b324-4bb8ef18fd8b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:14.199369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f79dc845-c41a-4b8d-b324-4bb8ef18fd8b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:14.237397 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f79dc845-c41a-4b8d-b324-4bb8ef18fd8b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.228436 Mar 05 21:19:14.238347 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2721/5406] 10.222.0.15 () {58 vars in 1184 bytes} [Sat Mar 5 21:19:14 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:19:14.325816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1f021eb9-b3b6-44ae-bd76-71b7d96c756c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:14.326931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1f021eb9-b3b6-44ae-bd76-71b7d96c756c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:14.341126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f021eb9-b3b6-44ae-bd76-71b7d96c756c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:14.341605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f021eb9-b3b6-44ae-bd76-71b7d96c756c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:14.342626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f021eb9-b3b6-44ae-bd76-71b7d96c756c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:14.343246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f021eb9-b3b6-44ae-bd76-71b7d96c756c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:14.480830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1f021eb9-b3b6-44ae-bd76-71b7d96c756c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:14.514107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-7b785a9a-784c-4c04-80d7-90f519e486c1 req-48b284b8-f10f-4b29-b106-975eeaaa7b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb25768-95bd-4f59-95dc-a08ca3477af3", "tag": "0b00b531-b0ae-4f1d-a442-74a1fe2153df"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:14.516546 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1f021eb9-b3b6-44ae-bd76-71b7d96c756c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1198 microversion: 2.1 time: 0.195115 Mar 05 21:19:14.519116 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2686/5407] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:14 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1198 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:14.526201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7b785a9a-784c-4c04-80d7-90f519e486c1 req-48b284b8-f10f-4b29-b106-975eeaaa7b7f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:14.526555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1265698480", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "aa514f23-77bd-4790-8d98-783b4fe41cc8"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:14.527795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7b785a9a-784c-4c04-80d7-90f519e486c1 req-48b284b8-f10f-4b29-b106-975eeaaa7b7f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:14.553614 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-7b785a9a-784c-4c04-80d7-90f519e486c1 req-48b284b8-f10f-4b29-b106-975eeaaa7b7f service nova] Creating event network-changed:0b00b531-b0ae-4f1d-a442-74a1fe2153df for instance afb25768-95bd-4f59-95dc-a08ca3477af3 on nch2-master-1 Mar 05 21:19:14.574234 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-7b785a9a-784c-4c04-80d7-90f519e486c1 req-48b284b8-f10f-4b29-b106-975eeaaa7b7f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066098 Mar 05 21:19:14.577976 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2722/5408] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:19:14.598514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91bf4f0d-9242-4286-b30a-c3dc51caa075 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:14.599917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91bf4f0d-9242-4286-b30a-c3dc51caa075 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:14.608936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91bf4f0d-9242-4286-b30a-c3dc51caa075 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:14.609964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91bf4f0d-9242-4286-b30a-c3dc51caa075 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:14.610976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91bf4f0d-9242-4286-b30a-c3dc51caa075 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:14.611616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91bf4f0d-9242-4286-b30a-c3dc51caa075 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:14.619173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] validate_networks() for [('aa514f23-77bd-4790-8d98-783b4fe41cc8', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:19:14.848448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-91bf4f0d-9242-4286-b30a-c3dc51caa075 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:14.857551 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91bf4f0d-9242-4286-b30a-c3dc51caa075 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1391 microversion: 2.1 time: 0.270339 Mar 05 21:19:14.857551 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2723/5409] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:14 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1391 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:15.537390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c1875383-d923-4e6f-a751-967d43820ab5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:15.539035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c1875383-d923-4e6f-a751-967d43820ab5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:15.547330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1875383-d923-4e6f-a751-967d43820ab5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:15.547904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1875383-d923-4e6f-a751-967d43820ab5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:15.548859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1875383-d923-4e6f-a751-967d43820ab5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:15.549386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1875383-d923-4e6f-a751-967d43820ab5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:15.657154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:19:15.657705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:19:15.658577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:19:15.659557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:19:15.660887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:19:15.670820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:15.671521 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:15.672460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:15.673139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:15.693863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Getting quotas for project a500d095d0294b1b948358cfe6ebdcd9. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:19:15.699969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Getting quotas for user 714a98f109814fb5929664eb8e57ca7b and project a500d095d0294b1b948358cfe6ebdcd9. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:19:15.701773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c1875383-d923-4e6f-a751-967d43820ab5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:15.713290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:19:15.713675 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c1875383-d923-4e6f-a751-967d43820ab5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1265 microversion: 2.1 time: 0.180826 Mar 05 21:19:15.715496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:19:15.724975 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2724/5410] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:15 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:19:15.762644 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-187fcce0-3da0-4260-989e-797476b6376a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240153 Mar 05 21:19:15.763283 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2687/5411] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:19:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:19:15.776005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9fa1bf34-1044-4d7a-8151-b28e00c09754 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:15.777038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9fa1bf34-1044-4d7a-8151-b28e00c09754 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:15.852036 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9fa1bf34-1044-4d7a-8151-b28e00c09754 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1329 microversion: 2.1 time: 0.082420 Mar 05 21:19:15.852887 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2725/5412] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:15 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1329 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:15.873081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3eb1cee1-6dbb-4a95-a2cc-b3e6c7f8315b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:15.873957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3eb1cee1-6dbb-4a95-a2cc-b3e6c7f8315b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:15.882346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3eb1cee1-6dbb-4a95-a2cc-b3e6c7f8315b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:15.883079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3eb1cee1-6dbb-4a95-a2cc-b3e6c7f8315b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:15.884178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3eb1cee1-6dbb-4a95-a2cc-b3e6c7f8315b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:15.884865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3eb1cee1-6dbb-4a95-a2cc-b3e6c7f8315b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:16.276764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3eb1cee1-6dbb-4a95-a2cc-b3e6c7f8315b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:16.286337 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3eb1cee1-6dbb-4a95-a2cc-b3e6c7f8315b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1391 microversion: 2.1 time: 0.416917 Mar 05 21:19:16.296985 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2688/5413] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:15 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1391 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:16.610559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-dcbb04a7-1847-4543-9d01-da13dbaa9307 req-741a55b4-c6c5-48d2-b42f-95e14b580b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d", "tag": "2d792f34-8e44-42c7-923e-91d5e87974f1"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:16.621758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-dcbb04a7-1847-4543-9d01-da13dbaa9307 req-741a55b4-c6c5-48d2-b42f-95e14b580b49 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:16.622488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-dcbb04a7-1847-4543-9d01-da13dbaa9307 req-741a55b4-c6c5-48d2-b42f-95e14b580b49 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:16.635289 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-dcbb04a7-1847-4543-9d01-da13dbaa9307 req-741a55b4-c6c5-48d2-b42f-95e14b580b49 service nova] Creating event network-changed:2d792f34-8e44-42c7-923e-91d5e87974f1 for instance 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d on nch1-master-1 Mar 05 21:19:16.640566 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-dcbb04a7-1847-4543-9d01-da13dbaa9307 req-741a55b4-c6c5-48d2-b42f-95e14b580b49 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033903 Mar 05 21:19:16.641291 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2726/5414] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:19:16.731262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9c7d0d3d-7b8a-4365-9a09-c5babb3090c9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:16.732695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9c7d0d3d-7b8a-4365-9a09-c5babb3090c9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:16.742258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c7d0d3d-7b8a-4365-9a09-c5babb3090c9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:16.742734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c7d0d3d-7b8a-4365-9a09-c5babb3090c9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:16.743650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c7d0d3d-7b8a-4365-9a09-c5babb3090c9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:16.744292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9c7d0d3d-7b8a-4365-9a09-c5babb3090c9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:16.879251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-74d4ef5e-f2f7-4217-81d6-5e479e082b6c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:16.880500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-74d4ef5e-f2f7-4217-81d6-5e479e082b6c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:16.888228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74d4ef5e-f2f7-4217-81d6-5e479e082b6c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:16.889050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74d4ef5e-f2f7-4217-81d6-5e479e082b6c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:16.890171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74d4ef5e-f2f7-4217-81d6-5e479e082b6c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:16.890826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74d4ef5e-f2f7-4217-81d6-5e479e082b6c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:17.005196 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-74d4ef5e-f2f7-4217-81d6-5e479e082b6c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1424 microversion: 2.1 time: 0.135256 Mar 05 21:19:17.007279 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2727/5415] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:16 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1424 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:17.304307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a9cb232f-51c0-40a4-923a-4e7da5ed904e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:17.304937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a9cb232f-51c0-40a4-923a-4e7da5ed904e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:17.312117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9cb232f-51c0-40a4-923a-4e7da5ed904e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:17.312571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9cb232f-51c0-40a4-923a-4e7da5ed904e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:17.313557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9cb232f-51c0-40a4-923a-4e7da5ed904e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:17.313999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9cb232f-51c0-40a4-923a-4e7da5ed904e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:17.464558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9c7d0d3d-7b8a-4365-9a09-c5babb3090c9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:17.482387 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9c7d0d3d-7b8a-4365-9a09-c5babb3090c9 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1265 microversion: 2.1 time: 0.755772 Mar 05 21:19:17.491716 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2689/5416] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:16 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1265 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:17.503166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a9cb232f-51c0-40a4-923a-4e7da5ed904e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:17.514101 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a9cb232f-51c0-40a4-923a-4e7da5ed904e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1391 microversion: 2.1 time: 0.214289 Mar 05 21:19:17.516047 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2728/5417] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:17 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1391 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:18.025456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a5d98896-57d5-4d81-865a-735679bf2ce4 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:18.026636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a5d98896-57d5-4d81-865a-735679bf2ce4 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:18.033765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5d98896-57d5-4d81-865a-735679bf2ce4 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:18.034366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5d98896-57d5-4d81-865a-735679bf2ce4 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:18.035441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5d98896-57d5-4d81-865a-735679bf2ce4 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:18.036228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5d98896-57d5-4d81-865a-735679bf2ce4 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:18.418886 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a5d98896-57d5-4d81-865a-735679bf2ce4 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1464 microversion: 2.1 time: 0.397412 Mar 05 21:19:18.419777 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2690/5418] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:18 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1464 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:18.502056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ddbef26f-6785-4af7-b950-7f5c7001ab99 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:18.505588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ddbef26f-6785-4af7-b950-7f5c7001ab99 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:18.528011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ddbef26f-6785-4af7-b950-7f5c7001ab99 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:18.528497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ddbef26f-6785-4af7-b950-7f5c7001ab99 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:18.529465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ddbef26f-6785-4af7-b950-7f5c7001ab99 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:18.530161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ddbef26f-6785-4af7-b950-7f5c7001ab99 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:18.534259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-98ac6555-3373-42a3-82e4-c25534ceac2e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:18.534905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-98ac6555-3373-42a3-82e4-c25534ceac2e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:18.552599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98ac6555-3373-42a3-82e4-c25534ceac2e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:18.553091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98ac6555-3373-42a3-82e4-c25534ceac2e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:18.559881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98ac6555-3373-42a3-82e4-c25534ceac2e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:18.560954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-98ac6555-3373-42a3-82e4-c25534ceac2e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:18.845874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ddbef26f-6785-4af7-b950-7f5c7001ab99 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:18.854031 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ddbef26f-6785-4af7-b950-7f5c7001ab99 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1265 microversion: 2.1 time: 0.357096 Mar 05 21:19:18.854761 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2729/5419] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:18 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1265 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:19.013782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-98ac6555-3373-42a3-82e4-c25534ceac2e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:19.022660 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-98ac6555-3373-42a3-82e4-c25534ceac2e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1391 microversion: 2.1 time: 0.493284 Mar 05 21:19:19.023447 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2691/5420] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:18 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1391 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:19:19.435435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-53bfb8be-e278-48d5-8f0f-e449d3f501a3 req-6dd25d12-c02d-4cbe-a2ab-cfc08fa6eb35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05cde54-ee23-444f-8a2e-b0e963034007", "tag": "11d85a14-9ebe-4a08-8a66-0c34185bc068"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:19.445444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c44831fd-d7b5-488d-85a6-508415ac894c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:19.446203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c44831fd-d7b5-488d-85a6-508415ac894c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:19.446830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-53bfb8be-e278-48d5-8f0f-e449d3f501a3 req-6dd25d12-c02d-4cbe-a2ab-cfc08fa6eb35 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:19.447511 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-53bfb8be-e278-48d5-8f0f-e449d3f501a3 req-6dd25d12-c02d-4cbe-a2ab-cfc08fa6eb35 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:19.463267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c44831fd-d7b5-488d-85a6-508415ac894c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:19.465757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c44831fd-d7b5-488d-85a6-508415ac894c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:19.469580 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-53bfb8be-e278-48d5-8f0f-e449d3f501a3 req-6dd25d12-c02d-4cbe-a2ab-cfc08fa6eb35 service nova] Creating event network-changed:11d85a14-9ebe-4a08-8a66-0c34185bc068 for instance c05cde54-ee23-444f-8a2e-b0e963034007 on nch1-master-1 Mar 05 21:19:19.471554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c44831fd-d7b5-488d-85a6-508415ac894c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:19.472068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c44831fd-d7b5-488d-85a6-508415ac894c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:19.480324 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-53bfb8be-e278-48d5-8f0f-e449d3f501a3 req-6dd25d12-c02d-4cbe-a2ab-cfc08fa6eb35 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055591 Mar 05 21:19:19.481792 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2730/5421] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:19:19.746690 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c44831fd-d7b5-488d-85a6-508415ac894c tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1464 microversion: 2.1 time: 0.312150 Mar 05 21:19:19.753844 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2692/5422] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:19 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1464 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:19.874208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d9628fcf-62a6-46b7-92dd-2b6a6153799a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:19.875070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d9628fcf-62a6-46b7-92dd-2b6a6153799a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:19.882178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9628fcf-62a6-46b7-92dd-2b6a6153799a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:19.882645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9628fcf-62a6-46b7-92dd-2b6a6153799a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:19.883699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9628fcf-62a6-46b7-92dd-2b6a6153799a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:19.884154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9628fcf-62a6-46b7-92dd-2b6a6153799a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:20.042141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-386dc0a0-cdc3-4b5b-8263-3b39fc4e00f1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:20.042790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-386dc0a0-cdc3-4b5b-8263-3b39fc4e00f1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:20.054602 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d9628fcf-62a6-46b7-92dd-2b6a6153799a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:20.055507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-386dc0a0-cdc3-4b5b-8263-3b39fc4e00f1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:20.056062 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-386dc0a0-cdc3-4b5b-8263-3b39fc4e00f1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:20.056895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-386dc0a0-cdc3-4b5b-8263-3b39fc4e00f1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:20.057552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-386dc0a0-cdc3-4b5b-8263-3b39fc4e00f1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:20.063567 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d9628fcf-62a6-46b7-92dd-2b6a6153799a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1265 microversion: 2.1 time: 0.195110 Mar 05 21:19:20.065804 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2731/5423] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:19 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:20.351054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-386dc0a0-cdc3-4b5b-8263-3b39fc4e00f1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:20.358960 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-386dc0a0-cdc3-4b5b-8263-3b39fc4e00f1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1391 microversion: 2.1 time: 0.322057 Mar 05 21:19:20.360486 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2693/5424] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:20 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1391 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:19:20.372313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-af4e53b3-1901-4a19-84c9-f0ffce18c382 req-09b8c257-bf5c-4f97-b965-285f42352b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb25768-95bd-4f59-95dc-a08ca3477af3", "name": "network-vif-plugged", "status": "completed", "tag": "0b00b531-b0ae-4f1d-a442-74a1fe2153df"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:20.381187 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-af4e53b3-1901-4a19-84c9-f0ffce18c382 req-09b8c257-bf5c-4f97-b965-285f42352b34 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:20.381638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-af4e53b3-1901-4a19-84c9-f0ffce18c382 req-09b8c257-bf5c-4f97-b965-285f42352b34 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:20.393280 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-af4e53b3-1901-4a19-84c9-f0ffce18c382 req-09b8c257-bf5c-4f97-b965-285f42352b34 service nova] Creating event network-vif-plugged:0b00b531-b0ae-4f1d-a442-74a1fe2153df for instance afb25768-95bd-4f59-95dc-a08ca3477af3 on nch2-master-1 Mar 05 21:19:20.399719 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-af4e53b3-1901-4a19-84c9-f0ffce18c382 req-09b8c257-bf5c-4f97-b965-285f42352b34 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031151 Mar 05 21:19:20.401823 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2732/5425] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:19:20.763946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-df844544-6287-4297-bfb0-fe05657db07a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:20.764571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-df844544-6287-4297-bfb0-fe05657db07a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:20.771183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df844544-6287-4297-bfb0-fe05657db07a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:20.771646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df844544-6287-4297-bfb0-fe05657db07a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:20.772455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df844544-6287-4297-bfb0-fe05657db07a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:20.772902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-df844544-6287-4297-bfb0-fe05657db07a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:20.907365 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-df844544-6287-4297-bfb0-fe05657db07a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1464 microversion: 2.1 time: 0.146972 Mar 05 21:19:20.908333 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2694/5426] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:20 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:21.084390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f7eb849d-0059-462c-a8f3-b393706dcf1a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:21.085021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f7eb849d-0059-462c-a8f3-b393706dcf1a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:21.091143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7eb849d-0059-462c-a8f3-b393706dcf1a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:21.091597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7eb849d-0059-462c-a8f3-b393706dcf1a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:21.092389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7eb849d-0059-462c-a8f3-b393706dcf1a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:21.092831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7eb849d-0059-462c-a8f3-b393706dcf1a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:21.227514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f7eb849d-0059-462c-a8f3-b393706dcf1a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:21.234824 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f7eb849d-0059-462c-a8f3-b393706dcf1a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1265 microversion: 2.1 time: 0.156124 Mar 05 21:19:21.235403 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2733/5427] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:21 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:21.376533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6f1c8d8d-727d-4a2e-9988-41c3d29949c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:21.377094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6f1c8d8d-727d-4a2e-9988-41c3d29949c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:21.384076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f1c8d8d-727d-4a2e-9988-41c3d29949c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:21.384486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f1c8d8d-727d-4a2e-9988-41c3d29949c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:21.385273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f1c8d8d-727d-4a2e-9988-41c3d29949c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:21.385739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f1c8d8d-727d-4a2e-9988-41c3d29949c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:21.524462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6f1c8d8d-727d-4a2e-9988-41c3d29949c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:21.531855 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6f1c8d8d-727d-4a2e-9988-41c3d29949c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1391 microversion: 2.1 time: 0.159279 Mar 05 21:19:21.532443 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2695/5428] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:21 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:21.924964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7136afc2-2d9c-47cf-bfa3-387bcf163a15 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:21.926073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7136afc2-2d9c-47cf-bfa3-387bcf163a15 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:21.932239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7136afc2-2d9c-47cf-bfa3-387bcf163a15 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:21.932706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7136afc2-2d9c-47cf-bfa3-387bcf163a15 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:21.933483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7136afc2-2d9c-47cf-bfa3-387bcf163a15 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:21.933933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7136afc2-2d9c-47cf-bfa3-387bcf163a15 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:22.061133 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7136afc2-2d9c-47cf-bfa3-387bcf163a15 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1464 microversion: 2.1 time: 0.140047 Mar 05 21:19:22.061718 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2734/5429] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:21 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:22.251655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f3b49bd4-8fe8-4319-8aa0-934777087276 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:22.252249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f3b49bd4-8fe8-4319-8aa0-934777087276 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:22.259294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3b49bd4-8fe8-4319-8aa0-934777087276 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:22.259783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3b49bd4-8fe8-4319-8aa0-934777087276 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:22.260563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3b49bd4-8fe8-4319-8aa0-934777087276 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:22.261014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3b49bd4-8fe8-4319-8aa0-934777087276 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:22.399956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f3b49bd4-8fe8-4319-8aa0-934777087276 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:22.408322 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f3b49bd4-8fe8-4319-8aa0-934777087276 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1265 microversion: 2.1 time: 0.160371 Mar 05 21:19:22.409021 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2696/5430] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:22 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:22.548707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4824f7dd-e6cf-4326-9531-8eb4d141b412 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:22.549382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4824f7dd-e6cf-4326-9531-8eb4d141b412 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:22.556779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4824f7dd-e6cf-4326-9531-8eb4d141b412 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:22.557243 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4824f7dd-e6cf-4326-9531-8eb4d141b412 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:22.558024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4824f7dd-e6cf-4326-9531-8eb4d141b412 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:22.558471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4824f7dd-e6cf-4326-9531-8eb4d141b412 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:22.705206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4824f7dd-e6cf-4326-9531-8eb4d141b412 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:22.713594 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4824f7dd-e6cf-4326-9531-8eb4d141b412 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1563 microversion: 2.1 time: 0.168797 Mar 05 21:19:22.714189 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2735/5431] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:22 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:22.730555 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f4b3faa2-ee8a-4343-bcc4-1b3cac827289 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:22.731199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f4b3faa2-ee8a-4343-bcc4-1b3cac827289 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:22.737210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4b3faa2-ee8a-4343-bcc4-1b3cac827289 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:22.737689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4b3faa2-ee8a-4343-bcc4-1b3cac827289 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:22.738717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4b3faa2-ee8a-4343-bcc4-1b3cac827289 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:22.739185 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f4b3faa2-ee8a-4343-bcc4-1b3cac827289 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:22.879770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f4b3faa2-ee8a-4343-bcc4-1b3cac827289 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:22.887525 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f4b3faa2-ee8a-4343-bcc4-1b3cac827289 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1563 microversion: 2.1 time: 0.160813 Mar 05 21:19:22.888141 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2697/5432] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:22 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:23.077977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-14812ffd-4bb4-4c0a-88ad-86daf89c8fee tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:23.079002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-14812ffd-4bb4-4c0a-88ad-86daf89c8fee tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:23.086251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14812ffd-4bb4-4c0a-88ad-86daf89c8fee tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:23.086983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14812ffd-4bb4-4c0a-88ad-86daf89c8fee tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:23.088140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14812ffd-4bb4-4c0a-88ad-86daf89c8fee tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:23.089048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-14812ffd-4bb4-4c0a-88ad-86daf89c8fee tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:23.242770 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-14812ffd-4bb4-4c0a-88ad-86daf89c8fee tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1464 microversion: 2.1 time: 0.168948 Mar 05 21:19:23.243840 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2736/5433] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:23 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:23.427018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d47a1950-592c-48a6-bd97-300cb37f665d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:23.427640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d47a1950-592c-48a6-bd97-300cb37f665d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:23.434382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d47a1950-592c-48a6-bd97-300cb37f665d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:23.434845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d47a1950-592c-48a6-bd97-300cb37f665d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:23.435627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d47a1950-592c-48a6-bd97-300cb37f665d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:23.436108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d47a1950-592c-48a6-bd97-300cb37f665d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:23.693301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d47a1950-592c-48a6-bd97-300cb37f665d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:23.701406 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d47a1950-592c-48a6-bd97-300cb37f665d tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1265 microversion: 2.1 time: 0.278607 Mar 05 21:19:23.701994 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2698/5434] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:23 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:24.260304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c90a1c19-4886-4d0c-98ee-90771a362c23 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:24.260930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c90a1c19-4886-4d0c-98ee-90771a362c23 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:24.267999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c90a1c19-4886-4d0c-98ee-90771a362c23 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:24.268458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c90a1c19-4886-4d0c-98ee-90771a362c23 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:24.269291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c90a1c19-4886-4d0c-98ee-90771a362c23 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:24.269913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c90a1c19-4886-4d0c-98ee-90771a362c23 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:24.421377 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c90a1c19-4886-4d0c-98ee-90771a362c23 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1464 microversion: 2.1 time: 0.164887 Mar 05 21:19:24.422231 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2737/5435] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:24 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:24.526540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-6baef786-28d3-4df5-abfa-2b4d47000874 req-6c536626-f1b7-4ae0-b425-a6aa9b2db3ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05cde54-ee23-444f-8a2e-b0e963034007", "name": "network-vif-plugged", "status": "completed", "tag": "11d85a14-9ebe-4a08-8a66-0c34185bc068"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:24.538345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6baef786-28d3-4df5-abfa-2b4d47000874 req-6c536626-f1b7-4ae0-b425-a6aa9b2db3ef service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:24.538883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6baef786-28d3-4df5-abfa-2b4d47000874 req-6c536626-f1b7-4ae0-b425-a6aa9b2db3ef service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:24.551065 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-6baef786-28d3-4df5-abfa-2b4d47000874 req-6c536626-f1b7-4ae0-b425-a6aa9b2db3ef service nova] Creating event network-vif-plugged:11d85a14-9ebe-4a08-8a66-0c34185bc068 for instance c05cde54-ee23-444f-8a2e-b0e963034007 on nch1-master-1 Mar 05 21:19:24.556789 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-6baef786-28d3-4df5-abfa-2b4d47000874 req-6c536626-f1b7-4ae0-b425-a6aa9b2db3ef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034150 Mar 05 21:19:24.557530 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2699/5436] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:19:24.724173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-265dffb2-bd1c-4fc7-8f7e-08926813dfc8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:24.724831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-265dffb2-bd1c-4fc7-8f7e-08926813dfc8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:24.731441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-265dffb2-bd1c-4fc7-8f7e-08926813dfc8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:24.731960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-265dffb2-bd1c-4fc7-8f7e-08926813dfc8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:24.732835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-265dffb2-bd1c-4fc7-8f7e-08926813dfc8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:24.733294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-265dffb2-bd1c-4fc7-8f7e-08926813dfc8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:24.877722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-265dffb2-bd1c-4fc7-8f7e-08926813dfc8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:24.888133 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-265dffb2-bd1c-4fc7-8f7e-08926813dfc8 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1265 microversion: 2.1 time: 0.171681 Mar 05 21:19:24.889078 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2738/5437] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:24 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:25.021007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3c0deb28-ad75-45b4-aff1-81b357fe0cd0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:25.021738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3c0deb28-ad75-45b4-aff1-81b357fe0cd0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:25.026313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-20003fe5-7735-4e48-bdb4-cac0475bcb90 req-68f65166-7f2f-4a8a-9cf7-65499c7fa9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb25768-95bd-4f59-95dc-a08ca3477af3", "tag": "0b00b531-b0ae-4f1d-a442-74a1fe2153df"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:25.028073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c0deb28-ad75-45b4-aff1-81b357fe0cd0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:25.028541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c0deb28-ad75-45b4-aff1-81b357fe0cd0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:25.029369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c0deb28-ad75-45b4-aff1-81b357fe0cd0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:25.029819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3c0deb28-ad75-45b4-aff1-81b357fe0cd0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:25.034762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-20003fe5-7735-4e48-bdb4-cac0475bcb90 req-68f65166-7f2f-4a8a-9cf7-65499c7fa9e3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:25.035327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-20003fe5-7735-4e48-bdb4-cac0475bcb90 req-68f65166-7f2f-4a8a-9cf7-65499c7fa9e3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:25.048243 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-20003fe5-7735-4e48-bdb4-cac0475bcb90 req-68f65166-7f2f-4a8a-9cf7-65499c7fa9e3 service nova] Creating event network-changed:0b00b531-b0ae-4f1d-a442-74a1fe2153df for instance afb25768-95bd-4f59-95dc-a08ca3477af3 on nch2-master-1 Mar 05 21:19:25.053595 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-20003fe5-7735-4e48-bdb4-cac0475bcb90 req-68f65166-7f2f-4a8a-9cf7-65499c7fa9e3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030889 Mar 05 21:19:25.054561 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2739/5438] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:19:25.266003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3c0deb28-ad75-45b4-aff1-81b357fe0cd0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:25.274419 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3c0deb28-ad75-45b4-aff1-81b357fe0cd0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1563 microversion: 2.1 time: 0.258703 Mar 05 21:19:25.275241 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2700/5439] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:25 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1563 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:25.440438 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d2b2d638-c488-4145-a129-9ae8d765514b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:25.442452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d2b2d638-c488-4145-a129-9ae8d765514b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:25.449552 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2b2d638-c488-4145-a129-9ae8d765514b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:25.450381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2b2d638-c488-4145-a129-9ae8d765514b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:25.451570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2b2d638-c488-4145-a129-9ae8d765514b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:25.452309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2b2d638-c488-4145-a129-9ae8d765514b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:25.592991 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d2b2d638-c488-4145-a129-9ae8d765514b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1464 microversion: 2.1 time: 0.157681 Mar 05 21:19:25.593811 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2740/5440] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:25 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1464 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:25.907482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eaaea94a-e2f5-4545-944b-f831f31b43e7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:25.909140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eaaea94a-e2f5-4545-944b-f831f31b43e7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:25.918584 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eaaea94a-e2f5-4545-944b-f831f31b43e7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:25.919291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eaaea94a-e2f5-4545-944b-f831f31b43e7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:25.920311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eaaea94a-e2f5-4545-944b-f831f31b43e7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:25.920922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eaaea94a-e2f5-4545-944b-f831f31b43e7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:26.074563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eaaea94a-e2f5-4545-944b-f831f31b43e7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:26.082596 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eaaea94a-e2f5-4545-944b-f831f31b43e7 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1265 microversion: 2.1 time: 0.179883 Mar 05 21:19:26.083229 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2701/5441] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:25 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:26.591252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-72846e02-3ce3-4d97-80e4-5fbd2e62ebd1 req-97863639-bd9d-42ae-ad21-6f0fc8eed9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d", "name": "network-vif-plugged", "status": "completed", "tag": "2d792f34-8e44-42c7-923e-91d5e87974f1"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:26.600979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-72846e02-3ce3-4d97-80e4-5fbd2e62ebd1 req-97863639-bd9d-42ae-ad21-6f0fc8eed9ee service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:26.601437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-72846e02-3ce3-4d97-80e4-5fbd2e62ebd1 req-97863639-bd9d-42ae-ad21-6f0fc8eed9ee service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:26.609228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f7efc1ce-7c71-4287-a751-7b54c82407b2 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:26.610152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f7efc1ce-7c71-4287-a751-7b54c82407b2 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:26.612836 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-72846e02-3ce3-4d97-80e4-5fbd2e62ebd1 req-97863639-bd9d-42ae-ad21-6f0fc8eed9ee service nova] Creating event network-vif-plugged:2d792f34-8e44-42c7-923e-91d5e87974f1 for instance 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d on nch1-master-1 Mar 05 21:19:26.616760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7efc1ce-7c71-4287-a751-7b54c82407b2 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:26.617417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7efc1ce-7c71-4287-a751-7b54c82407b2 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:26.618488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7efc1ce-7c71-4287-a751-7b54c82407b2 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:26.618610 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-72846e02-3ce3-4d97-80e4-5fbd2e62ebd1 req-97863639-bd9d-42ae-ad21-6f0fc8eed9ee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031096 Mar 05 21:19:26.619386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7efc1ce-7c71-4287-a751-7b54c82407b2 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:26.619499 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2741/5442] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:19:26.824057 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f7efc1ce-7c71-4287-a751-7b54c82407b2 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1648 microversion: 2.1 time: 0.218485 Mar 05 21:19:26.824905 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2702/5443] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:26 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1648 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:19:26.843389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8311a6dd-f504-4da9-8997-d6dd5f47cbd8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:26.844130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8311a6dd-f504-4da9-8997-d6dd5f47cbd8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:26.850666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8311a6dd-f504-4da9-8997-d6dd5f47cbd8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:26.851136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8311a6dd-f504-4da9-8997-d6dd5f47cbd8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:26.851959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8311a6dd-f504-4da9-8997-d6dd5f47cbd8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:26.852411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8311a6dd-f504-4da9-8997-d6dd5f47cbd8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:26.986349 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8311a6dd-f504-4da9-8997-d6dd5f47cbd8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1648 microversion: 2.1 time: 0.147146 Mar 05 21:19:26.986938 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2742/5444] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:26 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1648 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:27.002325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6e54ad19-6deb-461f-9d63-5f2895fc8d98 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:27.002963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6e54ad19-6deb-461f-9d63-5f2895fc8d98 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:27.010013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e54ad19-6deb-461f-9d63-5f2895fc8d98 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:27.010489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e54ad19-6deb-461f-9d63-5f2895fc8d98 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:27.011284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e54ad19-6deb-461f-9d63-5f2895fc8d98 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:27.011764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e54ad19-6deb-461f-9d63-5f2895fc8d98 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:27.098806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-28adc158-b9f1-4626-968b-53d7366dcb56 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:27.099516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-28adc158-b9f1-4626-968b-53d7366dcb56 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:27.105609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28adc158-b9f1-4626-968b-53d7366dcb56 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:27.106062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28adc158-b9f1-4626-968b-53d7366dcb56 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:27.106974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28adc158-b9f1-4626-968b-53d7366dcb56 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:27.107452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28adc158-b9f1-4626-968b-53d7366dcb56 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:27.141642 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6e54ad19-6deb-461f-9d63-5f2895fc8d98 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1648 microversion: 2.1 time: 0.142862 Mar 05 21:19:27.142225 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2703/5445] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:26 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1648 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:27.196496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-853344088", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "aa514f23-77bd-4790-8d98-783b4fe41cc8"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:27.244879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-28adc158-b9f1-4626-968b-53d7366dcb56 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:27.251319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] validate_networks() for [('aa514f23-77bd-4790-8d98-783b4fe41cc8', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:19:27.252419 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-28adc158-b9f1-4626-968b-53d7366dcb56 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1265 microversion: 2.1 time: 0.157575 Mar 05 21:19:27.252998 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2743/5446] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:27 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:19:27.599405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:19:27.599896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:19:27.600394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:19:27.600824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:19:27.601253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:19:27.610069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:27.610538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:27.611361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:27.611859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:27.630208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Getting quotas for project a500d095d0294b1b948358cfe6ebdcd9. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:19:27.635768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Getting quotas for user 714a98f109814fb5929664eb8e57ca7b and project a500d095d0294b1b948358cfe6ebdcd9. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:19:27.647840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:19:27.650147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:19:27.696107 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1662f341-d0c7-4be7-a5d3-9bff82fa1f3a tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503090 Mar 05 21:19:27.696965 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2704/5447] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:19:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 21:19:27.707216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ac9b1fa-2f9c-497f-bccd-295f913941f5 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:27.707876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ac9b1fa-2f9c-497f-bccd-295f913941f5 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:27.765641 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4ac9b1fa-2f9c-497f-bccd-295f913941f5 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 200 len: 1328 microversion: 2.1 time: 0.062044 Mar 05 21:19:27.766582 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2744/5448] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:27 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 1328 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:28.271257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-805456e1-5f95-4cd9-a8d7-d4bec765e044 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:28.271919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-805456e1-5f95-4cd9-a8d7-d4bec765e044 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:28.280513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-805456e1-5f95-4cd9-a8d7-d4bec765e044 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:28.280978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-805456e1-5f95-4cd9-a8d7-d4bec765e044 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:28.281764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-805456e1-5f95-4cd9-a8d7-d4bec765e044 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:28.282219 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-805456e1-5f95-4cd9-a8d7-d4bec765e044 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:28.421182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-805456e1-5f95-4cd9-a8d7-d4bec765e044 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:28.429628 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-805456e1-5f95-4cd9-a8d7-d4bec765e044 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1451 microversion: 2.1 time: 0.163563 Mar 05 21:19:28.430184 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2705/5449] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:28 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:28.446617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-390331b9-280b-4398-9967-cac7fbd49847 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:28.447261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-390331b9-280b-4398-9967-cac7fbd49847 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:28.454471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-390331b9-280b-4398-9967-cac7fbd49847 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:28.454931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-390331b9-280b-4398-9967-cac7fbd49847 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:28.455726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-390331b9-280b-4398-9967-cac7fbd49847 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:28.456165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-390331b9-280b-4398-9967-cac7fbd49847 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:28.594689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-390331b9-280b-4398-9967-cac7fbd49847 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:28.603408 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-390331b9-280b-4398-9967-cac7fbd49847 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1451 microversion: 2.1 time: 0.160574 Mar 05 21:19:28.615274 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2745/5450] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:28 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:19:28.782279 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0a0450bc-0330-40fa-aa1a-142e51a7c7e8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:28.783180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0a0450bc-0330-40fa-aa1a-142e51a7c7e8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:28.790107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a0450bc-0330-40fa-aa1a-142e51a7c7e8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:28.790611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a0450bc-0330-40fa-aa1a-142e51a7c7e8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:28.791412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a0450bc-0330-40fa-aa1a-142e51a7c7e8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:28.791905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a0450bc-0330-40fa-aa1a-142e51a7c7e8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:28.883474 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0a0450bc-0330-40fa-aa1a-142e51a7c7e8 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 200 len: 1421 microversion: 2.1 time: 0.104341 Mar 05 21:19:28.894971 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2706/5451] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:28 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 1421 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:19:29.884778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ca400a54-8213-429a-9bc3-984fb0393eaf req-ecf8ae38-2ed0-4c5d-8b7d-89155c22a391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed522d82-98f7-4b8b-be87-f6ffb9d45f85", "tag": "362fa0d4-03d8-4fe7-a84e-67417b78fbd4"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:29.904543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9ed7cc7b-a1d3-47da-95b5-f2e86483c7f6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:29.906227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9ed7cc7b-a1d3-47da-95b5-f2e86483c7f6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:29.912537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ca400a54-8213-429a-9bc3-984fb0393eaf req-ecf8ae38-2ed0-4c5d-8b7d-89155c22a391 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:29.913560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ca400a54-8213-429a-9bc3-984fb0393eaf req-ecf8ae38-2ed0-4c5d-8b7d-89155c22a391 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:29.919720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ed7cc7b-a1d3-47da-95b5-f2e86483c7f6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:29.920466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ed7cc7b-a1d3-47da-95b5-f2e86483c7f6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:29.921561 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ed7cc7b-a1d3-47da-95b5-f2e86483c7f6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:29.922252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9ed7cc7b-a1d3-47da-95b5-f2e86483c7f6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:29.960435 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ca400a54-8213-429a-9bc3-984fb0393eaf req-ecf8ae38-2ed0-4c5d-8b7d-89155c22a391 service nova] Creating event network-changed:362fa0d4-03d8-4fe7-a84e-67417b78fbd4 for instance ed522d82-98f7-4b8b-be87-f6ffb9d45f85 on nch2-master-1 Mar 05 21:19:29.975525 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ca400a54-8213-429a-9bc3-984fb0393eaf req-ecf8ae38-2ed0-4c5d-8b7d-89155c22a391 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095591 Mar 05 21:19:29.976604 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2746/5452] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:19:30.244482 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9ed7cc7b-a1d3-47da-95b5-f2e86483c7f6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 200 len: 1463 microversion: 2.1 time: 0.345607 Mar 05 21:19:30.245075 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2707/5453] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:29 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 1463 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:19:30.505054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-4922d44f-6197-443b-a120-a4e4e42b9fd6 req-eddacffa-71c5-401a-b5a7-2f68e323d455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d", "tag": "2d792f34-8e44-42c7-923e-91d5e87974f1"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:30.522214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4922d44f-6197-443b-a120-a4e4e42b9fd6 req-eddacffa-71c5-401a-b5a7-2f68e323d455 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:30.522928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4922d44f-6197-443b-a120-a4e4e42b9fd6 req-eddacffa-71c5-401a-b5a7-2f68e323d455 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:30.536474 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-4922d44f-6197-443b-a120-a4e4e42b9fd6 req-eddacffa-71c5-401a-b5a7-2f68e323d455 service nova] Creating event network-changed:2d792f34-8e44-42c7-923e-91d5e87974f1 for instance 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d on nch1-master-1 Mar 05 21:19:30.542059 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-4922d44f-6197-443b-a120-a4e4e42b9fd6 req-eddacffa-71c5-401a-b5a7-2f68e323d455 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109644 Mar 05 21:19:30.543254 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2747/5454] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:19:31.262069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-20d84073-e084-4e3d-9d42-57da147f8909 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:31.262737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-20d84073-e084-4e3d-9d42-57da147f8909 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:31.270781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20d84073-e084-4e3d-9d42-57da147f8909 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:31.271271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20d84073-e084-4e3d-9d42-57da147f8909 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:31.272129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20d84073-e084-4e3d-9d42-57da147f8909 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:31.272603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20d84073-e084-4e3d-9d42-57da147f8909 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:31.482759 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-20d84073-e084-4e3d-9d42-57da147f8909 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 200 len: 1463 microversion: 2.1 time: 0.224838 Mar 05 21:19:31.487011 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2708/5455] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:31 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 1463 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:32.501547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-80e766a5-55c2-4864-98cc-2250f5e9d7d7 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:32.502350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-80e766a5-55c2-4864-98cc-2250f5e9d7d7 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:32.510742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80e766a5-55c2-4864-98cc-2250f5e9d7d7 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:32.511221 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80e766a5-55c2-4864-98cc-2250f5e9d7d7 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:32.512061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80e766a5-55c2-4864-98cc-2250f5e9d7d7 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:32.512502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80e766a5-55c2-4864-98cc-2250f5e9d7d7 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:32.654988 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-80e766a5-55c2-4864-98cc-2250f5e9d7d7 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 200 len: 1463 microversion: 2.1 time: 0.157438 Mar 05 21:19:32.656859 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2748/5456] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:32 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:19:33.674919 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e3d620bf-4199-4fed-b2ba-f159d9c892a6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:33.676449 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e3d620bf-4199-4fed-b2ba-f159d9c892a6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:33.682737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3d620bf-4199-4fed-b2ba-f159d9c892a6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:33.683201 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3d620bf-4199-4fed-b2ba-f159d9c892a6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:33.684021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3d620bf-4199-4fed-b2ba-f159d9c892a6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:33.684469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e3d620bf-4199-4fed-b2ba-f159d9c892a6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:33.814357 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e3d620bf-4199-4fed-b2ba-f159d9c892a6 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 200 len: 1463 microversion: 2.1 time: 0.143166 Mar 05 21:19:33.814931 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2709/5457] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:33 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 1463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:34.529576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-4bc8ecd3-4f4d-4083-b653-51a2bc2a712a req-3506573c-8a27-45f7-a7ef-3638dcd61440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed522d82-98f7-4b8b-be87-f6ffb9d45f85", "name": "network-vif-plugged", "status": "completed", "tag": "362fa0d4-03d8-4fe7-a84e-67417b78fbd4"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:34.539838 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4bc8ecd3-4f4d-4083-b653-51a2bc2a712a req-3506573c-8a27-45f7-a7ef-3638dcd61440 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:34.540293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4bc8ecd3-4f4d-4083-b653-51a2bc2a712a req-3506573c-8a27-45f7-a7ef-3638dcd61440 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:34.552502 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-4bc8ecd3-4f4d-4083-b653-51a2bc2a712a req-3506573c-8a27-45f7-a7ef-3638dcd61440 service nova] Creating event network-vif-plugged:362fa0d4-03d8-4fe7-a84e-67417b78fbd4 for instance ed522d82-98f7-4b8b-be87-f6ffb9d45f85 on nch2-master-1 Mar 05 21:19:34.557447 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-4bc8ecd3-4f4d-4083-b653-51a2bc2a712a req-3506573c-8a27-45f7-a7ef-3638dcd61440 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031659 Mar 05 21:19:34.558057 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2749/5458] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:19:34.832294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a1a36c34-5b3d-43b8-a7ff-ddea0e17ee44 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:34.832935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a1a36c34-5b3d-43b8-a7ff-ddea0e17ee44 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:34.839859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1a36c34-5b3d-43b8-a7ff-ddea0e17ee44 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:34.840335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1a36c34-5b3d-43b8-a7ff-ddea0e17ee44 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:34.841128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1a36c34-5b3d-43b8-a7ff-ddea0e17ee44 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:34.841586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1a36c34-5b3d-43b8-a7ff-ddea0e17ee44 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:34.971735 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a1a36c34-5b3d-43b8-a7ff-ddea0e17ee44 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 200 len: 1463 microversion: 2.1 time: 0.143700 Mar 05 21:19:34.972374 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2710/5459] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:34 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 1463 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:35.989786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5318ebc8-3dca-4ecc-990a-a662fe47a670 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:35.990504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5318ebc8-3dca-4ecc-990a-a662fe47a670 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:35.997458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5318ebc8-3dca-4ecc-990a-a662fe47a670 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:35.997923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5318ebc8-3dca-4ecc-990a-a662fe47a670 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:35.998710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5318ebc8-3dca-4ecc-990a-a662fe47a670 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:35.999156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5318ebc8-3dca-4ecc-990a-a662fe47a670 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:36.132367 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5318ebc8-3dca-4ecc-990a-a662fe47a670 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 200 len: 1648 microversion: 2.1 time: 0.147060 Mar 05 21:19:36.132967 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2750/5460] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:35 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 1648 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:36.149667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1904e2c1-d25c-43b3-b9ca-db9bfea40dfc tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:36.150245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1904e2c1-d25c-43b3-b9ca-db9bfea40dfc tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:36.157021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1904e2c1-d25c-43b3-b9ca-db9bfea40dfc tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:36.157488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1904e2c1-d25c-43b3-b9ca-db9bfea40dfc tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:36.158269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1904e2c1-d25c-43b3-b9ca-db9bfea40dfc tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:36.158726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1904e2c1-d25c-43b3-b9ca-db9bfea40dfc tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:36.610127 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1904e2c1-d25c-43b3-b9ca-db9bfea40dfc tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 200 len: 1648 microversion: 2.1 time: 0.464374 Mar 05 21:19:36.610709 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2711/5461] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:36 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 1648 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:36.626232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c1faee9d-85d8-4b20-8289-c4c34becfb3b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:36.626852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c1faee9d-85d8-4b20-8289-c4c34becfb3b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:36.633305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1faee9d-85d8-4b20-8289-c4c34becfb3b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:36.633760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1faee9d-85d8-4b20-8289-c4c34becfb3b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:36.634515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1faee9d-85d8-4b20-8289-c4c34becfb3b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:36.634954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1faee9d-85d8-4b20-8289-c4c34becfb3b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:36.769300 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c1faee9d-85d8-4b20-8289-c4c34becfb3b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 200 len: 1648 microversion: 2.1 time: 0.146175 Mar 05 21:19:36.779728 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2751/5462] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:36 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 1648 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:36.786190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-386be301-fdae-4a12-891d-b5f5d9492076 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:36.786718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-386be301-fdae-4a12-891d-b5f5d9492076 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:36.793075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-386be301-fdae-4a12-891d-b5f5d9492076 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:36.793718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-386be301-fdae-4a12-891d-b5f5d9492076 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:36.794528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-386be301-fdae-4a12-891d-b5f5d9492076 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:36.794987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-386be301-fdae-4a12-891d-b5f5d9492076 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:36.821918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-386be301-fdae-4a12-891d-b5f5d9492076 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:19:36.906495 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-386be301-fdae-4a12-891d-b5f5d9492076 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "DELETE /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 204 len: 0 microversion: 2.1 time: 0.123969 Mar 05 21:19:36.911009 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2712/5463] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:19:36 2022] DELETE /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:19:36.917337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b5c02ee5-6e98-404c-81e0-2ced26b86099 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:36.918146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b5c02ee5-6e98-404c-81e0-2ced26b86099 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:36.924041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5c02ee5-6e98-404c-81e0-2ced26b86099 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:36.924513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5c02ee5-6e98-404c-81e0-2ced26b86099 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:36.925532 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5c02ee5-6e98-404c-81e0-2ced26b86099 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:36.925986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b5c02ee5-6e98-404c-81e0-2ced26b86099 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:37.060144 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b5c02ee5-6e98-404c-81e0-2ced26b86099 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 200 len: 1654 microversion: 2.1 time: 0.147663 Mar 05 21:19:37.061562 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2752/5464] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:36 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 1654 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:38.079075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-50099f74-4ed4-4b69-8203-6a87ee89e7be tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:38.079832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-50099f74-4ed4-4b69-8203-6a87ee89e7be tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:38.087494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50099f74-4ed4-4b69-8203-6a87ee89e7be tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:38.088028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50099f74-4ed4-4b69-8203-6a87ee89e7be tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:38.088967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50099f74-4ed4-4b69-8203-6a87ee89e7be tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:38.089572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50099f74-4ed4-4b69-8203-6a87ee89e7be tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:38.231039 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-50099f74-4ed4-4b69-8203-6a87ee89e7be tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 200 len: 1654 microversion: 2.1 time: 0.156741 Mar 05 21:19:38.231626 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2713/5465] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:38 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 1654 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:38.790748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c327edd4-6135-418f-a3db-f83edf921d0c req-810eb0ec-5339-44e0-b8b2-4a7a2050965e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed522d82-98f7-4b8b-be87-f6ffb9d45f85", "name": "network-vif-deleted", "tag": "362fa0d4-03d8-4fe7-a84e-67417b78fbd4"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:38.800366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c327edd4-6135-418f-a3db-f83edf921d0c req-810eb0ec-5339-44e0-b8b2-4a7a2050965e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:38.800869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c327edd4-6135-418f-a3db-f83edf921d0c req-810eb0ec-5339-44e0-b8b2-4a7a2050965e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:38.816454 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c327edd4-6135-418f-a3db-f83edf921d0c req-810eb0ec-5339-44e0-b8b2-4a7a2050965e service nova] Creating event network-vif-deleted:362fa0d4-03d8-4fe7-a84e-67417b78fbd4 for instance ed522d82-98f7-4b8b-be87-f6ffb9d45f85 on nch2-master-1 Mar 05 21:19:38.824158 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c327edd4-6135-418f-a3db-f83edf921d0c req-810eb0ec-5339-44e0-b8b2-4a7a2050965e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038278 Mar 05 21:19:38.825129 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2753/5466] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:19:39.248429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-68d52a78-acce-4d20-bb44-68901a947980 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:39.249063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-68d52a78-acce-4d20-bb44-68901a947980 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:39.256727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68d52a78-acce-4d20-bb44-68901a947980 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:39.257186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68d52a78-acce-4d20-bb44-68901a947980 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:39.257974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68d52a78-acce-4d20-bb44-68901a947980 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:39.258670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68d52a78-acce-4d20-bb44-68901a947980 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:39.291191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68d52a78-acce-4d20-bb44-68901a947980 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:39.291655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68d52a78-acce-4d20-bb44-68901a947980 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:39.292318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-68d52a78-acce-4d20-bb44-68901a947980 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lazy-loading 'fault' on Instance uuid ed522d82-98f7-4b8b-be87-f6ffb9d45f85 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:19:39.342138 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-68d52a78-acce-4d20-bb44-68901a947980 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 200 len: 1453 microversion: 2.1 time: 0.097640 Mar 05 21:19:39.342722 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2714/5467] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:39 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:40.359651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cec8654e-e6d1-47ac-88c4-9b695572284b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:40.360382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cec8654e-e6d1-47ac-88c4-9b695572284b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: ed522d82-98f7-4b8b-be87-f6ffb9d45f85] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:40.368513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cec8654e-e6d1-47ac-88c4-9b695572284b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:40.368972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cec8654e-e6d1-47ac-88c4-9b695572284b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:40.369748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cec8654e-e6d1-47ac-88c4-9b695572284b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:40.370194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cec8654e-e6d1-47ac-88c4-9b695572284b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:40.383891 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-cec8654e-e6d1-47ac-88c4-9b695572284b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] HTTP exception thrown: Instance ed522d82-98f7-4b8b-be87-f6ffb9d45f85 could not be found. Mar 05 21:19:40.384495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cec8654e-e6d1-47ac-88c4-9b695572284b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Returning 404 to user: Instance ed522d82-98f7-4b8b-be87-f6ffb9d45f85 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:19:40.385328 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cec8654e-e6d1-47ac-88c4-9b695572284b tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85" status: 404 len: 111 microversion: 2.1 time: 0.029852 Mar 05 21:19:40.385870 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2754/5468] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:40 2022] GET /compute/v2.1/servers/ed522d82-98f7-4b8b-be87-f6ffb9d45f85 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:19:40.394478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-73ecb2f2-84cd-4d2d-a98e-75cf1fa542af tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:40.394996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-73ecb2f2-84cd-4d2d-a98e-75cf1fa542af tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:40.401779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-73ecb2f2-84cd-4d2d-a98e-75cf1fa542af tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:40.402246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-73ecb2f2-84cd-4d2d-a98e-75cf1fa542af tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:40.403030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-73ecb2f2-84cd-4d2d-a98e-75cf1fa542af tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:40.403487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-73ecb2f2-84cd-4d2d-a98e-75cf1fa542af tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:40.427626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-73ecb2f2-84cd-4d2d-a98e-75cf1fa542af tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:19:40.500460 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-73ecb2f2-84cd-4d2d-a98e-75cf1fa542af tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "DELETE /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 204 len: 0 microversion: 2.1 time: 0.109913 Mar 05 21:19:40.500973 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2715/5469] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:19:40 2022] DELETE /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:19:40.510572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3623533f-7710-447c-9c2b-93ece14d845d tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:40.511190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3623533f-7710-447c-9c2b-93ece14d845d tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:40.517144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3623533f-7710-447c-9c2b-93ece14d845d tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:40.517604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3623533f-7710-447c-9c2b-93ece14d845d tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:40.518368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3623533f-7710-447c-9c2b-93ece14d845d tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:40.519301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3623533f-7710-447c-9c2b-93ece14d845d tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:40.647818 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3623533f-7710-447c-9c2b-93ece14d845d tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1654 microversion: 2.1 time: 0.141450 Mar 05 21:19:40.648420 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2755/5470] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:40 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1654 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:41.664643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-be8cda04-d9af-4d01-b3b1-31f8ef72162e tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:41.665409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-be8cda04-d9af-4d01-b3b1-31f8ef72162e tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:41.671954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be8cda04-d9af-4d01-b3b1-31f8ef72162e tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:41.672423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be8cda04-d9af-4d01-b3b1-31f8ef72162e tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:41.673193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be8cda04-d9af-4d01-b3b1-31f8ef72162e tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:41.673642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be8cda04-d9af-4d01-b3b1-31f8ef72162e tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:41.802277 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-be8cda04-d9af-4d01-b3b1-31f8ef72162e tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1654 microversion: 2.1 time: 0.141642 Mar 05 21:19:41.802854 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2716/5471] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:41 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1654 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:42.465037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-10d32059-c4f7-430f-bdcb-0781bc56d748 req-799dd541-0df5-40e4-a1ed-01d12ccd41eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05cde54-ee23-444f-8a2e-b0e963034007", "name": "network-vif-deleted", "tag": "11d85a14-9ebe-4a08-8a66-0c34185bc068"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:42.474793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-10d32059-c4f7-430f-bdcb-0781bc56d748 req-799dd541-0df5-40e4-a1ed-01d12ccd41eb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:42.475252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-10d32059-c4f7-430f-bdcb-0781bc56d748 req-799dd541-0df5-40e4-a1ed-01d12ccd41eb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:42.489109 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-10d32059-c4f7-430f-bdcb-0781bc56d748 req-799dd541-0df5-40e4-a1ed-01d12ccd41eb service nova] Creating event network-vif-deleted:11d85a14-9ebe-4a08-8a66-0c34185bc068 for instance c05cde54-ee23-444f-8a2e-b0e963034007 on nch1-master-1 Mar 05 21:19:42.494540 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-10d32059-c4f7-430f-bdcb-0781bc56d748 req-799dd541-0df5-40e4-a1ed-01d12ccd41eb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033397 Mar 05 21:19:42.495333 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2756/5472] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:19:42.820231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6ff40210-0f81-4d8a-9b33-9854dd9bd082 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:42.820864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6ff40210-0f81-4d8a-9b33-9854dd9bd082 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:42.826877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ff40210-0f81-4d8a-9b33-9854dd9bd082 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:42.827351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ff40210-0f81-4d8a-9b33-9854dd9bd082 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:42.828191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ff40210-0f81-4d8a-9b33-9854dd9bd082 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:42.828649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ff40210-0f81-4d8a-9b33-9854dd9bd082 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:42.863079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ff40210-0f81-4d8a-9b33-9854dd9bd082 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:42.863618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6ff40210-0f81-4d8a-9b33-9854dd9bd082 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:42.864168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-6ff40210-0f81-4d8a-9b33-9854dd9bd082 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lazy-loading 'fault' on Instance uuid c05cde54-ee23-444f-8a2e-b0e963034007 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:19:42.917409 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6ff40210-0f81-4d8a-9b33-9854dd9bd082 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 200 len: 1454 microversion: 2.1 time: 0.101827 Mar 05 21:19:42.918001 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2717/5473] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:42 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:43.935681 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-74dac695-438a-48ff-97d7-fd54852bf2b9 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:43.936423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-74dac695-438a-48ff-97d7-fd54852bf2b9 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] [instance: c05cde54-ee23-444f-8a2e-b0e963034007] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:43.942901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74dac695-438a-48ff-97d7-fd54852bf2b9 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:43.943362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74dac695-438a-48ff-97d7-fd54852bf2b9 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:43.944159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74dac695-438a-48ff-97d7-fd54852bf2b9 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:43.944607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-74dac695-438a-48ff-97d7-fd54852bf2b9 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:43.957527 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-74dac695-438a-48ff-97d7-fd54852bf2b9 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] HTTP exception thrown: Instance c05cde54-ee23-444f-8a2e-b0e963034007 could not be found. Mar 05 21:19:43.958129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-74dac695-438a-48ff-97d7-fd54852bf2b9 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] Returning 404 to user: Instance c05cde54-ee23-444f-8a2e-b0e963034007 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:19:43.958955 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-74dac695-438a-48ff-97d7-fd54852bf2b9 tempest-TestServerMultinode-1975856309 tempest-TestServerMultinode-1975856309-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007" status: 404 len: 111 microversion: 2.1 time: 0.028369 Mar 05 21:19:43.959494 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2757/5474] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:43 2022] GET /compute/v2.1/servers/c05cde54-ee23-444f-8a2e-b0e963034007 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:19:47.600832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d343ff2a-aaa7-4444-b373-aee3db373c4e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:47.602094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d343ff2a-aaa7-4444-b373-aee3db373c4e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:47.609986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d343ff2a-aaa7-4444-b373-aee3db373c4e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:47.610466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d343ff2a-aaa7-4444-b373-aee3db373c4e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:47.611471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d343ff2a-aaa7-4444-b373-aee3db373c4e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:47.612127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d343ff2a-aaa7-4444-b373-aee3db373c4e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:47.664250 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d343ff2a-aaa7-4444-b373-aee3db373c4e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3/action" status: 200 len: 24568 microversion: 2.1 time: 0.069210 Mar 05 21:19:47.668579 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2718/5475] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:19:47 2022] POST /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3/action => generated 24568 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:19:58.765519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-183c78cd-22d0-4368-be85-a718a2494849 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:58.766148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-183c78cd-22d0-4368-be85-a718a2494849 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:58.772974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-183c78cd-22d0-4368-be85-a718a2494849 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:58.773273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-183c78cd-22d0-4368-be85-a718a2494849 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:58.774048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-183c78cd-22d0-4368-be85-a718a2494849 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:58.774496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-183c78cd-22d0-4368-be85-a718a2494849 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:59.002159 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-183c78cd-22d0-4368-be85-a718a2494849 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1832 microversion: 2.1 time: 0.240673 Mar 05 21:19:59.002735 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2758/5476] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:58 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1832 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:59.019695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-66fdaf6b-3d64-49d0-b9a1-8ac43b5331eb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:59.020422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-66fdaf6b-3d64-49d0-b9a1-8ac43b5331eb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:59.028509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66fdaf6b-3d64-49d0-b9a1-8ac43b5331eb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:59.028977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66fdaf6b-3d64-49d0-b9a1-8ac43b5331eb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:59.029762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66fdaf6b-3d64-49d0-b9a1-8ac43b5331eb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:59.030212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66fdaf6b-3d64-49d0-b9a1-8ac43b5331eb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:59.168535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-66fdaf6b-3d64-49d0-b9a1-8ac43b5331eb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:59.176035 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-66fdaf6b-3d64-49d0-b9a1-8ac43b5331eb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1681 microversion: 2.1 time: 0.160586 Mar 05 21:19:59.176619 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2719/5477] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:59 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:19:59.266952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e2240d14-baae-4077-8d4b-cb34a4ff63d6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:59.267930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e2240d14-baae-4077-8d4b-cb34a4ff63d6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:59.274047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2240d14-baae-4077-8d4b-cb34a4ff63d6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:59.274506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2240d14-baae-4077-8d4b-cb34a4ff63d6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:59.275274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2240d14-baae-4077-8d4b-cb34a4ff63d6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:59.275795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2240d14-baae-4077-8d4b-cb34a4ff63d6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:59.322995 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e2240d14-baae-4077-8d4b-cb34a4ff63d6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3/action" status: 200 len: 32639 microversion: 2.1 time: 0.059846 Mar 05 21:19:59.323631 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2759/5478] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:19:59 2022] POST /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3/action => generated 32639 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:19:59.497495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d472a70b-20d5-4f4b-8b4f-bc5c8b0f8884 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:19:59.498094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d472a70b-20d5-4f4b-8b4f-bc5c8b0f8884 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:59.504598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d472a70b-20d5-4f4b-8b4f-bc5c8b0f8884 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:59.505011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d472a70b-20d5-4f4b-8b4f-bc5c8b0f8884 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:59.505796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d472a70b-20d5-4f4b-8b4f-bc5c8b0f8884 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:59.506307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d472a70b-20d5-4f4b-8b4f-bc5c8b0f8884 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:59.589622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d472a70b-20d5-4f4b-8b4f-bc5c8b0f8884 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7e11ef4525bc43e7a51f03690badd71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6a7fe2f1e941e4a8dc0e64ff9b2fe9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:19:59.590121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d472a70b-20d5-4f4b-8b4f-bc5c8b0f8884 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] flavor_id is None. Assuming migration. {{(pid=141478) resize /opt/stack/nova/nova/compute/api.py:4140}} Mar 05 21:19:59.590596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d472a70b-20d5-4f4b-8b4f-bc5c8b0f8884 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141478) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 21:19:59.968367 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d472a70b-20d5-4f4b-8b4f-bc5c8b0f8884 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3/action" status: 202 len: 0 microversion: 2.1 time: 0.474404 Mar 05 21:19:59.969202 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2720/5479] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:19:59 2022] POST /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:19:59.978386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b975872f-573d-4413-be28-3f2153521b34 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:19:59.979112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b975872f-573d-4413-be28-3f2153521b34 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:19:59.986287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b975872f-573d-4413-be28-3f2153521b34 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:59.986755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b975872f-573d-4413-be28-3f2153521b34 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:19:59.987539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b975872f-573d-4413-be28-3f2153521b34 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:19:59.988026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b975872f-573d-4413-be28-3f2153521b34 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:00.133081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b975872f-573d-4413-be28-3f2153521b34 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:00.140685 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b975872f-573d-4413-be28-3f2153521b34 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1690 microversion: 2.1 time: 0.167256 Mar 05 21:20:00.141362 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2760/5480] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:19:59 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:20:01.160111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d01eb70f-28ad-4185-948d-b5ca5d94ea25 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:01.160780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d01eb70f-28ad-4185-948d-b5ca5d94ea25 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:01.168125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d01eb70f-28ad-4185-948d-b5ca5d94ea25 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:01.168595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d01eb70f-28ad-4185-948d-b5ca5d94ea25 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:01.169539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d01eb70f-28ad-4185-948d-b5ca5d94ea25 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:01.170061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d01eb70f-28ad-4185-948d-b5ca5d94ea25 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:01.309289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d01eb70f-28ad-4185-948d-b5ca5d94ea25 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:01.316701 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d01eb70f-28ad-4185-948d-b5ca5d94ea25 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1690 microversion: 2.1 time: 0.161968 Mar 05 21:20:01.317274 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2721/5481] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:01 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:02.334881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2cdd1ce2-92e7-48d5-b312-3ecdd0b4e5a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:02.335516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2cdd1ce2-92e7-48d5-b312-3ecdd0b4e5a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:02.342910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2cdd1ce2-92e7-48d5-b312-3ecdd0b4e5a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:02.343399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2cdd1ce2-92e7-48d5-b312-3ecdd0b4e5a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:02.344216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2cdd1ce2-92e7-48d5-b312-3ecdd0b4e5a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:02.344665 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2cdd1ce2-92e7-48d5-b312-3ecdd0b4e5a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:02.485617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2cdd1ce2-92e7-48d5-b312-3ecdd0b4e5a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:02.493273 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2cdd1ce2-92e7-48d5-b312-3ecdd0b4e5a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.162374 Mar 05 21:20:02.493849 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2761/5482] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:02 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:03.511178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-af2b0760-4e93-44b0-b907-79a3c92f07d8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:03.511844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-af2b0760-4e93-44b0-b907-79a3c92f07d8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:03.518512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-af2b0760-4e93-44b0-b907-79a3c92f07d8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:03.518976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-af2b0760-4e93-44b0-b907-79a3c92f07d8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:03.519782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-af2b0760-4e93-44b0-b907-79a3c92f07d8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:03.520234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-af2b0760-4e93-44b0-b907-79a3c92f07d8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:03.654829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-af2b0760-4e93-44b0-b907-79a3c92f07d8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:03.662140 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-af2b0760-4e93-44b0-b907-79a3c92f07d8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.155752 Mar 05 21:20:03.662707 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2722/5483] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:03 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:04.680508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f7a3454a-2be6-4475-9cad-715a9b13dc2d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:04.681349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f7a3454a-2be6-4475-9cad-715a9b13dc2d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:04.688223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7a3454a-2be6-4475-9cad-715a9b13dc2d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:04.688686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7a3454a-2be6-4475-9cad-715a9b13dc2d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:04.689469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7a3454a-2be6-4475-9cad-715a9b13dc2d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:04.689917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f7a3454a-2be6-4475-9cad-715a9b13dc2d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:04.822229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f7a3454a-2be6-4475-9cad-715a9b13dc2d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:04.829644 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f7a3454a-2be6-4475-9cad-715a9b13dc2d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.153715 Mar 05 21:20:04.830213 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2762/5484] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:04 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:05.846386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4e509074-4f3d-48c4-9a46-7fe525edfb63 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:05.847044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4e509074-4f3d-48c4-9a46-7fe525edfb63 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:05.854000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e509074-4f3d-48c4-9a46-7fe525edfb63 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:05.854474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e509074-4f3d-48c4-9a46-7fe525edfb63 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:05.855261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e509074-4f3d-48c4-9a46-7fe525edfb63 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:05.855749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e509074-4f3d-48c4-9a46-7fe525edfb63 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:05.990190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4e509074-4f3d-48c4-9a46-7fe525edfb63 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:05.998402 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4e509074-4f3d-48c4-9a46-7fe525edfb63 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.155992 Mar 05 21:20:05.998987 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2723/5485] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:05 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:07.015788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4d4a4787-7c98-4b79-a91d-62084f6dbe86 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:07.016333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4d4a4787-7c98-4b79-a91d-62084f6dbe86 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:07.023300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d4a4787-7c98-4b79-a91d-62084f6dbe86 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:07.024422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d4a4787-7c98-4b79-a91d-62084f6dbe86 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:07.025454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d4a4787-7c98-4b79-a91d-62084f6dbe86 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:07.025896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d4a4787-7c98-4b79-a91d-62084f6dbe86 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:07.164005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4d4a4787-7c98-4b79-a91d-62084f6dbe86 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:07.171381 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4d4a4787-7c98-4b79-a91d-62084f6dbe86 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.159580 Mar 05 21:20:07.171990 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2763/5486] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:07 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:08.188881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-481b5dca-7466-4f9a-bc20-c1d210ada1c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:08.189524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-481b5dca-7466-4f9a-bc20-c1d210ada1c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:08.196507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-481b5dca-7466-4f9a-bc20-c1d210ada1c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:08.196968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-481b5dca-7466-4f9a-bc20-c1d210ada1c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:08.197742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-481b5dca-7466-4f9a-bc20-c1d210ada1c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:08.198191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-481b5dca-7466-4f9a-bc20-c1d210ada1c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:08.339646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-481b5dca-7466-4f9a-bc20-c1d210ada1c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:08.347704 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-481b5dca-7466-4f9a-bc20-c1d210ada1c9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.162739 Mar 05 21:20:08.348345 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2724/5487] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:08 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:09.365575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0857bf92-a6b7-4f64-973a-ee90c81de676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:09.366157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0857bf92-a6b7-4f64-973a-ee90c81de676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:09.373735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0857bf92-a6b7-4f64-973a-ee90c81de676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:09.374197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0857bf92-a6b7-4f64-973a-ee90c81de676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:09.374974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0857bf92-a6b7-4f64-973a-ee90c81de676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:09.375425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0857bf92-a6b7-4f64-973a-ee90c81de676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:09.510986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0857bf92-a6b7-4f64-973a-ee90c81de676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:09.518440 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0857bf92-a6b7-4f64-973a-ee90c81de676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.156928 Mar 05 21:20:09.519040 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2764/5488] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:09 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:10.536707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-430ac161-68e3-40a3-a070-a09e918e964c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:10.537464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-430ac161-68e3-40a3-a070-a09e918e964c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:10.545973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-430ac161-68e3-40a3-a070-a09e918e964c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:10.546610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-430ac161-68e3-40a3-a070-a09e918e964c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:10.547535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-430ac161-68e3-40a3-a070-a09e918e964c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:10.548233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-430ac161-68e3-40a3-a070-a09e918e964c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:10.695071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-430ac161-68e3-40a3-a070-a09e918e964c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:10.706385 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-430ac161-68e3-40a3-a070-a09e918e964c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.173955 Mar 05 21:20:10.707287 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2725/5489] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:10 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:11.724673 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d65577f6-898a-4a54-b88f-bfca0b2d1a73 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:11.725296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d65577f6-898a-4a54-b88f-bfca0b2d1a73 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:11.733768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d65577f6-898a-4a54-b88f-bfca0b2d1a73 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:11.734234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d65577f6-898a-4a54-b88f-bfca0b2d1a73 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:11.735074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d65577f6-898a-4a54-b88f-bfca0b2d1a73 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:11.735531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d65577f6-898a-4a54-b88f-bfca0b2d1a73 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:11.764347 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:20:11.764980 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 21:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:20:11.884604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d65577f6-898a-4a54-b88f-bfca0b2d1a73 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:11.893472 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d65577f6-898a-4a54-b88f-bfca0b2d1a73 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.172690 Mar 05 21:20:11.894053 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2765/5490] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:11 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:20:12.913005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d979cc97-1690-497e-a74a-231afe262ac3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:12.913670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d979cc97-1690-497e-a74a-231afe262ac3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:12.921518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d979cc97-1690-497e-a74a-231afe262ac3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:12.921922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d979cc97-1690-497e-a74a-231afe262ac3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:12.922715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d979cc97-1690-497e-a74a-231afe262ac3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:12.923171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d979cc97-1690-497e-a74a-231afe262ac3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:13.076817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d979cc97-1690-497e-a74a-231afe262ac3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:13.085270 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d979cc97-1690-497e-a74a-231afe262ac3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.177348 Mar 05 21:20:13.085931 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2726/5491] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:12 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:14.103402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8fb95fac-1002-4480-ab3a-a26be7e92b3e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:14.104177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8fb95fac-1002-4480-ab3a-a26be7e92b3e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:14.112678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fb95fac-1002-4480-ab3a-a26be7e92b3e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:14.113129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fb95fac-1002-4480-ab3a-a26be7e92b3e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:14.113958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fb95fac-1002-4480-ab3a-a26be7e92b3e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:14.114501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8fb95fac-1002-4480-ab3a-a26be7e92b3e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:14.272724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8fb95fac-1002-4480-ab3a-a26be7e92b3e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:14.281750 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8fb95fac-1002-4480-ab3a-a26be7e92b3e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.182933 Mar 05 21:20:14.282467 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2766/5492] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:14 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:15.290278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6e37cfe4-85dc-4b24-b526-1f324bcea557 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:15.290917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6e37cfe4-85dc-4b24-b526-1f324bcea557 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:15.299388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e37cfe4-85dc-4b24-b526-1f324bcea557 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:15.300051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e37cfe4-85dc-4b24-b526-1f324bcea557 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:15.300900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c2456ff5-9ad1-4542-b57d-9695dd468f96 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:15.301450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e37cfe4-85dc-4b24-b526-1f324bcea557 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:15.301569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c2456ff5-9ad1-4542-b57d-9695dd468f96 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:15.301937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6e37cfe4-85dc-4b24-b526-1f324bcea557 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:15.309019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2456ff5-9ad1-4542-b57d-9695dd468f96 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:15.310098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2456ff5-9ad1-4542-b57d-9695dd468f96 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:15.310934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2456ff5-9ad1-4542-b57d-9695dd468f96 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:15.311462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2456ff5-9ad1-4542-b57d-9695dd468f96 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:15.395860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-6e37cfe4-85dc-4b24-b526-1f324bcea557 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lazy-loading 'services' on Instance uuid 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:20:15.476492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c2456ff5-9ad1-4542-b57d-9695dd468f96 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:15.477310 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6e37cfe4-85dc-4b24-b526-1f324bcea557 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131/os-volume_attachments/2b235070-e46f-4802-b5ac-7531e3c2899c" status: 202 len: 0 microversion: 2.1 time: 0.191849 Mar 05 21:20:15.481691 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2727/5493] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 21:20:15 2022] DELETE /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131/os-volume_attachments/2b235070-e46f-4802-b5ac-7531e3c2899c => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:20:15.486072 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c2456ff5-9ad1-4542-b57d-9695dd468f96 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.188977 Mar 05 21:20:15.487143 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2767/5494] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:15 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:16.506179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2f819be1-a2f0-4785-8f27-ca95df7c335d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:16.506816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2f819be1-a2f0-4785-8f27-ca95df7c335d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:16.513620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f819be1-a2f0-4785-8f27-ca95df7c335d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:16.514082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f819be1-a2f0-4785-8f27-ca95df7c335d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:16.514873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f819be1-a2f0-4785-8f27-ca95df7c335d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:16.515305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f819be1-a2f0-4785-8f27-ca95df7c335d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:16.602816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-989ba2bb-cbd6-44ec-9e51-5622f35e0ca0 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:16.603410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-989ba2bb-cbd6-44ec-9e51-5622f35e0ca0 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:16.616037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-989ba2bb-cbd6-44ec-9e51-5622f35e0ca0 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:16.616642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-989ba2bb-cbd6-44ec-9e51-5622f35e0ca0 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:16.618029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-989ba2bb-cbd6-44ec-9e51-5622f35e0ca0 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:16.618640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-989ba2bb-cbd6-44ec-9e51-5622f35e0ca0 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:16.644677 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-989ba2bb-cbd6-44ec-9e51-5622f35e0ca0 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:20:16.661718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2f819be1-a2f0-4785-8f27-ca95df7c335d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:16.669027 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2f819be1-a2f0-4785-8f27-ca95df7c335d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.168077 Mar 05 21:20:16.670124 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2728/5495] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:16 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:16.723795 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-989ba2bb-cbd6-44ec-9e51-5622f35e0ca0 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 204 len: 0 microversion: 2.1 time: 0.124431 Mar 05 21:20:16.724863 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2768/5496] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:20:16 2022] DELETE /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:20:16.735764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e9158946-3167-43e9-b0e8-07f5ccbe8df2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:16.736832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e9158946-3167-43e9-b0e8-07f5ccbe8df2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:16.744147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9158946-3167-43e9-b0e8-07f5ccbe8df2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:16.744634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9158946-3167-43e9-b0e8-07f5ccbe8df2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:16.745508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9158946-3167-43e9-b0e8-07f5ccbe8df2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:16.746050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9158946-3167-43e9-b0e8-07f5ccbe8df2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:16.885400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e9158946-3167-43e9-b0e8-07f5ccbe8df2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:16.893296 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e9158946-3167-43e9-b0e8-07f5ccbe8df2 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 200 len: 1513 microversion: 2.1 time: 0.163100 Mar 05 21:20:16.893887 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2729/5497] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:16 2022] GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:17.688345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-29ecef9d-1b98-45c5-97be-570c78424de0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:17.689095 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-29ecef9d-1b98-45c5-97be-570c78424de0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:17.696409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29ecef9d-1b98-45c5-97be-570c78424de0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:17.696881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29ecef9d-1b98-45c5-97be-570c78424de0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:17.697821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29ecef9d-1b98-45c5-97be-570c78424de0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:17.698281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29ecef9d-1b98-45c5-97be-570c78424de0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:17.858848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-29ecef9d-1b98-45c5-97be-570c78424de0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:17.867315 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-29ecef9d-1b98-45c5-97be-570c78424de0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1695 microversion: 2.1 time: 0.184095 Mar 05 21:20:17.867994 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2769/5498] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:17 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:17.911703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-16b34029-0b3e-456c-9c3c-70c5f4378ed4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:17.912544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-16b34029-0b3e-456c-9c3c-70c5f4378ed4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:17.920900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16b34029-0b3e-456c-9c3c-70c5f4378ed4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:17.921937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16b34029-0b3e-456c-9c3c-70c5f4378ed4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:17.922911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16b34029-0b3e-456c-9c3c-70c5f4378ed4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:17.923456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-16b34029-0b3e-456c-9c3c-70c5f4378ed4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:18.070273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-16b34029-0b3e-456c-9c3c-70c5f4378ed4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:18.078121 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-16b34029-0b3e-456c-9c3c-70c5f4378ed4 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 200 len: 1513 microversion: 2.1 time: 0.170989 Mar 05 21:20:18.079277 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2730/5499] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:17 2022] GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:18.741136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-134dd313-ac38-4492-842b-2352a13e8c49 req-8a1c5493-e4cc-4f35-9b33-34a081fba823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131", "name": "network-vif-deleted", "tag": "d32a51ba-1b83-4ea7-8689-d48596dd2ff0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:20:18.758478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-134dd313-ac38-4492-842b-2352a13e8c49 req-8a1c5493-e4cc-4f35-9b33-34a081fba823 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:18.759181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-134dd313-ac38-4492-842b-2352a13e8c49 req-8a1c5493-e4cc-4f35-9b33-34a081fba823 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:18.773850 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-134dd313-ac38-4492-842b-2352a13e8c49 req-8a1c5493-e4cc-4f35-9b33-34a081fba823 service nova] Creating event network-vif-deleted:d32a51ba-1b83-4ea7-8689-d48596dd2ff0 for instance 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 on nch1-master-1 Mar 05 21:20:18.779881 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-134dd313-ac38-4492-842b-2352a13e8c49 req-8a1c5493-e4cc-4f35-9b33-34a081fba823 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043063 Mar 05 21:20:18.780612 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2770/5500] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:18.886925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ce779b65-8468-41ba-a76d-07b3349f7536 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:18.887573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ce779b65-8468-41ba-a76d-07b3349f7536 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:18.894161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce779b65-8468-41ba-a76d-07b3349f7536 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:18.894640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce779b65-8468-41ba-a76d-07b3349f7536 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:18.895616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce779b65-8468-41ba-a76d-07b3349f7536 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:18.896302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ce779b65-8468-41ba-a76d-07b3349f7536 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:19.066145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ce779b65-8468-41ba-a76d-07b3349f7536 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:19.074575 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ce779b65-8468-41ba-a76d-07b3349f7536 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1694 microversion: 2.1 time: 0.192174 Mar 05 21:20:19.075146 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2731/5501] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:18 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:19.097286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c784218f-5571-497f-8c6b-b3bb72888594 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:19.098031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c784218f-5571-497f-8c6b-b3bb72888594 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:19.104413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c784218f-5571-497f-8c6b-b3bb72888594 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:19.104877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c784218f-5571-497f-8c6b-b3bb72888594 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:19.106068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c784218f-5571-497f-8c6b-b3bb72888594 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:19.106184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c784218f-5571-497f-8c6b-b3bb72888594 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:19.139945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c784218f-5571-497f-8c6b-b3bb72888594 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:19.140433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c784218f-5571-497f-8c6b-b3bb72888594 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:19.140910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-c784218f-5571-497f-8c6b-b3bb72888594 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lazy-loading 'fault' on Instance uuid 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:20:19.186265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c784218f-5571-497f-8c6b-b3bb72888594 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b581b22102f425daee098c1318c506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46aa322abe044eb7baa1f99f151b28cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:19.196157 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c784218f-5571-497f-8c6b-b3bb72888594 tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 200 len: 1308 microversion: 2.1 time: 0.104016 Mar 05 21:20:19.196756 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2771/5502] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:19 2022] GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:20.092076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c4fe078-fccd-4238-815c-29e58eec0dbd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:20.092707 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c4fe078-fccd-4238-815c-29e58eec0dbd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:20.099363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c4fe078-fccd-4238-815c-29e58eec0dbd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:20.099856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c4fe078-fccd-4238-815c-29e58eec0dbd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:20.100645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c4fe078-fccd-4238-815c-29e58eec0dbd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:20.101094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c4fe078-fccd-4238-815c-29e58eec0dbd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:20.213752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9db461cf-4e11-4074-bc21-93569282cbbd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:20.214328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9db461cf-4e11-4074-bc21-93569282cbbd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] [instance: 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:20.221561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9db461cf-4e11-4074-bc21-93569282cbbd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:20.222028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9db461cf-4e11-4074-bc21-93569282cbbd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:20.222874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9db461cf-4e11-4074-bc21-93569282cbbd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:20.223376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9db461cf-4e11-4074-bc21-93569282cbbd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:20.238104 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-9db461cf-4e11-4074-bc21-93569282cbbd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] HTTP exception thrown: Instance 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 could not be found. Mar 05 21:20:20.238846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9db461cf-4e11-4074-bc21-93569282cbbd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] Returning 404 to user: Instance 5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:20:20.239726 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9db461cf-4e11-4074-bc21-93569282cbbd tempest-VolumesSnapshotTestJSON-163973597 tempest-VolumesSnapshotTestJSON-163973597-project] 10.222.0.15 "GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131" status: 404 len: 111 microversion: 2.1 time: 0.030134 Mar 05 21:20:20.240298 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2772/5503] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:20 2022] GET /compute/v2.1/servers/5dc0e734-0d9f-4dfd-a335-ae9e2c6b4131 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:20:20.330424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8c4fe078-fccd-4238-815c-29e58eec0dbd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:20.340269 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8c4fe078-fccd-4238-815c-29e58eec0dbd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1694 microversion: 2.1 time: 0.251944 Mar 05 21:20:20.341072 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2732/5504] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:20 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1694 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:20.796650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-2dc8f312-9958-4f7a-bc31-5b0b14d3b6c6 req-5541e570-9df8-455c-906a-0fc5841795f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb25768-95bd-4f59-95dc-a08ca3477af3", "name": "network-vif-unplugged", "status": "completed", "tag": "0b00b531-b0ae-4f1d-a442-74a1fe2153df"}, {"name": "network-changed", "server_uuid": "afb25768-95bd-4f59-95dc-a08ca3477af3", "tag": "0b00b531-b0ae-4f1d-a442-74a1fe2153df"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:20:20.804708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2dc8f312-9958-4f7a-bc31-5b0b14d3b6c6 req-5541e570-9df8-455c-906a-0fc5841795f3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:20.805159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2dc8f312-9958-4f7a-bc31-5b0b14d3b6c6 req-5541e570-9df8-455c-906a-0fc5841795f3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:20.816958 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-2dc8f312-9958-4f7a-bc31-5b0b14d3b6c6 req-5541e570-9df8-455c-906a-0fc5841795f3 service nova] Creating event network-vif-unplugged:0b00b531-b0ae-4f1d-a442-74a1fe2153df for instance afb25768-95bd-4f59-95dc-a08ca3477af3 on nch1-master-1 Mar 05 21:20:20.817477 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-2dc8f312-9958-4f7a-bc31-5b0b14d3b6c6 req-5541e570-9df8-455c-906a-0fc5841795f3 service nova] Creating event network-changed:0b00b531-b0ae-4f1d-a442-74a1fe2153df for instance afb25768-95bd-4f59-95dc-a08ca3477af3 on nch1-master-1 Mar 05 21:20:20.822698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-2dc8f312-9958-4f7a-bc31-5b0b14d3b6c6 req-5541e570-9df8-455c-906a-0fc5841795f3 service nova] Instance afb25768-95bd-4f59-95dc-a08ca3477af3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:20:20.834820 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-2dc8f312-9958-4f7a-bc31-5b0b14d3b6c6 req-5541e570-9df8-455c-906a-0fc5841795f3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.041957 Mar 05 21:20:20.835417 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2773/5505] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:21.358392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3547e548-ecb9-4fa2-9046-77608aeb521a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:21.359652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3547e548-ecb9-4fa2-9046-77608aeb521a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:21.366424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3547e548-ecb9-4fa2-9046-77608aeb521a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:21.366897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3547e548-ecb9-4fa2-9046-77608aeb521a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:21.367714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3547e548-ecb9-4fa2-9046-77608aeb521a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:21.368173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3547e548-ecb9-4fa2-9046-77608aeb521a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:21.781485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3547e548-ecb9-4fa2-9046-77608aeb521a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:21.790368 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3547e548-ecb9-4fa2-9046-77608aeb521a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1692 microversion: 2.1 time: 0.435885 Mar 05 21:20:21.790968 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2733/5506] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:21 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1692 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:22.809680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-949b6a60-8bbd-4d28-ad60-8cfe183a943b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:22.810402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-949b6a60-8bbd-4d28-ad60-8cfe183a943b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:22.818143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-949b6a60-8bbd-4d28-ad60-8cfe183a943b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:22.818613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-949b6a60-8bbd-4d28-ad60-8cfe183a943b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:22.819409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-949b6a60-8bbd-4d28-ad60-8cfe183a943b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:22.819890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-949b6a60-8bbd-4d28-ad60-8cfe183a943b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:22.987013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-949b6a60-8bbd-4d28-ad60-8cfe183a943b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:22.994693 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-949b6a60-8bbd-4d28-ad60-8cfe183a943b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1689 microversion: 2.1 time: 0.189117 Mar 05 21:20:22.995416 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2774/5507] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:22 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:23.014015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3141560f-a225-4cf5-8053-b2bd2b851496 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:20:23.015495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3141560f-a225-4cf5-8053-b2bd2b851496 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:23.022453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3141560f-a225-4cf5-8053-b2bd2b851496 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:23.023004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3141560f-a225-4cf5-8053-b2bd2b851496 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:23.023910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3141560f-a225-4cf5-8053-b2bd2b851496 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:23.024812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3141560f-a225-4cf5-8053-b2bd2b851496 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:23.090556 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3141560f-a225-4cf5-8053-b2bd2b851496 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3/action" status: 204 len: 0 microversion: 2.1 time: 0.080321 Mar 05 21:20:23.091313 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2734/5508] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:20:23 2022] POST /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:20:23.100238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-32fc522b-927d-49cd-8475-9bf317bc45b8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:23.101284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-32fc522b-927d-49cd-8475-9bf317bc45b8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:23.110808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32fc522b-927d-49cd-8475-9bf317bc45b8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:23.111604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32fc522b-927d-49cd-8475-9bf317bc45b8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:23.112613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32fc522b-927d-49cd-8475-9bf317bc45b8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:23.113391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-32fc522b-927d-49cd-8475-9bf317bc45b8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:23.337373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-32fc522b-927d-49cd-8475-9bf317bc45b8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:23.348382 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-32fc522b-927d-49cd-8475-9bf317bc45b8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1689 microversion: 2.1 time: 0.251404 Mar 05 21:20:23.349195 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2775/5509] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:23 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1689 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:20:24.370446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5fb00175-c10d-46c0-ba28-e45d02078a8c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:24.371305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5fb00175-c10d-46c0-ba28-e45d02078a8c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:24.378783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5fb00175-c10d-46c0-ba28-e45d02078a8c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:24.379287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5fb00175-c10d-46c0-ba28-e45d02078a8c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:24.380144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5fb00175-c10d-46c0-ba28-e45d02078a8c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:24.380586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5fb00175-c10d-46c0-ba28-e45d02078a8c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:24.542925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5fb00175-c10d-46c0-ba28-e45d02078a8c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:24.555777 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5fb00175-c10d-46c0-ba28-e45d02078a8c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1689 microversion: 2.1 time: 0.190171 Mar 05 21:20:24.556818 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2735/5510] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:24 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:25.153842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e5ada1e9-d120-49f0-9e3a-eb6986a81ab8 req-996978b3-98b8-47d9-a296-411c75321743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb25768-95bd-4f59-95dc-a08ca3477af3", "name": "network-vif-plugged", "status": "completed", "tag": "0b00b531-b0ae-4f1d-a442-74a1fe2153df"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:20:25.175740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e5ada1e9-d120-49f0-9e3a-eb6986a81ab8 req-996978b3-98b8-47d9-a296-411c75321743 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:25.176132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e5ada1e9-d120-49f0-9e3a-eb6986a81ab8 req-996978b3-98b8-47d9-a296-411c75321743 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:25.189102 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e5ada1e9-d120-49f0-9e3a-eb6986a81ab8 req-996978b3-98b8-47d9-a296-411c75321743 service nova] Creating event network-vif-plugged:0b00b531-b0ae-4f1d-a442-74a1fe2153df for instance afb25768-95bd-4f59-95dc-a08ca3477af3 on nch1-master-1 Mar 05 21:20:25.194278 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e5ada1e9-d120-49f0-9e3a-eb6986a81ab8 req-996978b3-98b8-47d9-a296-411c75321743 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132279 Mar 05 21:20:25.194852 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2776/5511] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:20:25.579385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3f4ecc22-0364-43e9-bcff-979e138ad358 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:25.580345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3f4ecc22-0364-43e9-bcff-979e138ad358 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:25.592091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f4ecc22-0364-43e9-bcff-979e138ad358 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:25.592091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f4ecc22-0364-43e9-bcff-979e138ad358 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:25.592091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f4ecc22-0364-43e9-bcff-979e138ad358 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:25.592091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3f4ecc22-0364-43e9-bcff-979e138ad358 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:25.757705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3f4ecc22-0364-43e9-bcff-979e138ad358 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:25.768791 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3f4ecc22-0364-43e9-bcff-979e138ad358 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1681 microversion: 2.1 time: 0.194615 Mar 05 21:20:25.769434 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2736/5512] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:25 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:47.957075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-21c97e55-480a-4258-a29a-a2f9b4753817 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:20:47.959124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-21c97e55-480a-4258-a29a-a2f9b4753817 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:47.969124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21c97e55-480a-4258-a29a-a2f9b4753817 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:47.969843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21c97e55-480a-4258-a29a-a2f9b4753817 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:47.971198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21c97e55-480a-4258-a29a-a2f9b4753817 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:47.971944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-21c97e55-480a-4258-a29a-a2f9b4753817 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:48.028350 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-21c97e55-480a-4258-a29a-a2f9b4753817 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3/action" status: 200 len: 24578 microversion: 2.1 time: 0.075966 Mar 05 21:20:48.029765 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2777/5513] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:20:47 2022] POST /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3/action => generated 24578 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:20:50.867230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9b34983b-8716-4697-a8d7-267d50dedd1f tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-149484564", "availability_zone": "foo_zone"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:20:50.868855 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:20:50.868855 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 21:20:50.869814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.aggregate [None req-9b34983b-8716-4697-a8d7-267d50dedd1f tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Generated uuid 32a7e623-31ec-4f7d-aedd-15fb3933e696 for aggregate {{(pid=141478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 05 21:20:50.906701 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9b34983b-8716-4697-a8d7-267d50dedd1f tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.190845 Mar 05 21:20:50.907626 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2737/5514] 10.222.0.15 () {60 vars in 1163 bytes} [Sat Mar 5 21:20:50 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:50.920356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-45100c56-e041-4eb3-9aa0-b462a513df13 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:20:50.921730 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:20:50.921730 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 21:20:50.960339 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-45100c56-e041-4eb3-9aa0-b462a513df13 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.045477 Mar 05 21:20:50.961103 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2778/5515] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 21:20:50 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:50.973890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dddc8297-a826-4020-8c8f-bd2f060938e9 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:50.975336 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:20:50.975336 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 21:20:50.976934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dddc8297-a826-4020-8c8f-bd2f060938e9 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:50.977760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dddc8297-a826-4020-8c8f-bd2f060938e9 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:50.978673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dddc8297-a826-4020-8c8f-bd2f060938e9 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:50.979205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dddc8297-a826-4020-8c8f-bd2f060938e9 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:51.008254 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dddc8297-a826-4020-8c8f-bd2f060938e9 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] 10.222.0.15 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040577 Mar 05 21:20:51.008881 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2738/5516] 10.222.0.15 () {58 vars in 1175 bytes} [Sat Mar 5 21:20:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:51.020416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ca265eb2-94ea-4711-841d-0a447c3c4643 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:51.021182 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:20:51.021182 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 21:20:51.029537 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ca265eb2-94ea-4711-841d-0a447c3c4643 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.014313 Mar 05 21:20:51.030124 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2779/5517] 10.222.0.15 () {58 vars in 1142 bytes} [Sat Mar 5 21:20:51 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:51.041168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-017ef3f1-2664-4a9d-9b0c-10d413301938 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:20:51.042522 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:20:51.042522 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 21:20:51.052127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-017ef3f1-2664-4a9d-9b0c-10d413301938 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:51.052927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-017ef3f1-2664-4a9d-9b0c-10d413301938 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:51.329533 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-017ef3f1-2664-4a9d-9b0c-10d413301938 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.292542 Mar 05 21:20:51.330168 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2739/5518] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 21:20:51 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:51.340288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5341f580-32d5-491d-8857-b3ecccbb8265 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:51.341053 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:20:51.341053 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 21:20:51.350241 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5341f580-32d5-491d-8857-b3ecccbb8265 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.013555 Mar 05 21:20:51.351054 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2780/5519] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 21:20:51 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:51.362454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5c85b9d9-f557-4af9-a176-c49ad07b3c10 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-957978698", "availability_zone": "foo_zone"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:20:51.440504 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:20:51.440504 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 21:20:51.480953 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5c85b9d9-f557-4af9-a176-c49ad07b3c10 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] 10.222.0.15 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.123015 Mar 05 21:20:51.481486 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2740/5520] 10.222.0.15 () {60 vars in 1172 bytes} [Sat Mar 5 21:20:51 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:51.492906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7ce17628-cfb4-4433-b613-992a88376c9b tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:20:51.494199 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:20:51.494199 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 21:20:51.515918 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7ce17628-cfb4-4433-b613-992a88376c9b tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.026825 Mar 05 21:20:51.516674 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2781/5521] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 21:20:51 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:51.526688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3ec0029f-4a8d-4484-bd23-4f665a78c6cf tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:51.527753 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:20:51.527753 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 21:20:51.535629 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3ec0029f-4a8d-4484-bd23-4f665a78c6cf tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] 10.222.0.15 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.012750 Mar 05 21:20:51.536199 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2741/5522] 10.222.0.15 () {58 vars in 1151 bytes} [Sat Mar 5 21:20:51 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:51.546299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-45acdfe0-fdc4-485c-82e6-b9b96ee6d7a8 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:20:51.547526 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:20:51.547526 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 21:20:51.558646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45acdfe0-fdc4-485c-82e6-b9b96ee6d7a8 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:51.559102 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45acdfe0-fdc4-485c-82e6-b9b96ee6d7a8 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:51.737215 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-45acdfe0-fdc4-485c-82e6-b9b96ee6d7a8 tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] 10.222.0.15 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.194517 Mar 05 21:20:51.737739 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2782/5523] 10.222.0.15 () {60 vars in 1193 bytes} [Sat Mar 5 21:20:51 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:51.747531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-03d97dc7-6741-475c-ba8d-f83891f7b02a tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:51.748305 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:20:51.748305 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 21:20:51.770925 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-03d97dc7-6741-475c-ba8d-f83891f7b02a tempest-TestAggregatesBasicOps-1600260429 tempest-TestAggregatesBasicOps-1600260429-project-admin] 10.222.0.15 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.026917 Mar 05 21:20:51.771515 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2742/5524] 10.222.0.15 () {58 vars in 1154 bytes} [Sat Mar 5 21:20:51 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 05 21:20:54.618412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a7581bbe-5699-4697-b639-2350b60bb52f tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:54.619876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a7581bbe-5699-4697-b639-2350b60bb52f tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:54.630995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7581bbe-5699-4697-b639-2350b60bb52f tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:54.631460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7581bbe-5699-4697-b639-2350b60bb52f tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:54.633264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7581bbe-5699-4697-b639-2350b60bb52f tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:54.633935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7581bbe-5699-4697-b639-2350b60bb52f tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:54.950801 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a7581bbe-5699-4697-b639-2350b60bb52f tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1832 microversion: 2.1 time: 0.337001 Mar 05 21:20:54.951497 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2783/5525] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:54 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1832 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:56.367500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1e359691-750d-4ce7-be86-e71eeecba0ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:56.368575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1e359691-750d-4ce7-be86-e71eeecba0ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:56.375978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e359691-750d-4ce7-be86-e71eeecba0ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:56.377518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e359691-750d-4ce7-be86-e71eeecba0ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:56.378643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e359691-750d-4ce7-be86-e71eeecba0ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:56.379321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e359691-750d-4ce7-be86-e71eeecba0ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:56.406609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1e359691-750d-4ce7-be86-e71eeecba0ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:20:56.457157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-610c096c-5682-4ba1-85e5-8cd7f6420291 req-532ab7e2-75be-41a3-b684-79749edaa1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb25768-95bd-4f59-95dc-a08ca3477af3", "tag": "0b00b531-b0ae-4f1d-a442-74a1fe2153df"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:20:56.466527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-610c096c-5682-4ba1-85e5-8cd7f6420291 req-532ab7e2-75be-41a3-b684-79749edaa1f2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:56.466923 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-610c096c-5682-4ba1-85e5-8cd7f6420291 req-532ab7e2-75be-41a3-b684-79749edaa1f2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:56.483112 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-610c096c-5682-4ba1-85e5-8cd7f6420291 req-532ab7e2-75be-41a3-b684-79749edaa1f2 service nova] Creating event network-changed:0b00b531-b0ae-4f1d-a442-74a1fe2153df for instance afb25768-95bd-4f59-95dc-a08ca3477af3 on nch1-master-1 Mar 05 21:20:56.493534 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-610c096c-5682-4ba1-85e5-8cd7f6420291 req-532ab7e2-75be-41a3-b684-79749edaa1f2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118174 Mar 05 21:20:56.510962 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2784/5526] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:56.514206 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1e359691-750d-4ce7-be86-e71eeecba0ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "DELETE /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 204 len: 0 microversion: 2.1 time: 0.148653 Mar 05 21:20:56.516361 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2743/5527] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:20:56 2022] DELETE /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:20:56.526432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d4e9dc10-37b5-412f-90b6-2a8f64d33155 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:56.527946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d4e9dc10-37b5-412f-90b6-2a8f64d33155 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:56.542958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4e9dc10-37b5-412f-90b6-2a8f64d33155 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:56.543831 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4e9dc10-37b5-412f-90b6-2a8f64d33155 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:56.544880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4e9dc10-37b5-412f-90b6-2a8f64d33155 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:56.545541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4e9dc10-37b5-412f-90b6-2a8f64d33155 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:56.879012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d4e9dc10-37b5-412f-90b6-2a8f64d33155 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:56.887638 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d4e9dc10-37b5-412f-90b6-2a8f64d33155 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1687 microversion: 2.1 time: 0.367803 Mar 05 21:20:56.896526 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2785/5528] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:56 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1687 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:57.916023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b0a200ee-0de8-499a-827a-4ba87b325cae tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:57.916743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b0a200ee-0de8-499a-827a-4ba87b325cae tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:57.923528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0a200ee-0de8-499a-827a-4ba87b325cae tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:57.924030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0a200ee-0de8-499a-827a-4ba87b325cae tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:57.924823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0a200ee-0de8-499a-827a-4ba87b325cae tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:57.925272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0a200ee-0de8-499a-827a-4ba87b325cae tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:58.177464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b0a200ee-0de8-499a-827a-4ba87b325cae tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:20:58.185376 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b0a200ee-0de8-499a-827a-4ba87b325cae tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 200 len: 1569 microversion: 2.1 time: 0.273612 Mar 05 21:20:58.186176 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2744/5529] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:57 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 1569 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:20:58.526299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-70c5e5e7-44c0-4a0c-aa9d-91a33a0d7e60 req-a7af302a-a233-42b2-80eb-196ae4bbb6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb25768-95bd-4f59-95dc-a08ca3477af3", "name": "network-vif-deleted", "tag": "0b00b531-b0ae-4f1d-a442-74a1fe2153df"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:20:58.541203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-70c5e5e7-44c0-4a0c-aa9d-91a33a0d7e60 req-a7af302a-a233-42b2-80eb-196ae4bbb6ac service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:58.542035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-70c5e5e7-44c0-4a0c-aa9d-91a33a0d7e60 req-a7af302a-a233-42b2-80eb-196ae4bbb6ac service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:58.559732 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-70c5e5e7-44c0-4a0c-aa9d-91a33a0d7e60 req-a7af302a-a233-42b2-80eb-196ae4bbb6ac service nova] Creating event network-vif-deleted:0b00b531-b0ae-4f1d-a442-74a1fe2153df for instance afb25768-95bd-4f59-95dc-a08ca3477af3 on nch1-master-1 Mar 05 21:20:58.566405 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-70c5e5e7-44c0-4a0c-aa9d-91a33a0d7e60 req-a7af302a-a233-42b2-80eb-196ae4bbb6ac service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043818 Mar 05 21:20:58.567225 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2786/5530] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:20:59.203455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-281300ee-f00d-4872-a399-b662801f203a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:20:59.204196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-281300ee-f00d-4872-a399-b662801f203a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: afb25768-95bd-4f59-95dc-a08ca3477af3] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:20:59.211208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-281300ee-f00d-4872-a399-b662801f203a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:59.211693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-281300ee-f00d-4872-a399-b662801f203a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:59.212898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-281300ee-f00d-4872-a399-b662801f203a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:20:59.213519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-281300ee-f00d-4872-a399-b662801f203a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:20:59.230020 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-281300ee-f00d-4872-a399-b662801f203a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] HTTP exception thrown: Instance afb25768-95bd-4f59-95dc-a08ca3477af3 could not be found. Mar 05 21:20:59.230637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-281300ee-f00d-4872-a399-b662801f203a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Returning 404 to user: Instance afb25768-95bd-4f59-95dc-a08ca3477af3 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:20:59.231475 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-281300ee-f00d-4872-a399-b662801f203a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3" status: 404 len: 111 microversion: 2.1 time: 0.032010 Mar 05 21:20:59.232073 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2745/5531] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:20:59 2022] GET /compute/v2.1/servers/afb25768-95bd-4f59-95dc-a08ca3477af3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:21:02.750011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ce3dad1-6767-4a95-a59d-24eeaa358533 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '.version_select at 0x7fed4f6d04c0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:02.770962 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ce3dad1-6767-4a95-a59d-24eeaa358533 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-604599963" status: 202 len: 0 microversion: 2.1 time: 0.025815 Mar 05 21:21:02.771644 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2787/5532] 10.222.0.15 () {58 vars in 1280 bytes} [Sat Mar 5 21:21:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-604599963 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 21:21:02.799646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a87d5e00-d5a2-41ba-99ea-f87c66ec9ae4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'create', calling method: .version_select at 0x7fed4c732820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1088685082"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:21:02.813660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a87d5e00-d5a2-41ba-99ea-f87c66ec9ae4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:21:02.820994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a87d5e00-d5a2-41ba-99ea-f87c66ec9ae4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for user f9a39fb8a8fe498db9a98166acf96d0d and project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:21:03.070495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a87d5e00-d5a2-41ba-99ea-f87c66ec9ae4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:21:03.075421 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a87d5e00-d5a2-41ba-99ea-f87c66ec9ae4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for user f9a39fb8a8fe498db9a98166acf96d0d and project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:21:03.089957 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a87d5e00-d5a2-41ba-99ea-f87c66ec9ae4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.295029 Mar 05 21:21:03.090564 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2746/5533] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:21:02 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:21:08.778065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1296478465", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "3d55d609-f400-454a-bf9e-f66ee003cded"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1088685082", "security_groups": [{"name": "tempest-secgroup-smoke-323888337"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:21:08.938283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] validate_networks() for [('3d55d609-f400-454a-bf9e-f66ee003cded', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:21:09.415444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:21:09.416131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:21:09.417452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:21:09.418174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:21:09.419108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:21:09.429856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:09.430317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:09.431133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:09.431580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:09.464392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for project 7be8dce4a165431c8a7279be20d99612. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:21:09.470477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for user f9a39fb8a8fe498db9a98166acf96d0d and project 7be8dce4a165431c8a7279be20d99612. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:21:09.488817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:21:09.492301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:21:09.574991 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7e6420f7-e6fb-49a7-a9ff-3f8cd989deb1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.809163 Mar 05 21:21:09.582466 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2788/5534] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:21:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:21:09.591056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4af0bfab-0adf-4451-a1f9-dc5ede21871b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:09.593955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4af0bfab-0adf-4451-a1f9-dc5ede21871b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:09.705800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4af0bfab-0adf-4451-a1f9-dc5ede21871b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:09.715609 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4af0bfab-0adf-4451-a1f9-dc5ede21871b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1267 microversion: 2.1 time: 0.131378 Mar 05 21:21:09.716857 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2747/5535] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:09 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:09.736490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-165636891", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1698875555", "security_groups": [{"name": "tempest-secgroup-smoke-108176879"}], "block_device_mapping_v2": [{"uuid": "01335ff0-455d-4442-8826-b96e8565b6f9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "82b49213-810d-43f2-9dca-5a622352a45d"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:21:09.917361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] validate_networks() for [('82b49213-810d-43f2-9dca-5a622352a45d', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:21:10.356422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:21:10.356851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:21:10.357468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:21:10.358151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:21:10.358670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:21:10.370178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:10.370708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:10.371525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:10.372022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:10.389944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for project cdcb29011e61419981c5bfc5f10677c5. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:21:10.395658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Getting quotas for user 0c07bd2946594c3e8848bca133da0d90 and project cdcb29011e61419981c5bfc5f10677c5. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:21:10.454456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:21:10.457131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01335ff0-455d-4442-8826-b96e8565b6f9',volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:21:10.616309 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-563afe4d-bbb7-48ac-91de-1e1bc2767ec5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.884326 Mar 05 21:21:10.617141 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2789/5536] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:21:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:21:10.627142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f800f3f0-f341-475e-a645-afad385ea216 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:10.628362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f800f3f0-f341-475e-a645-afad385ea216 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:10.707223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f800f3f0-f341-475e-a645-afad385ea216 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:10.716297 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f800f3f0-f341-475e-a645-afad385ea216 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1094 microversion: 2.1 time: 0.093096 Mar 05 21:21:10.716904 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2748/5537] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:10 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:10.732944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0cf01bd-220a-4830-a8d0-38476648a8c7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:10.733886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e0cf01bd-220a-4830-a8d0-38476648a8c7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:10.745802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0cf01bd-220a-4830-a8d0-38476648a8c7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:10.748279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0cf01bd-220a-4830-a8d0-38476648a8c7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:10.750482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0cf01bd-220a-4830-a8d0-38476648a8c7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:10.752110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0cf01bd-220a-4830-a8d0-38476648a8c7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:10.841514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e0cf01bd-220a-4830-a8d0-38476648a8c7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:10.850861 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0cf01bd-220a-4830-a8d0-38476648a8c7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1327 microversion: 2.1 time: 0.121599 Mar 05 21:21:10.851490 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2790/5538] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:10 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1327 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:11.738411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-43105e60-7935-4bde-9fe9-5190a22cf9e0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:11.739126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-43105e60-7935-4bde-9fe9-5190a22cf9e0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:11.746643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43105e60-7935-4bde-9fe9-5190a22cf9e0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:11.747213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43105e60-7935-4bde-9fe9-5190a22cf9e0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:11.748134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43105e60-7935-4bde-9fe9-5190a22cf9e0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:11.748595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43105e60-7935-4bde-9fe9-5190a22cf9e0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:11.842545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-43105e60-7935-4bde-9fe9-5190a22cf9e0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:11.865795 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-43105e60-7935-4bde-9fe9-5190a22cf9e0 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1192 microversion: 2.1 time: 0.133172 Mar 05 21:21:11.875851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b3bc41d5-3b6a-4844-9d7a-353647233ecf tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:11.877230 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2749/5539] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:11 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1192 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:11.877327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b3bc41d5-3b6a-4844-9d7a-353647233ecf tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:11.884724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3bc41d5-3b6a-4844-9d7a-353647233ecf tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:11.887521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3bc41d5-3b6a-4844-9d7a-353647233ecf tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:11.888826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3bc41d5-3b6a-4844-9d7a-353647233ecf tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:11.889514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3bc41d5-3b6a-4844-9d7a-353647233ecf tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:12.144659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b3bc41d5-3b6a-4844-9d7a-353647233ecf tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:12.160206 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b3bc41d5-3b6a-4844-9d7a-353647233ecf tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1392 microversion: 2.1 time: 0.295633 Mar 05 21:21:12.161470 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2791/5540] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:11 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1392 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:21:12.884148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c5c1d22-d5c1-4423-81c4-05eb39f95b7b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:12.884801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c5c1d22-d5c1-4423-81c4-05eb39f95b7b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:12.907894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c5c1d22-d5c1-4423-81c4-05eb39f95b7b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:12.908574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c5c1d22-d5c1-4423-81c4-05eb39f95b7b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:12.909441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c5c1d22-d5c1-4423-81c4-05eb39f95b7b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:12.909904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c5c1d22-d5c1-4423-81c4-05eb39f95b7b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:13.004410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8c5c1d22-d5c1-4423-81c4-05eb39f95b7b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:13.012332 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8c5c1d22-d5c1-4423-81c4-05eb39f95b7b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1210 microversion: 2.1 time: 0.132688 Mar 05 21:21:13.012926 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2750/5541] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:12 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:13.178385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a421cea1-d40a-47d3-b96e-98156f43eaf3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:13.179804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a421cea1-d40a-47d3-b96e-98156f43eaf3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:13.186922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a421cea1-d40a-47d3-b96e-98156f43eaf3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:13.187591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a421cea1-d40a-47d3-b96e-98156f43eaf3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:13.189296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a421cea1-d40a-47d3-b96e-98156f43eaf3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:13.190153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a421cea1-d40a-47d3-b96e-98156f43eaf3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:13.267604 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-ef92170c-14d1-4f04-abc7-088bd46c716f req-3da75c92-7c6c-461b-b75d-eb4bef6be40c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c80c28-c101-4b19-bf5b-4fa5075ef055", "tag": "e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:21:13.302534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ef92170c-14d1-4f04-abc7-088bd46c716f req-3da75c92-7c6c-461b-b75d-eb4bef6be40c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:13.303263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ef92170c-14d1-4f04-abc7-088bd46c716f req-3da75c92-7c6c-461b-b75d-eb4bef6be40c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:13.334156 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ef92170c-14d1-4f04-abc7-088bd46c716f req-3da75c92-7c6c-461b-b75d-eb4bef6be40c service nova] Creating event network-changed:e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f for instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 on nch2-master-1 Mar 05 21:21:13.341015 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-ef92170c-14d1-4f04-abc7-088bd46c716f req-3da75c92-7c6c-461b-b75d-eb4bef6be40c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080437 Mar 05 21:21:13.342250 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2751/5542] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:21:13.414286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a421cea1-d40a-47d3-b96e-98156f43eaf3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:13.425399 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a421cea1-d40a-47d3-b96e-98156f43eaf3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1392 microversion: 2.1 time: 0.251113 Mar 05 21:21:13.426171 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2792/5543] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:13 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1392 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:14.031175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e32e726e-6f19-49b8-9ad7-e0625344558b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:14.032410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e32e726e-6f19-49b8-9ad7-e0625344558b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:14.039187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e32e726e-6f19-49b8-9ad7-e0625344558b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:14.039661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e32e726e-6f19-49b8-9ad7-e0625344558b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:14.040647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e32e726e-6f19-49b8-9ad7-e0625344558b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:14.041131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e32e726e-6f19-49b8-9ad7-e0625344558b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:14.431298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e32e726e-6f19-49b8-9ad7-e0625344558b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:14.439260 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e32e726e-6f19-49b8-9ad7-e0625344558b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1265 microversion: 2.1 time: 0.413288 Mar 05 21:21:14.440353 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2752/5544] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:14 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:14.443546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-150e262f-6d4f-4268-9619-0d941272095b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:14.444211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-150e262f-6d4f-4268-9619-0d941272095b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:14.450910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-150e262f-6d4f-4268-9619-0d941272095b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:14.451369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-150e262f-6d4f-4268-9619-0d941272095b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:14.452204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-150e262f-6d4f-4268-9619-0d941272095b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:14.452630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-150e262f-6d4f-4268-9619-0d941272095b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:14.603066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-150e262f-6d4f-4268-9619-0d941272095b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:14.613923 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-150e262f-6d4f-4268-9619-0d941272095b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1392 microversion: 2.1 time: 0.174593 Mar 05 21:21:14.623555 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2793/5545] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:14 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:21:15.376674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e48224ee-e91e-4021-9ec8-05204c9d37e3 req-8a3bae77-202e-4df6-b5c6-53538325cee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cdd70d0-e01c-4a03-95c8-55a1bdad1323", "tag": "b9de74e7-a8f7-46f7-9407-5aeb0c3859da"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:21:15.386500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e48224ee-e91e-4021-9ec8-05204c9d37e3 req-8a3bae77-202e-4df6-b5c6-53538325cee7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:15.386955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e48224ee-e91e-4021-9ec8-05204c9d37e3 req-8a3bae77-202e-4df6-b5c6-53538325cee7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:15.399324 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e48224ee-e91e-4021-9ec8-05204c9d37e3 req-8a3bae77-202e-4df6-b5c6-53538325cee7 service nova] Creating event network-changed:b9de74e7-a8f7-46f7-9407-5aeb0c3859da for instance 9cdd70d0-e01c-4a03-95c8-55a1bdad1323 on nch1-master-1 Mar 05 21:21:15.404332 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e48224ee-e91e-4021-9ec8-05204c9d37e3 req-8a3bae77-202e-4df6-b5c6-53538325cee7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032091 Mar 05 21:21:15.404944 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2753/5546] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:21:15.457013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b8d9a00c-464a-46b2-bac9-9b5d337ceb45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:15.457630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b8d9a00c-464a-46b2-bac9-9b5d337ceb45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:15.464547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8d9a00c-464a-46b2-bac9-9b5d337ceb45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:15.465000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8d9a00c-464a-46b2-bac9-9b5d337ceb45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:15.465781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8d9a00c-464a-46b2-bac9-9b5d337ceb45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:15.466229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b8d9a00c-464a-46b2-bac9-9b5d337ceb45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:15.603795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b8d9a00c-464a-46b2-bac9-9b5d337ceb45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:15.612037 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b8d9a00c-464a-46b2-bac9-9b5d337ceb45 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1265 microversion: 2.1 time: 0.159675 Mar 05 21:21:15.612616 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2794/5547] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:15 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:15.631969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-79ca914c-1b5c-422a-bba7-a5734a2371ba tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:15.632691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-79ca914c-1b5c-422a-bba7-a5734a2371ba tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:15.638699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79ca914c-1b5c-422a-bba7-a5734a2371ba tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:15.639164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79ca914c-1b5c-422a-bba7-a5734a2371ba tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:15.640004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79ca914c-1b5c-422a-bba7-a5734a2371ba tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:15.640576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79ca914c-1b5c-422a-bba7-a5734a2371ba tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:15.842750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-79ca914c-1b5c-422a-bba7-a5734a2371ba tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:15.850955 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-79ca914c-1b5c-422a-bba7-a5734a2371ba tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1392 microversion: 2.1 time: 0.223607 Mar 05 21:21:15.851539 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2754/5548] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:15 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1392 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:16.629018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3938c202-e9bd-46a0-9427-f06abeac887a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:16.629630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3938c202-e9bd-46a0-9427-f06abeac887a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:16.636816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3938c202-e9bd-46a0-9427-f06abeac887a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:16.637272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3938c202-e9bd-46a0-9427-f06abeac887a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:16.638040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3938c202-e9bd-46a0-9427-f06abeac887a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:16.638478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3938c202-e9bd-46a0-9427-f06abeac887a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:16.808935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3938c202-e9bd-46a0-9427-f06abeac887a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:16.818942 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3938c202-e9bd-46a0-9427-f06abeac887a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1265 microversion: 2.1 time: 0.194534 Mar 05 21:21:16.819660 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2795/5549] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:16 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:16.867868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-40bdd460-547b-4272-a54c-2beaf3ab9172 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:16.868505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-40bdd460-547b-4272-a54c-2beaf3ab9172 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:16.875102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-40bdd460-547b-4272-a54c-2beaf3ab9172 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:16.875616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-40bdd460-547b-4272-a54c-2beaf3ab9172 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:16.877132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-40bdd460-547b-4272-a54c-2beaf3ab9172 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:16.877681 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-40bdd460-547b-4272-a54c-2beaf3ab9172 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:17.024963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-40bdd460-547b-4272-a54c-2beaf3ab9172 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:17.032854 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-40bdd460-547b-4272-a54c-2beaf3ab9172 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1392 microversion: 2.1 time: 0.168909 Mar 05 21:21:17.033439 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2755/5550] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:16 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:17.835919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-04f276b6-b1bd-4649-b851-c7caf82bd692 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:17.836546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-04f276b6-b1bd-4649-b851-c7caf82bd692 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:17.843318 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04f276b6-b1bd-4649-b851-c7caf82bd692 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:17.843810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04f276b6-b1bd-4649-b851-c7caf82bd692 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:17.845801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04f276b6-b1bd-4649-b851-c7caf82bd692 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:17.846245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04f276b6-b1bd-4649-b851-c7caf82bd692 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:17.982828 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-04f276b6-b1bd-4649-b851-c7caf82bd692 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:17.990566 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-04f276b6-b1bd-4649-b851-c7caf82bd692 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1265 microversion: 2.1 time: 0.158557 Mar 05 21:21:17.991174 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2796/5551] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:17 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:18.049543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5d3f63c2-2aba-4e89-8576-0d518f7d960b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:18.050106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5d3f63c2-2aba-4e89-8576-0d518f7d960b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:18.056942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d3f63c2-2aba-4e89-8576-0d518f7d960b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:18.057413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d3f63c2-2aba-4e89-8576-0d518f7d960b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:18.058192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d3f63c2-2aba-4e89-8576-0d518f7d960b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:18.058647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d3f63c2-2aba-4e89-8576-0d518f7d960b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:18.193436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5d3f63c2-2aba-4e89-8576-0d518f7d960b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:18.200723 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5d3f63c2-2aba-4e89-8576-0d518f7d960b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1392 microversion: 2.1 time: 0.155391 Mar 05 21:21:18.201288 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2756/5552] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:18 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:18.902080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c15a65ae-5225-423f-b746-dd8cb2895f4c req-c2b36937-fbd5-472e-a1f9-5c3523272cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c80c28-c101-4b19-bf5b-4fa5075ef055", "name": "network-vif-plugged", "status": "completed", "tag": "e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:21:18.913172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c15a65ae-5225-423f-b746-dd8cb2895f4c req-c2b36937-fbd5-472e-a1f9-5c3523272cf2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:18.913990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c15a65ae-5225-423f-b746-dd8cb2895f4c req-c2b36937-fbd5-472e-a1f9-5c3523272cf2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:18.927504 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c15a65ae-5225-423f-b746-dd8cb2895f4c req-c2b36937-fbd5-472e-a1f9-5c3523272cf2 service nova] Creating event network-vif-plugged:e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f for instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 on nch2-master-1 Mar 05 21:21:18.932606 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c15a65ae-5225-423f-b746-dd8cb2895f4c req-c2b36937-fbd5-472e-a1f9-5c3523272cf2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034424 Mar 05 21:21:18.933218 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2797/5553] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:21:19.007731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-30891810-615f-47e9-94ef-9cdb796f840b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:19.008759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-30891810-615f-47e9-94ef-9cdb796f840b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:19.014924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30891810-615f-47e9-94ef-9cdb796f840b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:19.015403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30891810-615f-47e9-94ef-9cdb796f840b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:19.016825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30891810-615f-47e9-94ef-9cdb796f840b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:19.018369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-30891810-615f-47e9-94ef-9cdb796f840b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:19.187092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-30891810-615f-47e9-94ef-9cdb796f840b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:19.206351 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-30891810-615f-47e9-94ef-9cdb796f840b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1265 microversion: 2.1 time: 0.203194 Mar 05 21:21:19.206962 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2757/5554] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:19 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:19.218534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9f4a71fd-1822-4e60-b78f-158abe148f32 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:19.219288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9f4a71fd-1822-4e60-b78f-158abe148f32 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:19.227440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f4a71fd-1822-4e60-b78f-158abe148f32 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:19.227942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f4a71fd-1822-4e60-b78f-158abe148f32 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:19.228733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f4a71fd-1822-4e60-b78f-158abe148f32 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:19.229182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f4a71fd-1822-4e60-b78f-158abe148f32 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:19.367233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9f4a71fd-1822-4e60-b78f-158abe148f32 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:19.374806 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9f4a71fd-1822-4e60-b78f-158abe148f32 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1392 microversion: 2.1 time: 0.160998 Mar 05 21:21:19.375391 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2798/5555] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:19 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:20.222417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b2c1d68a-54ae-4fd1-a6f2-a10f9786ceb5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:20.223043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b2c1d68a-54ae-4fd1-a6f2-a10f9786ceb5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:20.229723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2c1d68a-54ae-4fd1-a6f2-a10f9786ceb5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:20.230184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2c1d68a-54ae-4fd1-a6f2-a10f9786ceb5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:20.230955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2c1d68a-54ae-4fd1-a6f2-a10f9786ceb5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:20.231402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2c1d68a-54ae-4fd1-a6f2-a10f9786ceb5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:20.368858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b2c1d68a-54ae-4fd1-a6f2-a10f9786ceb5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:20.376795 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b2c1d68a-54ae-4fd1-a6f2-a10f9786ceb5 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1265 microversion: 2.1 time: 0.158346 Mar 05 21:21:20.377365 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2758/5556] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:20 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:20.393402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f6e4456a-a517-48e8-8cde-38ad686a98a8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:20.394164 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f6e4456a-a517-48e8-8cde-38ad686a98a8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:20.401117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f6e4456a-a517-48e8-8cde-38ad686a98a8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:20.401572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f6e4456a-a517-48e8-8cde-38ad686a98a8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:20.402340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f6e4456a-a517-48e8-8cde-38ad686a98a8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:20.402780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f6e4456a-a517-48e8-8cde-38ad686a98a8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:20.536307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f6e4456a-a517-48e8-8cde-38ad686a98a8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:20.543947 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f6e4456a-a517-48e8-8cde-38ad686a98a8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1563 microversion: 2.1 time: 0.155029 Mar 05 21:21:20.544533 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2799/5557] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:20 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:20.561441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7950bfb0-d6ad-41c9-bec5-7cfa8f77d2b6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:20.562100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7950bfb0-d6ad-41c9-bec5-7cfa8f77d2b6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:20.568092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7950bfb0-d6ad-41c9-bec5-7cfa8f77d2b6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:20.568560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7950bfb0-d6ad-41c9-bec5-7cfa8f77d2b6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:20.569334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7950bfb0-d6ad-41c9-bec5-7cfa8f77d2b6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:20.569784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7950bfb0-d6ad-41c9-bec5-7cfa8f77d2b6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:20.703243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7950bfb0-d6ad-41c9-bec5-7cfa8f77d2b6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:20.711061 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7950bfb0-d6ad-41c9-bec5-7cfa8f77d2b6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1563 microversion: 2.1 time: 0.153610 Mar 05 21:21:20.711636 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2759/5558] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:20 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:21.141873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-06711e74-a075-4bd3-926f-2b41da7b2904 req-b5cc622f-cf5e-4eca-a1eb-07b8e987c944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdd70d0-e01c-4a03-95c8-55a1bdad1323", "name": "network-vif-plugged", "status": "completed", "tag": "b9de74e7-a8f7-46f7-9407-5aeb0c3859da"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:21:21.150193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-06711e74-a075-4bd3-926f-2b41da7b2904 req-b5cc622f-cf5e-4eca-a1eb-07b8e987c944 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:21.150646 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-06711e74-a075-4bd3-926f-2b41da7b2904 req-b5cc622f-cf5e-4eca-a1eb-07b8e987c944 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:21.162914 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-06711e74-a075-4bd3-926f-2b41da7b2904 req-b5cc622f-cf5e-4eca-a1eb-07b8e987c944 service nova] Creating event network-vif-plugged:b9de74e7-a8f7-46f7-9407-5aeb0c3859da for instance 9cdd70d0-e01c-4a03-95c8-55a1bdad1323 on nch1-master-1 Mar 05 21:21:21.168083 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-06711e74-a075-4bd3-926f-2b41da7b2904 req-b5cc622f-cf5e-4eca-a1eb-07b8e987c944 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030277 Mar 05 21:21:21.169050 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2800/5559] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:21:21.395475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-daf72982-47bb-4cd8-8223-88ca7dcfc438 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:21.396268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-daf72982-47bb-4cd8-8223-88ca7dcfc438 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:21.404940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-daf72982-47bb-4cd8-8223-88ca7dcfc438 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:21.405779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-daf72982-47bb-4cd8-8223-88ca7dcfc438 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:21.407456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-daf72982-47bb-4cd8-8223-88ca7dcfc438 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:21.408340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-daf72982-47bb-4cd8-8223-88ca7dcfc438 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:21.553233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-daf72982-47bb-4cd8-8223-88ca7dcfc438 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:21.560741 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-daf72982-47bb-4cd8-8223-88ca7dcfc438 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1265 microversion: 2.1 time: 0.170618 Mar 05 21:21:21.561322 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2760/5560] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:21 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:22.578689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-338dedcc-9129-42c2-9649-1245436ef743 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:22.579406 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-338dedcc-9129-42c2-9649-1245436ef743 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:22.586271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-338dedcc-9129-42c2-9649-1245436ef743 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:22.586723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-338dedcc-9129-42c2-9649-1245436ef743 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:22.587492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-338dedcc-9129-42c2-9649-1245436ef743 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:22.588179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-338dedcc-9129-42c2-9649-1245436ef743 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:22.771711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c04c9334-af1e-4c18-ba2c-81048bba0e74 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:22.772361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c04c9334-af1e-4c18-ba2c-81048bba0e74 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:22.779363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c04c9334-af1e-4c18-ba2c-81048bba0e74 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:22.779880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c04c9334-af1e-4c18-ba2c-81048bba0e74 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:22.780884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c04c9334-af1e-4c18-ba2c-81048bba0e74 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:22.781487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c04c9334-af1e-4c18-ba2c-81048bba0e74 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:22.786816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-338dedcc-9129-42c2-9649-1245436ef743 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:22.794516 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-338dedcc-9129-42c2-9649-1245436ef743 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1451 microversion: 2.1 time: 0.220963 Mar 05 21:21:22.795332 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2801/5561] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:22 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1451 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:22.805610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-dfda1e2a-2191-4bff-9425-29aa72cf62d8 req-19ec7b51-f2c6-4355-8804-1c35e04459d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c80c28-c101-4b19-bf5b-4fa5075ef055", "tag": "e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:21:22.815335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-dfda1e2a-2191-4bff-9425-29aa72cf62d8 req-19ec7b51-f2c6-4355-8804-1c35e04459d3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:22.815898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-dfda1e2a-2191-4bff-9425-29aa72cf62d8 req-19ec7b51-f2c6-4355-8804-1c35e04459d3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:22.830880 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-dfda1e2a-2191-4bff-9425-29aa72cf62d8 req-19ec7b51-f2c6-4355-8804-1c35e04459d3 service nova] Creating event network-changed:e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f for instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 on nch2-master-1 Mar 05 21:21:22.836276 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-dfda1e2a-2191-4bff-9425-29aa72cf62d8 req-19ec7b51-f2c6-4355-8804-1c35e04459d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039994 Mar 05 21:21:22.837078 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2802/5562] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:21:22.846538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a9be351e-297f-46ee-9834-bd07b9bbdcfb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:22.847266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a9be351e-297f-46ee-9834-bd07b9bbdcfb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:22.853599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9be351e-297f-46ee-9834-bd07b9bbdcfb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:22.854066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9be351e-297f-46ee-9834-bd07b9bbdcfb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:22.855049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9be351e-297f-46ee-9834-bd07b9bbdcfb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:22.855504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9be351e-297f-46ee-9834-bd07b9bbdcfb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:22.973445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c04c9334-af1e-4c18-ba2c-81048bba0e74 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:22.981350 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c04c9334-af1e-4c18-ba2c-81048bba0e74 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1563 microversion: 2.1 time: 0.214493 Mar 05 21:21:22.981939 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2761/5563] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:22 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1563 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:23.095995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a9be351e-297f-46ee-9834-bd07b9bbdcfb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:23.104474 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a9be351e-297f-46ee-9834-bd07b9bbdcfb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1451 microversion: 2.1 time: 0.263498 Mar 05 21:21:23.105268 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2803/5564] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:22 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1451 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:24.850956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-97b51106-202b-48e3-a9d4-9cf76ea0a59a req-7699defa-b3dd-4b21-a6b3-40e572440b28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cdd70d0-e01c-4a03-95c8-55a1bdad1323", "tag": "b9de74e7-a8f7-46f7-9407-5aeb0c3859da"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:21:24.860042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-97b51106-202b-48e3-a9d4-9cf76ea0a59a req-7699defa-b3dd-4b21-a6b3-40e572440b28 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:24.860516 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-97b51106-202b-48e3-a9d4-9cf76ea0a59a req-7699defa-b3dd-4b21-a6b3-40e572440b28 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:24.875724 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-97b51106-202b-48e3-a9d4-9cf76ea0a59a req-7699defa-b3dd-4b21-a6b3-40e572440b28 service nova] Creating event network-changed:b9de74e7-a8f7-46f7-9407-5aeb0c3859da for instance 9cdd70d0-e01c-4a03-95c8-55a1bdad1323 on nch1-master-1 Mar 05 21:21:24.885526 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-97b51106-202b-48e3-a9d4-9cf76ea0a59a req-7699defa-b3dd-4b21-a6b3-40e572440b28 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037781 Mar 05 21:21:24.886903 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2762/5565] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:21:44.276186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ad55385b-9381-431a-84dd-5bfb11b45037 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:21:44.277093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ad55385b-9381-431a-84dd-5bfb11b45037 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:44.283483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad55385b-9381-431a-84dd-5bfb11b45037 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:44.283982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad55385b-9381-431a-84dd-5bfb11b45037 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:44.284752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad55385b-9381-431a-84dd-5bfb11b45037 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:44.285193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad55385b-9381-431a-84dd-5bfb11b45037 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:44.338479 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ad55385b-9381-431a-84dd-5bfb11b45037 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055/action" status: 200 len: 24561 microversion: 2.1 time: 0.067149 Mar 05 21:21:44.339120 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2804/5566] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:21:44 2022] POST /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055/action => generated 24561 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:21:55.326828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cb10070e-42c5-46f8-a4c9-c3541401e5da tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:55.327546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cb10070e-42c5-46f8-a4c9-c3541401e5da tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:55.333780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb10070e-42c5-46f8-a4c9-c3541401e5da tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:55.334249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb10070e-42c5-46f8-a4c9-c3541401e5da tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:55.335071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb10070e-42c5-46f8-a4c9-c3541401e5da tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:55.335534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb10070e-42c5-46f8-a4c9-c3541401e5da tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:55.469788 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cb10070e-42c5-46f8-a4c9-c3541401e5da tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1833 microversion: 2.1 time: 0.148450 Mar 05 21:21:55.470397 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2763/5567] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:55 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1833 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:55.487224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b4dd556a-5575-4a31-afc4-2ad9779a6fce tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:55.488001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b4dd556a-5575-4a31-afc4-2ad9779a6fce tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:55.495112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4dd556a-5575-4a31-afc4-2ad9779a6fce tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:55.495567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4dd556a-5575-4a31-afc4-2ad9779a6fce tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:55.497004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4dd556a-5575-4a31-afc4-2ad9779a6fce tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:55.497443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4dd556a-5575-4a31-afc4-2ad9779a6fce tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:55.638216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b4dd556a-5575-4a31-afc4-2ad9779a6fce tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:55.645615 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b4dd556a-5575-4a31-afc4-2ad9779a6fce tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1682 microversion: 2.1 time: 0.162801 Mar 05 21:21:55.646189 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2805/5568] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:55 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:55.737077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-39f605fa-de83-4844-8d8f-0e57e62214e1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:21:55.738045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-39f605fa-de83-4844-8d8f-0e57e62214e1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:55.743953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39f605fa-de83-4844-8d8f-0e57e62214e1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:55.744420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39f605fa-de83-4844-8d8f-0e57e62214e1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:55.745191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39f605fa-de83-4844-8d8f-0e57e62214e1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:55.745637 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-39f605fa-de83-4844-8d8f-0e57e62214e1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:55.792935 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-39f605fa-de83-4844-8d8f-0e57e62214e1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055/action" status: 200 len: 32635 microversion: 2.1 time: 0.059754 Mar 05 21:21:55.794193 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2764/5569] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:21:55 2022] POST /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 21:21:55.959377 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-18a04660-739e-4d66-943f-4933289de40c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:21:55.960011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-18a04660-739e-4d66-943f-4933289de40c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:55.967144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18a04660-739e-4d66-943f-4933289de40c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:55.967605 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18a04660-739e-4d66-943f-4933289de40c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:55.968416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18a04660-739e-4d66-943f-4933289de40c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:55.968866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18a04660-739e-4d66-943f-4933289de40c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:56.007363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-18a04660-739e-4d66-943f-4933289de40c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7e11ef4525bc43e7a51f03690badd71c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6a7fe2f1e941e4a8dc0e64ff9b2fe9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:56.008017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-18a04660-739e-4d66-943f-4933289de40c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] flavor_id is None. Assuming migration. {{(pid=141479) resize /opt/stack/nova/nova/compute/api.py:4140}} Mar 05 21:21:56.008469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-18a04660-739e-4d66-943f-4933289de40c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141479) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 21:21:56.175051 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-18a04660-739e-4d66-943f-4933289de40c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055/action" status: 202 len: 0 microversion: 2.1 time: 0.219530 Mar 05 21:21:56.175589 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2806/5570] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:21:55 2022] POST /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:21:56.184245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c86ae3f0-87e4-4622-98ab-e9b502ee4a26 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:56.185073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c86ae3f0-87e4-4622-98ab-e9b502ee4a26 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:56.192114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c86ae3f0-87e4-4622-98ab-e9b502ee4a26 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:56.192603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c86ae3f0-87e4-4622-98ab-e9b502ee4a26 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:56.193408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c86ae3f0-87e4-4622-98ab-e9b502ee4a26 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:56.193842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c86ae3f0-87e4-4622-98ab-e9b502ee4a26 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:56.332994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c86ae3f0-87e4-4622-98ab-e9b502ee4a26 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:56.340487 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c86ae3f0-87e4-4622-98ab-e9b502ee4a26 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1691 microversion: 2.1 time: 0.160476 Mar 05 21:21:56.341095 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2765/5571] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:56 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:57.358294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fed60130-8884-47fe-8f4e-76b46d3a2956 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:57.358927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fed60130-8884-47fe-8f4e-76b46d3a2956 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:57.364983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fed60130-8884-47fe-8f4e-76b46d3a2956 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:57.365449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fed60130-8884-47fe-8f4e-76b46d3a2956 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:57.366223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fed60130-8884-47fe-8f4e-76b46d3a2956 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:57.366670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fed60130-8884-47fe-8f4e-76b46d3a2956 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:57.505642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fed60130-8884-47fe-8f4e-76b46d3a2956 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:57.515295 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fed60130-8884-47fe-8f4e-76b46d3a2956 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1691 microversion: 2.1 time: 0.161184 Mar 05 21:21:57.515827 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2807/5572] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:57 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:58.531914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f8a3eb56-4d22-447e-be35-1dfc498ca400 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:58.532577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f8a3eb56-4d22-447e-be35-1dfc498ca400 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:58.540065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8a3eb56-4d22-447e-be35-1dfc498ca400 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:58.540538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8a3eb56-4d22-447e-be35-1dfc498ca400 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:58.541331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8a3eb56-4d22-447e-be35-1dfc498ca400 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:58.541793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8a3eb56-4d22-447e-be35-1dfc498ca400 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:58.679730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f8a3eb56-4d22-447e-be35-1dfc498ca400 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:58.687090 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f8a3eb56-4d22-447e-be35-1dfc498ca400 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.159768 Mar 05 21:21:58.687678 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2766/5573] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:58 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:21:59.704575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f979d93f-e0db-48f0-a30b-141fef74b553 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:21:59.705205 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f979d93f-e0db-48f0-a30b-141fef74b553 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:21:59.712138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f979d93f-e0db-48f0-a30b-141fef74b553 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:59.712604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f979d93f-e0db-48f0-a30b-141fef74b553 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:59.713382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f979d93f-e0db-48f0-a30b-141fef74b553 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:21:59.713837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f979d93f-e0db-48f0-a30b-141fef74b553 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:21:59.851192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f979d93f-e0db-48f0-a30b-141fef74b553 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:21:59.859342 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f979d93f-e0db-48f0-a30b-141fef74b553 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.158667 Mar 05 21:21:59.859949 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2808/5574] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:21:59 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:00.875768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c4a0b53c-fa6d-4d81-92f5-ac21e864744a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:00.876397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c4a0b53c-fa6d-4d81-92f5-ac21e864744a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:00.883230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4a0b53c-fa6d-4d81-92f5-ac21e864744a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:00.883799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4a0b53c-fa6d-4d81-92f5-ac21e864744a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:00.884578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4a0b53c-fa6d-4d81-92f5-ac21e864744a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:00.885036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c4a0b53c-fa6d-4d81-92f5-ac21e864744a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:01.020474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c4a0b53c-fa6d-4d81-92f5-ac21e864744a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:01.028148 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c4a0b53c-fa6d-4d81-92f5-ac21e864744a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.156192 Mar 05 21:22:01.028760 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2767/5575] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:00 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:02.046249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0ec0c4d-b8ef-4e54-afe2-ac9da0ee8868 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:02.046866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e0ec0c4d-b8ef-4e54-afe2-ac9da0ee8868 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:02.053683 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0ec0c4d-b8ef-4e54-afe2-ac9da0ee8868 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:02.054135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0ec0c4d-b8ef-4e54-afe2-ac9da0ee8868 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:02.054901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0ec0c4d-b8ef-4e54-afe2-ac9da0ee8868 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:02.055341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0ec0c4d-b8ef-4e54-afe2-ac9da0ee8868 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:02.197741 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e0ec0c4d-b8ef-4e54-afe2-ac9da0ee8868 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:02.206259 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0ec0c4d-b8ef-4e54-afe2-ac9da0ee8868 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.164812 Mar 05 21:22:02.206848 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2809/5576] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:02 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:03.223840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f533bc24-31c0-4f9a-8a51-199dec70b8db tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:03.224470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f533bc24-31c0-4f9a-8a51-199dec70b8db tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:03.231195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f533bc24-31c0-4f9a-8a51-199dec70b8db tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:03.231663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f533bc24-31c0-4f9a-8a51-199dec70b8db tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:03.232478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f533bc24-31c0-4f9a-8a51-199dec70b8db tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:03.232933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f533bc24-31c0-4f9a-8a51-199dec70b8db tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:03.371435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f533bc24-31c0-4f9a-8a51-199dec70b8db tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:03.378941 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f533bc24-31c0-4f9a-8a51-199dec70b8db tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.158994 Mar 05 21:22:03.379553 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2768/5577] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:03 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:04.396824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c4e1d1b5-676f-4463-8d0a-dc79c07f75b9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:04.397443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c4e1d1b5-676f-4463-8d0a-dc79c07f75b9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:04.405195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4e1d1b5-676f-4463-8d0a-dc79c07f75b9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:04.405651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4e1d1b5-676f-4463-8d0a-dc79c07f75b9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:04.406415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4e1d1b5-676f-4463-8d0a-dc79c07f75b9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:04.406854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4e1d1b5-676f-4463-8d0a-dc79c07f75b9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:04.545405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c4e1d1b5-676f-4463-8d0a-dc79c07f75b9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:04.552729 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c4e1d1b5-676f-4463-8d0a-dc79c07f75b9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.159822 Mar 05 21:22:04.553314 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2810/5578] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:04 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:22:05.570477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dc6553de-1eb0-47b2-8b3e-0eaa7769298c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:05.571112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dc6553de-1eb0-47b2-8b3e-0eaa7769298c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:05.578999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc6553de-1eb0-47b2-8b3e-0eaa7769298c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:05.579473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc6553de-1eb0-47b2-8b3e-0eaa7769298c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:05.580290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc6553de-1eb0-47b2-8b3e-0eaa7769298c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:05.580765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc6553de-1eb0-47b2-8b3e-0eaa7769298c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:05.718846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dc6553de-1eb0-47b2-8b3e-0eaa7769298c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:05.726261 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dc6553de-1eb0-47b2-8b3e-0eaa7769298c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.159774 Mar 05 21:22:05.726828 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2769/5579] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:05 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:06.743463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e2c87a62-8586-42a8-b903-dd02b7d0440c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:06.744133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e2c87a62-8586-42a8-b903-dd02b7d0440c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:06.751543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2c87a62-8586-42a8-b903-dd02b7d0440c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:06.751543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2c87a62-8586-42a8-b903-dd02b7d0440c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:06.752314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2c87a62-8586-42a8-b903-dd02b7d0440c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:06.752751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2c87a62-8586-42a8-b903-dd02b7d0440c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:06.892510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e2c87a62-8586-42a8-b903-dd02b7d0440c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:06.899975 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e2c87a62-8586-42a8-b903-dd02b7d0440c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.160376 Mar 05 21:22:06.900546 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2811/5580] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:06 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:07.918406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8240c305-d1f3-4e1f-82f7-4c08aea420c1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:07.919265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8240c305-d1f3-4e1f-82f7-4c08aea420c1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:07.926566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8240c305-d1f3-4e1f-82f7-4c08aea420c1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:07.927033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8240c305-d1f3-4e1f-82f7-4c08aea420c1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:07.927865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8240c305-d1f3-4e1f-82f7-4c08aea420c1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:07.928326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8240c305-d1f3-4e1f-82f7-4c08aea420c1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:08.071422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8240c305-d1f3-4e1f-82f7-4c08aea420c1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:08.079992 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8240c305-d1f3-4e1f-82f7-4c08aea420c1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.165849 Mar 05 21:22:08.080586 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2770/5581] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:07 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:22:09.099403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-66935563-eff0-4adf-a7b6-5907144d912f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:09.100054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-66935563-eff0-4adf-a7b6-5907144d912f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:09.108827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-66935563-eff0-4adf-a7b6-5907144d912f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:09.109296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-66935563-eff0-4adf-a7b6-5907144d912f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:09.110080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-66935563-eff0-4adf-a7b6-5907144d912f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:09.110534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-66935563-eff0-4adf-a7b6-5907144d912f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:09.265080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-66935563-eff0-4adf-a7b6-5907144d912f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:09.272843 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-66935563-eff0-4adf-a7b6-5907144d912f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.178352 Mar 05 21:22:09.273432 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2812/5582] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:09 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:10.292544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b695ba9b-c549-496f-83a3-f50a718e4607 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:10.293217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b695ba9b-c549-496f-83a3-f50a718e4607 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:10.301611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b695ba9b-c549-496f-83a3-f50a718e4607 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:10.302114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b695ba9b-c549-496f-83a3-f50a718e4607 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:10.303045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b695ba9b-c549-496f-83a3-f50a718e4607 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:10.303690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b695ba9b-c549-496f-83a3-f50a718e4607 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:10.454008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b695ba9b-c549-496f-83a3-f50a718e4607 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:10.461934 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b695ba9b-c549-496f-83a3-f50a718e4607 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.174079 Mar 05 21:22:10.462510 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2771/5583] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:10 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:11.481583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0b6a4af-d11a-4889-bba7-3c34841e7e17 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:11.482833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a0b6a4af-d11a-4889-bba7-3c34841e7e17 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:11.490977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0b6a4af-d11a-4889-bba7-3c34841e7e17 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:11.491505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0b6a4af-d11a-4889-bba7-3c34841e7e17 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:11.492311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0b6a4af-d11a-4889-bba7-3c34841e7e17 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:11.492752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0b6a4af-d11a-4889-bba7-3c34841e7e17 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:11.648781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a0b6a4af-d11a-4889-bba7-3c34841e7e17 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:11.658302 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0b6a4af-d11a-4889-bba7-3c34841e7e17 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.181753 Mar 05 21:22:11.659253 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2813/5584] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:11 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:12.678566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-08e5a0e3-8f52-4045-9041-b46e0144211d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:12.679849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-08e5a0e3-8f52-4045-9041-b46e0144211d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:12.686964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08e5a0e3-8f52-4045-9041-b46e0144211d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:12.687580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08e5a0e3-8f52-4045-9041-b46e0144211d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:12.688560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08e5a0e3-8f52-4045-9041-b46e0144211d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:12.689119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-08e5a0e3-8f52-4045-9041-b46e0144211d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:12.829783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-08e5a0e3-8f52-4045-9041-b46e0144211d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:12.837104 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-08e5a0e3-8f52-4045-9041-b46e0144211d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.163323 Mar 05 21:22:12.837673 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2772/5585] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:12 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:13.856249 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-07c5aa97-7c5c-4581-b5d6-b694df17e5f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:13.857018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-07c5aa97-7c5c-4581-b5d6-b694df17e5f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:13.865195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07c5aa97-7c5c-4581-b5d6-b694df17e5f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:13.865823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07c5aa97-7c5c-4581-b5d6-b694df17e5f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:13.866801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07c5aa97-7c5c-4581-b5d6-b694df17e5f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:13.867354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-07c5aa97-7c5c-4581-b5d6-b694df17e5f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:14.026032 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-07c5aa97-7c5c-4581-b5d6-b694df17e5f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:14.035461 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-07c5aa97-7c5c-4581-b5d6-b694df17e5f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1696 microversion: 2.1 time: 0.183941 Mar 05 21:22:14.036204 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2814/5586] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:13 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:15.053670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-399176d4-c224-42a7-ac7f-d491d25db35a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:15.054392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-399176d4-c224-42a7-ac7f-d491d25db35a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:15.061327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-399176d4-c224-42a7-ac7f-d491d25db35a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:15.061805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-399176d4-c224-42a7-ac7f-d491d25db35a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:15.062647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-399176d4-c224-42a7-ac7f-d491d25db35a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:15.063102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-399176d4-c224-42a7-ac7f-d491d25db35a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:15.272398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-399176d4-c224-42a7-ac7f-d491d25db35a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:15.280862 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-399176d4-c224-42a7-ac7f-d491d25db35a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1695 microversion: 2.1 time: 0.231337 Mar 05 21:22:15.281500 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2773/5587] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:15 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1695 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:15.552761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-74693052-2371-40af-b936-9a600a353165 req-161c473d-af30-4eb8-ab9d-a39825464ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c80c28-c101-4b19-bf5b-4fa5075ef055", "name": "network-vif-unplugged", "status": "completed", "tag": "e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:22:15.563998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-74693052-2371-40af-b936-9a600a353165 req-161c473d-af30-4eb8-ab9d-a39825464ca5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:15.564500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-74693052-2371-40af-b936-9a600a353165 req-161c473d-af30-4eb8-ab9d-a39825464ca5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:15.581515 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-74693052-2371-40af-b936-9a600a353165 req-161c473d-af30-4eb8-ab9d-a39825464ca5 service nova] Creating event network-vif-unplugged:e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f for instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 on nch1-master-1 Mar 05 21:22:15.589092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-74693052-2371-40af-b936-9a600a353165 req-161c473d-af30-4eb8-ab9d-a39825464ca5 service nova] Instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:22:15.602473 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-74693052-2371-40af-b936-9a600a353165 req-161c473d-af30-4eb8-ab9d-a39825464ca5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054157 Mar 05 21:22:15.603238 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2815/5588] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:22:16.300310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2ca7c435-472d-4463-89b3-c7a1e6e94bb3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:16.301381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2ca7c435-472d-4463-89b3-c7a1e6e94bb3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:16.309644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ca7c435-472d-4463-89b3-c7a1e6e94bb3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:16.310775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ca7c435-472d-4463-89b3-c7a1e6e94bb3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:16.311663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ca7c435-472d-4463-89b3-c7a1e6e94bb3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:16.312327 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2ca7c435-472d-4463-89b3-c7a1e6e94bb3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:16.560898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2ca7c435-472d-4463-89b3-c7a1e6e94bb3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:16.568395 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2ca7c435-472d-4463-89b3-c7a1e6e94bb3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1695 microversion: 2.1 time: 0.272805 Mar 05 21:22:16.569185 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2774/5589] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:16 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1695 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:17.586015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6bc318e0-2806-43ec-8104-2132656b62f2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:17.586736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6bc318e0-2806-43ec-8104-2132656b62f2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:17.593877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bc318e0-2806-43ec-8104-2132656b62f2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:17.594343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bc318e0-2806-43ec-8104-2132656b62f2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:17.595125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bc318e0-2806-43ec-8104-2132656b62f2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:17.595581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6bc318e0-2806-43ec-8104-2132656b62f2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:17.732915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6bc318e0-2806-43ec-8104-2132656b62f2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:17.740348 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6bc318e0-2806-43ec-8104-2132656b62f2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1693 microversion: 2.1 time: 0.158692 Mar 05 21:22:17.740944 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2816/5590] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:17 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:17.945218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-4b061a16-2097-4b80-bc5c-887a3d51264d req-8d67b8e3-96f8-488e-a7a1-b9992cf9abe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c80c28-c101-4b19-bf5b-4fa5075ef055", "tag": "e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:22:17.953903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4b061a16-2097-4b80-bc5c-887a3d51264d req-8d67b8e3-96f8-488e-a7a1-b9992cf9abe2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:17.954361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4b061a16-2097-4b80-bc5c-887a3d51264d req-8d67b8e3-96f8-488e-a7a1-b9992cf9abe2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:17.968477 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-4b061a16-2097-4b80-bc5c-887a3d51264d req-8d67b8e3-96f8-488e-a7a1-b9992cf9abe2 service nova] Creating event network-changed:e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f for instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 on nch1-master-1 Mar 05 21:22:17.973728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-4b061a16-2097-4b80-bc5c-887a3d51264d req-8d67b8e3-96f8-488e-a7a1-b9992cf9abe2 service nova] Instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:22:17.985275 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-4b061a16-2097-4b80-bc5c-887a3d51264d req-8d67b8e3-96f8-488e-a7a1-b9992cf9abe2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043696 Mar 05 21:22:17.985872 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2775/5591] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:22:18.758896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-84557b87-fae4-4d0e-a66b-fcb3bc7d1585 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:18.759565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-84557b87-fae4-4d0e-a66b-fcb3bc7d1585 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:18.767364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84557b87-fae4-4d0e-a66b-fcb3bc7d1585 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:18.767850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84557b87-fae4-4d0e-a66b-fcb3bc7d1585 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:18.768632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84557b87-fae4-4d0e-a66b-fcb3bc7d1585 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:18.769073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84557b87-fae4-4d0e-a66b-fcb3bc7d1585 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:18.915259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-84557b87-fae4-4d0e-a66b-fcb3bc7d1585 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:18.923718 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-84557b87-fae4-4d0e-a66b-fcb3bc7d1585 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1690 microversion: 2.1 time: 0.168963 Mar 05 21:22:18.924299 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2817/5592] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:18 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:18.941567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3a37a3b7-f817-4b9d-b608-90980ab9375d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:22:18.942205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3a37a3b7-f817-4b9d-b608-90980ab9375d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:18.948238 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a37a3b7-f817-4b9d-b608-90980ab9375d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:18.948805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a37a3b7-f817-4b9d-b608-90980ab9375d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:18.949472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a37a3b7-f817-4b9d-b608-90980ab9375d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:18.949923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3a37a3b7-f817-4b9d-b608-90980ab9375d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:19.054825 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3a37a3b7-f817-4b9d-b608-90980ab9375d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055/action" status: 202 len: 0 microversion: 2.1 time: 0.117161 Mar 05 21:22:19.055550 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2776/5593] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:22:18 2022] POST /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:22:19.064501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e7708e8c-f110-4eae-9335-2a6d90332852 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:19.065135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e7708e8c-f110-4eae-9335-2a6d90332852 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:19.071078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7708e8c-f110-4eae-9335-2a6d90332852 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:19.071544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7708e8c-f110-4eae-9335-2a6d90332852 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:19.072348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7708e8c-f110-4eae-9335-2a6d90332852 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:19.072823 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e7708e8c-f110-4eae-9335-2a6d90332852 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:19.210513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e7708e8c-f110-4eae-9335-2a6d90332852 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:19.217956 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e7708e8c-f110-4eae-9335-2a6d90332852 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1689 microversion: 2.1 time: 0.157938 Mar 05 21:22:19.218850 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2818/5594] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:19 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:20.236386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a890b78f-c2a2-46d6-ae96-a05a9ead7c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:20.237110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a890b78f-c2a2-46d6-ae96-a05a9ead7c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:20.244023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a890b78f-c2a2-46d6-ae96-a05a9ead7c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:20.244497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a890b78f-c2a2-46d6-ae96-a05a9ead7c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:20.245283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a890b78f-c2a2-46d6-ae96-a05a9ead7c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:20.245738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a890b78f-c2a2-46d6-ae96-a05a9ead7c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:20.381038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a890b78f-c2a2-46d6-ae96-a05a9ead7c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:20.388475 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a890b78f-c2a2-46d6-ae96-a05a9ead7c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1689 microversion: 2.1 time: 0.156949 Mar 05 21:22:20.389089 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2777/5595] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:20 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:21.406217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9033e0f7-5160-41bb-8386-7486bb0ad622 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:21.406958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9033e0f7-5160-41bb-8386-7486bb0ad622 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:21.414080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9033e0f7-5160-41bb-8386-7486bb0ad622 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:21.414533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9033e0f7-5160-41bb-8386-7486bb0ad622 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:21.415326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9033e0f7-5160-41bb-8386-7486bb0ad622 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:21.415799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9033e0f7-5160-41bb-8386-7486bb0ad622 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:21.423705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f9be22fa-ef56-4d26-8a30-b08ddfa32556 req-bafda99a-6a6a-4820-903c-4974794ceabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c80c28-c101-4b19-bf5b-4fa5075ef055", "name": "network-vif-plugged", "status": "completed", "tag": "e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:22:21.434914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f9be22fa-ef56-4d26-8a30-b08ddfa32556 req-bafda99a-6a6a-4820-903c-4974794ceabc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:21.435702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f9be22fa-ef56-4d26-8a30-b08ddfa32556 req-bafda99a-6a6a-4820-903c-4974794ceabc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:21.455457 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f9be22fa-ef56-4d26-8a30-b08ddfa32556 req-bafda99a-6a6a-4820-903c-4974794ceabc service nova] Creating event network-vif-plugged:e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f for instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 on nch1-master-1 Mar 05 21:22:21.462819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-f9be22fa-ef56-4d26-8a30-b08ddfa32556 req-bafda99a-6a6a-4820-903c-4974794ceabc service nova] Instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:22:21.475908 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f9be22fa-ef56-4d26-8a30-b08ddfa32556 req-bafda99a-6a6a-4820-903c-4974794ceabc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055223 Mar 05 21:22:21.476755 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2778/5596] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:22:21.570272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9033e0f7-5160-41bb-8386-7486bb0ad622 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:21.578554 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9033e0f7-5160-41bb-8386-7486bb0ad622 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1689 microversion: 2.1 time: 0.176901 Mar 05 21:22:21.579153 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2819/5597] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:21 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:22.174678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-9d58a25d-b3ad-414d-b99e-eadeed8004ee req-1b24ca58-8c49-4fea-abd3-e066bd39b84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c80c28-c101-4b19-bf5b-4fa5075ef055", "name": "network-vif-unplugged", "status": "completed", "tag": "e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:22:22.183511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9d58a25d-b3ad-414d-b99e-eadeed8004ee req-1b24ca58-8c49-4fea-abd3-e066bd39b84d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:22.184022 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9d58a25d-b3ad-414d-b99e-eadeed8004ee req-1b24ca58-8c49-4fea-abd3-e066bd39b84d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:22.196863 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-9d58a25d-b3ad-414d-b99e-eadeed8004ee req-1b24ca58-8c49-4fea-abd3-e066bd39b84d service nova] Creating event network-vif-unplugged:e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f for instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 on nch2-master-1 Mar 05 21:22:22.203806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-9d58a25d-b3ad-414d-b99e-eadeed8004ee req-1b24ca58-8c49-4fea-abd3-e066bd39b84d service nova] Instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:22:22.219968 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-9d58a25d-b3ad-414d-b99e-eadeed8004ee req-1b24ca58-8c49-4fea-abd3-e066bd39b84d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049817 Mar 05 21:22:22.220612 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2779/5598] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:22:22.597023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-77eba276-4037-46b0-8d36-c8e4f5076deb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:22.597660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-77eba276-4037-46b0-8d36-c8e4f5076deb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:22.605733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77eba276-4037-46b0-8d36-c8e4f5076deb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:22.606338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77eba276-4037-46b0-8d36-c8e4f5076deb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:22.608394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77eba276-4037-46b0-8d36-c8e4f5076deb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:22.608843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77eba276-4037-46b0-8d36-c8e4f5076deb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:22.777898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-77eba276-4037-46b0-8d36-c8e4f5076deb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:22.787159 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-77eba276-4037-46b0-8d36-c8e4f5076deb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1689 microversion: 2.1 time: 0.195578 Mar 05 21:22:22.788064 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2820/5599] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:22 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:23.806360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6132c020-06b7-4662-9b40-17aeb35b56de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:23.807078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6132c020-06b7-4662-9b40-17aeb35b56de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:23.813297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6132c020-06b7-4662-9b40-17aeb35b56de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:23.813761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6132c020-06b7-4662-9b40-17aeb35b56de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:23.814538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6132c020-06b7-4662-9b40-17aeb35b56de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:23.814996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6132c020-06b7-4662-9b40-17aeb35b56de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:23.961263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6132c020-06b7-4662-9b40-17aeb35b56de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:23.969092 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6132c020-06b7-4662-9b40-17aeb35b56de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1689 microversion: 2.1 time: 0.167731 Mar 05 21:22:23.969676 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2780/5600] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:23 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:24.241754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-d56413e5-0ee6-4249-bf8c-32daf00cf839 req-48a497f8-d30a-4848-852e-fbb92855de9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c80c28-c101-4b19-bf5b-4fa5075ef055", "tag": "e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:22:24.251066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d56413e5-0ee6-4249-bf8c-32daf00cf839 req-48a497f8-d30a-4848-852e-fbb92855de9e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:24.251518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d56413e5-0ee6-4249-bf8c-32daf00cf839 req-48a497f8-d30a-4848-852e-fbb92855de9e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:24.264254 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-d56413e5-0ee6-4249-bf8c-32daf00cf839 req-48a497f8-d30a-4848-852e-fbb92855de9e service nova] Creating event network-changed:e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f for instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 on nch2-master-1 Mar 05 21:22:24.269736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-d56413e5-0ee6-4249-bf8c-32daf00cf839 req-48a497f8-d30a-4848-852e-fbb92855de9e service nova] Instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:22:24.280749 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-d56413e5-0ee6-4249-bf8c-32daf00cf839 req-48a497f8-d30a-4848-852e-fbb92855de9e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042936 Mar 05 21:22:24.281352 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2821/5601] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:22:24.987924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-97ab424c-35e4-48b7-a2d5-ccc9b5c0bf33 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:24.988560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-97ab424c-35e4-48b7-a2d5-ccc9b5c0bf33 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:24.995743 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-97ab424c-35e4-48b7-a2d5-ccc9b5c0bf33 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:24.996475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-97ab424c-35e4-48b7-a2d5-ccc9b5c0bf33 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:24.997870 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-97ab424c-35e4-48b7-a2d5-ccc9b5c0bf33 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:24.998793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-97ab424c-35e4-48b7-a2d5-ccc9b5c0bf33 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:25.623161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-97ab424c-35e4-48b7-a2d5-ccc9b5c0bf33 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:25.632478 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-97ab424c-35e4-48b7-a2d5-ccc9b5c0bf33 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1682 microversion: 2.1 time: 0.648473 Mar 05 21:22:25.633162 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2781/5602] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:24 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1682 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:27.178388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-5460515f-9dbc-4639-9405-10e1365d45ac req-2e4416ac-f2b8-4ed5-90d4-3dd1d3228617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c80c28-c101-4b19-bf5b-4fa5075ef055", "name": "network-vif-plugged", "status": "completed", "tag": "e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:22:27.188743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5460515f-9dbc-4639-9405-10e1365d45ac req-2e4416ac-f2b8-4ed5-90d4-3dd1d3228617 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:27.189461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5460515f-9dbc-4639-9405-10e1365d45ac req-2e4416ac-f2b8-4ed5-90d4-3dd1d3228617 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:27.200629 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-5460515f-9dbc-4639-9405-10e1365d45ac req-2e4416ac-f2b8-4ed5-90d4-3dd1d3228617 service nova] Creating event network-vif-plugged:e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f for instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 on nch2-master-1 Mar 05 21:22:27.207503 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-5460515f-9dbc-4639-9405-10e1365d45ac req-2e4416ac-f2b8-4ed5-90d4-3dd1d3228617 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034303 Mar 05 21:22:27.208260 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2822/5603] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:22:49.826874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7e142fb0-0765-4e2b-a479-a5ee9dafe1a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:22:49.827873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7e142fb0-0765-4e2b-a479-a5ee9dafe1a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:49.834108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e142fb0-0765-4e2b-a479-a5ee9dafe1a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:49.834573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e142fb0-0765-4e2b-a479-a5ee9dafe1a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:49.835353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e142fb0-0765-4e2b-a479-a5ee9dafe1a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:49.835849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7e142fb0-0765-4e2b-a479-a5ee9dafe1a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:49.892062 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7e142fb0-0765-4e2b-a479-a5ee9dafe1a7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055/action" status: 200 len: 63195 microversion: 2.1 time: 0.068754 Mar 05 21:22:49.892717 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2782/5604] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:22:49 2022] POST /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055/action => generated 63195 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:22:56.072623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5eb8e111-8af0-4345-b38e-60ac86b028b6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:56.073323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5eb8e111-8af0-4345-b38e-60ac86b028b6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:56.080370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eb8e111-8af0-4345-b38e-60ac86b028b6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:56.080830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eb8e111-8af0-4345-b38e-60ac86b028b6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:56.081595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eb8e111-8af0-4345-b38e-60ac86b028b6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:56.082036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eb8e111-8af0-4345-b38e-60ac86b028b6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:56.217762 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5eb8e111-8af0-4345-b38e-60ac86b028b6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1833 microversion: 2.1 time: 0.150148 Mar 05 21:22:56.218351 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2823/5605] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:56 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1833 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:22:57.099843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1e354d98-6116-4f74-a4b5-4d30bcd3709a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:57.105475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-6ff40d42-ee98-4965-9908-53ca4819c68f req-e2520dc6-0759-462a-936c-e31157dabc04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c80c28-c101-4b19-bf5b-4fa5075ef055", "tag": "e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:22:57.106074 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1e354d98-6116-4f74-a4b5-4d30bcd3709a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:57.114321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e354d98-6116-4f74-a4b5-4d30bcd3709a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:57.114868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e354d98-6116-4f74-a4b5-4d30bcd3709a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:57.115766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e354d98-6116-4f74-a4b5-4d30bcd3709a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:57.116303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1e354d98-6116-4f74-a4b5-4d30bcd3709a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:57.118299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6ff40d42-ee98-4965-9908-53ca4819c68f req-e2520dc6-0759-462a-936c-e31157dabc04 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:57.118751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-6ff40d42-ee98-4965-9908-53ca4819c68f req-e2520dc6-0759-462a-936c-e31157dabc04 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:57.133690 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-6ff40d42-ee98-4965-9908-53ca4819c68f req-e2520dc6-0759-462a-936c-e31157dabc04 service nova] Creating event network-changed:e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f for instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 on nch2-master-1 Mar 05 21:22:57.139787 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-6ff40d42-ee98-4965-9908-53ca4819c68f req-e2520dc6-0759-462a-936c-e31157dabc04 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037262 Mar 05 21:22:57.139787 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2824/5606] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:22:57.150841 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1e354d98-6116-4f74-a4b5-4d30bcd3709a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:22:57.238801 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1e354d98-6116-4f74-a4b5-4d30bcd3709a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 204 len: 0 microversion: 2.1 time: 0.142838 Mar 05 21:22:57.239841 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2783/5607] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:22:57 2022] DELETE /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:22:57.248138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9857d7e7-020b-4384-989b-23eb12977e00 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:57.248958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9857d7e7-020b-4384-989b-23eb12977e00 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:57.256322 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9857d7e7-020b-4384-989b-23eb12977e00 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:57.256784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9857d7e7-020b-4384-989b-23eb12977e00 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:57.257571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9857d7e7-020b-4384-989b-23eb12977e00 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:57.258013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9857d7e7-020b-4384-989b-23eb12977e00 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:57.402185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9857d7e7-020b-4384-989b-23eb12977e00 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:57.411165 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9857d7e7-020b-4384-989b-23eb12977e00 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1688 microversion: 2.1 time: 0.167170 Mar 05 21:22:57.411765 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2825/5608] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:57 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:22:58.429450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0afb30db-8651-44c0-87c7-fb35916e90bb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:58.430078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0afb30db-8651-44c0-87c7-fb35916e90bb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:58.437424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0afb30db-8651-44c0-87c7-fb35916e90bb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:58.437892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0afb30db-8651-44c0-87c7-fb35916e90bb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:58.438714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0afb30db-8651-44c0-87c7-fb35916e90bb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:58.439164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0afb30db-8651-44c0-87c7-fb35916e90bb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:58.603943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0afb30db-8651-44c0-87c7-fb35916e90bb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:22:58.612145 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0afb30db-8651-44c0-87c7-fb35916e90bb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 200 len: 1569 microversion: 2.1 time: 0.187073 Mar 05 21:22:58.612937 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2784/5609] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:58 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:22:59.038929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b61faf72-73a3-46dc-a136-70d2c66cc701 req-0609a098-2e88-4fa0-a3d3-c72916f4850c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c80c28-c101-4b19-bf5b-4fa5075ef055", "name": "network-vif-deleted", "tag": "e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:22:59.048447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b61faf72-73a3-46dc-a136-70d2c66cc701 req-0609a098-2e88-4fa0-a3d3-c72916f4850c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:59.048908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b61faf72-73a3-46dc-a136-70d2c66cc701 req-0609a098-2e88-4fa0-a3d3-c72916f4850c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:59.060843 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b61faf72-73a3-46dc-a136-70d2c66cc701 req-0609a098-2e88-4fa0-a3d3-c72916f4850c service nova] Creating event network-vif-deleted:e9cdccdf-0e63-4bb7-a22f-2f9c2822ce0f for instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 on nch2-master-1 Mar 05 21:22:59.066058 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b61faf72-73a3-46dc-a136-70d2c66cc701 req-0609a098-2e88-4fa0-a3d3-c72916f4850c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031049 Mar 05 21:22:59.066673 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2826/5610] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:22:59.631412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9626a32a-b489-4a40-82cc-fa0ea11bb9ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:22:59.632062 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9626a32a-b489-4a40-82cc-fa0ea11bb9ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: b8c80c28-c101-4b19-bf5b-4fa5075ef055] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:22:59.638666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9626a32a-b489-4a40-82cc-fa0ea11bb9ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:59.639128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9626a32a-b489-4a40-82cc-fa0ea11bb9ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:59.639948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9626a32a-b489-4a40-82cc-fa0ea11bb9ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:22:59.640396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9626a32a-b489-4a40-82cc-fa0ea11bb9ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:22:59.653618 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-9626a32a-b489-4a40-82cc-fa0ea11bb9ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] HTTP exception thrown: Instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 could not be found. Mar 05 21:22:59.654217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9626a32a-b489-4a40-82cc-fa0ea11bb9ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Returning 404 to user: Instance b8c80c28-c101-4b19-bf5b-4fa5075ef055 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:22:59.655035 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9626a32a-b489-4a40-82cc-fa0ea11bb9ac tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055" status: 404 len: 111 microversion: 2.1 time: 0.027869 Mar 05 21:22:59.655551 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2785/5611] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:22:59 2022] GET /compute/v2.1/servers/b8c80c28-c101-4b19-bf5b-4fa5075ef055 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:23:03.020855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c00c25eb-4a6b-46cc-9cd1-e266f4f1ccab tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '.version_select at 0x7fed4f65baf0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:03.039539 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c00c25eb-4a6b-46cc-9cd1-e266f4f1ccab tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1088685082" status: 202 len: 0 microversion: 2.1 time: 0.025046 Mar 05 21:23:03.040335 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2827/5612] 10.222.0.15 () {58 vars in 1283 bytes} [Sat Mar 5 21:23:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1088685082 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:23:03.069511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9615b8de-5b8b-4086-b4fa-4d8776c481d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'create', calling method: .version_select at 0x7fed61a45790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1384916457"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:03.084651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-9615b8de-5b8b-4086-b4fa-4d8776c481d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:23:03.089761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-9615b8de-5b8b-4086-b4fa-4d8776c481d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for user f9a39fb8a8fe498db9a98166acf96d0d and project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:23:03.275321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-9615b8de-5b8b-4086-b4fa-4d8776c481d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:23:03.281510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-9615b8de-5b8b-4086-b4fa-4d8776c481d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for user f9a39fb8a8fe498db9a98166acf96d0d and project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:23:03.298093 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9615b8de-5b8b-4086-b4fa-4d8776c481d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.232056 Mar 05 21:23:03.298708 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2786/5613] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:23:03 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:05.250624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-18acd558-38ed-4a1a-850c-102bd3a605bc req-6d56965a-1362-4739-b123-669426b4b461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cdd70d0-e01c-4a03-95c8-55a1bdad1323", "tag": "b9de74e7-a8f7-46f7-9407-5aeb0c3859da"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:05.251405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9246f3e0-af47-42ff-82f5-f52bb8d3ef09 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:05.252081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9246f3e0-af47-42ff-82f5-f52bb8d3ef09 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:05.260523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9246f3e0-af47-42ff-82f5-f52bb8d3ef09 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:05.264586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-18acd558-38ed-4a1a-850c-102bd3a605bc req-6d56965a-1362-4739-b123-669426b4b461 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:05.265577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-18acd558-38ed-4a1a-850c-102bd3a605bc req-6d56965a-1362-4739-b123-669426b4b461 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:05.268348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9246f3e0-af47-42ff-82f5-f52bb8d3ef09 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:05.269171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9246f3e0-af47-42ff-82f5-f52bb8d3ef09 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:05.269785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9246f3e0-af47-42ff-82f5-f52bb8d3ef09 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:05.285676 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-18acd558-38ed-4a1a-850c-102bd3a605bc req-6d56965a-1362-4739-b123-669426b4b461 service nova] Creating event network-changed:b9de74e7-a8f7-46f7-9407-5aeb0c3859da for instance 9cdd70d0-e01c-4a03-95c8-55a1bdad1323 on nch1-master-1 Mar 05 21:23:05.292632 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-18acd558-38ed-4a1a-850c-102bd3a605bc req-6d56965a-1362-4739-b123-669426b4b461 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046734 Mar 05 21:23:05.293688 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2787/5614] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:23:05.302938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9246f3e0-af47-42ff-82f5-f52bb8d3ef09 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:23:05.418140 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9246f3e0-af47-42ff-82f5-f52bb8d3ef09 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 204 len: 0 microversion: 2.1 time: 0.173821 Mar 05 21:23:05.421891 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2828/5615] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:23:05 2022] DELETE /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:23:05.429039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-109f26ae-85d4-43d3-a929-7c72df6b8fc6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:05.430318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-109f26ae-85d4-43d3-a929-7c72df6b8fc6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:05.437505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-109f26ae-85d4-43d3-a929-7c72df6b8fc6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:05.438457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-109f26ae-85d4-43d3-a929-7c72df6b8fc6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:05.440490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-109f26ae-85d4-43d3-a929-7c72df6b8fc6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:05.441131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-109f26ae-85d4-43d3-a929-7c72df6b8fc6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:05.984938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-109f26ae-85d4-43d3-a929-7c72df6b8fc6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:05.992496 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-109f26ae-85d4-43d3-a929-7c72df6b8fc6 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1576 microversion: 2.1 time: 0.568659 Mar 05 21:23:05.993088 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2788/5616] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:05 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1576 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:07.011949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-566c5f59-8557-40b5-ab7a-1b75d0f38c2e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:07.013387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-566c5f59-8557-40b5-ab7a-1b75d0f38c2e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:07.021647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-566c5f59-8557-40b5-ab7a-1b75d0f38c2e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:07.022348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-566c5f59-8557-40b5-ab7a-1b75d0f38c2e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:07.023465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-566c5f59-8557-40b5-ab7a-1b75d0f38c2e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:07.024403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-566c5f59-8557-40b5-ab7a-1b75d0f38c2e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:07.472891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-2505cc85-156a-4abc-ba56-e8575c2966f0 req-dc0cc023-d84c-405c-a377-dc0b6ffa930c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdd70d0-e01c-4a03-95c8-55a1bdad1323", "name": "network-vif-deleted", "tag": "b9de74e7-a8f7-46f7-9407-5aeb0c3859da"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:07.489814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-2505cc85-156a-4abc-ba56-e8575c2966f0 req-dc0cc023-d84c-405c-a377-dc0b6ffa930c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:07.490789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-2505cc85-156a-4abc-ba56-e8575c2966f0 req-dc0cc023-d84c-405c-a377-dc0b6ffa930c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:07.514615 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-2505cc85-156a-4abc-ba56-e8575c2966f0 req-dc0cc023-d84c-405c-a377-dc0b6ffa930c service nova] Creating event network-vif-deleted:b9de74e7-a8f7-46f7-9407-5aeb0c3859da for instance 9cdd70d0-e01c-4a03-95c8-55a1bdad1323 on nch1-master-1 Mar 05 21:23:07.521750 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-2505cc85-156a-4abc-ba56-e8575c2966f0 req-dc0cc023-d84c-405c-a377-dc0b6ffa930c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054850 Mar 05 21:23:07.522611 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2789/5617] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:23:07.658138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-566c5f59-8557-40b5-ab7a-1b75d0f38c2e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:07.665873 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-566c5f59-8557-40b5-ab7a-1b75d0f38c2e tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 200 len: 1457 microversion: 2.1 time: 0.658692 Mar 05 21:23:07.676227 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2829/5618] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:07 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 1457 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:08.684037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1971db6e-4016-4397-9718-9baa190a6b0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:08.693065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1971db6e-4016-4397-9718-9baa190a6b0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 9cdd70d0-e01c-4a03-95c8-55a1bdad1323] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:08.700094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1971db6e-4016-4397-9718-9baa190a6b0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:08.700576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1971db6e-4016-4397-9718-9baa190a6b0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:08.701391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1971db6e-4016-4397-9718-9baa190a6b0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:08.701856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1971db6e-4016-4397-9718-9baa190a6b0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:08.724420 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-1971db6e-4016-4397-9718-9baa190a6b0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance 9cdd70d0-e01c-4a03-95c8-55a1bdad1323 could not be found. Mar 05 21:23:08.725254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1971db6e-4016-4397-9718-9baa190a6b0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance 9cdd70d0-e01c-4a03-95c8-55a1bdad1323 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:23:08.726597 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1971db6e-4016-4397-9718-9baa190a6b0a tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323" status: 404 len: 111 microversion: 2.1 time: 0.046867 Mar 05 21:23:08.727709 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2790/5619] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:08 2022] GET /compute/v2.1/servers/9cdd70d0-e01c-4a03-95c8-55a1bdad1323 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:23:09.339607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1414838837", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "8039d5d0-c4b5-4630-98d4-b0f0f0742b20"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1384916457", "security_groups": [{"name": "tempest-secgroup-smoke-654252334"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:09.484420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] validate_networks() for [('8039d5d0-c4b5-4630-98d4-b0f0f0742b20', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:23:09.946589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:23:09.947026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:23:09.947536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:23:09.947999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:23:09.948419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:23:09.958857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:09.959533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:09.960285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:09.960970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:09.994649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for project 7be8dce4a165431c8a7279be20d99612. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:23:10.002430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for user f9a39fb8a8fe498db9a98166acf96d0d and project 7be8dce4a165431c8a7279be20d99612. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:23:10.019821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:23:10.024021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:23:10.090215 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1ddd6edb-d126-4bd5-82b9-3c715deceb7e tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.754827 Mar 05 21:23:10.091841 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2830/5620] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:23:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:23:10.104452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ae0c4d77-9395-4635-b844-3fc00dd05e37 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:10.105164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ae0c4d77-9395-4635-b844-3fc00dd05e37 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:10.215490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ae0c4d77-9395-4635-b844-3fc00dd05e37 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:10.225823 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ae0c4d77-9395-4635-b844-3fc00dd05e37 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1267 microversion: 2.1 time: 0.127394 Mar 05 21:23:10.227377 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2791/5621] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:10 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:11.245912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fa9af003-021f-4dc1-a93a-15ca49e1b1ed tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:11.246621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fa9af003-021f-4dc1-a93a-15ca49e1b1ed tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:11.262331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa9af003-021f-4dc1-a93a-15ca49e1b1ed tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:11.263766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa9af003-021f-4dc1-a93a-15ca49e1b1ed tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:11.268796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa9af003-021f-4dc1-a93a-15ca49e1b1ed tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:11.269607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa9af003-021f-4dc1-a93a-15ca49e1b1ed tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:11.338432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fa9af003-021f-4dc1-a93a-15ca49e1b1ed tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:11.347048 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fa9af003-021f-4dc1-a93a-15ca49e1b1ed tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1325 microversion: 2.1 time: 0.108256 Mar 05 21:23:11.356104 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2831/5622] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:11 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1325 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:12.366246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b5c5bc7e-9c15-480d-a884-0cfc71e6996d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:12.367061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b5c5bc7e-9c15-480d-a884-0cfc71e6996d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:12.375479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc7e-9c15-480d-a884-0cfc71e6996d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:12.376084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc7e-9c15-480d-a884-0cfc71e6996d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:12.376901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc7e-9c15-480d-a884-0cfc71e6996d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:12.377359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc7e-9c15-480d-a884-0cfc71e6996d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:12.652648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b5c5bc7e-9c15-480d-a884-0cfc71e6996d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:12.662040 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b5c5bc7e-9c15-480d-a884-0cfc71e6996d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1392 microversion: 2.1 time: 0.299864 Mar 05 21:23:12.662713 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2792/5623] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:12 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1392 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:12.783924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-0a0365de-1305-48d0-849c-0f1940239ed6 req-997c1912-afb7-467d-9865-8afdd79c9d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ae1004-597e-4bab-acb1-96ebd290f040", "tag": "a5de0875-8060-48d1-8e0b-80631f2a3596"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:12.809501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0a0365de-1305-48d0-849c-0f1940239ed6 req-997c1912-afb7-467d-9865-8afdd79c9d89 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:12.810038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-0a0365de-1305-48d0-849c-0f1940239ed6 req-997c1912-afb7-467d-9865-8afdd79c9d89 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:12.824933 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-0a0365de-1305-48d0-849c-0f1940239ed6 req-997c1912-afb7-467d-9865-8afdd79c9d89 service nova] Creating event network-changed:a5de0875-8060-48d1-8e0b-80631f2a3596 for instance d2ae1004-597e-4bab-acb1-96ebd290f040 on nch2-master-1 Mar 05 21:23:12.839346 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-0a0365de-1305-48d0-849c-0f1940239ed6 req-997c1912-afb7-467d-9865-8afdd79c9d89 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058099 Mar 05 21:23:12.841923 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2832/5624] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:23:13.679066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41ddf8bd-f575-4a03-aced-292001168bd7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:13.679621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-41ddf8bd-f575-4a03-aced-292001168bd7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:13.686889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41ddf8bd-f575-4a03-aced-292001168bd7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:13.687351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41ddf8bd-f575-4a03-aced-292001168bd7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:13.688360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41ddf8bd-f575-4a03-aced-292001168bd7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:13.688731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41ddf8bd-f575-4a03-aced-292001168bd7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:13.880721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-41ddf8bd-f575-4a03-aced-292001168bd7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:13.888107 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-41ddf8bd-f575-4a03-aced-292001168bd7 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1392 microversion: 2.1 time: 0.212999 Mar 05 21:23:13.888711 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2793/5625] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:13 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1392 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:14.906935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-acdb1bee-8777-4e9f-9fa9-d38b3173c395 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:14.907711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-acdb1bee-8777-4e9f-9fa9-d38b3173c395 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:14.914021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acdb1bee-8777-4e9f-9fa9-d38b3173c395 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:14.914479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acdb1bee-8777-4e9f-9fa9-d38b3173c395 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:14.915286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acdb1bee-8777-4e9f-9fa9-d38b3173c395 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:14.915759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acdb1bee-8777-4e9f-9fa9-d38b3173c395 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:15.058634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-acdb1bee-8777-4e9f-9fa9-d38b3173c395 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:15.066628 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-acdb1bee-8777-4e9f-9fa9-d38b3173c395 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1392 microversion: 2.1 time: 0.165462 Mar 05 21:23:15.067215 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2833/5626] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:14 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:16.084285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7b504fc4-5578-43f6-93ca-2e8620aa4b04 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:16.084920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7b504fc4-5578-43f6-93ca-2e8620aa4b04 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:16.091851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b504fc4-5578-43f6-93ca-2e8620aa4b04 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:16.092317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b504fc4-5578-43f6-93ca-2e8620aa4b04 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:16.093087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b504fc4-5578-43f6-93ca-2e8620aa4b04 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:16.093540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b504fc4-5578-43f6-93ca-2e8620aa4b04 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:16.231195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7b504fc4-5578-43f6-93ca-2e8620aa4b04 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:16.238606 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7b504fc4-5578-43f6-93ca-2e8620aa4b04 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1392 microversion: 2.1 time: 0.158285 Mar 05 21:23:16.239182 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2794/5627] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:16 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:23:17.254341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f24763ce-2c93-4a31-8167-e38a6946bfe9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:17.255208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f24763ce-2c93-4a31-8167-e38a6946bfe9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:17.262177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f24763ce-2c93-4a31-8167-e38a6946bfe9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:17.262451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f24763ce-2c93-4a31-8167-e38a6946bfe9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:17.263226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f24763ce-2c93-4a31-8167-e38a6946bfe9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:17.263690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f24763ce-2c93-4a31-8167-e38a6946bfe9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:17.407889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f24763ce-2c93-4a31-8167-e38a6946bfe9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:17.416080 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f24763ce-2c93-4a31-8167-e38a6946bfe9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1392 microversion: 2.1 time: 0.165542 Mar 05 21:23:17.416822 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2834/5628] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:17 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:17.418898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-319d7dbf-17f9-4481-913b-d2be92c2a5fd req-9922f910-db27-4faf-825a-13268929d5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ae1004-597e-4bab-acb1-96ebd290f040", "name": "network-vif-plugged", "status": "completed", "tag": "a5de0875-8060-48d1-8e0b-80631f2a3596"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:17.428658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-319d7dbf-17f9-4481-913b-d2be92c2a5fd req-9922f910-db27-4faf-825a-13268929d5df service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:17.429113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-319d7dbf-17f9-4481-913b-d2be92c2a5fd req-9922f910-db27-4faf-825a-13268929d5df service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:17.440458 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-319d7dbf-17f9-4481-913b-d2be92c2a5fd req-9922f910-db27-4faf-825a-13268929d5df service nova] Creating event network-vif-plugged:a5de0875-8060-48d1-8e0b-80631f2a3596 for instance d2ae1004-597e-4bab-acb1-96ebd290f040 on nch2-master-1 Mar 05 21:23:17.445394 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-319d7dbf-17f9-4481-913b-d2be92c2a5fd req-9922f910-db27-4faf-825a-13268929d5df service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030511 Mar 05 21:23:17.446358 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2795/5629] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:23:18.434108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-89950d31-5874-435f-b09d-c2b1d40dd569 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:18.434729 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-89950d31-5874-435f-b09d-c2b1d40dd569 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:18.442325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89950d31-5874-435f-b09d-c2b1d40dd569 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:18.442732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89950d31-5874-435f-b09d-c2b1d40dd569 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:18.443513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89950d31-5874-435f-b09d-c2b1d40dd569 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:18.443989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-89950d31-5874-435f-b09d-c2b1d40dd569 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:18.579032 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-89950d31-5874-435f-b09d-c2b1d40dd569 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:18.586499 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-89950d31-5874-435f-b09d-c2b1d40dd569 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1392 microversion: 2.1 time: 0.156724 Mar 05 21:23:18.587074 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2835/5630] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:18 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:19.605537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a072cb42-b475-4c66-8398-4b770770147b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:19.606253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a072cb42-b475-4c66-8398-4b770770147b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:19.612744 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a072cb42-b475-4c66-8398-4b770770147b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:19.613217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a072cb42-b475-4c66-8398-4b770770147b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:19.614003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a072cb42-b475-4c66-8398-4b770770147b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:19.614458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a072cb42-b475-4c66-8398-4b770770147b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:19.749556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a072cb42-b475-4c66-8398-4b770770147b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:19.758280 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a072cb42-b475-4c66-8398-4b770770147b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1564 microversion: 2.1 time: 0.157854 Mar 05 21:23:19.758863 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2796/5631] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:19 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:19.774581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f2a68f9d-99d2-477f-a2ad-f4a096ed0b69 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:19.775201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f2a68f9d-99d2-477f-a2ad-f4a096ed0b69 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:19.781918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2a68f9d-99d2-477f-a2ad-f4a096ed0b69 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:19.782370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2a68f9d-99d2-477f-a2ad-f4a096ed0b69 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:19.783137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2a68f9d-99d2-477f-a2ad-f4a096ed0b69 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:19.783579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2a68f9d-99d2-477f-a2ad-f4a096ed0b69 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:19.924560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f2a68f9d-99d2-477f-a2ad-f4a096ed0b69 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:19.932364 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f2a68f9d-99d2-477f-a2ad-f4a096ed0b69 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1564 microversion: 2.1 time: 0.161688 Mar 05 21:23:19.932949 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2836/5632] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:19 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:21.536907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-265d8904-a23f-4330-858b-a80e0fcf10bc req-6745c9b8-d7c4-41f7-91d6-2d5ce4787012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ae1004-597e-4bab-acb1-96ebd290f040", "tag": "a5de0875-8060-48d1-8e0b-80631f2a3596"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:21.543125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8b938a68-2552-4b6c-b180-c028115f6dd2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:21.543829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8b938a68-2552-4b6c-b180-c028115f6dd2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:21.553359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b938a68-2552-4b6c-b180-c028115f6dd2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:21.553832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b938a68-2552-4b6c-b180-c028115f6dd2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:21.554441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-265d8904-a23f-4330-858b-a80e0fcf10bc req-6745c9b8-d7c4-41f7-91d6-2d5ce4787012 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:21.554625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b938a68-2552-4b6c-b180-c028115f6dd2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:21.555083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8b938a68-2552-4b6c-b180-c028115f6dd2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:21.555204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-265d8904-a23f-4330-858b-a80e0fcf10bc req-6745c9b8-d7c4-41f7-91d6-2d5ce4787012 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:21.568796 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-265d8904-a23f-4330-858b-a80e0fcf10bc req-6745c9b8-d7c4-41f7-91d6-2d5ce4787012 service nova] Creating event network-changed:a5de0875-8060-48d1-8e0b-80631f2a3596 for instance d2ae1004-597e-4bab-acb1-96ebd290f040 on nch2-master-1 Mar 05 21:23:21.573872 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-265d8904-a23f-4330-858b-a80e0fcf10bc req-6745c9b8-d7c4-41f7-91d6-2d5ce4787012 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040714 Mar 05 21:23:21.574680 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2837/5633] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:23:21.787083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8b938a68-2552-4b6c-b180-c028115f6dd2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:21.797131 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8b938a68-2552-4b6c-b180-c028115f6dd2 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1564 microversion: 2.1 time: 0.268259 Mar 05 21:23:21.798387 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2797/5634] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:21 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1564 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:31.862610 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:23:31.863265 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 21:23:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:23:41.781052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-69cb0b20-7ddb-4fd0-948d-d0ad5903bdee req-00cfc39d-f080-4d5d-b189-1c4c70272499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d", "tag": "2d792f34-8e44-42c7-923e-91d5e87974f1"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:41.788341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5db97c60-2e5e-46db-bff3-dab9fd53c869 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:41.788945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5db97c60-2e5e-46db-bff3-dab9fd53c869 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:41.795447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5db97c60-2e5e-46db-bff3-dab9fd53c869 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:41.796468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5db97c60-2e5e-46db-bff3-dab9fd53c869 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:41.797165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-69cb0b20-7ddb-4fd0-948d-d0ad5903bdee req-00cfc39d-f080-4d5d-b189-1c4c70272499 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:41.797448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5db97c60-2e5e-46db-bff3-dab9fd53c869 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:41.797635 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-69cb0b20-7ddb-4fd0-948d-d0ad5903bdee req-00cfc39d-f080-4d5d-b189-1c4c70272499 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:41.797888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5db97c60-2e5e-46db-bff3-dab9fd53c869 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:41.812956 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-69cb0b20-7ddb-4fd0-948d-d0ad5903bdee req-00cfc39d-f080-4d5d-b189-1c4c70272499 service nova] Creating event network-changed:2d792f34-8e44-42c7-923e-91d5e87974f1 for instance 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d on nch1-master-1 Mar 05 21:23:41.818337 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-69cb0b20-7ddb-4fd0-948d-d0ad5903bdee req-00cfc39d-f080-4d5d-b189-1c4c70272499 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041064 Mar 05 21:23:41.819137 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2798/5635] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:23:41.824308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5db97c60-2e5e-46db-bff3-dab9fd53c869 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:23:41.914588 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5db97c60-2e5e-46db-bff3-dab9fd53c869 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 204 len: 0 microversion: 2.1 time: 0.139846 Mar 05 21:23:41.918457 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2838/5636] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:23:41 2022] DELETE /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:23:41.925263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a1abb971-0dc9-4761-9eac-2d4b7277d417 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:41.926029 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a1abb971-0dc9-4761-9eac-2d4b7277d417 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:41.933566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1abb971-0dc9-4761-9eac-2d4b7277d417 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:41.934227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1abb971-0dc9-4761-9eac-2d4b7277d417 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:41.935195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1abb971-0dc9-4761-9eac-2d4b7277d417 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:41.935868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1abb971-0dc9-4761-9eac-2d4b7277d417 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:42.254574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a1abb971-0dc9-4761-9eac-2d4b7277d417 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:42.262757 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a1abb971-0dc9-4761-9eac-2d4b7277d417 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1576 microversion: 2.1 time: 0.342841 Mar 05 21:23:42.273683 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2799/5637] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:41 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1576 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:43.038506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8c234518-ecf6-436e-8a7b-6dd175c4adf5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:43.039441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8c234518-ecf6-436e-8a7b-6dd175c4adf5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:43.050671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c234518-ecf6-436e-8a7b-6dd175c4adf5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:43.051136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c234518-ecf6-436e-8a7b-6dd175c4adf5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:43.051946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c234518-ecf6-436e-8a7b-6dd175c4adf5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:43.052397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8c234518-ecf6-436e-8a7b-6dd175c4adf5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:43.100458 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8c234518-ecf6-436e-8a7b-6dd175c4adf5 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040/action" status: 200 len: 24576 microversion: 2.1 time: 0.066152 Mar 05 21:23:43.101157 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2839/5638] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:23:43 2022] POST /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040/action => generated 24576 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:23:43.280276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-db841369-b348-4000-bfc4-e1d94836d7cb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:43.281723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-db841369-b348-4000-bfc4-e1d94836d7cb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:43.288562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db841369-b348-4000-bfc4-e1d94836d7cb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:43.288984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db841369-b348-4000-bfc4-e1d94836d7cb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:43.290053 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db841369-b348-4000-bfc4-e1d94836d7cb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:43.290526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db841369-b348-4000-bfc4-e1d94836d7cb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:43.427633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-db841369-b348-4000-bfc4-e1d94836d7cb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:43.435253 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-db841369-b348-4000-bfc4-e1d94836d7cb tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1457 microversion: 2.1 time: 0.158898 Mar 05 21:23:43.435853 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2800/5639] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:43 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1457 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:43.988563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-1c3d2e77-3f32-4b42-a509-b1cc144fdffd req-f489281b-f598-42d9-af9a-656cfa356403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d", "name": "network-vif-deleted", "tag": "2d792f34-8e44-42c7-923e-91d5e87974f1"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:44.001148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1c3d2e77-3f32-4b42-a509-b1cc144fdffd req-f489281b-f598-42d9-af9a-656cfa356403 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:44.001607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-1c3d2e77-3f32-4b42-a509-b1cc144fdffd req-f489281b-f598-42d9-af9a-656cfa356403 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:44.014512 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-1c3d2e77-3f32-4b42-a509-b1cc144fdffd req-f489281b-f598-42d9-af9a-656cfa356403 service nova] Creating event network-vif-deleted:2d792f34-8e44-42c7-923e-91d5e87974f1 for instance 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d on nch1-master-1 Mar 05 21:23:44.020227 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-1c3d2e77-3f32-4b42-a509-b1cc144fdffd req-f489281b-f598-42d9-af9a-656cfa356403 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038177 Mar 05 21:23:44.020850 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2840/5640] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:23:44.453804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ad409127-14fb-4340-8139-a6890a55081b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:44.455264 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ad409127-14fb-4340-8139-a6890a55081b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:44.462731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad409127-14fb-4340-8139-a6890a55081b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:44.463226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad409127-14fb-4340-8139-a6890a55081b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:44.464063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad409127-14fb-4340-8139-a6890a55081b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:44.464536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad409127-14fb-4340-8139-a6890a55081b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:44.498724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad409127-14fb-4340-8139-a6890a55081b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:44.499102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad409127-14fb-4340-8139-a6890a55081b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:44.500416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-ad409127-14fb-4340-8139-a6890a55081b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lazy-loading 'fault' on Instance uuid 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:23:44.772764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad409127-14fb-4340-8139-a6890a55081b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c07bd2946594c3e8848bca133da0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb29011e61419981c5bfc5f10677c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:44.779474 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ad409127-14fb-4340-8139-a6890a55081b tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 200 len: 1184 microversion: 2.1 time: 0.330552 Mar 05 21:23:44.780096 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2801/5641] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:44 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 1184 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:45.797805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cfcfe415-21b6-42cc-918a-5238a634eb5f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:45.798541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cfcfe415-21b6-42cc-918a-5238a634eb5f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:45.805468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfcfe415-21b6-42cc-918a-5238a634eb5f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:45.805925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfcfe415-21b6-42cc-918a-5238a634eb5f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:45.806691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfcfe415-21b6-42cc-918a-5238a634eb5f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:45.807133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cfcfe415-21b6-42cc-918a-5238a634eb5f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:45.821210 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-cfcfe415-21b6-42cc-918a-5238a634eb5f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d could not be found. Mar 05 21:23:45.821813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cfcfe415-21b6-42cc-918a-5238a634eb5f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance 5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:23:45.822629 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cfcfe415-21b6-42cc-918a-5238a634eb5f tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d" status: 404 len: 111 microversion: 2.1 time: 0.029137 Mar 05 21:23:45.823161 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2841/5642] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:45 2022] GET /compute/v2.1/servers/5c5861bb-9cbe-4511-9dd3-5c3b8e1b271d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:23:46.271475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ceb4afed-ed41-49b0-a2a0-33c90f927bfd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:46.272015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ceb4afed-ed41-49b0-a2a0-33c90f927bfd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:46.278693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ceb4afed-ed41-49b0-a2a0-33c90f927bfd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:46.279162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ceb4afed-ed41-49b0-a2a0-33c90f927bfd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:46.279974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ceb4afed-ed41-49b0-a2a0-33c90f927bfd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:46.281025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ceb4afed-ed41-49b0-a2a0-33c90f927bfd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:46.293975 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-ceb4afed-ed41-49b0-a2a0-33c90f927bfd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance dc84e1f0-ab0d-4abb-94af-c4a562afe24f could not be found. Mar 05 21:23:46.294576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ceb4afed-ed41-49b0-a2a0-33c90f927bfd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance dc84e1f0-ab0d-4abb-94af-c4a562afe24f could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:23:46.295403 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ceb4afed-ed41-49b0-a2a0-33c90f927bfd tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 404 len: 111 microversion: 2.1 time: 0.027837 Mar 05 21:23:46.296190 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2802/5643] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:23:46 2022] DELETE /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:23:46.304476 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-59cf29a7-c441-40a0-b451-a2e2bae3a74c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:46.305107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-59cf29a7-c441-40a0-b451-a2e2bae3a74c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] [instance: dc84e1f0-ab0d-4abb-94af-c4a562afe24f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:46.312192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59cf29a7-c441-40a0-b451-a2e2bae3a74c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:46.312538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59cf29a7-c441-40a0-b451-a2e2bae3a74c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:46.313315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59cf29a7-c441-40a0-b451-a2e2bae3a74c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:46.313760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59cf29a7-c441-40a0-b451-a2e2bae3a74c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:46.327901 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-59cf29a7-c441-40a0-b451-a2e2bae3a74c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] HTTP exception thrown: Instance dc84e1f0-ab0d-4abb-94af-c4a562afe24f could not be found. Mar 05 21:23:46.328522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-59cf29a7-c441-40a0-b451-a2e2bae3a74c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Returning 404 to user: Instance dc84e1f0-ab0d-4abb-94af-c4a562afe24f could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:23:46.329334 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-59cf29a7-c441-40a0-b451-a2e2bae3a74c tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f" status: 404 len: 111 microversion: 2.1 time: 0.028860 Mar 05 21:23:46.329875 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2842/5644] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:46 2022] GET /compute/v2.1/servers/dc84e1f0-ab0d-4abb-94af-c4a562afe24f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:23:47.611107 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3673992e-2340-46f2-8282-88947534bc36 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] Calling method '.version_select at 0x7fed4c732040>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:47.630710 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3673992e-2340-46f2-8282-88947534bc36 tempest-TestVolumeBootPattern-160921740 tempest-TestVolumeBootPattern-160921740-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1698875555" status: 202 len: 0 microversion: 2.1 time: 0.023706 Mar 05 21:23:47.631309 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2803/5645] 10.222.0.15 () {58 vars in 1262 bytes} [Sat Mar 5 21:23:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1698875555 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:23:49.501486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c1cc858-a5a7-476a-98b0-4662e8208212 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:49.502733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3c1cc858-a5a7-476a-98b0-4662e8208212 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:49.509892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c1cc858-a5a7-476a-98b0-4662e8208212 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:49.510352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c1cc858-a5a7-476a-98b0-4662e8208212 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:49.511130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c1cc858-a5a7-476a-98b0-4662e8208212 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:49.511573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c1cc858-a5a7-476a-98b0-4662e8208212 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:49.836951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3c1cc858-a5a7-476a-98b0-4662e8208212 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:49.847451 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3c1cc858-a5a7-476a-98b0-4662e8208212 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1681 microversion: 2.1 time: 0.350385 Mar 05 21:23:49.848251 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2843/5646] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:49 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1681 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:49.962484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f25d5981-4bac-44a9-877b-0b2ab841b3d9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:49.964099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f25d5981-4bac-44a9-877b-0b2ab841b3d9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:49.980037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f25d5981-4bac-44a9-877b-0b2ab841b3d9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:49.980724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f25d5981-4bac-44a9-877b-0b2ab841b3d9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:49.981612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f25d5981-4bac-44a9-877b-0b2ab841b3d9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:49.982222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f25d5981-4bac-44a9-877b-0b2ab841b3d9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:50.062182 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f25d5981-4bac-44a9-877b-0b2ab841b3d9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040/action" status: 200 len: 32651 microversion: 2.1 time: 0.102760 Mar 05 21:23:50.062944 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2804/5647] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:23:49 2022] POST /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040/action => generated 32651 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:23:50.255882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f1e09bba-0b07-451a-ba90-a5f7f07cb8bf tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:50.256429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f1e09bba-0b07-451a-ba90-a5f7f07cb8bf tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:50.263245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1e09bba-0b07-451a-ba90-a5f7f07cb8bf tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:50.263725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1e09bba-0b07-451a-ba90-a5f7f07cb8bf tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:50.265100 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1e09bba-0b07-451a-ba90-a5f7f07cb8bf tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:50.265553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f1e09bba-0b07-451a-ba90-a5f7f07cb8bf tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:50.518686 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f1e09bba-0b07-451a-ba90-a5f7f07cb8bf tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1832 microversion: 2.1 time: 0.266983 Mar 05 21:23:50.530777 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2844/5648] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:50 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1832 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:50.536510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e7949adf-9cbf-4e22-9c68-964bb16b170c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:50.537745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e7949adf-9cbf-4e22-9c68-964bb16b170c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:50.544700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7949adf-9cbf-4e22-9c68-964bb16b170c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:50.545175 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7949adf-9cbf-4e22-9c68-964bb16b170c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:50.546260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7949adf-9cbf-4e22-9c68-964bb16b170c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:50.546754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e7949adf-9cbf-4e22-9c68-964bb16b170c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:50.573003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-e7949adf-9cbf-4e22-9c68-964bb16b170c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lazy-loading 'flavor' on Instance uuid d2ae1004-597e-4bab-acb1-96ebd290f040 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:23:50.587139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e7949adf-9cbf-4e22-9c68-964bb16b170c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Going to try to live migrate instance to another host {{(pid=141478) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 05 21:23:52.067872 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e7949adf-9cbf-4e22-9c68-964bb16b170c tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040/action" status: 202 len: 0 microversion: 2.1 time: 1.535299 Mar 05 21:23:52.069381 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2805/5649] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:23:50 2022] POST /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040/action => generated 0 bytes in 1539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 21:23:52.078654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a1310bee-bc73-4a1e-a051-2aa9c8d76d72 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:52.079546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a1310bee-bc73-4a1e-a051-2aa9c8d76d72 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:52.087181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a1310bee-bc73-4a1e-a051-2aa9c8d76d72 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:52.087791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a1310bee-bc73-4a1e-a051-2aa9c8d76d72 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:52.088709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a1310bee-bc73-4a1e-a051-2aa9c8d76d72 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:52.089246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a1310bee-bc73-4a1e-a051-2aa9c8d76d72 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:52.576443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a1310bee-bc73-4a1e-a051-2aa9c8d76d72 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:52.585246 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a1310bee-bc73-4a1e-a051-2aa9c8d76d72 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1691 microversion: 2.1 time: 0.511345 Mar 05 21:23:52.585843 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2845/5650] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:52 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1691 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:53.603918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ef58cca7-5f89-43cc-be3d-09f64a66e31b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:53.606932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ef58cca7-5f89-43cc-be3d-09f64a66e31b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:53.616217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef58cca7-5f89-43cc-be3d-09f64a66e31b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:53.617848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef58cca7-5f89-43cc-be3d-09f64a66e31b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:53.618858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef58cca7-5f89-43cc-be3d-09f64a66e31b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:53.620021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ef58cca7-5f89-43cc-be3d-09f64a66e31b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:53.749957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-f9f60b19-1151-49f1-b3f3-67faa1a7a255 req-0fd9ca0f-2ab9-4856-90fb-d035d3058160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ae1004-597e-4bab-acb1-96ebd290f040", "name": "network-vif-unplugged", "status": "completed", "tag": "a5de0875-8060-48d1-8e0b-80631f2a3596"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:53.760486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f9f60b19-1151-49f1-b3f3-67faa1a7a255 req-0fd9ca0f-2ab9-4856-90fb-d035d3058160 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:53.761215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f9f60b19-1151-49f1-b3f3-67faa1a7a255 req-0fd9ca0f-2ab9-4856-90fb-d035d3058160 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:53.773765 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-f9f60b19-1151-49f1-b3f3-67faa1a7a255 req-0fd9ca0f-2ab9-4856-90fb-d035d3058160 service nova] Creating event network-vif-unplugged:a5de0875-8060-48d1-8e0b-80631f2a3596 for instance d2ae1004-597e-4bab-acb1-96ebd290f040 on nch2-master-1 Mar 05 21:23:53.785794 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-f9f60b19-1151-49f1-b3f3-67faa1a7a255 req-0fd9ca0f-2ab9-4856-90fb-d035d3058160 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040120 Mar 05 21:23:53.786824 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2846/5651] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:23:53.958650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ef58cca7-5f89-43cc-be3d-09f64a66e31b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:53.966499 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ef58cca7-5f89-43cc-be3d-09f64a66e31b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1691 microversion: 2.1 time: 0.367929 Mar 05 21:23:53.976546 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2806/5652] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:53 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1691 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:54.382352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-3d2d4c2b-69ef-4932-b77c-e88405ea790e req-8047dac4-f9de-4cfe-8d67-b4c6eef7dfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ae1004-597e-4bab-acb1-96ebd290f040", "name": "network-vif-plugged", "status": "completed", "tag": "a5de0875-8060-48d1-8e0b-80631f2a3596"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:54.400862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3d2d4c2b-69ef-4932-b77c-e88405ea790e req-8047dac4-f9de-4cfe-8d67-b4c6eef7dfd4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:54.401586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3d2d4c2b-69ef-4932-b77c-e88405ea790e req-8047dac4-f9de-4cfe-8d67-b4c6eef7dfd4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:54.429212 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-3d2d4c2b-69ef-4932-b77c-e88405ea790e req-8047dac4-f9de-4cfe-8d67-b4c6eef7dfd4 service nova] Creating event network-vif-plugged:a5de0875-8060-48d1-8e0b-80631f2a3596 for instance d2ae1004-597e-4bab-acb1-96ebd290f040 on nch2-master-1 Mar 05 21:23:54.436785 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-3d2d4c2b-69ef-4932-b77c-e88405ea790e req-8047dac4-f9de-4cfe-8d67-b4c6eef7dfd4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063831 Mar 05 21:23:54.438008 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2847/5653] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:23:54.984829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-437a8539-75ce-4d9f-9728-c7e3b78645bd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:54.985494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-437a8539-75ce-4d9f-9728-c7e3b78645bd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:54.993144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-437a8539-75ce-4d9f-9728-c7e3b78645bd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:54.993607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-437a8539-75ce-4d9f-9728-c7e3b78645bd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:54.994415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-437a8539-75ce-4d9f-9728-c7e3b78645bd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:54.994869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-437a8539-75ce-4d9f-9728-c7e3b78645bd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:55.189032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-437a8539-75ce-4d9f-9728-c7e3b78645bd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:55.198026 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-437a8539-75ce-4d9f-9728-c7e3b78645bd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1691 microversion: 2.1 time: 0.218084 Mar 05 21:23:55.198629 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2807/5654] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:54 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1691 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:55.819695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-07b6a346-0a92-47c5-a5d5-2915320c6e3d req-f5296820-fe5b-4226-a7ec-d8826d276391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ae1004-597e-4bab-acb1-96ebd290f040", "tag": "a5de0875-8060-48d1-8e0b-80631f2a3596"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:55.828355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-07b6a346-0a92-47c5-a5d5-2915320c6e3d req-f5296820-fe5b-4226-a7ec-d8826d276391 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:55.828814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-07b6a346-0a92-47c5-a5d5-2915320c6e3d req-f5296820-fe5b-4226-a7ec-d8826d276391 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:55.839784 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-07b6a346-0a92-47c5-a5d5-2915320c6e3d req-f5296820-fe5b-4226-a7ec-d8826d276391 service nova] Creating event network-changed:a5de0875-8060-48d1-8e0b-80631f2a3596 for instance d2ae1004-597e-4bab-acb1-96ebd290f040 on nch2-master-1 Mar 05 21:23:55.845435 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-07b6a346-0a92-47c5-a5d5-2915320c6e3d req-f5296820-fe5b-4226-a7ec-d8826d276391 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030611 Mar 05 21:23:55.846125 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2848/5655] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:23:56.215981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d4873ff9-c90c-412c-9f41-47e3114a4690 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:56.217225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d4873ff9-c90c-412c-9f41-47e3114a4690 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:56.225461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4873ff9-c90c-412c-9f41-47e3114a4690 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:56.226142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4873ff9-c90c-412c-9f41-47e3114a4690 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:56.226940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4873ff9-c90c-412c-9f41-47e3114a4690 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:56.227413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4873ff9-c90c-412c-9f41-47e3114a4690 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:56.495431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d4873ff9-c90c-412c-9f41-47e3114a4690 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:56.504473 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d4873ff9-c90c-412c-9f41-47e3114a4690 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1691 microversion: 2.1 time: 0.292246 Mar 05 21:23:56.505079 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2808/5656] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:56 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1691 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:57.740585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2d82158c-a43a-44bc-9556-3236ba96048b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:57.741302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2d82158c-a43a-44bc-9556-3236ba96048b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:57.747355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d82158c-a43a-44bc-9556-3236ba96048b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:57.747868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d82158c-a43a-44bc-9556-3236ba96048b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:57.748688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d82158c-a43a-44bc-9556-3236ba96048b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:57.749179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d82158c-a43a-44bc-9556-3236ba96048b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:57.891917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2d82158c-a43a-44bc-9556-3236ba96048b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:57.899240 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2d82158c-a43a-44bc-9556-3236ba96048b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1691 microversion: 2.1 time: 0.381512 Mar 05 21:23:57.899831 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2849/5657] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:57 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1691 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:58.917326 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4d91e9fb-dbee-4127-9116-be0d8d9c943a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:23:58.917982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4d91e9fb-dbee-4127-9116-be0d8d9c943a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:23:58.925513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d91e9fb-dbee-4127-9116-be0d8d9c943a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:58.926088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d91e9fb-dbee-4127-9116-be0d8d9c943a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:58.927047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d91e9fb-dbee-4127-9116-be0d8d9c943a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:58.927562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4d91e9fb-dbee-4127-9116-be0d8d9c943a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:59.064506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4d91e9fb-dbee-4127-9116-be0d8d9c943a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:23:59.072338 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4d91e9fb-dbee-4127-9116-be0d8d9c943a tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1691 microversion: 2.1 time: 0.158880 Mar 05 21:23:59.072900 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2809/5658] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:23:58 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:23:59.805450 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-3f992b74-aef3-413f-a778-7dd7b41112d7 req-639583de-5752-40db-844f-0240b7a2ee89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ae1004-597e-4bab-acb1-96ebd290f040", "name": "network-vif-unplugged", "status": "completed", "tag": "a5de0875-8060-48d1-8e0b-80631f2a3596"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:23:59.814999 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3f992b74-aef3-413f-a778-7dd7b41112d7 req-639583de-5752-40db-844f-0240b7a2ee89 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:23:59.815449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3f992b74-aef3-413f-a778-7dd7b41112d7 req-639583de-5752-40db-844f-0240b7a2ee89 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:23:59.826493 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-3f992b74-aef3-413f-a778-7dd7b41112d7 req-639583de-5752-40db-844f-0240b7a2ee89 service nova] Creating event network-vif-unplugged:a5de0875-8060-48d1-8e0b-80631f2a3596 for instance d2ae1004-597e-4bab-acb1-96ebd290f040 on nch2-master-1 Mar 05 21:23:59.832023 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-3f992b74-aef3-413f-a778-7dd7b41112d7 req-639583de-5752-40db-844f-0240b7a2ee89 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030253 Mar 05 21:23:59.832628 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2850/5659] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:24:00.089847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f2ba178c-e428-4b05-9a3d-aa42696d90dd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:00.090775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f2ba178c-e428-4b05-9a3d-aa42696d90dd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:00.098708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2ba178c-e428-4b05-9a3d-aa42696d90dd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:00.099240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2ba178c-e428-4b05-9a3d-aa42696d90dd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:00.100067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2ba178c-e428-4b05-9a3d-aa42696d90dd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:00.100693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2ba178c-e428-4b05-9a3d-aa42696d90dd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:00.291699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f2ba178c-e428-4b05-9a3d-aa42696d90dd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:00.299950 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f2ba178c-e428-4b05-9a3d-aa42696d90dd tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1691 microversion: 2.1 time: 0.214014 Mar 05 21:24:00.300733 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2810/5660] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:00 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1691 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:01.319786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eba4175a-bce2-4245-9a43-e5aa8b1afa3b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:01.320589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eba4175a-bce2-4245-9a43-e5aa8b1afa3b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:01.328080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eba4175a-bce2-4245-9a43-e5aa8b1afa3b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:01.328560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eba4175a-bce2-4245-9a43-e5aa8b1afa3b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:01.329352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eba4175a-bce2-4245-9a43-e5aa8b1afa3b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:01.329801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eba4175a-bce2-4245-9a43-e5aa8b1afa3b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:01.466852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eba4175a-bce2-4245-9a43-e5aa8b1afa3b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:01.474521 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eba4175a-bce2-4245-9a43-e5aa8b1afa3b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1681 microversion: 2.1 time: 0.159834 Mar 05 21:24:01.475198 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2851/5661] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:01 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:01.492277 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cfe60634-5530-48b5-93f4-8e34339c5bd6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:01.492949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cfe60634-5530-48b5-93f4-8e34339c5bd6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:01.500652 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cfe60634-5530-48b5-93f4-8e34339c5bd6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:01.501184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cfe60634-5530-48b5-93f4-8e34339c5bd6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:01.502020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cfe60634-5530-48b5-93f4-8e34339c5bd6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:01.502480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cfe60634-5530-48b5-93f4-8e34339c5bd6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:01.641456 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cfe60634-5530-48b5-93f4-8e34339c5bd6 tempest-TestNetworkAdvancedServerOps-1211650658 tempest-TestNetworkAdvancedServerOps-1211650658-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1832 microversion: 2.1 time: 0.152804 Mar 05 21:24:01.642042 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2811/5662] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:01 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1832 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:01.658487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d4d7cc8a-4a43-4a8e-8737-95be293929a4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:01.659217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d4d7cc8a-4a43-4a8e-8737-95be293929a4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:01.665253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4d7cc8a-4a43-4a8e-8737-95be293929a4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:01.665730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4d7cc8a-4a43-4a8e-8737-95be293929a4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:01.666568 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4d7cc8a-4a43-4a8e-8737-95be293929a4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:01.667048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d4d7cc8a-4a43-4a8e-8737-95be293929a4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:01.801626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d4d7cc8a-4a43-4a8e-8737-95be293929a4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:01.808933 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d4d7cc8a-4a43-4a8e-8737-95be293929a4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1681 microversion: 2.1 time: 0.155259 Mar 05 21:24:01.809507 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2852/5663] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:01 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:01.905715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f52a4ad4-19ed-4838-8d72-1fcc8aca8d28 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:24:01.906929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f52a4ad4-19ed-4838-8d72-1fcc8aca8d28 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:01.912909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f52a4ad4-19ed-4838-8d72-1fcc8aca8d28 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:01.913375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f52a4ad4-19ed-4838-8d72-1fcc8aca8d28 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:01.914285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f52a4ad4-19ed-4838-8d72-1fcc8aca8d28 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:01.914735 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f52a4ad4-19ed-4838-8d72-1fcc8aca8d28 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:01.964884 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f52a4ad4-19ed-4838-8d72-1fcc8aca8d28 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040/action" status: 200 len: 38533 microversion: 2.1 time: 0.063263 Mar 05 21:24:01.966003 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2812/5664] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:24:01 2022] POST /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040/action => generated 38533 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 21:24:02.967641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-01f4d7b3-8c68-41e0-9838-ad1792d4a612 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:02.968269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-01f4d7b3-8c68-41e0-9838-ad1792d4a612 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:02.970638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b798a5a3-f681-46fd-a312-8d6a6e67ead9 req-db00ed33-619c-4d43-9e78-3b92e5bb7508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ae1004-597e-4bab-acb1-96ebd290f040", "tag": "a5de0875-8060-48d1-8e0b-80631f2a3596"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:24:02.975509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01f4d7b3-8c68-41e0-9838-ad1792d4a612 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:02.976008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01f4d7b3-8c68-41e0-9838-ad1792d4a612 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:02.976800 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01f4d7b3-8c68-41e0-9838-ad1792d4a612 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:02.977246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-01f4d7b3-8c68-41e0-9838-ad1792d4a612 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:02.980324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b798a5a3-f681-46fd-a312-8d6a6e67ead9 req-db00ed33-619c-4d43-9e78-3b92e5bb7508 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:02.980848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b798a5a3-f681-46fd-a312-8d6a6e67ead9 req-db00ed33-619c-4d43-9e78-3b92e5bb7508 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:02.993469 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-b798a5a3-f681-46fd-a312-8d6a6e67ead9 req-db00ed33-619c-4d43-9e78-3b92e5bb7508 service nova] Creating event network-changed:a5de0875-8060-48d1-8e0b-80631f2a3596 for instance d2ae1004-597e-4bab-acb1-96ebd290f040 on nch1-master-1 Mar 05 21:24:02.998917 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b798a5a3-f681-46fd-a312-8d6a6e67ead9 req-db00ed33-619c-4d43-9e78-3b92e5bb7508 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032088 Mar 05 21:24:03.000200 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2813/5665] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:24:03.006858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-01f4d7b3-8c68-41e0-9838-ad1792d4a612 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:24:03.088662 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-01f4d7b3-8c68-41e0-9838-ad1792d4a612 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 204 len: 0 microversion: 2.1 time: 0.124624 Mar 05 21:24:03.089642 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2853/5666] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:24:02 2022] DELETE /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:24:03.099734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d851c4c3-e83b-4fe4-bb80-d0d884eeac51 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:03.100642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d851c4c3-e83b-4fe4-bb80-d0d884eeac51 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:03.106758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d851c4c3-e83b-4fe4-bb80-d0d884eeac51 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:03.107705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d851c4c3-e83b-4fe4-bb80-d0d884eeac51 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:03.108812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d851c4c3-e83b-4fe4-bb80-d0d884eeac51 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:03.109343 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d851c4c3-e83b-4fe4-bb80-d0d884eeac51 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:03.351938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d851c4c3-e83b-4fe4-bb80-d0d884eeac51 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:03.360269 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d851c4c3-e83b-4fe4-bb80-d0d884eeac51 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 200 len: 1687 microversion: 2.1 time: 0.265039 Mar 05 21:24:03.360871 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2814/5667] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:03 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 1687 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:04.128988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-429bfbe5-766e-449e-b631-2e2d1cfe492f req-30abcbb6-6eeb-48c2-a9d0-b3744a7c0651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ae1004-597e-4bab-acb1-96ebd290f040", "name": "network-vif-deleted", "tag": "a5de0875-8060-48d1-8e0b-80631f2a3596"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:24:04.140599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-429bfbe5-766e-449e-b631-2e2d1cfe492f req-30abcbb6-6eeb-48c2-a9d0-b3744a7c0651 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:04.140978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-429bfbe5-766e-449e-b631-2e2d1cfe492f req-30abcbb6-6eeb-48c2-a9d0-b3744a7c0651 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:04.153285 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-429bfbe5-766e-449e-b631-2e2d1cfe492f req-30abcbb6-6eeb-48c2-a9d0-b3744a7c0651 service nova] Creating event network-vif-deleted:a5de0875-8060-48d1-8e0b-80631f2a3596 for instance d2ae1004-597e-4bab-acb1-96ebd290f040 on nch1-master-1 Mar 05 21:24:04.159300 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-429bfbe5-766e-449e-b631-2e2d1cfe492f req-30abcbb6-6eeb-48c2-a9d0-b3744a7c0651 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034810 Mar 05 21:24:04.159933 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2854/5668] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:24:04.379193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2edba2da-535f-42fa-9687-40d561d5b073 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:04.380019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2edba2da-535f-42fa-9687-40d561d5b073 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: d2ae1004-597e-4bab-acb1-96ebd290f040] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:04.386738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2edba2da-535f-42fa-9687-40d561d5b073 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:04.387209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2edba2da-535f-42fa-9687-40d561d5b073 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:04.388025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2edba2da-535f-42fa-9687-40d561d5b073 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:04.388482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2edba2da-535f-42fa-9687-40d561d5b073 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:04.403359 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-2edba2da-535f-42fa-9687-40d561d5b073 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] HTTP exception thrown: Instance d2ae1004-597e-4bab-acb1-96ebd290f040 could not be found. Mar 05 21:24:04.404011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2edba2da-535f-42fa-9687-40d561d5b073 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Returning 404 to user: Instance d2ae1004-597e-4bab-acb1-96ebd290f040 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:24:04.405208 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2edba2da-535f-42fa-9687-40d561d5b073 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040" status: 404 len: 111 microversion: 2.1 time: 0.030334 Mar 05 21:24:04.405874 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2815/5669] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:04 2022] GET /compute/v2.1/servers/d2ae1004-597e-4bab-acb1-96ebd290f040 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:24:07.776393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-98f156c7-229f-4802-9c63-e3177e9a7f0f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '.version_select at 0x7fed4f65bdc0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:07.800035 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-98f156c7-229f-4802-9c63-e3177e9a7f0f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1384916457" status: 202 len: 0 microversion: 2.1 time: 0.028191 Mar 05 21:24:07.800806 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2855/5670] 10.222.0.15 () {58 vars in 1283 bytes} [Sat Mar 5 21:24:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1384916457 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:24:07.828668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0327b74f-f7ca-492e-831a-33e6680fbca3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'create', calling method: .version_select at 0x7fed5ed231f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1804714466"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:24:07.843699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-0327b74f-f7ca-492e-831a-33e6680fbca3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:24:07.849402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-0327b74f-f7ca-492e-831a-33e6680fbca3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for user f9a39fb8a8fe498db9a98166acf96d0d and project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:24:08.068394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-0327b74f-f7ca-492e-831a-33e6680fbca3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:24:08.073300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-0327b74f-f7ca-492e-831a-33e6680fbca3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for user f9a39fb8a8fe498db9a98166acf96d0d and project 7be8dce4a165431c8a7279be20d99612. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:24:08.087983 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0327b74f-f7ca-492e-831a-33e6680fbca3 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.263031 Mar 05 21:24:08.088592 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2816/5671] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:24:07 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:24:13.854171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1331248390", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "85099e52-467a-42aa-8133-bc744a0c6342"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1804714466", "security_groups": [{"name": "tempest-secgroup-smoke-1532253260"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:24:13.980754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] validate_networks() for [('85099e52-467a-42aa-8133-bc744a0c6342', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:24:14.486324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:24:14.486757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:24:14.487237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:24:14.488003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:24:14.488439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:24:14.498928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:14.498928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:14.499911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:14.500612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:14.522637 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for project 7be8dce4a165431c8a7279be20d99612. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:24:14.528135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Getting quotas for user f9a39fb8a8fe498db9a98166acf96d0d and project 7be8dce4a165431c8a7279be20d99612. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:24:14.542132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:24:14.544699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:24:14.596523 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0798c756-2813-4d7f-aa24-45447e6db2a9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.746125 Mar 05 21:24:14.597652 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2856/5672] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:24:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 21:24:14.611190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-007a29c0-58d0-49e5-9372-d7959db9fe93 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:14.612746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-007a29c0-58d0-49e5-9372-d7959db9fe93 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:14.696781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-007a29c0-58d0-49e5-9372-d7959db9fe93 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:14.709354 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-007a29c0-58d0-49e5-9372-d7959db9fe93 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1267 microversion: 2.1 time: 0.104815 Mar 05 21:24:14.710924 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2817/5673] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:14 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:15.727493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d5dfced-a2be-4d3b-8cfd-21aa2c468e8f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:15.728885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7d5dfced-a2be-4d3b-8cfd-21aa2c468e8f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:15.736901 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d5dfced-a2be-4d3b-8cfd-21aa2c468e8f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:15.737449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d5dfced-a2be-4d3b-8cfd-21aa2c468e8f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:15.739283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d5dfced-a2be-4d3b-8cfd-21aa2c468e8f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:15.740161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d5dfced-a2be-4d3b-8cfd-21aa2c468e8f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:15.844294 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d5dfced-a2be-4d3b-8cfd-21aa2c468e8f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:15.855425 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7d5dfced-a2be-4d3b-8cfd-21aa2c468e8f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1327 microversion: 2.1 time: 0.132787 Mar 05 21:24:15.856421 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2857/5674] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:15 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:16.873316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eb790fa8-0457-466d-9d46-9210844b7260 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:16.874667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eb790fa8-0457-466d-9d46-9210844b7260 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:16.882486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb790fa8-0457-466d-9d46-9210844b7260 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:16.883226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb790fa8-0457-466d-9d46-9210844b7260 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:16.884395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb790fa8-0457-466d-9d46-9210844b7260 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:16.885082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eb790fa8-0457-466d-9d46-9210844b7260 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:17.476335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eb790fa8-0457-466d-9d46-9210844b7260 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:17.487084 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eb790fa8-0457-466d-9d46-9210844b7260 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1393 microversion: 2.1 time: 0.617814 Mar 05 21:24:17.488202 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2818/5675] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:16 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1393 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:17.670321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-67dbf091-7526-4917-8f05-88ad34a5812d req-0398b47f-a0b2-4058-8c86-a9ff89576cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb", "tag": "f62a0af6-b1e1-48c2-b304-059a1b9c84a9"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:24:17.688538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-67dbf091-7526-4917-8f05-88ad34a5812d req-0398b47f-a0b2-4058-8c86-a9ff89576cfc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:17.689278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-67dbf091-7526-4917-8f05-88ad34a5812d req-0398b47f-a0b2-4058-8c86-a9ff89576cfc service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:17.701707 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-67dbf091-7526-4917-8f05-88ad34a5812d req-0398b47f-a0b2-4058-8c86-a9ff89576cfc service nova] Creating event network-changed:f62a0af6-b1e1-48c2-b304-059a1b9c84a9 for instance 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb on nch1-master-1 Mar 05 21:24:17.707180 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-67dbf091-7526-4917-8f05-88ad34a5812d req-0398b47f-a0b2-4058-8c86-a9ff89576cfc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046657 Mar 05 21:24:17.708168 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2858/5676] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:24:18.504999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d40150c5-2872-4cb5-b4a4-cd44f13d499f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:18.505629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d40150c5-2872-4cb5-b4a4-cd44f13d499f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:18.512115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d40150c5-2872-4cb5-b4a4-cd44f13d499f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:18.512582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d40150c5-2872-4cb5-b4a4-cd44f13d499f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:18.513358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d40150c5-2872-4cb5-b4a4-cd44f13d499f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:18.514361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d40150c5-2872-4cb5-b4a4-cd44f13d499f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:18.695334 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d40150c5-2872-4cb5-b4a4-cd44f13d499f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:18.703330 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d40150c5-2872-4cb5-b4a4-cd44f13d499f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1393 microversion: 2.1 time: 0.202481 Mar 05 21:24:18.703940 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2819/5677] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:18 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1393 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:19.722423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ca82ff52-9ce8-4ab1-9d61-cbbf857af7fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:19.723167 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ca82ff52-9ce8-4ab1-9d61-cbbf857af7fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:19.729321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca82ff52-9ce8-4ab1-9d61-cbbf857af7fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:19.729791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca82ff52-9ce8-4ab1-9d61-cbbf857af7fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:19.730580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca82ff52-9ce8-4ab1-9d61-cbbf857af7fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:19.731029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca82ff52-9ce8-4ab1-9d61-cbbf857af7fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:19.871679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ca82ff52-9ce8-4ab1-9d61-cbbf857af7fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:19.880206 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ca82ff52-9ce8-4ab1-9d61-cbbf857af7fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1393 microversion: 2.1 time: 0.163394 Mar 05 21:24:19.880811 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2859/5678] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:19 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:20.897711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-77d3b779-06ab-4f44-afc7-a752483f6185 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:20.898344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-77d3b779-06ab-4f44-afc7-a752483f6185 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:20.906314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77d3b779-06ab-4f44-afc7-a752483f6185 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:20.906805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77d3b779-06ab-4f44-afc7-a752483f6185 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:20.907585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77d3b779-06ab-4f44-afc7-a752483f6185 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:20.908069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-77d3b779-06ab-4f44-afc7-a752483f6185 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:21.047227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-77d3b779-06ab-4f44-afc7-a752483f6185 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:21.054531 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-77d3b779-06ab-4f44-afc7-a752483f6185 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1393 microversion: 2.1 time: 0.160793 Mar 05 21:24:21.055120 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2820/5679] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:20 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:21.885391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-4560fd93-98c8-4b14-9bea-aef63182de52 req-30308b39-6e26-4475-8471-ca986a49d964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb", "name": "network-vif-plugged", "status": "completed", "tag": "f62a0af6-b1e1-48c2-b304-059a1b9c84a9"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:24:21.895659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4560fd93-98c8-4b14-9bea-aef63182de52 req-30308b39-6e26-4475-8471-ca986a49d964 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:21.896361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4560fd93-98c8-4b14-9bea-aef63182de52 req-30308b39-6e26-4475-8471-ca986a49d964 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:21.909093 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-4560fd93-98c8-4b14-9bea-aef63182de52 req-30308b39-6e26-4475-8471-ca986a49d964 service nova] Creating event network-vif-plugged:f62a0af6-b1e1-48c2-b304-059a1b9c84a9 for instance 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb on nch1-master-1 Mar 05 21:24:21.914098 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-4560fd93-98c8-4b14-9bea-aef63182de52 req-30308b39-6e26-4475-8471-ca986a49d964 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032512 Mar 05 21:24:21.914884 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2860/5680] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:24:22.070405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6d43488b-1154-4427-875c-c9da34012676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:22.071093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6d43488b-1154-4427-875c-c9da34012676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:22.077845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d43488b-1154-4427-875c-c9da34012676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:22.078306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d43488b-1154-4427-875c-c9da34012676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:22.079086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d43488b-1154-4427-875c-c9da34012676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:22.079535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d43488b-1154-4427-875c-c9da34012676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:22.214923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6d43488b-1154-4427-875c-c9da34012676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:22.223049 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6d43488b-1154-4427-875c-c9da34012676 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1393 microversion: 2.1 time: 0.156565 Mar 05 21:24:22.223628 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2821/5681] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:22 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:23.240571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a61be6d4-ba4e-4b08-a881-66141ca5c3e4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:23.241275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a61be6d4-ba4e-4b08-a881-66141ca5c3e4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:23.248590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a61be6d4-ba4e-4b08-a881-66141ca5c3e4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:23.249044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a61be6d4-ba4e-4b08-a881-66141ca5c3e4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:23.249817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a61be6d4-ba4e-4b08-a881-66141ca5c3e4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:23.250257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a61be6d4-ba4e-4b08-a881-66141ca5c3e4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:23.388121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a61be6d4-ba4e-4b08-a881-66141ca5c3e4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:23.395612 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a61be6d4-ba4e-4b08-a881-66141ca5c3e4 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1566 microversion: 2.1 time: 0.159387 Mar 05 21:24:23.396227 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2861/5682] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:23 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:23.412179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6cd22a9-4123-4724-ae08-33523cc5cc40 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:23.412830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c6cd22a9-4123-4724-ae08-33523cc5cc40 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:23.419627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6cd22a9-4123-4724-ae08-33523cc5cc40 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:23.420924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6cd22a9-4123-4724-ae08-33523cc5cc40 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:23.421703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6cd22a9-4123-4724-ae08-33523cc5cc40 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:23.422156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6cd22a9-4123-4724-ae08-33523cc5cc40 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:23.562418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c6cd22a9-4123-4724-ae08-33523cc5cc40 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:23.569809 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c6cd22a9-4123-4724-ae08-33523cc5cc40 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1566 microversion: 2.1 time: 0.161428 Mar 05 21:24:23.570384 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2822/5683] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:23 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:25.195231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9d1acb7c-5300-4a2b-ada9-d76dab813a0c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:25.195917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9d1acb7c-5300-4a2b-ada9-d76dab813a0c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:25.205014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-00f3d357-3cca-485a-a8b3-29922200a7ba req-3641cf13-ae0c-479d-bfaf-e4712dbb8984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb", "tag": "f62a0af6-b1e1-48c2-b304-059a1b9c84a9"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:24:25.205573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d1acb7c-5300-4a2b-ada9-d76dab813a0c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:25.205758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d1acb7c-5300-4a2b-ada9-d76dab813a0c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:25.206531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d1acb7c-5300-4a2b-ada9-d76dab813a0c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:25.207223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d1acb7c-5300-4a2b-ada9-d76dab813a0c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:25.214569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-00f3d357-3cca-485a-a8b3-29922200a7ba req-3641cf13-ae0c-479d-bfaf-e4712dbb8984 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:25.215036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-00f3d357-3cca-485a-a8b3-29922200a7ba req-3641cf13-ae0c-479d-bfaf-e4712dbb8984 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:25.228850 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-00f3d357-3cca-485a-a8b3-29922200a7ba req-3641cf13-ae0c-479d-bfaf-e4712dbb8984 service nova] Creating event network-changed:f62a0af6-b1e1-48c2-b304-059a1b9c84a9 for instance 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb on nch1-master-1 Mar 05 21:24:25.235042 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-00f3d357-3cca-485a-a8b3-29922200a7ba req-3641cf13-ae0c-479d-bfaf-e4712dbb8984 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034738 Mar 05 21:24:25.235889 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2823/5684] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:24:25.350324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9d1acb7c-5300-4a2b-ada9-d76dab813a0c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:25.358532 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9d1acb7c-5300-4a2b-ada9-d76dab813a0c tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1566 microversion: 2.1 time: 0.167140 Mar 05 21:24:25.359260 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2862/5685] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:25 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:48.623995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dc7b2f04-4537-4dcc-80b4-3bd839b0322f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:24:48.625086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dc7b2f04-4537-4dcc-80b4-3bd839b0322f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:48.632618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc7b2f04-4537-4dcc-80b4-3bd839b0322f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:48.633081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc7b2f04-4537-4dcc-80b4-3bd839b0322f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:48.633866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc7b2f04-4537-4dcc-80b4-3bd839b0322f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:48.634320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc7b2f04-4537-4dcc-80b4-3bd839b0322f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:48.691047 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dc7b2f04-4537-4dcc-80b4-3bd839b0322f tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb/action" status: 200 len: 24558 microversion: 2.1 time: 0.073010 Mar 05 21:24:48.692587 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2824/5686] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:24:48 2022] POST /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb/action => generated 24558 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:24:55.165072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:24:55.166452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:55.173439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:55.173920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:55.174693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:55.175136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:55.250021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:24:55.250771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:24:55.251255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:24:55.251690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:24:55.252110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:24:55.311313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:55.317355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:55.317826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:55.318759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:55.319218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:55.345050 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0d1c5bc0-8c7c-467a-b5a9-b8a34ae18ee6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb/action" status: 202 len: 1137 microversion: 2.1 time: 0.183901 Mar 05 21:24:55.345698 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2863/5687] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:24:55 2022] POST /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb/action => generated 1137 bytes in 185 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 05 21:24:55.362170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ee5f1603-3ec1-44df-9265-774740e02223 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:55.362968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ee5f1603-3ec1-44df-9265-774740e02223 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:55.371294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee5f1603-3ec1-44df-9265-774740e02223 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:55.371928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee5f1603-3ec1-44df-9265-774740e02223 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:55.372813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee5f1603-3ec1-44df-9265-774740e02223 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:55.373490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee5f1603-3ec1-44df-9265-774740e02223 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:55.853803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ee5f1603-3ec1-44df-9265-774740e02223 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:55.861817 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ee5f1603-3ec1-44df-9265-774740e02223 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1692 microversion: 2.1 time: 0.504715 Mar 05 21:24:55.862399 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2825/5688] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:55 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1692 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:56.879842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-512af9de-d156-467d-a95b-91995077c746 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:56.880470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-512af9de-d156-467d-a95b-91995077c746 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:56.887082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-512af9de-d156-467d-a95b-91995077c746 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:56.887578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-512af9de-d156-467d-a95b-91995077c746 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:56.889247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-512af9de-d156-467d-a95b-91995077c746 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:56.889717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-512af9de-d156-467d-a95b-91995077c746 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:57.030060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-512af9de-d156-467d-a95b-91995077c746 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:57.037361 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-512af9de-d156-467d-a95b-91995077c746 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1692 microversion: 2.1 time: 0.161872 Mar 05 21:24:57.037973 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2864/5689] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:56 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:58.054451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4e80e2cc-c3df-4034-a3b4-12994384d3fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:58.055125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4e80e2cc-c3df-4034-a3b4-12994384d3fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:58.063416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e80e2cc-c3df-4034-a3b4-12994384d3fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:58.063924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e80e2cc-c3df-4034-a3b4-12994384d3fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:58.064721 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e80e2cc-c3df-4034-a3b4-12994384d3fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:58.065186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e80e2cc-c3df-4034-a3b4-12994384d3fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:58.197978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4e80e2cc-c3df-4034-a3b4-12994384d3fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:58.205897 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4e80e2cc-c3df-4034-a3b4-12994384d3fb tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1692 microversion: 2.1 time: 0.155372 Mar 05 21:24:58.206460 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2826/5690] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:58 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:24:59.223144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2706d33e-da0e-47b5-b755-79847f1c1dd8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:24:59.223711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2706d33e-da0e-47b5-b755-79847f1c1dd8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:24:59.230601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2706d33e-da0e-47b5-b755-79847f1c1dd8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:59.231059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2706d33e-da0e-47b5-b755-79847f1c1dd8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:59.231906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2706d33e-da0e-47b5-b755-79847f1c1dd8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:24:59.232821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2706d33e-da0e-47b5-b755-79847f1c1dd8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:24:59.369067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2706d33e-da0e-47b5-b755-79847f1c1dd8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:24:59.376987 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2706d33e-da0e-47b5-b755-79847f1c1dd8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1692 microversion: 2.1 time: 0.157977 Mar 05 21:24:59.377567 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2865/5691] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:24:59 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:25:00.395748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e0df8c4e-1459-4709-9755-47226a6a951d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:00.396380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e0df8c4e-1459-4709-9755-47226a6a951d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:00.402742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e0df8c4e-1459-4709-9755-47226a6a951d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:00.403212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e0df8c4e-1459-4709-9755-47226a6a951d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:00.405208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e0df8c4e-1459-4709-9755-47226a6a951d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:00.405670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e0df8c4e-1459-4709-9755-47226a6a951d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:00.540762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e0df8c4e-1459-4709-9755-47226a6a951d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:25:00.548293 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e0df8c4e-1459-4709-9755-47226a6a951d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1692 microversion: 2.1 time: 0.156630 Mar 05 21:25:00.548877 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2827/5692] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:25:00 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:25:01.569537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-daaa9e01-315a-45a7-beca-4eb9014cb4d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:01.570162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-daaa9e01-315a-45a7-beca-4eb9014cb4d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:01.577620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-daaa9e01-315a-45a7-beca-4eb9014cb4d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:01.578110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-daaa9e01-315a-45a7-beca-4eb9014cb4d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:01.578921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-daaa9e01-315a-45a7-beca-4eb9014cb4d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:01.579370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-daaa9e01-315a-45a7-beca-4eb9014cb4d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:01.722984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-daaa9e01-315a-45a7-beca-4eb9014cb4d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:25:01.730391 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-daaa9e01-315a-45a7-beca-4eb9014cb4d0 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1692 microversion: 2.1 time: 0.164854 Mar 05 21:25:01.730981 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2866/5693] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:25:01 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:25:02.748813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4010d968-3c43-4ce5-87ed-e3da434b06de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:02.749436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4010d968-3c43-4ce5-87ed-e3da434b06de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:02.756464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4010d968-3c43-4ce5-87ed-e3da434b06de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:02.756925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4010d968-3c43-4ce5-87ed-e3da434b06de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:02.757698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4010d968-3c43-4ce5-87ed-e3da434b06de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:02.758146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4010d968-3c43-4ce5-87ed-e3da434b06de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:02.889605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4010d968-3c43-4ce5-87ed-e3da434b06de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:25:02.896981 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4010d968-3c43-4ce5-87ed-e3da434b06de tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1692 microversion: 2.1 time: 0.152627 Mar 05 21:25:02.897543 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2828/5694] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:25:02 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:25:03.914471 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-28240f29-8957-4ff9-b2ee-57e3c4a234f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:03.915098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-28240f29-8957-4ff9-b2ee-57e3c4a234f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:03.922212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28240f29-8957-4ff9-b2ee-57e3c4a234f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:03.922697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28240f29-8957-4ff9-b2ee-57e3c4a234f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:03.923467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28240f29-8957-4ff9-b2ee-57e3c4a234f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:03.923938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-28240f29-8957-4ff9-b2ee-57e3c4a234f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:04.058266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-28240f29-8957-4ff9-b2ee-57e3c4a234f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:25:04.065589 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-28240f29-8957-4ff9-b2ee-57e3c4a234f8 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1692 microversion: 2.1 time: 0.155056 Mar 05 21:25:04.066164 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2867/5695] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:25:03 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:25:05.083282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-def5997f-b042-485e-a397-45acff3ceaf6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:05.083934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-def5997f-b042-485e-a397-45acff3ceaf6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:05.090663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-def5997f-b042-485e-a397-45acff3ceaf6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:05.091638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-def5997f-b042-485e-a397-45acff3ceaf6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:05.092441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-def5997f-b042-485e-a397-45acff3ceaf6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:05.092891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-def5997f-b042-485e-a397-45acff3ceaf6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:05.230008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-def5997f-b042-485e-a397-45acff3ceaf6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:25:05.237923 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-def5997f-b042-485e-a397-45acff3ceaf6 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1692 microversion: 2.1 time: 0.158674 Mar 05 21:25:05.238500 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2829/5696] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:25:05 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:25:06.255299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5bbe9bb1-7382-44fe-bfe6-cc5f295a100d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:06.255879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5bbe9bb1-7382-44fe-bfe6-cc5f295a100d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:06.262736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bbe9bb1-7382-44fe-bfe6-cc5f295a100d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:06.263322 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bbe9bb1-7382-44fe-bfe6-cc5f295a100d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:06.264144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bbe9bb1-7382-44fe-bfe6-cc5f295a100d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:06.264598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5bbe9bb1-7382-44fe-bfe6-cc5f295a100d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:06.399296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5bbe9bb1-7382-44fe-bfe6-cc5f295a100d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:25:06.407195 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5bbe9bb1-7382-44fe-bfe6-cc5f295a100d tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1692 microversion: 2.1 time: 0.156171 Mar 05 21:25:06.407819 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2868/5697] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:25:06 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:25:07.425920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cd1c7217-da1c-4bab-9d9a-5acffe9e7931 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:07.426535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cd1c7217-da1c-4bab-9d9a-5acffe9e7931 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:07.433228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd1c7217-da1c-4bab-9d9a-5acffe9e7931 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:07.433692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd1c7217-da1c-4bab-9d9a-5acffe9e7931 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:07.434470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd1c7217-da1c-4bab-9d9a-5acffe9e7931 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:07.435001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd1c7217-da1c-4bab-9d9a-5acffe9e7931 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:07.567089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cd1c7217-da1c-4bab-9d9a-5acffe9e7931 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:25:07.574521 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cd1c7217-da1c-4bab-9d9a-5acffe9e7931 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1698 microversion: 2.1 time: 0.153237 Mar 05 21:25:07.575087 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2830/5698] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:25:07 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:25:08.592835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-16372292-0f5d-44c8-a88a-de355c8534b1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:08.593464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-16372292-0f5d-44c8-a88a-de355c8534b1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:08.600263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16372292-0f5d-44c8-a88a-de355c8534b1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:08.600725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16372292-0f5d-44c8-a88a-de355c8534b1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:08.601498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16372292-0f5d-44c8-a88a-de355c8534b1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:08.601942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-16372292-0f5d-44c8-a88a-de355c8534b1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:08.739995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-16372292-0f5d-44c8-a88a-de355c8534b1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:25:08.747969 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-16372292-0f5d-44c8-a88a-de355c8534b1 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1698 microversion: 2.1 time: 0.159102 Mar 05 21:25:08.748543 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2869/5699] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:25:08 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:25:09.765630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7cd03e47-17b0-4033-9582-da820c73cba9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:09.766290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7cd03e47-17b0-4033-9582-da820c73cba9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:09.772984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cd03e47-17b0-4033-9582-da820c73cba9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:09.773450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cd03e47-17b0-4033-9582-da820c73cba9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:09.774226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cd03e47-17b0-4033-9582-da820c73cba9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:09.774679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cd03e47-17b0-4033-9582-da820c73cba9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:09.908132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7cd03e47-17b0-4033-9582-da820c73cba9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:25:09.915695 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7cd03e47-17b0-4033-9582-da820c73cba9 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1683 microversion: 2.1 time: 0.154637 Mar 05 21:25:09.916267 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2831/5700] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:25:09 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:25:10.139154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-04cabeae-9be4-44d0-9dcd-7fbd894c456c req-82b38281-3034-4cdd-be6f-efdc418344f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb", "name": "network-vif-unplugged", "status": "completed", "tag": "f62a0af6-b1e1-48c2-b304-059a1b9c84a9"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:25:10.148280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-04cabeae-9be4-44d0-9dcd-7fbd894c456c req-82b38281-3034-4cdd-be6f-efdc418344f1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:10.148737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-04cabeae-9be4-44d0-9dcd-7fbd894c456c req-82b38281-3034-4cdd-be6f-efdc418344f1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:10.160246 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-04cabeae-9be4-44d0-9dcd-7fbd894c456c req-82b38281-3034-4cdd-be6f-efdc418344f1 service nova] Creating event network-vif-unplugged:f62a0af6-b1e1-48c2-b304-059a1b9c84a9 for instance 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb on nch1-master-1 Mar 05 21:25:10.165276 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-04cabeae-9be4-44d0-9dcd-7fbd894c456c req-82b38281-3034-4cdd-be6f-efdc418344f1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029910 Mar 05 21:25:10.166059 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2870/5701] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:25:12.181932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7da10159-43bf-441a-9b09-7f9b3fa48a7b req-5a57bcbb-dd16-460f-9357-8ef9f2fa165c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb", "name": "network-vif-plugged", "status": "completed", "tag": "f62a0af6-b1e1-48c2-b304-059a1b9c84a9"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:25:12.191020 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7da10159-43bf-441a-9b09-7f9b3fa48a7b req-5a57bcbb-dd16-460f-9357-8ef9f2fa165c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:12.191565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7da10159-43bf-441a-9b09-7f9b3fa48a7b req-5a57bcbb-dd16-460f-9357-8ef9f2fa165c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:12.203406 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7da10159-43bf-441a-9b09-7f9b3fa48a7b req-5a57bcbb-dd16-460f-9357-8ef9f2fa165c service nova] Creating event network-vif-plugged:f62a0af6-b1e1-48c2-b304-059a1b9c84a9 for instance 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb on nch1-master-1 Mar 05 21:25:12.208492 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7da10159-43bf-441a-9b09-7f9b3fa48a7b req-5a57bcbb-dd16-460f-9357-8ef9f2fa165c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030260 Mar 05 21:25:12.209203 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2832/5702] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:25:34.103736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c30cda1-fd62-42ed-99a3-6ad81eb45697 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:25:34.104747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3c30cda1-fd62-42ed-99a3-6ad81eb45697 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:34.112671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c30cda1-fd62-42ed-99a3-6ad81eb45697 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:34.113125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c30cda1-fd62-42ed-99a3-6ad81eb45697 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:34.113891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c30cda1-fd62-42ed-99a3-6ad81eb45697 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:34.114332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c30cda1-fd62-42ed-99a3-6ad81eb45697 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:34.162902 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3c30cda1-fd62-42ed-99a3-6ad81eb45697 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "POST /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb/action" status: 200 len: 24566 microversion: 2.1 time: 0.063190 Mar 05 21:25:34.163528 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2871/5703] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:25:34 2022] POST /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb/action => generated 24566 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:25:41.445924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3490813f-604d-4e0b-bff0-44db06fa2568 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:41.447110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3490813f-604d-4e0b-bff0-44db06fa2568 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:41.454311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3490813f-604d-4e0b-bff0-44db06fa2568 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:41.454811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3490813f-604d-4e0b-bff0-44db06fa2568 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:41.455563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3490813f-604d-4e0b-bff0-44db06fa2568 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:41.456259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3490813f-604d-4e0b-bff0-44db06fa2568 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:41.482734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3490813f-604d-4e0b-bff0-44db06fa2568 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:25:41.522500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c8294ab0-c716-435e-b77e-b02d8f799b97 req-7322afd9-cc42-4007-9069-33e5c80136f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb", "tag": "f62a0af6-b1e1-48c2-b304-059a1b9c84a9"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:25:41.533531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c8294ab0-c716-435e-b77e-b02d8f799b97 req-7322afd9-cc42-4007-9069-33e5c80136f6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:41.534250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c8294ab0-c716-435e-b77e-b02d8f799b97 req-7322afd9-cc42-4007-9069-33e5c80136f6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:41.546183 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c8294ab0-c716-435e-b77e-b02d8f799b97 req-7322afd9-cc42-4007-9069-33e5c80136f6 service nova] Creating event network-changed:f62a0af6-b1e1-48c2-b304-059a1b9c84a9 for instance 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb on nch1-master-1 Mar 05 21:25:41.551627 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c8294ab0-c716-435e-b77e-b02d8f799b97 req-7322afd9-cc42-4007-9069-33e5c80136f6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108428 Mar 05 21:25:41.552462 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2872/5704] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:25:41.570800 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3490813f-604d-4e0b-bff0-44db06fa2568 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "DELETE /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 204 len: 0 microversion: 2.1 time: 0.130266 Mar 05 21:25:41.571478 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2833/5705] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:25:41 2022] DELETE /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:25:41.583145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-33ec15f1-a565-4b20-9338-d07687eab871 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:41.583880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-33ec15f1-a565-4b20-9338-d07687eab871 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:41.590420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-33ec15f1-a565-4b20-9338-d07687eab871 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:41.590994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-33ec15f1-a565-4b20-9338-d07687eab871 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:41.591943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-33ec15f1-a565-4b20-9338-d07687eab871 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:41.592386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-33ec15f1-a565-4b20-9338-d07687eab871 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:41.742480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-33ec15f1-a565-4b20-9338-d07687eab871 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:25:41.750870 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-33ec15f1-a565-4b20-9338-d07687eab871 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1689 microversion: 2.1 time: 0.171848 Mar 05 21:25:41.751746 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2873/5706] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:25:41 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:25:42.769929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c7456aa6-1b0e-4558-8542-a4843fef9984 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:42.770570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c7456aa6-1b0e-4558-8542-a4843fef9984 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:42.777229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7456aa6-1b0e-4558-8542-a4843fef9984 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:42.777699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7456aa6-1b0e-4558-8542-a4843fef9984 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:42.778988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7456aa6-1b0e-4558-8542-a4843fef9984 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:42.779448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7456aa6-1b0e-4558-8542-a4843fef9984 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:42.917466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c7456aa6-1b0e-4558-8542-a4843fef9984 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a39fb8a8fe498db9a98166acf96d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be8dce4a165431c8a7279be20d99612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:25:42.925202 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c7456aa6-1b0e-4558-8542-a4843fef9984 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 200 len: 1572 microversion: 2.1 time: 0.159693 Mar 05 21:25:42.925771 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2834/5707] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:25:42 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:25:43.403084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-cb6f93f7-7f65-4b51-b52f-6f94a5823e2a req-5a956203-3f6d-40e8-a070-857cc4862bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb", "name": "network-vif-deleted", "tag": "f62a0af6-b1e1-48c2-b304-059a1b9c84a9"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:25:43.411945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-cb6f93f7-7f65-4b51-b52f-6f94a5823e2a req-5a956203-3f6d-40e8-a070-857cc4862bad service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:43.412395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-cb6f93f7-7f65-4b51-b52f-6f94a5823e2a req-5a956203-3f6d-40e8-a070-857cc4862bad service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:43.429313 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-cb6f93f7-7f65-4b51-b52f-6f94a5823e2a req-5a956203-3f6d-40e8-a070-857cc4862bad service nova] Creating event network-vif-deleted:f62a0af6-b1e1-48c2-b304-059a1b9c84a9 for instance 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb on nch1-master-1 Mar 05 21:25:43.434004 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-cb6f93f7-7f65-4b51-b52f-6f94a5823e2a req-5a956203-3f6d-40e8-a070-857cc4862bad service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034935 Mar 05 21:25:43.435581 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2874/5708] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:25:43.942709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-36cfd502-0f5b-4c5d-a6ef-1957ff712c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:43.943273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-36cfd502-0f5b-4c5d-a6ef-1957ff712c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] [instance: 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:43.949864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36cfd502-0f5b-4c5d-a6ef-1957ff712c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:43.950643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36cfd502-0f5b-4c5d-a6ef-1957ff712c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:43.951470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36cfd502-0f5b-4c5d-a6ef-1957ff712c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:43.951913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-36cfd502-0f5b-4c5d-a6ef-1957ff712c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:43.965197 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-36cfd502-0f5b-4c5d-a6ef-1957ff712c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] HTTP exception thrown: Instance 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb could not be found. Mar 05 21:25:43.965844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-36cfd502-0f5b-4c5d-a6ef-1957ff712c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Returning 404 to user: Instance 04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:25:43.966686 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-36cfd502-0f5b-4c5d-a6ef-1957ff712c6b tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb" status: 404 len: 111 microversion: 2.1 time: 0.028197 Mar 05 21:25:43.967320 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2835/5709] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:25:43 2022] GET /compute/v2.1/servers/04e98d11-c5ec-4a9f-82c1-c2ec18fd56bb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:25:47.351412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c9441f21-43d2-40e1-a03e-a1aa3b70ea44 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] Calling method '.version_select at 0x7fed4f6d08b0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:47.382585 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c9441f21-43d2-40e1-a03e-a1aa3b70ea44 tempest-TestNetworkAdvancedServerOps-1760850558 tempest-TestNetworkAdvancedServerOps-1760850558-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1804714466" status: 202 len: 0 microversion: 2.1 time: 0.036440 Mar 05 21:25:47.383373 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2875/5710] 10.222.0.15 () {58 vars in 1283 bytes} [Sat Mar 5 21:25:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1804714466 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:25:53.027307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f9b414b2-8247-48b6-81ee-b5dc30d6c154 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Action: 'create', calling method: .version_select at 0x7fed4c651700>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-739341305"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:25:53.041419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f9b414b2-8247-48b6-81ee-b5dc30d6c154 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Getting quotas for project 5120b650f5274703a566800555703672. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:25:53.047352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f9b414b2-8247-48b6-81ee-b5dc30d6c154 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Getting quotas for user 8704a9ebe6704f919245a198a6ee3b97 and project 5120b650f5274703a566800555703672. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:25:53.474537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f9b414b2-8247-48b6-81ee-b5dc30d6c154 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Getting quotas for project 5120b650f5274703a566800555703672. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:25:53.479431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-f9b414b2-8247-48b6-81ee-b5dc30d6c154 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Getting quotas for user 8704a9ebe6704f919245a198a6ee3b97 and project 5120b650f5274703a566800555703672. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:25:53.494011 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f9b414b2-8247-48b6-81ee-b5dc30d6c154 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.625666 Mar 05 21:25:53.494622 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2836/5711] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:25:52 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:25:58.788783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-394692282-access_point-273140174", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "6e53b308-bf6c-41c7-88b4-bad6034482db"}], "key_name": "tempest-TestSecurityGroupsBasicOps-739341305", "security_groups": [{"name": "tempest-secgroup_access--1165332685"}, {"name": "tempest-secgroup_general--554949090"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:25:58.980004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] validate_networks() for [('6e53b308-bf6c-41c7-88b4-bad6034482db', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:25:59.361572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:25:59.362045 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:25:59.362652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:25:59.363073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:25:59.363495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:25:59.373168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:59.373626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:59.374559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:25:59.375007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:25:59.392452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Getting quotas for project 5120b650f5274703a566800555703672. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:25:59.398213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Getting quotas for user 8704a9ebe6704f919245a198a6ee3b97 and project 5120b650f5274703a566800555703672. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:25:59.411110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:25:59.413232 ncdv-master-1 devstack@n-api.service[141479]: WARNING nova.utils [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-394692282-access_point-273140174 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-394692282-acc Mar 05 21:25:59.414040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:25:59.461700 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c263f12c-b0c3-49a4-b6c3-3e7c75c65527 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.677414 Mar 05 21:25:59.462536 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2876/5712] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:25:58 2022] POST /compute/v2.1/servers => generated 457 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 21:25:59.474021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9a6f2c69-1ea2-426b-8f52-cfdabbf7e1d8 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:25:59.474648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9a6f2c69-1ea2-426b-8f52-cfdabbf7e1d8 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:25:59.540250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9a6f2c69-1ea2-426b-8f52-cfdabbf7e1d8 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:25:59.553570 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9a6f2c69-1ea2-426b-8f52-cfdabbf7e1d8 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1292 microversion: 2.1 time: 0.083595 Mar 05 21:25:59.554558 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2837/5713] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:25:59 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:00.572094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bcf61c95-6a78-4b4c-8c8b-44fa59801559 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:00.573582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bcf61c95-6a78-4b4c-8c8b-44fa59801559 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:00.583048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bcf61c95-6a78-4b4c-8c8b-44fa59801559 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:00.584004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bcf61c95-6a78-4b4c-8c8b-44fa59801559 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:00.585030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bcf61c95-6a78-4b4c-8c8b-44fa59801559 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:00.585712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bcf61c95-6a78-4b4c-8c8b-44fa59801559 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:00.659972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bcf61c95-6a78-4b4c-8c8b-44fa59801559 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:00.669103 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bcf61c95-6a78-4b4c-8c8b-44fa59801559 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1352 microversion: 2.1 time: 0.101578 Mar 05 21:26:00.679146 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2877/5714] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:00 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:01.687522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ac9dffcb-b930-4c35-8be2-861736f81cee tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:01.688775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ac9dffcb-b930-4c35-8be2-861736f81cee tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:01.697796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac9dffcb-b930-4c35-8be2-861736f81cee tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:01.698566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac9dffcb-b930-4c35-8be2-861736f81cee tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:01.699710 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac9dffcb-b930-4c35-8be2-861736f81cee tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:01.700339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac9dffcb-b930-4c35-8be2-861736f81cee tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:01.947335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ac9dffcb-b930-4c35-8be2-861736f81cee tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:01.956051 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ac9dffcb-b930-4c35-8be2-861736f81cee tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1469 microversion: 2.1 time: 0.273359 Mar 05 21:26:01.957152 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2838/5715] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:01 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1469 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:02.313603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-d92bfe3c-6998-4ecf-9ef3-835e9e1de6d3 req-68972430-5874-4538-8a03-d6a33feb80f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d17919-fc30-4e20-8ed4-1ac942ff45d8", "tag": "f03c0832-9bef-4d28-a16e-8a71329d14d0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:26:02.322150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d92bfe3c-6998-4ecf-9ef3-835e9e1de6d3 req-68972430-5874-4538-8a03-d6a33feb80f2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:02.322601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-d92bfe3c-6998-4ecf-9ef3-835e9e1de6d3 req-68972430-5874-4538-8a03-d6a33feb80f2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:02.336240 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-d92bfe3c-6998-4ecf-9ef3-835e9e1de6d3 req-68972430-5874-4538-8a03-d6a33feb80f2 service nova] Creating event network-changed:f03c0832-9bef-4d28-a16e-8a71329d14d0 for instance 10d17919-fc30-4e20-8ed4-1ac942ff45d8 on nch1-master-1 Mar 05 21:26:02.348572 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-d92bfe3c-6998-4ecf-9ef3-835e9e1de6d3 req-68972430-5874-4538-8a03-d6a33feb80f2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120599 Mar 05 21:26:02.349410 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2878/5716] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:26:02.973676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-be4fb848-5a8e-4e2b-bb84-878e38bb44b9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:02.974301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-be4fb848-5a8e-4e2b-bb84-878e38bb44b9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:02.981016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be4fb848-5a8e-4e2b-bb84-878e38bb44b9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:02.981481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be4fb848-5a8e-4e2b-bb84-878e38bb44b9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:02.982265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be4fb848-5a8e-4e2b-bb84-878e38bb44b9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:02.982716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be4fb848-5a8e-4e2b-bb84-878e38bb44b9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:03.217508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-be4fb848-5a8e-4e2b-bb84-878e38bb44b9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:03.224869 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-be4fb848-5a8e-4e2b-bb84-878e38bb44b9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1469 microversion: 2.1 time: 0.255187 Mar 05 21:26:03.225468 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2839/5717] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:02 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1469 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:04.243194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-53e1d983-01b9-46ff-9bbf-b85afb923316 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:04.243927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-53e1d983-01b9-46ff-9bbf-b85afb923316 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:04.250742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53e1d983-01b9-46ff-9bbf-b85afb923316 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:04.251191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53e1d983-01b9-46ff-9bbf-b85afb923316 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:04.252241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53e1d983-01b9-46ff-9bbf-b85afb923316 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:04.252677 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53e1d983-01b9-46ff-9bbf-b85afb923316 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:04.402425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-53e1d983-01b9-46ff-9bbf-b85afb923316 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:04.410298 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-53e1d983-01b9-46ff-9bbf-b85afb923316 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1469 microversion: 2.1 time: 0.172201 Mar 05 21:26:04.410894 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2879/5718] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:04 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:05.427914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45c09fc3-960f-48b7-976d-7e884b87044b tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:05.428553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-45c09fc3-960f-48b7-976d-7e884b87044b tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:05.435957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45c09fc3-960f-48b7-976d-7e884b87044b tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:05.436432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45c09fc3-960f-48b7-976d-7e884b87044b tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:05.437221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45c09fc3-960f-48b7-976d-7e884b87044b tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:05.437678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45c09fc3-960f-48b7-976d-7e884b87044b tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:05.582461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-45c09fc3-960f-48b7-976d-7e884b87044b tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:05.591851 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45c09fc3-960f-48b7-976d-7e884b87044b tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1469 microversion: 2.1 time: 0.167622 Mar 05 21:26:05.592449 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2840/5719] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:05 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:06.610286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-443e3935-3ae0-4698-9ff2-b552e47a51ba tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:06.611969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-443e3935-3ae0-4698-9ff2-b552e47a51ba tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:06.618403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-443e3935-3ae0-4698-9ff2-b552e47a51ba tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:06.619066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-443e3935-3ae0-4698-9ff2-b552e47a51ba tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:06.619978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-443e3935-3ae0-4698-9ff2-b552e47a51ba tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:06.620428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-443e3935-3ae0-4698-9ff2-b552e47a51ba tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:06.691876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c5a0d9fc-1f18-4fbf-bcef-8adddcb940d8 req-2dd77f05-163c-4259-b91b-1d864dd3c6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d17919-fc30-4e20-8ed4-1ac942ff45d8", "name": "network-vif-plugged", "status": "completed", "tag": "f03c0832-9bef-4d28-a16e-8a71329d14d0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:26:06.699943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c5a0d9fc-1f18-4fbf-bcef-8adddcb940d8 req-2dd77f05-163c-4259-b91b-1d864dd3c6d8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:06.700469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c5a0d9fc-1f18-4fbf-bcef-8adddcb940d8 req-2dd77f05-163c-4259-b91b-1d864dd3c6d8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:06.712064 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c5a0d9fc-1f18-4fbf-bcef-8adddcb940d8 req-2dd77f05-163c-4259-b91b-1d864dd3c6d8 service nova] Creating event network-vif-plugged:f03c0832-9bef-4d28-a16e-8a71329d14d0 for instance 10d17919-fc30-4e20-8ed4-1ac942ff45d8 on nch1-master-1 Mar 05 21:26:06.717784 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c5a0d9fc-1f18-4fbf-bcef-8adddcb940d8 req-2dd77f05-163c-4259-b91b-1d864dd3c6d8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112110 Mar 05 21:26:06.718520 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2880/5720] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:26:06.774188 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-443e3935-3ae0-4698-9ff2-b552e47a51ba tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:06.782696 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-443e3935-3ae0-4698-9ff2-b552e47a51ba tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1469 microversion: 2.1 time: 0.177166 Mar 05 21:26:06.783297 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2841/5721] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:06 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:07.802455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67721914-3e1e-4191-9ace-747f199e8fec tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:07.803074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-67721914-3e1e-4191-9ace-747f199e8fec tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:07.809886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67721914-3e1e-4191-9ace-747f199e8fec tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:07.810335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67721914-3e1e-4191-9ace-747f199e8fec tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:07.811101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67721914-3e1e-4191-9ace-747f199e8fec tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:07.811538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67721914-3e1e-4191-9ace-747f199e8fec tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:07.957783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-67721914-3e1e-4191-9ace-747f199e8fec tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:07.965492 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67721914-3e1e-4191-9ace-747f199e8fec tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1469 microversion: 2.1 time: 0.168084 Mar 05 21:26:07.965979 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2881/5722] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:07 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:08.982287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1bc55f9b-bae5-448e-9c87-46e7d7e6b847 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:08.982955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1bc55f9b-bae5-448e-9c87-46e7d7e6b847 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:08.989758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bc55f9b-bae5-448e-9c87-46e7d7e6b847 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:08.990231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bc55f9b-bae5-448e-9c87-46e7d7e6b847 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:08.991014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bc55f9b-bae5-448e-9c87-46e7d7e6b847 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:08.991469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bc55f9b-bae5-448e-9c87-46e7d7e6b847 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:09.138889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1bc55f9b-bae5-448e-9c87-46e7d7e6b847 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:09.146164 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1bc55f9b-bae5-448e-9c87-46e7d7e6b847 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1640 microversion: 2.1 time: 0.167775 Mar 05 21:26:09.146746 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2842/5723] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:08 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1640 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:09.162505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6b904e2d-bb79-423b-982c-fc87667fb548 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:09.163169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6b904e2d-bb79-423b-982c-fc87667fb548 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:09.170594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b904e2d-bb79-423b-982c-fc87667fb548 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:09.171054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b904e2d-bb79-423b-982c-fc87667fb548 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:09.171986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b904e2d-bb79-423b-982c-fc87667fb548 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:09.172434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6b904e2d-bb79-423b-982c-fc87667fb548 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:09.314740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6b904e2d-bb79-423b-982c-fc87667fb548 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:09.322139 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6b904e2d-bb79-423b-982c-fc87667fb548 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1640 microversion: 2.1 time: 0.163466 Mar 05 21:26:09.322725 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2882/5724] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:09 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1640 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:09.337962 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a7803547-f3df-403b-b079-1adf9d62e7be tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:09.338592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a7803547-f3df-403b-b079-1adf9d62e7be tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:09.344532 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7803547-f3df-403b-b079-1adf9d62e7be tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:09.345000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7803547-f3df-403b-b079-1adf9d62e7be tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:09.345780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7803547-f3df-403b-b079-1adf9d62e7be tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:09.346259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a7803547-f3df-403b-b079-1adf9d62e7be tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:09.575249 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a7803547-f3df-403b-b079-1adf9d62e7be tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1791 microversion: 2.1 time: 0.240868 Mar 05 21:26:09.575982 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2843/5725] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:09 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1791 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:11.461251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-06505931-a0e2-4ffb-b290-f0552a5215ba req-9b271b44-fc5b-446e-92db-f0da36f072f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d17919-fc30-4e20-8ed4-1ac942ff45d8", "tag": "f03c0832-9bef-4d28-a16e-8a71329d14d0"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:26:11.470630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-06505931-a0e2-4ffb-b290-f0552a5215ba req-9b271b44-fc5b-446e-92db-f0da36f072f0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:11.471171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-06505931-a0e2-4ffb-b290-f0552a5215ba req-9b271b44-fc5b-446e-92db-f0da36f072f0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:11.485616 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-06505931-a0e2-4ffb-b290-f0552a5215ba req-9b271b44-fc5b-446e-92db-f0da36f072f0 service nova] Creating event network-changed:f03c0832-9bef-4d28-a16e-8a71329d14d0 for instance 10d17919-fc30-4e20-8ed4-1ac942ff45d8 on nch1-master-1 Mar 05 21:26:11.491038 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-06505931-a0e2-4ffb-b290-f0552a5215ba req-9b271b44-fc5b-446e-92db-f0da36f072f0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033378 Mar 05 21:26:11.492058 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2883/5726] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:26:50.534089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1060432196", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "dd727d48-f2e5-44c6-b54a-84576f525268"}], "key_name": "tempest-TestSecurityGroupsBasicOps-739341305", "security_groups": []}, "os:scheduler_hints": {"different_host": ["10d17919-fc30-4e20-8ed4-1ac942ff45d8"]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:26:50.608568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] validate_networks() for [('dd727d48-f2e5-44c6-b54a-84576f525268', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:26:51.214379 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:26:51.214986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:26:51.215480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:26:51.215968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:26:51.216402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:26:51.226189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:51.226631 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:51.227358 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:51.227842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:51.249517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Getting quotas for project 5120b650f5274703a566800555703672. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:26:51.256069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Getting quotas for user 8704a9ebe6704f919245a198a6ee3b97 and project 5120b650f5274703a566800555703672. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:26:51.269542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:26:51.272129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:26:51.325309 ncdv-master-1 devstack@n-api.service[141478]: ERROR oslo.messaging._drivers.impl_rabbit [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [d7595b8d-dbc1-47cb-8018-a07e7b2b6fe3] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 05 21:26:52.335879 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [d7595b8d-dbc1-47cb-8018-a07e7b2b6fe3] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 57904. Mar 05 21:26:52.341222 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-75563cde-2338-4b3a-aec7-a923dda388c1 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.811404 Mar 05 21:26:52.342085 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2844/5727] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:26:50 2022] POST /compute/v2.1/servers => generated 361 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 21:26:52.356440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-43a1663a-0412-4bef-a69b-94c1d4212658 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:52.357286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-43a1663a-0412-4bef-a69b-94c1d4212658 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:52.413577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-43a1663a-0412-4bef-a69b-94c1d4212658 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:52.420887 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-43a1663a-0412-4bef-a69b-94c1d4212658 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1241 microversion: 2.1 time: 0.068964 Mar 05 21:26:52.421516 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2884/5728] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:52 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:53.439280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-00041182-992c-4c0b-ab32-b1fcd330ac0f tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:53.440562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-00041182-992c-4c0b-ab32-b1fcd330ac0f tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:53.504976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-00041182-992c-4c0b-ab32-b1fcd330ac0f tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:53.512787 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-00041182-992c-4c0b-ab32-b1fcd330ac0f tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1241 microversion: 2.1 time: 0.078506 Mar 05 21:26:53.513423 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2845/5729] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:53 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:54.529575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ef066929-7822-43d3-b8a8-d9ccaed7a164 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:54.530358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ef066929-7822-43d3-b8a8-d9ccaed7a164 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:54.592072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ef066929-7822-43d3-b8a8-d9ccaed7a164 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:54.599328 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ef066929-7822-43d3-b8a8-d9ccaed7a164 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1241 microversion: 2.1 time: 0.074007 Mar 05 21:26:54.599928 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2885/5730] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:54 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:55.621730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-953d7dc9-f05d-42a8-b075-520fdb4dff76 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:55.622830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-953d7dc9-f05d-42a8-b075-520fdb4dff76 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:55.681106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-953d7dc9-f05d-42a8-b075-520fdb4dff76 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:55.688474 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-953d7dc9-f05d-42a8-b075-520fdb4dff76 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1241 microversion: 2.1 time: 0.071449 Mar 05 21:26:55.689056 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2846/5731] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:55 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:56.706129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3d0ff985-9dc9-46b7-9245-454b0046adae tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:56.706798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3d0ff985-9dc9-46b7-9245-454b0046adae tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:56.713699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d0ff985-9dc9-46b7-9245-454b0046adae tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:56.714165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d0ff985-9dc9-46b7-9245-454b0046adae tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:56.714988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d0ff985-9dc9-46b7-9245-454b0046adae tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:56.716086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d0ff985-9dc9-46b7-9245-454b0046adae tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:56.803514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3d0ff985-9dc9-46b7-9245-454b0046adae tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:56.812739 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3d0ff985-9dc9-46b7-9245-454b0046adae tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1299 microversion: 2.1 time: 0.110644 Mar 05 21:26:56.813673 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2886/5732] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:56 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:57.574187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-4acc3fdc-7d81-4ff0-a7db-7e494c2b57cb req-38668067-e0ed-4ddb-b913-fc2e4d7dd81d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afab8183-3c4d-42b1-9594-050d935ff07d", "tag": "40ad3cc4-42a9-40b7-a29e-ca32a68c7c36"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:26:57.586834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4acc3fdc-7d81-4ff0-a7db-7e494c2b57cb req-38668067-e0ed-4ddb-b913-fc2e4d7dd81d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:57.587302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-4acc3fdc-7d81-4ff0-a7db-7e494c2b57cb req-38668067-e0ed-4ddb-b913-fc2e4d7dd81d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:57.601673 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-4acc3fdc-7d81-4ff0-a7db-7e494c2b57cb req-38668067-e0ed-4ddb-b913-fc2e4d7dd81d service nova] Creating event network-changed:40ad3cc4-42a9-40b7-a29e-ca32a68c7c36 for instance afab8183-3c4d-42b1-9594-050d935ff07d on nch2-master-1 Mar 05 21:26:57.613031 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-4acc3fdc-7d81-4ff0-a7db-7e494c2b57cb req-38668067-e0ed-4ddb-b913-fc2e4d7dd81d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043382 Mar 05 21:26:57.614205 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2847/5733] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:26:57.830385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-de2b0299-b498-49ce-8c02-2bd7059c36db tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:57.831091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-de2b0299-b498-49ce-8c02-2bd7059c36db tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:57.837974 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de2b0299-b498-49ce-8c02-2bd7059c36db tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:57.838426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de2b0299-b498-49ce-8c02-2bd7059c36db tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:57.839192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de2b0299-b498-49ce-8c02-2bd7059c36db tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:57.839628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de2b0299-b498-49ce-8c02-2bd7059c36db tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:57.929449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-de2b0299-b498-49ce-8c02-2bd7059c36db tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:57.937222 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-de2b0299-b498-49ce-8c02-2bd7059c36db tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1299 microversion: 2.1 time: 0.110666 Mar 05 21:26:57.937826 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2887/5734] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:57 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:26:58.957232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3ac216f7-3221-4da2-979e-277cf267881a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:26:58.957977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3ac216f7-3221-4da2-979e-277cf267881a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:26:58.964203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ac216f7-3221-4da2-979e-277cf267881a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:58.964669 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ac216f7-3221-4da2-979e-277cf267881a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:58.966115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ac216f7-3221-4da2-979e-277cf267881a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:26:58.966566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ac216f7-3221-4da2-979e-277cf267881a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:26:59.051599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3ac216f7-3221-4da2-979e-277cf267881a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:26:59.058886 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3ac216f7-3221-4da2-979e-277cf267881a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1299 microversion: 2.1 time: 0.106708 Mar 05 21:26:59.060623 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2848/5735] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:26:58 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:00.078303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d1576432-c31a-4029-af30-1bcb6631b041 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:00.078928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d1576432-c31a-4029-af30-1bcb6631b041 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:00.085793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1576432-c31a-4029-af30-1bcb6631b041 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:00.086253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1576432-c31a-4029-af30-1bcb6631b041 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:00.087029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1576432-c31a-4029-af30-1bcb6631b041 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:00.087475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d1576432-c31a-4029-af30-1bcb6631b041 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:00.175301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d1576432-c31a-4029-af30-1bcb6631b041 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:00.182563 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d1576432-c31a-4029-af30-1bcb6631b041 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1299 microversion: 2.1 time: 0.109214 Mar 05 21:27:00.183138 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2888/5736] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:00 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:01.199862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-badc1ce4-9053-4e32-b6a6-b6403c1d7ba9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:01.200520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-badc1ce4-9053-4e32-b6a6-b6403c1d7ba9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:01.207134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-badc1ce4-9053-4e32-b6a6-b6403c1d7ba9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:01.207601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-badc1ce4-9053-4e32-b6a6-b6403c1d7ba9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:01.208414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-badc1ce4-9053-4e32-b6a6-b6403c1d7ba9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:01.208863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-badc1ce4-9053-4e32-b6a6-b6403c1d7ba9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:01.294748 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-badc1ce4-9053-4e32-b6a6-b6403c1d7ba9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:01.304793 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-badc1ce4-9053-4e32-b6a6-b6403c1d7ba9 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1299 microversion: 2.1 time: 0.108974 Mar 05 21:27:01.305376 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2849/5737] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:01 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:02.321882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d2a97413-1930-442a-960f-62b98bda84cd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:02.322623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d2a97413-1930-442a-960f-62b98bda84cd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:02.331199 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2a97413-1930-442a-960f-62b98bda84cd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:02.331655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2a97413-1930-442a-960f-62b98bda84cd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:02.332531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2a97413-1930-442a-960f-62b98bda84cd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:02.332980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d2a97413-1930-442a-960f-62b98bda84cd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:02.425456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d2a97413-1930-442a-960f-62b98bda84cd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:02.432825 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d2a97413-1930-442a-960f-62b98bda84cd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1299 microversion: 2.1 time: 0.114871 Mar 05 21:27:02.433420 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2889/5738] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:02 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:02.450753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8c7d74b0-35fd-4aa8-90bb-fe4fa7996f62 req-a0a6d3f9-e83f-46ea-bd84-7be9e9e115de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afab8183-3c4d-42b1-9594-050d935ff07d", "name": "network-vif-plugged", "status": "completed", "tag": "40ad3cc4-42a9-40b7-a29e-ca32a68c7c36"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:02.460410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8c7d74b0-35fd-4aa8-90bb-fe4fa7996f62 req-a0a6d3f9-e83f-46ea-bd84-7be9e9e115de service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:02.460877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8c7d74b0-35fd-4aa8-90bb-fe4fa7996f62 req-a0a6d3f9-e83f-46ea-bd84-7be9e9e115de service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:02.473010 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8c7d74b0-35fd-4aa8-90bb-fe4fa7996f62 req-a0a6d3f9-e83f-46ea-bd84-7be9e9e115de service nova] Creating event network-vif-plugged:40ad3cc4-42a9-40b7-a29e-ca32a68c7c36 for instance afab8183-3c4d-42b1-9594-050d935ff07d on nch2-master-1 Mar 05 21:27:02.478173 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-8c7d74b0-35fd-4aa8-90bb-fe4fa7996f62 req-a0a6d3f9-e83f-46ea-bd84-7be9e9e115de service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031778 Mar 05 21:27:02.479086 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2850/5739] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:27:03.450937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7da31469-5622-4d2d-bd91-78805551d331 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:03.451494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7da31469-5622-4d2d-bd91-78805551d331 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:03.458343 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7da31469-5622-4d2d-bd91-78805551d331 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:03.458796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7da31469-5622-4d2d-bd91-78805551d331 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:03.459571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7da31469-5622-4d2d-bd91-78805551d331 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:03.460035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7da31469-5622-4d2d-bd91-78805551d331 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:03.551065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7da31469-5622-4d2d-bd91-78805551d331 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:03.560966 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7da31469-5622-4d2d-bd91-78805551d331 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1299 microversion: 2.1 time: 0.114502 Mar 05 21:27:03.561983 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2890/5740] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:03 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:04.578127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-90eb3183-e5b6-4206-b4f5-b2ea5c5cc39d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:04.578847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-90eb3183-e5b6-4206-b4f5-b2ea5c5cc39d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:04.585978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90eb3183-e5b6-4206-b4f5-b2ea5c5cc39d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:04.586454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90eb3183-e5b6-4206-b4f5-b2ea5c5cc39d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:04.587276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90eb3183-e5b6-4206-b4f5-b2ea5c5cc39d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:04.587776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90eb3183-e5b6-4206-b4f5-b2ea5c5cc39d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:04.678903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-90eb3183-e5b6-4206-b4f5-b2ea5c5cc39d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:04.686998 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-90eb3183-e5b6-4206-b4f5-b2ea5c5cc39d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1472 microversion: 2.1 time: 0.113760 Mar 05 21:27:04.687591 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2851/5741] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:04 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1472 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:04.703704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d16b03f2-2365-4acc-aaa9-3eccaefd43a2 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:04.704329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d16b03f2-2365-4acc-aaa9-3eccaefd43a2 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:04.711003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d16b03f2-2365-4acc-aaa9-3eccaefd43a2 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:04.711463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d16b03f2-2365-4acc-aaa9-3eccaefd43a2 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:04.712297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d16b03f2-2365-4acc-aaa9-3eccaefd43a2 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:04.712743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d16b03f2-2365-4acc-aaa9-3eccaefd43a2 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:04.798124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d16b03f2-2365-4acc-aaa9-3eccaefd43a2 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:04.805563 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d16b03f2-2365-4acc-aaa9-3eccaefd43a2 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1472 microversion: 2.1 time: 0.106300 Mar 05 21:27:04.806145 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2891/5742] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:04 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1472 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:04.821921 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e71f883f-c5f7-4ed6-a476-6b02a82e40d8 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:04.822558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e71f883f-c5f7-4ed6-a476-6b02a82e40d8 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:04.828565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e71f883f-c5f7-4ed6-a476-6b02a82e40d8 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:04.828982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e71f883f-c5f7-4ed6-a476-6b02a82e40d8 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:04.829802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e71f883f-c5f7-4ed6-a476-6b02a82e40d8 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:04.830295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e71f883f-c5f7-4ed6-a476-6b02a82e40d8 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:04.913239 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e71f883f-c5f7-4ed6-a476-6b02a82e40d8 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1623 microversion: 2.1 time: 0.094975 Mar 05 21:27:04.913810 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2852/5743] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:04 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1623 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:04.930000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ce932eba-2d35-4a04-aa10-3f175730c070 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:04.930629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ce932eba-2d35-4a04-aa10-3f175730c070 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:04.937234 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce932eba-2d35-4a04-aa10-3f175730c070 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:04.937693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce932eba-2d35-4a04-aa10-3f175730c070 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:04.938468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce932eba-2d35-4a04-aa10-3f175730c070 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:04.938911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce932eba-2d35-4a04-aa10-3f175730c070 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:05.084244 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ce932eba-2d35-4a04-aa10-3f175730c070 tempest-TestSecurityGroupsBasicOps-1885956081 tempest-TestSecurityGroupsBasicOps-1885956081-project-admin] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1910 microversion: 2.1 time: 0.157946 Mar 05 21:27:05.084763 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2892/5744] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:04 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1910 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:05.149184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ad4aac27-7c95-4fa3-820e-6ed163ce75dd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:05.149705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ad4aac27-7c95-4fa3-820e-6ed163ce75dd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:05.156665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad4aac27-7c95-4fa3-820e-6ed163ce75dd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:05.157135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad4aac27-7c95-4fa3-820e-6ed163ce75dd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:05.157920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad4aac27-7c95-4fa3-820e-6ed163ce75dd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:05.158380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ad4aac27-7c95-4fa3-820e-6ed163ce75dd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:05.182896 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ad4aac27-7c95-4fa3-820e-6ed163ce75dd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:27:05.257488 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ad4aac27-7c95-4fa3-820e-6ed163ce75dd tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "DELETE /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 204 len: 0 microversion: 2.1 time: 0.111958 Mar 05 21:27:05.258199 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2853/5745] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:27:05 2022] DELETE /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:27:05.267363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cc591463-c4e0-4304-aa5d-8e52fc66a262 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:05.268026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cc591463-c4e0-4304-aa5d-8e52fc66a262 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:05.273957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc591463-c4e0-4304-aa5d-8e52fc66a262 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:05.274418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc591463-c4e0-4304-aa5d-8e52fc66a262 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:05.275190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc591463-c4e0-4304-aa5d-8e52fc66a262 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:05.275633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc591463-c4e0-4304-aa5d-8e52fc66a262 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:05.367702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cc591463-c4e0-4304-aa5d-8e52fc66a262 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:05.375112 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cc591463-c4e0-4304-aa5d-8e52fc66a262 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1478 microversion: 2.1 time: 0.111691 Mar 05 21:27:05.375916 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2893/5746] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:05 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1478 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:06.393779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-be9ec38e-f6e3-4fbb-93c1-bc4b2481a885 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:06.394504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-be9ec38e-f6e3-4fbb-93c1-bc4b2481a885 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:06.401291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be9ec38e-f6e3-4fbb-93c1-bc4b2481a885 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:06.401765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be9ec38e-f6e3-4fbb-93c1-bc4b2481a885 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:06.402556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be9ec38e-f6e3-4fbb-93c1-bc4b2481a885 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:06.403754 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-be9ec38e-f6e3-4fbb-93c1-bc4b2481a885 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:06.490833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-be9ec38e-f6e3-4fbb-93c1-bc4b2481a885 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:06.499145 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-be9ec38e-f6e3-4fbb-93c1-bc4b2481a885 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 200 len: 1478 microversion: 2.1 time: 0.109841 Mar 05 21:27:06.499739 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2854/5747] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:06 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 1478 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:07.026654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-41bec8d3-c53c-48bc-9897-0d2b3b6862b7 req-650034aa-9d77-4958-8231-30bbc491f009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afab8183-3c4d-42b1-9594-050d935ff07d", "name": "network-vif-deleted", "tag": "40ad3cc4-42a9-40b7-a29e-ca32a68c7c36"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:07.038218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-41bec8d3-c53c-48bc-9897-0d2b3b6862b7 req-650034aa-9d77-4958-8231-30bbc491f009 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:07.038667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-41bec8d3-c53c-48bc-9897-0d2b3b6862b7 req-650034aa-9d77-4958-8231-30bbc491f009 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:07.052673 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-41bec8d3-c53c-48bc-9897-0d2b3b6862b7 req-650034aa-9d77-4958-8231-30bbc491f009 service nova] Creating event network-vif-deleted:40ad3cc4-42a9-40b7-a29e-ca32a68c7c36 for instance afab8183-3c4d-42b1-9594-050d935ff07d on nch2-master-1 Mar 05 21:27:07.059964 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-41bec8d3-c53c-48bc-9897-0d2b3b6862b7 req-650034aa-9d77-4958-8231-30bbc491f009 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036161 Mar 05 21:27:07.060673 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2894/5748] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:27:07.516730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-15cfbc6c-96a2-4027-9148-aa9f329c423d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:07.517371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-15cfbc6c-96a2-4027-9148-aa9f329c423d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: afab8183-3c4d-42b1-9594-050d935ff07d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:07.524141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15cfbc6c-96a2-4027-9148-aa9f329c423d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:07.524614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15cfbc6c-96a2-4027-9148-aa9f329c423d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:07.525397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15cfbc6c-96a2-4027-9148-aa9f329c423d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:07.525850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15cfbc6c-96a2-4027-9148-aa9f329c423d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:07.539764 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-15cfbc6c-96a2-4027-9148-aa9f329c423d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] HTTP exception thrown: Instance afab8183-3c4d-42b1-9594-050d935ff07d could not be found. Mar 05 21:27:07.540368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-15cfbc6c-96a2-4027-9148-aa9f329c423d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Returning 404 to user: Instance afab8183-3c4d-42b1-9594-050d935ff07d could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:27:07.541206 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-15cfbc6c-96a2-4027-9148-aa9f329c423d tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d" status: 404 len: 111 microversion: 2.1 time: 0.028445 Mar 05 21:27:07.541754 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2855/5749] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:07 2022] GET /compute/v2.1/servers/afab8183-3c4d-42b1-9594-050d935ff07d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:27:11.793967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-954db1e8-4c0d-4247-a7d9-06f3ad233fc3 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:11.794580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-954db1e8-4c0d-4247-a7d9-06f3ad233fc3 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:11.796654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a37ad97f-9f09-4c25-a767-c68677005b8a req-b139e089-0344-4383-891f-b911187f69f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d17919-fc30-4e20-8ed4-1ac942ff45d8", "tag": "f03c0832-9bef-4d28-a16e-8a71329d14d0"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:11.801880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-954db1e8-4c0d-4247-a7d9-06f3ad233fc3 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:11.802577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-954db1e8-4c0d-4247-a7d9-06f3ad233fc3 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:11.803364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-954db1e8-4c0d-4247-a7d9-06f3ad233fc3 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:11.804021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-954db1e8-4c0d-4247-a7d9-06f3ad233fc3 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:11.805458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a37ad97f-9f09-4c25-a767-c68677005b8a req-b139e089-0344-4383-891f-b911187f69f7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:11.805931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a37ad97f-9f09-4c25-a767-c68677005b8a req-b139e089-0344-4383-891f-b911187f69f7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:11.818082 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a37ad97f-9f09-4c25-a767-c68677005b8a req-b139e089-0344-4383-891f-b911187f69f7 service nova] Creating event network-changed:f03c0832-9bef-4d28-a16e-8a71329d14d0 for instance 10d17919-fc30-4e20-8ed4-1ac942ff45d8 on nch1-master-1 Mar 05 21:27:11.823380 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a37ad97f-9f09-4c25-a767-c68677005b8a req-b139e089-0344-4383-891f-b911187f69f7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031885 Mar 05 21:27:11.824037 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2856/5750] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:27:11.832020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-954db1e8-4c0d-4247-a7d9-06f3ad233fc3 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:27:11.939808 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-954db1e8-4c0d-4247-a7d9-06f3ad233fc3 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "DELETE /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 204 len: 0 microversion: 2.1 time: 0.150677 Mar 05 21:27:11.940801 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2895/5751] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:27:11 2022] DELETE /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:27:11.950224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f6116aea-2360-476d-b71c-d9e411693466 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:11.951155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f6116aea-2360-476d-b71c-d9e411693466 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:11.957785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6116aea-2360-476d-b71c-d9e411693466 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:11.958257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6116aea-2360-476d-b71c-d9e411693466 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:11.959300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6116aea-2360-476d-b71c-d9e411693466 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:11.959791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f6116aea-2360-476d-b71c-d9e411693466 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:12.226244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f6116aea-2360-476d-b71c-d9e411693466 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:12.235259 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f6116aea-2360-476d-b71c-d9e411693466 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1765 microversion: 2.1 time: 0.289370 Mar 05 21:27:12.235882 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2857/5752] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:11 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1765 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:13.253686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ce557b0a-b6ea-422f-9ed8-a25e33bc2904 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:13.254309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ce557b0a-b6ea-422f-9ed8-a25e33bc2904 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:13.260990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce557b0a-b6ea-422f-9ed8-a25e33bc2904 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:13.261444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce557b0a-b6ea-422f-9ed8-a25e33bc2904 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:13.262601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce557b0a-b6ea-422f-9ed8-a25e33bc2904 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:13.263044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce557b0a-b6ea-422f-9ed8-a25e33bc2904 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:13.411719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ce557b0a-b6ea-422f-9ed8-a25e33bc2904 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8704a9ebe6704f919245a198a6ee3b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5120b650f5274703a566800555703672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:13.420457 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ce557b0a-b6ea-422f-9ed8-a25e33bc2904 tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 200 len: 1646 microversion: 2.1 time: 0.171383 Mar 05 21:27:13.421045 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2896/5753] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:13 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 1646 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:13.839340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a15ceeed-c449-4eec-9aaa-7bdd517b5c66 req-1c853e2e-3060-4718-a215-6c8901249473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d17919-fc30-4e20-8ed4-1ac942ff45d8", "name": "network-vif-deleted", "tag": "f03c0832-9bef-4d28-a16e-8a71329d14d0"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:13.848774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a15ceeed-c449-4eec-9aaa-7bdd517b5c66 req-1c853e2e-3060-4718-a215-6c8901249473 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:13.849229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a15ceeed-c449-4eec-9aaa-7bdd517b5c66 req-1c853e2e-3060-4718-a215-6c8901249473 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:13.859994 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a15ceeed-c449-4eec-9aaa-7bdd517b5c66 req-1c853e2e-3060-4718-a215-6c8901249473 service nova] Creating event network-vif-deleted:f03c0832-9bef-4d28-a16e-8a71329d14d0 for instance 10d17919-fc30-4e20-8ed4-1ac942ff45d8 on nch1-master-1 Mar 05 21:27:13.865166 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a15ceeed-c449-4eec-9aaa-7bdd517b5c66 req-1c853e2e-3060-4718-a215-6c8901249473 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029436 Mar 05 21:27:13.865747 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2858/5754] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:27:14.437676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b922a473-edde-4a6c-a928-a1cdaf3af64a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:14.438246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b922a473-edde-4a6c-a928-a1cdaf3af64a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] [instance: 10d17919-fc30-4e20-8ed4-1ac942ff45d8] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:14.445184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b922a473-edde-4a6c-a928-a1cdaf3af64a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:14.445655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b922a473-edde-4a6c-a928-a1cdaf3af64a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:14.446441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b922a473-edde-4a6c-a928-a1cdaf3af64a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:14.446893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b922a473-edde-4a6c-a928-a1cdaf3af64a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:14.460831 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-b922a473-edde-4a6c-a928-a1cdaf3af64a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] HTTP exception thrown: Instance 10d17919-fc30-4e20-8ed4-1ac942ff45d8 could not be found. Mar 05 21:27:14.461433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b922a473-edde-4a6c-a928-a1cdaf3af64a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Returning 404 to user: Instance 10d17919-fc30-4e20-8ed4-1ac942ff45d8 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:27:14.462265 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b922a473-edde-4a6c-a928-a1cdaf3af64a tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8" status: 404 len: 111 microversion: 2.1 time: 0.029364 Mar 05 21:27:14.462804 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2897/5755] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:14 2022] GET /compute/v2.1/servers/10d17919-fc30-4e20-8ed4-1ac942ff45d8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:27:18.212117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f418bec4-91f7-4447-a882-e29efd4d52fc tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] Calling method '.version_select at 0x7fed4c666670>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:18.231898 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f418bec4-91f7-4447-a882-e29efd4d52fc tempest-TestSecurityGroupsBasicOps-394692282 tempest-TestSecurityGroupsBasicOps-394692282-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-739341305" status: 202 len: 0 microversion: 2.1 time: 0.025193 Mar 05 21:27:18.232499 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2859/5756] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 21:27:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-739341305 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:27:30.736951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2111748873", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:30.784774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] validate_networks() for None {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:27:31.052820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:27:31.053263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:27:31.053808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:27:31.054226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:27:31.054660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:27:31.064171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:31.064754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:31.065633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:31.066106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:31.083754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Getting quotas for project a5616e7d8b824625b15d39e21b034ac9. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:27:31.089048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Getting quotas for user 5f52e0b288f44be19d2af7cd1485a15a and project a5616e7d8b824625b15d39e21b034ac9. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:27:31.102224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:27:31.104542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:27:31.147491 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4c175e63-2ada-4dbc-9d7c-6815bfeb607c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521507 Mar 05 21:27:31.153348 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2898/5757] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:27:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:27:31.159119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eba437e7-8d4e-44f5-85d5-15869d440123 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:31.160509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eba437e7-8d4e-44f5-85d5-15869d440123 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:31.219470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eba437e7-8d4e-44f5-85d5-15869d440123 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f52e0b288f44be19d2af7cd1485a15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5616e7d8b824625b15d39e21b034ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:31.227073 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eba437e7-8d4e-44f5-85d5-15869d440123 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 200 len: 1222 microversion: 2.1 time: 0.071837 Mar 05 21:27:31.227658 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2860/5758] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:31 2022] GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 1222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:32.245462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5eaa06ec-2037-4e7f-919f-855a762afeaa tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:32.246121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5eaa06ec-2037-4e7f-919f-855a762afeaa tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:32.253784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eaa06ec-2037-4e7f-919f-855a762afeaa tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:32.254247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eaa06ec-2037-4e7f-919f-855a762afeaa tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:32.255035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eaa06ec-2037-4e7f-919f-855a762afeaa tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:32.255481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eaa06ec-2037-4e7f-919f-855a762afeaa tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:32.315295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5eaa06ec-2037-4e7f-919f-855a762afeaa tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f52e0b288f44be19d2af7cd1485a15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5616e7d8b824625b15d39e21b034ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:32.322802 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5eaa06ec-2037-4e7f-919f-855a762afeaa tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 200 len: 1280 microversion: 2.1 time: 0.082110 Mar 05 21:27:32.323383 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2899/5759] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:32 2022] GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 1280 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:33.340953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-961f0b74-a030-4ffc-b762-7ccc2fc671f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:33.342213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-961f0b74-a030-4ffc-b762-7ccc2fc671f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:33.349589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-961f0b74-a030-4ffc-b762-7ccc2fc671f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:33.350057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-961f0b74-a030-4ffc-b762-7ccc2fc671f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:33.351061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-961f0b74-a030-4ffc-b762-7ccc2fc671f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:33.351518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-961f0b74-a030-4ffc-b762-7ccc2fc671f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:33.586578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-5cb5f538-42f7-4c46-b9e6-5c246c1f6aac req-1d0a72ed-cdcc-4223-991b-0236d5b76a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e233befc-6686-4fb9-aee7-0b9dd72abfd7", "tag": "5e323d9b-3589-41af-91f2-1d01b0a8d923"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:33.612231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5cb5f538-42f7-4c46-b9e6-5c246c1f6aac req-1d0a72ed-cdcc-4223-991b-0236d5b76a98 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:33.613415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-5cb5f538-42f7-4c46-b9e6-5c246c1f6aac req-1d0a72ed-cdcc-4223-991b-0236d5b76a98 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:33.619622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-961f0b74-a030-4ffc-b762-7ccc2fc671f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f52e0b288f44be19d2af7cd1485a15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5616e7d8b824625b15d39e21b034ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:33.628671 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-5cb5f538-42f7-4c46-b9e6-5c246c1f6aac req-1d0a72ed-cdcc-4223-991b-0236d5b76a98 service nova] Creating event network-changed:5e323d9b-3589-41af-91f2-1d01b0a8d923 for instance e233befc-6686-4fb9-aee7-0b9dd72abfd7 on nch2-master-1 Mar 05 21:27:33.636212 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-961f0b74-a030-4ffc-b762-7ccc2fc671f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 200 len: 1322 microversion: 2.1 time: 0.299023 Mar 05 21:27:33.636973 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2861/5760] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:33 2022] GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:33.637346 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-5cb5f538-42f7-4c46-b9e6-5c246c1f6aac req-1d0a72ed-cdcc-4223-991b-0236d5b76a98 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057477 Mar 05 21:27:33.638674 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2900/5761] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:27:34.653542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f984749d-2e22-4315-849e-44f496ed5e2d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:34.654330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f984749d-2e22-4315-849e-44f496ed5e2d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:34.661156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f984749d-2e22-4315-849e-44f496ed5e2d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:34.661648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f984749d-2e22-4315-849e-44f496ed5e2d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:34.662414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f984749d-2e22-4315-849e-44f496ed5e2d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:34.662873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f984749d-2e22-4315-849e-44f496ed5e2d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:34.797368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f984749d-2e22-4315-849e-44f496ed5e2d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f52e0b288f44be19d2af7cd1485a15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5616e7d8b824625b15d39e21b034ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:34.804828 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f984749d-2e22-4315-849e-44f496ed5e2d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 200 len: 1322 microversion: 2.1 time: 0.155205 Mar 05 21:27:34.805407 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2862/5762] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:34 2022] GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:35.822795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e2ea9146-e209-4636-a947-706f45f1557e tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:35.823508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e2ea9146-e209-4636-a947-706f45f1557e tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:35.830655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2ea9146-e209-4636-a947-706f45f1557e tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:35.831117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2ea9146-e209-4636-a947-706f45f1557e tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:35.831925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2ea9146-e209-4636-a947-706f45f1557e tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:35.832377 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e2ea9146-e209-4636-a947-706f45f1557e tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:35.973653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e2ea9146-e209-4636-a947-706f45f1557e tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f52e0b288f44be19d2af7cd1485a15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5616e7d8b824625b15d39e21b034ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:35.981096 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e2ea9146-e209-4636-a947-706f45f1557e tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 200 len: 1322 microversion: 2.1 time: 0.162595 Mar 05 21:27:35.981684 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2901/5763] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:35 2022] GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:36.997758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-32104bd8-eee5-4aef-b257-1755018c9168 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:36.998627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-32104bd8-eee5-4aef-b257-1755018c9168 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:37.005423 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32104bd8-eee5-4aef-b257-1755018c9168 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:37.005889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32104bd8-eee5-4aef-b257-1755018c9168 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:37.006673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32104bd8-eee5-4aef-b257-1755018c9168 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:37.007128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-32104bd8-eee5-4aef-b257-1755018c9168 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:37.138678 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-32104bd8-eee5-4aef-b257-1755018c9168 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f52e0b288f44be19d2af7cd1485a15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5616e7d8b824625b15d39e21b034ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:37.145934 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-32104bd8-eee5-4aef-b257-1755018c9168 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 200 len: 1322 microversion: 2.1 time: 0.152239 Mar 05 21:27:37.146519 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2863/5764] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:36 2022] GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:38.163222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-611f4f1f-6be5-4668-8302-27a768a14a8a tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:38.163802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-611f4f1f-6be5-4668-8302-27a768a14a8a tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:38.171365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-611f4f1f-6be5-4668-8302-27a768a14a8a tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:38.171874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-611f4f1f-6be5-4668-8302-27a768a14a8a tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:38.172660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-611f4f1f-6be5-4668-8302-27a768a14a8a tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:38.173103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-611f4f1f-6be5-4668-8302-27a768a14a8a tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:38.308918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-611f4f1f-6be5-4668-8302-27a768a14a8a tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f52e0b288f44be19d2af7cd1485a15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5616e7d8b824625b15d39e21b034ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:38.317512 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-611f4f1f-6be5-4668-8302-27a768a14a8a tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 200 len: 1322 microversion: 2.1 time: 0.158307 Mar 05 21:27:38.318092 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2902/5765] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:38 2022] GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:38.770332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5ffe4b98-e344-4167-b44b-4af87ae2d7c0 req-b622982d-e7f8-4b23-99fa-372d6e27e0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e233befc-6686-4fb9-aee7-0b9dd72abfd7", "name": "network-vif-plugged", "status": "completed", "tag": "5e323d9b-3589-41af-91f2-1d01b0a8d923"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:38.781044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5ffe4b98-e344-4167-b44b-4af87ae2d7c0 req-b622982d-e7f8-4b23-99fa-372d6e27e0df service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:38.781520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5ffe4b98-e344-4167-b44b-4af87ae2d7c0 req-b622982d-e7f8-4b23-99fa-372d6e27e0df service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:38.792937 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-5ffe4b98-e344-4167-b44b-4af87ae2d7c0 req-b622982d-e7f8-4b23-99fa-372d6e27e0df service nova] Creating event network-vif-plugged:5e323d9b-3589-41af-91f2-1d01b0a8d923 for instance e233befc-6686-4fb9-aee7-0b9dd72abfd7 on nch2-master-1 Mar 05 21:27:38.798427 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5ffe4b98-e344-4167-b44b-4af87ae2d7c0 req-b622982d-e7f8-4b23-99fa-372d6e27e0df service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031861 Mar 05 21:27:38.799111 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2864/5766] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:27:39.334218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f5ff1ea4-7787-4178-ae82-cb351c90e73f tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:39.334828 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f5ff1ea4-7787-4178-ae82-cb351c90e73f tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:39.341577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f5ff1ea4-7787-4178-ae82-cb351c90e73f tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:39.342038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f5ff1ea4-7787-4178-ae82-cb351c90e73f tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:39.342794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f5ff1ea4-7787-4178-ae82-cb351c90e73f tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:39.343236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f5ff1ea4-7787-4178-ae82-cb351c90e73f tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:39.476613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f5ff1ea4-7787-4178-ae82-cb351c90e73f tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f52e0b288f44be19d2af7cd1485a15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5616e7d8b824625b15d39e21b034ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:39.484509 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f5ff1ea4-7787-4178-ae82-cb351c90e73f tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 200 len: 1322 microversion: 2.1 time: 0.154149 Mar 05 21:27:39.485092 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2903/5767] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:39 2022] GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:40.502580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ee3774ca-37ac-4615-9edd-095b30b5b7f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:40.503306 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ee3774ca-37ac-4615-9edd-095b30b5b7f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:40.509605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee3774ca-37ac-4615-9edd-095b30b5b7f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:40.510080 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee3774ca-37ac-4615-9edd-095b30b5b7f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:40.510869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee3774ca-37ac-4615-9edd-095b30b5b7f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:40.511330 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee3774ca-37ac-4615-9edd-095b30b5b7f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:40.646960 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ee3774ca-37ac-4615-9edd-095b30b5b7f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f52e0b288f44be19d2af7cd1485a15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5616e7d8b824625b15d39e21b034ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:40.654379 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ee3774ca-37ac-4615-9edd-095b30b5b7f1 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 200 len: 1471 microversion: 2.1 time: 0.157211 Mar 05 21:27:40.654957 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2865/5768] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:40 2022] GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:40.723139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-45e1f5a2-a0b4-4b2d-9e5b-68d4aed7bd7e tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Calling method '.version_select at 0x7fed4f65bc10>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:40.788492 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-45e1f5a2-a0b4-4b2d-9e5b-68d4aed7bd7e tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/db0f6c05572b4b42884e489f911e746e" status: 200 len: 371 microversion: 2.1 time: 0.119627 Mar 05 21:27:40.789081 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2904/5769] 10.222.0.15 () {58 vars in 1241 bytes} [Sat Mar 5 21:27:40 2022] GET /compute/v2.1/os-quota-sets/db0f6c05572b4b42884e489f911e746e => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:27:40.799579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c58ea34-cd80-4e4d-b31b-35de5cd44b95 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-17849144", "id": 227474837, "os-flavor-access:is_public": "True"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:40.801185 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:27:40.801185 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 21:27:40.816756 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4c58ea34-cd80-4e4d-b31b-35de5cd44b95 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.020878 Mar 05 21:27:40.817349 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2866/5770] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:27:40 2022] POST /compute/v2.1/flavors => generated 433 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:27:40.828516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "227474837"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:40.829532 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:40.835437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:40.835925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:40.836694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:40.837133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:40.920095 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cdbfb5b80ebe43ebaec993db722ac8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0f6c05572b4b42884e489f911e746e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:40.926443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-17849144 {{(pid=141479) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 21:27:40.932790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:40.933241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:40.934042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:40.934485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:40.956391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Getting quotas for project a5616e7d8b824625b15d39e21b034ac9. Resources: {'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:27:40.961374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Getting quotas for user 5f52e0b288f44be19d2af7cd1485a15a and project a5616e7d8b824625b15d39e21b034ac9. Resources: {'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:27:40.974066 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.compute.api [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] ram quota exceeded for db0f6c05572b4b42884e489f911e746e, tried to resize instance. Mar 05 21:27:40.974613 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Mar 05 21:27:40.975216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:27:40.976101 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-027f8d8a-86d8-44a8-85c9-ead8dc4996ec tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7/action" status: 403 len: 118 microversion: 2.1 time: 0.152069 Mar 05 21:27:40.976698 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2905/5771] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:27:40 2022] POST /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7/action => generated 118 bytes in 153 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:27:40.985837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-caf84c46-5211-4051-ad43-23733791300b tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:40.986604 ncdv-master-1 devstack@n-api.service[141478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:27:40.986604 ncdv-master-1 devstack@n-api.service[141478]: warnings.warn(msg) Mar 05 21:27:41.003487 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-caf84c46-5211-4051-ad43-23733791300b tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/227474837" status: 202 len: 0 microversion: 2.1 time: 0.022029 Mar 05 21:27:41.004177 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2867/5772] 10.222.0.15 () {58 vars in 1157 bytes} [Sat Mar 5 21:27:40 2022] DELETE /compute/v2.1/flavors/227474837 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:27:41.012906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e8448589-c722-4178-b779-0703f9eb2eb2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:41.036015 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e8448589-c722-4178-b779-0703f9eb2eb2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027379 Mar 05 21:27:41.036604 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2906/5773] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 21:27:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:41.053259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-629cff1c-080f-42f0-8f5b-0b2caefa7dc7 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Calling method '.version_select at 0x7fed4c69a1f0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:41.130374 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-629cff1c-080f-42f0-8f5b-0b2caefa7dc7 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] 10.222.0.15 "GET /compute/v2.1/os-quota-sets/db0f6c05572b4b42884e489f911e746e" status: 200 len: 371 microversion: 2.1 time: 0.080490 Mar 05 21:27:41.131072 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2868/5774] 10.222.0.15 () {58 vars in 1241 bytes} [Sat Mar 5 21:27:41 2022] GET /compute/v2.1/os-quota-sets/db0f6c05572b4b42884e489f911e746e => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:27:41.141961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-609be299-ec44-4035-9ec3-e59e9be8a971 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1742392800", "id": 2126485236, "os-flavor-access:is_public": "True"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:41.143734 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:27:41.143734 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 21:27:41.160598 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-609be299-ec44-4035-9ec3-e59e9be8a971 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.023108 Mar 05 21:27:41.161349 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2907/5775] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:27:41 2022] POST /compute/v2.1/flavors => generated 437 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:27:41.175846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2126485236"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:41.176895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:41.183280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:41.184070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:41.185450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:41.186235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:41.282692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cdbfb5b80ebe43ebaec993db722ac8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0f6c05572b4b42884e489f911e746e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:41.289533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1742392800 {{(pid=141478) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 21:27:41.296134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:41.296627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:41.297439 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:41.297885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:41.319773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Getting quotas for project a5616e7d8b824625b15d39e21b034ac9. Resources: {'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:27:41.324946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Getting quotas for user 5f52e0b288f44be19d2af7cd1485a15a and project a5616e7d8b824625b15d39e21b034ac9. Resources: {'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:27:41.339396 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.compute.api [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] cores quota exceeded for db0f6c05572b4b42884e489f911e746e, tried to resize instance. Mar 05 21:27:41.339984 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Mar 05 21:27:41.340597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:27:41.342211 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5d9e7e0f-b90f-463d-8a3e-cd6bb22615c2 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] 10.222.0.15 "POST /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7/action" status: 403 len: 113 microversion: 2.1 time: 0.172502 Mar 05 21:27:41.343172 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2869/5776] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:27:41 2022] POST /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7/action => generated 113 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:27:41.354409 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-263ebdb0-8a7c-4cbc-81a1-4ace4c5544d1 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:41.355201 ncdv-master-1 devstack@n-api.service[141479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 21:27:41.355201 ncdv-master-1 devstack@n-api.service[141479]: warnings.warn(msg) Mar 05 21:27:41.373869 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-263ebdb0-8a7c-4cbc-81a1-4ace4c5544d1 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] 10.222.0.15 "DELETE /compute/v2.1/flavors/2126485236" status: 202 len: 0 microversion: 2.1 time: 0.024471 Mar 05 21:27:41.374497 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2908/5777] 10.222.0.15 () {58 vars in 1160 bytes} [Sat Mar 5 21:27:41 2022] DELETE /compute/v2.1/flavors/2126485236 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:27:41.383054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74e9c17d-246e-456d-8d05-d6f6422525d7 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:41.406693 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-74e9c17d-246e-456d-8d05-d6f6422525d7 tempest-ServersAdminNegativeTestJSON-1293616461 tempest-ServersAdminNegativeTestJSON-1293616461-project-admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026887 Mar 05 21:27:41.407691 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2870/5778] 10.222.0.15 () {58 vars in 1145 bytes} [Sat Mar 5 21:27:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:41.425966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9fa9ef28-e411-4993-ba6c-a6cd58f6e318 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:41.426836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9fa9ef28-e411-4993-ba6c-a6cd58f6e318 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:41.435804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fa9ef28-e411-4993-ba6c-a6cd58f6e318 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:41.436261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fa9ef28-e411-4993-ba6c-a6cd58f6e318 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:41.437040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fa9ef28-e411-4993-ba6c-a6cd58f6e318 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:41.437481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9fa9ef28-e411-4993-ba6c-a6cd58f6e318 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:41.467731 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9fa9ef28-e411-4993-ba6c-a6cd58f6e318 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:27:41.546638 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9fa9ef28-e411-4993-ba6c-a6cd58f6e318 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 204 len: 0 microversion: 2.1 time: 0.125536 Mar 05 21:27:41.547349 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2909/5779] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:27:41 2022] DELETE /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:27:41.557404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f114affa-af37-4934-b856-cd2d7d55a76b tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:41.558157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f114affa-af37-4934-b856-cd2d7d55a76b tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:41.565562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f114affa-af37-4934-b856-cd2d7d55a76b tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:41.566028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f114affa-af37-4934-b856-cd2d7d55a76b tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:41.566845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f114affa-af37-4934-b856-cd2d7d55a76b tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:41.567294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f114affa-af37-4934-b856-cd2d7d55a76b tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:41.710829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f114affa-af37-4934-b856-cd2d7d55a76b tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f52e0b288f44be19d2af7cd1485a15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5616e7d8b824625b15d39e21b034ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:41.719513 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f114affa-af37-4934-b856-cd2d7d55a76b tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 200 len: 1477 microversion: 2.1 time: 0.167545 Mar 05 21:27:41.720501 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2871/5780] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:41 2022] GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 1477 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:27:42.737625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0e00e64-e135-4161-808f-26de37e5dc1c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:42.738344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a0e00e64-e135-4161-808f-26de37e5dc1c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:42.745113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0e00e64-e135-4161-808f-26de37e5dc1c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:42.745578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0e00e64-e135-4161-808f-26de37e5dc1c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:42.746359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0e00e64-e135-4161-808f-26de37e5dc1c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:42.746809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0e00e64-e135-4161-808f-26de37e5dc1c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:42.889779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a0e00e64-e135-4161-808f-26de37e5dc1c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f52e0b288f44be19d2af7cd1485a15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5616e7d8b824625b15d39e21b034ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:42.897753 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0e00e64-e135-4161-808f-26de37e5dc1c tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 200 len: 1477 microversion: 2.1 time: 0.164390 Mar 05 21:27:42.898337 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2910/5781] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:42 2022] GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 1477 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:43.538821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-c0478a24-e779-42c3-b6bc-20056a15f6f1 req-ab32dd5b-3ce6-49aa-99df-d830edc5e572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e233befc-6686-4fb9-aee7-0b9dd72abfd7", "name": "network-vif-deleted", "tag": "5e323d9b-3589-41af-91f2-1d01b0a8d923"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:43.552540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c0478a24-e779-42c3-b6bc-20056a15f6f1 req-ab32dd5b-3ce6-49aa-99df-d830edc5e572 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:43.553002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c0478a24-e779-42c3-b6bc-20056a15f6f1 req-ab32dd5b-3ce6-49aa-99df-d830edc5e572 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:43.565718 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-c0478a24-e779-42c3-b6bc-20056a15f6f1 req-ab32dd5b-3ce6-49aa-99df-d830edc5e572 service nova] Creating event network-vif-deleted:5e323d9b-3589-41af-91f2-1d01b0a8d923 for instance e233befc-6686-4fb9-aee7-0b9dd72abfd7 on nch2-master-1 Mar 05 21:27:43.572725 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-c0478a24-e779-42c3-b6bc-20056a15f6f1 req-ab32dd5b-3ce6-49aa-99df-d830edc5e572 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037759 Mar 05 21:27:43.573342 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2872/5782] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:27:43.916254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a2b4c91e-5b97-4b70-9946-3bd5738c3e70 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:43.916862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a2b4c91e-5b97-4b70-9946-3bd5738c3e70 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:43.925822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2b4c91e-5b97-4b70-9946-3bd5738c3e70 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:43.926288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2b4c91e-5b97-4b70-9946-3bd5738c3e70 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:43.927103 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2b4c91e-5b97-4b70-9946-3bd5738c3e70 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:43.927543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2b4c91e-5b97-4b70-9946-3bd5738c3e70 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:43.959570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2b4c91e-5b97-4b70-9946-3bd5738c3e70 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:43.960030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2b4c91e-5b97-4b70-9946-3bd5738c3e70 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:43.960408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-a2b4c91e-5b97-4b70-9946-3bd5738c3e70 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lazy-loading 'fault' on Instance uuid e233befc-6686-4fb9-aee7-0b9dd72abfd7 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:27:44.003563 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a2b4c91e-5b97-4b70-9946-3bd5738c3e70 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f52e0b288f44be19d2af7cd1485a15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5616e7d8b824625b15d39e21b034ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:44.011101 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a2b4c91e-5b97-4b70-9946-3bd5738c3e70 tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 200 len: 1312 microversion: 2.1 time: 0.099049 Mar 05 21:27:44.012579 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2911/5783] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:43 2022] GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:45.030643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0c957cb6-1e67-44f5-8383-ad0b2302824d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:45.031368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0c957cb6-1e67-44f5-8383-ad0b2302824d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] [instance: e233befc-6686-4fb9-aee7-0b9dd72abfd7] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:45.038383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c957cb6-1e67-44f5-8383-ad0b2302824d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:45.038854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c957cb6-1e67-44f5-8383-ad0b2302824d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:45.039639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c957cb6-1e67-44f5-8383-ad0b2302824d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:45.040119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c957cb6-1e67-44f5-8383-ad0b2302824d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:45.053476 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-0c957cb6-1e67-44f5-8383-ad0b2302824d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] HTTP exception thrown: Instance e233befc-6686-4fb9-aee7-0b9dd72abfd7 could not be found. Mar 05 21:27:45.054111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0c957cb6-1e67-44f5-8383-ad0b2302824d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] Returning 404 to user: Instance e233befc-6686-4fb9-aee7-0b9dd72abfd7 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:27:45.054954 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0c957cb6-1e67-44f5-8383-ad0b2302824d tempest-ServersAdminNegativeTestJSON-1247174446 tempest-ServersAdminNegativeTestJSON-1247174446-project] 10.222.0.15 "GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7" status: 404 len: 111 microversion: 2.1 time: 0.029611 Mar 05 21:27:45.055493 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2873/5784] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:45 2022] GET /compute/v2.1/servers/e233befc-6686-4fb9-aee7-0b9dd72abfd7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:27:47.741870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1028093069", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "8a230d4b-f3ce-411f-b74c-67f2bc5403dd"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:47.791922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] validate_networks() for [('8a230d4b-f3ce-411f-b74c-67f2bc5403dd', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:27:48.127954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:27:48.128390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:27:48.128869 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:27:48.129289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:27:48.129707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:27:48.138979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:48.139443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:48.140297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:48.140787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:48.158106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Getting quotas for project a389d80df2ec4570aa76785c5c066c64. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:27:48.163298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Getting quotas for user 84b47c6e3eb64aa3a03678c0d74ac527 and project a389d80df2ec4570aa76785c5c066c64. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:27:48.176516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:27:48.178762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:27:48.222928 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e30f8e25-5dd2-4b24-8152-f1846e06fef9 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594816 Mar 05 21:27:48.223620 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2912/5785] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:27:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:27:48.234859 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-877b65ef-5710-4eac-ba9b-9968804b6d94 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:48.235496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-877b65ef-5710-4eac-ba9b-9968804b6d94 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:48.288128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-877b65ef-5710-4eac-ba9b-9968804b6d94 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:48.296249 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-877b65ef-5710-4eac-ba9b-9968804b6d94 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1215 microversion: 2.1 time: 0.066408 Mar 05 21:27:48.296821 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2874/5786] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:48 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:49.315245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ef44822-4bb1-4c08-821f-57228715eb36 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:49.315934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ef44822-4bb1-4c08-821f-57228715eb36 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:49.323715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ef44822-4bb1-4c08-821f-57228715eb36 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:49.324172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ef44822-4bb1-4c08-821f-57228715eb36 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:49.324958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ef44822-4bb1-4c08-821f-57228715eb36 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:49.325466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ef44822-4bb1-4c08-821f-57228715eb36 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:49.387762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9ef44822-4bb1-4c08-821f-57228715eb36 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:49.396124 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ef44822-4bb1-4c08-821f-57228715eb36 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1273 microversion: 2.1 time: 0.086826 Mar 05 21:27:49.396703 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2913/5787] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:49 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:50.381121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d92820ea-69bc-4369-af6b-5cb022b7c1bf req-e5a6a9d3-a1ee-4c96-b581-94071f612dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c14a1a2d-d30c-4a89-ace1-235cd5466b7d", "tag": "ea65bb67-e86a-453a-a090-f2c921f98fbc"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:50.390110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d92820ea-69bc-4369-af6b-5cb022b7c1bf req-e5a6a9d3-a1ee-4c96-b581-94071f612dfa service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:50.390800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d92820ea-69bc-4369-af6b-5cb022b7c1bf req-e5a6a9d3-a1ee-4c96-b581-94071f612dfa service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:50.402270 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d92820ea-69bc-4369-af6b-5cb022b7c1bf req-e5a6a9d3-a1ee-4c96-b581-94071f612dfa service nova] Creating event network-changed:ea65bb67-e86a-453a-a090-f2c921f98fbc for instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d on nch2-master-1 Mar 05 21:27:50.408122 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d92820ea-69bc-4369-af6b-5cb022b7c1bf req-e5a6a9d3-a1ee-4c96-b581-94071f612dfa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030566 Mar 05 21:27:50.408983 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2875/5788] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:27:50.414256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9980b5b7-7d7c-4c10-af4a-3b51681b923d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:50.415481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9980b5b7-7d7c-4c10-af4a-3b51681b923d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:50.424161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9980b5b7-7d7c-4c10-af4a-3b51681b923d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:50.424649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9980b5b7-7d7c-4c10-af4a-3b51681b923d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:50.425464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9980b5b7-7d7c-4c10-af4a-3b51681b923d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:50.425904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9980b5b7-7d7c-4c10-af4a-3b51681b923d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:50.561395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9980b5b7-7d7c-4c10-af4a-3b51681b923d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:50.569300 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9980b5b7-7d7c-4c10-af4a-3b51681b923d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1315 microversion: 2.1 time: 0.159338 Mar 05 21:27:50.569885 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2914/5789] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:50 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:51.587893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9f3e5839-4e7a-42e5-be67-d8a930ff4243 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:51.588622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9f3e5839-4e7a-42e5-be67-d8a930ff4243 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:51.595933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f3e5839-4e7a-42e5-be67-d8a930ff4243 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:51.596413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f3e5839-4e7a-42e5-be67-d8a930ff4243 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:51.597204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f3e5839-4e7a-42e5-be67-d8a930ff4243 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:51.597662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f3e5839-4e7a-42e5-be67-d8a930ff4243 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:51.734509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9f3e5839-4e7a-42e5-be67-d8a930ff4243 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:51.741874 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9f3e5839-4e7a-42e5-be67-d8a930ff4243 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1315 microversion: 2.1 time: 0.159233 Mar 05 21:27:51.742455 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2876/5790] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:51 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:52.758483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d55655e-4f50-411a-8a15-ebb129cc686d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:52.759107 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7d55655e-4f50-411a-8a15-ebb129cc686d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:52.766651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d55655e-4f50-411a-8a15-ebb129cc686d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:52.767109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d55655e-4f50-411a-8a15-ebb129cc686d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:52.767924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d55655e-4f50-411a-8a15-ebb129cc686d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:52.768371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d55655e-4f50-411a-8a15-ebb129cc686d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:52.918185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d55655e-4f50-411a-8a15-ebb129cc686d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:52.927460 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7d55655e-4f50-411a-8a15-ebb129cc686d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1315 microversion: 2.1 time: 0.172839 Mar 05 21:27:52.928367 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2915/5791] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:52 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:53.944951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-95138ee2-3e0f-49be-a8c5-8ffc7f71df61 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:53.945733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-95138ee2-3e0f-49be-a8c5-8ffc7f71df61 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:53.953394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95138ee2-3e0f-49be-a8c5-8ffc7f71df61 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:53.953862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95138ee2-3e0f-49be-a8c5-8ffc7f71df61 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:53.954650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95138ee2-3e0f-49be-a8c5-8ffc7f71df61 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:53.955102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-95138ee2-3e0f-49be-a8c5-8ffc7f71df61 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:54.349949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-95138ee2-3e0f-49be-a8c5-8ffc7f71df61 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:54.357431 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-95138ee2-3e0f-49be-a8c5-8ffc7f71df61 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1315 microversion: 2.1 time: 0.416175 Mar 05 21:27:54.357988 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2877/5792] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:53 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:54.697038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-af199f46-13a7-4fd4-8759-db535f4662e1 req-c97b3005-76b0-438e-bece-29777b3bd2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14a1a2d-d30c-4a89-ace1-235cd5466b7d", "name": "network-vif-plugged", "status": "completed", "tag": "ea65bb67-e86a-453a-a090-f2c921f98fbc"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:54.706566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-af199f46-13a7-4fd4-8759-db535f4662e1 req-c97b3005-76b0-438e-bece-29777b3bd2b4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:54.707019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-af199f46-13a7-4fd4-8759-db535f4662e1 req-c97b3005-76b0-438e-bece-29777b3bd2b4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:54.718241 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-af199f46-13a7-4fd4-8759-db535f4662e1 req-c97b3005-76b0-438e-bece-29777b3bd2b4 service nova] Creating event network-vif-plugged:ea65bb67-e86a-453a-a090-f2c921f98fbc for instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d on nch2-master-1 Mar 05 21:27:54.723317 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-af199f46-13a7-4fd4-8759-db535f4662e1 req-c97b3005-76b0-438e-bece-29777b3bd2b4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030133 Mar 05 21:27:54.723951 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2916/5793] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:27:55.374290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d9038993-e338-4d9e-a832-a9c51acb42eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:55.374958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d9038993-e338-4d9e-a832-a9c51acb42eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:55.382037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d9038993-e338-4d9e-a832-a9c51acb42eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:55.382511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d9038993-e338-4d9e-a832-a9c51acb42eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:55.383304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d9038993-e338-4d9e-a832-a9c51acb42eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:55.383788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d9038993-e338-4d9e-a832-a9c51acb42eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:55.518698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d9038993-e338-4d9e-a832-a9c51acb42eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:55.526063 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d9038993-e338-4d9e-a832-a9c51acb42eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1315 microversion: 2.1 time: 0.155773 Mar 05 21:27:55.526646 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2878/5794] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:55 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:56.545128 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e6bdacf8-a859-41c3-ab62-70eacf80832c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:56.545834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e6bdacf8-a859-41c3-ab62-70eacf80832c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:56.552080 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6bdacf8-a859-41c3-ab62-70eacf80832c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:56.552532 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6bdacf8-a859-41c3-ab62-70eacf80832c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:56.553297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6bdacf8-a859-41c3-ab62-70eacf80832c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:56.553739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6bdacf8-a859-41c3-ab62-70eacf80832c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:56.685226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e6bdacf8-a859-41c3-ab62-70eacf80832c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:56.692692 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e6bdacf8-a859-41c3-ab62-70eacf80832c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1503 microversion: 2.1 time: 0.153344 Mar 05 21:27:56.693276 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2917/5795] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:56 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:27:56.709590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:27:56.710572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:56.717578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:56.718038 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:56.718815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:56.719266 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:56.745585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:56.752343 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Old instance type m1.heat2, new instance type m1.heat {{(pid=141478) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 21:27:56.758349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:27:56.758782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:27:56.759273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:27:56.759715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:27:56.760145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:27:56.820364 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3b989c9f-b991-4b8c-b66d-c9ddb54b7c16 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "POST /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d/action" status: 202 len: 0 microversion: 2.1 time: 0.114560 Mar 05 21:27:56.821008 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2879/5796] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:27:56 2022] POST /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:27:56.829308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ed46bdeb-30f6-4c25-89d2-1c63b33a6e50 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:56.829927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ed46bdeb-30f6-4c25-89d2-1c63b33a6e50 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:56.835898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ed46bdeb-30f6-4c25-89d2-1c63b33a6e50 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:56.836364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ed46bdeb-30f6-4c25-89d2-1c63b33a6e50 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:56.837132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ed46bdeb-30f6-4c25-89d2-1c63b33a6e50 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:56.837570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ed46bdeb-30f6-4c25-89d2-1c63b33a6e50 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:56.975041 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ed46bdeb-30f6-4c25-89d2-1c63b33a6e50 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:56.983301 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ed46bdeb-30f6-4c25-89d2-1c63b33a6e50 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1512 microversion: 2.1 time: 0.157843 Mar 05 21:27:56.983930 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2918/5797] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:56 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:58.002366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-791b5e0a-6452-43f7-b515-e8ee32bd10a7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:58.002987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-791b5e0a-6452-43f7-b515-e8ee32bd10a7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:58.009674 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-791b5e0a-6452-43f7-b515-e8ee32bd10a7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:58.010145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-791b5e0a-6452-43f7-b515-e8ee32bd10a7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:58.010926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-791b5e0a-6452-43f7-b515-e8ee32bd10a7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:58.011376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-791b5e0a-6452-43f7-b515-e8ee32bd10a7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:58.151908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-791b5e0a-6452-43f7-b515-e8ee32bd10a7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:58.160044 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-791b5e0a-6452-43f7-b515-e8ee32bd10a7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1512 microversion: 2.1 time: 0.163456 Mar 05 21:27:58.160630 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2880/5798] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:57 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:27:59.177375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bb862010-e85b-46e8-af6e-f4f63763cbf7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:27:59.177929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bb862010-e85b-46e8-af6e-f4f63763cbf7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:27:59.185907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb862010-e85b-46e8-af6e-f4f63763cbf7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:59.186361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb862010-e85b-46e8-af6e-f4f63763cbf7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:59.187129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb862010-e85b-46e8-af6e-f4f63763cbf7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:27:59.187568 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb862010-e85b-46e8-af6e-f4f63763cbf7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:27:59.331067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb862010-e85b-46e8-af6e-f4f63763cbf7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:27:59.338595 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bb862010-e85b-46e8-af6e-f4f63763cbf7 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.165199 Mar 05 21:27:59.339177 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2919/5799] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:27:59 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:00.357632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0aaf0bc0-d76e-46d5-91b4-5367d5a7016f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:00.358268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0aaf0bc0-d76e-46d5-91b4-5367d5a7016f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:00.364675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0aaf0bc0-d76e-46d5-91b4-5367d5a7016f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:00.365149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0aaf0bc0-d76e-46d5-91b4-5367d5a7016f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:00.365940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0aaf0bc0-d76e-46d5-91b4-5367d5a7016f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:00.366405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0aaf0bc0-d76e-46d5-91b4-5367d5a7016f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:00.501747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0aaf0bc0-d76e-46d5-91b4-5367d5a7016f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:00.509196 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0aaf0bc0-d76e-46d5-91b4-5367d5a7016f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.156296 Mar 05 21:28:00.509770 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2881/5800] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:00 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:01.528008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9b9622a8-4897-4e9e-8611-a138ce46885b tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:01.528654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9b9622a8-4897-4e9e-8611-a138ce46885b tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:01.535341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9b9622a8-4897-4e9e-8611-a138ce46885b tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:01.535833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9b9622a8-4897-4e9e-8611-a138ce46885b tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:01.536603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9b9622a8-4897-4e9e-8611-a138ce46885b tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:01.537044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9b9622a8-4897-4e9e-8611-a138ce46885b tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:01.667315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9b9622a8-4897-4e9e-8611-a138ce46885b tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:01.675361 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9b9622a8-4897-4e9e-8611-a138ce46885b tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.151574 Mar 05 21:28:01.675982 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2920/5801] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:01 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:02.691507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-443b2517-ee68-43e5-90e6-bb9250b96599 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:02.692172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-443b2517-ee68-43e5-90e6-bb9250b96599 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:02.699001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-443b2517-ee68-43e5-90e6-bb9250b96599 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:02.699476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-443b2517-ee68-43e5-90e6-bb9250b96599 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:02.700814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-443b2517-ee68-43e5-90e6-bb9250b96599 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:02.701757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-443b2517-ee68-43e5-90e6-bb9250b96599 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:02.833613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-443b2517-ee68-43e5-90e6-bb9250b96599 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:02.841111 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-443b2517-ee68-43e5-90e6-bb9250b96599 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.153534 Mar 05 21:28:02.841772 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2882/5802] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:02 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:03.858778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-186650f8-d108-4c1e-9a74-afde1eca246e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:03.859413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-186650f8-d108-4c1e-9a74-afde1eca246e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:03.866298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-186650f8-d108-4c1e-9a74-afde1eca246e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:03.866761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-186650f8-d108-4c1e-9a74-afde1eca246e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:03.867538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-186650f8-d108-4c1e-9a74-afde1eca246e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:03.868018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-186650f8-d108-4c1e-9a74-afde1eca246e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:04.004166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-186650f8-d108-4c1e-9a74-afde1eca246e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:04.011405 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-186650f8-d108-4c1e-9a74-afde1eca246e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.157141 Mar 05 21:28:04.012012 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2921/5803] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:03 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:05.028446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8e30dca9-5e55-4f63-b5cc-2c103429ba82 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:05.029704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8e30dca9-5e55-4f63-b5cc-2c103429ba82 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:05.036586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e30dca9-5e55-4f63-b5cc-2c103429ba82 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:05.037067 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e30dca9-5e55-4f63-b5cc-2c103429ba82 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:05.037854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e30dca9-5e55-4f63-b5cc-2c103429ba82 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:05.038311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8e30dca9-5e55-4f63-b5cc-2c103429ba82 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:05.175663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8e30dca9-5e55-4f63-b5cc-2c103429ba82 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:05.183046 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8e30dca9-5e55-4f63-b5cc-2c103429ba82 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.158576 Mar 05 21:28:05.183617 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2883/5804] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:05 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:06.201845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-45475cbb-06bb-461e-9e5c-2c425950aa3f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:06.202374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-45475cbb-06bb-461e-9e5c-2c425950aa3f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:06.209237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45475cbb-06bb-461e-9e5c-2c425950aa3f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:06.209694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45475cbb-06bb-461e-9e5c-2c425950aa3f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:06.210482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45475cbb-06bb-461e-9e5c-2c425950aa3f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:06.210927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-45475cbb-06bb-461e-9e5c-2c425950aa3f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:06.344842 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-45475cbb-06bb-461e-9e5c-2c425950aa3f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:06.352121 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-45475cbb-06bb-461e-9e5c-2c425950aa3f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.155372 Mar 05 21:28:06.352705 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2922/5805] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:06 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:07.369611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-22a6c5ae-3fee-4dcb-b350-964a7717a9b2 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:07.370254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-22a6c5ae-3fee-4dcb-b350-964a7717a9b2 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:07.378654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22a6c5ae-3fee-4dcb-b350-964a7717a9b2 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:07.379128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22a6c5ae-3fee-4dcb-b350-964a7717a9b2 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:07.379959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22a6c5ae-3fee-4dcb-b350-964a7717a9b2 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:07.380417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22a6c5ae-3fee-4dcb-b350-964a7717a9b2 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:07.514255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-22a6c5ae-3fee-4dcb-b350-964a7717a9b2 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:07.521895 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-22a6c5ae-3fee-4dcb-b350-964a7717a9b2 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.156251 Mar 05 21:28:07.522481 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2884/5806] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:07 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:08.538389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6581afac-dc54-413c-af4d-3c00b0e5aa1f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:08.539139 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6581afac-dc54-413c-af4d-3c00b0e5aa1f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:08.546609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6581afac-dc54-413c-af4d-3c00b0e5aa1f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:08.547063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6581afac-dc54-413c-af4d-3c00b0e5aa1f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:08.547866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6581afac-dc54-413c-af4d-3c00b0e5aa1f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:08.548309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6581afac-dc54-413c-af4d-3c00b0e5aa1f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:08.678574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6581afac-dc54-413c-af4d-3c00b0e5aa1f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:08.685910 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6581afac-dc54-413c-af4d-3c00b0e5aa1f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.151447 Mar 05 21:28:08.686534 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2923/5807] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:08 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:09.703060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7f601fcd-55ee-49b7-a25e-d11d5571de26 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:09.703730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7f601fcd-55ee-49b7-a25e-d11d5571de26 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:09.710470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f601fcd-55ee-49b7-a25e-d11d5571de26 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:09.710942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f601fcd-55ee-49b7-a25e-d11d5571de26 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:09.711766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f601fcd-55ee-49b7-a25e-d11d5571de26 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:09.712225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f601fcd-55ee-49b7-a25e-d11d5571de26 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:09.845730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7f601fcd-55ee-49b7-a25e-d11d5571de26 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:09.853169 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7f601fcd-55ee-49b7-a25e-d11d5571de26 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.154061 Mar 05 21:28:09.853751 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2885/5808] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:09 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:10.870373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0d19155-3050-4f0d-adff-893cbb44d9ac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:10.870991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a0d19155-3050-4f0d-adff-893cbb44d9ac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:10.878504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0d19155-3050-4f0d-adff-893cbb44d9ac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:10.878961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0d19155-3050-4f0d-adff-893cbb44d9ac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:10.879747 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0d19155-3050-4f0d-adff-893cbb44d9ac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:10.880190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0d19155-3050-4f0d-adff-893cbb44d9ac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:11.016212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a0d19155-3050-4f0d-adff-893cbb44d9ac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:11.023612 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0d19155-3050-4f0d-adff-893cbb44d9ac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.157143 Mar 05 21:28:11.024214 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2924/5809] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:10 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:12.040999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e9204a5f-8489-4d78-bac9-40a797ced947 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:12.041630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e9204a5f-8489-4d78-bac9-40a797ced947 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:12.048124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9204a5f-8489-4d78-bac9-40a797ced947 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:12.048591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9204a5f-8489-4d78-bac9-40a797ced947 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:12.049375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9204a5f-8489-4d78-bac9-40a797ced947 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:12.049830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9204a5f-8489-4d78-bac9-40a797ced947 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:12.183811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e9204a5f-8489-4d78-bac9-40a797ced947 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:12.191915 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e9204a5f-8489-4d78-bac9-40a797ced947 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.155014 Mar 05 21:28:12.192483 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2886/5810] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:12 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:13.209257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2be5b32a-7ee4-420e-b18a-59f2bea23259 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:13.209798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2be5b32a-7ee4-420e-b18a-59f2bea23259 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:13.216543 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2be5b32a-7ee4-420e-b18a-59f2bea23259 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:13.217018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2be5b32a-7ee4-420e-b18a-59f2bea23259 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:13.217926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2be5b32a-7ee4-420e-b18a-59f2bea23259 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:13.218362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2be5b32a-7ee4-420e-b18a-59f2bea23259 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:13.349342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2be5b32a-7ee4-420e-b18a-59f2bea23259 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:13.356817 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2be5b32a-7ee4-420e-b18a-59f2bea23259 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.151601 Mar 05 21:28:13.357886 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2925/5811] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:13 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:14.375018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-86253238-e2ad-4ef4-a25b-4bb91af38a91 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:14.375646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-86253238-e2ad-4ef4-a25b-4bb91af38a91 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:14.382698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86253238-e2ad-4ef4-a25b-4bb91af38a91 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:14.383164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86253238-e2ad-4ef4-a25b-4bb91af38a91 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:14.383975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86253238-e2ad-4ef4-a25b-4bb91af38a91 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:14.384426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-86253238-e2ad-4ef4-a25b-4bb91af38a91 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:14.516739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-86253238-e2ad-4ef4-a25b-4bb91af38a91 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:14.524115 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-86253238-e2ad-4ef4-a25b-4bb91af38a91 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.153641 Mar 05 21:28:14.524689 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2887/5812] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:14 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:15.541439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9e599b68-8234-4bde-9d62-0de867b5d40c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:15.542064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9e599b68-8234-4bde-9d62-0de867b5d40c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:15.549405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e599b68-8234-4bde-9d62-0de867b5d40c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:15.549863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e599b68-8234-4bde-9d62-0de867b5d40c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:15.550643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e599b68-8234-4bde-9d62-0de867b5d40c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:15.551087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9e599b68-8234-4bde-9d62-0de867b5d40c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:15.687833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9e599b68-8234-4bde-9d62-0de867b5d40c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:15.695256 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9e599b68-8234-4bde-9d62-0de867b5d40c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.157737 Mar 05 21:28:15.695863 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2926/5813] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:15 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:16.713106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5ca8f32b-1ea0-4820-ad4a-ad2e81913eb0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:16.713737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5ca8f32b-1ea0-4820-ad4a-ad2e81913eb0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:16.721198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5ca8f32b-1ea0-4820-ad4a-ad2e81913eb0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:16.721668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5ca8f32b-1ea0-4820-ad4a-ad2e81913eb0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:16.722459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5ca8f32b-1ea0-4820-ad4a-ad2e81913eb0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:16.722916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5ca8f32b-1ea0-4820-ad4a-ad2e81913eb0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:16.857951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5ca8f32b-1ea0-4820-ad4a-ad2e81913eb0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:16.865227 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5ca8f32b-1ea0-4820-ad4a-ad2e81913eb0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.156121 Mar 05 21:28:16.865796 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2888/5814] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:16 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:17.883290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fabe09e0-4946-4e2a-bf8c-1d260ef3d25d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:17.883955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fabe09e0-4946-4e2a-bf8c-1d260ef3d25d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:17.891350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fabe09e0-4946-4e2a-bf8c-1d260ef3d25d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:17.891851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fabe09e0-4946-4e2a-bf8c-1d260ef3d25d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:17.892633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fabe09e0-4946-4e2a-bf8c-1d260ef3d25d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:17.893075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fabe09e0-4946-4e2a-bf8c-1d260ef3d25d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:18.024391 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fabe09e0-4946-4e2a-bf8c-1d260ef3d25d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:18.031845 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fabe09e0-4946-4e2a-bf8c-1d260ef3d25d tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.152444 Mar 05 21:28:18.032433 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2927/5815] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:17 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:19.048814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b700eaff-553f-4d31-b135-942f6fa578eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:19.049451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b700eaff-553f-4d31-b135-942f6fa578eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:19.056256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b700eaff-553f-4d31-b135-942f6fa578eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:19.056741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b700eaff-553f-4d31-b135-942f6fa578eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:19.057536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b700eaff-553f-4d31-b135-942f6fa578eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:19.058000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b700eaff-553f-4d31-b135-942f6fa578eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:19.192017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b700eaff-553f-4d31-b135-942f6fa578eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:19.199431 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b700eaff-553f-4d31-b135-942f6fa578eb tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.154595 Mar 05 21:28:19.200051 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2889/5816] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:19 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:20.216477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4d692703-9026-4617-b71c-a2cf238197b1 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:20.217680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4d692703-9026-4617-b71c-a2cf238197b1 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:20.224299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d692703-9026-4617-b71c-a2cf238197b1 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:20.224896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d692703-9026-4617-b71c-a2cf238197b1 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:20.225926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d692703-9026-4617-b71c-a2cf238197b1 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:20.226394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4d692703-9026-4617-b71c-a2cf238197b1 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:20.363410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4d692703-9026-4617-b71c-a2cf238197b1 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:20.370893 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4d692703-9026-4617-b71c-a2cf238197b1 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.158354 Mar 05 21:28:20.371478 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2928/5817] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:20 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:21.388298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c28eab5d-f43e-4cef-b8ff-a7700b6f550c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:21.389164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c28eab5d-f43e-4cef-b8ff-a7700b6f550c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:21.396150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c28eab5d-f43e-4cef-b8ff-a7700b6f550c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:21.396628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c28eab5d-f43e-4cef-b8ff-a7700b6f550c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:21.397427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c28eab5d-f43e-4cef-b8ff-a7700b6f550c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:21.397914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c28eab5d-f43e-4cef-b8ff-a7700b6f550c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:21.534531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c28eab5d-f43e-4cef-b8ff-a7700b6f550c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:21.545723 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c28eab5d-f43e-4cef-b8ff-a7700b6f550c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.161131 Mar 05 21:28:21.546311 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2890/5818] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:21 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:22.563489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b43e1587-44a8-4bfb-ac41-cb7a6e00f6a3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:22.564168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b43e1587-44a8-4bfb-ac41-cb7a6e00f6a3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:22.570910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b43e1587-44a8-4bfb-ac41-cb7a6e00f6a3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:22.571375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b43e1587-44a8-4bfb-ac41-cb7a6e00f6a3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:22.572174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b43e1587-44a8-4bfb-ac41-cb7a6e00f6a3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:22.572621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b43e1587-44a8-4bfb-ac41-cb7a6e00f6a3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:22.703768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b43e1587-44a8-4bfb-ac41-cb7a6e00f6a3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:22.711086 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b43e1587-44a8-4bfb-ac41-cb7a6e00f6a3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.152653 Mar 05 21:28:22.711693 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2929/5819] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:22 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:23.728564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2d8e82ff-65d8-4216-a5d6-d9457edc8da0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:23.729191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2d8e82ff-65d8-4216-a5d6-d9457edc8da0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:23.736098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d8e82ff-65d8-4216-a5d6-d9457edc8da0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:23.736600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d8e82ff-65d8-4216-a5d6-d9457edc8da0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:23.737386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d8e82ff-65d8-4216-a5d6-d9457edc8da0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:23.737872 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d8e82ff-65d8-4216-a5d6-d9457edc8da0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:23.874733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d8e82ff-65d8-4216-a5d6-d9457edc8da0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:23.882380 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2d8e82ff-65d8-4216-a5d6-d9457edc8da0 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.157690 Mar 05 21:28:23.882951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2891/5820] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:23 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:24.899255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ad7c2830-9f42-468a-848b-b0cb72510dac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:24.899924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ad7c2830-9f42-468a-848b-b0cb72510dac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:24.907855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad7c2830-9f42-468a-848b-b0cb72510dac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:24.908362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad7c2830-9f42-468a-848b-b0cb72510dac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:24.909157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad7c2830-9f42-468a-848b-b0cb72510dac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:24.909601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad7c2830-9f42-468a-848b-b0cb72510dac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:25.042418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ad7c2830-9f42-468a-848b-b0cb72510dac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:25.050399 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ad7c2830-9f42-468a-848b-b0cb72510dac tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1517 microversion: 2.1 time: 0.155047 Mar 05 21:28:25.050989 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2930/5821] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:24 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:25.895849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e7c4b853-07f2-466d-b10f-6b7dcd2f868c req-2b821bf7-5762-4337-aa42-7854732ef574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14a1a2d-d30c-4a89-ace1-235cd5466b7d", "name": "network-vif-unplugged", "status": "completed", "tag": "ea65bb67-e86a-453a-a090-f2c921f98fbc"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:28:25.904524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e7c4b853-07f2-466d-b10f-6b7dcd2f868c req-2b821bf7-5762-4337-aa42-7854732ef574 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:25.904981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e7c4b853-07f2-466d-b10f-6b7dcd2f868c req-2b821bf7-5762-4337-aa42-7854732ef574 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:25.917898 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e7c4b853-07f2-466d-b10f-6b7dcd2f868c req-2b821bf7-5762-4337-aa42-7854732ef574 service nova] Creating event network-vif-unplugged:ea65bb67-e86a-453a-a090-f2c921f98fbc for instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d on nch1-master-1 Mar 05 21:28:25.923978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-e7c4b853-07f2-466d-b10f-6b7dcd2f868c req-2b821bf7-5762-4337-aa42-7854732ef574 service nova] Instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:28:25.935150 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e7c4b853-07f2-466d-b10f-6b7dcd2f868c req-2b821bf7-5762-4337-aa42-7854732ef574 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043135 Mar 05 21:28:25.936408 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2892/5822] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:28:26.067056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d759de52-3a83-4331-b69a-40b265b8f576 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:26.067802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d759de52-3a83-4331-b69a-40b265b8f576 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:26.074326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d759de52-3a83-4331-b69a-40b265b8f576 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:26.074864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d759de52-3a83-4331-b69a-40b265b8f576 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:26.075642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d759de52-3a83-4331-b69a-40b265b8f576 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:26.076149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d759de52-3a83-4331-b69a-40b265b8f576 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:26.220328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d759de52-3a83-4331-b69a-40b265b8f576 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:26.228887 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d759de52-3a83-4331-b69a-40b265b8f576 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1516 microversion: 2.1 time: 0.165835 Mar 05 21:28:26.229475 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2931/5823] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:26 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:27.248715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-00ec7cae-60bf-4a8c-b0f4-fa2bcc21bba5 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:27.249539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-00ec7cae-60bf-4a8c-b0f4-fa2bcc21bba5 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:27.256262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00ec7cae-60bf-4a8c-b0f4-fa2bcc21bba5 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:27.256728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00ec7cae-60bf-4a8c-b0f4-fa2bcc21bba5 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:27.257512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00ec7cae-60bf-4a8c-b0f4-fa2bcc21bba5 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:27.257964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-00ec7cae-60bf-4a8c-b0f4-fa2bcc21bba5 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:27.398570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-00ec7cae-60bf-4a8c-b0f4-fa2bcc21bba5 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:27.406445 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-00ec7cae-60bf-4a8c-b0f4-fa2bcc21bba5 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1514 microversion: 2.1 time: 0.163094 Mar 05 21:28:27.407021 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2893/5824] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:27 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:27.955333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ec1fb8a3-551d-47b4-9e91-3555931441a2 req-de16d0e2-28cb-42b5-9b79-974572a49fcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c14a1a2d-d30c-4a89-ace1-235cd5466b7d", "tag": "ea65bb67-e86a-453a-a090-f2c921f98fbc"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:28:27.963882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ec1fb8a3-551d-47b4-9e91-3555931441a2 req-de16d0e2-28cb-42b5-9b79-974572a49fcf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:27.964335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ec1fb8a3-551d-47b4-9e91-3555931441a2 req-de16d0e2-28cb-42b5-9b79-974572a49fcf service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:27.976111 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ec1fb8a3-551d-47b4-9e91-3555931441a2 req-de16d0e2-28cb-42b5-9b79-974572a49fcf service nova] Creating event network-changed:ea65bb67-e86a-453a-a090-f2c921f98fbc for instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d on nch1-master-1 Mar 05 21:28:27.981321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-ec1fb8a3-551d-47b4-9e91-3555931441a2 req-de16d0e2-28cb-42b5-9b79-974572a49fcf service nova] Instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:28:27.992150 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ec1fb8a3-551d-47b4-9e91-3555931441a2 req-de16d0e2-28cb-42b5-9b79-974572a49fcf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042345 Mar 05 21:28:27.992801 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2932/5825] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:28:28.424542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6b1067b-9ac5-48ae-b4e8-adfa8114bc69 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:28.425169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6b1067b-9ac5-48ae-b4e8-adfa8114bc69 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:28.432400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6b1067b-9ac5-48ae-b4e8-adfa8114bc69 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:28.432875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6b1067b-9ac5-48ae-b4e8-adfa8114bc69 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:28.433690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6b1067b-9ac5-48ae-b4e8-adfa8114bc69 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:28.434156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6b1067b-9ac5-48ae-b4e8-adfa8114bc69 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:28.825349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6b1067b-9ac5-48ae-b4e8-adfa8114bc69 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:28.833224 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6b1067b-9ac5-48ae-b4e8-adfa8114bc69 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1511 microversion: 2.1 time: 0.413362 Mar 05 21:28:28.833825 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2894/5826] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:28 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1511 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:28.850583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1d8a25c5-7b4b-41d4-b75f-e648abcb4d49 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:28.851165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1d8a25c5-7b4b-41d4-b75f-e648abcb4d49 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:28.864781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d8a25c5-7b4b-41d4-b75f-e648abcb4d49 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:28.865191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d8a25c5-7b4b-41d4-b75f-e648abcb4d49 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:28.871329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d8a25c5-7b4b-41d4-b75f-e648abcb4d49 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:28.871857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d8a25c5-7b4b-41d4-b75f-e648abcb4d49 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:28.907634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1d8a25c5-7b4b-41d4-b75f-e648abcb4d49 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:28:28.976779 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.compute.api [None req-1d8a25c5-7b4b-41d4-b75f-e648abcb4d49 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Found an unconfirmed migration during delete, id: 16, status: finished Mar 05 21:28:30.677294 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1d8a25c5-7b4b-41d4-b75f-e648abcb4d49 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 204 len: 0 microversion: 2.1 time: 1.830838 Mar 05 21:28:30.678139 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2933/5827] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:28:28 2022] DELETE /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 0 bytes in 1833 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:28:30.687910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1b1577c4-6cc0-432f-8316-481b97149e92 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:30.688548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1b1577c4-6cc0-432f-8316-481b97149e92 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:30.694768 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b1577c4-6cc0-432f-8316-481b97149e92 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:30.695237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b1577c4-6cc0-432f-8316-481b97149e92 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:30.696055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b1577c4-6cc0-432f-8316-481b97149e92 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:30.696511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1b1577c4-6cc0-432f-8316-481b97149e92 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:30.837078 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1b1577c4-6cc0-432f-8316-481b97149e92 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:30.845563 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1b1577c4-6cc0-432f-8316-481b97149e92 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1503 microversion: 2.1 time: 0.162560 Mar 05 21:28:30.846146 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2895/5828] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:30 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:31.059288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e6874058-4428-48c1-bc00-881e46f40021 req-af13bd33-7839-4f89-a0b1-73109a083642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14a1a2d-d30c-4a89-ace1-235cd5466b7d", "name": "network-vif-plugged", "status": "completed", "tag": "ea65bb67-e86a-453a-a090-f2c921f98fbc"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:28:31.068566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e6874058-4428-48c1-bc00-881e46f40021 req-af13bd33-7839-4f89-a0b1-73109a083642 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:31.069075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e6874058-4428-48c1-bc00-881e46f40021 req-af13bd33-7839-4f89-a0b1-73109a083642 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:31.081436 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e6874058-4428-48c1-bc00-881e46f40021 req-af13bd33-7839-4f89-a0b1-73109a083642 service nova] Creating event network-vif-plugged:ea65bb67-e86a-453a-a090-f2c921f98fbc for instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d on nch1-master-1 Mar 05 21:28:31.086306 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e6874058-4428-48c1-bc00-881e46f40021 req-af13bd33-7839-4f89-a0b1-73109a083642 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031365 Mar 05 21:28:31.086941 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2934/5829] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:28:31.862696 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3555027c-9ef9-44b0-8149-cebbdfc8f08c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:31.863333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3555027c-9ef9-44b0-8149-cebbdfc8f08c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:31.870114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3555027c-9ef9-44b0-8149-cebbdfc8f08c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:31.870583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3555027c-9ef9-44b0-8149-cebbdfc8f08c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:31.871402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3555027c-9ef9-44b0-8149-cebbdfc8f08c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:31.871890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3555027c-9ef9-44b0-8149-cebbdfc8f08c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:32.037155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3555027c-9ef9-44b0-8149-cebbdfc8f08c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b47c6e3eb64aa3a03678c0d74ac527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a389d80df2ec4570aa76785c5c066c64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:32.044888 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3555027c-9ef9-44b0-8149-cebbdfc8f08c tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 200 len: 1503 microversion: 2.1 time: 0.186178 Mar 05 21:28:32.046146 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2896/5830] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:31 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:32.320708 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:28:32.321304 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 21:28:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:28:32.463935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c6b525d9-9beb-4299-a0b7-499a8637b889 req-7c3faa9c-8e9d-4e66-a6e3-7bcc0b462f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14a1a2d-d30c-4a89-ace1-235cd5466b7d", "name": "network-vif-deleted", "tag": "ea65bb67-e86a-453a-a090-f2c921f98fbc"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:28:32.473528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c6b525d9-9beb-4299-a0b7-499a8637b889 req-7c3faa9c-8e9d-4e66-a6e3-7bcc0b462f6d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:32.473981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c6b525d9-9beb-4299-a0b7-499a8637b889 req-7c3faa9c-8e9d-4e66-a6e3-7bcc0b462f6d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:32.484465 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c6b525d9-9beb-4299-a0b7-499a8637b889 req-7c3faa9c-8e9d-4e66-a6e3-7bcc0b462f6d service nova] Creating event network-vif-deleted:ea65bb67-e86a-453a-a090-f2c921f98fbc for instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d on nch1-master-1 Mar 05 21:28:32.489249 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c6b525d9-9beb-4299-a0b7-499a8637b889 req-7c3faa9c-8e9d-4e66-a6e3-7bcc0b462f6d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030403 Mar 05 21:28:32.489848 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2935/5831] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:28:33.062916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f2741d21-8927-4f55-a507-8b65820aa65e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:33.063552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f2741d21-8927-4f55-a507-8b65820aa65e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:33.070350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2741d21-8927-4f55-a507-8b65820aa65e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:33.070825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2741d21-8927-4f55-a507-8b65820aa65e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:33.071624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2741d21-8927-4f55-a507-8b65820aa65e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:33.072133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2741d21-8927-4f55-a507-8b65820aa65e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:33.085884 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-f2741d21-8927-4f55-a507-8b65820aa65e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] HTTP exception thrown: Instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d could not be found. Mar 05 21:28:33.086529 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f2741d21-8927-4f55-a507-8b65820aa65e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Returning 404 to user: Instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:28:33.087382 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f2741d21-8927-4f55-a507-8b65820aa65e tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 404 len: 111 microversion: 2.1 time: 0.029398 Mar 05 21:28:33.087951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2897/5832] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:33 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:28:33.103042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-386da054-270f-4cbc-9fdb-1a0dbf4883f3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:33.103642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-386da054-270f-4cbc-9fdb-1a0dbf4883f3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:33.110169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-386da054-270f-4cbc-9fdb-1a0dbf4883f3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:33.110623 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-386da054-270f-4cbc-9fdb-1a0dbf4883f3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:33.111403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-386da054-270f-4cbc-9fdb-1a0dbf4883f3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:33.111892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-386da054-270f-4cbc-9fdb-1a0dbf4883f3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:33.125520 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-386da054-270f-4cbc-9fdb-1a0dbf4883f3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] HTTP exception thrown: Instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d could not be found. Mar 05 21:28:33.126153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-386da054-270f-4cbc-9fdb-1a0dbf4883f3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Returning 404 to user: Instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:28:33.127249 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-386da054-270f-4cbc-9fdb-1a0dbf4883f3 tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 404 len: 111 microversion: 2.1 time: 0.028946 Mar 05 21:28:33.127813 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2936/5833] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:28:33 2022] DELETE /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:28:33.135810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7556f630-301a-4b38-9781-5b5ff3dd718f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:33.136485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7556f630-301a-4b38-9781-5b5ff3dd718f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] [instance: c14a1a2d-d30c-4a89-ace1-235cd5466b7d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:33.143012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7556f630-301a-4b38-9781-5b5ff3dd718f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:33.143429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7556f630-301a-4b38-9781-5b5ff3dd718f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:33.144261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7556f630-301a-4b38-9781-5b5ff3dd718f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:33.144726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7556f630-301a-4b38-9781-5b5ff3dd718f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:33.157778 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-7556f630-301a-4b38-9781-5b5ff3dd718f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] HTTP exception thrown: Instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d could not be found. Mar 05 21:28:33.158391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7556f630-301a-4b38-9781-5b5ff3dd718f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] Returning 404 to user: Instance c14a1a2d-d30c-4a89-ace1-235cd5466b7d could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:28:33.159234 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7556f630-301a-4b38-9781-5b5ff3dd718f tempest-DeleteServersTestJSON-2060879600 tempest-DeleteServersTestJSON-2060879600-project] 10.222.0.15 "GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d" status: 404 len: 111 microversion: 2.1 time: 0.027406 Mar 05 21:28:33.159793 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2898/5834] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:33 2022] GET /compute/v2.1/servers/c14a1a2d-d30c-4a89-ace1-235cd5466b7d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:28:35.533569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-507756475", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "ec6dd59e-b905-4d5c-8801-dafc4d378ba9"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:28:35.585113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] validate_networks() for [('ec6dd59e-b905-4d5c-8801-dafc4d378ba9', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:28:35.928075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:28:35.928509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:28:35.928994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:28:35.929449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:28:35.929872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:28:35.939182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:35.939697 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:35.940505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:35.940959 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:35.960189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Getting quotas for project a6194eed29994ae8be33cdd34fa12d83. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:28:35.965422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Getting quotas for user 12344f6a4659469baeb7f9b3d4abc547 and project a6194eed29994ae8be33cdd34fa12d83. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:28:35.977952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:28:35.980261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:28:36.024155 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b65f7ecf-acba-4413-a287-4695c67bb254 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608701 Mar 05 21:28:36.024809 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2937/5835] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:28:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:28:36.034840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4f609049-a7e2-406f-a71a-fb4cf8b6e5e0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:36.035490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4f609049-a7e2-406f-a71a-fb4cf8b6e5e0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:36.090199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4f609049-a7e2-406f-a71a-fb4cf8b6e5e0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:36.097712 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4f609049-a7e2-406f-a71a-fb4cf8b6e5e0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1217 microversion: 2.1 time: 0.066761 Mar 05 21:28:36.098278 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2899/5836] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:36 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:28:37.115488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-20d775ef-6bb1-4384-8f26-b21139ac846a tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:37.116150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-20d775ef-6bb1-4384-8f26-b21139ac846a tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:37.122500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20d775ef-6bb1-4384-8f26-b21139ac846a tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:37.122777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20d775ef-6bb1-4384-8f26-b21139ac846a tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:37.124124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20d775ef-6bb1-4384-8f26-b21139ac846a tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:37.124565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-20d775ef-6bb1-4384-8f26-b21139ac846a tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:37.186562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-20d775ef-6bb1-4384-8f26-b21139ac846a tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:37.194024 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-20d775ef-6bb1-4384-8f26-b21139ac846a tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1275 microversion: 2.1 time: 0.083360 Mar 05 21:28:37.194865 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2938/5837] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:37 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:38.172536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-9d6710f4-9ac6-4808-a28d-60450c76e5ab req-d8500ec6-f34b-489d-b6d4-3c0d29270f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e4de292-8520-4229-8d34-6b326c9b95bf", "tag": "1886e648-93a9-42c6-94f3-071ee3469375"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:28:38.185140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9d6710f4-9ac6-4808-a28d-60450c76e5ab req-d8500ec6-f34b-489d-b6d4-3c0d29270f37 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:38.185664 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9d6710f4-9ac6-4808-a28d-60450c76e5ab req-d8500ec6-f34b-489d-b6d4-3c0d29270f37 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:38.198561 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-9d6710f4-9ac6-4808-a28d-60450c76e5ab req-d8500ec6-f34b-489d-b6d4-3c0d29270f37 service nova] Creating event network-changed:1886e648-93a9-42c6-94f3-071ee3469375 for instance 3e4de292-8520-4229-8d34-6b326c9b95bf on nch1-master-1 Mar 05 21:28:38.204271 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-9d6710f4-9ac6-4808-a28d-60450c76e5ab req-d8500ec6-f34b-489d-b6d4-3c0d29270f37 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036627 Mar 05 21:28:38.204862 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2900/5838] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:28:38.211029 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c52a2205-73c2-4b66-ae32-e617c4956919 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:38.211647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c52a2205-73c2-4b66-ae32-e617c4956919 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:38.219189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c52a2205-73c2-4b66-ae32-e617c4956919 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:38.219643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c52a2205-73c2-4b66-ae32-e617c4956919 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:38.220512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c52a2205-73c2-4b66-ae32-e617c4956919 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:38.220888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c52a2205-73c2-4b66-ae32-e617c4956919 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:38.356970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c52a2205-73c2-4b66-ae32-e617c4956919 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:38.366331 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c52a2205-73c2-4b66-ae32-e617c4956919 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1317 microversion: 2.1 time: 0.159466 Mar 05 21:28:38.367034 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2939/5839] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:38 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:28:39.383847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2a63880f-9e66-40b8-b26d-aa92dda3f2bc tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:39.384583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2a63880f-9e66-40b8-b26d-aa92dda3f2bc tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:39.392110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a63880f-9e66-40b8-b26d-aa92dda3f2bc tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:39.392609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a63880f-9e66-40b8-b26d-aa92dda3f2bc tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:39.393402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a63880f-9e66-40b8-b26d-aa92dda3f2bc tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:39.393858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a63880f-9e66-40b8-b26d-aa92dda3f2bc tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:39.534530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2a63880f-9e66-40b8-b26d-aa92dda3f2bc tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:39.541896 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2a63880f-9e66-40b8-b26d-aa92dda3f2bc tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1317 microversion: 2.1 time: 0.162325 Mar 05 21:28:39.542876 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2901/5840] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:39 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:40.559194 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4e9b4c17-7252-4b52-a8a3-c5612fd9c4d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:40.559843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4e9b4c17-7252-4b52-a8a3-c5612fd9c4d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:40.567254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e9b4c17-7252-4b52-a8a3-c5612fd9c4d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:40.567734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e9b4c17-7252-4b52-a8a3-c5612fd9c4d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:40.568502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e9b4c17-7252-4b52-a8a3-c5612fd9c4d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:40.568938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e9b4c17-7252-4b52-a8a3-c5612fd9c4d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:40.703794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4e9b4c17-7252-4b52-a8a3-c5612fd9c4d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:40.711014 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4e9b4c17-7252-4b52-a8a3-c5612fd9c4d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1317 microversion: 2.1 time: 0.155732 Mar 05 21:28:40.711587 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2940/5841] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:40 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:41.728923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f7c6dab5-ecea-421e-b728-aa4f66f561ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:41.729558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f7c6dab5-ecea-421e-b728-aa4f66f561ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:41.737088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7c6dab5-ecea-421e-b728-aa4f66f561ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:41.737688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7c6dab5-ecea-421e-b728-aa4f66f561ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:41.738500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7c6dab5-ecea-421e-b728-aa4f66f561ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:41.738964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f7c6dab5-ecea-421e-b728-aa4f66f561ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:41.869132 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f7c6dab5-ecea-421e-b728-aa4f66f561ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:41.877712 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f7c6dab5-ecea-421e-b728-aa4f66f561ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1317 microversion: 2.1 time: 0.152969 Mar 05 21:28:41.878277 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2902/5842] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:41 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:42.895053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d7bdec6b-9cda-4073-a7a5-d1a86edfc183 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:42.895693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d7bdec6b-9cda-4073-a7a5-d1a86edfc183 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:42.902555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7bdec6b-9cda-4073-a7a5-d1a86edfc183 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:42.903011 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7bdec6b-9cda-4073-a7a5-d1a86edfc183 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:42.903822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7bdec6b-9cda-4073-a7a5-d1a86edfc183 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:42.904848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7bdec6b-9cda-4073-a7a5-d1a86edfc183 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:43.040425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d7bdec6b-9cda-4073-a7a5-d1a86edfc183 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:43.049124 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d7bdec6b-9cda-4073-a7a5-d1a86edfc183 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1317 microversion: 2.1 time: 0.157881 Mar 05 21:28:43.049721 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2941/5843] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:42 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:43.117922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-16bcf929-267e-4d3f-8cb3-ecfc2a5d6469 req-b83cf6b4-0310-4241-8e3d-da1515cb8db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4de292-8520-4229-8d34-6b326c9b95bf", "name": "network-vif-plugged", "status": "completed", "tag": "1886e648-93a9-42c6-94f3-071ee3469375"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:28:43.127265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-16bcf929-267e-4d3f-8cb3-ecfc2a5d6469 req-b83cf6b4-0310-4241-8e3d-da1515cb8db3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:43.127758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-16bcf929-267e-4d3f-8cb3-ecfc2a5d6469 req-b83cf6b4-0310-4241-8e3d-da1515cb8db3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:43.139149 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-16bcf929-267e-4d3f-8cb3-ecfc2a5d6469 req-b83cf6b4-0310-4241-8e3d-da1515cb8db3 service nova] Creating event network-vif-plugged:1886e648-93a9-42c6-94f3-071ee3469375 for instance 3e4de292-8520-4229-8d34-6b326c9b95bf on nch1-master-1 Mar 05 21:28:43.144184 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-16bcf929-267e-4d3f-8cb3-ecfc2a5d6469 req-b83cf6b4-0310-4241-8e3d-da1515cb8db3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029942 Mar 05 21:28:43.144718 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2903/5844] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:28:44.066387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b6422a67-79fe-4870-b893-27b2dd8fde12 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:44.067047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b6422a67-79fe-4870-b893-27b2dd8fde12 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:44.073996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6422a67-79fe-4870-b893-27b2dd8fde12 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:44.074460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6422a67-79fe-4870-b893-27b2dd8fde12 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:44.075240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6422a67-79fe-4870-b893-27b2dd8fde12 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:44.075705 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b6422a67-79fe-4870-b893-27b2dd8fde12 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:44.210877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b6422a67-79fe-4870-b893-27b2dd8fde12 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:44.219343 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b6422a67-79fe-4870-b893-27b2dd8fde12 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1317 microversion: 2.1 time: 0.156833 Mar 05 21:28:44.219955 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2942/5845] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:44 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:45.238928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c2ef2aae-d1c5-4826-a7a9-7a719a19baa2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:45.239608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c2ef2aae-d1c5-4826-a7a9-7a719a19baa2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:45.245824 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2ef2aae-d1c5-4826-a7a9-7a719a19baa2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:45.246298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2ef2aae-d1c5-4826-a7a9-7a719a19baa2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:45.247085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2ef2aae-d1c5-4826-a7a9-7a719a19baa2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:45.247544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2ef2aae-d1c5-4826-a7a9-7a719a19baa2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:45.438517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c2ef2aae-d1c5-4826-a7a9-7a719a19baa2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:45.445911 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c2ef2aae-d1c5-4826-a7a9-7a719a19baa2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1505 microversion: 2.1 time: 0.212271 Mar 05 21:28:45.446494 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2904/5846] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:45 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:45.462403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7fe6cd8c-96d5-4255-8c9f-ceec9bf9ea67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:45.463030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7fe6cd8c-96d5-4255-8c9f-ceec9bf9ea67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:45.470366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fe6cd8c-96d5-4255-8c9f-ceec9bf9ea67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:45.470829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fe6cd8c-96d5-4255-8c9f-ceec9bf9ea67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:45.471611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fe6cd8c-96d5-4255-8c9f-ceec9bf9ea67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:45.472084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7fe6cd8c-96d5-4255-8c9f-ceec9bf9ea67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:45.608161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7fe6cd8c-96d5-4255-8c9f-ceec9bf9ea67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:45.616129 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7fe6cd8c-96d5-4255-8c9f-ceec9bf9ea67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1505 microversion: 2.1 time: 0.157509 Mar 05 21:28:45.616708 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2943/5847] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:45 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:45.632705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-70d6aa19-8e06-438b-be7e-b3dd73300529 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:28:45.633848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-70d6aa19-8e06-438b-be7e-b3dd73300529 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:45.641303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70d6aa19-8e06-438b-be7e-b3dd73300529 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:45.641850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70d6aa19-8e06-438b-be7e-b3dd73300529 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:45.642673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70d6aa19-8e06-438b-be7e-b3dd73300529 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:45.643176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70d6aa19-8e06-438b-be7e-b3dd73300529 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:45.712162 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-70d6aa19-8e06-438b-be7e-b3dd73300529 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "PUT /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1077 microversion: 2.1 time: 0.083357 Mar 05 21:28:45.712793 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2905/5848] 10.222.0.15 () {60 vars in 1255 bytes} [Sat Mar 5 21:28:45 2022] PUT /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1077 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:28:45.727192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-62121d37-ce2c-45bf-bf5a-37039c7a4417 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:45.727870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-62121d37-ce2c-45bf-bf5a-37039c7a4417 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:45.734119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62121d37-ce2c-45bf-bf5a-37039c7a4417 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:45.734603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62121d37-ce2c-45bf-bf5a-37039c7a4417 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:45.735378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62121d37-ce2c-45bf-bf5a-37039c7a4417 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:45.735908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-62121d37-ce2c-45bf-bf5a-37039c7a4417 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:45.864469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-62121d37-ce2c-45bf-bf5a-37039c7a4417 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:45.871872 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-62121d37-ce2c-45bf-bf5a-37039c7a4417 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1503 microversion: 2.1 time: 0.148616 Mar 05 21:28:45.872453 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2944/5849] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:45 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:45.888410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9764aadf-6032-4030-8fdd-4a4519521f74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:45.889959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9764aadf-6032-4030-8fdd-4a4519521f74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:45.896570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9764aadf-6032-4030-8fdd-4a4519521f74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:45.897047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9764aadf-6032-4030-8fdd-4a4519521f74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:45.897847 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9764aadf-6032-4030-8fdd-4a4519521f74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:45.898305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9764aadf-6032-4030-8fdd-4a4519521f74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:46.036048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9764aadf-6032-4030-8fdd-4a4519521f74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:46.043639 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9764aadf-6032-4030-8fdd-4a4519521f74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1503 microversion: 2.1 time: 0.159236 Mar 05 21:28:46.044242 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2906/5850] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:45 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:46.059906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:28:46.061478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:46.067456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:46.067905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:46.068693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:46.069147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:46.096026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:46.101738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Old instance type m1.heat2, new instance type m1.heat {{(pid=141479) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 21:28:46.107773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:28:46.108203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:28:46.108690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:28:46.109111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:28:46.109535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:28:46.170693 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b156984a-8737-466a-a342-d26ff82e12e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "POST /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf/action" status: 202 len: 0 microversion: 2.1 time: 0.114205 Mar 05 21:28:46.171543 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2945/5851] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:28:46 2022] POST /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:28:46.179527 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cbd00941-d478-4443-94b2-8ec6c23f2478 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:46.180198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cbd00941-d478-4443-94b2-8ec6c23f2478 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:46.186795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbd00941-d478-4443-94b2-8ec6c23f2478 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:46.187282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbd00941-d478-4443-94b2-8ec6c23f2478 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:46.188120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbd00941-d478-4443-94b2-8ec6c23f2478 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:46.188581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cbd00941-d478-4443-94b2-8ec6c23f2478 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:46.358214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cbd00941-d478-4443-94b2-8ec6c23f2478 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:46.365690 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cbd00941-d478-4443-94b2-8ec6c23f2478 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1514 microversion: 2.1 time: 0.189898 Mar 05 21:28:46.366257 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2907/5852] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:46 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:47.384987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0a7f588-ffc2-4e84-ba6e-c93a1a4a2c9d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:47.385586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e0a7f588-ffc2-4e84-ba6e-c93a1a4a2c9d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:47.392780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a7f588-ffc2-4e84-ba6e-c93a1a4a2c9d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:47.393235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a7f588-ffc2-4e84-ba6e-c93a1a4a2c9d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:47.394016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a7f588-ffc2-4e84-ba6e-c93a1a4a2c9d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:47.394458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a7f588-ffc2-4e84-ba6e-c93a1a4a2c9d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:47.538948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e0a7f588-ffc2-4e84-ba6e-c93a1a4a2c9d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:47.546492 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0a7f588-ffc2-4e84-ba6e-c93a1a4a2c9d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1514 microversion: 2.1 time: 0.166573 Mar 05 21:28:47.547082 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2946/5853] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:47 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:48.564016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4580a85a-254b-44f9-976e-f7cafd2a8300 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:48.564647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4580a85a-254b-44f9-976e-f7cafd2a8300 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:48.571366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4580a85a-254b-44f9-976e-f7cafd2a8300 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:48.571878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4580a85a-254b-44f9-976e-f7cafd2a8300 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:48.572714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4580a85a-254b-44f9-976e-f7cafd2a8300 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:48.573124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4580a85a-254b-44f9-976e-f7cafd2a8300 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:48.708231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4580a85a-254b-44f9-976e-f7cafd2a8300 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:48.715555 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4580a85a-254b-44f9-976e-f7cafd2a8300 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.155982 Mar 05 21:28:48.716155 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2908/5854] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:48 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:49.733370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b075298e-9e76-4e3d-a070-96ebe04a05b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:49.734001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b075298e-9e76-4e3d-a070-96ebe04a05b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:49.740892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b075298e-9e76-4e3d-a070-96ebe04a05b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:49.741352 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b075298e-9e76-4e3d-a070-96ebe04a05b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:49.742168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b075298e-9e76-4e3d-a070-96ebe04a05b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:49.742613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b075298e-9e76-4e3d-a070-96ebe04a05b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:49.937919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b075298e-9e76-4e3d-a070-96ebe04a05b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:49.945593 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b075298e-9e76-4e3d-a070-96ebe04a05b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.215972 Mar 05 21:28:49.946207 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2947/5855] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:49 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:50.964049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-614aab86-1711-4d26-be5b-d423f49c373c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:50.964717 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-614aab86-1711-4d26-be5b-d423f49c373c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:50.971951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-614aab86-1711-4d26-be5b-d423f49c373c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:50.972435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-614aab86-1711-4d26-be5b-d423f49c373c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:50.973260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-614aab86-1711-4d26-be5b-d423f49c373c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:50.973723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-614aab86-1711-4d26-be5b-d423f49c373c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:51.115386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-614aab86-1711-4d26-be5b-d423f49c373c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:51.123421 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-614aab86-1711-4d26-be5b-d423f49c373c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.162810 Mar 05 21:28:51.124070 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2909/5856] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:50 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:52.140977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-603e9573-2afc-4f29-be47-b66950e1b85f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:52.141544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-603e9573-2afc-4f29-be47-b66950e1b85f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:52.148169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-603e9573-2afc-4f29-be47-b66950e1b85f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:52.148643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-603e9573-2afc-4f29-be47-b66950e1b85f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:52.149405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-603e9573-2afc-4f29-be47-b66950e1b85f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:52.149847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-603e9573-2afc-4f29-be47-b66950e1b85f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:52.282487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-603e9573-2afc-4f29-be47-b66950e1b85f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:52.289907 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-603e9573-2afc-4f29-be47-b66950e1b85f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.153205 Mar 05 21:28:52.290486 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2948/5857] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:52 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:53.306524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a417d8ef-a704-4d15-b72a-c049c26dce00 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:53.307070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a417d8ef-a704-4d15-b72a-c049c26dce00 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:53.320365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a417d8ef-a704-4d15-b72a-c049c26dce00 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:53.320837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a417d8ef-a704-4d15-b72a-c049c26dce00 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:53.321633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a417d8ef-a704-4d15-b72a-c049c26dce00 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:53.322093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a417d8ef-a704-4d15-b72a-c049c26dce00 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:53.454549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a417d8ef-a704-4d15-b72a-c049c26dce00 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:53.462165 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a417d8ef-a704-4d15-b72a-c049c26dce00 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.159642 Mar 05 21:28:53.462730 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2910/5858] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:53 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:54.478905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-75fcb2d8-0d08-4b8c-ba8a-044dcb3c71f9 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:54.479522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-75fcb2d8-0d08-4b8c-ba8a-044dcb3c71f9 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:54.486281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75fcb2d8-0d08-4b8c-ba8a-044dcb3c71f9 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:54.486736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75fcb2d8-0d08-4b8c-ba8a-044dcb3c71f9 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:54.487506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75fcb2d8-0d08-4b8c-ba8a-044dcb3c71f9 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:54.487993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75fcb2d8-0d08-4b8c-ba8a-044dcb3c71f9 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:54.630873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-75fcb2d8-0d08-4b8c-ba8a-044dcb3c71f9 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:54.638244 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-75fcb2d8-0d08-4b8c-ba8a-044dcb3c71f9 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.163238 Mar 05 21:28:54.639875 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2949/5859] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:54 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:55.656744 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fb970b39-5587-4531-aef2-1a2d0ea6db13 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:55.657374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fb970b39-5587-4531-aef2-1a2d0ea6db13 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:55.664288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb970b39-5587-4531-aef2-1a2d0ea6db13 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:55.664799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb970b39-5587-4531-aef2-1a2d0ea6db13 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:55.665819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb970b39-5587-4531-aef2-1a2d0ea6db13 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:55.666274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb970b39-5587-4531-aef2-1a2d0ea6db13 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:55.802787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fb970b39-5587-4531-aef2-1a2d0ea6db13 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:55.810172 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fb970b39-5587-4531-aef2-1a2d0ea6db13 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.157851 Mar 05 21:28:55.811023 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2911/5860] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:55 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:56.827361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8a351505-451f-44aa-b0b1-6521716b3303 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:56.828001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8a351505-451f-44aa-b0b1-6521716b3303 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:56.834302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a351505-451f-44aa-b0b1-6521716b3303 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:56.834750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a351505-451f-44aa-b0b1-6521716b3303 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:56.835519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a351505-451f-44aa-b0b1-6521716b3303 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:56.835987 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8a351505-451f-44aa-b0b1-6521716b3303 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:56.975573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8a351505-451f-44aa-b0b1-6521716b3303 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:56.983595 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8a351505-451f-44aa-b0b1-6521716b3303 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.160279 Mar 05 21:28:56.984206 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2950/5861] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:56 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:58.000203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-374ad54b-86bf-4b36-9a0d-2bdcc5ecf7ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:58.000838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-374ad54b-86bf-4b36-9a0d-2bdcc5ecf7ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:58.008480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-374ad54b-86bf-4b36-9a0d-2bdcc5ecf7ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:58.008959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-374ad54b-86bf-4b36-9a0d-2bdcc5ecf7ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:58.009764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-374ad54b-86bf-4b36-9a0d-2bdcc5ecf7ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:58.010225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-374ad54b-86bf-4b36-9a0d-2bdcc5ecf7ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:58.145461 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-374ad54b-86bf-4b36-9a0d-2bdcc5ecf7ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:58.152899 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-374ad54b-86bf-4b36-9a0d-2bdcc5ecf7ce tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.156650 Mar 05 21:28:58.153477 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2912/5862] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:57 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:28:59.171230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e6d36e1f-e2d4-4ce6-ad4e-50f4fc218351 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:28:59.171829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e6d36e1f-e2d4-4ce6-ad4e-50f4fc218351 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:28:59.178582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6d36e1f-e2d4-4ce6-ad4e-50f4fc218351 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:59.179046 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6d36e1f-e2d4-4ce6-ad4e-50f4fc218351 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:59.179865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6d36e1f-e2d4-4ce6-ad4e-50f4fc218351 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:28:59.180312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6d36e1f-e2d4-4ce6-ad4e-50f4fc218351 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:28:59.314333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e6d36e1f-e2d4-4ce6-ad4e-50f4fc218351 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:28:59.321628 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e6d36e1f-e2d4-4ce6-ad4e-50f4fc218351 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.155113 Mar 05 21:28:59.322196 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2951/5863] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:28:59 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:00.338502 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1f11a4a4-fd26-459e-977c-c1ff269c7a73 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:00.339164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1f11a4a4-fd26-459e-977c-c1ff269c7a73 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:00.345527 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f11a4a4-fd26-459e-977c-c1ff269c7a73 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:00.345996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f11a4a4-fd26-459e-977c-c1ff269c7a73 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:00.346779 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f11a4a4-fd26-459e-977c-c1ff269c7a73 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:00.347228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f11a4a4-fd26-459e-977c-c1ff269c7a73 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:00.476994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1f11a4a4-fd26-459e-977c-c1ff269c7a73 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:00.485288 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1f11a4a4-fd26-459e-977c-c1ff269c7a73 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.150751 Mar 05 21:29:00.485876 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2913/5864] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:00 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:01.503400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-96c4350c-7fd9-48bb-870f-a090a2c32052 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:01.504057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-96c4350c-7fd9-48bb-870f-a090a2c32052 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:01.510753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96c4350c-7fd9-48bb-870f-a090a2c32052 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:01.511215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96c4350c-7fd9-48bb-870f-a090a2c32052 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:01.512022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96c4350c-7fd9-48bb-870f-a090a2c32052 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:01.512466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-96c4350c-7fd9-48bb-870f-a090a2c32052 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:01.643948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-96c4350c-7fd9-48bb-870f-a090a2c32052 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:01.651237 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-96c4350c-7fd9-48bb-870f-a090a2c32052 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.152185 Mar 05 21:29:01.651841 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2952/5865] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:01 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:02.668355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4146c146-4e13-489d-a7c0-51e5690f6a60 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:02.668988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4146c146-4e13-489d-a7c0-51e5690f6a60 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:02.676453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4146c146-4e13-489d-a7c0-51e5690f6a60 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:02.676927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4146c146-4e13-489d-a7c0-51e5690f6a60 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:02.677720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4146c146-4e13-489d-a7c0-51e5690f6a60 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:02.678204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4146c146-4e13-489d-a7c0-51e5690f6a60 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:02.814322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4146c146-4e13-489d-a7c0-51e5690f6a60 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:02.821720 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4146c146-4e13-489d-a7c0-51e5690f6a60 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.157369 Mar 05 21:29:02.822293 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2914/5866] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:02 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:03.838770 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ee054b41-d942-4040-a047-c1280d882917 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:03.839383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ee054b41-d942-4040-a047-c1280d882917 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:03.846717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee054b41-d942-4040-a047-c1280d882917 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:03.847134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee054b41-d942-4040-a047-c1280d882917 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:03.847926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee054b41-d942-4040-a047-c1280d882917 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:03.848371 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ee054b41-d942-4040-a047-c1280d882917 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:03.989657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ee054b41-d942-4040-a047-c1280d882917 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:03.997019 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ee054b41-d942-4040-a047-c1280d882917 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.162156 Mar 05 21:29:03.998111 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2953/5867] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:03 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:05.015688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d7bdd11b-1b5f-4efb-8fbc-482774b9492e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:05.016318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d7bdd11b-1b5f-4efb-8fbc-482774b9492e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:05.023419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7bdd11b-1b5f-4efb-8fbc-482774b9492e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:05.023982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7bdd11b-1b5f-4efb-8fbc-482774b9492e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:05.024780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7bdd11b-1b5f-4efb-8fbc-482774b9492e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:05.025235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7bdd11b-1b5f-4efb-8fbc-482774b9492e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:05.156738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d7bdd11b-1b5f-4efb-8fbc-482774b9492e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:05.164037 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d7bdd11b-1b5f-4efb-8fbc-482774b9492e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.152782 Mar 05 21:29:05.164622 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2915/5868] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:05 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:06.180251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c1f0bde1-1f3f-4a63-9e6b-053313ba5006 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:06.180787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c1f0bde1-1f3f-4a63-9e6b-053313ba5006 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:06.187622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1f0bde1-1f3f-4a63-9e6b-053313ba5006 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:06.188117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1f0bde1-1f3f-4a63-9e6b-053313ba5006 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:06.188890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1f0bde1-1f3f-4a63-9e6b-053313ba5006 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:06.189329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c1f0bde1-1f3f-4a63-9e6b-053313ba5006 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:06.328880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c1f0bde1-1f3f-4a63-9e6b-053313ba5006 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:06.336236 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c1f0bde1-1f3f-4a63-9e6b-053313ba5006 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.159965 Mar 05 21:29:06.336921 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2954/5869] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:06 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:07.354207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-76fa89fa-3a0f-4c2e-b452-443bc36bc266 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:07.354843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-76fa89fa-3a0f-4c2e-b452-443bc36bc266 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:07.362171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76fa89fa-3a0f-4c2e-b452-443bc36bc266 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:07.362641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76fa89fa-3a0f-4c2e-b452-443bc36bc266 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:07.363431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76fa89fa-3a0f-4c2e-b452-443bc36bc266 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:07.363929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76fa89fa-3a0f-4c2e-b452-443bc36bc266 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:07.499255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-76fa89fa-3a0f-4c2e-b452-443bc36bc266 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:07.507211 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-76fa89fa-3a0f-4c2e-b452-443bc36bc266 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.156965 Mar 05 21:29:07.507877 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2916/5870] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:07 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:08.524899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-470e6c91-108e-4934-a737-853f4a9e40d3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:08.525510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-470e6c91-108e-4934-a737-853f4a9e40d3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:08.532484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-470e6c91-108e-4934-a737-853f4a9e40d3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:08.532950 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-470e6c91-108e-4934-a737-853f4a9e40d3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:08.533739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-470e6c91-108e-4934-a737-853f4a9e40d3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:08.534184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-470e6c91-108e-4934-a737-853f4a9e40d3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:08.666201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-470e6c91-108e-4934-a737-853f4a9e40d3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:08.674830 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-470e6c91-108e-4934-a737-853f4a9e40d3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.153827 Mar 05 21:29:08.675416 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2955/5871] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:08 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:09.692302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-779befe1-d049-4894-89e9-6e887ded6e26 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:09.692932 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-779befe1-d049-4894-89e9-6e887ded6e26 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:09.699740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-779befe1-d049-4894-89e9-6e887ded6e26 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:09.700217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-779befe1-d049-4894-89e9-6e887ded6e26 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:09.701654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-779befe1-d049-4894-89e9-6e887ded6e26 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:09.702124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-779befe1-d049-4894-89e9-6e887ded6e26 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:09.838130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-779befe1-d049-4894-89e9-6e887ded6e26 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:09.845673 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-779befe1-d049-4894-89e9-6e887ded6e26 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.157283 Mar 05 21:29:09.846253 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2917/5872] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:09 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:29:10.862005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d9932977-ebc2-460d-8b38-bd29838838d2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:10.862651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d9932977-ebc2-460d-8b38-bd29838838d2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:10.869365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9932977-ebc2-460d-8b38-bd29838838d2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:10.869853 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9932977-ebc2-460d-8b38-bd29838838d2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:10.870618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9932977-ebc2-460d-8b38-bd29838838d2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:10.871057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9932977-ebc2-460d-8b38-bd29838838d2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:11.010855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d9932977-ebc2-460d-8b38-bd29838838d2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:11.018452 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d9932977-ebc2-460d-8b38-bd29838838d2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.160349 Mar 05 21:29:11.019027 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2956/5873] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:10 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:12.036427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f124e383-eeb7-4991-bf6d-37a4ab06bbf0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:12.037070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f124e383-eeb7-4991-bf6d-37a4ab06bbf0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:12.043906 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f124e383-eeb7-4991-bf6d-37a4ab06bbf0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:12.044383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f124e383-eeb7-4991-bf6d-37a4ab06bbf0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:12.045183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f124e383-eeb7-4991-bf6d-37a4ab06bbf0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:12.045648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f124e383-eeb7-4991-bf6d-37a4ab06bbf0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:12.180404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f124e383-eeb7-4991-bf6d-37a4ab06bbf0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:12.188380 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f124e383-eeb7-4991-bf6d-37a4ab06bbf0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.155932 Mar 05 21:29:12.188968 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2918/5874] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:12 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:13.205825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-889de651-6560-4e14-8527-897c82b88a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:13.206399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-889de651-6560-4e14-8527-897c82b88a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:13.213188 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-889de651-6560-4e14-8527-897c82b88a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:13.213647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-889de651-6560-4e14-8527-897c82b88a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:13.214449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-889de651-6560-4e14-8527-897c82b88a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:13.214872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-889de651-6560-4e14-8527-897c82b88a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:13.346946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-889de651-6560-4e14-8527-897c82b88a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:13.354348 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-889de651-6560-4e14-8527-897c82b88a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.152642 Mar 05 21:29:13.354925 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2957/5875] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:13 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:14.372260 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2b14682b-92b6-40b5-8def-28ad836ecc22 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:14.373454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2b14682b-92b6-40b5-8def-28ad836ecc22 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:14.380506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b14682b-92b6-40b5-8def-28ad836ecc22 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:14.380973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b14682b-92b6-40b5-8def-28ad836ecc22 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:14.381750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b14682b-92b6-40b5-8def-28ad836ecc22 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:14.382206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2b14682b-92b6-40b5-8def-28ad836ecc22 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:14.516481 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2b14682b-92b6-40b5-8def-28ad836ecc22 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:14.523858 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2b14682b-92b6-40b5-8def-28ad836ecc22 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1519 microversion: 2.1 time: 0.155481 Mar 05 21:29:14.524472 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2919/5876] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:14 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:15.245026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-783fbb11-2c55-49bf-b2cb-99bf48d4710d req-fb75a291-8308-4718-93a2-6669de667568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4de292-8520-4229-8d34-6b326c9b95bf", "name": "network-vif-unplugged", "status": "completed", "tag": "1886e648-93a9-42c6-94f3-071ee3469375"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:29:15.254453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-783fbb11-2c55-49bf-b2cb-99bf48d4710d req-fb75a291-8308-4718-93a2-6669de667568 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:15.254960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-783fbb11-2c55-49bf-b2cb-99bf48d4710d req-fb75a291-8308-4718-93a2-6669de667568 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:15.267385 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-783fbb11-2c55-49bf-b2cb-99bf48d4710d req-fb75a291-8308-4718-93a2-6669de667568 service nova] Creating event network-vif-unplugged:1886e648-93a9-42c6-94f3-071ee3469375 for instance 3e4de292-8520-4229-8d34-6b326c9b95bf on nch2-master-1 Mar 05 21:29:15.272786 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-783fbb11-2c55-49bf-b2cb-99bf48d4710d req-fb75a291-8308-4718-93a2-6669de667568 service nova] Instance 3e4de292-8520-4229-8d34-6b326c9b95bf is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:29:15.284125 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-783fbb11-2c55-49bf-b2cb-99bf48d4710d req-fb75a291-8308-4718-93a2-6669de667568 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042729 Mar 05 21:29:15.284773 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2958/5877] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:29:15.541673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a5ba41f9-69bb-4248-8ed6-eee9d21dd656 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:15.542411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a5ba41f9-69bb-4248-8ed6-eee9d21dd656 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:15.550321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5ba41f9-69bb-4248-8ed6-eee9d21dd656 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:15.550789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5ba41f9-69bb-4248-8ed6-eee9d21dd656 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:15.551601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5ba41f9-69bb-4248-8ed6-eee9d21dd656 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:15.552118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a5ba41f9-69bb-4248-8ed6-eee9d21dd656 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:15.694218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a5ba41f9-69bb-4248-8ed6-eee9d21dd656 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:15.702630 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a5ba41f9-69bb-4248-8ed6-eee9d21dd656 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1518 microversion: 2.1 time: 0.165453 Mar 05 21:29:15.703146 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2920/5878] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:15 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:29:16.722223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fe5fd45d-8201-41ac-9588-805f92cf3398 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:16.722938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fe5fd45d-8201-41ac-9588-805f92cf3398 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:16.729239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe5fd45d-8201-41ac-9588-805f92cf3398 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:16.729702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe5fd45d-8201-41ac-9588-805f92cf3398 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:16.730484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe5fd45d-8201-41ac-9588-805f92cf3398 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:16.730931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe5fd45d-8201-41ac-9588-805f92cf3398 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:16.865549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fe5fd45d-8201-41ac-9588-805f92cf3398 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:16.873431 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fe5fd45d-8201-41ac-9588-805f92cf3398 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1516 microversion: 2.1 time: 0.156975 Mar 05 21:29:16.874025 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2959/5879] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:16 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:17.301829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-220e8abb-9e63-44de-a576-e789a93e5b42 req-32b7b573-e2f6-41a5-b15b-e4c5f6700ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e4de292-8520-4229-8d34-6b326c9b95bf", "tag": "1886e648-93a9-42c6-94f3-071ee3469375"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:29:17.312221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-220e8abb-9e63-44de-a576-e789a93e5b42 req-32b7b573-e2f6-41a5-b15b-e4c5f6700ce5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:17.312433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-220e8abb-9e63-44de-a576-e789a93e5b42 req-32b7b573-e2f6-41a5-b15b-e4c5f6700ce5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:17.324304 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-220e8abb-9e63-44de-a576-e789a93e5b42 req-32b7b573-e2f6-41a5-b15b-e4c5f6700ce5 service nova] Creating event network-changed:1886e648-93a9-42c6-94f3-071ee3469375 for instance 3e4de292-8520-4229-8d34-6b326c9b95bf on nch2-master-1 Mar 05 21:29:17.331388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-220e8abb-9e63-44de-a576-e789a93e5b42 req-32b7b573-e2f6-41a5-b15b-e4c5f6700ce5 service nova] Instance 3e4de292-8520-4229-8d34-6b326c9b95bf is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:29:17.343838 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-220e8abb-9e63-44de-a576-e789a93e5b42 req-32b7b573-e2f6-41a5-b15b-e4c5f6700ce5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045805 Mar 05 21:29:17.344505 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2921/5880] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:29:17.894601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-210ff547-afa8-494d-b6ed-c5fe925fb8ea tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:17.895247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-210ff547-afa8-494d-b6ed-c5fe925fb8ea tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:17.902817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-210ff547-afa8-494d-b6ed-c5fe925fb8ea tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:17.903280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-210ff547-afa8-494d-b6ed-c5fe925fb8ea tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:17.905549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-210ff547-afa8-494d-b6ed-c5fe925fb8ea tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:17.906163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-210ff547-afa8-494d-b6ed-c5fe925fb8ea tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:18.045678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-210ff547-afa8-494d-b6ed-c5fe925fb8ea tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:18.053327 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-210ff547-afa8-494d-b6ed-c5fe925fb8ea tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1513 microversion: 2.1 time: 0.162818 Mar 05 21:29:18.053915 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2960/5881] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:17 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:18.070756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e1b09ccc-7b74-4a52-ae42-e04925d70a94 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:29:18.071402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e1b09ccc-7b74-4a52-ae42-e04925d70a94 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:18.078579 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e1b09ccc-7b74-4a52-ae42-e04925d70a94 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:18.079209 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e1b09ccc-7b74-4a52-ae42-e04925d70a94 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:18.079949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e1b09ccc-7b74-4a52-ae42-e04925d70a94 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:18.080407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e1b09ccc-7b74-4a52-ae42-e04925d70a94 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:18.141320 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e1b09ccc-7b74-4a52-ae42-e04925d70a94 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "POST /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf/action" status: 204 len: 0 microversion: 2.1 time: 0.074671 Mar 05 21:29:18.142248 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2922/5882] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:29:18 2022] POST /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:29:18.150266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2d87957f-4791-42fb-bd7e-6cdf9a4bda62 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:18.151512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2d87957f-4791-42fb-bd7e-6cdf9a4bda62 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:18.158497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d87957f-4791-42fb-bd7e-6cdf9a4bda62 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:18.159191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d87957f-4791-42fb-bd7e-6cdf9a4bda62 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:18.160172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d87957f-4791-42fb-bd7e-6cdf9a4bda62 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:18.160748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2d87957f-4791-42fb-bd7e-6cdf9a4bda62 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:18.309594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2d87957f-4791-42fb-bd7e-6cdf9a4bda62 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:18.318375 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2d87957f-4791-42fb-bd7e-6cdf9a4bda62 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1513 microversion: 2.1 time: 0.171931 Mar 05 21:29:18.318975 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2961/5883] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:18 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:19.096353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-18d01125-2b6e-48c7-bcaf-d60fdec0a818 req-2d370fd1-1f55-4909-9002-e1aa24c9882a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4de292-8520-4229-8d34-6b326c9b95bf", "name": "network-vif-plugged", "status": "completed", "tag": "1886e648-93a9-42c6-94f3-071ee3469375"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:29:19.104912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-18d01125-2b6e-48c7-bcaf-d60fdec0a818 req-2d370fd1-1f55-4909-9002-e1aa24c9882a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:19.105385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-18d01125-2b6e-48c7-bcaf-d60fdec0a818 req-2d370fd1-1f55-4909-9002-e1aa24c9882a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:19.118347 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-18d01125-2b6e-48c7-bcaf-d60fdec0a818 req-2d370fd1-1f55-4909-9002-e1aa24c9882a service nova] Creating event network-vif-plugged:1886e648-93a9-42c6-94f3-071ee3469375 for instance 3e4de292-8520-4229-8d34-6b326c9b95bf on nch2-master-1 Mar 05 21:29:19.124269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-18d01125-2b6e-48c7-bcaf-d60fdec0a818 req-2d370fd1-1f55-4909-9002-e1aa24c9882a service nova] Instance 3e4de292-8520-4229-8d34-6b326c9b95bf is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:29:19.135200 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-18d01125-2b6e-48c7-bcaf-d60fdec0a818 req-2d370fd1-1f55-4909-9002-e1aa24c9882a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044836 Mar 05 21:29:19.135912 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2923/5884] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:29:19.335280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a188f962-9ce1-4db7-a013-a3f24ab09dab tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:19.335936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a188f962-9ce1-4db7-a013-a3f24ab09dab tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:19.343277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a188f962-9ce1-4db7-a013-a3f24ab09dab tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:19.343764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a188f962-9ce1-4db7-a013-a3f24ab09dab tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:19.344531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a188f962-9ce1-4db7-a013-a3f24ab09dab tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:19.344971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a188f962-9ce1-4db7-a013-a3f24ab09dab tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:19.477890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a188f962-9ce1-4db7-a013-a3f24ab09dab tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:19.485474 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a188f962-9ce1-4db7-a013-a3f24ab09dab tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1505 microversion: 2.1 time: 0.154057 Mar 05 21:29:19.486063 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2962/5885] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:19 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:19.502601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-27e43a99-a023-4bf7-ad24-91707e8c132c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:19.503424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-27e43a99-a023-4bf7-ad24-91707e8c132c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:19.510351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27e43a99-a023-4bf7-ad24-91707e8c132c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:19.510941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27e43a99-a023-4bf7-ad24-91707e8c132c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:19.511882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27e43a99-a023-4bf7-ad24-91707e8c132c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:19.512486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27e43a99-a023-4bf7-ad24-91707e8c132c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:19.656658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-27e43a99-a023-4bf7-ad24-91707e8c132c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:19.664066 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-27e43a99-a023-4bf7-ad24-91707e8c132c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1505 microversion: 2.1 time: 0.166026 Mar 05 21:29:19.664639 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2924/5886] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:19 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:19.679852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-967999e1-caaa-4e1b-bcbe-99b40c7727c0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:19.680400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-967999e1-caaa-4e1b-bcbe-99b40c7727c0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:19.686881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-967999e1-caaa-4e1b-bcbe-99b40c7727c0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:19.687330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-967999e1-caaa-4e1b-bcbe-99b40c7727c0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:19.688135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-967999e1-caaa-4e1b-bcbe-99b40c7727c0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:19.688573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-967999e1-caaa-4e1b-bcbe-99b40c7727c0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:19.821333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-967999e1-caaa-4e1b-bcbe-99b40c7727c0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:19.830019 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-967999e1-caaa-4e1b-bcbe-99b40c7727c0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 200 len: 1505 microversion: 2.1 time: 0.154061 Mar 05 21:29:19.830601 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2963/5887] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:19 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:19.846644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dbe573da-54d9-4eeb-ba3a-ec51700b1313 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:19.847167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dbe573da-54d9-4eeb-ba3a-ec51700b1313 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:19.853178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dbe573da-54d9-4eeb-ba3a-ec51700b1313 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:19.853656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dbe573da-54d9-4eeb-ba3a-ec51700b1313 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:19.854447 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dbe573da-54d9-4eeb-ba3a-ec51700b1313 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:19.854905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dbe573da-54d9-4eeb-ba3a-ec51700b1313 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:19.879807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dbe573da-54d9-4eeb-ba3a-ec51700b1313 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:29:19.959140 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dbe573da-54d9-4eeb-ba3a-ec51700b1313 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 204 len: 0 microversion: 2.1 time: 0.115901 Mar 05 21:29:19.960031 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2925/5888] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:29:19 2022] DELETE /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:29:20.045074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-731342594", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "ec6dd59e-b905-4d5c-8801-dafc4d378ba9"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:29:20.093586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] validate_networks() for [('ec6dd59e-b905-4d5c-8801-dafc4d378ba9', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:29:20.495214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:29:20.495766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:29:20.496155 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:29:20.496608 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:29:20.497032 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:29:20.506063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:20.506525 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:20.507335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:20.507821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:20.524430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Getting quotas for project a6194eed29994ae8be33cdd34fa12d83. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:29:20.530388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Getting quotas for user 12344f6a4659469baeb7f9b3d4abc547 and project a6194eed29994ae8be33cdd34fa12d83. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:29:20.542569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:29:20.545629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:29:20.588137 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b3cc8f6a-9920-4427-80d5-5d75f31a5d8d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547520 Mar 05 21:29:20.588800 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2964/5889] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:29:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:29:20.600236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2147d6e1-c08b-455c-a0ca-b02cefb86a21 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:20.601153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2147d6e1-c08b-455c-a0ca-b02cefb86a21 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:20.659610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2147d6e1-c08b-455c-a0ca-b02cefb86a21 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:20.666586 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2147d6e1-c08b-455c-a0ca-b02cefb86a21 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1217 microversion: 2.1 time: 0.070780 Mar 05 21:29:20.667169 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2926/5890] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:20 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:21.685175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-583b35da-6a90-49b8-b5de-01611e46a1aa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:21.686459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-583b35da-6a90-49b8-b5de-01611e46a1aa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:21.694808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-583b35da-6a90-49b8-b5de-01611e46a1aa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:21.695558 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-583b35da-6a90-49b8-b5de-01611e46a1aa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:21.696626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-583b35da-6a90-49b8-b5de-01611e46a1aa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:21.697289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-583b35da-6a90-49b8-b5de-01611e46a1aa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:21.746372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-38bce5bf-68e8-47f5-804e-35a5ba5048b0 req-2979bcc4-0a71-4afd-b06f-c81cd86c7141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4de292-8520-4229-8d34-6b326c9b95bf", "name": "network-vif-deleted", "tag": "1886e648-93a9-42c6-94f3-071ee3469375"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:29:21.759831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-38bce5bf-68e8-47f5-804e-35a5ba5048b0 req-2979bcc4-0a71-4afd-b06f-c81cd86c7141 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:21.760832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-38bce5bf-68e8-47f5-804e-35a5ba5048b0 req-2979bcc4-0a71-4afd-b06f-c81cd86c7141 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:21.771960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-583b35da-6a90-49b8-b5de-01611e46a1aa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:21.773152 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-38bce5bf-68e8-47f5-804e-35a5ba5048b0 req-2979bcc4-0a71-4afd-b06f-c81cd86c7141 service nova] Creating event network-vif-deleted:1886e648-93a9-42c6-94f3-071ee3469375 for instance 3e4de292-8520-4229-8d34-6b326c9b95bf on nch2-master-1 Mar 05 21:29:21.779864 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-38bce5bf-68e8-47f5-804e-35a5ba5048b0 req-2979bcc4-0a71-4afd-b06f-c81cd86c7141 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037700 Mar 05 21:29:21.780878 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-583b35da-6a90-49b8-b5de-01611e46a1aa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1275 microversion: 2.1 time: 0.100302 Mar 05 21:29:21.781358 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2927/5891] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:29:21.784872 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2965/5892] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:21 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:22.790832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a3c40729-d6c6-4547-bb1b-5dfef7b53124 req-3a391689-e102-413a-b398-7226b9ede890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1ad1748-49fc-4e24-8dba-0e532c6ef662", "tag": "de028a48-3bba-42e5-bf45-0564c7636c17"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:29:22.802146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a3c40729-d6c6-4547-bb1b-5dfef7b53124 req-3a391689-e102-413a-b398-7226b9ede890 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:22.802891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a3c40729-d6c6-4547-bb1b-5dfef7b53124 req-3a391689-e102-413a-b398-7226b9ede890 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:22.804339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3da311cf-235b-4f71-9329-f6c05703a9c5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:22.805071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3da311cf-235b-4f71-9329-f6c05703a9c5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:22.813106 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3da311cf-235b-4f71-9329-f6c05703a9c5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:22.813847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3da311cf-235b-4f71-9329-f6c05703a9c5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:22.814868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3da311cf-235b-4f71-9329-f6c05703a9c5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:22.815530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3da311cf-235b-4f71-9329-f6c05703a9c5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:22.817726 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a3c40729-d6c6-4547-bb1b-5dfef7b53124 req-3a391689-e102-413a-b398-7226b9ede890 service nova] Creating event network-changed:de028a48-3bba-42e5-bf45-0564c7636c17 for instance c1ad1748-49fc-4e24-8dba-0e532c6ef662 on nch2-master-1 Mar 05 21:29:22.822516 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a3c40729-d6c6-4547-bb1b-5dfef7b53124 req-3a391689-e102-413a-b398-7226b9ede890 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035959 Mar 05 21:29:22.823128 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2928/5893] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:29:22.958281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3da311cf-235b-4f71-9329-f6c05703a9c5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:22.965793 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3da311cf-235b-4f71-9329-f6c05703a9c5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1317 microversion: 2.1 time: 0.167174 Mar 05 21:29:22.966409 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2966/5894] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:22 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:29:23.984642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1193ae97-13e2-4826-abf6-76474cf5ebe1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:23.985317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1193ae97-13e2-4826-abf6-76474cf5ebe1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:23.991530 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1193ae97-13e2-4826-abf6-76474cf5ebe1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:23.992025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1193ae97-13e2-4826-abf6-76474cf5ebe1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:23.992805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1193ae97-13e2-4826-abf6-76474cf5ebe1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:23.993254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1193ae97-13e2-4826-abf6-76474cf5ebe1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:24.131883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1193ae97-13e2-4826-abf6-76474cf5ebe1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:24.139941 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1193ae97-13e2-4826-abf6-76474cf5ebe1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1317 microversion: 2.1 time: 0.160661 Mar 05 21:29:24.140529 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2929/5895] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:23 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:25.157285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5a8681d3-b0d1-4b57-afba-c10d84ea6124 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:25.157864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5a8681d3-b0d1-4b57-afba-c10d84ea6124 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:25.164519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a8681d3-b0d1-4b57-afba-c10d84ea6124 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:25.164973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a8681d3-b0d1-4b57-afba-c10d84ea6124 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:25.165784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a8681d3-b0d1-4b57-afba-c10d84ea6124 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:25.166227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a8681d3-b0d1-4b57-afba-c10d84ea6124 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:25.301348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5a8681d3-b0d1-4b57-afba-c10d84ea6124 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:25.308831 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5a8681d3-b0d1-4b57-afba-c10d84ea6124 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1317 microversion: 2.1 time: 0.156039 Mar 05 21:29:25.309411 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2967/5896] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:25 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:26.327887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bb356b96-6b62-42be-a943-d300a9979af0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:26.328522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bb356b96-6b62-42be-a943-d300a9979af0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:26.335262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bb356b96-6b62-42be-a943-d300a9979af0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:26.335772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bb356b96-6b62-42be-a943-d300a9979af0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:26.336568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bb356b96-6b62-42be-a943-d300a9979af0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:26.337033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bb356b96-6b62-42be-a943-d300a9979af0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:26.467785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bb356b96-6b62-42be-a943-d300a9979af0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:26.475502 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bb356b96-6b62-42be-a943-d300a9979af0 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1317 microversion: 2.1 time: 0.152676 Mar 05 21:29:26.476109 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2930/5897] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:26 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:27.110083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-26e4de33-83bf-4627-9407-34d838fde6cf req-291a95bf-0aaf-4eba-b9c0-be391535e01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1ad1748-49fc-4e24-8dba-0e532c6ef662", "name": "network-vif-plugged", "status": "completed", "tag": "de028a48-3bba-42e5-bf45-0564c7636c17"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:29:27.118537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-26e4de33-83bf-4627-9407-34d838fde6cf req-291a95bf-0aaf-4eba-b9c0-be391535e01a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:27.118995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-26e4de33-83bf-4627-9407-34d838fde6cf req-291a95bf-0aaf-4eba-b9c0-be391535e01a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:27.131733 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-26e4de33-83bf-4627-9407-34d838fde6cf req-291a95bf-0aaf-4eba-b9c0-be391535e01a service nova] Creating event network-vif-plugged:de028a48-3bba-42e5-bf45-0564c7636c17 for instance c1ad1748-49fc-4e24-8dba-0e532c6ef662 on nch2-master-1 Mar 05 21:29:27.137175 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-26e4de33-83bf-4627-9407-34d838fde6cf req-291a95bf-0aaf-4eba-b9c0-be391535e01a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032210 Mar 05 21:29:27.137811 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2968/5898] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:29:27.492917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a924ee16-4de6-4d23-9334-838f104523d8 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:27.493444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a924ee16-4de6-4d23-9334-838f104523d8 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:27.500878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a924ee16-4de6-4d23-9334-838f104523d8 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:27.501601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a924ee16-4de6-4d23-9334-838f104523d8 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:27.502380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a924ee16-4de6-4d23-9334-838f104523d8 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:27.502835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a924ee16-4de6-4d23-9334-838f104523d8 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:27.634849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a924ee16-4de6-4d23-9334-838f104523d8 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:27.642259 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a924ee16-4de6-4d23-9334-838f104523d8 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1317 microversion: 2.1 time: 0.153326 Mar 05 21:29:27.642844 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2931/5899] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:27 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:28.659860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d5ec4a19-8ae5-424d-9cd1-d41b7318823b tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:28.660571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d5ec4a19-8ae5-424d-9cd1-d41b7318823b tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:28.666800 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5ec4a19-8ae5-424d-9cd1-d41b7318823b tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:28.667256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5ec4a19-8ae5-424d-9cd1-d41b7318823b tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:28.668053 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5ec4a19-8ae5-424d-9cd1-d41b7318823b tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:28.668496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5ec4a19-8ae5-424d-9cd1-d41b7318823b tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:28.805434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d5ec4a19-8ae5-424d-9cd1-d41b7318823b tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:28.813349 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d5ec4a19-8ae5-424d-9cd1-d41b7318823b tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1506 microversion: 2.1 time: 0.158687 Mar 05 21:29:28.813932 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2969/5900] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:28 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:28.829992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f076d07-9723-4610-8c50-208188e49249 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:28.830656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5f076d07-9723-4610-8c50-208188e49249 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:28.837459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f076d07-9723-4610-8c50-208188e49249 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:28.837931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f076d07-9723-4610-8c50-208188e49249 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:28.838722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f076d07-9723-4610-8c50-208188e49249 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:28.839181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f076d07-9723-4610-8c50-208188e49249 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:28.976019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5f076d07-9723-4610-8c50-208188e49249 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:28.984021 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5f076d07-9723-4610-8c50-208188e49249 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1506 microversion: 2.1 time: 0.158450 Mar 05 21:29:28.984621 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2932/5901] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:28 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:29.001112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:29:29.002443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:29.008570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:29.009024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:29.009792 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:29.010232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:29.037200 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:29.042873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Old instance type m1.heat2, new instance type m1.heat {{(pid=141479) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 21:29:29.049579 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:29:29.050004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:29:29.050486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:29:29.050899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:29:29.051312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:29:29.113942 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ed515fe4-442a-45fc-9e60-d4817cf64beb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "POST /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662/action" status: 202 len: 0 microversion: 2.1 time: 0.117901 Mar 05 21:29:29.114558 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2970/5902] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:29:28 2022] POST /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:29:29.123375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-62d19728-bf26-44e3-9c81-a471fd9490f4 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:29.124037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-62d19728-bf26-44e3-9c81-a471fd9490f4 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:29.130217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62d19728-bf26-44e3-9c81-a471fd9490f4 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:29.130686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62d19728-bf26-44e3-9c81-a471fd9490f4 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:29.131478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62d19728-bf26-44e3-9c81-a471fd9490f4 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:29.131963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62d19728-bf26-44e3-9c81-a471fd9490f4 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:29.304738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-62d19728-bf26-44e3-9c81-a471fd9490f4 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:29.312273 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-62d19728-bf26-44e3-9c81-a471fd9490f4 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1513 microversion: 2.1 time: 0.193351 Mar 05 21:29:29.312859 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2933/5903] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:29 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:30.330520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5e69043d-ec1e-422a-a849-12d26abe7e05 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:30.331303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5e69043d-ec1e-422a-a849-12d26abe7e05 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:30.338166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e69043d-ec1e-422a-a849-12d26abe7e05 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:30.338627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e69043d-ec1e-422a-a849-12d26abe7e05 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:30.339439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e69043d-ec1e-422a-a849-12d26abe7e05 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:30.339915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e69043d-ec1e-422a-a849-12d26abe7e05 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:30.474181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5e69043d-ec1e-422a-a849-12d26abe7e05 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:30.481502 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5e69043d-ec1e-422a-a849-12d26abe7e05 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1513 microversion: 2.1 time: 0.155974 Mar 05 21:29:30.482269 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2971/5904] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:30 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:31.499189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-24c5aa24-7673-44a7-8997-6e97c8e0f519 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:31.499849 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-24c5aa24-7673-44a7-8997-6e97c8e0f519 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:31.506452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24c5aa24-7673-44a7-8997-6e97c8e0f519 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:31.506952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24c5aa24-7673-44a7-8997-6e97c8e0f519 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:31.507757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24c5aa24-7673-44a7-8997-6e97c8e0f519 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:31.508212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24c5aa24-7673-44a7-8997-6e97c8e0f519 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:31.640082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-24c5aa24-7673-44a7-8997-6e97c8e0f519 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:31.647589 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-24c5aa24-7673-44a7-8997-6e97c8e0f519 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.153068 Mar 05 21:29:31.648210 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2934/5905] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:31 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:32.665926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8b3a6ac5-841e-465e-ad4b-d26a9965a2ad tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:32.666584 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8b3a6ac5-841e-465e-ad4b-d26a9965a2ad tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:32.674818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b3a6ac5-841e-465e-ad4b-d26a9965a2ad tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:32.675275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b3a6ac5-841e-465e-ad4b-d26a9965a2ad tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:32.676090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b3a6ac5-841e-465e-ad4b-d26a9965a2ad tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:32.676535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8b3a6ac5-841e-465e-ad4b-d26a9965a2ad tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:32.807620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8b3a6ac5-841e-465e-ad4b-d26a9965a2ad tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:32.815404 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8b3a6ac5-841e-465e-ad4b-d26a9965a2ad tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.153379 Mar 05 21:29:32.816033 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2972/5906] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:32 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:33.832183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0fec31f3-c300-46c5-a0bf-46389bf41886 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:33.832822 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0fec31f3-c300-46c5-a0bf-46389bf41886 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:33.839581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fec31f3-c300-46c5-a0bf-46389bf41886 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:33.840086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fec31f3-c300-46c5-a0bf-46389bf41886 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:33.840885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fec31f3-c300-46c5-a0bf-46389bf41886 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:33.841350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0fec31f3-c300-46c5-a0bf-46389bf41886 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:33.980352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0fec31f3-c300-46c5-a0bf-46389bf41886 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:33.988348 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0fec31f3-c300-46c5-a0bf-46389bf41886 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.160241 Mar 05 21:29:33.988921 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2935/5907] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:33 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:35.006478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5ea71408-02ae-4b54-9b15-a9934b160793 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:35.007096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5ea71408-02ae-4b54-9b15-a9934b160793 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:35.014033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ea71408-02ae-4b54-9b15-a9934b160793 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:35.014487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ea71408-02ae-4b54-9b15-a9934b160793 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:35.015270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ea71408-02ae-4b54-9b15-a9934b160793 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:35.015738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ea71408-02ae-4b54-9b15-a9934b160793 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:35.425198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5ea71408-02ae-4b54-9b15-a9934b160793 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:35.432414 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5ea71408-02ae-4b54-9b15-a9934b160793 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.429845 Mar 05 21:29:35.432992 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2973/5908] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:35 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:36.449791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-82a57ae5-6c8f-426e-8f64-70122ee57551 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:36.450444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-82a57ae5-6c8f-426e-8f64-70122ee57551 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:36.459361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82a57ae5-6c8f-426e-8f64-70122ee57551 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:36.459857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82a57ae5-6c8f-426e-8f64-70122ee57551 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:36.460653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82a57ae5-6c8f-426e-8f64-70122ee57551 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:36.461106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-82a57ae5-6c8f-426e-8f64-70122ee57551 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:36.590827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-82a57ae5-6c8f-426e-8f64-70122ee57551 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:36.599032 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-82a57ae5-6c8f-426e-8f64-70122ee57551 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.153174 Mar 05 21:29:36.599612 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2936/5909] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:36 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:37.616173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7a8bb2af-fe48-48e6-b6af-9c60a7436ebf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:37.616791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7a8bb2af-fe48-48e6-b6af-9c60a7436ebf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:37.623705 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a8bb2af-fe48-48e6-b6af-9c60a7436ebf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:37.624452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a8bb2af-fe48-48e6-b6af-9c60a7436ebf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:37.625233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a8bb2af-fe48-48e6-b6af-9c60a7436ebf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:37.625680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7a8bb2af-fe48-48e6-b6af-9c60a7436ebf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:38.021537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7a8bb2af-fe48-48e6-b6af-9c60a7436ebf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:38.028966 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7a8bb2af-fe48-48e6-b6af-9c60a7436ebf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.416752 Mar 05 21:29:38.029552 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2974/5910] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:37 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:39.047322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6af9700b-117d-4276-a96b-3a54ad5c6e1d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:39.047974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6af9700b-117d-4276-a96b-3a54ad5c6e1d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:39.054695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6af9700b-117d-4276-a96b-3a54ad5c6e1d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:39.055166 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6af9700b-117d-4276-a96b-3a54ad5c6e1d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:39.055977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6af9700b-117d-4276-a96b-3a54ad5c6e1d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:39.056432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6af9700b-117d-4276-a96b-3a54ad5c6e1d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:39.191572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6af9700b-117d-4276-a96b-3a54ad5c6e1d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:39.199034 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6af9700b-117d-4276-a96b-3a54ad5c6e1d tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.156282 Mar 05 21:29:39.199613 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2937/5911] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:39 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:40.215585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1cd0aba3-74e0-46d2-8269-0ce619906bc2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:40.216148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1cd0aba3-74e0-46d2-8269-0ce619906bc2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:40.223005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cd0aba3-74e0-46d2-8269-0ce619906bc2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:40.223453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cd0aba3-74e0-46d2-8269-0ce619906bc2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:40.224260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cd0aba3-74e0-46d2-8269-0ce619906bc2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:40.224758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1cd0aba3-74e0-46d2-8269-0ce619906bc2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:40.359829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1cd0aba3-74e0-46d2-8269-0ce619906bc2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:40.367072 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1cd0aba3-74e0-46d2-8269-0ce619906bc2 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.155532 Mar 05 21:29:40.367645 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2975/5912] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:40 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:41.385183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8071d7bf-592f-4322-a051-ba49ab28c274 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:41.385845 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8071d7bf-592f-4322-a051-ba49ab28c274 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:41.393436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8071d7bf-592f-4322-a051-ba49ab28c274 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:41.393912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8071d7bf-592f-4322-a051-ba49ab28c274 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:41.394705 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8071d7bf-592f-4322-a051-ba49ab28c274 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:41.395166 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8071d7bf-592f-4322-a051-ba49ab28c274 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:41.526089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8071d7bf-592f-4322-a051-ba49ab28c274 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:41.533523 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8071d7bf-592f-4322-a051-ba49ab28c274 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.152471 Mar 05 21:29:41.534106 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2938/5913] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:41 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:42.550302 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ea19ff12-eb1f-409c-9622-054d968c98b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:42.550919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ea19ff12-eb1f-409c-9622-054d968c98b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:42.557600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea19ff12-eb1f-409c-9622-054d968c98b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:42.558084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea19ff12-eb1f-409c-9622-054d968c98b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:42.558848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea19ff12-eb1f-409c-9622-054d968c98b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:42.559286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ea19ff12-eb1f-409c-9622-054d968c98b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:42.689549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ea19ff12-eb1f-409c-9622-054d968c98b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:42.697097 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ea19ff12-eb1f-409c-9622-054d968c98b5 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.150705 Mar 05 21:29:42.697666 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2976/5914] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:42 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:43.714475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b65b9098-e6a6-466c-aba9-2e1953dd180c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:43.715108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b65b9098-e6a6-466c-aba9-2e1953dd180c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:43.722514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b65b9098-e6a6-466c-aba9-2e1953dd180c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:43.722990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b65b9098-e6a6-466c-aba9-2e1953dd180c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:43.723809 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b65b9098-e6a6-466c-aba9-2e1953dd180c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:43.724274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b65b9098-e6a6-466c-aba9-2e1953dd180c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:43.863867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b65b9098-e6a6-466c-aba9-2e1953dd180c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:43.871335 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b65b9098-e6a6-466c-aba9-2e1953dd180c tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.160829 Mar 05 21:29:43.871951 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2939/5915] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:43 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:44.889372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-47cf6ca1-562c-471c-96cc-df793063d7eb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:44.890649 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-47cf6ca1-562c-471c-96cc-df793063d7eb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:44.897444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47cf6ca1-562c-471c-96cc-df793063d7eb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:44.897900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47cf6ca1-562c-471c-96cc-df793063d7eb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:44.898670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47cf6ca1-562c-471c-96cc-df793063d7eb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:44.899110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47cf6ca1-562c-471c-96cc-df793063d7eb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:45.047244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-47cf6ca1-562c-471c-96cc-df793063d7eb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:45.054875 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-47cf6ca1-562c-471c-96cc-df793063d7eb tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.169477 Mar 05 21:29:45.055456 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2977/5916] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:44 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:46.071958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5e8239be-c1b6-4eb9-9f64-3f7f314c2a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:46.072596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5e8239be-c1b6-4eb9-9f64-3f7f314c2a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:46.079442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e8239be-c1b6-4eb9-9f64-3f7f314c2a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:46.079957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e8239be-c1b6-4eb9-9f64-3f7f314c2a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:46.080752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e8239be-c1b6-4eb9-9f64-3f7f314c2a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:46.081211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5e8239be-c1b6-4eb9-9f64-3f7f314c2a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:46.212390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5e8239be-c1b6-4eb9-9f64-3f7f314c2a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:46.220648 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5e8239be-c1b6-4eb9-9f64-3f7f314c2a85 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.152696 Mar 05 21:29:46.221243 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2940/5917] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:46 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:47.239348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-da6a617a-bea2-443b-a25d-00d22750b597 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:47.239909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-da6a617a-bea2-443b-a25d-00d22750b597 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:47.246651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da6a617a-bea2-443b-a25d-00d22750b597 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:47.247113 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da6a617a-bea2-443b-a25d-00d22750b597 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:47.247927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da6a617a-bea2-443b-a25d-00d22750b597 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:47.248376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da6a617a-bea2-443b-a25d-00d22750b597 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:47.380399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-da6a617a-bea2-443b-a25d-00d22750b597 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:47.387749 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-da6a617a-bea2-443b-a25d-00d22750b597 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.152406 Mar 05 21:29:47.388330 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2978/5918] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:47 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:48.404891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-834a7703-4342-4f92-8ea3-f502801e8b78 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:48.406092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-834a7703-4342-4f92-8ea3-f502801e8b78 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:48.412871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-834a7703-4342-4f92-8ea3-f502801e8b78 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:48.413340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-834a7703-4342-4f92-8ea3-f502801e8b78 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:48.414136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-834a7703-4342-4f92-8ea3-f502801e8b78 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:48.414599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-834a7703-4342-4f92-8ea3-f502801e8b78 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:48.544342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-834a7703-4342-4f92-8ea3-f502801e8b78 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:48.551969 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-834a7703-4342-4f92-8ea3-f502801e8b78 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.151010 Mar 05 21:29:48.556792 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2941/5919] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:48 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:49.569061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d8f4f9f8-a081-40c7-8dc4-cd9ae484fcf6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:49.569926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d8f4f9f8-a081-40c7-8dc4-cd9ae484fcf6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:49.576825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8f4f9f8-a081-40c7-8dc4-cd9ae484fcf6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:49.577904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8f4f9f8-a081-40c7-8dc4-cd9ae484fcf6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:49.578699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8f4f9f8-a081-40c7-8dc4-cd9ae484fcf6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:49.579169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8f4f9f8-a081-40c7-8dc4-cd9ae484fcf6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:49.711604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d8f4f9f8-a081-40c7-8dc4-cd9ae484fcf6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:49.719801 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d8f4f9f8-a081-40c7-8dc4-cd9ae484fcf6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.154747 Mar 05 21:29:49.720402 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2979/5920] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:49 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:50.736791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a3825282-95f9-4650-9458-4104047f3d89 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:50.737432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a3825282-95f9-4650-9458-4104047f3d89 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:50.744270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3825282-95f9-4650-9458-4104047f3d89 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:50.744749 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3825282-95f9-4650-9458-4104047f3d89 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:50.745549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3825282-95f9-4650-9458-4104047f3d89 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:50.746017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a3825282-95f9-4650-9458-4104047f3d89 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:50.877170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a3825282-95f9-4650-9458-4104047f3d89 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:50.884723 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a3825282-95f9-4650-9458-4104047f3d89 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.152518 Mar 05 21:29:50.885307 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2942/5921] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:50 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:51.901412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e4023703-418c-4148-a0f0-e06939516d21 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:51.902047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e4023703-418c-4148-a0f0-e06939516d21 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:51.909539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4023703-418c-4148-a0f0-e06939516d21 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:51.910024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4023703-418c-4148-a0f0-e06939516d21 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:51.910805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4023703-418c-4148-a0f0-e06939516d21 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:51.911257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e4023703-418c-4148-a0f0-e06939516d21 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:52.048610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e4023703-418c-4148-a0f0-e06939516d21 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:52.056106 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e4023703-418c-4148-a0f0-e06939516d21 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.158668 Mar 05 21:29:52.056693 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2980/5922] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:51 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:53.073726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-72e9fa62-7929-41c8-a960-4e2ceb2e01c3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:53.074355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-72e9fa62-7929-41c8-a960-4e2ceb2e01c3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:53.081104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72e9fa62-7929-41c8-a960-4e2ceb2e01c3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:53.081574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72e9fa62-7929-41c8-a960-4e2ceb2e01c3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:53.082356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72e9fa62-7929-41c8-a960-4e2ceb2e01c3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:53.082809 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72e9fa62-7929-41c8-a960-4e2ceb2e01c3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:53.217868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-72e9fa62-7929-41c8-a960-4e2ceb2e01c3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:53.225780 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-72e9fa62-7929-41c8-a960-4e2ceb2e01c3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.155992 Mar 05 21:29:53.226349 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2943/5923] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:53 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:54.243899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-370d7dfc-a5a6-4bdf-b030-1cc86b3a16e7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:54.244448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-370d7dfc-a5a6-4bdf-b030-1cc86b3a16e7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:54.251156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-370d7dfc-a5a6-4bdf-b030-1cc86b3a16e7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:54.251900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-370d7dfc-a5a6-4bdf-b030-1cc86b3a16e7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:54.252672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-370d7dfc-a5a6-4bdf-b030-1cc86b3a16e7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:54.253112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-370d7dfc-a5a6-4bdf-b030-1cc86b3a16e7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:54.384531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-370d7dfc-a5a6-4bdf-b030-1cc86b3a16e7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:54.392012 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-370d7dfc-a5a6-4bdf-b030-1cc86b3a16e7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.152064 Mar 05 21:29:54.392586 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2981/5924] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:54 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:55.409422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ca4f2e2f-b74c-4fe2-9a1a-a947589dd151 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:55.410070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ca4f2e2f-b74c-4fe2-9a1a-a947589dd151 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:55.416801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca4f2e2f-b74c-4fe2-9a1a-a947589dd151 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:55.417267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca4f2e2f-b74c-4fe2-9a1a-a947589dd151 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:55.418050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca4f2e2f-b74c-4fe2-9a1a-a947589dd151 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:55.418536 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca4f2e2f-b74c-4fe2-9a1a-a947589dd151 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:55.550924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ca4f2e2f-b74c-4fe2-9a1a-a947589dd151 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:55.558387 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ca4f2e2f-b74c-4fe2-9a1a-a947589dd151 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.153528 Mar 05 21:29:55.558974 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2944/5925] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:55 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:56.575467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-43cd3732-bf5d-4b60-b90a-8bcd08e134bf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:56.576135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-43cd3732-bf5d-4b60-b90a-8bcd08e134bf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:56.582662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43cd3732-bf5d-4b60-b90a-8bcd08e134bf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:56.583131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43cd3732-bf5d-4b60-b90a-8bcd08e134bf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:56.583936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43cd3732-bf5d-4b60-b90a-8bcd08e134bf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:56.584389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43cd3732-bf5d-4b60-b90a-8bcd08e134bf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:56.720619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-43cd3732-bf5d-4b60-b90a-8bcd08e134bf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:56.728002 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-43cd3732-bf5d-4b60-b90a-8bcd08e134bf tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1518 microversion: 2.1 time: 0.156622 Mar 05 21:29:56.728588 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2982/5926] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:56 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:57.745803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2782200a-cff2-4b22-a2cc-ba7fd703ed25 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:57.746445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2782200a-cff2-4b22-a2cc-ba7fd703ed25 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:57.754464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2782200a-cff2-4b22-a2cc-ba7fd703ed25 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:57.754945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2782200a-cff2-4b22-a2cc-ba7fd703ed25 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:57.755776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2782200a-cff2-4b22-a2cc-ba7fd703ed25 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:57.756239 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2782200a-cff2-4b22-a2cc-ba7fd703ed25 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:58.331087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2782200a-cff2-4b22-a2cc-ba7fd703ed25 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:58.339272 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2782200a-cff2-4b22-a2cc-ba7fd703ed25 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1517 microversion: 2.1 time: 0.597449 Mar 05 21:29:58.339897 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2945/5927] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:57 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1517 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:29:58.397397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-03acea9e-faeb-4c1f-b815-7b4ec51e18b5 req-63504d1c-bc27-45ad-b8a0-dfd1087bd018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1ad1748-49fc-4e24-8dba-0e532c6ef662", "name": "network-vif-unplugged", "status": "completed", "tag": "de028a48-3bba-42e5-bf45-0564c7636c17"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:29:58.406346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-03acea9e-faeb-4c1f-b815-7b4ec51e18b5 req-63504d1c-bc27-45ad-b8a0-dfd1087bd018 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:58.407159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-03acea9e-faeb-4c1f-b815-7b4ec51e18b5 req-63504d1c-bc27-45ad-b8a0-dfd1087bd018 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:58.418916 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-03acea9e-faeb-4c1f-b815-7b4ec51e18b5 req-63504d1c-bc27-45ad-b8a0-dfd1087bd018 service nova] Creating event network-vif-unplugged:de028a48-3bba-42e5-bf45-0564c7636c17 for instance c1ad1748-49fc-4e24-8dba-0e532c6ef662 on nch1-master-1 Mar 05 21:29:58.424569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-03acea9e-faeb-4c1f-b815-7b4ec51e18b5 req-63504d1c-bc27-45ad-b8a0-dfd1087bd018 service nova] Instance c1ad1748-49fc-4e24-8dba-0e532c6ef662 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:29:58.435360 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-03acea9e-faeb-4c1f-b815-7b4ec51e18b5 req-63504d1c-bc27-45ad-b8a0-dfd1087bd018 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041708 Mar 05 21:29:58.436199 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2983/5928] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:29:59.357049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9e3bca32-d3b9-4070-a352-c394bf96eadd tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:29:59.357676 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9e3bca32-d3b9-4070-a352-c394bf96eadd tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:29:59.364446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e3bca32-d3b9-4070-a352-c394bf96eadd tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:59.364918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e3bca32-d3b9-4070-a352-c394bf96eadd tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:59.365697 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e3bca32-d3b9-4070-a352-c394bf96eadd tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:29:59.366151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e3bca32-d3b9-4070-a352-c394bf96eadd tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:29:59.497368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9e3bca32-d3b9-4070-a352-c394bf96eadd tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:29:59.505692 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9e3bca32-d3b9-4070-a352-c394bf96eadd tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1515 microversion: 2.1 time: 0.152569 Mar 05 21:29:59.506489 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2946/5929] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:29:59 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:00.454577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-fcc5d36e-84fa-4825-a384-a68b70439921 req-86615c4a-4b94-45e9-ad1a-5915b0be76c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1ad1748-49fc-4e24-8dba-0e532c6ef662", "tag": "de028a48-3bba-42e5-bf45-0564c7636c17"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:00.462711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fcc5d36e-84fa-4825-a384-a68b70439921 req-86615c4a-4b94-45e9-ad1a-5915b0be76c1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:00.463151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fcc5d36e-84fa-4825-a384-a68b70439921 req-86615c4a-4b94-45e9-ad1a-5915b0be76c1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:00.475196 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-fcc5d36e-84fa-4825-a384-a68b70439921 req-86615c4a-4b94-45e9-ad1a-5915b0be76c1 service nova] Creating event network-changed:de028a48-3bba-42e5-bf45-0564c7636c17 for instance c1ad1748-49fc-4e24-8dba-0e532c6ef662 on nch1-master-1 Mar 05 21:30:00.480630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-fcc5d36e-84fa-4825-a384-a68b70439921 req-86615c4a-4b94-45e9-ad1a-5915b0be76c1 service nova] Instance c1ad1748-49fc-4e24-8dba-0e532c6ef662 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:30:00.492696 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-fcc5d36e-84fa-4825-a384-a68b70439921 req-86615c4a-4b94-45e9-ad1a-5915b0be76c1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044499 Mar 05 21:30:00.493309 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2984/5930] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:30:00.522903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6815a3c-df2c-419e-b872-7ab6151ca353 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:00.523587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6815a3c-df2c-419e-b872-7ab6151ca353 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:00.531237 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6815a3c-df2c-419e-b872-7ab6151ca353 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:00.532098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6815a3c-df2c-419e-b872-7ab6151ca353 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:00.533024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6815a3c-df2c-419e-b872-7ab6151ca353 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:00.533473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6815a3c-df2c-419e-b872-7ab6151ca353 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:00.854146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6815a3c-df2c-419e-b872-7ab6151ca353 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:00.862688 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6815a3c-df2c-419e-b872-7ab6151ca353 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1515 microversion: 2.1 time: 0.343942 Mar 05 21:30:00.863273 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2947/5931] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:00 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1515 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:30:01.880627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-630102f4-0e09-4f3f-b400-4c8ed6d929d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:01.881341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-630102f4-0e09-4f3f-b400-4c8ed6d929d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:01.888278 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-630102f4-0e09-4f3f-b400-4c8ed6d929d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:01.888735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-630102f4-0e09-4f3f-b400-4c8ed6d929d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:01.889510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-630102f4-0e09-4f3f-b400-4c8ed6d929d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:01.889952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-630102f4-0e09-4f3f-b400-4c8ed6d929d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:02.024773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-630102f4-0e09-4f3f-b400-4c8ed6d929d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:02.032520 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-630102f4-0e09-4f3f-b400-4c8ed6d929d1 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1512 microversion: 2.1 time: 0.156529 Mar 05 21:30:02.033094 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2985/5932] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:01 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:02.048851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4338ce2c-53da-4cf4-a4b8-30533b349e74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:02.049472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4338ce2c-53da-4cf4-a4b8-30533b349e74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:02.056262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4338ce2c-53da-4cf4-a4b8-30533b349e74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:02.056734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4338ce2c-53da-4cf4-a4b8-30533b349e74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:02.057517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4338ce2c-53da-4cf4-a4b8-30533b349e74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:02.057970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4338ce2c-53da-4cf4-a4b8-30533b349e74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:02.113647 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4338ce2c-53da-4cf4-a4b8-30533b349e74 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "POST /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662/action" status: 204 len: 0 microversion: 2.1 time: 0.068768 Mar 05 21:30:02.114294 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2948/5933] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:30:02 2022] POST /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:30:02.122336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-88327871-8463-46fc-af40-9514b4de7d2e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:02.122957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-88327871-8463-46fc-af40-9514b4de7d2e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:02.129818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88327871-8463-46fc-af40-9514b4de7d2e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:02.130271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88327871-8463-46fc-af40-9514b4de7d2e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:02.131364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88327871-8463-46fc-af40-9514b4de7d2e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:02.131631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-88327871-8463-46fc-af40-9514b4de7d2e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:02.266804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-88327871-8463-46fc-af40-9514b4de7d2e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:02.274503 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-88327871-8463-46fc-af40-9514b4de7d2e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1512 microversion: 2.1 time: 0.156014 Mar 05 21:30:02.275088 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2986/5934] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:02 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:03.293161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-24175f1a-97d7-4639-bf59-7dd08349e4de tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:03.293786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-24175f1a-97d7-4639-bf59-7dd08349e4de tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:03.300649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24175f1a-97d7-4639-bf59-7dd08349e4de tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:03.301123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24175f1a-97d7-4639-bf59-7dd08349e4de tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:03.301939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24175f1a-97d7-4639-bf59-7dd08349e4de tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:03.302416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24175f1a-97d7-4639-bf59-7dd08349e4de tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:03.441300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-24175f1a-97d7-4639-bf59-7dd08349e4de tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:03.448927 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-24175f1a-97d7-4639-bf59-7dd08349e4de tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1504 microversion: 2.1 time: 0.160918 Mar 05 21:30:03.449510 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2949/5935] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:03 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:03.465539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2c905b45-5a34-43a2-9c30-a65957329c5e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:03.466166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2c905b45-5a34-43a2-9c30-a65957329c5e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:03.473661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c905b45-5a34-43a2-9c30-a65957329c5e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:03.474122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c905b45-5a34-43a2-9c30-a65957329c5e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:03.474908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c905b45-5a34-43a2-9c30-a65957329c5e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:03.475354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2c905b45-5a34-43a2-9c30-a65957329c5e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:03.521470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e078f94e-b390-4bba-b220-54c56f6f66b7 req-87e90b45-c037-431c-944e-b725836c6d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1ad1748-49fc-4e24-8dba-0e532c6ef662", "name": "network-vif-plugged", "status": "completed", "tag": "de028a48-3bba-42e5-bf45-0564c7636c17"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:03.530183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e078f94e-b390-4bba-b220-54c56f6f66b7 req-87e90b45-c037-431c-944e-b725836c6d75 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:03.531227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e078f94e-b390-4bba-b220-54c56f6f66b7 req-87e90b45-c037-431c-944e-b725836c6d75 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:03.543277 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e078f94e-b390-4bba-b220-54c56f6f66b7 req-87e90b45-c037-431c-944e-b725836c6d75 service nova] Creating event network-vif-plugged:de028a48-3bba-42e5-bf45-0564c7636c17 for instance c1ad1748-49fc-4e24-8dba-0e532c6ef662 on nch1-master-1 Mar 05 21:30:03.549022 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e078f94e-b390-4bba-b220-54c56f6f66b7 req-87e90b45-c037-431c-944e-b725836c6d75 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031900 Mar 05 21:30:03.549857 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2950/5936] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:30:03.621176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2c905b45-5a34-43a2-9c30-a65957329c5e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:03.629593 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2c905b45-5a34-43a2-9c30-a65957329c5e tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1504 microversion: 2.1 time: 0.167897 Mar 05 21:30:03.630169 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2987/5937] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:03 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:30:03.647903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-227bdfe7-f6a5-4d3a-982d-d1a9e38f75e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:03.648629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-227bdfe7-f6a5-4d3a-982d-d1a9e38f75e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:03.654764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-227bdfe7-f6a5-4d3a-982d-d1a9e38f75e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:03.655233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-227bdfe7-f6a5-4d3a-982d-d1a9e38f75e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:03.656090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-227bdfe7-f6a5-4d3a-982d-d1a9e38f75e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:03.656693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-227bdfe7-f6a5-4d3a-982d-d1a9e38f75e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:03.797869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-227bdfe7-f6a5-4d3a-982d-d1a9e38f75e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:03.805427 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-227bdfe7-f6a5-4d3a-982d-d1a9e38f75e3 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1504 microversion: 2.1 time: 0.161761 Mar 05 21:30:03.806004 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2951/5938] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:03 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:03.821841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-75cbb364-375b-45c8-bce3-7a6572ab08f6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:03.822342 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-75cbb364-375b-45c8-bce3-7a6572ab08f6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:03.828274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75cbb364-375b-45c8-bce3-7a6572ab08f6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:03.828725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75cbb364-375b-45c8-bce3-7a6572ab08f6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:03.829495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75cbb364-375b-45c8-bce3-7a6572ab08f6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:03.829933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75cbb364-375b-45c8-bce3-7a6572ab08f6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:03.853307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-75cbb364-375b-45c8-bce3-7a6572ab08f6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:30:03.931265 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-75cbb364-375b-45c8-bce3-7a6572ab08f6 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 204 len: 0 microversion: 2.1 time: 0.112967 Mar 05 21:30:03.931968 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2988/5939] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:30:03 2022] DELETE /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:30:03.947989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-13da1487-cf13-4078-963a-7baab4106a34 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:03.948509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-13da1487-cf13-4078-963a-7baab4106a34 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:03.954699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13da1487-cf13-4078-963a-7baab4106a34 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:03.955164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13da1487-cf13-4078-963a-7baab4106a34 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:03.956023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13da1487-cf13-4078-963a-7baab4106a34 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:03.956506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13da1487-cf13-4078-963a-7baab4106a34 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:03.980093 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-13da1487-cf13-4078-963a-7baab4106a34 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:30:04.023847 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.compute.api [None req-13da1487-cf13-4078-963a-7baab4106a34 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Instance is already in deleting state, ignoring this request Mar 05 21:30:04.024683 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-13da1487-cf13-4078-963a-7baab4106a34 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 204 len: 0 microversion: 2.1 time: 0.080756 Mar 05 21:30:04.025244 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2952/5940] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:30:03 2022] DELETE /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:30:04.034385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7ffb8be6-7893-4605-9cc2-cbaa65d25d67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:04.035099 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7ffb8be6-7893-4605-9cc2-cbaa65d25d67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:04.041068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ffb8be6-7893-4605-9cc2-cbaa65d25d67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:04.041535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ffb8be6-7893-4605-9cc2-cbaa65d25d67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:04.042341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ffb8be6-7893-4605-9cc2-cbaa65d25d67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:04.042821 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7ffb8be6-7893-4605-9cc2-cbaa65d25d67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:04.176502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7ffb8be6-7893-4605-9cc2-cbaa65d25d67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:04.183867 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7ffb8be6-7893-4605-9cc2-cbaa65d25d67 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1510 microversion: 2.1 time: 0.154332 Mar 05 21:30:04.184442 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2989/5941] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:04 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:05.201153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-40200083-c9e2-42d7-a904-4524211d8efa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:05.201742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-40200083-c9e2-42d7-a904-4524211d8efa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:05.209183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-40200083-c9e2-42d7-a904-4524211d8efa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:05.209646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-40200083-c9e2-42d7-a904-4524211d8efa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:05.210448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-40200083-c9e2-42d7-a904-4524211d8efa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:05.215083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-40200083-c9e2-42d7-a904-4524211d8efa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:05.461941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-40200083-c9e2-42d7-a904-4524211d8efa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12344f6a4659469baeb7f9b3d4abc547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194eed29994ae8be33cdd34fa12d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:05.469717 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-40200083-c9e2-42d7-a904-4524211d8efa tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 200 len: 1510 microversion: 2.1 time: 0.272620 Mar 05 21:30:05.470311 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2953/5942] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:05 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:05.733830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-828e8be6-d5c1-42e4-8d30-a0a3c70153cb req-931c3cc1-0298-479e-9ee7-fe6825cfde86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1ad1748-49fc-4e24-8dba-0e532c6ef662", "name": "network-vif-deleted", "tag": "de028a48-3bba-42e5-bf45-0564c7636c17"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:05.743292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-828e8be6-d5c1-42e4-8d30-a0a3c70153cb req-931c3cc1-0298-479e-9ee7-fe6825cfde86 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:05.743859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-828e8be6-d5c1-42e4-8d30-a0a3c70153cb req-931c3cc1-0298-479e-9ee7-fe6825cfde86 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:05.755521 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-828e8be6-d5c1-42e4-8d30-a0a3c70153cb req-931c3cc1-0298-479e-9ee7-fe6825cfde86 service nova] Creating event network-vif-deleted:de028a48-3bba-42e5-bf45-0564c7636c17 for instance c1ad1748-49fc-4e24-8dba-0e532c6ef662 on nch1-master-1 Mar 05 21:30:05.760317 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-828e8be6-d5c1-42e4-8d30-a0a3c70153cb req-931c3cc1-0298-479e-9ee7-fe6825cfde86 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030364 Mar 05 21:30:05.760921 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2990/5943] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:30:06.486605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-52f9cc2a-357e-42b2-aade-20414bb908f7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:06.487239 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-52f9cc2a-357e-42b2-aade-20414bb908f7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: c1ad1748-49fc-4e24-8dba-0e532c6ef662] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:06.494121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52f9cc2a-357e-42b2-aade-20414bb908f7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:06.494595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52f9cc2a-357e-42b2-aade-20414bb908f7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:06.495385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52f9cc2a-357e-42b2-aade-20414bb908f7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:06.495887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52f9cc2a-357e-42b2-aade-20414bb908f7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:06.510279 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-52f9cc2a-357e-42b2-aade-20414bb908f7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] HTTP exception thrown: Instance c1ad1748-49fc-4e24-8dba-0e532c6ef662 could not be found. Mar 05 21:30:06.510894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-52f9cc2a-357e-42b2-aade-20414bb908f7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Returning 404 to user: Instance c1ad1748-49fc-4e24-8dba-0e532c6ef662 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:30:06.511794 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-52f9cc2a-357e-42b2-aade-20414bb908f7 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662" status: 404 len: 111 microversion: 2.1 time: 0.029275 Mar 05 21:30:06.512335 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2954/5944] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:06 2022] GET /compute/v2.1/servers/c1ad1748-49fc-4e24-8dba-0e532c6ef662 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:30:06.521699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5a88d38b-0b51-43f3-a3ef-fede65fd1281 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:06.522373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5a88d38b-0b51-43f3-a3ef-fede65fd1281 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:06.528527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a88d38b-0b51-43f3-a3ef-fede65fd1281 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:06.528991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a88d38b-0b51-43f3-a3ef-fede65fd1281 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:06.529765 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a88d38b-0b51-43f3-a3ef-fede65fd1281 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:06.530215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a88d38b-0b51-43f3-a3ef-fede65fd1281 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:06.543065 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-5a88d38b-0b51-43f3-a3ef-fede65fd1281 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] HTTP exception thrown: Instance 3e4de292-8520-4229-8d34-6b326c9b95bf could not be found. Mar 05 21:30:06.543664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5a88d38b-0b51-43f3-a3ef-fede65fd1281 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Returning 404 to user: Instance 3e4de292-8520-4229-8d34-6b326c9b95bf could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:30:06.544512 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5a88d38b-0b51-43f3-a3ef-fede65fd1281 tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 404 len: 111 microversion: 2.1 time: 0.027092 Mar 05 21:30:06.545046 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2991/5945] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:30:06 2022] DELETE /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:30:06.553368 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-70f04ba6-4ae2-46b7-80a1-0eaac48b438f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:06.553995 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-70f04ba6-4ae2-46b7-80a1-0eaac48b438f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] [instance: 3e4de292-8520-4229-8d34-6b326c9b95bf] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:06.559893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70f04ba6-4ae2-46b7-80a1-0eaac48b438f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:06.560363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70f04ba6-4ae2-46b7-80a1-0eaac48b438f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:06.561142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70f04ba6-4ae2-46b7-80a1-0eaac48b438f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:06.561624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70f04ba6-4ae2-46b7-80a1-0eaac48b438f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:06.575325 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-70f04ba6-4ae2-46b7-80a1-0eaac48b438f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] HTTP exception thrown: Instance 3e4de292-8520-4229-8d34-6b326c9b95bf could not be found. Mar 05 21:30:06.575953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-70f04ba6-4ae2-46b7-80a1-0eaac48b438f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] Returning 404 to user: Instance 3e4de292-8520-4229-8d34-6b326c9b95bf could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:30:06.576783 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-70f04ba6-4ae2-46b7-80a1-0eaac48b438f tempest-ServerDiskConfigTestJSON-312048584 tempest-ServerDiskConfigTestJSON-312048584-project] 10.222.0.15 "GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf" status: 404 len: 111 microversion: 2.1 time: 0.027328 Mar 05 21:30:06.577311 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2955/5946] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:06 2022] GET /compute/v2.1/servers/3e4de292-8520-4229-8d34-6b326c9b95bf => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:30:11.782385 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:30:11.783112 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 21:30:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:30:12.502574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6e3144e7-a491-4f4e-bdc6-c8dfa21de10c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'create', calling method: .version_select at 0x7fed4f668700>, body: {"keypair": {"name": "tempest-keypair-1237555310"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:12.517373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-6e3144e7-a491-4f4e-bdc6-c8dfa21de10c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for project 82cb16655b3348048ea81b796af0da84. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:30:12.523508 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-6e3144e7-a491-4f4e-bdc6-c8dfa21de10c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for user a2def15483f54bf282b64a4712ba0ce9 and project 82cb16655b3348048ea81b796af0da84. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:30:12.891703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-6e3144e7-a491-4f4e-bdc6-c8dfa21de10c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for project 82cb16655b3348048ea81b796af0da84. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:30:12.896624 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-6e3144e7-a491-4f4e-bdc6-c8dfa21de10c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for user a2def15483f54bf282b64a4712ba0ce9 and project 82cb16655b3348048ea81b796af0da84. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:30:12.911780 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6e3144e7-a491-4f4e-bdc6-c8dfa21de10c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.539267 Mar 05 21:30:12.912398 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2992/5947] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:30:12 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:14.524340 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1224962929", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9689e7b-ea3e-4fc4-94eb-1bf10ac2e162"}], "security_groups": [{"name": "tempest-securitygroup--1535879041"}], "key_name": "tempest-keypair-1237555310", "user_data": "}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:14.646569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] validate_networks() for [('b9689e7b-ea3e-4fc4-94eb-1bf10ac2e162', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:30:15.061222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:30:15.064535 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:30:15.065050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:30:15.066128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:30:15.066738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:30:15.084106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:15.084527 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:15.085569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:15.086018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:15.103651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for project 82cb16655b3348048ea81b796af0da84. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:30:15.109699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for user a2def15483f54bf282b64a4712ba0ce9 and project 82cb16655b3348048ea81b796af0da84. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:30:15.122476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:30:15.125413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:30:15.172988 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3bea9711-13ab-4517-b559-d052810e14fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.652966 Mar 05 21:30:15.173900 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2956/5948] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:30:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:30:15.184828 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b2d0b5d8-b744-4d9b-a011-1853827f8ab6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:15.185453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b2d0b5d8-b744-4d9b-a011-1853827f8ab6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:15.252533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b2d0b5d8-b744-4d9b-a011-1853827f8ab6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:15.259394 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b2d0b5d8-b744-4d9b-a011-1853827f8ab6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1239 microversion: 2.1 time: 0.079485 Mar 05 21:30:15.260512 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2993/5949] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:15 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:16.277696 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c66b27c2-ee34-42bc-9ae1-c02a8ed0eb5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:16.278338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c66b27c2-ee34-42bc-9ae1-c02a8ed0eb5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:16.293602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c66b27c2-ee34-42bc-9ae1-c02a8ed0eb5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:16.294129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c66b27c2-ee34-42bc-9ae1-c02a8ed0eb5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:16.295015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c66b27c2-ee34-42bc-9ae1-c02a8ed0eb5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:16.295487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c66b27c2-ee34-42bc-9ae1-c02a8ed0eb5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:16.368692 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c66b27c2-ee34-42bc-9ae1-c02a8ed0eb5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:16.378949 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c66b27c2-ee34-42bc-9ae1-c02a8ed0eb5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1297 microversion: 2.1 time: 0.105341 Mar 05 21:30:16.380543 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2957/5950] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:16 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:17.397758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-03d45658-5a28-4dbb-a5d3-b1525e107d14 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:17.399650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-03d45658-5a28-4dbb-a5d3-b1525e107d14 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:17.408388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03d45658-5a28-4dbb-a5d3-b1525e107d14 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:17.408890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03d45658-5a28-4dbb-a5d3-b1525e107d14 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:17.409690 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03d45658-5a28-4dbb-a5d3-b1525e107d14 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:17.410140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-03d45658-5a28-4dbb-a5d3-b1525e107d14 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:17.575028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-03d45658-5a28-4dbb-a5d3-b1525e107d14 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:17.583988 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-03d45658-5a28-4dbb-a5d3-b1525e107d14 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1365 microversion: 2.1 time: 0.190280 Mar 05 21:30:17.588343 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2994/5951] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:17 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:17.639070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f74b82ac-a480-48b5-b96b-90ab20637fda req-baa614b2-1129-4ff4-8cb0-dda9fb4929a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab651fe-cee4-4d8b-aa45-a691885f239d", "tag": "911883f9-5b5d-493c-8a57-c184c5c7b1c1"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:17.651495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f74b82ac-a480-48b5-b96b-90ab20637fda req-baa614b2-1129-4ff4-8cb0-dda9fb4929a3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:17.652274 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f74b82ac-a480-48b5-b96b-90ab20637fda req-baa614b2-1129-4ff4-8cb0-dda9fb4929a3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:17.667930 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f74b82ac-a480-48b5-b96b-90ab20637fda req-baa614b2-1129-4ff4-8cb0-dda9fb4929a3 service nova] Creating event network-changed:911883f9-5b5d-493c-8a57-c184c5c7b1c1 for instance fab651fe-cee4-4d8b-aa45-a691885f239d on nch1-master-1 Mar 05 21:30:17.673951 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f74b82ac-a480-48b5-b96b-90ab20637fda req-baa614b2-1129-4ff4-8cb0-dda9fb4929a3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039477 Mar 05 21:30:17.674583 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2958/5952] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:30:18.600726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cf88e100-9d02-441a-a951-aeb51fce22d9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:18.601344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cf88e100-9d02-441a-a951-aeb51fce22d9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:18.607996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf88e100-9d02-441a-a951-aeb51fce22d9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:18.608462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf88e100-9d02-441a-a951-aeb51fce22d9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:18.609483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf88e100-9d02-441a-a951-aeb51fce22d9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:18.609929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf88e100-9d02-441a-a951-aeb51fce22d9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:18.740751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cf88e100-9d02-441a-a951-aeb51fce22d9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:18.747988 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cf88e100-9d02-441a-a951-aeb51fce22d9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1365 microversion: 2.1 time: 0.151147 Mar 05 21:30:18.748559 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2995/5953] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:18 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:19.766943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a1e74fbf-0c70-4d63-932f-6e7512838660 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:19.767808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a1e74fbf-0c70-4d63-932f-6e7512838660 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:19.774887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1e74fbf-0c70-4d63-932f-6e7512838660 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:19.775370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1e74fbf-0c70-4d63-932f-6e7512838660 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:19.776206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1e74fbf-0c70-4d63-932f-6e7512838660 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:19.776673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a1e74fbf-0c70-4d63-932f-6e7512838660 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:19.920417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a1e74fbf-0c70-4d63-932f-6e7512838660 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:19.928269 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a1e74fbf-0c70-4d63-932f-6e7512838660 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1365 microversion: 2.1 time: 0.166545 Mar 05 21:30:19.928841 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2959/5954] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:19 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:20.945737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a57aea2d-ebb9-4898-95f7-a0b2ee171a7e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:20.946355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a57aea2d-ebb9-4898-95f7-a0b2ee171a7e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:20.953979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a57aea2d-ebb9-4898-95f7-a0b2ee171a7e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:20.954436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a57aea2d-ebb9-4898-95f7-a0b2ee171a7e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:20.955211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a57aea2d-ebb9-4898-95f7-a0b2ee171a7e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:20.955657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a57aea2d-ebb9-4898-95f7-a0b2ee171a7e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:21.094040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a57aea2d-ebb9-4898-95f7-a0b2ee171a7e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:21.101364 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a57aea2d-ebb9-4898-95f7-a0b2ee171a7e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1365 microversion: 2.1 time: 0.159573 Mar 05 21:30:21.102161 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2996/5955] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:20 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:21.565958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-79b87ff0-53b4-49cc-9bb8-0bb58f2b19a1 req-651e4015-c01f-47c7-b9c0-7ada54c66904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab651fe-cee4-4d8b-aa45-a691885f239d", "name": "network-vif-plugged", "status": "completed", "tag": "911883f9-5b5d-493c-8a57-c184c5c7b1c1"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:21.574931 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-79b87ff0-53b4-49cc-9bb8-0bb58f2b19a1 req-651e4015-c01f-47c7-b9c0-7ada54c66904 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:21.575394 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-79b87ff0-53b4-49cc-9bb8-0bb58f2b19a1 req-651e4015-c01f-47c7-b9c0-7ada54c66904 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:21.587183 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-79b87ff0-53b4-49cc-9bb8-0bb58f2b19a1 req-651e4015-c01f-47c7-b9c0-7ada54c66904 service nova] Creating event network-vif-plugged:911883f9-5b5d-493c-8a57-c184c5c7b1c1 for instance fab651fe-cee4-4d8b-aa45-a691885f239d on nch1-master-1 Mar 05 21:30:21.592187 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-79b87ff0-53b4-49cc-9bb8-0bb58f2b19a1 req-651e4015-c01f-47c7-b9c0-7ada54c66904 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030013 Mar 05 21:30:21.592793 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2960/5956] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:30:22.118914 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-11025efd-de3d-425d-ab27-76e0abc149b9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:22.119534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-11025efd-de3d-425d-ab27-76e0abc149b9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:22.126707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-11025efd-de3d-425d-ab27-76e0abc149b9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:22.127183 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-11025efd-de3d-425d-ab27-76e0abc149b9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:22.127977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-11025efd-de3d-425d-ab27-76e0abc149b9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:22.128425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-11025efd-de3d-425d-ab27-76e0abc149b9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:22.259345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-11025efd-de3d-425d-ab27-76e0abc149b9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:22.267627 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-11025efd-de3d-425d-ab27-76e0abc149b9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1365 microversion: 2.1 time: 0.152594 Mar 05 21:30:22.268322 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2997/5957] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:22 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:23.286820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a0913471-673b-441c-bfbf-8584b454cae3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:23.287489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a0913471-673b-441c-bfbf-8584b454cae3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:23.293760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0913471-673b-441c-bfbf-8584b454cae3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:23.294232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0913471-673b-441c-bfbf-8584b454cae3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:23.295023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0913471-673b-441c-bfbf-8584b454cae3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:23.295480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a0913471-673b-441c-bfbf-8584b454cae3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:23.431303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a0913471-673b-441c-bfbf-8584b454cae3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:23.438979 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a0913471-673b-441c-bfbf-8584b454cae3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1552 microversion: 2.1 time: 0.157573 Mar 05 21:30:23.439557 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2961/5958] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:23 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:23.456228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b28c74e5-be0b-4318-8938-dab7db3bf214 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:23.456754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b28c74e5-be0b-4318-8938-dab7db3bf214 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:23.463492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b28c74e5-be0b-4318-8938-dab7db3bf214 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:23.463986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b28c74e5-be0b-4318-8938-dab7db3bf214 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:23.464773 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b28c74e5-be0b-4318-8938-dab7db3bf214 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:23.465226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b28c74e5-be0b-4318-8938-dab7db3bf214 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:23.546875 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b28c74e5-be0b-4318-8938-dab7db3bf214 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095553 Mar 05 21:30:23.547492 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2998/5959] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 21:30:23 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:30:24.560718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-65408fb5-df2d-4da7-8a5a-e06d4cef42ec tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:24.561356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-65408fb5-df2d-4da7-8a5a-e06d4cef42ec tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:24.563988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-35d1218e-5af5-4270-8d0d-d0dd224b6ef7 req-d309d3b3-bb12-4922-a3c3-a5993c12f36b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab651fe-cee4-4d8b-aa45-a691885f239d", "tag": "911883f9-5b5d-493c-8a57-c184c5c7b1c1"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:24.569199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65408fb5-df2d-4da7-8a5a-e06d4cef42ec tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:24.569910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65408fb5-df2d-4da7-8a5a-e06d4cef42ec tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:24.570831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65408fb5-df2d-4da7-8a5a-e06d4cef42ec tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:24.571285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-65408fb5-df2d-4da7-8a5a-e06d4cef42ec tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:24.572287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-35d1218e-5af5-4270-8d0d-d0dd224b6ef7 req-d309d3b3-bb12-4922-a3c3-a5993c12f36b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:24.572880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-35d1218e-5af5-4270-8d0d-d0dd224b6ef7 req-d309d3b3-bb12-4922-a3c3-a5993c12f36b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:24.585147 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-35d1218e-5af5-4270-8d0d-d0dd224b6ef7 req-d309d3b3-bb12-4922-a3c3-a5993c12f36b service nova] Creating event network-changed:911883f9-5b5d-493c-8a57-c184c5c7b1c1 for instance fab651fe-cee4-4d8b-aa45-a691885f239d on nch1-master-1 Mar 05 21:30:24.591172 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-35d1218e-5af5-4270-8d0d-d0dd224b6ef7 req-d309d3b3-bb12-4922-a3c3-a5993c12f36b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031681 Mar 05 21:30:24.592104 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 2999/5960] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:30:24.794942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-65408fb5-df2d-4da7-8a5a-e06d4cef42ec tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:24.804482 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-65408fb5-df2d-4da7-8a5a-e06d4cef42ec tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1552 microversion: 2.1 time: 0.247656 Mar 05 21:30:24.805359 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2962/5961] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:24 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1552 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:24.821671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e70f144c-4f74-445d-8f48-084683bc2d04 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:24.822717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e70f144c-4f74-445d-8f48-084683bc2d04 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:24.830329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e70f144c-4f74-445d-8f48-084683bc2d04 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:24.830802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e70f144c-4f74-445d-8f48-084683bc2d04 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:24.831601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e70f144c-4f74-445d-8f48-084683bc2d04 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:24.832111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e70f144c-4f74-445d-8f48-084683bc2d04 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:24.972203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e70f144c-4f74-445d-8f48-084683bc2d04 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:24.982278 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e70f144c-4f74-445d-8f48-084683bc2d04 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1552 microversion: 2.1 time: 0.164769 Mar 05 21:30:24.994461 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3000/5962] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:24 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1552 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:26.001446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3b2a90bb-ae3b-4fdd-a646-0e50f0e6ce37 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:26.002083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3b2a90bb-ae3b-4fdd-a646-0e50f0e6ce37 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:26.008907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b2a90bb-ae3b-4fdd-a646-0e50f0e6ce37 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:26.009387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b2a90bb-ae3b-4fdd-a646-0e50f0e6ce37 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:26.010184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b2a90bb-ae3b-4fdd-a646-0e50f0e6ce37 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:26.010648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b2a90bb-ae3b-4fdd-a646-0e50f0e6ce37 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:26.141386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3b2a90bb-ae3b-4fdd-a646-0e50f0e6ce37 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:26.148734 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3b2a90bb-ae3b-4fdd-a646-0e50f0e6ce37 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1671 microversion: 2.1 time: 0.151740 Mar 05 21:30:26.149316 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2963/5963] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:25 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:26.165047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0e4a9b1d-b20c-453f-b0a5-8a4ad596a725 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:26.165675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0e4a9b1d-b20c-453f-b0a5-8a4ad596a725 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:26.172787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e4a9b1d-b20c-453f-b0a5-8a4ad596a725 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:26.173250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e4a9b1d-b20c-453f-b0a5-8a4ad596a725 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:26.174037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e4a9b1d-b20c-453f-b0a5-8a4ad596a725 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:26.174489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0e4a9b1d-b20c-453f-b0a5-8a4ad596a725 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:26.317735 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0e4a9b1d-b20c-453f-b0a5-8a4ad596a725 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:26.325214 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0e4a9b1d-b20c-453f-b0a5-8a4ad596a725 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1671 microversion: 2.1 time: 0.164017 Mar 05 21:30:26.325788 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3001/5964] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:26 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:26.342004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:26.343826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:26.349854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:26.350329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:26.351106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:26.351556 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:26.378324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:26.384032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Old instance type m1.heat2, new instance type m1.heat {{(pid=141478) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 21:30:26.390778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:30:26.391220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:30:26.391793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:30:26.392170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:30:26.392599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:30:26.451977 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-72ccafdc-80b6-4db5-a0dc-53a5c450f970 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d/action" status: 202 len: 0 microversion: 2.1 time: 0.113865 Mar 05 21:30:26.453337 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2964/5965] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:30:26 2022] POST /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:30:26.461594 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-660ea838-2f7f-42cb-9291-6164829dfdc9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:26.462277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-660ea838-2f7f-42cb-9291-6164829dfdc9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:26.469166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-660ea838-2f7f-42cb-9291-6164829dfdc9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:26.469629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-660ea838-2f7f-42cb-9291-6164829dfdc9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:26.470415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-660ea838-2f7f-42cb-9291-6164829dfdc9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:26.470903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-660ea838-2f7f-42cb-9291-6164829dfdc9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:26.608771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-660ea838-2f7f-42cb-9291-6164829dfdc9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:26.617300 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-660ea838-2f7f-42cb-9291-6164829dfdc9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1680 microversion: 2.1 time: 0.159683 Mar 05 21:30:26.617889 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3002/5966] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:26 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:27.636064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b0e0275d-4b06-4818-b89d-a453516ed704 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:27.636736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b0e0275d-4b06-4818-b89d-a453516ed704 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:27.643714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0e0275d-4b06-4818-b89d-a453516ed704 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:27.644194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0e0275d-4b06-4818-b89d-a453516ed704 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:27.644992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0e0275d-4b06-4818-b89d-a453516ed704 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:27.645448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b0e0275d-4b06-4818-b89d-a453516ed704 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:27.823722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b0e0275d-4b06-4818-b89d-a453516ed704 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:27.831879 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b0e0275d-4b06-4818-b89d-a453516ed704 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1680 microversion: 2.1 time: 0.200889 Mar 05 21:30:27.832785 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2965/5967] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:27 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1680 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:28.849240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6db4c913-dead-47e0-b348-026f4594fdd9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:28.849886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6db4c913-dead-47e0-b348-026f4594fdd9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:28.856392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6db4c913-dead-47e0-b348-026f4594fdd9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:28.856849 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6db4c913-dead-47e0-b348-026f4594fdd9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:28.857940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6db4c913-dead-47e0-b348-026f4594fdd9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:28.858917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6db4c913-dead-47e0-b348-026f4594fdd9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:28.997483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6db4c913-dead-47e0-b348-026f4594fdd9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:29.005387 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6db4c913-dead-47e0-b348-026f4594fdd9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.160034 Mar 05 21:30:29.005957 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3003/5968] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:28 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:30.022374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c150438-60e7-4c83-8362-85e754d6828e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:30.023002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4c150438-60e7-4c83-8362-85e754d6828e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:30.029763 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c150438-60e7-4c83-8362-85e754d6828e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:30.030304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c150438-60e7-4c83-8362-85e754d6828e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:30.031265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c150438-60e7-4c83-8362-85e754d6828e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:30.031744 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c150438-60e7-4c83-8362-85e754d6828e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:30.165727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4c150438-60e7-4c83-8362-85e754d6828e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:30.174101 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4c150438-60e7-4c83-8362-85e754d6828e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.155664 Mar 05 21:30:30.174681 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2966/5969] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:30 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:31.191708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-71bff257-c28a-43e4-95a8-293df4f577d0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:31.192253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-71bff257-c28a-43e4-95a8-293df4f577d0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:31.198929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71bff257-c28a-43e4-95a8-293df4f577d0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:31.199383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71bff257-c28a-43e4-95a8-293df4f577d0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:31.200191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71bff257-c28a-43e4-95a8-293df4f577d0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:31.200631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71bff257-c28a-43e4-95a8-293df4f577d0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:31.340329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-71bff257-c28a-43e4-95a8-293df4f577d0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:31.348180 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-71bff257-c28a-43e4-95a8-293df4f577d0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.160645 Mar 05 21:30:31.348772 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3004/5970] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:31 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:32.365258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2df04872-6fa9-415d-98ba-ca9131ec91b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:32.365910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2df04872-6fa9-415d-98ba-ca9131ec91b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:32.372819 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2df04872-6fa9-415d-98ba-ca9131ec91b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:32.373290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2df04872-6fa9-415d-98ba-ca9131ec91b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:32.374194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2df04872-6fa9-415d-98ba-ca9131ec91b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:32.374689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2df04872-6fa9-415d-98ba-ca9131ec91b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:32.507497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2df04872-6fa9-415d-98ba-ca9131ec91b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:32.515361 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2df04872-6fa9-415d-98ba-ca9131ec91b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.153538 Mar 05 21:30:32.516115 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2967/5971] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:32 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:33.533181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-29a73dd1-0e22-4103-b0ed-a46ba1af155a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:33.534400 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-29a73dd1-0e22-4103-b0ed-a46ba1af155a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:33.541151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29a73dd1-0e22-4103-b0ed-a46ba1af155a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:33.541607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29a73dd1-0e22-4103-b0ed-a46ba1af155a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:33.542387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29a73dd1-0e22-4103-b0ed-a46ba1af155a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:33.542834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29a73dd1-0e22-4103-b0ed-a46ba1af155a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:33.677289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-29a73dd1-0e22-4103-b0ed-a46ba1af155a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:33.684959 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-29a73dd1-0e22-4103-b0ed-a46ba1af155a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.156193 Mar 05 21:30:33.685630 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3005/5972] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:33 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:34.702927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5652273b-6416-4d0a-bdd6-6d1a36abfd5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:34.703775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5652273b-6416-4d0a-bdd6-6d1a36abfd5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:34.710316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5652273b-6416-4d0a-bdd6-6d1a36abfd5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:34.710781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5652273b-6416-4d0a-bdd6-6d1a36abfd5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:34.711560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5652273b-6416-4d0a-bdd6-6d1a36abfd5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:34.712042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5652273b-6416-4d0a-bdd6-6d1a36abfd5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:34.841954 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5652273b-6416-4d0a-bdd6-6d1a36abfd5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:34.849415 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5652273b-6416-4d0a-bdd6-6d1a36abfd5a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.150526 Mar 05 21:30:34.849992 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2968/5973] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:34 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:35.868039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-154395e4-8874-42a9-90ff-d3b2af7588cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:35.868657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-154395e4-8874-42a9-90ff-d3b2af7588cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:35.876595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-154395e4-8874-42a9-90ff-d3b2af7588cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:35.877050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-154395e4-8874-42a9-90ff-d3b2af7588cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:35.877820 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-154395e4-8874-42a9-90ff-d3b2af7588cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:35.878270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-154395e4-8874-42a9-90ff-d3b2af7588cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:36.010338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-154395e4-8874-42a9-90ff-d3b2af7588cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:36.018854 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-154395e4-8874-42a9-90ff-d3b2af7588cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.154751 Mar 05 21:30:36.019432 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3006/5974] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:35 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:37.036165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b076a851-d3a2-455e-ad3d-742c6d941fd0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:37.036798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b076a851-d3a2-455e-ad3d-742c6d941fd0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:37.043534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b076a851-d3a2-455e-ad3d-742c6d941fd0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:37.044056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b076a851-d3a2-455e-ad3d-742c6d941fd0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:37.044844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b076a851-d3a2-455e-ad3d-742c6d941fd0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:37.045297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b076a851-d3a2-455e-ad3d-742c6d941fd0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:37.188647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b076a851-d3a2-455e-ad3d-742c6d941fd0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:37.196095 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b076a851-d3a2-455e-ad3d-742c6d941fd0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.163961 Mar 05 21:30:37.196665 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2969/5975] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:37 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:38.213261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7e3910fc-580c-4d4b-aa91-4e34a51053a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:38.213795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7e3910fc-580c-4d4b-aa91-4e34a51053a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:38.221307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e3910fc-580c-4d4b-aa91-4e34a51053a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:38.221767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e3910fc-580c-4d4b-aa91-4e34a51053a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:38.222536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e3910fc-580c-4d4b-aa91-4e34a51053a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:38.222977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7e3910fc-580c-4d4b-aa91-4e34a51053a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:38.354373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7e3910fc-580c-4d4b-aa91-4e34a51053a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:38.362095 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7e3910fc-580c-4d4b-aa91-4e34a51053a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.152842 Mar 05 21:30:38.362651 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3007/5976] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:38 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:39.380513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-196358c7-e9f0-4ada-ab1d-96968ec8ea51 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:39.381153 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-196358c7-e9f0-4ada-ab1d-96968ec8ea51 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:39.388027 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-196358c7-e9f0-4ada-ab1d-96968ec8ea51 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:39.388511 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-196358c7-e9f0-4ada-ab1d-96968ec8ea51 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:39.389297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-196358c7-e9f0-4ada-ab1d-96968ec8ea51 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:39.389756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-196358c7-e9f0-4ada-ab1d-96968ec8ea51 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:39.521276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-196358c7-e9f0-4ada-ab1d-96968ec8ea51 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:39.528794 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-196358c7-e9f0-4ada-ab1d-96968ec8ea51 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.152678 Mar 05 21:30:39.529371 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2970/5977] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:39 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:40.546379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-232ee129-432f-4226-b036-ca699a95fb7f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:40.547535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-232ee129-432f-4226-b036-ca699a95fb7f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:40.554613 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-232ee129-432f-4226-b036-ca699a95fb7f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:40.555078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-232ee129-432f-4226-b036-ca699a95fb7f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:40.555898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-232ee129-432f-4226-b036-ca699a95fb7f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:40.556348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-232ee129-432f-4226-b036-ca699a95fb7f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:40.691994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-232ee129-432f-4226-b036-ca699a95fb7f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:40.699378 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-232ee129-432f-4226-b036-ca699a95fb7f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.156967 Mar 05 21:30:40.699992 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3008/5978] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:40 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:41.716806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f2cd1211-2984-419b-9c36-81454685fdb2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:41.717437 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f2cd1211-2984-419b-9c36-81454685fdb2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:41.724528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2cd1211-2984-419b-9c36-81454685fdb2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:41.724996 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2cd1211-2984-419b-9c36-81454685fdb2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:41.725781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2cd1211-2984-419b-9c36-81454685fdb2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:41.726235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f2cd1211-2984-419b-9c36-81454685fdb2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:41.865016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f2cd1211-2984-419b-9c36-81454685fdb2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:41.872384 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f2cd1211-2984-419b-9c36-81454685fdb2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.159591 Mar 05 21:30:41.872960 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2971/5979] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:41 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:42.889893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-093ddd71-b92a-45f2-93c0-dd0d268d98c6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:42.891638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-093ddd71-b92a-45f2-93c0-dd0d268d98c6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:42.897815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-093ddd71-b92a-45f2-93c0-dd0d268d98c6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:42.898273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-093ddd71-b92a-45f2-93c0-dd0d268d98c6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:42.899043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-093ddd71-b92a-45f2-93c0-dd0d268d98c6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:42.899486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-093ddd71-b92a-45f2-93c0-dd0d268d98c6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:43.034452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-093ddd71-b92a-45f2-93c0-dd0d268d98c6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:43.041826 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-093ddd71-b92a-45f2-93c0-dd0d268d98c6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.155879 Mar 05 21:30:43.042411 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3009/5980] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:42 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:44.059006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3b49f773-c253-4fa0-9c20-581113cf4aef tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:44.059623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3b49f773-c253-4fa0-9c20-581113cf4aef tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:44.068233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b49f773-c253-4fa0-9c20-581113cf4aef tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:44.068701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b49f773-c253-4fa0-9c20-581113cf4aef tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:44.069486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b49f773-c253-4fa0-9c20-581113cf4aef tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:44.069939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b49f773-c253-4fa0-9c20-581113cf4aef tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:44.209035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3b49f773-c253-4fa0-9c20-581113cf4aef tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:44.218727 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3b49f773-c253-4fa0-9c20-581113cf4aef tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1685 microversion: 2.1 time: 0.163708 Mar 05 21:30:44.220045 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2972/5981] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:44 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:45.239799 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0c873205-4bc3-494e-adf3-79a6bd58d491 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:45.240373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0c873205-4bc3-494e-adf3-79a6bd58d491 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:45.247630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c873205-4bc3-494e-adf3-79a6bd58d491 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:45.248131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c873205-4bc3-494e-adf3-79a6bd58d491 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:45.248921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c873205-4bc3-494e-adf3-79a6bd58d491 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:45.249362 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c873205-4bc3-494e-adf3-79a6bd58d491 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:45.385370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0c873205-4bc3-494e-adf3-79a6bd58d491 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:45.393892 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0c873205-4bc3-494e-adf3-79a6bd58d491 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1684 microversion: 2.1 time: 0.159443 Mar 05 21:30:45.394487 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3010/5982] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:45 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:45.530284 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-d7674cc8-b444-4700-b33b-1d83b55869d3 req-eac0dbda-4e38-4415-8aad-2da2a8e623aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab651fe-cee4-4d8b-aa45-a691885f239d", "name": "network-vif-unplugged", "status": "completed", "tag": "911883f9-5b5d-493c-8a57-c184c5c7b1c1"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:45.539787 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d7674cc8-b444-4700-b33b-1d83b55869d3 req-eac0dbda-4e38-4415-8aad-2da2a8e623aa service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:45.540199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-d7674cc8-b444-4700-b33b-1d83b55869d3 req-eac0dbda-4e38-4415-8aad-2da2a8e623aa service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:45.552623 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-d7674cc8-b444-4700-b33b-1d83b55869d3 req-eac0dbda-4e38-4415-8aad-2da2a8e623aa service nova] Creating event network-vif-unplugged:911883f9-5b5d-493c-8a57-c184c5c7b1c1 for instance fab651fe-cee4-4d8b-aa45-a691885f239d on nch2-master-1 Mar 05 21:30:45.558041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-d7674cc8-b444-4700-b33b-1d83b55869d3 req-eac0dbda-4e38-4415-8aad-2da2a8e623aa service nova] Instance fab651fe-cee4-4d8b-aa45-a691885f239d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:30:45.569130 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-d7674cc8-b444-4700-b33b-1d83b55869d3 req-eac0dbda-4e38-4415-8aad-2da2a8e623aa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042635 Mar 05 21:30:45.569807 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2973/5983] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:30:46.410732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1703792d-a109-4460-b85c-01006d7d47e8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:46.411357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1703792d-a109-4460-b85c-01006d7d47e8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:46.418825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1703792d-a109-4460-b85c-01006d7d47e8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:46.419288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1703792d-a109-4460-b85c-01006d7d47e8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:46.420390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1703792d-a109-4460-b85c-01006d7d47e8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:46.421470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1703792d-a109-4460-b85c-01006d7d47e8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:46.560328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1703792d-a109-4460-b85c-01006d7d47e8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:46.570231 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1703792d-a109-4460-b85c-01006d7d47e8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1684 microversion: 2.1 time: 0.163586 Mar 05 21:30:46.570999 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3011/5984] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:46 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:47.587549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-ef907a24-7367-4db1-a83b-b74635ad8caf req-b9b0341c-2348-44c7-a248-cb54e44ed054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab651fe-cee4-4d8b-aa45-a691885f239d", "tag": "911883f9-5b5d-493c-8a57-c184c5c7b1c1"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:47.588094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5eb281da-090f-47f5-9c2c-95e1ce71fe78 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:47.588469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5eb281da-090f-47f5-9c2c-95e1ce71fe78 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:47.595970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eb281da-090f-47f5-9c2c-95e1ce71fe78 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:47.596428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eb281da-090f-47f5-9c2c-95e1ce71fe78 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:47.597252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eb281da-090f-47f5-9c2c-95e1ce71fe78 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:47.597699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5eb281da-090f-47f5-9c2c-95e1ce71fe78 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:47.597857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ef907a24-7367-4db1-a83b-b74635ad8caf req-b9b0341c-2348-44c7-a248-cb54e44ed054 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:47.598246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ef907a24-7367-4db1-a83b-b74635ad8caf req-b9b0341c-2348-44c7-a248-cb54e44ed054 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:47.610136 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ef907a24-7367-4db1-a83b-b74635ad8caf req-b9b0341c-2348-44c7-a248-cb54e44ed054 service nova] Creating event network-changed:911883f9-5b5d-493c-8a57-c184c5c7b1c1 for instance fab651fe-cee4-4d8b-aa45-a691885f239d on nch2-master-1 Mar 05 21:30:47.616912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-ef907a24-7367-4db1-a83b-b74635ad8caf req-b9b0341c-2348-44c7-a248-cb54e44ed054 service nova] Instance fab651fe-cee4-4d8b-aa45-a691885f239d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:30:47.628078 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-ef907a24-7367-4db1-a83b-b74635ad8caf req-b9b0341c-2348-44c7-a248-cb54e44ed054 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045480 Mar 05 21:30:47.628703 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2974/5985] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:30:47.736938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5eb281da-090f-47f5-9c2c-95e1ce71fe78 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:47.744702 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5eb281da-090f-47f5-9c2c-95e1ce71fe78 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1682 microversion: 2.1 time: 0.160869 Mar 05 21:30:47.745377 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3012/5986] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:47 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:30:48.764083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3144fde4-8b74-4796-a0af-139cb91d7eac tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:48.764797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3144fde4-8b74-4796-a0af-139cb91d7eac tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:48.771708 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3144fde4-8b74-4796-a0af-139cb91d7eac tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:48.772133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3144fde4-8b74-4796-a0af-139cb91d7eac tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:48.772917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3144fde4-8b74-4796-a0af-139cb91d7eac tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:48.773369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3144fde4-8b74-4796-a0af-139cb91d7eac tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:48.906828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3144fde4-8b74-4796-a0af-139cb91d7eac tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:48.914301 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3144fde4-8b74-4796-a0af-139cb91d7eac tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1679 microversion: 2.1 time: 0.155350 Mar 05 21:30:48.914868 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2975/5987] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:48 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:48.930469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eddad81f-6491-4bc5-af45-f2a81afb6453 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:48.931021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eddad81f-6491-4bc5-af45-f2a81afb6453 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:48.937833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eddad81f-6491-4bc5-af45-f2a81afb6453 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:48.938836 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eddad81f-6491-4bc5-af45-f2a81afb6453 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:48.939855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eddad81f-6491-4bc5-af45-f2a81afb6453 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:48.940312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eddad81f-6491-4bc5-af45-f2a81afb6453 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:48.996547 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eddad81f-6491-4bc5-af45-f2a81afb6453 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d/action" status: 204 len: 0 microversion: 2.1 time: 0.069847 Mar 05 21:30:48.997193 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3013/5988] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:30:48 2022] POST /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:30:49.006620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-453d71e1-681d-487b-8269-285db516b207 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:49.007350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-453d71e1-681d-487b-8269-285db516b207 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:49.013463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-453d71e1-681d-487b-8269-285db516b207 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:49.013943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-453d71e1-681d-487b-8269-285db516b207 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:49.014782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-453d71e1-681d-487b-8269-285db516b207 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:49.015236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-453d71e1-681d-487b-8269-285db516b207 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:49.239610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-453d71e1-681d-487b-8269-285db516b207 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:49.248347 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-453d71e1-681d-487b-8269-285db516b207 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1679 microversion: 2.1 time: 0.245749 Mar 05 21:30:49.248930 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2976/5989] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:49 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1679 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:50.268081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-55fdac70-0aad-4033-8854-294d72cc8f89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:50.268984 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-55fdac70-0aad-4033-8854-294d72cc8f89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:50.275805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55fdac70-0aad-4033-8854-294d72cc8f89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:50.276269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55fdac70-0aad-4033-8854-294d72cc8f89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:50.277084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55fdac70-0aad-4033-8854-294d72cc8f89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:50.277530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55fdac70-0aad-4033-8854-294d72cc8f89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:50.417553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-55fdac70-0aad-4033-8854-294d72cc8f89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:50.425566 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-55fdac70-0aad-4033-8854-294d72cc8f89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1671 microversion: 2.1 time: 0.162820 Mar 05 21:30:50.426139 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3014/5990] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:50 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:50.441944 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d4671dbe-5e0b-4964-a267-a4167b096ba0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:50.442589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d4671dbe-5e0b-4964-a267-a4167b096ba0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:50.449409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4671dbe-5e0b-4964-a267-a4167b096ba0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:50.449886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4671dbe-5e0b-4964-a267-a4167b096ba0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:50.450712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4671dbe-5e0b-4964-a267-a4167b096ba0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:50.451173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d4671dbe-5e0b-4964-a267-a4167b096ba0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:50.585836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d4671dbe-5e0b-4964-a267-a4167b096ba0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:50.593254 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d4671dbe-5e0b-4964-a267-a4167b096ba0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1671 microversion: 2.1 time: 0.155334 Mar 05 21:30:50.593828 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2977/5991] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:50 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:50.610172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fc6cacc4-73ea-4b44-9652-511e0a9a3299 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:50.611347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fc6cacc4-73ea-4b44-9652-511e0a9a3299 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:50.617331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc6cacc4-73ea-4b44-9652-511e0a9a3299 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:50.617797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc6cacc4-73ea-4b44-9652-511e0a9a3299 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:50.618609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc6cacc4-73ea-4b44-9652-511e0a9a3299 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:50.619063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fc6cacc4-73ea-4b44-9652-511e0a9a3299 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:50.756827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fc6cacc4-73ea-4b44-9652-511e0a9a3299 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:50.765373 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fc6cacc4-73ea-4b44-9652-511e0a9a3299 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1671 microversion: 2.1 time: 0.159166 Mar 05 21:30:50.765956 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3015/5992] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:50 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:50.783951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fb4ba73b-c10d-403f-82a7-81be03731f05 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:50.784477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fb4ba73b-c10d-403f-82a7-81be03731f05 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:50.790642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb4ba73b-c10d-403f-82a7-81be03731f05 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:50.791106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb4ba73b-c10d-403f-82a7-81be03731f05 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:50.791927 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb4ba73b-c10d-403f-82a7-81be03731f05 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:50.792382 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb4ba73b-c10d-403f-82a7-81be03731f05 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:50.817194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fb4ba73b-c10d-403f-82a7-81be03731f05 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:30:50.902994 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fb4ba73b-c10d-403f-82a7-81be03731f05 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 204 len: 0 microversion: 2.1 time: 0.124076 Mar 05 21:30:50.904198 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2978/5993] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:30:50 2022] DELETE /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:30:50.914084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-82bb73ff-9a40-48f3-8f71-09d6e63425b4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:50.914962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-82bb73ff-9a40-48f3-8f71-09d6e63425b4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:50.921271 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82bb73ff-9a40-48f3-8f71-09d6e63425b4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:50.921737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82bb73ff-9a40-48f3-8f71-09d6e63425b4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:50.922544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82bb73ff-9a40-48f3-8f71-09d6e63425b4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:50.923709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82bb73ff-9a40-48f3-8f71-09d6e63425b4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:51.064111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-82bb73ff-9a40-48f3-8f71-09d6e63425b4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:51.071612 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-82bb73ff-9a40-48f3-8f71-09d6e63425b4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1677 microversion: 2.1 time: 0.162417 Mar 05 21:30:51.072372 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3016/5994] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:50 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:52.089507 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-acb7834c-4839-4917-98af-dd5a9905f918 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:52.090263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-acb7834c-4839-4917-98af-dd5a9905f918 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:52.097987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-acb7834c-4839-4917-98af-dd5a9905f918 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:52.098463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-acb7834c-4839-4917-98af-dd5a9905f918 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:52.099253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-acb7834c-4839-4917-98af-dd5a9905f918 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:52.099741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-acb7834c-4839-4917-98af-dd5a9905f918 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:52.324939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-acb7834c-4839-4917-98af-dd5a9905f918 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:52.333541 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-acb7834c-4839-4917-98af-dd5a9905f918 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1677 microversion: 2.1 time: 0.248376 Mar 05 21:30:52.334154 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2979/5995] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:52 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1677 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:53.352311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fbadc562-d5ed-4107-a5cb-d461d7649994 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:53.353146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fbadc562-d5ed-4107-a5cb-d461d7649994 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:53.360425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbadc562-d5ed-4107-a5cb-d461d7649994 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:53.361110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbadc562-d5ed-4107-a5cb-d461d7649994 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:53.362117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbadc562-d5ed-4107-a5cb-d461d7649994 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:53.362954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fbadc562-d5ed-4107-a5cb-d461d7649994 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:53.415984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-ebe216a9-1e22-4e44-8f8a-ddabf46331f2 req-1c86f094-066e-43b8-9ae6-dcb7609ba8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab651fe-cee4-4d8b-aa45-a691885f239d", "name": "network-vif-deleted", "tag": "911883f9-5b5d-493c-8a57-c184c5c7b1c1"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:53.430321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ebe216a9-1e22-4e44-8f8a-ddabf46331f2 req-1c86f094-066e-43b8-9ae6-dcb7609ba8a1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:53.430781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ebe216a9-1e22-4e44-8f8a-ddabf46331f2 req-1c86f094-066e-43b8-9ae6-dcb7609ba8a1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:53.445679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fbadc562-d5ed-4107-a5cb-d461d7649994 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:53.451567 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ebe216a9-1e22-4e44-8f8a-ddabf46331f2 req-1c86f094-066e-43b8-9ae6-dcb7609ba8a1 service nova] Creating event network-vif-deleted:911883f9-5b5d-493c-8a57-c184c5c7b1c1 for instance fab651fe-cee4-4d8b-aa45-a691885f239d on nch2-master-1 Mar 05 21:30:53.455339 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fbadc562-d5ed-4107-a5cb-d461d7649994 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 200 len: 1609 microversion: 2.1 time: 0.105734 Mar 05 21:30:53.456395 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3017/5996] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:53 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 1609 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:53.458999 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-ebe216a9-1e22-4e44-8f8a-ddabf46331f2 req-1c86f094-066e-43b8-9ae6-dcb7609ba8a1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046544 Mar 05 21:30:53.459876 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2980/5997] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:30:54.473909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0a97fe3-9ab5-4262-ad4d-88747a1a6693 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:54.474531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e0a97fe3-9ab5-4262-ad4d-88747a1a6693 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:54.481671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a97fe3-9ab5-4262-ad4d-88747a1a6693 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:54.481830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a97fe3-9ab5-4262-ad4d-88747a1a6693 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:54.482599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a97fe3-9ab5-4262-ad4d-88747a1a6693 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:54.483047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e0a97fe3-9ab5-4262-ad4d-88747a1a6693 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:54.496911 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-e0a97fe3-9ab5-4262-ad4d-88747a1a6693 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance fab651fe-cee4-4d8b-aa45-a691885f239d could not be found. Mar 05 21:30:54.497520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e0a97fe3-9ab5-4262-ad4d-88747a1a6693 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance fab651fe-cee4-4d8b-aa45-a691885f239d could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:30:54.498371 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e0a97fe3-9ab5-4262-ad4d-88747a1a6693 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 404 len: 111 microversion: 2.1 time: 0.029541 Mar 05 21:30:54.498933 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3018/5998] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:54 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:30:54.513252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6c37d6f4-59a2-4298-a7ca-35058ed63536 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:54.514593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6c37d6f4-59a2-4298-a7ca-35058ed63536 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:54.522884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c37d6f4-59a2-4298-a7ca-35058ed63536 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:54.523797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c37d6f4-59a2-4298-a7ca-35058ed63536 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:54.524977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c37d6f4-59a2-4298-a7ca-35058ed63536 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:54.525662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c37d6f4-59a2-4298-a7ca-35058ed63536 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:54.541586 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-6c37d6f4-59a2-4298-a7ca-35058ed63536 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance fab651fe-cee4-4d8b-aa45-a691885f239d could not be found. Mar 05 21:30:54.542217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6c37d6f4-59a2-4298-a7ca-35058ed63536 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance fab651fe-cee4-4d8b-aa45-a691885f239d could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:30:54.543099 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6c37d6f4-59a2-4298-a7ca-35058ed63536 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 404 len: 111 microversion: 2.1 time: 0.034226 Mar 05 21:30:54.543695 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2981/5999] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:54 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:30:54.591578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-444082539", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "b9689e7b-ea3e-4fc4-94eb-1bf10ac2e162"}], "security_groups": [{"name": "tempest-securitygroup--1535879041"}], "key_name": "tempest-keypair-1237555310", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:54.693180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] validate_networks() for [('b9689e7b-ea3e-4fc4-94eb-1bf10ac2e162', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:30:55.347084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:30:55.347518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:30:55.348062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:30:55.348481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:30:55.348900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:30:55.357673 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:55.358132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:55.358947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:55.359392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:55.375611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for project 82cb16655b3348048ea81b796af0da84. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:30:55.381114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for user a2def15483f54bf282b64a4712ba0ce9 and project 82cb16655b3348048ea81b796af0da84. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:30:55.394375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:30:55.396719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:30:55.443806 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a26c8526-b80c-42c7-9683-050371ee526a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.856057 Mar 05 21:30:55.444691 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3019/6000] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:30:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:30:55.455081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f77170f5-5d28-437d-9a44-a16b3b7006c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:55.455825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f77170f5-5d28-437d-9a44-a16b3b7006c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:55.508693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f77170f5-5d28-437d-9a44-a16b3b7006c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:55.515794 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f77170f5-5d28-437d-9a44-a16b3b7006c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1238 microversion: 2.1 time: 0.065043 Mar 05 21:30:55.517084 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2982/6001] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:55 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:56.535065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-83a4b425-15e7-4b7e-a714-e1acaa9ca186 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:56.535693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-83a4b425-15e7-4b7e-a714-e1acaa9ca186 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:56.542529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a4b425-15e7-4b7e-a714-e1acaa9ca186 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:56.542979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a4b425-15e7-4b7e-a714-e1acaa9ca186 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:56.543788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a4b425-15e7-4b7e-a714-e1acaa9ca186 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:56.544232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-83a4b425-15e7-4b7e-a714-e1acaa9ca186 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:56.605154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-83a4b425-15e7-4b7e-a714-e1acaa9ca186 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:56.613805 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-83a4b425-15e7-4b7e-a714-e1acaa9ca186 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1296 microversion: 2.1 time: 0.083956 Mar 05 21:30:56.614447 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3020/6002] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:56 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:30:57.633903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9af49824-85a6-4993-b341-9d1ef5e9b9af tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:57.634565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9af49824-85a6-4993-b341-9d1ef5e9b9af tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:57.644177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9af49824-85a6-4993-b341-9d1ef5e9b9af tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:57.644973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9af49824-85a6-4993-b341-9d1ef5e9b9af tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:57.646003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9af49824-85a6-4993-b341-9d1ef5e9b9af tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:57.646677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9af49824-85a6-4993-b341-9d1ef5e9b9af tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:57.647759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-70138bbe-8f8e-4610-b082-35c83070d61c req-580cdcec-ccd1-48ca-8f2c-e3e43ee92a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2974512-1028-498a-b3ee-523fe4594c22", "tag": "27963ca3-af30-4494-b232-7a8a3697cf20"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:30:57.659387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-70138bbe-8f8e-4610-b082-35c83070d61c req-580cdcec-ccd1-48ca-8f2c-e3e43ee92a89 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:57.660260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-70138bbe-8f8e-4610-b082-35c83070d61c req-580cdcec-ccd1-48ca-8f2c-e3e43ee92a89 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:57.673621 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-70138bbe-8f8e-4610-b082-35c83070d61c req-580cdcec-ccd1-48ca-8f2c-e3e43ee92a89 service nova] Creating event network-changed:27963ca3-af30-4494-b232-7a8a3697cf20 for instance b2974512-1028-498a-b3ee-523fe4594c22 on nch1-master-1 Mar 05 21:30:57.682303 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-70138bbe-8f8e-4610-b082-35c83070d61c req-580cdcec-ccd1-48ca-8f2c-e3e43ee92a89 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038178 Mar 05 21:30:57.687912 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3021/6003] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:30:57.905644 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9af49824-85a6-4993-b341-9d1ef5e9b9af tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:57.914908 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9af49824-85a6-4993-b341-9d1ef5e9b9af tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1364 microversion: 2.1 time: 0.286137 Mar 05 21:30:57.915508 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2983/6004] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:57 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:30:58.934678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c8638f86-ee46-442c-88ee-f751fcb314dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:30:58.935394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c8638f86-ee46-442c-88ee-f751fcb314dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:30:58.942349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8638f86-ee46-442c-88ee-f751fcb314dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:58.942810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8638f86-ee46-442c-88ee-f751fcb314dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:58.943596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8638f86-ee46-442c-88ee-f751fcb314dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:30:58.944073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8638f86-ee46-442c-88ee-f751fcb314dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:30:59.075165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c8638f86-ee46-442c-88ee-f751fcb314dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:30:59.082693 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c8638f86-ee46-442c-88ee-f751fcb314dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1364 microversion: 2.1 time: 0.153059 Mar 05 21:30:59.083269 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3022/6005] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:30:58 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:00.100186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-62289df1-a282-4b65-9bc5-903462c029dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:00.100827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-62289df1-a282-4b65-9bc5-903462c029dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:00.107433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62289df1-a282-4b65-9bc5-903462c029dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:00.107898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62289df1-a282-4b65-9bc5-903462c029dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:00.108704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62289df1-a282-4b65-9bc5-903462c029dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:00.109167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-62289df1-a282-4b65-9bc5-903462c029dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:00.243179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-62289df1-a282-4b65-9bc5-903462c029dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:00.251315 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-62289df1-a282-4b65-9bc5-903462c029dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1364 microversion: 2.1 time: 0.154344 Mar 05 21:31:00.251976 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2984/6006] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:00 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:01.270988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-225b64e3-b118-41d8-962c-26f52304aa35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:01.271601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-225b64e3-b118-41d8-962c-26f52304aa35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:01.278363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-225b64e3-b118-41d8-962c-26f52304aa35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:01.278818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-225b64e3-b118-41d8-962c-26f52304aa35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:01.279589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-225b64e3-b118-41d8-962c-26f52304aa35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:01.280066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-225b64e3-b118-41d8-962c-26f52304aa35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:01.416331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-225b64e3-b118-41d8-962c-26f52304aa35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:01.424171 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-225b64e3-b118-41d8-962c-26f52304aa35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1364 microversion: 2.1 time: 0.158821 Mar 05 21:31:01.424792 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3023/6007] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:01 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:01.775287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-c9bd56d0-3a1e-4ce6-a176-bf3cba98cf2c req-c37c993a-93a4-4c94-bee3-f2898bb526bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2974512-1028-498a-b3ee-523fe4594c22", "name": "network-vif-plugged", "status": "completed", "tag": "27963ca3-af30-4494-b232-7a8a3697cf20"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:01.786035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c9bd56d0-3a1e-4ce6-a176-bf3cba98cf2c req-c37c993a-93a4-4c94-bee3-f2898bb526bb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:01.786651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c9bd56d0-3a1e-4ce6-a176-bf3cba98cf2c req-c37c993a-93a4-4c94-bee3-f2898bb526bb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:01.800729 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-c9bd56d0-3a1e-4ce6-a176-bf3cba98cf2c req-c37c993a-93a4-4c94-bee3-f2898bb526bb service nova] Creating event network-vif-plugged:27963ca3-af30-4494-b232-7a8a3697cf20 for instance b2974512-1028-498a-b3ee-523fe4594c22 on nch1-master-1 Mar 05 21:31:01.805717 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-c9bd56d0-3a1e-4ce6-a176-bf3cba98cf2c req-c37c993a-93a4-4c94-bee3-f2898bb526bb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034976 Mar 05 21:31:01.806245 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2985/6008] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:31:02.442826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-80193d07-ae6c-4c57-b4bf-fd1cb0d40399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:02.443489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-80193d07-ae6c-4c57-b4bf-fd1cb0d40399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:02.450350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80193d07-ae6c-4c57-b4bf-fd1cb0d40399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:02.450813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80193d07-ae6c-4c57-b4bf-fd1cb0d40399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:02.451599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80193d07-ae6c-4c57-b4bf-fd1cb0d40399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:02.452071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-80193d07-ae6c-4c57-b4bf-fd1cb0d40399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:02.586941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-80193d07-ae6c-4c57-b4bf-fd1cb0d40399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:02.594434 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-80193d07-ae6c-4c57-b4bf-fd1cb0d40399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1364 microversion: 2.1 time: 0.156563 Mar 05 21:31:02.595025 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3024/6009] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:02 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:03.613504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7dd4a903-0ad6-4e1b-9f9b-a366bcadf0ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:03.614218 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7dd4a903-0ad6-4e1b-9f9b-a366bcadf0ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:03.620628 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7dd4a903-0ad6-4e1b-9f9b-a366bcadf0ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:03.621102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7dd4a903-0ad6-4e1b-9f9b-a366bcadf0ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:03.621884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7dd4a903-0ad6-4e1b-9f9b-a366bcadf0ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:03.622335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7dd4a903-0ad6-4e1b-9f9b-a366bcadf0ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:03.759574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7dd4a903-0ad6-4e1b-9f9b-a366bcadf0ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:03.767709 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7dd4a903-0ad6-4e1b-9f9b-a366bcadf0ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1551 microversion: 2.1 time: 0.159391 Mar 05 21:31:03.768304 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2986/6010] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:03 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1551 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:03.785092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c14a0864-e6ad-47f0-a5e0-519caecdb804 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:03.785674 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c14a0864-e6ad-47f0-a5e0-519caecdb804 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:03.792393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c14a0864-e6ad-47f0-a5e0-519caecdb804 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:03.792862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c14a0864-e6ad-47f0-a5e0-519caecdb804 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:03.793641 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c14a0864-e6ad-47f0-a5e0-519caecdb804 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:03.794090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c14a0864-e6ad-47f0-a5e0-519caecdb804 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:03.878492 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c14a0864-e6ad-47f0-a5e0-519caecdb804 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097656 Mar 05 21:31:03.879131 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3025/6011] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 21:31:03 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:31:04.826557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1ee2b860-5f66-4f2b-a358-e40ccca4d569 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:04.841328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ee2b860-5f66-4f2b-a358-e40ccca4d569 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:04.841880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ee2b860-5f66-4f2b-a358-e40ccca4d569 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:04.867091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1ee2b860-5f66-4f2b-a358-e40ccca4d569 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Going to try to stop instance {{(pid=141478) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 05 21:31:04.924536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9b2155df-b34b-43bd-a645-e85c88b931da req-9da30f5a-f90d-4a87-ab53-42c69b25a9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2974512-1028-498a-b3ee-523fe4594c22", "tag": "27963ca3-af30-4494-b232-7a8a3697cf20"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:04.927306 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1ee2b860-5f66-4f2b-a358-e40ccca4d569 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22/action" status: 202 len: 0 microversion: 2.1 time: 0.104692 Mar 05 21:31:04.927976 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2987/6012] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:31:04 2022] POST /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:31:04.937033 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-50bbcc34-15de-42f0-8529-f15f37c3e50c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:04.937792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-50bbcc34-15de-42f0-8529-f15f37c3e50c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:04.944741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50bbcc34-15de-42f0-8529-f15f37c3e50c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:04.945835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50bbcc34-15de-42f0-8529-f15f37c3e50c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:04.946649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50bbcc34-15de-42f0-8529-f15f37c3e50c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:04.947108 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-50bbcc34-15de-42f0-8529-f15f37c3e50c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:04.949587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9b2155df-b34b-43bd-a645-e85c88b931da req-9da30f5a-f90d-4a87-ab53-42c69b25a9a0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:04.950309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9b2155df-b34b-43bd-a645-e85c88b931da req-9da30f5a-f90d-4a87-ab53-42c69b25a9a0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:04.967216 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9b2155df-b34b-43bd-a645-e85c88b931da req-9da30f5a-f90d-4a87-ab53-42c69b25a9a0 service nova] Creating event network-changed:27963ca3-af30-4494-b232-7a8a3697cf20 for instance b2974512-1028-498a-b3ee-523fe4594c22 on nch1-master-1 Mar 05 21:31:04.974109 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9b2155df-b34b-43bd-a645-e85c88b931da req-9da30f5a-f90d-4a87-ab53-42c69b25a9a0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145630 Mar 05 21:31:04.975384 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3026/6013] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:31:05.177043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-50bbcc34-15de-42f0-8529-f15f37c3e50c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:05.184935 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-50bbcc34-15de-42f0-8529-f15f37c3e50c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1561 microversion: 2.1 time: 0.252156 Mar 05 21:31:05.187022 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2988/6014] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:04 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1561 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:06.205734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4c784a87-0c19-4bf7-b7d7-246c50977cca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:06.206436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4c784a87-0c19-4bf7-b7d7-246c50977cca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:06.212618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c784a87-0c19-4bf7-b7d7-246c50977cca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:06.213072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c784a87-0c19-4bf7-b7d7-246c50977cca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:06.213847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c784a87-0c19-4bf7-b7d7-246c50977cca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:06.214287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4c784a87-0c19-4bf7-b7d7-246c50977cca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:06.346404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4c784a87-0c19-4bf7-b7d7-246c50977cca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:06.353777 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4c784a87-0c19-4bf7-b7d7-246c50977cca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.153971 Mar 05 21:31:06.354367 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3027/6015] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:06 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:07.371814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-49ca7cf1-ac88-4ae3-b28e-6545a34b833c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:07.372457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-49ca7cf1-ac88-4ae3-b28e-6545a34b833c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:07.379727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49ca7cf1-ac88-4ae3-b28e-6545a34b833c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:07.380210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49ca7cf1-ac88-4ae3-b28e-6545a34b833c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:07.381010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49ca7cf1-ac88-4ae3-b28e-6545a34b833c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:07.381485 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-49ca7cf1-ac88-4ae3-b28e-6545a34b833c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:07.514795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-49ca7cf1-ac88-4ae3-b28e-6545a34b833c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:07.522837 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-49ca7cf1-ac88-4ae3-b28e-6545a34b833c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.155056 Mar 05 21:31:07.523416 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2989/6016] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:07 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:08.540348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fd70a2a9-43be-4f59-ba8a-f506b9348020 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:08.540973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fd70a2a9-43be-4f59-ba8a-f506b9348020 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:08.548488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd70a2a9-43be-4f59-ba8a-f506b9348020 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:08.548945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd70a2a9-43be-4f59-ba8a-f506b9348020 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:08.549726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd70a2a9-43be-4f59-ba8a-f506b9348020 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:08.550169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd70a2a9-43be-4f59-ba8a-f506b9348020 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:08.681121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fd70a2a9-43be-4f59-ba8a-f506b9348020 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:08.688651 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fd70a2a9-43be-4f59-ba8a-f506b9348020 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.152289 Mar 05 21:31:08.689227 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3028/6017] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:08 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:09.706348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9e176b17-e835-4e07-bb4f-63e5f622d8d8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:09.706986 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9e176b17-e835-4e07-bb4f-63e5f622d8d8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:09.713874 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e176b17-e835-4e07-bb4f-63e5f622d8d8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:09.714350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e176b17-e835-4e07-bb4f-63e5f622d8d8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:09.715144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e176b17-e835-4e07-bb4f-63e5f622d8d8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:09.715613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e176b17-e835-4e07-bb4f-63e5f622d8d8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:09.850810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9e176b17-e835-4e07-bb4f-63e5f622d8d8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:09.858301 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9e176b17-e835-4e07-bb4f-63e5f622d8d8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.156572 Mar 05 21:31:09.858882 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2990/6018] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:09 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:10.877650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d5af2c62-b824-4881-8337-68abd4c3712a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:10.878308 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d5af2c62-b824-4881-8337-68abd4c3712a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:10.885074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5af2c62-b824-4881-8337-68abd4c3712a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:10.885527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5af2c62-b824-4881-8337-68abd4c3712a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:10.886312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5af2c62-b824-4881-8337-68abd4c3712a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:10.886754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d5af2c62-b824-4881-8337-68abd4c3712a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:11.023944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d5af2c62-b824-4881-8337-68abd4c3712a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:11.032485 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d5af2c62-b824-4881-8337-68abd4c3712a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.158516 Mar 05 21:31:11.033083 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3029/6019] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:10 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:12.049918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0a40f689-09b4-4177-a230-34dc245c905d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:12.050548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0a40f689-09b4-4177-a230-34dc245c905d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:12.056943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a40f689-09b4-4177-a230-34dc245c905d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:12.057409 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a40f689-09b4-4177-a230-34dc245c905d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:12.058191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a40f689-09b4-4177-a230-34dc245c905d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:12.058650 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0a40f689-09b4-4177-a230-34dc245c905d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:12.188846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0a40f689-09b4-4177-a230-34dc245c905d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:12.196176 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0a40f689-09b4-4177-a230-34dc245c905d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.151145 Mar 05 21:31:12.196754 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2991/6020] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:12 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:13.213554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d335be59-abb9-4921-be78-3c50fb57bcf2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:13.214094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d335be59-abb9-4921-be78-3c50fb57bcf2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:13.221195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d335be59-abb9-4921-be78-3c50fb57bcf2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:13.221656 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d335be59-abb9-4921-be78-3c50fb57bcf2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:13.222434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d335be59-abb9-4921-be78-3c50fb57bcf2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:13.222879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d335be59-abb9-4921-be78-3c50fb57bcf2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:13.358375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d335be59-abb9-4921-be78-3c50fb57bcf2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:13.365969 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d335be59-abb9-4921-be78-3c50fb57bcf2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.156467 Mar 05 21:31:13.366571 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3030/6021] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:13 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:14.383401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-60f23b45-35b2-445e-b57e-58c52c3f2bc4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:14.384059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-60f23b45-35b2-445e-b57e-58c52c3f2bc4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:14.391034 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60f23b45-35b2-445e-b57e-58c52c3f2bc4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:14.391771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60f23b45-35b2-445e-b57e-58c52c3f2bc4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:14.392333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60f23b45-35b2-445e-b57e-58c52c3f2bc4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:14.392785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-60f23b45-35b2-445e-b57e-58c52c3f2bc4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:14.528429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-60f23b45-35b2-445e-b57e-58c52c3f2bc4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:14.536354 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-60f23b45-35b2-445e-b57e-58c52c3f2bc4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.156958 Mar 05 21:31:14.536936 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2992/6022] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:14 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:15.553916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6fe00357-0c8a-415b-a320-9c892d1d3582 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:15.554572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6fe00357-0c8a-415b-a320-9c892d1d3582 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:15.561457 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6fe00357-0c8a-415b-a320-9c892d1d3582 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:15.561917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6fe00357-0c8a-415b-a320-9c892d1d3582 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:15.562689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6fe00357-0c8a-415b-a320-9c892d1d3582 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:15.563826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6fe00357-0c8a-415b-a320-9c892d1d3582 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:15.700611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6fe00357-0c8a-415b-a320-9c892d1d3582 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:15.708159 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6fe00357-0c8a-415b-a320-9c892d1d3582 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.158142 Mar 05 21:31:15.708738 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3031/6023] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:15 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:16.725773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-021e0d25-e6a6-484f-be86-4c32aadbb113 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:16.726404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-021e0d25-e6a6-484f-be86-4c32aadbb113 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:16.733473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-021e0d25-e6a6-484f-be86-4c32aadbb113 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:16.733945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-021e0d25-e6a6-484f-be86-4c32aadbb113 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:16.734738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-021e0d25-e6a6-484f-be86-4c32aadbb113 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:16.735840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-021e0d25-e6a6-484f-be86-4c32aadbb113 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:16.865301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-021e0d25-e6a6-484f-be86-4c32aadbb113 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:16.872685 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-021e0d25-e6a6-484f-be86-4c32aadbb113 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.150888 Mar 05 21:31:16.873267 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2993/6024] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:16 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:17.890050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cc543943-85e6-4ef2-a665-ddcc69fc27b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:17.891214 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cc543943-85e6-4ef2-a665-ddcc69fc27b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:17.897769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc543943-85e6-4ef2-a665-ddcc69fc27b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:17.898226 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc543943-85e6-4ef2-a665-ddcc69fc27b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:17.899002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc543943-85e6-4ef2-a665-ddcc69fc27b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:17.899446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cc543943-85e6-4ef2-a665-ddcc69fc27b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:18.033203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cc543943-85e6-4ef2-a665-ddcc69fc27b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:18.040681 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cc543943-85e6-4ef2-a665-ddcc69fc27b1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.154575 Mar 05 21:31:18.041302 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3032/6025] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:17 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:19.058084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-785ebc84-a859-4ad8-b6e9-eab84896d8a9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:19.058714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-785ebc84-a859-4ad8-b6e9-eab84896d8a9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:19.066297 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-785ebc84-a859-4ad8-b6e9-eab84896d8a9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:19.066767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-785ebc84-a859-4ad8-b6e9-eab84896d8a9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:19.067554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-785ebc84-a859-4ad8-b6e9-eab84896d8a9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:19.068035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-785ebc84-a859-4ad8-b6e9-eab84896d8a9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:19.203161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-785ebc84-a859-4ad8-b6e9-eab84896d8a9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:19.211212 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-785ebc84-a859-4ad8-b6e9-eab84896d8a9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.157046 Mar 05 21:31:19.211818 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2994/6026] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:19 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:20.229003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aa0b8c18-2e02-4c22-bb5d-2f41af2d196a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:20.229554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-aa0b8c18-2e02-4c22-bb5d-2f41af2d196a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:20.236458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa0b8c18-2e02-4c22-bb5d-2f41af2d196a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:20.236919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa0b8c18-2e02-4c22-bb5d-2f41af2d196a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:20.237688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa0b8c18-2e02-4c22-bb5d-2f41af2d196a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:20.238126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aa0b8c18-2e02-4c22-bb5d-2f41af2d196a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:20.373345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-aa0b8c18-2e02-4c22-bb5d-2f41af2d196a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:20.381534 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aa0b8c18-2e02-4c22-bb5d-2f41af2d196a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.156501 Mar 05 21:31:20.382128 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3033/6027] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:20 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:21.398541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-72f2d48a-9a2b-48c8-ac9c-ef36d10b56a0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:21.399197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-72f2d48a-9a2b-48c8-ac9c-ef36d10b56a0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:21.405916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72f2d48a-9a2b-48c8-ac9c-ef36d10b56a0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:21.406389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72f2d48a-9a2b-48c8-ac9c-ef36d10b56a0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:21.407858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72f2d48a-9a2b-48c8-ac9c-ef36d10b56a0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:21.408316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-72f2d48a-9a2b-48c8-ac9c-ef36d10b56a0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:21.538504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-72f2d48a-9a2b-48c8-ac9c-ef36d10b56a0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:21.546037 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-72f2d48a-9a2b-48c8-ac9c-ef36d10b56a0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.151423 Mar 05 21:31:21.546612 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2995/6028] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:21 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:22.562368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2f0c64ee-a0aa-44d8-ab48-7de4c3f64068 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:22.563126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2f0c64ee-a0aa-44d8-ab48-7de4c3f64068 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:22.569945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f0c64ee-a0aa-44d8-ab48-7de4c3f64068 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:22.570408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f0c64ee-a0aa-44d8-ab48-7de4c3f64068 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:22.571203 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f0c64ee-a0aa-44d8-ab48-7de4c3f64068 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:22.571651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f0c64ee-a0aa-44d8-ab48-7de4c3f64068 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:22.703615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2f0c64ee-a0aa-44d8-ab48-7de4c3f64068 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:22.711172 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2f0c64ee-a0aa-44d8-ab48-7de4c3f64068 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.152757 Mar 05 21:31:22.711775 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3034/6029] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:22 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:23.728913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cae336d7-7e42-47d5-9f89-07478fc486f4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:23.729546 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cae336d7-7e42-47d5-9f89-07478fc486f4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:23.736891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cae336d7-7e42-47d5-9f89-07478fc486f4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:23.737398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cae336d7-7e42-47d5-9f89-07478fc486f4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:23.738196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cae336d7-7e42-47d5-9f89-07478fc486f4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:23.738654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cae336d7-7e42-47d5-9f89-07478fc486f4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:23.872109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cae336d7-7e42-47d5-9f89-07478fc486f4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:23.880964 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cae336d7-7e42-47d5-9f89-07478fc486f4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.155985 Mar 05 21:31:23.881543 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2996/6030] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:23 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:24.898527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6a9645c7-9fcb-46dc-baa3-42a597acd29b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:24.899158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6a9645c7-9fcb-46dc-baa3-42a597acd29b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:24.906049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a9645c7-9fcb-46dc-baa3-42a597acd29b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:24.906517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a9645c7-9fcb-46dc-baa3-42a597acd29b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:24.907310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a9645c7-9fcb-46dc-baa3-42a597acd29b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:24.907782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a9645c7-9fcb-46dc-baa3-42a597acd29b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:25.039143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6a9645c7-9fcb-46dc-baa3-42a597acd29b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:25.046545 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6a9645c7-9fcb-46dc-baa3-42a597acd29b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.152029 Mar 05 21:31:25.047166 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3035/6031] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:24 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:26.064051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-850386e2-b9aa-4c78-a39e-ad48be8f817b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:26.064690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-850386e2-b9aa-4c78-a39e-ad48be8f817b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:26.071537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-850386e2-b9aa-4c78-a39e-ad48be8f817b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:26.072054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-850386e2-b9aa-4c78-a39e-ad48be8f817b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:26.072851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-850386e2-b9aa-4c78-a39e-ad48be8f817b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:26.073311 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-850386e2-b9aa-4c78-a39e-ad48be8f817b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:26.209820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-850386e2-b9aa-4c78-a39e-ad48be8f817b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:26.217221 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-850386e2-b9aa-4c78-a39e-ad48be8f817b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.157355 Mar 05 21:31:26.217802 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2997/6032] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:26 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:31:27.235753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b628c1c6-ad18-485d-a255-e33546ead7ae tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:27.236307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b628c1c6-ad18-485d-a255-e33546ead7ae tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:27.242410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b628c1c6-ad18-485d-a255-e33546ead7ae tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:27.242872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b628c1c6-ad18-485d-a255-e33546ead7ae tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:27.243643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b628c1c6-ad18-485d-a255-e33546ead7ae tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:27.244111 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b628c1c6-ad18-485d-a255-e33546ead7ae tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:27.384258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b628c1c6-ad18-485d-a255-e33546ead7ae tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:27.391780 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b628c1c6-ad18-485d-a255-e33546ead7ae tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.160626 Mar 05 21:31:27.392368 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3036/6033] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:27 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:28.409421 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e251c154-00b5-4632-ae45-e54700f71ae6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:28.410291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e251c154-00b5-4632-ae45-e54700f71ae6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:28.417220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e251c154-00b5-4632-ae45-e54700f71ae6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:28.417688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e251c154-00b5-4632-ae45-e54700f71ae6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:28.418472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e251c154-00b5-4632-ae45-e54700f71ae6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:28.418925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e251c154-00b5-4632-ae45-e54700f71ae6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:28.551923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e251c154-00b5-4632-ae45-e54700f71ae6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:28.559369 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e251c154-00b5-4632-ae45-e54700f71ae6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.154767 Mar 05 21:31:28.559993 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2998/6034] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:28 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:29.577452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e761d6f4-d720-42bb-a441-20261fcd96c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:29.578078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e761d6f4-d720-42bb-a441-20261fcd96c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:29.585340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e761d6f4-d720-42bb-a441-20261fcd96c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:29.585802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e761d6f4-d720-42bb-a441-20261fcd96c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:29.586576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e761d6f4-d720-42bb-a441-20261fcd96c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:29.587019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e761d6f4-d720-42bb-a441-20261fcd96c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:29.718374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e761d6f4-d720-42bb-a441-20261fcd96c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:29.726866 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e761d6f4-d720-42bb-a441-20261fcd96c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.153360 Mar 05 21:31:29.727447 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3037/6035] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:29 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:30.744527 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f5ed6d31-8c25-4ac9-bd96-6531da40399b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:30.745156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f5ed6d31-8c25-4ac9-bd96-6531da40399b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:30.752608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5ed6d31-8c25-4ac9-bd96-6531da40399b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:30.753073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5ed6d31-8c25-4ac9-bd96-6531da40399b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:30.753853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5ed6d31-8c25-4ac9-bd96-6531da40399b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:30.754300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f5ed6d31-8c25-4ac9-bd96-6531da40399b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:30.887732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f5ed6d31-8c25-4ac9-bd96-6531da40399b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:30.895933 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f5ed6d31-8c25-4ac9-bd96-6531da40399b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1657 microversion: 2.1 time: 0.155282 Mar 05 21:31:30.896517 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 2999/6036] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:30 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1657 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:30.912437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:30.913402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:30.920630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:30.921092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:30.921876 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:30.922320 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:30.949292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:30.955534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Old instance type m1.heat2, new instance type m1.heat {{(pid=141479) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 21:31:30.961736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:31:30.962202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:31:30.962757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:31:30.963195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:31:30.963867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:31:31.026527 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9ab4f5b0-15aa-42e2-b217-c0fee1c21307 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22/action" status: 202 len: 0 microversion: 2.1 time: 0.117934 Mar 05 21:31:31.027067 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3038/6037] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:31:30 2022] POST /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:31:31.035537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7d0166f3-708d-4c3f-958e-a2137520978c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:31.036210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7d0166f3-708d-4c3f-958e-a2137520978c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:31.042172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d0166f3-708d-4c3f-958e-a2137520978c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:31.042656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d0166f3-708d-4c3f-958e-a2137520978c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:31.043462 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d0166f3-708d-4c3f-958e-a2137520978c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:31.044070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7d0166f3-708d-4c3f-958e-a2137520978c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:31.207161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7d0166f3-708d-4c3f-958e-a2137520978c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:31.214788 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7d0166f3-708d-4c3f-958e-a2137520978c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.183600 Mar 05 21:31:31.215453 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3000/6038] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:31 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:31:32.233261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-226dfbc8-c528-4af6-87fe-78528730a3fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:32.233813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-226dfbc8-c528-4af6-87fe-78528730a3fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:32.241220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-226dfbc8-c528-4af6-87fe-78528730a3fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:32.241687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-226dfbc8-c528-4af6-87fe-78528730a3fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:32.242472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-226dfbc8-c528-4af6-87fe-78528730a3fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:32.242921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-226dfbc8-c528-4af6-87fe-78528730a3fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:32.387117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-226dfbc8-c528-4af6-87fe-78528730a3fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:32.394961 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-226dfbc8-c528-4af6-87fe-78528730a3fe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1680 microversion: 2.1 time: 0.166520 Mar 05 21:31:32.395639 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3039/6039] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:32 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:33.412939 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1842c925-b90b-44f1-82dc-af2dd75da164 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:33.413570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1842c925-b90b-44f1-82dc-af2dd75da164 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:33.420261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1842c925-b90b-44f1-82dc-af2dd75da164 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:33.420724 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1842c925-b90b-44f1-82dc-af2dd75da164 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:33.421504 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1842c925-b90b-44f1-82dc-af2dd75da164 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:33.421956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1842c925-b90b-44f1-82dc-af2dd75da164 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:33.559958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1842c925-b90b-44f1-82dc-af2dd75da164 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:33.567342 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1842c925-b90b-44f1-82dc-af2dd75da164 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1685 microversion: 2.1 time: 0.158355 Mar 05 21:31:33.567969 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3001/6040] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:33 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:34.587331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3fd96929-8a48-4e81-99c0-e57d35157738 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:34.587995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3fd96929-8a48-4e81-99c0-e57d35157738 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:34.597425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fd96929-8a48-4e81-99c0-e57d35157738 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:34.597892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fd96929-8a48-4e81-99c0-e57d35157738 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:34.598689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fd96929-8a48-4e81-99c0-e57d35157738 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:34.599181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3fd96929-8a48-4e81-99c0-e57d35157738 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:34.735431 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3fd96929-8a48-4e81-99c0-e57d35157738 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:34.743176 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3fd96929-8a48-4e81-99c0-e57d35157738 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1684 microversion: 2.1 time: 0.161945 Mar 05 21:31:34.743898 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3040/6041] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:34 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:35.087172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5f92d81c-1e34-4704-8bb6-e939123a4d28 req-3cd54635-3c97-4e60-ab59-2c498235923f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2974512-1028-498a-b3ee-523fe4594c22", "name": "network-vif-unplugged", "status": "completed", "tag": "27963ca3-af30-4494-b232-7a8a3697cf20"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:35.095990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5f92d81c-1e34-4704-8bb6-e939123a4d28 req-3cd54635-3c97-4e60-ab59-2c498235923f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:35.096452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5f92d81c-1e34-4704-8bb6-e939123a4d28 req-3cd54635-3c97-4e60-ab59-2c498235923f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:35.113584 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-5f92d81c-1e34-4704-8bb6-e939123a4d28 req-3cd54635-3c97-4e60-ab59-2c498235923f service nova] Creating event network-vif-unplugged:27963ca3-af30-4494-b232-7a8a3697cf20 for instance b2974512-1028-498a-b3ee-523fe4594c22 on nch2-master-1 Mar 05 21:31:35.119441 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-5f92d81c-1e34-4704-8bb6-e939123a4d28 req-3cd54635-3c97-4e60-ab59-2c498235923f service nova] Instance b2974512-1028-498a-b3ee-523fe4594c22 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:31:35.132339 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5f92d81c-1e34-4704-8bb6-e939123a4d28 req-3cd54635-3c97-4e60-ab59-2c498235923f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126318 Mar 05 21:31:35.133134 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3002/6042] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:31:35.761891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3e3d64fc-ab4e-4ef7-bc90-617d62d3c35d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:35.762529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3e3d64fc-ab4e-4ef7-bc90-617d62d3c35d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:35.771292 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e3d64fc-ab4e-4ef7-bc90-617d62d3c35d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:35.771933 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e3d64fc-ab4e-4ef7-bc90-617d62d3c35d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:35.772740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e3d64fc-ab4e-4ef7-bc90-617d62d3c35d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:35.773195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e3d64fc-ab4e-4ef7-bc90-617d62d3c35d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:35.921142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3e3d64fc-ab4e-4ef7-bc90-617d62d3c35d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:35.929885 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3e3d64fc-ab4e-4ef7-bc90-617d62d3c35d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1684 microversion: 2.1 time: 0.172305 Mar 05 21:31:35.931152 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3041/6043] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:35 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:36.949321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6d4f29a9-dd5a-4c97-a4f5-e97204069370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:36.950044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6d4f29a9-dd5a-4c97-a4f5-e97204069370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:36.956851 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d4f29a9-dd5a-4c97-a4f5-e97204069370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:36.957320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d4f29a9-dd5a-4c97-a4f5-e97204069370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:36.958098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d4f29a9-dd5a-4c97-a4f5-e97204069370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:36.958552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6d4f29a9-dd5a-4c97-a4f5-e97204069370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:37.099976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6d4f29a9-dd5a-4c97-a4f5-e97204069370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:37.107483 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6d4f29a9-dd5a-4c97-a4f5-e97204069370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1682 microversion: 2.1 time: 0.163350 Mar 05 21:31:37.108107 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3003/6044] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:36 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:37.160087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-dc0d37c2-a529-4425-9e23-89e4a67a974f req-5c94d7bb-1caa-4bd4-b48b-3b44b72e8939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2974512-1028-498a-b3ee-523fe4594c22", "tag": "27963ca3-af30-4494-b232-7a8a3697cf20"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:37.168760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-dc0d37c2-a529-4425-9e23-89e4a67a974f req-5c94d7bb-1caa-4bd4-b48b-3b44b72e8939 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:37.169217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-dc0d37c2-a529-4425-9e23-89e4a67a974f req-5c94d7bb-1caa-4bd4-b48b-3b44b72e8939 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:37.183138 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-dc0d37c2-a529-4425-9e23-89e4a67a974f req-5c94d7bb-1caa-4bd4-b48b-3b44b72e8939 service nova] Creating event network-changed:27963ca3-af30-4494-b232-7a8a3697cf20 for instance b2974512-1028-498a-b3ee-523fe4594c22 on nch2-master-1 Mar 05 21:31:37.188439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-dc0d37c2-a529-4425-9e23-89e4a67a974f req-5c94d7bb-1caa-4bd4-b48b-3b44b72e8939 service nova] Instance b2974512-1028-498a-b3ee-523fe4594c22 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:31:37.202219 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-dc0d37c2-a529-4425-9e23-89e4a67a974f req-5c94d7bb-1caa-4bd4-b48b-3b44b72e8939 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046476 Mar 05 21:31:37.202851 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3042/6045] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:31:38.125488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-405b07cb-965c-44e7-887d-22760f11ce58 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:38.127139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-405b07cb-965c-44e7-887d-22760f11ce58 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:38.134031 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-405b07cb-965c-44e7-887d-22760f11ce58 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:38.134517 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-405b07cb-965c-44e7-887d-22760f11ce58 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:38.135312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-405b07cb-965c-44e7-887d-22760f11ce58 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:38.135804 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-405b07cb-965c-44e7-887d-22760f11ce58 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:38.269186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-405b07cb-965c-44e7-887d-22760f11ce58 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:38.276912 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-405b07cb-965c-44e7-887d-22760f11ce58 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1678 microversion: 2.1 time: 0.155430 Mar 05 21:31:38.277502 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3004/6046] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:38 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:38.295824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-77322c2a-f76f-4338-b402-b25752be5745 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:38.296452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-77322c2a-f76f-4338-b402-b25752be5745 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:38.303071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77322c2a-f76f-4338-b402-b25752be5745 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:38.303527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77322c2a-f76f-4338-b402-b25752be5745 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:38.304325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77322c2a-f76f-4338-b402-b25752be5745 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:38.304767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-77322c2a-f76f-4338-b402-b25752be5745 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:38.360433 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-77322c2a-f76f-4338-b402-b25752be5745 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22/action" status: 204 len: 0 microversion: 2.1 time: 0.070199 Mar 05 21:31:38.361743 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3043/6047] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:31:38 2022] POST /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:31:38.370152 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2a6f44d0-ddb6-4bcc-a002-a3a2a617495a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:38.370894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2a6f44d0-ddb6-4bcc-a002-a3a2a617495a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:38.377212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a6f44d0-ddb6-4bcc-a002-a3a2a617495a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:38.377684 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a6f44d0-ddb6-4bcc-a002-a3a2a617495a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:38.378588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a6f44d0-ddb6-4bcc-a002-a3a2a617495a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:38.379281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a6f44d0-ddb6-4bcc-a002-a3a2a617495a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:38.554256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2a6f44d0-ddb6-4bcc-a002-a3a2a617495a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:38.561773 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2a6f44d0-ddb6-4bcc-a002-a3a2a617495a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1678 microversion: 2.1 time: 0.195675 Mar 05 21:31:38.562370 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3005/6048] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:38 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:31:39.581935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-23b6320c-00e3-41c7-9497-180640bf7633 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:39.582830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-23b6320c-00e3-41c7-9497-180640bf7633 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:39.590177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-23b6320c-00e3-41c7-9497-180640bf7633 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:39.590582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-23b6320c-00e3-41c7-9497-180640bf7633 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:39.591505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-23b6320c-00e3-41c7-9497-180640bf7633 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:39.592038 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-23b6320c-00e3-41c7-9497-180640bf7633 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:39.743689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-23b6320c-00e3-41c7-9497-180640bf7633 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:39.752320 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-23b6320c-00e3-41c7-9497-180640bf7633 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1657 microversion: 2.1 time: 0.176361 Mar 05 21:31:39.752938 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3044/6049] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:39 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1657 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:39.771599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-66562520-604c-4635-b63a-fef8de1581ea tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:39.772288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-66562520-604c-4635-b63a-fef8de1581ea tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:39.778752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66562520-604c-4635-b63a-fef8de1581ea tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:39.779167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66562520-604c-4635-b63a-fef8de1581ea tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:39.779980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66562520-604c-4635-b63a-fef8de1581ea tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:39.780434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-66562520-604c-4635-b63a-fef8de1581ea tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:39.918677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-66562520-604c-4635-b63a-fef8de1581ea tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:39.926747 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-66562520-604c-4635-b63a-fef8de1581ea tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1657 microversion: 2.1 time: 0.160904 Mar 05 21:31:39.927362 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3006/6050] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:39 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1657 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:39.943312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9bc021c8-3362-4e0a-92c0-1d60410e6f14 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:39.951432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9bc021c8-3362-4e0a-92c0-1d60410e6f14 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:39.951432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9bc021c8-3362-4e0a-92c0-1d60410e6f14 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:39.973652 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9bc021c8-3362-4e0a-92c0-1d60410e6f14 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Going to try to start instance {{(pid=141479) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 05 21:31:40.016283 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9bc021c8-3362-4e0a-92c0-1d60410e6f14 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22/action" status: 202 len: 0 microversion: 2.1 time: 0.077237 Mar 05 21:31:40.020611 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3045/6051] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:31:39 2022] POST /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:31:40.025940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-abe370bc-e044-496e-b282-00167e084995 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:40.026798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-abe370bc-e044-496e-b282-00167e084995 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:40.033483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abe370bc-e044-496e-b282-00167e084995 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:40.034155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abe370bc-e044-496e-b282-00167e084995 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:40.035281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abe370bc-e044-496e-b282-00167e084995 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:40.035933 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abe370bc-e044-496e-b282-00167e084995 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:40.264857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-abe370bc-e044-496e-b282-00167e084995 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:40.272753 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-abe370bc-e044-496e-b282-00167e084995 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1666 microversion: 2.1 time: 0.250668 Mar 05 21:31:40.273842 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3007/6052] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:40 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1666 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:31:41.292949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c4aed52b-8466-4572-908b-028650262444 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:41.293573 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c4aed52b-8466-4572-908b-028650262444 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:41.300751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4aed52b-8466-4572-908b-028650262444 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:41.301204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4aed52b-8466-4572-908b-028650262444 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:41.301972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4aed52b-8466-4572-908b-028650262444 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:41.302411 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4aed52b-8466-4572-908b-028650262444 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:41.435305 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c4aed52b-8466-4572-908b-028650262444 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:41.443093 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c4aed52b-8466-4572-908b-028650262444 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1670 microversion: 2.1 time: 0.155580 Mar 05 21:31:41.443684 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3046/6053] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:41 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:41.459720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-35945941-3693-4339-8489-eac469af6841 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:41.460232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-35945941-3693-4339-8489-eac469af6841 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:41.466823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35945941-3693-4339-8489-eac469af6841 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:41.467290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35945941-3693-4339-8489-eac469af6841 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:41.468111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35945941-3693-4339-8489-eac469af6841 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:41.468572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-35945941-3693-4339-8489-eac469af6841 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:41.496322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-35945941-3693-4339-8489-eac469af6841 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:31:41.570619 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-35945941-3693-4339-8489-eac469af6841 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 204 len: 0 microversion: 2.1 time: 0.114676 Mar 05 21:31:41.571367 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3008/6054] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:31:41 2022] DELETE /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:31:41.579771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-99486de3-6d75-43e9-abae-b96f6be0fd71 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:41.580912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-99486de3-6d75-43e9-abae-b96f6be0fd71 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:41.586854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99486de3-6d75-43e9-abae-b96f6be0fd71 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:41.587314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99486de3-6d75-43e9-abae-b96f6be0fd71 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:41.588553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99486de3-6d75-43e9-abae-b96f6be0fd71 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:41.588553 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99486de3-6d75-43e9-abae-b96f6be0fd71 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:41.726513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-99486de3-6d75-43e9-abae-b96f6be0fd71 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:41.733953 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-99486de3-6d75-43e9-abae-b96f6be0fd71 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1676 microversion: 2.1 time: 0.158104 Mar 05 21:31:41.734545 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3047/6055] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:41 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:31:41.824147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-c635c1cb-e931-44a3-b8d5-2cccdc26dca7 req-27f80e17-049b-4216-8da6-c46332584c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2974512-1028-498a-b3ee-523fe4594c22", "name": "network-vif-plugged", "status": "completed", "tag": "27963ca3-af30-4494-b232-7a8a3697cf20"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:41.832359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c635c1cb-e931-44a3-b8d5-2cccdc26dca7 req-27f80e17-049b-4216-8da6-c46332584c3c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:41.832830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c635c1cb-e931-44a3-b8d5-2cccdc26dca7 req-27f80e17-049b-4216-8da6-c46332584c3c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:41.844076 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-c635c1cb-e931-44a3-b8d5-2cccdc26dca7 req-27f80e17-049b-4216-8da6-c46332584c3c service nova] Creating event network-vif-plugged:27963ca3-af30-4494-b232-7a8a3697cf20 for instance b2974512-1028-498a-b3ee-523fe4594c22 on nch2-master-1 Mar 05 21:31:41.849056 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-c635c1cb-e931-44a3-b8d5-2cccdc26dca7 req-27f80e17-049b-4216-8da6-c46332584c3c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093323 Mar 05 21:31:41.849650 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3009/6056] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:31:42.752591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-915fe5b7-549d-4ff2-9d4c-33a14b6ab417 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:42.753349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-915fe5b7-549d-4ff2-9d4c-33a14b6ab417 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:42.760128 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-915fe5b7-549d-4ff2-9d4c-33a14b6ab417 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:42.760581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-915fe5b7-549d-4ff2-9d4c-33a14b6ab417 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:42.761346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-915fe5b7-549d-4ff2-9d4c-33a14b6ab417 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:42.761785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-915fe5b7-549d-4ff2-9d4c-33a14b6ab417 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:42.896888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-915fe5b7-549d-4ff2-9d4c-33a14b6ab417 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:42.904787 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-915fe5b7-549d-4ff2-9d4c-33a14b6ab417 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 200 len: 1676 microversion: 2.1 time: 0.156912 Mar 05 21:31:42.905372 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3048/6057] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:42 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:43.731071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7d2a55f0-3a6c-4d12-9424-85b51a86b6ae req-428bedda-746b-41d0-9601-54a5d8f44558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2974512-1028-498a-b3ee-523fe4594c22", "name": "network-vif-deleted", "tag": "27963ca3-af30-4494-b232-7a8a3697cf20"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:43.740805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7d2a55f0-3a6c-4d12-9424-85b51a86b6ae req-428bedda-746b-41d0-9601-54a5d8f44558 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:43.741562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7d2a55f0-3a6c-4d12-9424-85b51a86b6ae req-428bedda-746b-41d0-9601-54a5d8f44558 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:43.753542 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7d2a55f0-3a6c-4d12-9424-85b51a86b6ae req-428bedda-746b-41d0-9601-54a5d8f44558 service nova] Creating event network-vif-deleted:27963ca3-af30-4494-b232-7a8a3697cf20 for instance b2974512-1028-498a-b3ee-523fe4594c22 on nch2-master-1 Mar 05 21:31:43.758367 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7d2a55f0-3a6c-4d12-9424-85b51a86b6ae req-428bedda-746b-41d0-9601-54a5d8f44558 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032550 Mar 05 21:31:43.758991 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3010/6058] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:31:43.922360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-61f7bd52-5c47-4d20-819c-cba588667c09 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:43.923651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-61f7bd52-5c47-4d20-819c-cba588667c09 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:43.930493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61f7bd52-5c47-4d20-819c-cba588667c09 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:43.931201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61f7bd52-5c47-4d20-819c-cba588667c09 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:43.932036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61f7bd52-5c47-4d20-819c-cba588667c09 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:43.932488 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-61f7bd52-5c47-4d20-819c-cba588667c09 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:43.951049 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-61f7bd52-5c47-4d20-819c-cba588667c09 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance b2974512-1028-498a-b3ee-523fe4594c22 could not be found. Mar 05 21:31:43.951877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-61f7bd52-5c47-4d20-819c-cba588667c09 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance b2974512-1028-498a-b3ee-523fe4594c22 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:31:43.952849 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-61f7bd52-5c47-4d20-819c-cba588667c09 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 404 len: 111 microversion: 2.1 time: 0.034620 Mar 05 21:31:43.953500 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3049/6059] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:43 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:31:43.974744 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1cfa36e6-ae60-4bd5-ba8f-714e33d6ca4e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:43.975493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1cfa36e6-ae60-4bd5-ba8f-714e33d6ca4e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:43.985245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1cfa36e6-ae60-4bd5-ba8f-714e33d6ca4e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:43.985720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1cfa36e6-ae60-4bd5-ba8f-714e33d6ca4e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:43.986569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1cfa36e6-ae60-4bd5-ba8f-714e33d6ca4e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:43.987037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1cfa36e6-ae60-4bd5-ba8f-714e33d6ca4e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:44.001505 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-1cfa36e6-ae60-4bd5-ba8f-714e33d6ca4e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance b2974512-1028-498a-b3ee-523fe4594c22 could not be found. Mar 05 21:31:44.002173 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1cfa36e6-ae60-4bd5-ba8f-714e33d6ca4e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance b2974512-1028-498a-b3ee-523fe4594c22 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:31:44.003048 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1cfa36e6-ae60-4bd5-ba8f-714e33d6ca4e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 404 len: 111 microversion: 2.1 time: 0.034149 Mar 05 21:31:44.003622 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3011/6060] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:43 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:31:44.050978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1315262344", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "b9689e7b-ea3e-4fc4-94eb-1bf10ac2e162"}], "security_groups": [{"name": "tempest-securitygroup--1535879041"}], "key_name": "tempest-keypair-1237555310", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:44.152171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] validate_networks() for [('b9689e7b-ea3e-4fc4-94eb-1bf10ac2e162', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:31:44.538127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:31:44.538632 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:31:44.539180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:31:44.539699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:31:44.540138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:31:44.549220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:44.549677 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:44.550481 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:44.550921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:44.569293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for project 82cb16655b3348048ea81b796af0da84. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:31:44.574599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for user a2def15483f54bf282b64a4712ba0ce9 and project 82cb16655b3348048ea81b796af0da84. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:31:44.587369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:31:44.589604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:31:44.637382 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c3539b55-5f65-4e99-9f91-89aa19ae80a6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.590632 Mar 05 21:31:44.638224 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3050/6061] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:31:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:31:44.649345 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d6fd4c31-8389-48a0-8e3e-1869b7c9c342 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:44.650301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d6fd4c31-8389-48a0-8e3e-1869b7c9c342 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:44.711990 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d6fd4c31-8389-48a0-8e3e-1869b7c9c342 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:44.720040 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d6fd4c31-8389-48a0-8e3e-1869b7c9c342 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1239 microversion: 2.1 time: 0.074925 Mar 05 21:31:44.721418 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3012/6062] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:44 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:31:45.742474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fb62d2c2-84b6-4853-b1de-20865b9f03dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:45.743419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fb62d2c2-84b6-4853-b1de-20865b9f03dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:45.751058 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb62d2c2-84b6-4853-b1de-20865b9f03dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:45.751607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb62d2c2-84b6-4853-b1de-20865b9f03dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:45.753689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb62d2c2-84b6-4853-b1de-20865b9f03dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:45.754231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fb62d2c2-84b6-4853-b1de-20865b9f03dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:45.832114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fb62d2c2-84b6-4853-b1de-20865b9f03dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:45.839539 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fb62d2c2-84b6-4853-b1de-20865b9f03dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1297 microversion: 2.1 time: 0.105059 Mar 05 21:31:45.840213 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3051/6063] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:45 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:46.857662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3ca40aaa-a390-483b-81f5-89b0657e486d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:46.858588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3ca40aaa-a390-483b-81f5-89b0657e486d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:46.867354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ca40aaa-a390-483b-81f5-89b0657e486d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:46.868319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ca40aaa-a390-483b-81f5-89b0657e486d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:46.869140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ca40aaa-a390-483b-81f5-89b0657e486d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:46.869607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ca40aaa-a390-483b-81f5-89b0657e486d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:47.313668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-c7f774a7-8306-4ec8-a27b-e7cf157827b5 req-6af87e3d-c9ec-4c00-b8bb-35af323d6928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb324dba-40c7-4cb8-b053-75608ca660b0", "tag": "3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:47.334306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c7f774a7-8306-4ec8-a27b-e7cf157827b5 req-6af87e3d-c9ec-4c00-b8bb-35af323d6928 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:47.335478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-c7f774a7-8306-4ec8-a27b-e7cf157827b5 req-6af87e3d-c9ec-4c00-b8bb-35af323d6928 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:47.349983 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-c7f774a7-8306-4ec8-a27b-e7cf157827b5 req-6af87e3d-c9ec-4c00-b8bb-35af323d6928 service nova] Creating event network-changed:3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06 for instance bb324dba-40c7-4cb8-b053-75608ca660b0 on nch2-master-1 Mar 05 21:31:47.356667 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-c7f774a7-8306-4ec8-a27b-e7cf157827b5 req-6af87e3d-c9ec-4c00-b8bb-35af323d6928 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049340 Mar 05 21:31:47.357286 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3052/6064] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:31:47.427701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3ca40aaa-a390-483b-81f5-89b0657e486d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:47.436634 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3ca40aaa-a390-483b-81f5-89b0657e486d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1365 microversion: 2.1 time: 0.582235 Mar 05 21:31:47.447275 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3013/6065] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:46 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1365 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:48.455596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-55782b64-027b-465d-8615-f8f1830c3061 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:48.456238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-55782b64-027b-465d-8615-f8f1830c3061 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:48.463148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55782b64-027b-465d-8615-f8f1830c3061 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:48.463606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55782b64-027b-465d-8615-f8f1830c3061 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:48.464398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55782b64-027b-465d-8615-f8f1830c3061 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:48.464841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-55782b64-027b-465d-8615-f8f1830c3061 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:48.604443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-55782b64-027b-465d-8615-f8f1830c3061 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:48.612371 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-55782b64-027b-465d-8615-f8f1830c3061 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1365 microversion: 2.1 time: 0.161170 Mar 05 21:31:48.612947 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3053/6066] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:48 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:49.630691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f041c533-3189-4ba0-bd82-ec641c4e5b89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:49.631361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f041c533-3189-4ba0-bd82-ec641c4e5b89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:49.638229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f041c533-3189-4ba0-bd82-ec641c4e5b89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:49.638701 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f041c533-3189-4ba0-bd82-ec641c4e5b89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:49.639495 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f041c533-3189-4ba0-bd82-ec641c4e5b89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:49.639980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f041c533-3189-4ba0-bd82-ec641c4e5b89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:49.774796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f041c533-3189-4ba0-bd82-ec641c4e5b89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:49.782168 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f041c533-3189-4ba0-bd82-ec641c4e5b89 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1365 microversion: 2.1 time: 0.156579 Mar 05 21:31:49.782751 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3014/6067] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:49 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:50.800152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c8472766-eb7f-4383-9ebc-4361734e39e1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:50.800729 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c8472766-eb7f-4383-9ebc-4361734e39e1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:50.807806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8472766-eb7f-4383-9ebc-4361734e39e1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:50.808263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8472766-eb7f-4383-9ebc-4361734e39e1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:50.809031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8472766-eb7f-4383-9ebc-4361734e39e1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:50.809473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c8472766-eb7f-4383-9ebc-4361734e39e1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:50.942141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c8472766-eb7f-4383-9ebc-4361734e39e1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:50.949470 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c8472766-eb7f-4383-9ebc-4361734e39e1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1365 microversion: 2.1 time: 0.153749 Mar 05 21:31:50.950053 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3054/6068] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:50 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:51.967193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b1d1fdbe-bdb4-4799-ac0f-db0906fbc8a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:51.967792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b1d1fdbe-bdb4-4799-ac0f-db0906fbc8a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:51.975129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1d1fdbe-bdb4-4799-ac0f-db0906fbc8a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:51.975593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1d1fdbe-bdb4-4799-ac0f-db0906fbc8a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:51.976416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1d1fdbe-bdb4-4799-ac0f-db0906fbc8a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:51.976877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b1d1fdbe-bdb4-4799-ac0f-db0906fbc8a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:52.122142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b1d1fdbe-bdb4-4799-ac0f-db0906fbc8a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:52.130254 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b1d1fdbe-bdb4-4799-ac0f-db0906fbc8a3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1365 microversion: 2.1 time: 0.167254 Mar 05 21:31:52.131147 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3015/6069] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:51 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:53.147708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-835668f6-8282-4bbb-9808-97ba2da22ac3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:53.148265 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-835668f6-8282-4bbb-9808-97ba2da22ac3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:53.155028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-835668f6-8282-4bbb-9808-97ba2da22ac3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:53.155490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-835668f6-8282-4bbb-9808-97ba2da22ac3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:53.156313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-835668f6-8282-4bbb-9808-97ba2da22ac3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:53.156759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-835668f6-8282-4bbb-9808-97ba2da22ac3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:53.288190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-835668f6-8282-4bbb-9808-97ba2da22ac3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:53.295508 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-835668f6-8282-4bbb-9808-97ba2da22ac3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1365 microversion: 2.1 time: 0.151831 Mar 05 21:31:53.296125 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3055/6070] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:53 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:53.882913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e0547d0a-2d33-4336-811b-2605a598bc0d req-03d23769-e10b-4556-a7cd-a86231f4a4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb324dba-40c7-4cb8-b053-75608ca660b0", "name": "network-vif-plugged", "status": "completed", "tag": "3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:53.893285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e0547d0a-2d33-4336-811b-2605a598bc0d req-03d23769-e10b-4556-a7cd-a86231f4a4b0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:53.893789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e0547d0a-2d33-4336-811b-2605a598bc0d req-03d23769-e10b-4556-a7cd-a86231f4a4b0 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:53.907503 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e0547d0a-2d33-4336-811b-2605a598bc0d req-03d23769-e10b-4556-a7cd-a86231f4a4b0 service nova] Creating event network-vif-plugged:3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06 for instance bb324dba-40c7-4cb8-b053-75608ca660b0 on nch2-master-1 Mar 05 21:31:53.910946 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e0547d0a-2d33-4336-811b-2605a598bc0d req-03d23769-e10b-4556-a7cd-a86231f4a4b0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031881 Mar 05 21:31:53.911557 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3016/6071] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:31:54.313945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e40a71b1-4437-4a2e-97ab-9e9da141ea8a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:54.315089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e40a71b1-4437-4a2e-97ab-9e9da141ea8a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:54.321848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e40a71b1-4437-4a2e-97ab-9e9da141ea8a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:54.322309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e40a71b1-4437-4a2e-97ab-9e9da141ea8a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:54.323085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e40a71b1-4437-4a2e-97ab-9e9da141ea8a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:54.323539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e40a71b1-4437-4a2e-97ab-9e9da141ea8a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:54.460973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e40a71b1-4437-4a2e-97ab-9e9da141ea8a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:54.468343 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e40a71b1-4437-4a2e-97ab-9e9da141ea8a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1365 microversion: 2.1 time: 0.158431 Mar 05 21:31:54.468925 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3056/6072] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:54 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:55.487116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-917cf09e-1148-4233-97b3-36ce12db0a76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:55.487863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-917cf09e-1148-4233-97b3-36ce12db0a76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:55.494163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-917cf09e-1148-4233-97b3-36ce12db0a76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:55.494629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-917cf09e-1148-4233-97b3-36ce12db0a76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:55.495407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-917cf09e-1148-4233-97b3-36ce12db0a76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:55.495893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-917cf09e-1148-4233-97b3-36ce12db0a76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:55.636648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-917cf09e-1148-4233-97b3-36ce12db0a76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:55.645073 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-917cf09e-1148-4233-97b3-36ce12db0a76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1552 microversion: 2.1 time: 0.163133 Mar 05 21:31:55.645712 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3017/6073] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:55 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:55.662195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e434d1cc-fd88-4793-afa9-07c194ed84e7 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:55.662684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e434d1cc-fd88-4793-afa9-07c194ed84e7 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:55.669190 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e434d1cc-fd88-4793-afa9-07c194ed84e7 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:55.669650 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e434d1cc-fd88-4793-afa9-07c194ed84e7 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:55.670425 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e434d1cc-fd88-4793-afa9-07c194ed84e7 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:55.670874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e434d1cc-fd88-4793-afa9-07c194ed84e7 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:55.755102 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e434d1cc-fd88-4793-afa9-07c194ed84e7 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097310 Mar 05 21:31:55.755775 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3057/6074] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 21:31:55 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:31:57.008885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:57.010477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:57.010834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e0813a02-b9a3-4e92-b7c6-4947e5734a82 req-2f2403f0-2963-4d9c-8f3d-24f04cd9be05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb324dba-40c7-4cb8-b053-75608ca660b0", "tag": "3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:31:57.019653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e0813a02-b9a3-4e92-b7c6-4947e5734a82 req-2f2403f0-2963-4d9c-8f3d-24f04cd9be05 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:57.020191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e0813a02-b9a3-4e92-b7c6-4947e5734a82 req-2f2403f0-2963-4d9c-8f3d-24f04cd9be05 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:57.024194 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:57.026510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:57.028444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:57.029076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:57.038850 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e0813a02-b9a3-4e92-b7c6-4947e5734a82 req-2f2403f0-2963-4d9c-8f3d-24f04cd9be05 service nova] Creating event network-changed:3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06 for instance bb324dba-40c7-4cb8-b053-75608ca660b0 on nch2-master-1 Mar 05 21:31:57.044577 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e0813a02-b9a3-4e92-b7c6-4947e5734a82 req-2f2403f0-2963-4d9c-8f3d-24f04cd9be05 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038277 Mar 05 21:31:57.045977 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3058/6075] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:31:57.065886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:57.083317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Old instance type m1.heat2, new instance type m1.heat {{(pid=141478) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 21:31:57.092013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:31:57.092706 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:31:57.093193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:31:57.093619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:31:57.094046 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:31:57.186383 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-abc1e2cc-0ead-4332-9cf1-76eafbf15b53 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0/action" status: 202 len: 0 microversion: 2.1 time: 0.181613 Mar 05 21:31:57.198848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f45aaf3f-9a5c-42e2-b9de-8223ff238702 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:57.199700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f45aaf3f-9a5c-42e2-b9de-8223ff238702 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:57.203901 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3018/6076] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:31:57 2022] POST /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:31:57.210047 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f45aaf3f-9a5c-42e2-b9de-8223ff238702 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:57.210706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f45aaf3f-9a5c-42e2-b9de-8223ff238702 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:57.212020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f45aaf3f-9a5c-42e2-b9de-8223ff238702 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:57.213532 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f45aaf3f-9a5c-42e2-b9de-8223ff238702 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:57.393854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f45aaf3f-9a5c-42e2-b9de-8223ff238702 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:57.401903 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f45aaf3f-9a5c-42e2-b9de-8223ff238702 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1561 microversion: 2.1 time: 0.208096 Mar 05 21:31:57.402503 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3059/6077] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:57 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1561 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:58.419396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f9cce167-bb5e-4a73-987d-811bdb4bf5df tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:58.419958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f9cce167-bb5e-4a73-987d-811bdb4bf5df tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:58.427349 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9cce167-bb5e-4a73-987d-811bdb4bf5df tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:58.427846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9cce167-bb5e-4a73-987d-811bdb4bf5df tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:58.428630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9cce167-bb5e-4a73-987d-811bdb4bf5df tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:58.429083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f9cce167-bb5e-4a73-987d-811bdb4bf5df tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:58.574892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f9cce167-bb5e-4a73-987d-811bdb4bf5df tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:58.582743 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f9cce167-bb5e-4a73-987d-811bdb4bf5df tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1680 microversion: 2.1 time: 0.167305 Mar 05 21:31:58.583346 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3019/6078] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:58 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:31:59.600810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-35b1350c-eb79-466d-8821-12288092a95c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:31:59.601436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-35b1350c-eb79-466d-8821-12288092a95c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:31:59.608268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35b1350c-eb79-466d-8821-12288092a95c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:59.608756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35b1350c-eb79-466d-8821-12288092a95c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:59.609780 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35b1350c-eb79-466d-8821-12288092a95c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:31:59.609966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35b1350c-eb79-466d-8821-12288092a95c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:31:59.746844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-35b1350c-eb79-466d-8821-12288092a95c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:31:59.754669 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-35b1350c-eb79-466d-8821-12288092a95c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.157785 Mar 05 21:31:59.755260 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3060/6079] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:31:59 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:00.773208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f813c340-acc1-4821-9edd-fb4df7bdc90b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:00.773835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f813c340-acc1-4821-9edd-fb4df7bdc90b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:00.780472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f813c340-acc1-4821-9edd-fb4df7bdc90b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:00.780941 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f813c340-acc1-4821-9edd-fb4df7bdc90b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:00.781755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f813c340-acc1-4821-9edd-fb4df7bdc90b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:00.782207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f813c340-acc1-4821-9edd-fb4df7bdc90b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:00.918952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f813c340-acc1-4821-9edd-fb4df7bdc90b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:00.926673 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f813c340-acc1-4821-9edd-fb4df7bdc90b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.157419 Mar 05 21:32:00.927251 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3020/6080] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:00 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:32:01.943091 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-de86cf27-e0fe-4f5d-aadd-6ddf43681647 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:01.943739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-de86cf27-e0fe-4f5d-aadd-6ddf43681647 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:01.950716 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de86cf27-e0fe-4f5d-aadd-6ddf43681647 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:01.951181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de86cf27-e0fe-4f5d-aadd-6ddf43681647 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:01.951992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de86cf27-e0fe-4f5d-aadd-6ddf43681647 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:01.952443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de86cf27-e0fe-4f5d-aadd-6ddf43681647 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:02.085101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-de86cf27-e0fe-4f5d-aadd-6ddf43681647 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:02.092483 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-de86cf27-e0fe-4f5d-aadd-6ddf43681647 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.153378 Mar 05 21:32:02.093071 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3061/6081] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:01 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:03.110376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-13ff457c-b373-4800-8bb3-d9b0e6c04cd6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:03.111044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-13ff457c-b373-4800-8bb3-d9b0e6c04cd6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:03.118608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13ff457c-b373-4800-8bb3-d9b0e6c04cd6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:03.119120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13ff457c-b373-4800-8bb3-d9b0e6c04cd6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:03.119942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13ff457c-b373-4800-8bb3-d9b0e6c04cd6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:03.120404 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-13ff457c-b373-4800-8bb3-d9b0e6c04cd6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:03.252789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-13ff457c-b373-4800-8bb3-d9b0e6c04cd6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:03.260192 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-13ff457c-b373-4800-8bb3-d9b0e6c04cd6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.153876 Mar 05 21:32:03.260770 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3021/6082] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:03 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:04.277496 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cd896e8f-e228-4286-84aa-bdb2fa59fe24 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:04.278124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cd896e8f-e228-4286-84aa-bdb2fa59fe24 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:04.285666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd896e8f-e228-4286-84aa-bdb2fa59fe24 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:04.286132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd896e8f-e228-4286-84aa-bdb2fa59fe24 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:04.286919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd896e8f-e228-4286-84aa-bdb2fa59fe24 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:04.287372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cd896e8f-e228-4286-84aa-bdb2fa59fe24 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:04.428960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cd896e8f-e228-4286-84aa-bdb2fa59fe24 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:04.436458 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cd896e8f-e228-4286-84aa-bdb2fa59fe24 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.162919 Mar 05 21:32:04.437028 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3062/6083] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:04 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:05.454320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-90c46417-ce31-4b4e-bffd-27a7932c1f96 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:05.455596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-90c46417-ce31-4b4e-bffd-27a7932c1f96 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:05.462622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90c46417-ce31-4b4e-bffd-27a7932c1f96 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:05.463104 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90c46417-ce31-4b4e-bffd-27a7932c1f96 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:05.463930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90c46417-ce31-4b4e-bffd-27a7932c1f96 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:05.464388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-90c46417-ce31-4b4e-bffd-27a7932c1f96 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:05.601781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-90c46417-ce31-4b4e-bffd-27a7932c1f96 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:05.609229 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-90c46417-ce31-4b4e-bffd-27a7932c1f96 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.158862 Mar 05 21:32:05.609816 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3022/6084] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:05 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:06.628365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-82069f82-272c-4dfd-8d9f-6b2b1aba499e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:06.628991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-82069f82-272c-4dfd-8d9f-6b2b1aba499e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:06.635989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82069f82-272c-4dfd-8d9f-6b2b1aba499e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:06.636450 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82069f82-272c-4dfd-8d9f-6b2b1aba499e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:06.637230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82069f82-272c-4dfd-8d9f-6b2b1aba499e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:06.637679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-82069f82-272c-4dfd-8d9f-6b2b1aba499e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:06.773611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-82069f82-272c-4dfd-8d9f-6b2b1aba499e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:06.781155 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-82069f82-272c-4dfd-8d9f-6b2b1aba499e tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.157852 Mar 05 21:32:06.781760 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3063/6085] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:06 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:07.798639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-279f5dba-ac46-416d-8ccf-4474121e393f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:07.799965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-279f5dba-ac46-416d-8ccf-4474121e393f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:07.806881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-279f5dba-ac46-416d-8ccf-4474121e393f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:07.807348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-279f5dba-ac46-416d-8ccf-4474121e393f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:07.808163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-279f5dba-ac46-416d-8ccf-4474121e393f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:07.808615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-279f5dba-ac46-416d-8ccf-4474121e393f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:07.943291 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-279f5dba-ac46-416d-8ccf-4474121e393f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:07.950667 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-279f5dba-ac46-416d-8ccf-4474121e393f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.156160 Mar 05 21:32:07.951247 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3023/6086] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:07 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:08.968094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e53a43ae-dad1-4c54-8653-8996e2480cfa tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:08.968722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e53a43ae-dad1-4c54-8653-8996e2480cfa tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:08.975598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e53a43ae-dad1-4c54-8653-8996e2480cfa tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:08.976093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e53a43ae-dad1-4c54-8653-8996e2480cfa tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:08.976885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e53a43ae-dad1-4c54-8653-8996e2480cfa tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:08.977331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e53a43ae-dad1-4c54-8653-8996e2480cfa tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:09.110086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e53a43ae-dad1-4c54-8653-8996e2480cfa tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:09.118162 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e53a43ae-dad1-4c54-8653-8996e2480cfa tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.154320 Mar 05 21:32:09.118748 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3064/6087] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:08 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:10.136446 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eccf0f54-7b4f-4c68-8399-737b55a3e63d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:10.137076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eccf0f54-7b4f-4c68-8399-737b55a3e63d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:10.143905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eccf0f54-7b4f-4c68-8399-737b55a3e63d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:10.144312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eccf0f54-7b4f-4c68-8399-737b55a3e63d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:10.145091 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eccf0f54-7b4f-4c68-8399-737b55a3e63d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:10.145540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eccf0f54-7b4f-4c68-8399-737b55a3e63d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:10.281490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eccf0f54-7b4f-4c68-8399-737b55a3e63d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:10.289659 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eccf0f54-7b4f-4c68-8399-737b55a3e63d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.157082 Mar 05 21:32:10.290247 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3024/6088] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:10 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:11.307767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-84b3978d-c576-47c1-a0bb-80e2570e61a8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:11.308304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-84b3978d-c576-47c1-a0bb-80e2570e61a8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:11.315619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84b3978d-c576-47c1-a0bb-80e2570e61a8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:11.316105 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84b3978d-c576-47c1-a0bb-80e2570e61a8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:11.316887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84b3978d-c576-47c1-a0bb-80e2570e61a8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:11.317337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-84b3978d-c576-47c1-a0bb-80e2570e61a8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:11.454903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-84b3978d-c576-47c1-a0bb-80e2570e61a8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:11.462262 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-84b3978d-c576-47c1-a0bb-80e2570e61a8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.158577 Mar 05 21:32:11.462828 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3065/6089] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:11 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:12.479791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-33d716c5-fd94-4732-ab95-7b2f3cc96d76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:12.480422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-33d716c5-fd94-4732-ab95-7b2f3cc96d76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:12.487583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33d716c5-fd94-4732-ab95-7b2f3cc96d76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:12.488117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33d716c5-fd94-4732-ab95-7b2f3cc96d76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:12.488898 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33d716c5-fd94-4732-ab95-7b2f3cc96d76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:12.489347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33d716c5-fd94-4732-ab95-7b2f3cc96d76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:12.626021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-33d716c5-fd94-4732-ab95-7b2f3cc96d76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:12.635404 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-33d716c5-fd94-4732-ab95-7b2f3cc96d76 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.159567 Mar 05 21:32:12.636017 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3025/6090] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:12 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:13.652120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-72c842e8-6480-4826-bfed-302fa8942e83 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:13.652736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-72c842e8-6480-4826-bfed-302fa8942e83 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:13.659461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72c842e8-6480-4826-bfed-302fa8942e83 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:13.659944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72c842e8-6480-4826-bfed-302fa8942e83 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:13.660709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72c842e8-6480-4826-bfed-302fa8942e83 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:13.661147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72c842e8-6480-4826-bfed-302fa8942e83 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:13.795589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-72c842e8-6480-4826-bfed-302fa8942e83 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:13.803991 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-72c842e8-6480-4826-bfed-302fa8942e83 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.156099 Mar 05 21:32:13.804571 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3066/6091] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:13 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:14.821741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3b68eeac-18ec-4997-a94d-8748d8a7bef3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:14.822373 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3b68eeac-18ec-4997-a94d-8748d8a7bef3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:14.829235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b68eeac-18ec-4997-a94d-8748d8a7bef3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:14.829704 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b68eeac-18ec-4997-a94d-8748d8a7bef3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:14.830745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b68eeac-18ec-4997-a94d-8748d8a7bef3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:14.831064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3b68eeac-18ec-4997-a94d-8748d8a7bef3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:14.964918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3b68eeac-18ec-4997-a94d-8748d8a7bef3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:14.976382 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3b68eeac-18ec-4997-a94d-8748d8a7bef3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.158364 Mar 05 21:32:14.977034 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3026/6092] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:14 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:15.993983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-36ed3ed2-cff4-4805-b5d0-a081edf9eccd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:15.994638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-36ed3ed2-cff4-4805-b5d0-a081edf9eccd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:16.001793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36ed3ed2-cff4-4805-b5d0-a081edf9eccd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:16.002290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36ed3ed2-cff4-4805-b5d0-a081edf9eccd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:16.003076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36ed3ed2-cff4-4805-b5d0-a081edf9eccd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:16.003527 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-36ed3ed2-cff4-4805-b5d0-a081edf9eccd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:16.139274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-36ed3ed2-cff4-4805-b5d0-a081edf9eccd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:16.147289 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-36ed3ed2-cff4-4805-b5d0-a081edf9eccd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.157323 Mar 05 21:32:16.147840 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3067/6093] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:15 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:17.164746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f3668eb7-2c22-48c5-a99a-15c05e900aa5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:17.165302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f3668eb7-2c22-48c5-a99a-15c05e900aa5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:17.173989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3668eb7-2c22-48c5-a99a-15c05e900aa5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:17.175149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3668eb7-2c22-48c5-a99a-15c05e900aa5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:17.176144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3668eb7-2c22-48c5-a99a-15c05e900aa5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:17.176596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f3668eb7-2c22-48c5-a99a-15c05e900aa5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:17.310966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f3668eb7-2c22-48c5-a99a-15c05e900aa5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:17.318389 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f3668eb7-2c22-48c5-a99a-15c05e900aa5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.157957 Mar 05 21:32:17.318975 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3027/6094] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:17 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:18.336549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fa9fb10d-eab6-43f9-b595-f47f2433d829 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:18.337350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fa9fb10d-eab6-43f9-b595-f47f2433d829 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:18.344781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa9fb10d-eab6-43f9-b595-f47f2433d829 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:18.345245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa9fb10d-eab6-43f9-b595-f47f2433d829 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:18.346088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa9fb10d-eab6-43f9-b595-f47f2433d829 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:18.346576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fa9fb10d-eab6-43f9-b595-f47f2433d829 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:18.483403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fa9fb10d-eab6-43f9-b595-f47f2433d829 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:18.491573 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fa9fb10d-eab6-43f9-b595-f47f2433d829 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.159098 Mar 05 21:32:18.492185 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3068/6095] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:18 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:19.508795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-52915509-46f5-4cc7-b88b-233a5ae08fe9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:19.509451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-52915509-46f5-4cc7-b88b-233a5ae08fe9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:19.516745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52915509-46f5-4cc7-b88b-233a5ae08fe9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:19.517208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52915509-46f5-4cc7-b88b-233a5ae08fe9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:19.518322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52915509-46f5-4cc7-b88b-233a5ae08fe9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:19.518466 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-52915509-46f5-4cc7-b88b-233a5ae08fe9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:19.652723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-52915509-46f5-4cc7-b88b-233a5ae08fe9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:19.660683 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-52915509-46f5-4cc7-b88b-233a5ae08fe9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.155821 Mar 05 21:32:19.661270 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3028/6096] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:19 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:20.679676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-47d6b33d-821b-4795-8c23-d734eb23cceb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:20.680329 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-47d6b33d-821b-4795-8c23-d734eb23cceb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:20.687298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47d6b33d-821b-4795-8c23-d734eb23cceb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:20.687788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47d6b33d-821b-4795-8c23-d734eb23cceb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:20.688577 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47d6b33d-821b-4795-8c23-d734eb23cceb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:20.689026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-47d6b33d-821b-4795-8c23-d734eb23cceb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:20.831324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-47d6b33d-821b-4795-8c23-d734eb23cceb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:20.839226 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-47d6b33d-821b-4795-8c23-d734eb23cceb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.163758 Mar 05 21:32:20.839859 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3069/6097] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:20 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:21.856700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f57ad710-cfe4-4499-9357-84462aaa07d5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:21.857315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f57ad710-cfe4-4499-9357-84462aaa07d5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:21.864966 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f57ad710-cfe4-4499-9357-84462aaa07d5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:21.865432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f57ad710-cfe4-4499-9357-84462aaa07d5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:21.866210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f57ad710-cfe4-4499-9357-84462aaa07d5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:21.866662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f57ad710-cfe4-4499-9357-84462aaa07d5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:21.999638 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f57ad710-cfe4-4499-9357-84462aaa07d5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:22.007431 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f57ad710-cfe4-4499-9357-84462aaa07d5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.154692 Mar 05 21:32:22.008111 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3029/6098] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:21 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:23.024886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ce84ee5e-3ec4-4500-adbe-d2aa0b01bb1b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:23.025515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ce84ee5e-3ec4-4500-adbe-d2aa0b01bb1b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:23.032410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce84ee5e-3ec4-4500-adbe-d2aa0b01bb1b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:23.032872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce84ee5e-3ec4-4500-adbe-d2aa0b01bb1b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:23.034158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce84ee5e-3ec4-4500-adbe-d2aa0b01bb1b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:23.034607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ce84ee5e-3ec4-4500-adbe-d2aa0b01bb1b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:23.168864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ce84ee5e-3ec4-4500-adbe-d2aa0b01bb1b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:23.176934 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ce84ee5e-3ec4-4500-adbe-d2aa0b01bb1b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.156078 Mar 05 21:32:23.177526 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3070/6099] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:23 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:24.194630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6831d14a-4410-4464-8db2-9c5a4532518b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:24.195221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6831d14a-4410-4464-8db2-9c5a4532518b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:24.202098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6831d14a-4410-4464-8db2-9c5a4532518b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:24.202576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6831d14a-4410-4464-8db2-9c5a4532518b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:24.203402 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6831d14a-4410-4464-8db2-9c5a4532518b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:24.203912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6831d14a-4410-4464-8db2-9c5a4532518b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:24.339308 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6831d14a-4410-4464-8db2-9c5a4532518b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:24.348328 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6831d14a-4410-4464-8db2-9c5a4532518b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.157610 Mar 05 21:32:24.348943 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3030/6100] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:24 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:25.366783 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b06f2898-4548-4bc7-bc79-71f1df5c2708 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:25.367417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b06f2898-4548-4bc7-bc79-71f1df5c2708 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:25.373932 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b06f2898-4548-4bc7-bc79-71f1df5c2708 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:25.374398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b06f2898-4548-4bc7-bc79-71f1df5c2708 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:25.375183 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b06f2898-4548-4bc7-bc79-71f1df5c2708 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:25.375918 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b06f2898-4548-4bc7-bc79-71f1df5c2708 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:25.506059 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b06f2898-4548-4bc7-bc79-71f1df5c2708 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:25.513541 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b06f2898-4548-4bc7-bc79-71f1df5c2708 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.151203 Mar 05 21:32:25.514134 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3071/6101] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:25 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:26.530646 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3793b3f3-602a-4cde-b996-4ebee295ca3b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:26.531267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3793b3f3-602a-4cde-b996-4ebee295ca3b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:26.538149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3793b3f3-602a-4cde-b996-4ebee295ca3b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:26.538627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3793b3f3-602a-4cde-b996-4ebee295ca3b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:26.539425 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3793b3f3-602a-4cde-b996-4ebee295ca3b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:26.539916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3793b3f3-602a-4cde-b996-4ebee295ca3b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:26.672319 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3793b3f3-602a-4cde-b996-4ebee295ca3b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:26.680731 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3793b3f3-602a-4cde-b996-4ebee295ca3b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.154318 Mar 05 21:32:26.681314 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3031/6102] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:26 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:27.696832 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d83560c0-8db0-4e7b-951a-2350135d859c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:27.697435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d83560c0-8db0-4e7b-951a-2350135d859c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:27.704066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d83560c0-8db0-4e7b-951a-2350135d859c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:27.704534 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d83560c0-8db0-4e7b-951a-2350135d859c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:27.705898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d83560c0-8db0-4e7b-951a-2350135d859c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:27.706350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d83560c0-8db0-4e7b-951a-2350135d859c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:27.842193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d83560c0-8db0-4e7b-951a-2350135d859c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:27.850574 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d83560c0-8db0-4e7b-951a-2350135d859c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.157658 Mar 05 21:32:27.851158 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3072/6103] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:27 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:28.868393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fd1b1361-8b4e-4c7d-8a7a-0a8fa3daba61 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:28.869024 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fd1b1361-8b4e-4c7d-8a7a-0a8fa3daba61 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:28.876055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1b1361-8b4e-4c7d-8a7a-0a8fa3daba61 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:28.876526 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1b1361-8b4e-4c7d-8a7a-0a8fa3daba61 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:28.877305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1b1361-8b4e-4c7d-8a7a-0a8fa3daba61 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:28.877808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fd1b1361-8b4e-4c7d-8a7a-0a8fa3daba61 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:29.014668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fd1b1361-8b4e-4c7d-8a7a-0a8fa3daba61 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:29.022184 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fd1b1361-8b4e-4c7d-8a7a-0a8fa3daba61 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.157720 Mar 05 21:32:29.022777 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3032/6104] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:28 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:30.039028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ec2d9768-917e-46b3-b131-15f98a0fba94 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:30.039708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ec2d9768-917e-46b3-b131-15f98a0fba94 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:30.046548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec2d9768-917e-46b3-b131-15f98a0fba94 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:30.047012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec2d9768-917e-46b3-b131-15f98a0fba94 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:30.047832 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec2d9768-917e-46b3-b131-15f98a0fba94 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:30.048281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ec2d9768-917e-46b3-b131-15f98a0fba94 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:30.181393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ec2d9768-917e-46b3-b131-15f98a0fba94 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:30.188843 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ec2d9768-917e-46b3-b131-15f98a0fba94 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.154381 Mar 05 21:32:30.189425 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3073/6105] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:30 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:31.208083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7b8f9baa-6f4f-4b9c-873b-c3cc74d38f6a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:31.208958 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7b8f9baa-6f4f-4b9c-873b-c3cc74d38f6a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:31.216512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b8f9baa-6f4f-4b9c-873b-c3cc74d38f6a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:31.216993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b8f9baa-6f4f-4b9c-873b-c3cc74d38f6a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:31.217998 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b8f9baa-6f4f-4b9c-873b-c3cc74d38f6a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:31.218452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7b8f9baa-6f4f-4b9c-873b-c3cc74d38f6a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:31.372265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7b8f9baa-6f4f-4b9c-873b-c3cc74d38f6a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:31.380700 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7b8f9baa-6f4f-4b9c-873b-c3cc74d38f6a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1685 microversion: 2.1 time: 0.178133 Mar 05 21:32:31.390570 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3033/6106] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:31 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:31.781582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-2811fd12-e0ae-42c0-afcd-1bd4f41f4b3e req-3b824a8d-033e-4070-9d45-63a857f58710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb324dba-40c7-4cb8-b053-75608ca660b0", "name": "network-vif-unplugged", "status": "completed", "tag": "3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:32:31.791586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2811fd12-e0ae-42c0-afcd-1bd4f41f4b3e req-3b824a8d-033e-4070-9d45-63a857f58710 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:31.792069 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2811fd12-e0ae-42c0-afcd-1bd4f41f4b3e req-3b824a8d-033e-4070-9d45-63a857f58710 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:31.803934 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-2811fd12-e0ae-42c0-afcd-1bd4f41f4b3e req-3b824a8d-033e-4070-9d45-63a857f58710 service nova] Creating event network-vif-unplugged:3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06 for instance bb324dba-40c7-4cb8-b053-75608ca660b0 on nch1-master-1 Mar 05 21:32:31.810478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-2811fd12-e0ae-42c0-afcd-1bd4f41f4b3e req-3b824a8d-033e-4070-9d45-63a857f58710 service nova] Instance bb324dba-40c7-4cb8-b053-75608ca660b0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:32:31.837637 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-2811fd12-e0ae-42c0-afcd-1bd4f41f4b3e req-3b824a8d-033e-4070-9d45-63a857f58710 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059694 Mar 05 21:32:31.838938 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3074/6107] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:32:32.398405 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-933f059c-5353-432e-9f6c-0052cff2c05c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:32.399415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-933f059c-5353-432e-9f6c-0052cff2c05c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:32.406151 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-933f059c-5353-432e-9f6c-0052cff2c05c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:32.406618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-933f059c-5353-432e-9f6c-0052cff2c05c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:32.407407 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-933f059c-5353-432e-9f6c-0052cff2c05c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:32.407890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-933f059c-5353-432e-9f6c-0052cff2c05c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:32.645214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-933f059c-5353-432e-9f6c-0052cff2c05c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:32.652563 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-933f059c-5353-432e-9f6c-0052cff2c05c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1684 microversion: 2.1 time: 0.258441 Mar 05 21:32:32.653344 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3034/6108] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:32 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1684 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:33.671694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91251714-bc0e-4f96-a67a-199f88389b77 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:33.672444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91251714-bc0e-4f96-a67a-199f88389b77 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:33.679172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91251714-bc0e-4f96-a67a-199f88389b77 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:33.679631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91251714-bc0e-4f96-a67a-199f88389b77 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:33.680436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91251714-bc0e-4f96-a67a-199f88389b77 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:33.680881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91251714-bc0e-4f96-a67a-199f88389b77 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:33.821322 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-91251714-bc0e-4f96-a67a-199f88389b77 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:33.828902 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91251714-bc0e-4f96-a67a-199f88389b77 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1682 microversion: 2.1 time: 0.162301 Mar 05 21:32:33.829470 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3075/6109] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:33 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:33.854862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-55655758-915d-461f-9002-10064780ed8f req-da075ee1-415c-4780-acd2-abdd70efc923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb324dba-40c7-4cb8-b053-75608ca660b0", "tag": "3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:32:33.864187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-55655758-915d-461f-9002-10064780ed8f req-da075ee1-415c-4780-acd2-abdd70efc923 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:33.864654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-55655758-915d-461f-9002-10064780ed8f req-da075ee1-415c-4780-acd2-abdd70efc923 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:33.876262 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-55655758-915d-461f-9002-10064780ed8f req-da075ee1-415c-4780-acd2-abdd70efc923 service nova] Creating event network-changed:3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06 for instance bb324dba-40c7-4cb8-b053-75608ca660b0 on nch1-master-1 Mar 05 21:32:33.881661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-55655758-915d-461f-9002-10064780ed8f req-da075ee1-415c-4780-acd2-abdd70efc923 service nova] Instance bb324dba-40c7-4cb8-b053-75608ca660b0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:32:33.894797 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-55655758-915d-461f-9002-10064780ed8f req-da075ee1-415c-4780-acd2-abdd70efc923 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043628 Mar 05 21:32:33.895936 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3035/6110] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:32:34.847133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-361d0457-a627-4499-8a3f-a9a56f7ea0dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:34.847759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-361d0457-a627-4499-8a3f-a9a56f7ea0dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:34.855141 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-361d0457-a627-4499-8a3f-a9a56f7ea0dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:34.855611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-361d0457-a627-4499-8a3f-a9a56f7ea0dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:34.856428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-361d0457-a627-4499-8a3f-a9a56f7ea0dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:34.856881 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-361d0457-a627-4499-8a3f-a9a56f7ea0dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:34.993818 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-361d0457-a627-4499-8a3f-a9a56f7ea0dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:35.001706 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-361d0457-a627-4499-8a3f-a9a56f7ea0dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1679 microversion: 2.1 time: 0.158624 Mar 05 21:32:35.002303 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3076/6111] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:34 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:35.020035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-41a83440-d90b-4c80-a12b-37353e5154cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:32:35.020683 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-41a83440-d90b-4c80-a12b-37353e5154cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:35.026848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41a83440-d90b-4c80-a12b-37353e5154cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:35.027312 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41a83440-d90b-4c80-a12b-37353e5154cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:35.028257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41a83440-d90b-4c80-a12b-37353e5154cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:35.030567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41a83440-d90b-4c80-a12b-37353e5154cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:35.070008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41a83440-d90b-4c80-a12b-37353e5154cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:35.070475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41a83440-d90b-4c80-a12b-37353e5154cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:35.071285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41a83440-d90b-4c80-a12b-37353e5154cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:35.071760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-41a83440-d90b-4c80-a12b-37353e5154cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:35.092620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-41a83440-d90b-4c80-a12b-37353e5154cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for project 82cb16655b3348048ea81b796af0da84. Resources: {'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:32:35.097793 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-41a83440-d90b-4c80-a12b-37353e5154cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for user a2def15483f54bf282b64a4712ba0ce9 and project 82cb16655b3348048ea81b796af0da84. Resources: {'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:32:35.196844 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-41a83440-d90b-4c80-a12b-37353e5154cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0/action" status: 202 len: 0 microversion: 2.1 time: 0.181749 Mar 05 21:32:35.197495 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3036/6112] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:32:35 2022] POST /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:32:35.205717 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-02ba006b-2bb8-4d43-8cb8-dfe032b2c0f0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:35.206340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-02ba006b-2bb8-4d43-8cb8-dfe032b2c0f0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:35.213075 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02ba006b-2bb8-4d43-8cb8-dfe032b2c0f0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:35.213574 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02ba006b-2bb8-4d43-8cb8-dfe032b2c0f0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:35.214489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02ba006b-2bb8-4d43-8cb8-dfe032b2c0f0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:35.214955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02ba006b-2bb8-4d43-8cb8-dfe032b2c0f0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:35.350609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-02ba006b-2bb8-4d43-8cb8-dfe032b2c0f0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:35.358624 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-02ba006b-2bb8-4d43-8cb8-dfe032b2c0f0 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1678 microversion: 2.1 time: 0.156888 Mar 05 21:32:35.359219 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3077/6113] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:35 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:36.376899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cfe605e1-dc7b-4bda-b741-8d1e760cdc56 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:36.377634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cfe605e1-dc7b-4bda-b741-8d1e760cdc56 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:36.385884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cfe605e1-dc7b-4bda-b741-8d1e760cdc56 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:36.386361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cfe605e1-dc7b-4bda-b741-8d1e760cdc56 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:36.387169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cfe605e1-dc7b-4bda-b741-8d1e760cdc56 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:36.387661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cfe605e1-dc7b-4bda-b741-8d1e760cdc56 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:36.524413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cfe605e1-dc7b-4bda-b741-8d1e760cdc56 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:36.532003 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cfe605e1-dc7b-4bda-b741-8d1e760cdc56 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1678 microversion: 2.1 time: 0.159717 Mar 05 21:32:36.532595 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3037/6114] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:36 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:37.550427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5cf264e1-1b30-49a7-921c-7a3743705399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:37.551012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5cf264e1-1b30-49a7-921c-7a3743705399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:37.558134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cf264e1-1b30-49a7-921c-7a3743705399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:37.558585 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cf264e1-1b30-49a7-921c-7a3743705399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:37.559360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cf264e1-1b30-49a7-921c-7a3743705399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:37.559956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5cf264e1-1b30-49a7-921c-7a3743705399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:37.703514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5cf264e1-1b30-49a7-921c-7a3743705399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:37.712632 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5cf264e1-1b30-49a7-921c-7a3743705399 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1678 microversion: 2.1 time: 0.166569 Mar 05 21:32:37.713237 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3078/6115] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:37 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:38.730750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5b6870f6-86cd-4643-a76a-dbb694746c46 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:38.731296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5b6870f6-86cd-4643-a76a-dbb694746c46 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:38.738064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b6870f6-86cd-4643-a76a-dbb694746c46 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:38.738542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b6870f6-86cd-4643-a76a-dbb694746c46 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:38.739338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b6870f6-86cd-4643-a76a-dbb694746c46 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:38.739836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5b6870f6-86cd-4643-a76a-dbb694746c46 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:38.858401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-2ce751b9-e8fe-440b-be5f-f472b0099a90 req-ce79ca20-38c0-4284-91f6-79aa18770ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb324dba-40c7-4cb8-b053-75608ca660b0", "tag": "3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:32:38.877020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2ce751b9-e8fe-440b-be5f-f472b0099a90 req-ce79ca20-38c0-4284-91f6-79aa18770ed8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:38.877484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-2ce751b9-e8fe-440b-be5f-f472b0099a90 req-ce79ca20-38c0-4284-91f6-79aa18770ed8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:38.892109 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-2ce751b9-e8fe-440b-be5f-f472b0099a90 req-ce79ca20-38c0-4284-91f6-79aa18770ed8 service nova] Creating event network-changed:3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06 for instance bb324dba-40c7-4cb8-b053-75608ca660b0 on nch2-master-1 Mar 05 21:32:38.900693 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-2ce751b9-e8fe-440b-be5f-f472b0099a90 req-ce79ca20-38c0-4284-91f6-79aa18770ed8 service nova] Instance bb324dba-40c7-4cb8-b053-75608ca660b0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:32:38.918495 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-2ce751b9-e8fe-440b-be5f-f472b0099a90 req-ce79ca20-38c0-4284-91f6-79aa18770ed8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068481 Mar 05 21:32:38.919563 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3079/6116] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:32:39.022494 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5b6870f6-86cd-4643-a76a-dbb694746c46 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:39.030315 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5b6870f6-86cd-4643-a76a-dbb694746c46 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1678 microversion: 2.1 time: 0.303741 Mar 05 21:32:39.031203 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3038/6117] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:38 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1678 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:40.049242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-486dba4e-0651-40f8-adab-25755c75f340 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:40.049880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-486dba4e-0651-40f8-adab-25755c75f340 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:40.057171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-486dba4e-0651-40f8-adab-25755c75f340 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:40.057629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-486dba4e-0651-40f8-adab-25755c75f340 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:40.058410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-486dba4e-0651-40f8-adab-25755c75f340 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:40.058848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-486dba4e-0651-40f8-adab-25755c75f340 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:40.195241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-486dba4e-0651-40f8-adab-25755c75f340 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:40.202912 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-486dba4e-0651-40f8-adab-25755c75f340 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1678 microversion: 2.1 time: 0.159063 Mar 05 21:32:40.203502 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3080/6118] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:40 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:41.220885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eacfb6c7-081f-4ec8-8dbe-381dae286f50 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:41.221420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eacfb6c7-081f-4ec8-8dbe-381dae286f50 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:41.228493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eacfb6c7-081f-4ec8-8dbe-381dae286f50 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:41.228976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eacfb6c7-081f-4ec8-8dbe-381dae286f50 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:41.229746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eacfb6c7-081f-4ec8-8dbe-381dae286f50 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:41.230199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eacfb6c7-081f-4ec8-8dbe-381dae286f50 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:41.370940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eacfb6c7-081f-4ec8-8dbe-381dae286f50 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:41.378634 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eacfb6c7-081f-4ec8-8dbe-381dae286f50 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1671 microversion: 2.1 time: 0.161794 Mar 05 21:32:41.379217 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3039/6119] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:41 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:41.397253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c4fb84ff-b35b-4bc4-8db8-359244ed86f1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:41.397902 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c4fb84ff-b35b-4bc4-8db8-359244ed86f1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:41.403967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4fb84ff-b35b-4bc4-8db8-359244ed86f1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:41.404429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4fb84ff-b35b-4bc4-8db8-359244ed86f1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:41.405216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4fb84ff-b35b-4bc4-8db8-359244ed86f1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:41.405663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c4fb84ff-b35b-4bc4-8db8-359244ed86f1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:41.541679 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c4fb84ff-b35b-4bc4-8db8-359244ed86f1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:41.549102 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c4fb84ff-b35b-4bc4-8db8-359244ed86f1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1671 microversion: 2.1 time: 0.157247 Mar 05 21:32:41.549729 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3081/6120] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:41 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:41.565850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-05e741ab-fff0-4524-9f6e-8f4eb401a1ee tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:41.566487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-05e741ab-fff0-4524-9f6e-8f4eb401a1ee tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:41.573004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05e741ab-fff0-4524-9f6e-8f4eb401a1ee tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:41.573478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05e741ab-fff0-4524-9f6e-8f4eb401a1ee tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:41.574269 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05e741ab-fff0-4524-9f6e-8f4eb401a1ee tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:41.574759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-05e741ab-fff0-4524-9f6e-8f4eb401a1ee tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:41.714902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-05e741ab-fff0-4524-9f6e-8f4eb401a1ee tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:41.722502 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-05e741ab-fff0-4524-9f6e-8f4eb401a1ee tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1671 microversion: 2.1 time: 0.160646 Mar 05 21:32:41.723080 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3040/6121] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:41 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:32:41.739698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-06e03d4b-abc2-4a76-986b-5a1793d3dd0f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:41.741274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-06e03d4b-abc2-4a76-986b-5a1793d3dd0f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:41.747331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06e03d4b-abc2-4a76-986b-5a1793d3dd0f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:41.747781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06e03d4b-abc2-4a76-986b-5a1793d3dd0f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:41.748564 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06e03d4b-abc2-4a76-986b-5a1793d3dd0f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:41.749015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-06e03d4b-abc2-4a76-986b-5a1793d3dd0f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:41.773769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-06e03d4b-abc2-4a76-986b-5a1793d3dd0f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:32:41.852584 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-06e03d4b-abc2-4a76-986b-5a1793d3dd0f tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 204 len: 0 microversion: 2.1 time: 0.116217 Mar 05 21:32:41.853829 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3082/6122] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:32:41 2022] DELETE /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:32:41.863087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f69fe565-516c-4bd1-9b61-ed491ac19a5c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:41.863765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f69fe565-516c-4bd1-9b61-ed491ac19a5c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:41.870505 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f69fe565-516c-4bd1-9b61-ed491ac19a5c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:41.870981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f69fe565-516c-4bd1-9b61-ed491ac19a5c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:41.871815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f69fe565-516c-4bd1-9b61-ed491ac19a5c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:41.872275 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f69fe565-516c-4bd1-9b61-ed491ac19a5c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:42.007834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f69fe565-516c-4bd1-9b61-ed491ac19a5c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:42.015382 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f69fe565-516c-4bd1-9b61-ed491ac19a5c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1677 microversion: 2.1 time: 0.156191 Mar 05 21:32:42.016006 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3041/6123] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:41 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:43.033523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a20c2266-2294-4ee7-9895-9ee05edc24a1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:43.034236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a20c2266-2294-4ee7-9895-9ee05edc24a1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:43.041756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a20c2266-2294-4ee7-9895-9ee05edc24a1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:43.042217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a20c2266-2294-4ee7-9895-9ee05edc24a1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:43.042991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a20c2266-2294-4ee7-9895-9ee05edc24a1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:43.043432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a20c2266-2294-4ee7-9895-9ee05edc24a1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:43.180866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a20c2266-2294-4ee7-9895-9ee05edc24a1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:43.188381 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a20c2266-2294-4ee7-9895-9ee05edc24a1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1677 microversion: 2.1 time: 0.159116 Mar 05 21:32:43.189317 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3083/6124] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:43 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:43.942640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-5fc93aa9-e2de-403d-95a8-24173f08ca1f req-9a990b26-6f66-4f17-bb76-74d0f2d6310a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb324dba-40c7-4cb8-b053-75608ca660b0", "name": "network-vif-deleted", "tag": "3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:32:43.955513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5fc93aa9-e2de-403d-95a8-24173f08ca1f req-9a990b26-6f66-4f17-bb76-74d0f2d6310a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:43.956167 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-5fc93aa9-e2de-403d-95a8-24173f08ca1f req-9a990b26-6f66-4f17-bb76-74d0f2d6310a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:43.972743 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-5fc93aa9-e2de-403d-95a8-24173f08ca1f req-9a990b26-6f66-4f17-bb76-74d0f2d6310a service nova] Creating event network-vif-deleted:3d289ebf-d8bd-478c-bfc3-f8ea51d1ea06 for instance bb324dba-40c7-4cb8-b053-75608ca660b0 on nch2-master-1 Mar 05 21:32:43.980169 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-5fc93aa9-e2de-403d-95a8-24173f08ca1f req-9a990b26-6f66-4f17-bb76-74d0f2d6310a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041017 Mar 05 21:32:43.980504 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3042/6125] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:32:44.206324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-986b521d-3b6d-41be-bc68-31b81b831672 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:44.207094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-986b521d-3b6d-41be-bc68-31b81b831672 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:44.214027 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-986b521d-3b6d-41be-bc68-31b81b831672 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:44.214486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-986b521d-3b6d-41be-bc68-31b81b831672 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:44.215260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-986b521d-3b6d-41be-bc68-31b81b831672 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:44.215725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-986b521d-3b6d-41be-bc68-31b81b831672 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:44.247033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-986b521d-3b6d-41be-bc68-31b81b831672 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:44.247489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-986b521d-3b6d-41be-bc68-31b81b831672 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:44.247977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-986b521d-3b6d-41be-bc68-31b81b831672 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lazy-loading 'fault' on Instance uuid bb324dba-40c7-4cb8-b053-75608ca660b0 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:32:44.289445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-986b521d-3b6d-41be-bc68-31b81b831672 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:44.297579 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-986b521d-3b6d-41be-bc68-31b81b831672 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 200 len: 1329 microversion: 2.1 time: 0.095248 Mar 05 21:32:44.299547 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3084/6126] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:44 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 1329 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:45.315738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-99e70516-f104-43cb-8c88-ecc0a9504792 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:45.316366 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-99e70516-f104-43cb-8c88-ecc0a9504792 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:45.324421 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99e70516-f104-43cb-8c88-ecc0a9504792 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:45.324929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99e70516-f104-43cb-8c88-ecc0a9504792 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:45.325771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99e70516-f104-43cb-8c88-ecc0a9504792 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:45.326220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99e70516-f104-43cb-8c88-ecc0a9504792 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:45.340906 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-99e70516-f104-43cb-8c88-ecc0a9504792 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance bb324dba-40c7-4cb8-b053-75608ca660b0 could not be found. Mar 05 21:32:45.341522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-99e70516-f104-43cb-8c88-ecc0a9504792 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance bb324dba-40c7-4cb8-b053-75608ca660b0 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:32:45.342376 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-99e70516-f104-43cb-8c88-ecc0a9504792 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 404 len: 111 microversion: 2.1 time: 0.031560 Mar 05 21:32:45.342944 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3043/6127] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:45 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:32:45.365588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-450035e0-b266-4b7d-a63f-fa11c76b58fc tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:45.366645 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-450035e0-b266-4b7d-a63f-fa11c76b58fc tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:45.375809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-450035e0-b266-4b7d-a63f-fa11c76b58fc tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:45.377283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-450035e0-b266-4b7d-a63f-fa11c76b58fc tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:45.377283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-450035e0-b266-4b7d-a63f-fa11c76b58fc tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:45.377696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-450035e0-b266-4b7d-a63f-fa11c76b58fc tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:45.392556 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-450035e0-b266-4b7d-a63f-fa11c76b58fc tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance bb324dba-40c7-4cb8-b053-75608ca660b0 could not be found. Mar 05 21:32:45.393993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-450035e0-b266-4b7d-a63f-fa11c76b58fc tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance bb324dba-40c7-4cb8-b053-75608ca660b0 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:32:45.394847 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-450035e0-b266-4b7d-a63f-fa11c76b58fc tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 404 len: 111 microversion: 2.1 time: 0.035423 Mar 05 21:32:45.395409 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3085/6128] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:45 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 21:32:45.456455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-482009149", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "b9689e7b-ea3e-4fc4-94eb-1bf10ac2e162"}], "security_groups": [{"name": "tempest-securitygroup--1535879041"}], "key_name": "tempest-keypair-1237555310", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:32:45.568875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] validate_networks() for [('b9689e7b-ea3e-4fc4-94eb-1bf10ac2e162', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:32:46.012361 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:32:46.012810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:32:46.013310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:32:46.013776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:32:46.014208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:32:46.023608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:46.024139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:46.025002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:46.025464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:46.042830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for project 82cb16655b3348048ea81b796af0da84. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:32:46.048115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for user a2def15483f54bf282b64a4712ba0ce9 and project 82cb16655b3348048ea81b796af0da84. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:32:46.060977 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:32:46.063290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:32:46.109111 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-352634db-ce97-4b17-8842-70aad4e11047 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.656635 Mar 05 21:32:46.109700 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3044/6129] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:32:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:32:46.120758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a9e271a3-f700-4cbb-86c1-bab8fd8bfc2c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:46.121408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a9e271a3-f700-4cbb-86c1-bab8fd8bfc2c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:46.179447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a9e271a3-f700-4cbb-86c1-bab8fd8bfc2c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:46.186295 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a9e271a3-f700-4cbb-86c1-bab8fd8bfc2c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1238 microversion: 2.1 time: 0.069573 Mar 05 21:32:46.186875 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3086/6130] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:46 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:47.204910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5d8b0aa8-18c4-4c12-b064-7a317087a19c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:47.205542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5d8b0aa8-18c4-4c12-b064-7a317087a19c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:47.212864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d8b0aa8-18c4-4c12-b064-7a317087a19c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:47.213333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d8b0aa8-18c4-4c12-b064-7a317087a19c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:47.214122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d8b0aa8-18c4-4c12-b064-7a317087a19c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:47.214574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d8b0aa8-18c4-4c12-b064-7a317087a19c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:47.280626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5d8b0aa8-18c4-4c12-b064-7a317087a19c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:47.288742 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5d8b0aa8-18c4-4c12-b064-7a317087a19c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1296 microversion: 2.1 time: 0.088511 Mar 05 21:32:47.289373 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3045/6131] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:47 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:48.307347 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-69da096b-f230-4c78-afae-dd4e14fb9181 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:48.308143 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-69da096b-f230-4c78-afae-dd4e14fb9181 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:48.315576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69da096b-f230-4c78-afae-dd4e14fb9181 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:48.316152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69da096b-f230-4c78-afae-dd4e14fb9181 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:48.316992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69da096b-f230-4c78-afae-dd4e14fb9181 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:48.317444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-69da096b-f230-4c78-afae-dd4e14fb9181 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:48.344868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-34215674-747d-4936-bddd-59f1a9d35143 req-f7862e14-60f6-445e-b037-152c77504f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f83a29-0207-43d0-9835-ff0ad847e28b", "tag": "200c80d2-ab83-4689-ace8-3e9087ff830a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:32:48.363113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-34215674-747d-4936-bddd-59f1a9d35143 req-f7862e14-60f6-445e-b037-152c77504f44 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:48.366352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-34215674-747d-4936-bddd-59f1a9d35143 req-f7862e14-60f6-445e-b037-152c77504f44 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:48.399962 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-34215674-747d-4936-bddd-59f1a9d35143 req-f7862e14-60f6-445e-b037-152c77504f44 service nova] Creating event network-changed:200c80d2-ab83-4689-ace8-3e9087ff830a for instance e5f83a29-0207-43d0-9835-ff0ad847e28b on nch1-master-1 Mar 05 21:32:48.411806 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-34215674-747d-4936-bddd-59f1a9d35143 req-f7862e14-60f6-445e-b037-152c77504f44 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071143 Mar 05 21:32:48.413879 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3046/6132] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:32:48.469832 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-69da096b-f230-4c78-afae-dd4e14fb9181 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:48.480390 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-69da096b-f230-4c78-afae-dd4e14fb9181 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1364 microversion: 2.1 time: 0.177410 Mar 05 21:32:48.481144 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3087/6133] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:48 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:49.499688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4cf090ff-d113-40bc-8090-797ad1fdf28b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:49.500690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4cf090ff-d113-40bc-8090-797ad1fdf28b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:49.507492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cf090ff-d113-40bc-8090-797ad1fdf28b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:49.507988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cf090ff-d113-40bc-8090-797ad1fdf28b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:49.508788 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cf090ff-d113-40bc-8090-797ad1fdf28b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:49.509253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cf090ff-d113-40bc-8090-797ad1fdf28b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:49.682015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4cf090ff-d113-40bc-8090-797ad1fdf28b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:49.689489 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4cf090ff-d113-40bc-8090-797ad1fdf28b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1364 microversion: 2.1 time: 0.195064 Mar 05 21:32:49.690129 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3047/6134] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:49 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:50.706776 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-39b6ea58-fe97-459c-9898-6ffec177322d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:50.707398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-39b6ea58-fe97-459c-9898-6ffec177322d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:50.714268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39b6ea58-fe97-459c-9898-6ffec177322d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:50.714761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39b6ea58-fe97-459c-9898-6ffec177322d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:50.715540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39b6ea58-fe97-459c-9898-6ffec177322d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:50.716017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39b6ea58-fe97-459c-9898-6ffec177322d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:50.847414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-39b6ea58-fe97-459c-9898-6ffec177322d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:50.855300 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-39b6ea58-fe97-459c-9898-6ffec177322d tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1364 microversion: 2.1 time: 0.152493 Mar 05 21:32:50.855908 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3088/6135] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:50 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:51.872993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5f0fb728-a02a-4315-b11a-faa190eb6d19 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:51.873605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5f0fb728-a02a-4315-b11a-faa190eb6d19 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:51.881362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f0fb728-a02a-4315-b11a-faa190eb6d19 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:51.881893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f0fb728-a02a-4315-b11a-faa190eb6d19 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:51.882682 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f0fb728-a02a-4315-b11a-faa190eb6d19 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:51.883135 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5f0fb728-a02a-4315-b11a-faa190eb6d19 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:52.017229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5f0fb728-a02a-4315-b11a-faa190eb6d19 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:52.025529 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5f0fb728-a02a-4315-b11a-faa190eb6d19 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1364 microversion: 2.1 time: 0.156496 Mar 05 21:32:52.026111 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3048/6136] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:51 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:53.043493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-528927f3-fdea-462a-a7d1-31051abac739 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:53.044163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-528927f3-fdea-462a-a7d1-31051abac739 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:53.050946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-528927f3-fdea-462a-a7d1-31051abac739 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:53.051408 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-528927f3-fdea-462a-a7d1-31051abac739 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:53.052211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-528927f3-fdea-462a-a7d1-31051abac739 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:53.053309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-528927f3-fdea-462a-a7d1-31051abac739 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:53.188759 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-528927f3-fdea-462a-a7d1-31051abac739 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:53.196592 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-528927f3-fdea-462a-a7d1-31051abac739 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1364 microversion: 2.1 time: 0.157018 Mar 05 21:32:53.197170 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3089/6137] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:53 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:54.199558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-6df7975f-ceea-4bba-8414-9cbabcce5ba1 req-cd75d813-8597-4f0c-a3b9-f1bd4e8d4e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f83a29-0207-43d0-9835-ff0ad847e28b", "name": "network-vif-plugged", "status": "completed", "tag": "200c80d2-ab83-4689-ace8-3e9087ff830a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:32:54.208825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6df7975f-ceea-4bba-8414-9cbabcce5ba1 req-cd75d813-8597-4f0c-a3b9-f1bd4e8d4e8a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:54.209496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6df7975f-ceea-4bba-8414-9cbabcce5ba1 req-cd75d813-8597-4f0c-a3b9-f1bd4e8d4e8a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:54.215562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0fa2916a-e098-4ebb-80b0-551f537daf5b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:54.216904 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0fa2916a-e098-4ebb-80b0-551f537daf5b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:54.224208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fa2916a-e098-4ebb-80b0-551f537daf5b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:54.225067 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-6df7975f-ceea-4bba-8414-9cbabcce5ba1 req-cd75d813-8597-4f0c-a3b9-f1bd4e8d4e8a service nova] Creating event network-vif-plugged:200c80d2-ab83-4689-ace8-3e9087ff830a for instance e5f83a29-0207-43d0-9835-ff0ad847e28b on nch1-master-1 Mar 05 21:32:54.225730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fa2916a-e098-4ebb-80b0-551f537daf5b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:54.226772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fa2916a-e098-4ebb-80b0-551f537daf5b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:54.227443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0fa2916a-e098-4ebb-80b0-551f537daf5b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:54.230042 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-6df7975f-ceea-4bba-8414-9cbabcce5ba1 req-cd75d813-8597-4f0c-a3b9-f1bd4e8d4e8a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034239 Mar 05 21:32:54.230674 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3049/6138] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:32:54.373498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0fa2916a-e098-4ebb-80b0-551f537daf5b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:54.381600 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0fa2916a-e098-4ebb-80b0-551f537daf5b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1364 microversion: 2.1 time: 0.171038 Mar 05 21:32:54.382207 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3090/6139] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:54 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:55.399542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4f482ac3-7e20-4a51-9f0f-2a9a07913fc2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:55.400328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4f482ac3-7e20-4a51-9f0f-2a9a07913fc2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:55.408172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f482ac3-7e20-4a51-9f0f-2a9a07913fc2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:55.408626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f482ac3-7e20-4a51-9f0f-2a9a07913fc2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:55.409412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f482ac3-7e20-4a51-9f0f-2a9a07913fc2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:55.409862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f482ac3-7e20-4a51-9f0f-2a9a07913fc2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:55.546734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4f482ac3-7e20-4a51-9f0f-2a9a07913fc2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:55.554929 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4f482ac3-7e20-4a51-9f0f-2a9a07913fc2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1552 microversion: 2.1 time: 0.160319 Mar 05 21:32:55.555523 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3050/6140] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:55 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:55.571872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0b8b097e-2c39-489b-ad55-9cbb81c4f370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:55.572375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0b8b097e-2c39-489b-ad55-9cbb81c4f370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:55.578676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b8b097e-2c39-489b-ad55-9cbb81c4f370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:55.579129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b8b097e-2c39-489b-ad55-9cbb81c4f370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:55.579920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b8b097e-2c39-489b-ad55-9cbb81c4f370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:55.580365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0b8b097e-2c39-489b-ad55-9cbb81c4f370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:55.665619 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0b8b097e-2c39-489b-ad55-9cbb81c4f370 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097994 Mar 05 21:32:55.666233 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3091/6141] 10.222.0.15 () {58 vars in 1274 bytes} [Sat Mar 5 21:32:55 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:32:56.609767 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-fe30eca8-a5b6-4399-adc6-2f5abc79d8dc req-f0841801-75e1-412f-bfab-0af6f650f1df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f83a29-0207-43d0-9835-ff0ad847e28b", "tag": "200c80d2-ab83-4689-ace8-3e9087ff830a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:32:56.621267 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-fe30eca8-a5b6-4399-adc6-2f5abc79d8dc req-f0841801-75e1-412f-bfab-0af6f650f1df service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:56.621736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-fe30eca8-a5b6-4399-adc6-2f5abc79d8dc req-f0841801-75e1-412f-bfab-0af6f650f1df service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:56.634812 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-fe30eca8-a5b6-4399-adc6-2f5abc79d8dc req-f0841801-75e1-412f-bfab-0af6f650f1df service nova] Creating event network-changed:200c80d2-ab83-4689-ace8-3e9087ff830a for instance e5f83a29-0207-43d0-9835-ff0ad847e28b on nch1-master-1 Mar 05 21:32:56.640401 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-fe30eca8-a5b6-4399-adc6-2f5abc79d8dc req-f0841801-75e1-412f-bfab-0af6f650f1df service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034332 Mar 05 21:32:56.640983 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3051/6142] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:32:58.023410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1d7e4381-8510-44b9-872e-0d7d8061c3f6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:32:58.024078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1d7e4381-8510-44b9-872e-0d7d8061c3f6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:58.030235 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d7e4381-8510-44b9-872e-0d7d8061c3f6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:58.030701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d7e4381-8510-44b9-872e-0d7d8061c3f6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:58.031486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d7e4381-8510-44b9-872e-0d7d8061c3f6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:58.031971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1d7e4381-8510-44b9-872e-0d7d8061c3f6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:58.170805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1d7e4381-8510-44b9-872e-0d7d8061c3f6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:32:58.178331 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1d7e4381-8510-44b9-872e-0d7d8061c3f6 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1671 microversion: 2.1 time: 0.160345 Mar 05 21:32:58.178917 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3092/6143] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:32:58 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:32:58.196745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eac19681-9c00-462a-a9c8-c4d1510cd257 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2dcc93e-3ce5-4d99-a342-9c3017d739d2"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:32:58.197930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eac19681-9c00-462a-a9c8-c4d1510cd257 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:32:58.204050 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eac19681-9c00-462a-a9c8-c4d1510cd257 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:58.204520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eac19681-9c00-462a-a9c8-c4d1510cd257 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:58.205296 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eac19681-9c00-462a-a9c8-c4d1510cd257 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:32:58.205747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eac19681-9c00-462a-a9c8-c4d1510cd257 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:32:58.436949 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eac19681-9c00-462a-a9c8-c4d1510cd257 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245960 Mar 05 21:32:58.437577 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3052/6144] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:32:58 2022] POST /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:33:00.650510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:33:00.651489 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:00.658268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:00.658724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:00.659502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:00.659979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:00.687068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:00.692745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Old instance type m1.heat2, new instance type m1.heat {{(pid=141479) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 21:33:00.699526 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:33:00.699980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:33:00.700463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:33:00.700880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:33:00.701310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:33:00.762360 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ad1e8834-7b92-49ed-a4f4-82d34c7ae08a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b/action" status: 202 len: 0 microversion: 2.1 time: 0.116316 Mar 05 21:33:00.762980 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3093/6145] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:33:00 2022] POST /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:33:00.772613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6d92b4e-c307-40e0-8ea3-1c76f2eb861b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:00.773429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6d92b4e-c307-40e0-8ea3-1c76f2eb861b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:00.780103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6d92b4e-c307-40e0-8ea3-1c76f2eb861b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:00.780582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6d92b4e-c307-40e0-8ea3-1c76f2eb861b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:00.781395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6d92b4e-c307-40e0-8ea3-1c76f2eb861b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:00.782125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6d92b4e-c307-40e0-8ea3-1c76f2eb861b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:00.961600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6d92b4e-c307-40e0-8ea3-1c76f2eb861b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:00.970112 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6d92b4e-c307-40e0-8ea3-1c76f2eb861b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1726 microversion: 2.1 time: 0.202624 Mar 05 21:33:00.975694 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3053/6146] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:00 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1726 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:01.989262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-64439241-1d04-4930-9b5d-e95edcfe444c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:01.989801 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-64439241-1d04-4930-9b5d-e95edcfe444c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:01.996018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64439241-1d04-4930-9b5d-e95edcfe444c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:01.996474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64439241-1d04-4930-9b5d-e95edcfe444c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:01.997274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64439241-1d04-4930-9b5d-e95edcfe444c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:01.997713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64439241-1d04-4930-9b5d-e95edcfe444c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:02.142176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-64439241-1d04-4930-9b5d-e95edcfe444c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:02.151391 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-64439241-1d04-4930-9b5d-e95edcfe444c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1726 microversion: 2.1 time: 0.167064 Mar 05 21:33:02.152112 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3094/6147] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:01 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:03.169191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d31db8d5-98cc-45f5-853e-6674b775d971 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:03.169758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d31db8d5-98cc-45f5-853e-6674b775d971 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:03.176677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d31db8d5-98cc-45f5-853e-6674b775d971 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:03.177149 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d31db8d5-98cc-45f5-853e-6674b775d971 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:03.177929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d31db8d5-98cc-45f5-853e-6674b775d971 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:03.178660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d31db8d5-98cc-45f5-853e-6674b775d971 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:03.316510 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d31db8d5-98cc-45f5-853e-6674b775d971 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:03.325534 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d31db8d5-98cc-45f5-853e-6674b775d971 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.160309 Mar 05 21:33:03.326130 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3054/6148] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:03 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:04.343204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9834c8cc-479d-43cd-98f5-1fd0ef63ddc3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:04.343859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9834c8cc-479d-43cd-98f5-1fd0ef63ddc3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:04.351363 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9834c8cc-479d-43cd-98f5-1fd0ef63ddc3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:04.351861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9834c8cc-479d-43cd-98f5-1fd0ef63ddc3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:04.352644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9834c8cc-479d-43cd-98f5-1fd0ef63ddc3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:04.353095 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9834c8cc-479d-43cd-98f5-1fd0ef63ddc3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:04.484756 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9834c8cc-479d-43cd-98f5-1fd0ef63ddc3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:04.492798 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9834c8cc-479d-43cd-98f5-1fd0ef63ddc3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.153515 Mar 05 21:33:04.493377 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3095/6149] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:04 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:05.510627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-619ec70b-ab12-4323-a094-158e47541e62 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:05.511268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-619ec70b-ab12-4323-a094-158e47541e62 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:05.518156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-619ec70b-ab12-4323-a094-158e47541e62 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:05.518632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-619ec70b-ab12-4323-a094-158e47541e62 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:05.519420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-619ec70b-ab12-4323-a094-158e47541e62 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:05.519917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-619ec70b-ab12-4323-a094-158e47541e62 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:05.656576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-619ec70b-ab12-4323-a094-158e47541e62 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:05.665095 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-619ec70b-ab12-4323-a094-158e47541e62 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.158830 Mar 05 21:33:05.665670 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3055/6150] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:05 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:06.682625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8ac1d89f-13cd-40dd-9f54-fb171955cdbe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:06.683433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8ac1d89f-13cd-40dd-9f54-fb171955cdbe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:06.690037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ac1d89f-13cd-40dd-9f54-fb171955cdbe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:06.690494 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ac1d89f-13cd-40dd-9f54-fb171955cdbe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:06.691263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ac1d89f-13cd-40dd-9f54-fb171955cdbe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:06.691736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ac1d89f-13cd-40dd-9f54-fb171955cdbe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:06.831440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8ac1d89f-13cd-40dd-9f54-fb171955cdbe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:06.840402 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8ac1d89f-13cd-40dd-9f54-fb171955cdbe tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.162184 Mar 05 21:33:06.841006 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3096/6151] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:06 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:07.857562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3ac77475-ce0a-4607-bde7-48d57ab47226 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:07.858189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3ac77475-ce0a-4607-bde7-48d57ab47226 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:07.864720 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ac77475-ce0a-4607-bde7-48d57ab47226 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:07.865182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ac77475-ce0a-4607-bde7-48d57ab47226 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:07.866675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ac77475-ce0a-4607-bde7-48d57ab47226 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:07.867162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ac77475-ce0a-4607-bde7-48d57ab47226 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:08.003318 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3ac77475-ce0a-4607-bde7-48d57ab47226 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:08.011348 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3ac77475-ce0a-4607-bde7-48d57ab47226 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.157726 Mar 05 21:33:08.011965 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3056/6152] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:07 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:09.028576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9f5181d6-dcad-4d7a-9edc-7f443098b09c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:09.029192 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9f5181d6-dcad-4d7a-9edc-7f443098b09c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:09.035896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f5181d6-dcad-4d7a-9edc-7f443098b09c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:09.036358 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f5181d6-dcad-4d7a-9edc-7f443098b09c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:09.037130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f5181d6-dcad-4d7a-9edc-7f443098b09c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:09.037822 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f5181d6-dcad-4d7a-9edc-7f443098b09c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:09.169889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9f5181d6-dcad-4d7a-9edc-7f443098b09c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:09.178424 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9f5181d6-dcad-4d7a-9edc-7f443098b09c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.153228 Mar 05 21:33:09.179094 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3097/6153] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:09 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:10.196587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f676bc3e-de40-46a1-a950-0e7dd41c9013 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:10.197129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f676bc3e-de40-46a1-a950-0e7dd41c9013 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:10.204090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f676bc3e-de40-46a1-a950-0e7dd41c9013 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:10.204588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f676bc3e-de40-46a1-a950-0e7dd41c9013 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:10.205557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f676bc3e-de40-46a1-a950-0e7dd41c9013 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:10.206021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f676bc3e-de40-46a1-a950-0e7dd41c9013 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:10.338745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f676bc3e-de40-46a1-a950-0e7dd41c9013 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:10.347438 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f676bc3e-de40-46a1-a950-0e7dd41c9013 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.155490 Mar 05 21:33:10.348087 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3057/6154] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:10 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:11.366020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6a513e39-ea6c-4240-b52e-20aa02189f81 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:11.366708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6a513e39-ea6c-4240-b52e-20aa02189f81 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:11.373016 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a513e39-ea6c-4240-b52e-20aa02189f81 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:11.373476 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a513e39-ea6c-4240-b52e-20aa02189f81 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:11.374256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a513e39-ea6c-4240-b52e-20aa02189f81 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:11.374699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a513e39-ea6c-4240-b52e-20aa02189f81 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:11.511033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6a513e39-ea6c-4240-b52e-20aa02189f81 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:11.519004 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6a513e39-ea6c-4240-b52e-20aa02189f81 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.157364 Mar 05 21:33:11.519590 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3098/6155] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:11 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:12.536981 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2166d400-01ed-42f4-bd7d-111173ff5269 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:12.538813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2166d400-01ed-42f4-bd7d-111173ff5269 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:12.545790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2166d400-01ed-42f4-bd7d-111173ff5269 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:12.546262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2166d400-01ed-42f4-bd7d-111173ff5269 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:12.547053 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2166d400-01ed-42f4-bd7d-111173ff5269 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:12.547542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2166d400-01ed-42f4-bd7d-111173ff5269 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:12.679860 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2166d400-01ed-42f4-bd7d-111173ff5269 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:12.687848 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2166d400-01ed-42f4-bd7d-111173ff5269 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.154952 Mar 05 21:33:12.688435 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3058/6156] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:12 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:33:13.705081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5ead82a9-7a52-4d05-84f2-8fcaf20bc509 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:13.705714 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5ead82a9-7a52-4d05-84f2-8fcaf20bc509 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:13.712612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ead82a9-7a52-4d05-84f2-8fcaf20bc509 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:13.713078 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ead82a9-7a52-4d05-84f2-8fcaf20bc509 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:13.713862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ead82a9-7a52-4d05-84f2-8fcaf20bc509 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:13.714313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5ead82a9-7a52-4d05-84f2-8fcaf20bc509 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:13.847606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5ead82a9-7a52-4d05-84f2-8fcaf20bc509 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:13.856180 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5ead82a9-7a52-4d05-84f2-8fcaf20bc509 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.155077 Mar 05 21:33:13.856760 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3099/6157] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:13 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:14.874427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c0bfa061-04b4-401a-8120-e7b1fdf41b3a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:14.875054 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c0bfa061-04b4-401a-8120-e7b1fdf41b3a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:14.882826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c0bfa061-04b4-401a-8120-e7b1fdf41b3a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:14.883300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c0bfa061-04b4-401a-8120-e7b1fdf41b3a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:14.884118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c0bfa061-04b4-401a-8120-e7b1fdf41b3a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:14.884568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c0bfa061-04b4-401a-8120-e7b1fdf41b3a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:15.023808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c0bfa061-04b4-401a-8120-e7b1fdf41b3a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:15.031813 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c0bfa061-04b4-401a-8120-e7b1fdf41b3a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.161348 Mar 05 21:33:15.032393 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3059/6158] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:14 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:16.049755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6841bea5-c13c-4c4b-9904-3507889eb683 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:16.050375 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6841bea5-c13c-4c4b-9904-3507889eb683 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:16.058087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6841bea5-c13c-4c4b-9904-3507889eb683 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:16.058541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6841bea5-c13c-4c4b-9904-3507889eb683 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:16.059316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6841bea5-c13c-4c4b-9904-3507889eb683 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:16.059784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6841bea5-c13c-4c4b-9904-3507889eb683 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:16.191293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6841bea5-c13c-4c4b-9904-3507889eb683 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:16.200372 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6841bea5-c13c-4c4b-9904-3507889eb683 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.154604 Mar 05 21:33:16.200965 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3100/6159] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:16 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:17.218309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7bacf076-b358-49f5-b4f6-19ed77e190ca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:17.218868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7bacf076-b358-49f5-b4f6-19ed77e190ca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:17.226317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7bacf076-b358-49f5-b4f6-19ed77e190ca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:17.226791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7bacf076-b358-49f5-b4f6-19ed77e190ca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:17.227576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7bacf076-b358-49f5-b4f6-19ed77e190ca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:17.228061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7bacf076-b358-49f5-b4f6-19ed77e190ca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:17.360198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7bacf076-b358-49f5-b4f6-19ed77e190ca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:17.368957 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7bacf076-b358-49f5-b4f6-19ed77e190ca tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.154721 Mar 05 21:33:17.369538 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3060/6160] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:17 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:18.386728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5c2da3ea-a5c6-44b1-93dd-b318f6e6af75 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:18.387346 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5c2da3ea-a5c6-44b1-93dd-b318f6e6af75 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:18.394132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c2da3ea-a5c6-44b1-93dd-b318f6e6af75 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:18.394590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c2da3ea-a5c6-44b1-93dd-b318f6e6af75 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:18.395399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c2da3ea-a5c6-44b1-93dd-b318f6e6af75 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:18.395866 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5c2da3ea-a5c6-44b1-93dd-b318f6e6af75 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:18.532389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5c2da3ea-a5c6-44b1-93dd-b318f6e6af75 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:18.540791 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5c2da3ea-a5c6-44b1-93dd-b318f6e6af75 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.157969 Mar 05 21:33:18.541369 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3101/6161] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:18 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:19.558566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-597210b6-983e-4539-9076-8782304ad3b5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:19.559190 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-597210b6-983e-4539-9076-8782304ad3b5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:19.565978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-597210b6-983e-4539-9076-8782304ad3b5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:19.566445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-597210b6-983e-4539-9076-8782304ad3b5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:19.567226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-597210b6-983e-4539-9076-8782304ad3b5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:19.567703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-597210b6-983e-4539-9076-8782304ad3b5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:19.706006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-597210b6-983e-4539-9076-8782304ad3b5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:19.714475 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-597210b6-983e-4539-9076-8782304ad3b5 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.159900 Mar 05 21:33:19.715069 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3061/6162] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:19 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:20.732178 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cf384376-9302-4a7f-88ca-85aca54e2b1c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:20.732793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cf384376-9302-4a7f-88ca-85aca54e2b1c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:20.740121 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf384376-9302-4a7f-88ca-85aca54e2b1c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:20.741326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf384376-9302-4a7f-88ca-85aca54e2b1c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:20.741991 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf384376-9302-4a7f-88ca-85aca54e2b1c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:20.742440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf384376-9302-4a7f-88ca-85aca54e2b1c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:20.876542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cf384376-9302-4a7f-88ca-85aca54e2b1c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:20.884505 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cf384376-9302-4a7f-88ca-85aca54e2b1c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.156599 Mar 05 21:33:20.885296 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3102/6163] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:20 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:21.901540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9e3174fc-9e2e-4e65-99d0-4748ce7b93c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:21.902168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9e3174fc-9e2e-4e65-99d0-4748ce7b93c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:21.909162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e3174fc-9e2e-4e65-99d0-4748ce7b93c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:21.909629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e3174fc-9e2e-4e65-99d0-4748ce7b93c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:21.910453 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e3174fc-9e2e-4e65-99d0-4748ce7b93c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:21.910903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e3174fc-9e2e-4e65-99d0-4748ce7b93c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:22.044032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9e3174fc-9e2e-4e65-99d0-4748ce7b93c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:22.051926 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9e3174fc-9e2e-4e65-99d0-4748ce7b93c9 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.154277 Mar 05 21:33:22.052507 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3062/6164] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:21 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:23.070797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f14ef993-0860-408c-9603-6176054db722 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:23.071449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f14ef993-0860-408c-9603-6176054db722 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:23.078242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f14ef993-0860-408c-9603-6176054db722 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:23.078700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f14ef993-0860-408c-9603-6176054db722 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:23.079469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f14ef993-0860-408c-9603-6176054db722 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:23.079935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f14ef993-0860-408c-9603-6176054db722 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:23.215861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f14ef993-0860-408c-9603-6176054db722 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:23.223758 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f14ef993-0860-408c-9603-6176054db722 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.157538 Mar 05 21:33:23.224343 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3103/6165] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:23 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:33:24.241955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9e8767bc-4cb3-4285-a117-128475766166 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:24.242497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9e8767bc-4cb3-4285-a117-128475766166 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:24.249332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e8767bc-4cb3-4285-a117-128475766166 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:24.249797 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e8767bc-4cb3-4285-a117-128475766166 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:24.250830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e8767bc-4cb3-4285-a117-128475766166 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:24.251278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9e8767bc-4cb3-4285-a117-128475766166 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:24.382991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9e8767bc-4cb3-4285-a117-128475766166 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:24.391361 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9e8767bc-4cb3-4285-a117-128475766166 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1731 microversion: 2.1 time: 0.154264 Mar 05 21:33:24.391987 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3063/6166] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:24 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:25.408528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-552d7dd0-34db-4b36-bf20-dbd33d34bf12 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:25.409177 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-552d7dd0-34db-4b36-bf20-dbd33d34bf12 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:25.415661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-552d7dd0-34db-4b36-bf20-dbd33d34bf12 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:25.416166 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-552d7dd0-34db-4b36-bf20-dbd33d34bf12 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:25.416973 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-552d7dd0-34db-4b36-bf20-dbd33d34bf12 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:25.417427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-552d7dd0-34db-4b36-bf20-dbd33d34bf12 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:25.524538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-ae599920-d62a-4674-a013-75a572c8edd8 req-265f8c81-2d7b-4199-bbf9-68e8c3e525d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f83a29-0207-43d0-9835-ff0ad847e28b", "name": "network-vif-unplugged", "status": "completed", "tag": "200c80d2-ab83-4689-ace8-3e9087ff830a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:33:25.534662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ae599920-d62a-4674-a013-75a572c8edd8 req-265f8c81-2d7b-4199-bbf9-68e8c3e525d3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:25.535315 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ae599920-d62a-4674-a013-75a572c8edd8 req-265f8c81-2d7b-4199-bbf9-68e8c3e525d3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:25.548477 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ae599920-d62a-4674-a013-75a572c8edd8 req-265f8c81-2d7b-4199-bbf9-68e8c3e525d3 service nova] Creating event network-vif-unplugged:200c80d2-ab83-4689-ace8-3e9087ff830a for instance e5f83a29-0207-43d0-9835-ff0ad847e28b on nch2-master-1 Mar 05 21:33:25.554207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-ae599920-d62a-4674-a013-75a572c8edd8 req-265f8c81-2d7b-4199-bbf9-68e8c3e525d3 service nova] Instance e5f83a29-0207-43d0-9835-ff0ad847e28b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:33:25.560231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-552d7dd0-34db-4b36-bf20-dbd33d34bf12 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:25.566000 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-ae599920-d62a-4674-a013-75a572c8edd8 req-265f8c81-2d7b-4199-bbf9-68e8c3e525d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045738 Mar 05 21:33:25.567543 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3064/6167] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:33:25.571587 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-552d7dd0-34db-4b36-bf20-dbd33d34bf12 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1730 microversion: 2.1 time: 0.167178 Mar 05 21:33:25.572232 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3104/6168] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:25 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:26.591073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ae719593-bf95-449c-9539-01de4566fbe4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:26.591893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ae719593-bf95-449c-9539-01de4566fbe4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:26.597965 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae719593-bf95-449c-9539-01de4566fbe4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:26.598807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae719593-bf95-449c-9539-01de4566fbe4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:26.599716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae719593-bf95-449c-9539-01de4566fbe4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:26.600197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae719593-bf95-449c-9539-01de4566fbe4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:26.738689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ae719593-bf95-449c-9539-01de4566fbe4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:26.746943 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ae719593-bf95-449c-9539-01de4566fbe4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1728 microversion: 2.1 time: 0.161139 Mar 05 21:33:26.747548 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3065/6169] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:26 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:27.584360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b7ccf217-c7f0-44c6-90dc-9d9d3ff102e9 req-9cd784c1-3a16-4982-b4d9-71a3ae3c0113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f83a29-0207-43d0-9835-ff0ad847e28b", "tag": "200c80d2-ab83-4689-ace8-3e9087ff830a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:33:27.592960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b7ccf217-c7f0-44c6-90dc-9d9d3ff102e9 req-9cd784c1-3a16-4982-b4d9-71a3ae3c0113 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:27.593469 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b7ccf217-c7f0-44c6-90dc-9d9d3ff102e9 req-9cd784c1-3a16-4982-b4d9-71a3ae3c0113 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:27.605620 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b7ccf217-c7f0-44c6-90dc-9d9d3ff102e9 req-9cd784c1-3a16-4982-b4d9-71a3ae3c0113 service nova] Creating event network-changed:200c80d2-ab83-4689-ace8-3e9087ff830a for instance e5f83a29-0207-43d0-9835-ff0ad847e28b on nch2-master-1 Mar 05 21:33:27.610744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-b7ccf217-c7f0-44c6-90dc-9d9d3ff102e9 req-9cd784c1-3a16-4982-b4d9-71a3ae3c0113 service nova] Instance e5f83a29-0207-43d0-9835-ff0ad847e28b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:33:27.621930 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b7ccf217-c7f0-44c6-90dc-9d9d3ff102e9 req-9cd784c1-3a16-4982-b4d9-71a3ae3c0113 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041802 Mar 05 21:33:27.622538 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3105/6170] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:33:27.765488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3ca49084-071a-4a2f-93b7-d98be991a60b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:27.766231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3ca49084-071a-4a2f-93b7-d98be991a60b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:27.773863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ca49084-071a-4a2f-93b7-d98be991a60b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:27.774332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ca49084-071a-4a2f-93b7-d98be991a60b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:27.775159 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ca49084-071a-4a2f-93b7-d98be991a60b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:27.775615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3ca49084-071a-4a2f-93b7-d98be991a60b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:28.114923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3ca49084-071a-4a2f-93b7-d98be991a60b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:28.123754 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3ca49084-071a-4a2f-93b7-d98be991a60b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1728 microversion: 2.1 time: 0.362143 Mar 05 21:33:28.124506 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3066/6171] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:27 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1728 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:29.143134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-937cff5c-20da-476d-8bb0-a35ff13157b3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:29.143900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-937cff5c-20da-476d-8bb0-a35ff13157b3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:29.150754 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-937cff5c-20da-476d-8bb0-a35ff13157b3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:29.151222 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-937cff5c-20da-476d-8bb0-a35ff13157b3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:29.152072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-937cff5c-20da-476d-8bb0-a35ff13157b3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:29.152528 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-937cff5c-20da-476d-8bb0-a35ff13157b3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:29.289544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-937cff5c-20da-476d-8bb0-a35ff13157b3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:29.297566 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-937cff5c-20da-476d-8bb0-a35ff13157b3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1728 microversion: 2.1 time: 0.159666 Mar 05 21:33:29.298150 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3106/6172] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:29 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:30.316014 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-10227049-f6a5-4387-a341-88f005e8f1eb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:30.316561 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-10227049-f6a5-4387-a341-88f005e8f1eb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:30.323207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-10227049-f6a5-4387-a341-88f005e8f1eb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:30.323718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-10227049-f6a5-4387-a341-88f005e8f1eb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:30.324513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-10227049-f6a5-4387-a341-88f005e8f1eb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:30.324969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-10227049-f6a5-4387-a341-88f005e8f1eb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:30.458381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-10227049-f6a5-4387-a341-88f005e8f1eb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:30.466686 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-10227049-f6a5-4387-a341-88f005e8f1eb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1728 microversion: 2.1 time: 0.155365 Mar 05 21:33:30.467291 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3067/6173] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:30 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:31.484962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9edb2d8b-38ce-475e-aa69-f08598b334ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:31.485587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9edb2d8b-38ce-475e-aa69-f08598b334ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:31.493618 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9edb2d8b-38ce-475e-aa69-f08598b334ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:31.494081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9edb2d8b-38ce-475e-aa69-f08598b334ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:31.494863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9edb2d8b-38ce-475e-aa69-f08598b334ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:31.495312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9edb2d8b-38ce-475e-aa69-f08598b334ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:31.628236 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9edb2d8b-38ce-475e-aa69-f08598b334ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:31.636660 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9edb2d8b-38ce-475e-aa69-f08598b334ed tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1725 microversion: 2.1 time: 0.156232 Mar 05 21:33:31.637238 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3107/6174] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:31 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:31.653802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:33:31.654364 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:31.661150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:31.661618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:31.662647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:31.663103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:31.702493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:31.702959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:31.703812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:31.704273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:31.724035 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for project 82cb16655b3348048ea81b796af0da84. Resources: {'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:33:31.731816 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Getting quotas for user a2def15483f54bf282b64a4712ba0ce9 and project 82cb16655b3348048ea81b796af0da84. Resources: {'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:33:31.795119 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:33:31.795949 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 21:33:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b/action (ip 10.222.0.15) !!! Mar 05 21:33:31.833315 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6f2a83b2-04e2-4a81-8c83-3662e7d58b35 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "POST /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b/action" status: 202 len: 0 microversion: 2.1 time: 0.183243 Mar 05 21:33:31.834140 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3068/6175] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:33:31 2022] POST /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:33:31.842426 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6a2a8dc4-f3de-4da5-80d0-1163b0556eff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:31.843052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6a2a8dc4-f3de-4da5-80d0-1163b0556eff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:31.849081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a2a8dc4-f3de-4da5-80d0-1163b0556eff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:31.850670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a2a8dc4-f3de-4da5-80d0-1163b0556eff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:31.851026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a2a8dc4-f3de-4da5-80d0-1163b0556eff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:31.851440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6a2a8dc4-f3de-4da5-80d0-1163b0556eff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:31.989535 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6a2a8dc4-f3de-4da5-80d0-1163b0556eff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:31.998235 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6a2a8dc4-f3de-4da5-80d0-1163b0556eff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1724 microversion: 2.1 time: 0.159729 Mar 05 21:33:31.998832 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3108/6176] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:31 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:32.331376 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:33:32.331604 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 21:33:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:33:33.016949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b94dc157-b428-4406-a893-dd4b2859d358 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:33.017594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b94dc157-b428-4406-a893-dd4b2859d358 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:33.024011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b94dc157-b428-4406-a893-dd4b2859d358 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:33.024483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b94dc157-b428-4406-a893-dd4b2859d358 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:33.025276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b94dc157-b428-4406-a893-dd4b2859d358 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:33.025733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b94dc157-b428-4406-a893-dd4b2859d358 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:33.163374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b94dc157-b428-4406-a893-dd4b2859d358 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:33.171393 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b94dc157-b428-4406-a893-dd4b2859d358 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1724 microversion: 2.1 time: 0.159732 Mar 05 21:33:33.172046 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3069/6177] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:33 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:34.188936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-87096833-a48e-4df7-b9d4-2b4fa94d8c9b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:34.189555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-87096833-a48e-4df7-b9d4-2b4fa94d8c9b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:34.197044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87096833-a48e-4df7-b9d4-2b4fa94d8c9b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:34.197501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87096833-a48e-4df7-b9d4-2b4fa94d8c9b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:34.198276 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87096833-a48e-4df7-b9d4-2b4fa94d8c9b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:34.198718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87096833-a48e-4df7-b9d4-2b4fa94d8c9b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:34.351366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-87096833-a48e-4df7-b9d4-2b4fa94d8c9b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:34.359963 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-87096833-a48e-4df7-b9d4-2b4fa94d8c9b tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1724 microversion: 2.1 time: 0.174614 Mar 05 21:33:34.361048 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3109/6178] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:34 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:34.445585 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7e9ce264-2089-43cd-87e3-f75ec937e4ba req-df433ea2-45b5-48e5-a1c2-056ab339fdf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f83a29-0207-43d0-9835-ff0ad847e28b", "name": "network-vif-plugged", "status": "completed", "tag": "200c80d2-ab83-4689-ace8-3e9087ff830a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:33:34.455045 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7e9ce264-2089-43cd-87e3-f75ec937e4ba req-df433ea2-45b5-48e5-a1c2-056ab339fdf3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:34.455514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7e9ce264-2089-43cd-87e3-f75ec937e4ba req-df433ea2-45b5-48e5-a1c2-056ab339fdf3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:34.467558 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7e9ce264-2089-43cd-87e3-f75ec937e4ba req-df433ea2-45b5-48e5-a1c2-056ab339fdf3 service nova] Creating event network-vif-plugged:200c80d2-ab83-4689-ace8-3e9087ff830a for instance e5f83a29-0207-43d0-9835-ff0ad847e28b on nch2-master-1 Mar 05 21:33:34.472989 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-7e9ce264-2089-43cd-87e3-f75ec937e4ba req-df433ea2-45b5-48e5-a1c2-056ab339fdf3 service nova] Instance e5f83a29-0207-43d0-9835-ff0ad847e28b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:33:34.484042 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7e9ce264-2089-43cd-87e3-f75ec937e4ba req-df433ea2-45b5-48e5-a1c2-056ab339fdf3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043206 Mar 05 21:33:34.484826 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3070/6179] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:33:35.368497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-87ff0b94-5a54-4dd0-8716-ef9da48dd3d8 req-fbb4ae86-fe13-4cd0-85b7-479554ca84d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f83a29-0207-43d0-9835-ff0ad847e28b", "name": "network-vif-unplugged", "status": "completed", "tag": "200c80d2-ab83-4689-ace8-3e9087ff830a"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:33:35.378037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-87ff0b94-5a54-4dd0-8716-ef9da48dd3d8 req-fbb4ae86-fe13-4cd0-85b7-479554ca84d6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:35.378497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-87ff0b94-5a54-4dd0-8716-ef9da48dd3d8 req-fbb4ae86-fe13-4cd0-85b7-479554ca84d6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:35.379583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e92247b0-7b56-4642-97b1-edaf310ab64a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:35.380416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e92247b0-7b56-4642-97b1-edaf310ab64a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:35.388232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e92247b0-7b56-4642-97b1-edaf310ab64a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:35.388887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e92247b0-7b56-4642-97b1-edaf310ab64a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:35.389866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e92247b0-7b56-4642-97b1-edaf310ab64a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:35.390476 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e92247b0-7b56-4642-97b1-edaf310ab64a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:35.393200 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-87ff0b94-5a54-4dd0-8716-ef9da48dd3d8 req-fbb4ae86-fe13-4cd0-85b7-479554ca84d6 service nova] Creating event network-vif-unplugged:200c80d2-ab83-4689-ace8-3e9087ff830a for instance e5f83a29-0207-43d0-9835-ff0ad847e28b on nch1-master-1 Mar 05 21:33:35.400105 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-87ff0b94-5a54-4dd0-8716-ef9da48dd3d8 req-fbb4ae86-fe13-4cd0-85b7-479554ca84d6 service nova] Instance e5f83a29-0207-43d0-9835-ff0ad847e28b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:33:35.411315 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-87ff0b94-5a54-4dd0-8716-ef9da48dd3d8 req-fbb4ae86-fe13-4cd0-85b7-479554ca84d6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047789 Mar 05 21:33:35.412581 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3110/6180] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:33:35.678317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e92247b0-7b56-4642-97b1-edaf310ab64a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:35.686900 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e92247b0-7b56-4642-97b1-edaf310ab64a tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1724 microversion: 2.1 time: 0.312635 Mar 05 21:33:35.687429 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3071/6181] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:35 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:36.706198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2397ff86-3908-4585-8607-11fbc47eb924 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:36.706920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2397ff86-3908-4585-8607-11fbc47eb924 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:36.713979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2397ff86-3908-4585-8607-11fbc47eb924 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:36.714439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2397ff86-3908-4585-8607-11fbc47eb924 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:36.715218 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2397ff86-3908-4585-8607-11fbc47eb924 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:36.715707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2397ff86-3908-4585-8607-11fbc47eb924 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:36.851050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2397ff86-3908-4585-8607-11fbc47eb924 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:36.859243 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2397ff86-3908-4585-8607-11fbc47eb924 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1724 microversion: 2.1 time: 0.158463 Mar 05 21:33:36.859850 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3111/6182] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:36 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:37.425491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-29c5b0e7-4d2f-4da4-950c-3c941a866376 req-e3eade6c-4a54-4a94-8f4f-2b465eb008d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f83a29-0207-43d0-9835-ff0ad847e28b", "tag": "200c80d2-ab83-4689-ace8-3e9087ff830a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:33:37.434317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-29c5b0e7-4d2f-4da4-950c-3c941a866376 req-e3eade6c-4a54-4a94-8f4f-2b465eb008d3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:37.434783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-29c5b0e7-4d2f-4da4-950c-3c941a866376 req-e3eade6c-4a54-4a94-8f4f-2b465eb008d3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:37.446560 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-29c5b0e7-4d2f-4da4-950c-3c941a866376 req-e3eade6c-4a54-4a94-8f4f-2b465eb008d3 service nova] Creating event network-changed:200c80d2-ab83-4689-ace8-3e9087ff830a for instance e5f83a29-0207-43d0-9835-ff0ad847e28b on nch1-master-1 Mar 05 21:33:37.451812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-29c5b0e7-4d2f-4da4-950c-3c941a866376 req-e3eade6c-4a54-4a94-8f4f-2b465eb008d3 service nova] Instance e5f83a29-0207-43d0-9835-ff0ad847e28b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:33:37.462878 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-29c5b0e7-4d2f-4da4-950c-3c941a866376 req-e3eade6c-4a54-4a94-8f4f-2b465eb008d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041190 Mar 05 21:33:37.463493 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3072/6183] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:33:37.877336 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-67b8cb2f-611d-4bb4-810c-c5a9be5a41f3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:37.877943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-67b8cb2f-611d-4bb4-810c-c5a9be5a41f3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:37.885304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67b8cb2f-611d-4bb4-810c-c5a9be5a41f3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:37.885764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67b8cb2f-611d-4bb4-810c-c5a9be5a41f3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:37.886556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67b8cb2f-611d-4bb4-810c-c5a9be5a41f3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:37.886994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-67b8cb2f-611d-4bb4-810c-c5a9be5a41f3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:38.026851 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-67b8cb2f-611d-4bb4-810c-c5a9be5a41f3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:38.034800 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-67b8cb2f-611d-4bb4-810c-c5a9be5a41f3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1724 microversion: 2.1 time: 0.161726 Mar 05 21:33:38.035385 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3112/6184] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:37 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:39.054160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a979f458-4b43-4730-9303-92e3a41af2ff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:39.054913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a979f458-4b43-4730-9303-92e3a41af2ff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:39.061189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a979f458-4b43-4730-9303-92e3a41af2ff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:39.061668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a979f458-4b43-4730-9303-92e3a41af2ff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:39.062459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a979f458-4b43-4730-9303-92e3a41af2ff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:39.062918 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a979f458-4b43-4730-9303-92e3a41af2ff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:39.197241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a979f458-4b43-4730-9303-92e3a41af2ff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:39.205274 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a979f458-4b43-4730-9303-92e3a41af2ff tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1724 microversion: 2.1 time: 0.156412 Mar 05 21:33:39.205856 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3073/6185] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:39 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:40.222357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6cc4e75d-b601-4cc7-96c4-ef4457eef1c4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:40.222983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6cc4e75d-b601-4cc7-96c4-ef4457eef1c4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:40.230325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6cc4e75d-b601-4cc7-96c4-ef4457eef1c4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:40.230777 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6cc4e75d-b601-4cc7-96c4-ef4457eef1c4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:40.231540 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6cc4e75d-b601-4cc7-96c4-ef4457eef1c4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:40.232008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6cc4e75d-b601-4cc7-96c4-ef4457eef1c4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:40.361891 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6cc4e75d-b601-4cc7-96c4-ef4457eef1c4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:40.369799 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6cc4e75d-b601-4cc7-96c4-ef4457eef1c4 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1717 microversion: 2.1 time: 0.151376 Mar 05 21:33:40.370382 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3113/6186] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:40 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:33:40.386740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b35bb7c0-22ed-42a6-92da-e38fb3cabec2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:40.387396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b35bb7c0-22ed-42a6-92da-e38fb3cabec2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:40.394280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b35bb7c0-22ed-42a6-92da-e38fb3cabec2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:40.394751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b35bb7c0-22ed-42a6-92da-e38fb3cabec2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:40.395541 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b35bb7c0-22ed-42a6-92da-e38fb3cabec2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:40.396025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b35bb7c0-22ed-42a6-92da-e38fb3cabec2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:40.537988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b35bb7c0-22ed-42a6-92da-e38fb3cabec2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:40.545846 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b35bb7c0-22ed-42a6-92da-e38fb3cabec2 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1717 microversion: 2.1 time: 0.163052 Mar 05 21:33:40.546419 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3074/6187] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:40 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:40.562180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a80a68e0-381e-45ba-9c47-787c52966134 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:40.562843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a80a68e0-381e-45ba-9c47-787c52966134 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:40.568909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a80a68e0-381e-45ba-9c47-787c52966134 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:40.569374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a80a68e0-381e-45ba-9c47-787c52966134 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:40.570184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a80a68e0-381e-45ba-9c47-787c52966134 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:40.570634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a80a68e0-381e-45ba-9c47-787c52966134 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:40.700868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a80a68e0-381e-45ba-9c47-787c52966134 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:40.708796 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a80a68e0-381e-45ba-9c47-787c52966134 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1717 microversion: 2.1 time: 0.150630 Mar 05 21:33:40.710079 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3114/6188] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:40 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:40.725500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9a301bcb-1ec8-47b2-a8f8-e58345990072 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:40.726013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9a301bcb-1ec8-47b2-a8f8-e58345990072 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:40.731892 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a301bcb-1ec8-47b2-a8f8-e58345990072 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:40.732458 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a301bcb-1ec8-47b2-a8f8-e58345990072 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:40.733290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a301bcb-1ec8-47b2-a8f8-e58345990072 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:40.733691 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a301bcb-1ec8-47b2-a8f8-e58345990072 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:40.758072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9a301bcb-1ec8-47b2-a8f8-e58345990072 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:33:40.838054 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9a301bcb-1ec8-47b2-a8f8-e58345990072 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 204 len: 0 microversion: 2.1 time: 0.116046 Mar 05 21:33:40.838843 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3075/6189] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:33:40 2022] DELETE /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:33:40.847464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dc4a3b36-6895-4016-913c-2c889b7ce6dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:40.848117 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dc4a3b36-6895-4016-913c-2c889b7ce6dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:40.854241 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc4a3b36-6895-4016-913c-2c889b7ce6dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:40.854762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc4a3b36-6895-4016-913c-2c889b7ce6dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:40.855560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc4a3b36-6895-4016-913c-2c889b7ce6dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:40.856031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc4a3b36-6895-4016-913c-2c889b7ce6dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:40.993517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dc4a3b36-6895-4016-913c-2c889b7ce6dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:41.001744 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dc4a3b36-6895-4016-913c-2c889b7ce6dd tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1723 microversion: 2.1 time: 0.158492 Mar 05 21:33:41.002332 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3115/6190] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:40 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:42.020543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e445db9f-15f4-436b-91b1-70e15705b682 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:42.022009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e445db9f-15f4-436b-91b1-70e15705b682 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:42.028758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e445db9f-15f4-436b-91b1-70e15705b682 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:42.029240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e445db9f-15f4-436b-91b1-70e15705b682 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:42.030032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e445db9f-15f4-436b-91b1-70e15705b682 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:42.030488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e445db9f-15f4-436b-91b1-70e15705b682 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:42.163619 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e445db9f-15f4-436b-91b1-70e15705b682 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:42.172423 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e445db9f-15f4-436b-91b1-70e15705b682 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1723 microversion: 2.1 time: 0.156303 Mar 05 21:33:42.173009 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3076/6191] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:42 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:43.192127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-609b7f28-f25c-4968-af84-98ccf125a40c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:43.192916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-609b7f28-f25c-4968-af84-98ccf125a40c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:43.201216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-609b7f28-f25c-4968-af84-98ccf125a40c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:43.201687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-609b7f28-f25c-4968-af84-98ccf125a40c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:43.202524 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-609b7f28-f25c-4968-af84-98ccf125a40c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:43.203003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-609b7f28-f25c-4968-af84-98ccf125a40c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:43.277919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-609b7f28-f25c-4968-af84-98ccf125a40c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2def15483f54bf282b64a4712ba0ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb16655b3348048ea81b796af0da84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:43.288189 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-609b7f28-f25c-4968-af84-98ccf125a40c tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 200 len: 1655 microversion: 2.1 time: 0.101546 Mar 05 21:33:43.296654 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-849d47b4-89b7-4d8e-8ee1-c6901f8ab105 req-e4d63029-2719-483f-8f07-1107e4fc0c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f83a29-0207-43d0-9835-ff0ad847e28b", "name": "network-vif-deleted", "tag": "200c80d2-ab83-4689-ace8-3e9087ff830a"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:33:43.299866 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3116/6192] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:43 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 1655 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:43.310002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-849d47b4-89b7-4d8e-8ee1-c6901f8ab105 req-e4d63029-2719-483f-8f07-1107e4fc0c84 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:43.310571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-849d47b4-89b7-4d8e-8ee1-c6901f8ab105 req-e4d63029-2719-483f-8f07-1107e4fc0c84 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:43.326500 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-849d47b4-89b7-4d8e-8ee1-c6901f8ab105 req-e4d63029-2719-483f-8f07-1107e4fc0c84 service nova] Creating event network-vif-deleted:200c80d2-ab83-4689-ace8-3e9087ff830a for instance e5f83a29-0207-43d0-9835-ff0ad847e28b on nch1-master-1 Mar 05 21:33:43.333023 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-849d47b4-89b7-4d8e-8ee1-c6901f8ab105 req-e4d63029-2719-483f-8f07-1107e4fc0c84 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040598 Mar 05 21:33:43.333652 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3077/6193] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:33:44.305245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-104ffe41-a2f0-4bca-af06-6209ee10a724 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:44.305864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-104ffe41-a2f0-4bca-af06-6209ee10a724 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:44.312659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-104ffe41-a2f0-4bca-af06-6209ee10a724 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:44.313116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-104ffe41-a2f0-4bca-af06-6209ee10a724 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:44.313890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-104ffe41-a2f0-4bca-af06-6209ee10a724 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:44.314327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-104ffe41-a2f0-4bca-af06-6209ee10a724 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:44.330832 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-104ffe41-a2f0-4bca-af06-6209ee10a724 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance e5f83a29-0207-43d0-9835-ff0ad847e28b could not be found. Mar 05 21:33:44.331445 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-104ffe41-a2f0-4bca-af06-6209ee10a724 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance e5f83a29-0207-43d0-9835-ff0ad847e28b could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:33:44.332310 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-104ffe41-a2f0-4bca-af06-6209ee10a724 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 404 len: 111 microversion: 2.1 time: 0.031612 Mar 05 21:33:44.332867 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3117/6194] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:44 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:33:44.391523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-643ec1a4-8051-44b2-8383-cd8d802aa304 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:44.392587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-643ec1a4-8051-44b2-8383-cd8d802aa304 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:44.400489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-643ec1a4-8051-44b2-8383-cd8d802aa304 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:44.400969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-643ec1a4-8051-44b2-8383-cd8d802aa304 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:44.401772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-643ec1a4-8051-44b2-8383-cd8d802aa304 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:44.402232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-643ec1a4-8051-44b2-8383-cd8d802aa304 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:44.417457 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-643ec1a4-8051-44b2-8383-cd8d802aa304 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance e5f83a29-0207-43d0-9835-ff0ad847e28b could not be found. Mar 05 21:33:44.418085 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-643ec1a4-8051-44b2-8383-cd8d802aa304 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance e5f83a29-0207-43d0-9835-ff0ad847e28b could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:33:44.418952 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-643ec1a4-8051-44b2-8383-cd8d802aa304 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031996 Mar 05 21:33:44.419528 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3078/6195] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:33:44 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:33:45.611424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7b6623b9-774c-4cc7-8b38-8179273d7c99 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:45.611971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7b6623b9-774c-4cc7-8b38-8179273d7c99 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:45.618806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b6623b9-774c-4cc7-8b38-8179273d7c99 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.619259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b6623b9-774c-4cc7-8b38-8179273d7c99 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.620128 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b6623b9-774c-4cc7-8b38-8179273d7c99 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.620576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7b6623b9-774c-4cc7-8b38-8179273d7c99 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.637914 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-7b6623b9-774c-4cc7-8b38-8179273d7c99 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance e5f83a29-0207-43d0-9835-ff0ad847e28b could not be found. Mar 05 21:33:45.638630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7b6623b9-774c-4cc7-8b38-8179273d7c99 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance e5f83a29-0207-43d0-9835-ff0ad847e28b could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:33:45.639374 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7b6623b9-774c-4cc7-8b38-8179273d7c99 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 404 len: 111 microversion: 2.1 time: 0.031918 Mar 05 21:33:45.639963 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3118/6196] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:33:45 2022] DELETE /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:33:45.649566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4f94f447-04f3-46c0-a041-071103d9e118 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:45.650205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4f94f447-04f3-46c0-a041-071103d9e118 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: e5f83a29-0207-43d0-9835-ff0ad847e28b] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:45.657126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f94f447-04f3-46c0-a041-071103d9e118 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.657601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f94f447-04f3-46c0-a041-071103d9e118 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.658406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f94f447-04f3-46c0-a041-071103d9e118 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.658858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4f94f447-04f3-46c0-a041-071103d9e118 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.673330 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-4f94f447-04f3-46c0-a041-071103d9e118 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance e5f83a29-0207-43d0-9835-ff0ad847e28b could not be found. Mar 05 21:33:45.673971 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4f94f447-04f3-46c0-a041-071103d9e118 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance e5f83a29-0207-43d0-9835-ff0ad847e28b could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:33:45.674854 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4f94f447-04f3-46c0-a041-071103d9e118 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b" status: 404 len: 111 microversion: 2.1 time: 0.030786 Mar 05 21:33:45.675893 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3079/6197] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:45 2022] GET /compute/v2.1/servers/e5f83a29-0207-43d0-9835-ff0ad847e28b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:33:45.684672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9f941151-51e3-4429-9185-3fddf7830956 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:45.685182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9f941151-51e3-4429-9185-3fddf7830956 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:45.692142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f941151-51e3-4429-9185-3fddf7830956 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.692766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f941151-51e3-4429-9185-3fddf7830956 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.693503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f941151-51e3-4429-9185-3fddf7830956 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.693969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9f941151-51e3-4429-9185-3fddf7830956 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.707932 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-9f941151-51e3-4429-9185-3fddf7830956 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance bb324dba-40c7-4cb8-b053-75608ca660b0 could not be found. Mar 05 21:33:45.708598 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9f941151-51e3-4429-9185-3fddf7830956 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance bb324dba-40c7-4cb8-b053-75608ca660b0 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:33:45.709912 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9f941151-51e3-4429-9185-3fddf7830956 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 404 len: 111 microversion: 2.1 time: 0.029012 Mar 05 21:33:45.710473 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3119/6198] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:33:45 2022] DELETE /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:33:45.718737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5cae4c35-4cc0-4e29-be6e-32d9bd8b72e3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:45.719367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5cae4c35-4cc0-4e29-be6e-32d9bd8b72e3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: bb324dba-40c7-4cb8-b053-75608ca660b0] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:45.725548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cae4c35-4cc0-4e29-be6e-32d9bd8b72e3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.726018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cae4c35-4cc0-4e29-be6e-32d9bd8b72e3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.726798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cae4c35-4cc0-4e29-be6e-32d9bd8b72e3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.727248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5cae4c35-4cc0-4e29-be6e-32d9bd8b72e3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.740441 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-5cae4c35-4cc0-4e29-be6e-32d9bd8b72e3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance bb324dba-40c7-4cb8-b053-75608ca660b0 could not be found. Mar 05 21:33:45.741561 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5cae4c35-4cc0-4e29-be6e-32d9bd8b72e3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance bb324dba-40c7-4cb8-b053-75608ca660b0 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:33:45.742543 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5cae4c35-4cc0-4e29-be6e-32d9bd8b72e3 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0" status: 404 len: 111 microversion: 2.1 time: 0.027861 Mar 05 21:33:45.743131 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3080/6199] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:45 2022] GET /compute/v2.1/servers/bb324dba-40c7-4cb8-b053-75608ca660b0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:33:45.753761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-686b0ecd-d259-4339-9d39-c106ecbad1f8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:45.754277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-686b0ecd-d259-4339-9d39-c106ecbad1f8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:45.760958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-686b0ecd-d259-4339-9d39-c106ecbad1f8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.761421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-686b0ecd-d259-4339-9d39-c106ecbad1f8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.762202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-686b0ecd-d259-4339-9d39-c106ecbad1f8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.762654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-686b0ecd-d259-4339-9d39-c106ecbad1f8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.776046 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-686b0ecd-d259-4339-9d39-c106ecbad1f8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance b2974512-1028-498a-b3ee-523fe4594c22 could not be found. Mar 05 21:33:45.776655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-686b0ecd-d259-4339-9d39-c106ecbad1f8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance b2974512-1028-498a-b3ee-523fe4594c22 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:33:45.777491 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-686b0ecd-d259-4339-9d39-c106ecbad1f8 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 404 len: 111 microversion: 2.1 time: 0.027936 Mar 05 21:33:45.778031 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3120/6200] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:33:45 2022] DELETE /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:33:45.786094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3407202f-de89-43b1-8c47-8710728e31cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:45.786764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3407202f-de89-43b1-8c47-8710728e31cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: b2974512-1028-498a-b3ee-523fe4594c22] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:45.792992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3407202f-de89-43b1-8c47-8710728e31cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.793465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3407202f-de89-43b1-8c47-8710728e31cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.794255 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3407202f-de89-43b1-8c47-8710728e31cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.794715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3407202f-de89-43b1-8c47-8710728e31cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.808973 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-3407202f-de89-43b1-8c47-8710728e31cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance b2974512-1028-498a-b3ee-523fe4594c22 could not be found. Mar 05 21:33:45.809591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3407202f-de89-43b1-8c47-8710728e31cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance b2974512-1028-498a-b3ee-523fe4594c22 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:33:45.810437 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3407202f-de89-43b1-8c47-8710728e31cb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22" status: 404 len: 111 microversion: 2.1 time: 0.028371 Mar 05 21:33:45.810987 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3081/6201] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:45 2022] GET /compute/v2.1/servers/b2974512-1028-498a-b3ee-523fe4594c22 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:33:45.818885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-17ca4b03-cda3-47ea-ad6e-64206b6b1523 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:45.820076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-17ca4b03-cda3-47ea-ad6e-64206b6b1523 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:45.826019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17ca4b03-cda3-47ea-ad6e-64206b6b1523 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.826474 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17ca4b03-cda3-47ea-ad6e-64206b6b1523 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.827247 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17ca4b03-cda3-47ea-ad6e-64206b6b1523 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.827710 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17ca4b03-cda3-47ea-ad6e-64206b6b1523 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.840902 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-17ca4b03-cda3-47ea-ad6e-64206b6b1523 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance fab651fe-cee4-4d8b-aa45-a691885f239d could not be found. Mar 05 21:33:45.841434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-17ca4b03-cda3-47ea-ad6e-64206b6b1523 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance fab651fe-cee4-4d8b-aa45-a691885f239d could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:33:45.842250 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-17ca4b03-cda3-47ea-ad6e-64206b6b1523 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 404 len: 111 microversion: 2.1 time: 0.027401 Mar 05 21:33:45.842781 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3121/6202] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:33:45 2022] DELETE /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:33:45.850762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-76d4b0b3-4e7f-4982-8473-47a245bf19bb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:45.851398 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-76d4b0b3-4e7f-4982-8473-47a245bf19bb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] [instance: fab651fe-cee4-4d8b-aa45-a691885f239d] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:45.857344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76d4b0b3-4e7f-4982-8473-47a245bf19bb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.857818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76d4b0b3-4e7f-4982-8473-47a245bf19bb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.858610 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76d4b0b3-4e7f-4982-8473-47a245bf19bb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:45.859069 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-76d4b0b3-4e7f-4982-8473-47a245bf19bb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:45.872925 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-76d4b0b3-4e7f-4982-8473-47a245bf19bb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] HTTP exception thrown: Instance fab651fe-cee4-4d8b-aa45-a691885f239d could not be found. Mar 05 21:33:45.873539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-76d4b0b3-4e7f-4982-8473-47a245bf19bb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Returning 404 to user: Instance fab651fe-cee4-4d8b-aa45-a691885f239d could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:33:45.874382 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-76d4b0b3-4e7f-4982-8473-47a245bf19bb tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d" status: 404 len: 111 microversion: 2.1 time: 0.027668 Mar 05 21:33:45.874922 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3082/6203] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:45 2022] GET /compute/v2.1/servers/fab651fe-cee4-4d8b-aa45-a691885f239d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:33:45.883712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a8bd3293-a62c-4bfc-9abc-82913bf613f1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] Calling method '.version_select at 0x7fed4f61d310>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:45.909329 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a8bd3293-a62c-4bfc-9abc-82913bf613f1 tempest-ServerActionsTestJSON-961807460 tempest-ServerActionsTestJSON-961807460-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237555310" status: 202 len: 0 microversion: 2.1 time: 0.030056 Mar 05 21:33:45.909924 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3122/6204] 10.222.0.15 () {58 vars in 1220 bytes} [Sat Mar 5 21:33:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237555310 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:33:51.785699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2096206004", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "0916c3e1-ca39-405a-a675-577fa31a9350"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:33:51.965550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] validate_networks() for [('0916c3e1-ca39-405a-a675-577fa31a9350', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:33:52.301808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:33:52.302259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:33:52.302760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:33:52.303193 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:33:52.304207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:33:52.313682 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:52.314162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:52.315019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:52.315480 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:52.332942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Getting quotas for project 7f696665b40b40f48962338a625b4d8b. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:33:52.338273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Getting quotas for user cb99bac4c1b642b9bb1548b9f74b14e1 and project 7f696665b40b40f48962338a625b4d8b. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:33:52.350599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:33:52.352970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:33:52.398479 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-96dcb32f-3a1f-40a9-aef8-30da65449513 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727687 Mar 05 21:33:52.399259 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3083/6205] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:33:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:33:52.410007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8b29ce13-2979-42fe-9fa2-7742af5f6773 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:52.410634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8b29ce13-2979-42fe-9fa2-7742af5f6773 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:52.521970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8b29ce13-2979-42fe-9fa2-7742af5f6773 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:52.529370 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8b29ce13-2979-42fe-9fa2-7742af5f6773 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1217 microversion: 2.1 time: 0.124136 Mar 05 21:33:52.530042 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3123/6206] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:52 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:53.547529 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4cbf1f7c-5949-4f33-b3e1-44a3b2e46e8f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:53.548195 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4cbf1f7c-5949-4f33-b3e1-44a3b2e46e8f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:53.557595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cbf1f7c-5949-4f33-b3e1-44a3b2e46e8f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:53.558061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cbf1f7c-5949-4f33-b3e1-44a3b2e46e8f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:53.558863 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cbf1f7c-5949-4f33-b3e1-44a3b2e46e8f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:53.559324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4cbf1f7c-5949-4f33-b3e1-44a3b2e46e8f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:53.799199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4cbf1f7c-5949-4f33-b3e1-44a3b2e46e8f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:53.807498 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4cbf1f7c-5949-4f33-b3e1-44a3b2e46e8f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1275 microversion: 2.1 time: 0.264894 Mar 05 21:33:53.808347 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3084/6207] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:53 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:54.824988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ba7fde2e-b564-4d41-b749-0459dbd37d5b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:54.825622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ba7fde2e-b564-4d41-b749-0459dbd37d5b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:54.832700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba7fde2e-b564-4d41-b749-0459dbd37d5b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:54.833169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba7fde2e-b564-4d41-b749-0459dbd37d5b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:54.833965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba7fde2e-b564-4d41-b749-0459dbd37d5b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:54.834417 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ba7fde2e-b564-4d41-b749-0459dbd37d5b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:54.903698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-6f93c663-5e09-4e7e-aef2-244b0cf7903a req-8a9caf5d-5660-4e9b-b575-fde0491947a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e01b9d4-d99d-47a1-993c-0786a7916d36", "tag": "59341c10-7720-4b07-bc0d-acfed6b20e9e"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:33:54.929422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6f93c663-5e09-4e7e-aef2-244b0cf7903a req-8a9caf5d-5660-4e9b-b575-fde0491947a5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:54.930021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6f93c663-5e09-4e7e-aef2-244b0cf7903a req-8a9caf5d-5660-4e9b-b575-fde0491947a5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:54.942324 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-6f93c663-5e09-4e7e-aef2-244b0cf7903a req-8a9caf5d-5660-4e9b-b575-fde0491947a5 service nova] Creating event network-changed:59341c10-7720-4b07-bc0d-acfed6b20e9e for instance 2e01b9d4-d99d-47a1-993c-0786a7916d36 on nch2-master-1 Mar 05 21:33:54.948547 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-6f93c663-5e09-4e7e-aef2-244b0cf7903a req-8a9caf5d-5660-4e9b-b575-fde0491947a5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053452 Mar 05 21:33:54.949269 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3085/6208] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:33:54.992277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ba7fde2e-b564-4d41-b749-0459dbd37d5b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:54.999934 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ba7fde2e-b564-4d41-b749-0459dbd37d5b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1317 microversion: 2.1 time: 0.179009 Mar 05 21:33:55.000777 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3124/6209] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:54 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:56.018738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-84a03a56-6a1f-4a06-a91b-11ada9fb0b62 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:56.019388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-84a03a56-6a1f-4a06-a91b-11ada9fb0b62 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:56.025880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84a03a56-6a1f-4a06-a91b-11ada9fb0b62 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:56.026372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84a03a56-6a1f-4a06-a91b-11ada9fb0b62 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:56.027163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84a03a56-6a1f-4a06-a91b-11ada9fb0b62 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:56.027620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-84a03a56-6a1f-4a06-a91b-11ada9fb0b62 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:56.165773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-84a03a56-6a1f-4a06-a91b-11ada9fb0b62 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:56.173150 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-84a03a56-6a1f-4a06-a91b-11ada9fb0b62 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1317 microversion: 2.1 time: 0.159739 Mar 05 21:33:56.173734 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3086/6210] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:56 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:57.190427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-64830b64-2931-43e0-a6ec-a4e54e30e69e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:57.190988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-64830b64-2931-43e0-a6ec-a4e54e30e69e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:57.197604 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64830b64-2931-43e0-a6ec-a4e54e30e69e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:57.198060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64830b64-2931-43e0-a6ec-a4e54e30e69e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:57.198832 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64830b64-2931-43e0-a6ec-a4e54e30e69e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:57.199282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-64830b64-2931-43e0-a6ec-a4e54e30e69e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:57.332915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-64830b64-2931-43e0-a6ec-a4e54e30e69e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:57.340588 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-64830b64-2931-43e0-a6ec-a4e54e30e69e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1317 microversion: 2.1 time: 0.154592 Mar 05 21:33:57.341168 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3125/6211] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:57 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:58.357820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-94eed262-5cce-44cb-aff0-41845bac90f2 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:58.358469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-94eed262-5cce-44cb-aff0-41845bac90f2 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:58.365467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94eed262-5cce-44cb-aff0-41845bac90f2 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:58.365929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94eed262-5cce-44cb-aff0-41845bac90f2 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:58.366837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94eed262-5cce-44cb-aff0-41845bac90f2 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:58.367290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-94eed262-5cce-44cb-aff0-41845bac90f2 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:58.499072 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-94eed262-5cce-44cb-aff0-41845bac90f2 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:58.506770 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-94eed262-5cce-44cb-aff0-41845bac90f2 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1317 microversion: 2.1 time: 0.152865 Mar 05 21:33:58.507563 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3087/6212] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:58 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:33:59.524372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-91a30603-1f47-4fe3-aa04-63f6cee14ea3 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:33:59.524917 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-91a30603-1f47-4fe3-aa04-63f6cee14ea3 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:33:59.531713 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91a30603-1f47-4fe3-aa04-63f6cee14ea3 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:59.532231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91a30603-1f47-4fe3-aa04-63f6cee14ea3 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:59.532952 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91a30603-1f47-4fe3-aa04-63f6cee14ea3 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:33:59.533399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-91a30603-1f47-4fe3-aa04-63f6cee14ea3 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:33:59.669538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-91a30603-1f47-4fe3-aa04-63f6cee14ea3 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:33:59.677004 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-91a30603-1f47-4fe3-aa04-63f6cee14ea3 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1317 microversion: 2.1 time: 0.157280 Mar 05 21:33:59.677586 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3126/6213] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:33:59 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:00.566959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-c4c6e579-bc3d-4e6f-becb-d3aa1c324d2d req-dd774b3e-278f-4a08-89f8-bed4cc62dc5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e01b9d4-d99d-47a1-993c-0786a7916d36", "name": "network-vif-plugged", "status": "completed", "tag": "59341c10-7720-4b07-bc0d-acfed6b20e9e"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:34:00.579314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c4c6e579-bc3d-4e6f-becb-d3aa1c324d2d req-dd774b3e-278f-4a08-89f8-bed4cc62dc5e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:00.579314 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c4c6e579-bc3d-4e6f-becb-d3aa1c324d2d req-dd774b3e-278f-4a08-89f8-bed4cc62dc5e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:00.589278 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-c4c6e579-bc3d-4e6f-becb-d3aa1c324d2d req-dd774b3e-278f-4a08-89f8-bed4cc62dc5e service nova] Creating event network-vif-plugged:59341c10-7720-4b07-bc0d-acfed6b20e9e for instance 2e01b9d4-d99d-47a1-993c-0786a7916d36 on nch2-master-1 Mar 05 21:34:00.594166 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-c4c6e579-bc3d-4e6f-becb-d3aa1c324d2d req-dd774b3e-278f-4a08-89f8-bed4cc62dc5e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030951 Mar 05 21:34:00.594802 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3088/6214] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:34:00.694418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4cdd6d68-8144-45c7-8334-51eff58eb812 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:00.695004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4cdd6d68-8144-45c7-8334-51eff58eb812 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:00.701844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4cdd6d68-8144-45c7-8334-51eff58eb812 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:00.702300 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4cdd6d68-8144-45c7-8334-51eff58eb812 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:00.703081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4cdd6d68-8144-45c7-8334-51eff58eb812 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:00.703621 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4cdd6d68-8144-45c7-8334-51eff58eb812 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:00.836742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4cdd6d68-8144-45c7-8334-51eff58eb812 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:00.844026 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4cdd6d68-8144-45c7-8334-51eff58eb812 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1317 microversion: 2.1 time: 0.153788 Mar 05 21:34:00.844603 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3127/6215] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:00 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:01.861642 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-540397dc-9e0b-4386-b951-45f400b72deb tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:01.862534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-540397dc-9e0b-4386-b951-45f400b72deb tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:01.870746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-540397dc-9e0b-4386-b951-45f400b72deb tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:01.871212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-540397dc-9e0b-4386-b951-45f400b72deb tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:01.872073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-540397dc-9e0b-4386-b951-45f400b72deb tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:01.872529 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-540397dc-9e0b-4386-b951-45f400b72deb tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:02.006490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-540397dc-9e0b-4386-b951-45f400b72deb tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:02.013937 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-540397dc-9e0b-4386-b951-45f400b72deb tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1505 microversion: 2.1 time: 0.156613 Mar 05 21:34:02.014519 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3089/6216] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:01 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:02.067332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-914164874", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "0916c3e1-ca39-405a-a675-577fa31a9350"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:34:02.119081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] validate_networks() for [('0916c3e1-ca39-405a-a675-577fa31a9350', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:34:02.474311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:34:02.474743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:34:02.475253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:34:02.475684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:34:02.476114 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:34:02.485254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:02.485706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:02.486507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:02.486947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:02.504074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Getting quotas for project 7f696665b40b40f48962338a625b4d8b. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:34:02.509325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Getting quotas for user cb99bac4c1b642b9bb1548b9f74b14e1 and project 7f696665b40b40f48962338a625b4d8b. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:34:02.521288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:34:02.523643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:34:02.568320 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4b033214-522b-4452-b1b4-e7106fcc3f7c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504977 Mar 05 21:34:02.568975 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3128/6217] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:34:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:34:02.579030 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6f0d751a-1c47-469b-a517-a8d82a318826 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:02.579798 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6f0d751a-1c47-469b-a517-a8d82a318826 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:02.634576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6f0d751a-1c47-469b-a517-a8d82a318826 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:02.641297 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6f0d751a-1c47-469b-a517-a8d82a318826 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 200 len: 1216 microversion: 2.1 time: 0.066294 Mar 05 21:34:02.641883 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3090/6218] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:02 2022] GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 1216 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:03.658191 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8e489c1b-f803-440a-97b4-9951e6d04c46 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:03.658879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8e489c1b-f803-440a-97b4-9951e6d04c46 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:03.667338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e489c1b-f803-440a-97b4-9951e6d04c46 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:03.667837 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e489c1b-f803-440a-97b4-9951e6d04c46 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:03.668631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e489c1b-f803-440a-97b4-9951e6d04c46 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:03.669076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8e489c1b-f803-440a-97b4-9951e6d04c46 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:03.731108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8e489c1b-f803-440a-97b4-9951e6d04c46 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:03.738656 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8e489c1b-f803-440a-97b4-9951e6d04c46 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 200 len: 1274 microversion: 2.1 time: 0.084397 Mar 05 21:34:03.739237 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3129/6219] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:03 2022] GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:04.702457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a198bec2-367a-4b82-8a21-268e7d7d5ddf req-49f20652-a79c-4ca2-9e18-55ae25fec96a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7c5af0-7046-4c61-b90b-edfac649864a", "tag": "c2bd23b5-e8f4-4edd-a20c-4458fe2ba7de"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:34:04.713018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a198bec2-367a-4b82-8a21-268e7d7d5ddf req-49f20652-a79c-4ca2-9e18-55ae25fec96a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:04.713487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a198bec2-367a-4b82-8a21-268e7d7d5ddf req-49f20652-a79c-4ca2-9e18-55ae25fec96a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:04.724387 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a198bec2-367a-4b82-8a21-268e7d7d5ddf req-49f20652-a79c-4ca2-9e18-55ae25fec96a service nova] Creating event network-changed:c2bd23b5-e8f4-4edd-a20c-4458fe2ba7de for instance aa7c5af0-7046-4c61-b90b-edfac649864a on nch1-master-1 Mar 05 21:34:04.729295 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a198bec2-367a-4b82-8a21-268e7d7d5ddf req-49f20652-a79c-4ca2-9e18-55ae25fec96a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031255 Mar 05 21:34:04.730354 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3091/6220] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:34:04.756532 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4bbe593a-1249-436f-a6fa-3af78af60bb8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:04.757179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4bbe593a-1249-436f-a6fa-3af78af60bb8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:04.764884 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bbe593a-1249-436f-a6fa-3af78af60bb8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:04.765350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bbe593a-1249-436f-a6fa-3af78af60bb8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:04.766220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bbe593a-1249-436f-a6fa-3af78af60bb8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:04.766664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4bbe593a-1249-436f-a6fa-3af78af60bb8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:04.902413 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4bbe593a-1249-436f-a6fa-3af78af60bb8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:04.910101 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4bbe593a-1249-436f-a6fa-3af78af60bb8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 200 len: 1316 microversion: 2.1 time: 0.157559 Mar 05 21:34:04.910697 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3130/6221] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:04 2022] GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:05.928681 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-077ca02a-8029-49f5-98a3-67978638da8a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:05.929410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-077ca02a-8029-49f5-98a3-67978638da8a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:05.936203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-077ca02a-8029-49f5-98a3-67978638da8a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:05.936702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-077ca02a-8029-49f5-98a3-67978638da8a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:05.937493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-077ca02a-8029-49f5-98a3-67978638da8a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:05.937951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-077ca02a-8029-49f5-98a3-67978638da8a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:06.074829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-077ca02a-8029-49f5-98a3-67978638da8a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:06.082308 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-077ca02a-8029-49f5-98a3-67978638da8a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 200 len: 1316 microversion: 2.1 time: 0.158875 Mar 05 21:34:06.082903 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3092/6222] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:05 2022] GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:07.099862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e3e399ce-211c-483e-9f47-f8a5a608697a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:07.100434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e3e399ce-211c-483e-9f47-f8a5a608697a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:07.107975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3e399ce-211c-483e-9f47-f8a5a608697a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:07.108432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3e399ce-211c-483e-9f47-f8a5a608697a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:07.109293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3e399ce-211c-483e-9f47-f8a5a608697a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:07.109743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3e399ce-211c-483e-9f47-f8a5a608697a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:07.251135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e3e399ce-211c-483e-9f47-f8a5a608697a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:07.258517 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e3e399ce-211c-483e-9f47-f8a5a608697a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 200 len: 1316 microversion: 2.1 time: 0.162705 Mar 05 21:34:07.259102 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3131/6223] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:07 2022] GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:08.275083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fb2b48a7-6ebf-44f2-94fd-d3ea0caa5a40 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:08.275826 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fb2b48a7-6ebf-44f2-94fd-d3ea0caa5a40 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:08.282626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb2b48a7-6ebf-44f2-94fd-d3ea0caa5a40 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:08.283094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb2b48a7-6ebf-44f2-94fd-d3ea0caa5a40 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:08.283911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb2b48a7-6ebf-44f2-94fd-d3ea0caa5a40 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:08.284365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fb2b48a7-6ebf-44f2-94fd-d3ea0caa5a40 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:08.421121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fb2b48a7-6ebf-44f2-94fd-d3ea0caa5a40 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:08.428577 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fb2b48a7-6ebf-44f2-94fd-d3ea0caa5a40 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 200 len: 1316 microversion: 2.1 time: 0.158134 Mar 05 21:34:08.429167 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3093/6224] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:08 2022] GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:09.445706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d7249124-5f21-4d61-8f7e-6ae8caad1046 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:09.446979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d7249124-5f21-4d61-8f7e-6ae8caad1046 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:09.453775 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7249124-5f21-4d61-8f7e-6ae8caad1046 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:09.454230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7249124-5f21-4d61-8f7e-6ae8caad1046 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:09.454997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7249124-5f21-4d61-8f7e-6ae8caad1046 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:09.455436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d7249124-5f21-4d61-8f7e-6ae8caad1046 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:09.585981 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d7249124-5f21-4d61-8f7e-6ae8caad1046 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:09.593405 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d7249124-5f21-4d61-8f7e-6ae8caad1046 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 200 len: 1316 microversion: 2.1 time: 0.151779 Mar 05 21:34:09.593996 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3132/6225] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:09 2022] GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:10.543565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7673afd0-36a4-4e8b-8725-65bb8417ee5f req-db000437-11e9-47fb-81e2-d3719772ee04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7c5af0-7046-4c61-b90b-edfac649864a", "name": "network-vif-plugged", "status": "completed", "tag": "c2bd23b5-e8f4-4edd-a20c-4458fe2ba7de"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:34:10.553341 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7673afd0-36a4-4e8b-8725-65bb8417ee5f req-db000437-11e9-47fb-81e2-d3719772ee04 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:10.553805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7673afd0-36a4-4e8b-8725-65bb8417ee5f req-db000437-11e9-47fb-81e2-d3719772ee04 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:10.566512 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7673afd0-36a4-4e8b-8725-65bb8417ee5f req-db000437-11e9-47fb-81e2-d3719772ee04 service nova] Creating event network-vif-plugged:c2bd23b5-e8f4-4edd-a20c-4458fe2ba7de for instance aa7c5af0-7046-4c61-b90b-edfac649864a on nch1-master-1 Mar 05 21:34:10.572537 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7673afd0-36a4-4e8b-8725-65bb8417ee5f req-db000437-11e9-47fb-81e2-d3719772ee04 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031789 Mar 05 21:34:10.573140 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3094/6226] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:34:10.610694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9a6eef33-56ae-4cb9-bc5a-ce8d29dea92e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:10.611321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9a6eef33-56ae-4cb9-bc5a-ce8d29dea92e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:10.625385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a6eef33-56ae-4cb9-bc5a-ce8d29dea92e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:10.626089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a6eef33-56ae-4cb9-bc5a-ce8d29dea92e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:10.626882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a6eef33-56ae-4cb9-bc5a-ce8d29dea92e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:10.627328 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9a6eef33-56ae-4cb9-bc5a-ce8d29dea92e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:10.763745 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9a6eef33-56ae-4cb9-bc5a-ce8d29dea92e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:10.771129 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9a6eef33-56ae-4cb9-bc5a-ce8d29dea92e tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 200 len: 1316 microversion: 2.1 time: 0.164524 Mar 05 21:34:10.771816 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3133/6227] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:10 2022] GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:11.788791 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4e7f1a98-8d83-41f1-80fa-17c1c64c3808 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:11.789544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4e7f1a98-8d83-41f1-80fa-17c1c64c3808 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:11.797249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e7f1a98-8d83-41f1-80fa-17c1c64c3808 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:11.797716 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e7f1a98-8d83-41f1-80fa-17c1c64c3808 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:11.798496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e7f1a98-8d83-41f1-80fa-17c1c64c3808 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:11.798945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4e7f1a98-8d83-41f1-80fa-17c1c64c3808 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:11.935415 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4e7f1a98-8d83-41f1-80fa-17c1c64c3808 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:11.942824 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4e7f1a98-8d83-41f1-80fa-17c1c64c3808 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 200 len: 1504 microversion: 2.1 time: 0.158316 Mar 05 21:34:11.943396 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3095/6228] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:11 2022] GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:11.961368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-40576649-4992-4308-a916-d12978739ae8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:11.962510 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-40576649-4992-4308-a916-d12978739ae8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:11.969581 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40576649-4992-4308-a916-d12978739ae8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:11.970039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40576649-4992-4308-a916-d12978739ae8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:11.970819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40576649-4992-4308-a916-d12978739ae8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:11.971262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40576649-4992-4308-a916-d12978739ae8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:12.000086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-40576649-4992-4308-a916-d12978739ae8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:34:12.073857 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-40576649-4992-4308-a916-d12978739ae8 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 204 len: 0 microversion: 2.1 time: 0.118630 Mar 05 21:34:12.074535 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3134/6229] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:34:11 2022] DELETE /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:34:12.083040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-bbbed6ec-78ea-42df-890f-f4058afdf25f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:12.083695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-bbbed6ec-78ea-42df-890f-f4058afdf25f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:12.091052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bbbed6ec-78ea-42df-890f-f4058afdf25f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:12.091527 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bbbed6ec-78ea-42df-890f-f4058afdf25f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:12.092357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bbbed6ec-78ea-42df-890f-f4058afdf25f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:12.092814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-bbbed6ec-78ea-42df-890f-f4058afdf25f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:12.228938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-bbbed6ec-78ea-42df-890f-f4058afdf25f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:12.236485 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-bbbed6ec-78ea-42df-890f-f4058afdf25f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 200 len: 1510 microversion: 2.1 time: 0.157672 Mar 05 21:34:12.237068 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3096/6230] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:12 2022] GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:13.254787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4ccdff6a-435a-4937-a6c9-dbfc03236b8b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:13.255446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4ccdff6a-435a-4937-a6c9-dbfc03236b8b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:13.262175 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ccdff6a-435a-4937-a6c9-dbfc03236b8b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:13.262631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ccdff6a-435a-4937-a6c9-dbfc03236b8b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:13.263399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ccdff6a-435a-4937-a6c9-dbfc03236b8b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:13.263868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4ccdff6a-435a-4937-a6c9-dbfc03236b8b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:13.396977 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4ccdff6a-435a-4937-a6c9-dbfc03236b8b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:13.405659 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4ccdff6a-435a-4937-a6c9-dbfc03236b8b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 200 len: 1510 microversion: 2.1 time: 0.155519 Mar 05 21:34:13.406447 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3135/6231] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:13 2022] GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:13.801740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-03c5a807-79bb-4512-9c98-23a212aaaa89 req-11e59677-429d-4fb6-af21-98087d7016d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7c5af0-7046-4c61-b90b-edfac649864a", "name": "network-vif-deleted", "tag": "c2bd23b5-e8f4-4edd-a20c-4458fe2ba7de"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:34:13.812048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-03c5a807-79bb-4512-9c98-23a212aaaa89 req-11e59677-429d-4fb6-af21-98087d7016d1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:13.812493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-03c5a807-79bb-4512-9c98-23a212aaaa89 req-11e59677-429d-4fb6-af21-98087d7016d1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:13.826039 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-03c5a807-79bb-4512-9c98-23a212aaaa89 req-11e59677-429d-4fb6-af21-98087d7016d1 service nova] Creating event network-vif-deleted:c2bd23b5-e8f4-4edd-a20c-4458fe2ba7de for instance aa7c5af0-7046-4c61-b90b-edfac649864a on nch1-master-1 Mar 05 21:34:13.831053 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-03c5a807-79bb-4512-9c98-23a212aaaa89 req-11e59677-429d-4fb6-af21-98087d7016d1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033303 Mar 05 21:34:13.831664 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3097/6232] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:34:14.424126 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-756ff20d-9afc-43e9-ad1e-e040e7364a51 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:14.424682 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-756ff20d-9afc-43e9-ad1e-e040e7364a51 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:14.432098 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-756ff20d-9afc-43e9-ad1e-e040e7364a51 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:14.432560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-756ff20d-9afc-43e9-ad1e-e040e7364a51 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:14.433341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-756ff20d-9afc-43e9-ad1e-e040e7364a51 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:14.433788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-756ff20d-9afc-43e9-ad1e-e040e7364a51 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:14.446979 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-756ff20d-9afc-43e9-ad1e-e040e7364a51 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] HTTP exception thrown: Instance aa7c5af0-7046-4c61-b90b-edfac649864a could not be found. Mar 05 21:34:14.447578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-756ff20d-9afc-43e9-ad1e-e040e7364a51 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Returning 404 to user: Instance aa7c5af0-7046-4c61-b90b-edfac649864a could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:34:14.448435 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-756ff20d-9afc-43e9-ad1e-e040e7364a51 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 404 len: 111 microversion: 2.1 time: 0.028445 Mar 05 21:34:14.448983 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3136/6233] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:14 2022] GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:34:14.458032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7f499ee9-fae6-432b-aa60-2f9f9ff43e20 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:14.458757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7f499ee9-fae6-432b-aa60-2f9f9ff43e20 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:14.465025 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f499ee9-fae6-432b-aa60-2f9f9ff43e20 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:14.465497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f499ee9-fae6-432b-aa60-2f9f9ff43e20 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:14.466281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f499ee9-fae6-432b-aa60-2f9f9ff43e20 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:14.466738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7f499ee9-fae6-432b-aa60-2f9f9ff43e20 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:14.604249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7f499ee9-fae6-432b-aa60-2f9f9ff43e20 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:14.611639 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7f499ee9-fae6-432b-aa60-2f9f9ff43e20 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1505 microversion: 2.1 time: 0.157840 Mar 05 21:34:14.612246 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3098/6234] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:14 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:14.634412 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f78d815d-8822-4d1a-9955-3698838db09c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:34:14.635499 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f78d815d-8822-4d1a-9955-3698838db09c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: ad94fe6a-ddbb-4ae8-9a77-331b741849ab] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:14.641013 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-f78d815d-8822-4d1a-9955-3698838db09c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] HTTP exception thrown: Instance ad94fe6a-ddbb-4ae8-9a77-331b741849ab could not be found. Mar 05 21:34:14.641609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f78d815d-8822-4d1a-9955-3698838db09c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Returning 404 to user: Instance ad94fe6a-ddbb-4ae8-9a77-331b741849ab could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:34:14.642433 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f78d815d-8822-4d1a-9955-3698838db09c tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "POST /compute/v2.1/servers/ad94fe6a-ddbb-4ae8-9a77-331b741849ab/action" status: 404 len: 111 microversion: 2.1 time: 0.012531 Mar 05 21:34:14.642987 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3137/6235] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:34:14 2022] POST /compute/v2.1/servers/ad94fe6a-ddbb-4ae8-9a77-331b741849ab/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:34:14.651096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b8a12665-abaa-4df8-b851-839c60f5a1a9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:14.651761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b8a12665-abaa-4df8-b851-839c60f5a1a9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:14.657893 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8a12665-abaa-4df8-b851-839c60f5a1a9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:14.658355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8a12665-abaa-4df8-b851-839c60f5a1a9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:14.659136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8a12665-abaa-4df8-b851-839c60f5a1a9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:14.659587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b8a12665-abaa-4df8-b851-839c60f5a1a9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:14.791427 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b8a12665-abaa-4df8-b851-839c60f5a1a9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:14.798878 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b8a12665-abaa-4df8-b851-839c60f5a1a9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1505 microversion: 2.1 time: 0.151669 Mar 05 21:34:14.799455 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3099/6236] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:14 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:14.816778 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-39cca605-a154-4ba4-84f6-05b19480ffa5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:14.817401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-39cca605-a154-4ba4-84f6-05b19480ffa5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:14.824761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39cca605-a154-4ba4-84f6-05b19480ffa5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:14.825224 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39cca605-a154-4ba4-84f6-05b19480ffa5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:14.826031 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39cca605-a154-4ba4-84f6-05b19480ffa5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:14.826480 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-39cca605-a154-4ba4-84f6-05b19480ffa5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:14.963742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-39cca605-a154-4ba4-84f6-05b19480ffa5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:14.971207 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-39cca605-a154-4ba4-84f6-05b19480ffa5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1505 microversion: 2.1 time: 0.158280 Mar 05 21:34:14.971808 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3138/6237] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:14 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:14.989554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dc92c81c-7a10-4d6f-be8a-836b4ab8fec9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "04609fe1-d54d-432d-b85f-57c50b932194"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:34:14.990594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dc92c81c-7a10-4d6f-be8a-836b4ab8fec9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:14.997909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc92c81c-7a10-4d6f-be8a-836b4ab8fec9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:14.998408 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc92c81c-7a10-4d6f-be8a-836b4ab8fec9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:14.999200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc92c81c-7a10-4d6f-be8a-836b4ab8fec9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:14.999655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dc92c81c-7a10-4d6f-be8a-836b4ab8fec9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.030515 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dc92c81c-7a10-4d6f-be8a-836b4ab8fec9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:15.035548 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-dc92c81c-7a10-4d6f-be8a-836b4ab8fec9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] HTTP exception thrown: Flavor 04609fe1-d54d-432d-b85f-57c50b932194 could not be found. Mar 05 21:34:15.036200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dc92c81c-7a10-4d6f-be8a-836b4ab8fec9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Returning 400 to user: Flavor 04609fe1-d54d-432d-b85f-57c50b932194 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:34:15.037053 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dc92c81c-7a10-4d6f-be8a-836b4ab8fec9 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "POST /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36/action" status: 400 len: 107 microversion: 2.1 time: 0.051614 Mar 05 21:34:15.037625 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3100/6238] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:34:14 2022] POST /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36/action => generated 107 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:34:15.047019 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1438210f-15ae-4c2b-aada-c51b384475a6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:15.047643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1438210f-15ae-4c2b-aada-c51b384475a6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:15.053541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1438210f-15ae-4c2b-aada-c51b384475a6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.053996 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1438210f-15ae-4c2b-aada-c51b384475a6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.054764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1438210f-15ae-4c2b-aada-c51b384475a6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.055204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1438210f-15ae-4c2b-aada-c51b384475a6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.187861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1438210f-15ae-4c2b-aada-c51b384475a6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:15.195374 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1438210f-15ae-4c2b-aada-c51b384475a6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1505 microversion: 2.1 time: 0.152249 Mar 05 21:34:15.196502 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3139/6239] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:15 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:15.214412 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c7a576ce-b3dd-40ba-94d4-7cc663fe636a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:15.215039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c7a576ce-b3dd-40ba-94d4-7cc663fe636a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:15.220951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7a576ce-b3dd-40ba-94d4-7cc663fe636a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.221420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7a576ce-b3dd-40ba-94d4-7cc663fe636a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.222197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7a576ce-b3dd-40ba-94d4-7cc663fe636a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.222663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c7a576ce-b3dd-40ba-94d4-7cc663fe636a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.357471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c7a576ce-b3dd-40ba-94d4-7cc663fe636a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:15.365104 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c7a576ce-b3dd-40ba-94d4-7cc663fe636a tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1505 microversion: 2.1 time: 0.155502 Mar 05 21:34:15.365714 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3101/6240] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:15 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:15.382145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2ef947e5-041b-41eb-8668-28138a213e87 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:34:15.383378 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2ef947e5-041b-41eb-8668-28138a213e87 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:34:15.384902 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2ef947e5-041b-41eb-8668-28138a213e87 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "POST /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36/action" status: 400 len: 113 microversion: 2.1 time: 0.006719 Mar 05 21:34:15.385431 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3140/6241] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:34:15 2022] POST /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36/action => generated 113 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 21:34:15.392929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6b5d583f-911d-4dcb-b942-a216b45d071b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:15.393562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6b5d583f-911d-4dcb-b942-a216b45d071b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:15.400780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b5d583f-911d-4dcb-b942-a216b45d071b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.401254 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b5d583f-911d-4dcb-b942-a216b45d071b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.402077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b5d583f-911d-4dcb-b942-a216b45d071b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.402539 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6b5d583f-911d-4dcb-b942-a216b45d071b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.535386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6b5d583f-911d-4dcb-b942-a216b45d071b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:15.542968 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6b5d583f-911d-4dcb-b942-a216b45d071b tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1505 microversion: 2.1 time: 0.153793 Mar 05 21:34:15.543557 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3102/6242] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:15 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:15.563888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-43c5e2cd-66b1-49b8-8bab-930b3551e0f5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:15.564385 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-43c5e2cd-66b1-49b8-8bab-930b3551e0f5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:15.572168 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43c5e2cd-66b1-49b8-8bab-930b3551e0f5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.572627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43c5e2cd-66b1-49b8-8bab-930b3551e0f5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.573397 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43c5e2cd-66b1-49b8-8bab-930b3551e0f5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.573839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-43c5e2cd-66b1-49b8-8bab-930b3551e0f5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.586979 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-43c5e2cd-66b1-49b8-8bab-930b3551e0f5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] HTTP exception thrown: Instance aa7c5af0-7046-4c61-b90b-edfac649864a could not be found. Mar 05 21:34:15.587587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-43c5e2cd-66b1-49b8-8bab-930b3551e0f5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Returning 404 to user: Instance aa7c5af0-7046-4c61-b90b-edfac649864a could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:34:15.588494 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-43c5e2cd-66b1-49b8-8bab-930b3551e0f5 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 404 len: 111 microversion: 2.1 time: 0.029537 Mar 05 21:34:15.589032 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3141/6243] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:34:15 2022] DELETE /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:34:15.597042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7ee782ac-a449-4b2d-bf6d-1cc93019171f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:15.597672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7ee782ac-a449-4b2d-bf6d-1cc93019171f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: aa7c5af0-7046-4c61-b90b-edfac649864a] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:15.603583 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ee782ac-a449-4b2d-bf6d-1cc93019171f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.605129 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ee782ac-a449-4b2d-bf6d-1cc93019171f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.605913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ee782ac-a449-4b2d-bf6d-1cc93019171f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.606363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ee782ac-a449-4b2d-bf6d-1cc93019171f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.620305 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-7ee782ac-a449-4b2d-bf6d-1cc93019171f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] HTTP exception thrown: Instance aa7c5af0-7046-4c61-b90b-edfac649864a could not be found. Mar 05 21:34:15.620911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7ee782ac-a449-4b2d-bf6d-1cc93019171f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Returning 404 to user: Instance aa7c5af0-7046-4c61-b90b-edfac649864a could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:34:15.621749 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7ee782ac-a449-4b2d-bf6d-1cc93019171f tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a" status: 404 len: 111 microversion: 2.1 time: 0.028616 Mar 05 21:34:15.622285 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3103/6244] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:15 2022] GET /compute/v2.1/servers/aa7c5af0-7046-4c61-b90b-edfac649864a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:34:15.630639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a2d711ec-0885-4e55-a9ec-8f40d125839d tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:15.631274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a2d711ec-0885-4e55-a9ec-8f40d125839d tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:15.638634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2d711ec-0885-4e55-a9ec-8f40d125839d tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.639280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2d711ec-0885-4e55-a9ec-8f40d125839d tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.640248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2d711ec-0885-4e55-a9ec-8f40d125839d tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.640769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a2d711ec-0885-4e55-a9ec-8f40d125839d tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.667379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a2d711ec-0885-4e55-a9ec-8f40d125839d tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:34:15.739568 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a2d711ec-0885-4e55-a9ec-8f40d125839d tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 204 len: 0 microversion: 2.1 time: 0.112697 Mar 05 21:34:15.740218 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3142/6245] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:34:15 2022] DELETE /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:34:15.748967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b29afcc6-5322-4822-a682-ce1ae2a4ad91 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:15.749690 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b29afcc6-5322-4822-a682-ce1ae2a4ad91 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:15.756047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b29afcc6-5322-4822-a682-ce1ae2a4ad91 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.756518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b29afcc6-5322-4822-a682-ce1ae2a4ad91 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.757307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b29afcc6-5322-4822-a682-ce1ae2a4ad91 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:15.757764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b29afcc6-5322-4822-a682-ce1ae2a4ad91 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:15.893436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b29afcc6-5322-4822-a682-ce1ae2a4ad91 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:15.901584 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b29afcc6-5322-4822-a682-ce1ae2a4ad91 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1511 microversion: 2.1 time: 0.156511 Mar 05 21:34:15.902170 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3104/6246] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:15 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:16.919410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-550ca246-d834-4779-be8a-11ad16f2e5b6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:16.920189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-550ca246-d834-4779-be8a-11ad16f2e5b6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:16.926993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-550ca246-d834-4779-be8a-11ad16f2e5b6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:16.927446 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-550ca246-d834-4779-be8a-11ad16f2e5b6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:16.928252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-550ca246-d834-4779-be8a-11ad16f2e5b6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:16.928694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-550ca246-d834-4779-be8a-11ad16f2e5b6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:17.063337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-550ca246-d834-4779-be8a-11ad16f2e5b6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb99bac4c1b642b9bb1548b9f74b14e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f696665b40b40f48962338a625b4d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:17.070945 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-550ca246-d834-4779-be8a-11ad16f2e5b6 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 200 len: 1511 microversion: 2.1 time: 0.156295 Mar 05 21:34:17.072055 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3143/6247] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:16 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:17.616820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e06272c6-a323-4135-a26c-4c1f2f2c07f1 req-285c6a8f-dc66-426e-819c-f72ff3b42752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e01b9d4-d99d-47a1-993c-0786a7916d36", "name": "network-vif-deleted", "tag": "59341c10-7720-4b07-bc0d-acfed6b20e9e"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:34:17.629000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e06272c6-a323-4135-a26c-4c1f2f2c07f1 req-285c6a8f-dc66-426e-819c-f72ff3b42752 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:17.629467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e06272c6-a323-4135-a26c-4c1f2f2c07f1 req-285c6a8f-dc66-426e-819c-f72ff3b42752 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:17.645311 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e06272c6-a323-4135-a26c-4c1f2f2c07f1 req-285c6a8f-dc66-426e-819c-f72ff3b42752 service nova] Creating event network-vif-deleted:59341c10-7720-4b07-bc0d-acfed6b20e9e for instance 2e01b9d4-d99d-47a1-993c-0786a7916d36 on nch2-master-1 Mar 05 21:34:17.650572 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e06272c6-a323-4135-a26c-4c1f2f2c07f1 req-285c6a8f-dc66-426e-819c-f72ff3b42752 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037970 Mar 05 21:34:17.651190 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3105/6248] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:34:18.089013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-305aeb33-3136-4cfe-a612-2076b8956485 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:18.089635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-305aeb33-3136-4cfe-a612-2076b8956485 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] [instance: 2e01b9d4-d99d-47a1-993c-0786a7916d36] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:18.096458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-305aeb33-3136-4cfe-a612-2076b8956485 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:18.096912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-305aeb33-3136-4cfe-a612-2076b8956485 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:18.097678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-305aeb33-3136-4cfe-a612-2076b8956485 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:18.098118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-305aeb33-3136-4cfe-a612-2076b8956485 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:18.113175 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-305aeb33-3136-4cfe-a612-2076b8956485 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] HTTP exception thrown: Instance 2e01b9d4-d99d-47a1-993c-0786a7916d36 could not be found. Mar 05 21:34:18.113803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-305aeb33-3136-4cfe-a612-2076b8956485 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] Returning 404 to user: Instance 2e01b9d4-d99d-47a1-993c-0786a7916d36 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:34:18.114752 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-305aeb33-3136-4cfe-a612-2076b8956485 tempest-ServersNegativeTestJSON-148569663 tempest-ServersNegativeTestJSON-148569663-project] 10.222.0.15 "GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36" status: 404 len: 111 microversion: 2.1 time: 0.030189 Mar 05 21:34:18.115521 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3144/6249] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:18 2022] GET /compute/v2.1/servers/2e01b9d4-d99d-47a1-993c-0786a7916d36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:34:56.763463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2ef3b6bb-00ed-4a2f-a423-735a435a9ce5 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Action: 'create', calling method: .version_select at 0x7fed4c651670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1314714622"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:34:56.777868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-2ef3b6bb-00ed-4a2f-a423-735a435a9ce5 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Getting quotas for project 63f0b6da33924ffea363d98139111178. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:34:56.783128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-2ef3b6bb-00ed-4a2f-a423-735a435a9ce5 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Getting quotas for user 69f2f1f38a5447528d0c5f1162d604c3 and project 63f0b6da33924ffea363d98139111178. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:34:57.110672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-2ef3b6bb-00ed-4a2f-a423-735a435a9ce5 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Getting quotas for project 63f0b6da33924ffea363d98139111178. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:34:57.115753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-2ef3b6bb-00ed-4a2f-a423-735a435a9ce5 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Getting quotas for user 69f2f1f38a5447528d0c5f1162d604c3 and project 63f0b6da33924ffea363d98139111178. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:34:57.130416 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2ef3b6bb-00ed-4a2f-a423-735a435a9ce5 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.372402 Mar 05 21:34:57.131031 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3106/6250] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:34:56 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:34:57.181689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-19355782", "imageRef": "597a0bce-1143-49e0-9764-e425ddd86ffa", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1314714622", "networks": [{"uuid": "bdd38536-6495-47e2-b37b-441ec39c47b0"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:34:57.231907 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] validate_networks() for [('bdd38536-6495-47e2-b37b-441ec39c47b0', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:34:57.694811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:34:57.695283 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:34:57.695804 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:34:57.696219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:34:57.696664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:34:57.705374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:57.705830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:57.706631 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:57.707076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:57.724856 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Getting quotas for project 63f0b6da33924ffea363d98139111178. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:34:57.730422 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Getting quotas for user 69f2f1f38a5447528d0c5f1162d604c3 and project 63f0b6da33924ffea363d98139111178. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:34:57.743144 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:34:57.745372 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='597a0bce-1143-49e0-9764-e425ddd86ffa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:34:57.789948 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8f56a132-a3ae-4344-915d-50a309564b17 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613126 Mar 05 21:34:57.790620 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3145/6251] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:34:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:34:57.801384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-933c608f-34cc-421f-b7dd-580efae73f3c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:57.802131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-933c608f-34cc-421f-b7dd-580efae73f3c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:57.856285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-933c608f-34cc-421f-b7dd-580efae73f3c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:57.862866 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-933c608f-34cc-421f-b7dd-580efae73f3c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1257 microversion: 2.1 time: 0.066395 Mar 05 21:34:57.863573 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3107/6252] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:57 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:34:58.884210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3c0488e4-fcfd-4fc4-98ab-23a947b5b4ee tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:34:58.885462 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3c0488e4-fcfd-4fc4-98ab-23a947b5b4ee tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:34:58.896382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c0488e4-fcfd-4fc4-98ab-23a947b5b4ee tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:58.897211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c0488e4-fcfd-4fc4-98ab-23a947b5b4ee tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:58.899085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c0488e4-fcfd-4fc4-98ab-23a947b5b4ee tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:34:58.900018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3c0488e4-fcfd-4fc4-98ab-23a947b5b4ee tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:34:58.983557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3c0488e4-fcfd-4fc4-98ab-23a947b5b4ee tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:34:58.995352 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3c0488e4-fcfd-4fc4-98ab-23a947b5b4ee tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1315 microversion: 2.1 time: 0.117559 Mar 05 21:34:59.005811 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3146/6253] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:34:58 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1315 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:00.013975 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0c714646-7659-4b81-ac0f-a348d3266f7f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:00.015329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0c714646-7659-4b81-ac0f-a348d3266f7f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:00.023648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c714646-7659-4b81-ac0f-a348d3266f7f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:00.024141 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c714646-7659-4b81-ac0f-a348d3266f7f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:00.025391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c714646-7659-4b81-ac0f-a348d3266f7f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:00.025901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0c714646-7659-4b81-ac0f-a348d3266f7f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:00.179980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0c714646-7659-4b81-ac0f-a348d3266f7f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:00.190327 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0c714646-7659-4b81-ac0f-a348d3266f7f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1357 microversion: 2.1 time: 0.180691 Mar 05 21:35:00.190936 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3108/6254] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:00 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:35:01.207609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ae5d4b29-e01b-42a0-a45c-9d261d820a94 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:01.208921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ae5d4b29-e01b-42a0-a45c-9d261d820a94 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:01.219761 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae5d4b29-e01b-42a0-a45c-9d261d820a94 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:01.220228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae5d4b29-e01b-42a0-a45c-9d261d820a94 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:01.221035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae5d4b29-e01b-42a0-a45c-9d261d820a94 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:01.221487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ae5d4b29-e01b-42a0-a45c-9d261d820a94 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:01.374264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ae5d4b29-e01b-42a0-a45c-9d261d820a94 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:01.384728 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ae5d4b29-e01b-42a0-a45c-9d261d820a94 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1357 microversion: 2.1 time: 0.181161 Mar 05 21:35:01.385482 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3147/6255] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:01 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:02.402884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-aa4705fa-5396-4b24-83ec-abfa117e4a2a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:02.403695 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-aa4705fa-5396-4b24-83ec-abfa117e4a2a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:02.411729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa4705fa-5396-4b24-83ec-abfa117e4a2a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:02.412289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa4705fa-5396-4b24-83ec-abfa117e4a2a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:02.413170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa4705fa-5396-4b24-83ec-abfa117e4a2a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:02.414203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-aa4705fa-5396-4b24-83ec-abfa117e4a2a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:02.567837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-aa4705fa-5396-4b24-83ec-abfa117e4a2a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:02.575940 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-aa4705fa-5396-4b24-83ec-abfa117e4a2a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1357 microversion: 2.1 time: 0.177981 Mar 05 21:35:02.576931 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3109/6256] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:02 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:03.595557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b4b94caf-21c4-428a-a51a-85ba02ae1443 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:03.596327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b4b94caf-21c4-428a-a51a-85ba02ae1443 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:03.603433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4b94caf-21c4-428a-a51a-85ba02ae1443 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:03.604028 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4b94caf-21c4-428a-a51a-85ba02ae1443 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:03.604889 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4b94caf-21c4-428a-a51a-85ba02ae1443 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:03.605511 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4b94caf-21c4-428a-a51a-85ba02ae1443 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:03.751085 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b4b94caf-21c4-428a-a51a-85ba02ae1443 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:03.761326 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b4b94caf-21c4-428a-a51a-85ba02ae1443 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1357 microversion: 2.1 time: 0.171865 Mar 05 21:35:03.762440 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3148/6257] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:03 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:04.779889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6766ec09-ddad-4620-8254-a8a20675763a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:04.780675 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6766ec09-ddad-4620-8254-a8a20675763a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:04.787618 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6766ec09-ddad-4620-8254-a8a20675763a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:04.788122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6766ec09-ddad-4620-8254-a8a20675763a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:04.789009 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6766ec09-ddad-4620-8254-a8a20675763a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:04.789551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6766ec09-ddad-4620-8254-a8a20675763a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:04.954245 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6766ec09-ddad-4620-8254-a8a20675763a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:04.962823 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6766ec09-ddad-4620-8254-a8a20675763a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1357 microversion: 2.1 time: 0.186933 Mar 05 21:35:04.964471 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3110/6258] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:04 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:05.980936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d486539-260e-4c04-9003-d627fd29d67f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:05.981644 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7d486539-260e-4c04-9003-d627fd29d67f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:05.988908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d486539-260e-4c04-9003-d627fd29d67f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:05.989367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d486539-260e-4c04-9003-d627fd29d67f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:05.990154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d486539-260e-4c04-9003-d627fd29d67f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:05.990593 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d486539-260e-4c04-9003-d627fd29d67f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:06.139394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d486539-260e-4c04-9003-d627fd29d67f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:06.147000 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7d486539-260e-4c04-9003-d627fd29d67f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1357 microversion: 2.1 time: 0.170668 Mar 05 21:35:06.147599 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3149/6259] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:05 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:07.169976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-24264dbb-4ac6-4b33-ae56-b0b5932b3d88 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:07.170623 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-24264dbb-4ac6-4b33-ae56-b0b5932b3d88 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:07.177568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24264dbb-4ac6-4b33-ae56-b0b5932b3d88 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:07.178044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24264dbb-4ac6-4b33-ae56-b0b5932b3d88 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:07.178852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24264dbb-4ac6-4b33-ae56-b0b5932b3d88 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:07.180126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-24264dbb-4ac6-4b33-ae56-b0b5932b3d88 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:07.393490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-24264dbb-4ac6-4b33-ae56-b0b5932b3d88 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:07.402126 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-24264dbb-4ac6-4b33-ae56-b0b5932b3d88 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1357 microversion: 2.1 time: 0.236525 Mar 05 21:35:07.402715 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3111/6260] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:07 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1357 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:07.695475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-03f445d8-4498-4b47-95c8-83d6af649226 req-ca5acd6a-dea4-4b31-8622-cd55c305d3cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79692993-f373-4a75-bd13-b7e216a2f7dc", "tag": "125aa08d-af50-4a4e-9390-d93bcbcfc10e"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:35:07.708724 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-03f445d8-4498-4b47-95c8-83d6af649226 req-ca5acd6a-dea4-4b31-8622-cd55c305d3cb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:07.709485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-03f445d8-4498-4b47-95c8-83d6af649226 req-ca5acd6a-dea4-4b31-8622-cd55c305d3cb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:07.722322 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-03f445d8-4498-4b47-95c8-83d6af649226 req-ca5acd6a-dea4-4b31-8622-cd55c305d3cb service nova] Creating event network-changed:125aa08d-af50-4a4e-9390-d93bcbcfc10e for instance 79692993-f373-4a75-bd13-b7e216a2f7dc on nch1-master-1 Mar 05 21:35:07.728239 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-03f445d8-4498-4b47-95c8-83d6af649226 req-ca5acd6a-dea4-4b31-8622-cd55c305d3cb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037234 Mar 05 21:35:07.728853 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3150/6261] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:35:08.419139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ea7d1fdc-1ec9-46d9-b3cd-6f051abe1de2 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:08.419785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ea7d1fdc-1ec9-46d9-b3cd-6f051abe1de2 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:08.426630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ea7d1fdc-1ec9-46d9-b3cd-6f051abe1de2 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:08.427084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ea7d1fdc-1ec9-46d9-b3cd-6f051abe1de2 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:08.427901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ea7d1fdc-1ec9-46d9-b3cd-6f051abe1de2 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:08.428357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ea7d1fdc-1ec9-46d9-b3cd-6f051abe1de2 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:08.682490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ea7d1fdc-1ec9-46d9-b3cd-6f051abe1de2 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:08.690237 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ea7d1fdc-1ec9-46d9-b3cd-6f051abe1de2 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1357 microversion: 2.1 time: 0.275158 Mar 05 21:35:08.690831 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3112/6262] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:08 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1357 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:09.707846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e8c7c9a8-b7f1-438e-b6f5-3538b9c75de8 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:09.708560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e8c7c9a8-b7f1-438e-b6f5-3538b9c75de8 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:09.715511 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8c7c9a8-b7f1-438e-b6f5-3538b9c75de8 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:09.715998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8c7c9a8-b7f1-438e-b6f5-3538b9c75de8 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:09.716768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8c7c9a8-b7f1-438e-b6f5-3538b9c75de8 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:09.717207 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e8c7c9a8-b7f1-438e-b6f5-3538b9c75de8 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:09.849611 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e8c7c9a8-b7f1-438e-b6f5-3538b9c75de8 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:09.857689 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e8c7c9a8-b7f1-438e-b6f5-3538b9c75de8 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1357 microversion: 2.1 time: 0.154231 Mar 05 21:35:09.858268 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3151/6263] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:09 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:10.876127 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dae4054c-1e49-4804-ae3e-d119194c02cd tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:10.876799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dae4054c-1e49-4804-ae3e-d119194c02cd tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:10.883907 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dae4054c-1e49-4804-ae3e-d119194c02cd tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:10.884395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dae4054c-1e49-4804-ae3e-d119194c02cd tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:10.885199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dae4054c-1e49-4804-ae3e-d119194c02cd tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:10.885662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dae4054c-1e49-4804-ae3e-d119194c02cd tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:11.043385 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dae4054c-1e49-4804-ae3e-d119194c02cd tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:11.051186 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dae4054c-1e49-4804-ae3e-d119194c02cd tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1357 microversion: 2.1 time: 0.179288 Mar 05 21:35:11.052240 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3113/6264] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:10 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:12.070307 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-876c026b-5977-42ce-905a-7833cbf2c6ba tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:12.070929 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-876c026b-5977-42ce-905a-7833cbf2c6ba tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:12.077732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-876c026b-5977-42ce-905a-7833cbf2c6ba tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:12.078197 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-876c026b-5977-42ce-905a-7833cbf2c6ba tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:12.078966 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-876c026b-5977-42ce-905a-7833cbf2c6ba tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:12.079410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-876c026b-5977-42ce-905a-7833cbf2c6ba tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:12.215209 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-876c026b-5977-42ce-905a-7833cbf2c6ba tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:12.222811 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-876c026b-5977-42ce-905a-7833cbf2c6ba tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1357 microversion: 2.1 time: 0.157082 Mar 05 21:35:12.223409 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3152/6265] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:12 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:13.082796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-70590d8a-a71e-46ea-8ebb-16815cd6fab3 req-f98bfeea-3c4b-4535-bbf9-3f6168c24d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79692993-f373-4a75-bd13-b7e216a2f7dc", "name": "network-vif-plugged", "status": "completed", "tag": "125aa08d-af50-4a4e-9390-d93bcbcfc10e"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:35:13.092729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-70590d8a-a71e-46ea-8ebb-16815cd6fab3 req-f98bfeea-3c4b-4535-bbf9-3f6168c24d49 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:13.093207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-70590d8a-a71e-46ea-8ebb-16815cd6fab3 req-f98bfeea-3c4b-4535-bbf9-3f6168c24d49 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:13.105125 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-70590d8a-a71e-46ea-8ebb-16815cd6fab3 req-f98bfeea-3c4b-4535-bbf9-3f6168c24d49 service nova] Creating event network-vif-plugged:125aa08d-af50-4a4e-9390-d93bcbcfc10e for instance 79692993-f373-4a75-bd13-b7e216a2f7dc on nch1-master-1 Mar 05 21:35:13.110341 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-70590d8a-a71e-46ea-8ebb-16815cd6fab3 req-f98bfeea-3c4b-4535-bbf9-3f6168c24d49 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031439 Mar 05 21:35:13.110959 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3114/6266] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:35:13.240434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cf5230b2-d9ef-470e-b03b-f5313c5cd5bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:13.241052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cf5230b2-d9ef-470e-b03b-f5313c5cd5bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:13.248513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf5230b2-d9ef-470e-b03b-f5313c5cd5bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:13.248968 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf5230b2-d9ef-470e-b03b-f5313c5cd5bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:13.249992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf5230b2-d9ef-470e-b03b-f5313c5cd5bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:13.250430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf5230b2-d9ef-470e-b03b-f5313c5cd5bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:13.382575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cf5230b2-d9ef-470e-b03b-f5313c5cd5bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:13.389876 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cf5230b2-d9ef-470e-b03b-f5313c5cd5bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1357 microversion: 2.1 time: 0.153361 Mar 05 21:35:13.390452 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3153/6267] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:13 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:14.407833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1bcbcaba-8245-48c5-90d9-d99f3c70916a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:14.408595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1bcbcaba-8245-48c5-90d9-d99f3c70916a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:14.416391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bcbcaba-8245-48c5-90d9-d99f3c70916a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:14.416865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bcbcaba-8245-48c5-90d9-d99f3c70916a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:14.417655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bcbcaba-8245-48c5-90d9-d99f3c70916a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:14.418116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1bcbcaba-8245-48c5-90d9-d99f3c70916a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:14.551482 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1bcbcaba-8245-48c5-90d9-d99f3c70916a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:14.559722 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1bcbcaba-8245-48c5-90d9-d99f3c70916a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1547 microversion: 2.1 time: 0.156292 Mar 05 21:35:14.560307 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3115/6268] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:14 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:14.575712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a8d643bc-e517-4beb-abae-2cedf123f073 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:14.576340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a8d643bc-e517-4beb-abae-2cedf123f073 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:14.583000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a8d643bc-e517-4beb-abae-2cedf123f073 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:14.583451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a8d643bc-e517-4beb-abae-2cedf123f073 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:14.584256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a8d643bc-e517-4beb-abae-2cedf123f073 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:14.584694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a8d643bc-e517-4beb-abae-2cedf123f073 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:14.718663 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a8d643bc-e517-4beb-abae-2cedf123f073 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:14.726499 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a8d643bc-e517-4beb-abae-2cedf123f073 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1547 microversion: 2.1 time: 0.154134 Mar 05 21:35:14.727074 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3154/6269] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:14 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:14.743148 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6967c330-bdf2-4ddb-b79b-f45f3596af09 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:14.746475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6967c330-bdf2-4ddb-b79b-f45f3596af09 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:14.747261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6967c330-bdf2-4ddb-b79b-f45f3596af09 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Searching by: {'deleted': False, 'project_id': '63f0b6da33924ffea363d98139111178'} {{(pid=141478) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 21:35:14.752831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6967c330-bdf2-4ddb-b79b-f45f3596af09 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:14.753301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6967c330-bdf2-4ddb-b79b-f45f3596af09 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:14.754120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6967c330-bdf2-4ddb-b79b-f45f3596af09 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:14.754588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6967c330-bdf2-4ddb-b79b-f45f3596af09 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:14.778518 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.multi_cell_list [None req-6967c330-bdf2-4ddb-b79b-f45f3596af09 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 21:35:14.808321 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6967c330-bdf2-4ddb-b79b-f45f3596af09 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.070035 Mar 05 21:35:14.808909 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3116/6270] 10.222.0.15 () {58 vars in 1124 bytes} [Sat Mar 5 21:35:14 2022] GET /compute/v2.1/servers => generated 341 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:35:14.819064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3076b276-6e1e-4d76-8c33-0f47ded19422 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:14.819702 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3076b276-6e1e-4d76-8c33-0f47ded19422 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:14.825772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3076b276-6e1e-4d76-8c33-0f47ded19422 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:14.826228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3076b276-6e1e-4d76-8c33-0f47ded19422 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:14.826997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3076b276-6e1e-4d76-8c33-0f47ded19422 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:14.827436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3076b276-6e1e-4d76-8c33-0f47ded19422 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:14.959830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3076b276-6e1e-4d76-8c33-0f47ded19422 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:14.967644 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3076b276-6e1e-4d76-8c33-0f47ded19422 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1547 microversion: 2.1 time: 0.152526 Mar 05 21:35:14.968247 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3155/6271] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:14 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:16.467703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a438fa21-5ffd-4ffc-8168-7d0954abdb0b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8028eb84-fe39-47df-a0d7-e87cb202377c"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:35:16.468784 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a438fa21-5ffd-4ffc-8168-7d0954abdb0b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:16.475475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a438fa21-5ffd-4ffc-8168-7d0954abdb0b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:16.476598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a438fa21-5ffd-4ffc-8168-7d0954abdb0b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:16.477383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a438fa21-5ffd-4ffc-8168-7d0954abdb0b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:16.477832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a438fa21-5ffd-4ffc-8168-7d0954abdb0b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:16.702858 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a438fa21-5ffd-4ffc-8168-7d0954abdb0b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "POST /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238906 Mar 05 21:35:16.703645 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3117/6272] 10.222.0.15 () {60 vars in 1322 bytes} [Sat Mar 5 21:35:16 2022] POST /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:35:20.020395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-72680da4-94db-4f63-bbfa-8ddcae956456 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:20.021023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-72680da4-94db-4f63-bbfa-8ddcae956456 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:20.027941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72680da4-94db-4f63-bbfa-8ddcae956456 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:20.028402 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72680da4-94db-4f63-bbfa-8ddcae956456 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:20.029181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72680da4-94db-4f63-bbfa-8ddcae956456 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:20.029625 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72680da4-94db-4f63-bbfa-8ddcae956456 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:20.165767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-72680da4-94db-4f63-bbfa-8ddcae956456 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:20.173744 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-72680da4-94db-4f63-bbfa-8ddcae956456 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1593 microversion: 2.1 time: 0.157238 Mar 05 21:35:20.174341 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3156/6273] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:20 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1593 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:21.914123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-500c3f4a-41aa-4d95-805d-f4bd6217aa25 req-8485c9a0-5a98-4719-9673-7406f4ecf0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79692993-f373-4a75-bd13-b7e216a2f7dc", "tag": "125aa08d-af50-4a4e-9390-d93bcbcfc10e"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:35:21.927227 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-500c3f4a-41aa-4d95-805d-f4bd6217aa25 req-8485c9a0-5a98-4719-9673-7406f4ecf0b7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:21.927812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-500c3f4a-41aa-4d95-805d-f4bd6217aa25 req-8485c9a0-5a98-4719-9673-7406f4ecf0b7 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:21.941067 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-500c3f4a-41aa-4d95-805d-f4bd6217aa25 req-8485c9a0-5a98-4719-9673-7406f4ecf0b7 service nova] Creating event network-changed:125aa08d-af50-4a4e-9390-d93bcbcfc10e for instance 79692993-f373-4a75-bd13-b7e216a2f7dc on nch1-master-1 Mar 05 21:35:21.946452 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-500c3f4a-41aa-4d95-805d-f4bd6217aa25 req-8485c9a0-5a98-4719-9673-7406f4ecf0b7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040787 Mar 05 21:35:21.948086 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3118/6274] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:35:22.929935 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2dcd477d-6e6a-4291-a3e8-98d12028097a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1581299559"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:35:22.931252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2dcd477d-6e6a-4291-a3e8-98d12028097a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:22.938599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dcd477d-6e6a-4291-a3e8-98d12028097a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:22.939055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dcd477d-6e6a-4291-a3e8-98d12028097a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:22.939897 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dcd477d-6e6a-4291-a3e8-98d12028097a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:22.940341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dcd477d-6e6a-4291-a3e8-98d12028097a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:23.076302 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.network.security_group_api [None req-2dcd477d-6e6a-4291-a3e8-98d12028097a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Adding security group b800afc3-ae5a-47fc-92f3-352fe787ba15 to port 125aa08d-af50-4a4e-9390-d93bcbcfc10e Mar 05 21:35:23.427531 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2dcd477d-6e6a-4291-a3e8-98d12028097a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "POST /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/action" status: 202 len: 0 microversion: 2.1 time: 0.502042 Mar 05 21:35:23.428644 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3157/6275] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:35:22 2022] POST /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:35:23.438395 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-baa19f3e-a92b-4207-8d86-c49e5de0ff03 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:23.439122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-baa19f3e-a92b-4207-8d86-c49e5de0ff03 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:23.446591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-baa19f3e-a92b-4207-8d86-c49e5de0ff03 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:23.447064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-baa19f3e-a92b-4207-8d86-c49e5de0ff03 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:23.448553 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-baa19f3e-a92b-4207-8d86-c49e5de0ff03 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:23.449317 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-baa19f3e-a92b-4207-8d86-c49e5de0ff03 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:23.616590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-baa19f3e-a92b-4207-8d86-c49e5de0ff03 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:23.625779 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-baa19f3e-a92b-4207-8d86-c49e5de0ff03 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1759 microversion: 2.1 time: 0.191658 Mar 05 21:35:23.630771 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3119/6276] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:23 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:35:23.963633 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-fad4506b-a60c-4880-bb32-783f08a6722a req-05644fca-3b4a-4655-ab0d-1a939cf17872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79692993-f373-4a75-bd13-b7e216a2f7dc", "tag": "125aa08d-af50-4a4e-9390-d93bcbcfc10e"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:35:23.971874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fad4506b-a60c-4880-bb32-783f08a6722a req-05644fca-3b4a-4655-ab0d-1a939cf17872 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:23.972333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fad4506b-a60c-4880-bb32-783f08a6722a req-05644fca-3b4a-4655-ab0d-1a939cf17872 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:23.985090 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-fad4506b-a60c-4880-bb32-783f08a6722a req-05644fca-3b4a-4655-ab0d-1a939cf17872 service nova] Creating event network-changed:125aa08d-af50-4a4e-9390-d93bcbcfc10e for instance 79692993-f373-4a75-bd13-b7e216a2f7dc on nch1-master-1 Mar 05 21:35:23.990456 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-fad4506b-a60c-4880-bb32-783f08a6722a req-05644fca-3b4a-4655-ab0d-1a939cf17872 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031643 Mar 05 21:35:23.991143 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3158/6277] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:35:48.006997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ca471081-e927-4e0c-ac74-018161a9f6d1 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:35:48.008172 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ca471081-e927-4e0c-ac74-018161a9f6d1 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:48.015109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca471081-e927-4e0c-ac74-018161a9f6d1 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:48.015580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca471081-e927-4e0c-ac74-018161a9f6d1 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:48.016963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca471081-e927-4e0c-ac74-018161a9f6d1 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:48.017422 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ca471081-e927-4e0c-ac74-018161a9f6d1 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:48.089290 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ca471081-e927-4e0c-ac74-018161a9f6d1 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "POST /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/action" status: 202 len: 0 microversion: 2.1 time: 0.086271 Mar 05 21:35:48.089946 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3120/6278] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:35:48 2022] POST /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:35:48.099568 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1e63a26d-b681-40e3-8779-407f3699103b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:48.100757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1e63a26d-b681-40e3-8779-407f3699103b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:48.107118 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e63a26d-b681-40e3-8779-407f3699103b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:48.107583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e63a26d-b681-40e3-8779-407f3699103b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:48.108415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e63a26d-b681-40e3-8779-407f3699103b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:48.108865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e63a26d-b681-40e3-8779-407f3699103b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:48.285921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1e63a26d-b681-40e3-8779-407f3699103b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:48.296201 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1e63a26d-b681-40e3-8779-407f3699103b tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1751 microversion: 2.1 time: 0.201406 Mar 05 21:35:48.296835 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3159/6279] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:48 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1751 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:49.319399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fbd37d0f-25e1-4846-b245-164a3d53416d tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:49.320168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fbd37d0f-25e1-4846-b245-164a3d53416d tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:49.326359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbd37d0f-25e1-4846-b245-164a3d53416d tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:49.326821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbd37d0f-25e1-4846-b245-164a3d53416d tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:49.327600 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbd37d0f-25e1-4846-b245-164a3d53416d tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:49.328075 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fbd37d0f-25e1-4846-b245-164a3d53416d tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:49.473276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fbd37d0f-25e1-4846-b245-164a3d53416d tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:49.481904 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fbd37d0f-25e1-4846-b245-164a3d53416d tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1756 microversion: 2.1 time: 0.167735 Mar 05 21:35:49.482480 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3121/6280] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:49 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:50.499609 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-75c083f2-7942-4d24-9ae8-09c61338d74f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:50.500263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-75c083f2-7942-4d24-9ae8-09c61338d74f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:50.507088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75c083f2-7942-4d24-9ae8-09c61338d74f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:50.508065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75c083f2-7942-4d24-9ae8-09c61338d74f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:50.508834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75c083f2-7942-4d24-9ae8-09c61338d74f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:50.509273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-75c083f2-7942-4d24-9ae8-09c61338d74f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:50.661560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-75c083f2-7942-4d24-9ae8-09c61338d74f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:50.669645 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-75c083f2-7942-4d24-9ae8-09c61338d74f tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1756 microversion: 2.1 time: 0.174217 Mar 05 21:35:50.670446 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3160/6281] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:50 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:51.686286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9a2bf2df-1f96-433f-812f-e9eb765f3449 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:51.686913 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9a2bf2df-1f96-433f-812f-e9eb765f3449 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:51.693659 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a2bf2df-1f96-433f-812f-e9eb765f3449 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:51.694125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a2bf2df-1f96-433f-812f-e9eb765f3449 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:51.694936 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a2bf2df-1f96-433f-812f-e9eb765f3449 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:51.695389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a2bf2df-1f96-433f-812f-e9eb765f3449 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:51.845032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9a2bf2df-1f96-433f-812f-e9eb765f3449 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:51.853429 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9a2bf2df-1f96-433f-812f-e9eb765f3449 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1756 microversion: 2.1 time: 0.171035 Mar 05 21:35:51.854015 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3122/6282] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:51 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:52.871036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-48803137-0817-466f-9d9a-e61c6f3259d9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:52.871658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-48803137-0817-466f-9d9a-e61c6f3259d9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:52.878667 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48803137-0817-466f-9d9a-e61c6f3259d9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:52.879123 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48803137-0817-466f-9d9a-e61c6f3259d9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:52.879926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48803137-0817-466f-9d9a-e61c6f3259d9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:52.880367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-48803137-0817-466f-9d9a-e61c6f3259d9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:53.025470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-48803137-0817-466f-9d9a-e61c6f3259d9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:53.033394 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-48803137-0817-466f-9d9a-e61c6f3259d9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1756 microversion: 2.1 time: 0.166970 Mar 05 21:35:53.033974 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3161/6283] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:52 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:54.050322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ab9a48b0-60f9-4499-96d9-7638caaceac4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:54.050955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ab9a48b0-60f9-4499-96d9-7638caaceac4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:54.058486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab9a48b0-60f9-4499-96d9-7638caaceac4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:54.058953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab9a48b0-60f9-4499-96d9-7638caaceac4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:54.059774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab9a48b0-60f9-4499-96d9-7638caaceac4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:54.060231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab9a48b0-60f9-4499-96d9-7638caaceac4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:54.207742 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ab9a48b0-60f9-4499-96d9-7638caaceac4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:54.215782 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ab9a48b0-60f9-4499-96d9-7638caaceac4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1756 microversion: 2.1 time: 0.169376 Mar 05 21:35:54.216357 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3123/6284] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:54 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:55.233419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-53896063-0644-45f8-bd63-a86d26074dac tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:55.234070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-53896063-0644-45f8-bd63-a86d26074dac tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:55.240628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53896063-0644-45f8-bd63-a86d26074dac tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:55.241087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53896063-0644-45f8-bd63-a86d26074dac tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:55.242238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53896063-0644-45f8-bd63-a86d26074dac tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:55.242475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-53896063-0644-45f8-bd63-a86d26074dac tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:55.387931 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-53896063-0644-45f8-bd63-a86d26074dac tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:55.395987 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-53896063-0644-45f8-bd63-a86d26074dac tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1756 microversion: 2.1 time: 0.166488 Mar 05 21:35:55.396598 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3162/6285] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:55 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:56.412833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cf39cf51-5a0b-4745-9f11-4cdf04e4ed6a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:56.413460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cf39cf51-5a0b-4745-9f11-4cdf04e4ed6a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:56.420257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf39cf51-5a0b-4745-9f11-4cdf04e4ed6a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:56.420751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf39cf51-5a0b-4745-9f11-4cdf04e4ed6a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:56.421528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf39cf51-5a0b-4745-9f11-4cdf04e4ed6a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:56.421980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cf39cf51-5a0b-4745-9f11-4cdf04e4ed6a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:56.565549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cf39cf51-5a0b-4745-9f11-4cdf04e4ed6a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:56.574199 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cf39cf51-5a0b-4745-9f11-4cdf04e4ed6a tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1756 microversion: 2.1 time: 0.165268 Mar 05 21:35:56.574782 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3124/6286] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:56 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:35:57.592280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d8d6d73e-5ca7-4196-9b0d-94c702ca4527 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:57.592900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d8d6d73e-5ca7-4196-9b0d-94c702ca4527 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:57.599252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8d6d73e-5ca7-4196-9b0d-94c702ca4527 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:57.599740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8d6d73e-5ca7-4196-9b0d-94c702ca4527 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:57.600504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8d6d73e-5ca7-4196-9b0d-94c702ca4527 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:57.600948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d8d6d73e-5ca7-4196-9b0d-94c702ca4527 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:57.746369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d8d6d73e-5ca7-4196-9b0d-94c702ca4527 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:57.754636 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d8d6d73e-5ca7-4196-9b0d-94c702ca4527 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1756 microversion: 2.1 time: 0.166464 Mar 05 21:35:57.755237 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3163/6287] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:57 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:58.771420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7af328d9-bd6c-4724-b78f-5bf44cf0ba47 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:58.772094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7af328d9-bd6c-4724-b78f-5bf44cf0ba47 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:58.779543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7af328d9-bd6c-4724-b78f-5bf44cf0ba47 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:58.780048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7af328d9-bd6c-4724-b78f-5bf44cf0ba47 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:58.780834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7af328d9-bd6c-4724-b78f-5bf44cf0ba47 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:58.781293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7af328d9-bd6c-4724-b78f-5bf44cf0ba47 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:58.931184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7af328d9-bd6c-4724-b78f-5bf44cf0ba47 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:35:58.939133 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7af328d9-bd6c-4724-b78f-5bf44cf0ba47 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1756 microversion: 2.1 time: 0.171705 Mar 05 21:35:58.939724 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3125/6288] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:58 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:35:59.956900 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1e79ae62-7031-4ce2-bd3f-2bc3ad609ab9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:35:59.957536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1e79ae62-7031-4ce2-bd3f-2bc3ad609ab9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:35:59.964949 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e79ae62-7031-4ce2-bd3f-2bc3ad609ab9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:59.965418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e79ae62-7031-4ce2-bd3f-2bc3ad609ab9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:35:59.966204 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e79ae62-7031-4ce2-bd3f-2bc3ad609ab9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:35:59.966655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1e79ae62-7031-4ce2-bd3f-2bc3ad609ab9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:00.114740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1e79ae62-7031-4ce2-bd3f-2bc3ad609ab9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:36:00.122818 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1e79ae62-7031-4ce2-bd3f-2bc3ad609ab9 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1756 microversion: 2.1 time: 0.170275 Mar 05 21:36:00.123411 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3164/6289] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:35:59 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:36:01.141968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7a6d9feb-bd0f-4973-9e5c-07984cef64ef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:01.142894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7a6d9feb-bd0f-4973-9e5c-07984cef64ef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:01.150226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a6d9feb-bd0f-4973-9e5c-07984cef64ef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:01.150688 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a6d9feb-bd0f-4973-9e5c-07984cef64ef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:01.151487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a6d9feb-bd0f-4973-9e5c-07984cef64ef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:01.151967 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7a6d9feb-bd0f-4973-9e5c-07984cef64ef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:01.302344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7a6d9feb-bd0f-4973-9e5c-07984cef64ef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:36:01.310406 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7a6d9feb-bd0f-4973-9e5c-07984cef64ef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1756 microversion: 2.1 time: 0.173310 Mar 05 21:36:01.310976 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3126/6290] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:36:01 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:36:02.327338 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2e99ed2e-a515-4104-86f5-b1405ca8af98 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:02.328001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2e99ed2e-a515-4104-86f5-b1405ca8af98 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:02.334922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e99ed2e-a515-4104-86f5-b1405ca8af98 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:02.335380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e99ed2e-a515-4104-86f5-b1405ca8af98 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:02.336819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e99ed2e-a515-4104-86f5-b1405ca8af98 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:02.337380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2e99ed2e-a515-4104-86f5-b1405ca8af98 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:02.482642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2e99ed2e-a515-4104-86f5-b1405ca8af98 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:36:02.490759 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2e99ed2e-a515-4104-86f5-b1405ca8af98 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1756 microversion: 2.1 time: 0.167347 Mar 05 21:36:02.491340 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3165/6291] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:36:02 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:36:03.509208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d99ddf42-3926-4b75-8e57-1d4fe3c7610c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:03.509755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d99ddf42-3926-4b75-8e57-1d4fe3c7610c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:03.517426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d99ddf42-3926-4b75-8e57-1d4fe3c7610c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:03.517903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d99ddf42-3926-4b75-8e57-1d4fe3c7610c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:03.518736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d99ddf42-3926-4b75-8e57-1d4fe3c7610c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:03.519224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d99ddf42-3926-4b75-8e57-1d4fe3c7610c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:03.662115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d99ddf42-3926-4b75-8e57-1d4fe3c7610c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:36:03.670602 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d99ddf42-3926-4b75-8e57-1d4fe3c7610c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1756 microversion: 2.1 time: 0.166335 Mar 05 21:36:03.671183 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3127/6292] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:36:03 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:36:04.688196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-56b761cf-5f45-492b-81aa-23d0a4a2b334 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:04.688829 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-56b761cf-5f45-492b-81aa-23d0a4a2b334 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:04.696211 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56b761cf-5f45-492b-81aa-23d0a4a2b334 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:04.696680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56b761cf-5f45-492b-81aa-23d0a4a2b334 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:04.697460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56b761cf-5f45-492b-81aa-23d0a4a2b334 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:04.697908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-56b761cf-5f45-492b-81aa-23d0a4a2b334 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:04.841255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-56b761cf-5f45-492b-81aa-23d0a4a2b334 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:36:04.849230 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-56b761cf-5f45-492b-81aa-23d0a4a2b334 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1759 microversion: 2.1 time: 0.165051 Mar 05 21:36:04.849814 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3166/6293] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:36:04 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:36:37.232217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b4ba5d88-67ce-4059-ab28-d3dd3b1b66c4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1581299559"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:36:37.232783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b4ba5d88-67ce-4059-ab28-d3dd3b1b66c4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:37.238802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4ba5d88-67ce-4059-ab28-d3dd3b1b66c4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:37.239216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4ba5d88-67ce-4059-ab28-d3dd3b1b66c4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:37.240039 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4ba5d88-67ce-4059-ab28-d3dd3b1b66c4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:37.240496 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4ba5d88-67ce-4059-ab28-d3dd3b1b66c4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:37.377570 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.network.security_group_api [None req-b4ba5d88-67ce-4059-ab28-d3dd3b1b66c4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Removing security group b800afc3-ae5a-47fc-92f3-352fe787ba15 from port 125aa08d-af50-4a4e-9390-d93bcbcfc10e Mar 05 21:36:37.721217 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b4ba5d88-67ce-4059-ab28-d3dd3b1b66c4 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "POST /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/action" status: 202 len: 0 microversion: 2.1 time: 0.494056 Mar 05 21:36:37.721852 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3128/6294] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:36:37 2022] POST /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:36:37.892060 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e705a849-8869-4f40-92ae-0b690ba0022f req-b64da458-39e2-4fdc-80ca-8ef74e652a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79692993-f373-4a75-bd13-b7e216a2f7dc", "tag": "125aa08d-af50-4a4e-9390-d93bcbcfc10e"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:36:37.901382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e705a849-8869-4f40-92ae-0b690ba0022f req-b64da458-39e2-4fdc-80ca-8ef74e652a80 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:37.901841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e705a849-8869-4f40-92ae-0b690ba0022f req-b64da458-39e2-4fdc-80ca-8ef74e652a80 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:37.919512 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e705a849-8869-4f40-92ae-0b690ba0022f req-b64da458-39e2-4fdc-80ca-8ef74e652a80 service nova] Creating event network-changed:125aa08d-af50-4a4e-9390-d93bcbcfc10e for instance 79692993-f373-4a75-bd13-b7e216a2f7dc on nch1-master-1 Mar 05 21:36:37.926447 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e705a849-8869-4f40-92ae-0b690ba0022f req-b64da458-39e2-4fdc-80ca-8ef74e652a80 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194841 Mar 05 21:36:37.927461 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3167/6295] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:36:39.169442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-97cb159e-c419-4769-bee8-673b8fa3aaef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:39.170066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-97cb159e-c419-4769-bee8-673b8fa3aaef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:39.176890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-97cb159e-c419-4769-bee8-673b8fa3aaef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:39.177369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-97cb159e-c419-4769-bee8-673b8fa3aaef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:39.178171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-97cb159e-c419-4769-bee8-673b8fa3aaef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:39.178626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-97cb159e-c419-4769-bee8-673b8fa3aaef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:39.241180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9e4d263b-a6e5-472a-b10c-422c5b5b1ff4 req-be0164ce-d2c7-4459-9575-b6f72e57cb10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79692993-f373-4a75-bd13-b7e216a2f7dc", "tag": "125aa08d-af50-4a4e-9390-d93bcbcfc10e"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:36:39.251380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9e4d263b-a6e5-472a-b10c-422c5b5b1ff4 req-be0164ce-d2c7-4459-9575-b6f72e57cb10 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:39.252072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9e4d263b-a6e5-472a-b10c-422c5b5b1ff4 req-be0164ce-d2c7-4459-9575-b6f72e57cb10 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:39.264338 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9e4d263b-a6e5-472a-b10c-422c5b5b1ff4 req-be0164ce-d2c7-4459-9575-b6f72e57cb10 service nova] Creating event network-changed:125aa08d-af50-4a4e-9390-d93bcbcfc10e for instance 79692993-f373-4a75-bd13-b7e216a2f7dc on nch1-master-1 Mar 05 21:36:39.271778 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9e4d263b-a6e5-472a-b10c-422c5b5b1ff4 req-be0164ce-d2c7-4459-9575-b6f72e57cb10 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106268 Mar 05 21:36:39.273083 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3168/6296] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:36:39.275287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-97cb159e-c419-4769-bee8-673b8fa3aaef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lazy-loading 'services' on Instance uuid 79692993-f373-4a75-bd13-b7e216a2f7dc {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:36:39.351287 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-97cb159e-c419-4769-bee8-673b8fa3aaef tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "DELETE /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/os-volume_attachments/8028eb84-fe39-47df-a0d7-e87cb202377c" status: 202 len: 0 microversion: 2.1 time: 0.188031 Mar 05 21:36:39.352104 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3129/6297] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 21:36:39 2022] DELETE /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/os-volume_attachments/8028eb84-fe39-47df-a0d7-e87cb202377c => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:36:39.362001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e089f3af-fa27-45f3-bff1-e5c359668654 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:39.363035 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e089f3af-fa27-45f3-bff1-e5c359668654 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:39.370067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e089f3af-fa27-45f3-bff1-e5c359668654 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:39.370743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e089f3af-fa27-45f3-bff1-e5c359668654 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:39.371734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e089f3af-fa27-45f3-bff1-e5c359668654 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:39.372383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e089f3af-fa27-45f3-bff1-e5c359668654 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:39.413538 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e089f3af-fa27-45f3-bff1-e5c359668654 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055244 Mar 05 21:36:39.414426 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3169/6298] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:36:39 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:36:40.428926 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-25ac13ac-ff75-4a23-9b92-1c0ffcda0b0c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:40.429935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-25ac13ac-ff75-4a23-9b92-1c0ffcda0b0c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:40.437224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25ac13ac-ff75-4a23-9b92-1c0ffcda0b0c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:40.437693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25ac13ac-ff75-4a23-9b92-1c0ffcda0b0c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:40.438484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25ac13ac-ff75-4a23-9b92-1c0ffcda0b0c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:40.438938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25ac13ac-ff75-4a23-9b92-1c0ffcda0b0c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:40.468083 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-25ac13ac-ff75-4a23-9b92-1c0ffcda0b0c tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044455 Mar 05 21:36:40.468652 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3130/6299] 10.222.0.15 () {58 vars in 1301 bytes} [Sat Mar 5 21:36:40 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 21:36:40.479070 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-acd04b0a-8ba9-4df8-ba84-63d1d5c862bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:40.479580 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-acd04b0a-8ba9-4df8-ba84-63d1d5c862bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:40.486335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acd04b0a-8ba9-4df8-ba84-63d1d5c862bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:40.486795 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acd04b0a-8ba9-4df8-ba84-63d1d5c862bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:40.487570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acd04b0a-8ba9-4df8-ba84-63d1d5c862bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:40.488043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-acd04b0a-8ba9-4df8-ba84-63d1d5c862bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:40.564417 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-acd04b0a-8ba9-4df8-ba84-63d1d5c862bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] HTTP exception thrown: Instance 79692993-f373-4a75-bd13-b7e216a2f7dc is not attached to volume 8028eb84-fe39-47df-a0d7-e87cb202377c Mar 05 21:36:40.565040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-acd04b0a-8ba9-4df8-ba84-63d1d5c862bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Returning 404 to user: Instance 79692993-f373-4a75-bd13-b7e216a2f7dc is not attached to volume 8028eb84-fe39-47df-a0d7-e87cb202377c {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:36:40.565937 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-acd04b0a-8ba9-4df8-ba84-63d1d5c862bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "DELETE /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/os-volume_attachments/8028eb84-fe39-47df-a0d7-e87cb202377c" status: 404 len: 154 microversion: 2.1 time: 0.091454 Mar 05 21:36:40.566514 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3170/6300] 10.222.0.15 () {58 vars in 1415 bytes} [Sat Mar 5 21:36:40 2022] DELETE /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc/os-volume_attachments/8028eb84-fe39-47df-a0d7-e87cb202377c => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:36:41.696651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3205bec2-1cd8-40fc-b47f-dada82eb9885 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:41.698003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3205bec2-1cd8-40fc-b47f-dada82eb9885 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:41.704679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3205bec2-1cd8-40fc-b47f-dada82eb9885 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:41.705154 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3205bec2-1cd8-40fc-b47f-dada82eb9885 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:41.705957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3205bec2-1cd8-40fc-b47f-dada82eb9885 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:41.706417 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3205bec2-1cd8-40fc-b47f-dada82eb9885 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:41.730399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3205bec2-1cd8-40fc-b47f-dada82eb9885 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:36:41.804534 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3205bec2-1cd8-40fc-b47f-dada82eb9885 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "DELETE /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 204 len: 0 microversion: 2.1 time: 0.111522 Mar 05 21:36:41.805444 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3131/6301] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:36:41 2022] DELETE /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:36:41.815700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-72aa0132-80d3-4928-8915-3ea79ba34888 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:41.816345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-72aa0132-80d3-4928-8915-3ea79ba34888 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:41.824546 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72aa0132-80d3-4928-8915-3ea79ba34888 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:41.825002 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72aa0132-80d3-4928-8915-3ea79ba34888 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:41.825835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72aa0132-80d3-4928-8915-3ea79ba34888 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:41.826273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-72aa0132-80d3-4928-8915-3ea79ba34888 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:41.964760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-72aa0132-80d3-4928-8915-3ea79ba34888 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:36:41.972210 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-72aa0132-80d3-4928-8915-3ea79ba34888 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1553 microversion: 2.1 time: 0.161888 Mar 05 21:36:41.972805 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3171/6302] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:36:41 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:36:42.989612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ab59c13a-a723-4df0-a865-ddd0793dd7eb tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:42.990357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ab59c13a-a723-4df0-a865-ddd0793dd7eb tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:42.997615 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab59c13a-a723-4df0-a865-ddd0793dd7eb tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:42.998079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab59c13a-a723-4df0-a865-ddd0793dd7eb tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:42.999126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab59c13a-a723-4df0-a865-ddd0793dd7eb tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:42.999578 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ab59c13a-a723-4df0-a865-ddd0793dd7eb tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:43.137486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ab59c13a-a723-4df0-a865-ddd0793dd7eb tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:36:43.145019 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ab59c13a-a723-4df0-a865-ddd0793dd7eb tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1553 microversion: 2.1 time: 0.159696 Mar 05 21:36:43.145526 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3132/6303] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:36:42 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:36:43.913108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-4a1d0af4-7442-4e73-a630-4671ef4192ab req-170b8697-6027-495f-a237-a2c584de73bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79692993-f373-4a75-bd13-b7e216a2f7dc", "name": "network-vif-deleted", "tag": "125aa08d-af50-4a4e-9390-d93bcbcfc10e"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:36:43.923419 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4a1d0af4-7442-4e73-a630-4671ef4192ab req-170b8697-6027-495f-a237-a2c584de73bb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:43.924048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-4a1d0af4-7442-4e73-a630-4671ef4192ab req-170b8697-6027-495f-a237-a2c584de73bb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:43.936564 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-4a1d0af4-7442-4e73-a630-4671ef4192ab req-170b8697-6027-495f-a237-a2c584de73bb service nova] Creating event network-vif-deleted:125aa08d-af50-4a4e-9390-d93bcbcfc10e for instance 79692993-f373-4a75-bd13-b7e216a2f7dc on nch1-master-1 Mar 05 21:36:43.942117 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-4a1d0af4-7442-4e73-a630-4671ef4192ab req-170b8697-6027-495f-a237-a2c584de73bb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032628 Mar 05 21:36:43.943061 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3172/6304] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:36:44.162612 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-db816641-5b34-4cdc-8f4c-6f9daf2be7bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:44.163174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-db816641-5b34-4cdc-8f4c-6f9daf2be7bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:44.170289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db816641-5b34-4cdc-8f4c-6f9daf2be7bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:44.170759 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db816641-5b34-4cdc-8f4c-6f9daf2be7bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:44.171601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db816641-5b34-4cdc-8f4c-6f9daf2be7bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:44.172083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db816641-5b34-4cdc-8f4c-6f9daf2be7bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:44.204533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db816641-5b34-4cdc-8f4c-6f9daf2be7bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:44.205001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db816641-5b34-4cdc-8f4c-6f9daf2be7bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:44.205474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-db816641-5b34-4cdc-8f4c-6f9daf2be7bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lazy-loading 'fault' on Instance uuid 79692993-f373-4a75-bd13-b7e216a2f7dc {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:36:44.246978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-db816641-5b34-4cdc-8f4c-6f9daf2be7bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f2f1f38a5447528d0c5f1162d604c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f0b6da33924ffea363d98139111178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:36:44.255334 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-db816641-5b34-4cdc-8f4c-6f9daf2be7bf tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 200 len: 1347 microversion: 2.1 time: 0.096701 Mar 05 21:36:44.255969 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3133/6305] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:36:44 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 1347 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:36:45.274074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d24c055a-5927-4efe-87e3-90e3b647c174 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:45.274802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d24c055a-5927-4efe-87e3-90e3b647c174 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] [instance: 79692993-f373-4a75-bd13-b7e216a2f7dc] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:36:45.281708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d24c055a-5927-4efe-87e3-90e3b647c174 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:45.282173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d24c055a-5927-4efe-87e3-90e3b647c174 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:45.282965 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d24c055a-5927-4efe-87e3-90e3b647c174 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:36:45.283421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d24c055a-5927-4efe-87e3-90e3b647c174 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:36:45.297271 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-d24c055a-5927-4efe-87e3-90e3b647c174 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] HTTP exception thrown: Instance 79692993-f373-4a75-bd13-b7e216a2f7dc could not be found. Mar 05 21:36:45.297880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d24c055a-5927-4efe-87e3-90e3b647c174 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Returning 404 to user: Instance 79692993-f373-4a75-bd13-b7e216a2f7dc could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:36:45.298756 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d24c055a-5927-4efe-87e3-90e3b647c174 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc" status: 404 len: 111 microversion: 2.1 time: 0.030038 Mar 05 21:36:45.299301 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3173/6306] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:36:45 2022] GET /compute/v2.1/servers/79692993-f373-4a75-bd13-b7e216a2f7dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:36:45.307525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1613bb5a-6150-44ec-a62a-b7f795117e37 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] Calling method '.version_select at 0x7fed5c59d670>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:36:45.325750 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1613bb5a-6150-44ec-a62a-b7f795117e37 tempest-TestMinimumBasicScenario-1143423445 tempest-TestMinimumBasicScenario-1143423445-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1314714622" status: 202 len: 0 microversion: 2.1 time: 0.022060 Mar 05 21:36:45.326317 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3134/6307] 10.222.0.15 () {58 vars in 1271 bytes} [Sat Mar 5 21:36:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1314714622 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:36:52.341250 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:36:52.341813 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 21:36:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:36:52.352580 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:36:52.353199 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 21:36:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:36:54.769240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-68dc6a7b-2a59-45ce-ab6b-39b64f0edcdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'create', calling method: .version_select at 0x7fed4f78ab80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-885055342"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:36:54.783886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-68dc6a7b-2a59-45ce-ab6b-39b64f0edcdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:36:54.788978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-68dc6a7b-2a59-45ce-ab6b-39b64f0edcdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:36:54.877323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-68dc6a7b-2a59-45ce-ab6b-39b64f0edcdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:36:54.882340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-68dc6a7b-2a59-45ce-ab6b-39b64f0edcdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:36:54.897654 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-68dc6a7b-2a59-45ce-ab6b-39b64f0edcdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.291296 Mar 05 21:36:54.898270 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3174/6308] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:36:54 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:00.580823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1409196395", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "4e191c7a-99ab-442e-8a85-bb96b09425ba"}], "key_name": "tempest-TestNetworkAdvancedServerOps-885055342", "security_groups": [{"name": "tempest-secgroup-smoke-1400683402"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:37:00.707523 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] validate_networks() for [('4e191c7a-99ab-442e-8a85-bb96b09425ba', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:37:01.262469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:37:01.262956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:37:01.263460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:37:01.264161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:37:01.264607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:37:01.283142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:01.284560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:01.285197 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:01.285890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:01.319434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:37:01.325806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:37:01.341828 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:37:01.344389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:37:01.396659 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2a088295-3bbb-4262-9d8a-008803f43c90 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.819702 Mar 05 21:37:01.402859 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3135/6309] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:37:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:37:01.413706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bc401b5b-863a-4280-b950-c4ba371ca6c9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:01.415142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bc401b5b-863a-4280-b950-c4ba371ca6c9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:01.496927 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bc401b5b-863a-4280-b950-c4ba371ca6c9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:01.505709 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bc401b5b-863a-4280-b950-c4ba371ca6c9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1266 microversion: 2.1 time: 0.101408 Mar 05 21:37:01.516018 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3175/6310] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:01 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:02.523430 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-34796fad-f742-4c56-b4fc-bb2b3aa3df91 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:02.524192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-34796fad-f742-4c56-b4fc-bb2b3aa3df91 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:02.531391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-34796fad-f742-4c56-b4fc-bb2b3aa3df91 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:02.531894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-34796fad-f742-4c56-b4fc-bb2b3aa3df91 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:02.532901 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-34796fad-f742-4c56-b4fc-bb2b3aa3df91 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:02.533551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-34796fad-f742-4c56-b4fc-bb2b3aa3df91 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:02.603534 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-34796fad-f742-4c56-b4fc-bb2b3aa3df91 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:02.612298 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-34796fad-f742-4c56-b4fc-bb2b3aa3df91 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1318 microversion: 2.1 time: 0.093655 Mar 05 21:37:02.612907 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3136/6311] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:02 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1318 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:03.638353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f2e857f6-d5d7-4cb4-9a71-2e392b45397c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:03.639452 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f2e857f6-d5d7-4cb4-9a71-2e392b45397c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:03.653860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2e857f6-d5d7-4cb4-9a71-2e392b45397c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:03.654688 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2e857f6-d5d7-4cb4-9a71-2e392b45397c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:03.656354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2e857f6-d5d7-4cb4-9a71-2e392b45397c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:03.658455 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2e857f6-d5d7-4cb4-9a71-2e392b45397c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:03.835105 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f2e857f6-d5d7-4cb4-9a71-2e392b45397c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:03.845544 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f2e857f6-d5d7-4cb4-9a71-2e392b45397c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1392 microversion: 2.1 time: 0.218199 Mar 05 21:37:03.846732 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3176/6312] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:03 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1392 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:04.320029 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b36ce81c-52fd-4d09-a37f-524937bde914 req-bcf33842-0307-4e44-b4cd-ef76254513e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42350677-f1bf-4866-84d6-223673f5f272", "tag": "3dce304a-df1e-4e37-ac70-c247e4c082cc"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:37:04.333472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b36ce81c-52fd-4d09-a37f-524937bde914 req-bcf33842-0307-4e44-b4cd-ef76254513e5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:04.334118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b36ce81c-52fd-4d09-a37f-524937bde914 req-bcf33842-0307-4e44-b4cd-ef76254513e5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:04.346354 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-b36ce81c-52fd-4d09-a37f-524937bde914 req-bcf33842-0307-4e44-b4cd-ef76254513e5 service nova] Creating event network-changed:3dce304a-df1e-4e37-ac70-c247e4c082cc for instance 42350677-f1bf-4866-84d6-223673f5f272 on nch2-master-1 Mar 05 21:37:04.352018 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b36ce81c-52fd-4d09-a37f-524937bde914 req-bcf33842-0307-4e44-b4cd-ef76254513e5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038147 Mar 05 21:37:04.353492 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3137/6313] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:37:04.863009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-17d13406-a19b-4458-a9a8-0d6da6378cdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:04.863956 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-17d13406-a19b-4458-a9a8-0d6da6378cdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:04.871213 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17d13406-a19b-4458-a9a8-0d6da6378cdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:04.871782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17d13406-a19b-4458-a9a8-0d6da6378cdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:04.872569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17d13406-a19b-4458-a9a8-0d6da6378cdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:04.873008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-17d13406-a19b-4458-a9a8-0d6da6378cdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:05.029233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-17d13406-a19b-4458-a9a8-0d6da6378cdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:05.036960 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-17d13406-a19b-4458-a9a8-0d6da6378cdf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1392 microversion: 2.1 time: 0.177834 Mar 05 21:37:05.037555 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3177/6314] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:04 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:06.055702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-68f5444b-9275-43fa-b491-4ebe517f8739 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:06.056365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-68f5444b-9275-43fa-b491-4ebe517f8739 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:06.063559 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68f5444b-9275-43fa-b491-4ebe517f8739 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:06.064070 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68f5444b-9275-43fa-b491-4ebe517f8739 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:06.064883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68f5444b-9275-43fa-b491-4ebe517f8739 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:06.065329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-68f5444b-9275-43fa-b491-4ebe517f8739 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:06.199198 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-68f5444b-9275-43fa-b491-4ebe517f8739 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:06.206656 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-68f5444b-9275-43fa-b491-4ebe517f8739 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1392 microversion: 2.1 time: 0.156164 Mar 05 21:37:06.207243 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3138/6315] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:06 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:07.223830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-efbc296e-a4fd-46cf-b2fe-c56c904a249a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:07.224576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-efbc296e-a4fd-46cf-b2fe-c56c904a249a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:07.231383 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efbc296e-a4fd-46cf-b2fe-c56c904a249a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:07.231879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efbc296e-a4fd-46cf-b2fe-c56c904a249a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:07.232664 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efbc296e-a4fd-46cf-b2fe-c56c904a249a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:07.233115 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-efbc296e-a4fd-46cf-b2fe-c56c904a249a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:07.372908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-efbc296e-a4fd-46cf-b2fe-c56c904a249a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:07.380747 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-efbc296e-a4fd-46cf-b2fe-c56c904a249a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1392 microversion: 2.1 time: 0.160787 Mar 05 21:37:07.381320 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3178/6316] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:07 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:08.398055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-25c604ab-f981-49e1-a9d1-62306d187831 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:08.398728 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-25c604ab-f981-49e1-a9d1-62306d187831 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:08.405807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25c604ab-f981-49e1-a9d1-62306d187831 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:08.406228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25c604ab-f981-49e1-a9d1-62306d187831 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:08.407023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25c604ab-f981-49e1-a9d1-62306d187831 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:08.407486 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-25c604ab-f981-49e1-a9d1-62306d187831 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:08.544393 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-25c604ab-f981-49e1-a9d1-62306d187831 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:08.551662 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-25c604ab-f981-49e1-a9d1-62306d187831 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1392 microversion: 2.1 time: 0.157562 Mar 05 21:37:08.552267 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3139/6317] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:08 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:09.569587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-062a9317-15fe-45c0-b88f-7d3f2b8285cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:09.570220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-062a9317-15fe-45c0-b88f-7d3f2b8285cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:09.577132 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-062a9317-15fe-45c0-b88f-7d3f2b8285cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:09.577596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-062a9317-15fe-45c0-b88f-7d3f2b8285cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:09.578380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-062a9317-15fe-45c0-b88f-7d3f2b8285cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:09.578826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-062a9317-15fe-45c0-b88f-7d3f2b8285cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:09.716151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-062a9317-15fe-45c0-b88f-7d3f2b8285cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:09.723577 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-062a9317-15fe-45c0-b88f-7d3f2b8285cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1392 microversion: 2.1 time: 0.158111 Mar 05 21:37:09.724182 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3179/6318] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:09 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:10.741169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fe602099-fdeb-4ef4-80ac-025f65e94ebd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:10.741799 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fe602099-fdeb-4ef4-80ac-025f65e94ebd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:10.749300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe602099-fdeb-4ef4-80ac-025f65e94ebd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:10.749769 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe602099-fdeb-4ef4-80ac-025f65e94ebd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:10.750550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe602099-fdeb-4ef4-80ac-025f65e94ebd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:10.751002 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fe602099-fdeb-4ef4-80ac-025f65e94ebd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:10.884118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fe602099-fdeb-4ef4-80ac-025f65e94ebd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:10.892129 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fe602099-fdeb-4ef4-80ac-025f65e94ebd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1392 microversion: 2.1 time: 0.154872 Mar 05 21:37:10.892718 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3140/6319] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:10 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:11.493793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-73f3634e-70c9-4f87-9ec6-bcef03aa42e3 req-50fa1430-a37b-4287-bd47-669f2b21f86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42350677-f1bf-4866-84d6-223673f5f272", "name": "network-vif-plugged", "status": "completed", "tag": "3dce304a-df1e-4e37-ac70-c247e4c082cc"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:37:11.502279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-73f3634e-70c9-4f87-9ec6-bcef03aa42e3 req-50fa1430-a37b-4287-bd47-669f2b21f86d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:11.502726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-73f3634e-70c9-4f87-9ec6-bcef03aa42e3 req-50fa1430-a37b-4287-bd47-669f2b21f86d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:11.516140 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-73f3634e-70c9-4f87-9ec6-bcef03aa42e3 req-50fa1430-a37b-4287-bd47-669f2b21f86d service nova] Creating event network-vif-plugged:3dce304a-df1e-4e37-ac70-c247e4c082cc for instance 42350677-f1bf-4866-84d6-223673f5f272 on nch2-master-1 Mar 05 21:37:11.521190 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-73f3634e-70c9-4f87-9ec6-bcef03aa42e3 req-50fa1430-a37b-4287-bd47-669f2b21f86d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094194 Mar 05 21:37:11.521792 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3180/6320] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:37:11.909411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ec8dcf57-3034-4207-b7ea-530abddb223e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:11.911090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ec8dcf57-3034-4207-b7ea-530abddb223e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:11.918216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec8dcf57-3034-4207-b7ea-530abddb223e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:11.918832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec8dcf57-3034-4207-b7ea-530abddb223e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:11.919465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec8dcf57-3034-4207-b7ea-530abddb223e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:11.919963 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ec8dcf57-3034-4207-b7ea-530abddb223e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:12.054215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ec8dcf57-3034-4207-b7ea-530abddb223e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:12.062129 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ec8dcf57-3034-4207-b7ea-530abddb223e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1392 microversion: 2.1 time: 0.156617 Mar 05 21:37:12.062709 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3141/6321] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:11 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:13.079603 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-02e963e6-a3e4-4265-8054-a691ba53ea57 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:13.080331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-02e963e6-a3e4-4265-8054-a691ba53ea57 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:13.087310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02e963e6-a3e4-4265-8054-a691ba53ea57 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:13.087802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02e963e6-a3e4-4265-8054-a691ba53ea57 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:13.088575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02e963e6-a3e4-4265-8054-a691ba53ea57 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:13.089017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02e963e6-a3e4-4265-8054-a691ba53ea57 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:13.228920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-02e963e6-a3e4-4265-8054-a691ba53ea57 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:13.236952 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-02e963e6-a3e4-4265-8054-a691ba53ea57 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1564 microversion: 2.1 time: 0.161509 Mar 05 21:37:13.237525 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3181/6322] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:13 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:13.254338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5da0801a-9f1d-45d1-99e5-e15b9497086e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:13.254974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5da0801a-9f1d-45d1-99e5-e15b9497086e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:13.262570 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5da0801a-9f1d-45d1-99e5-e15b9497086e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:13.263044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5da0801a-9f1d-45d1-99e5-e15b9497086e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:13.263878 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5da0801a-9f1d-45d1-99e5-e15b9497086e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:13.264338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5da0801a-9f1d-45d1-99e5-e15b9497086e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:13.398130 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5da0801a-9f1d-45d1-99e5-e15b9497086e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:13.406372 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5da0801a-9f1d-45d1-99e5-e15b9497086e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1564 microversion: 2.1 time: 0.155908 Mar 05 21:37:13.406947 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3142/6323] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:13 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:15.332122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b35c3f89-0d7a-4444-b776-ae10b6ae6531 req-dae7c230-2023-4017-86d7-f51e6b1b0a31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42350677-f1bf-4866-84d6-223673f5f272", "tag": "3dce304a-df1e-4e37-ac70-c247e4c082cc"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:37:15.336110 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-aceba54f-b161-4bb0-9303-dda1158b3871 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:15.336826 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-aceba54f-b161-4bb0-9303-dda1158b3871 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:15.349148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aceba54f-b161-4bb0-9303-dda1158b3871 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:15.349893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aceba54f-b161-4bb0-9303-dda1158b3871 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:15.350899 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b35c3f89-0d7a-4444-b776-ae10b6ae6531 req-dae7c230-2023-4017-86d7-f51e6b1b0a31 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:15.351063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aceba54f-b161-4bb0-9303-dda1158b3871 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:15.351367 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b35c3f89-0d7a-4444-b776-ae10b6ae6531 req-dae7c230-2023-4017-86d7-f51e6b1b0a31 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:15.351512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-aceba54f-b161-4bb0-9303-dda1158b3871 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:15.366776 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-b35c3f89-0d7a-4444-b776-ae10b6ae6531 req-dae7c230-2023-4017-86d7-f51e6b1b0a31 service nova] Creating event network-changed:3dce304a-df1e-4e37-ac70-c247e4c082cc for instance 42350677-f1bf-4866-84d6-223673f5f272 on nch2-master-1 Mar 05 21:37:15.372684 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b35c3f89-0d7a-4444-b776-ae10b6ae6531 req-dae7c230-2023-4017-86d7-f51e6b1b0a31 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043757 Mar 05 21:37:15.374284 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3143/6324] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:37:15.499303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-aceba54f-b161-4bb0-9303-dda1158b3871 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:15.507137 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-aceba54f-b161-4bb0-9303-dda1158b3871 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1564 microversion: 2.1 time: 0.182120 Mar 05 21:37:15.508154 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3182/6325] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:15 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:36.775207 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-21f11b5a-5277-42ca-a13e-3579379535c1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:37:36.776261 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-21f11b5a-5277-42ca-a13e-3579379535c1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:36.783001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21f11b5a-5277-42ca-a13e-3579379535c1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:36.783478 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21f11b5a-5277-42ca-a13e-3579379535c1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:36.784298 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21f11b5a-5277-42ca-a13e-3579379535c1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:36.784758 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-21f11b5a-5277-42ca-a13e-3579379535c1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:36.834335 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-21f11b5a-5277-42ca-a13e-3579379535c1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272/action" status: 200 len: 24541 microversion: 2.1 time: 0.064240 Mar 05 21:37:36.835001 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3144/6326] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:37:36 2022] POST /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272/action => generated 24541 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:37:47.853281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2b6da09d-c9e0-4455-bc09-6f7edf2ac3a4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:37:47.853887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2b6da09d-c9e0-4455-bc09-6f7edf2ac3a4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:47.860262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b6da09d-c9e0-4455-bc09-6f7edf2ac3a4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:47.860721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b6da09d-c9e0-4455-bc09-6f7edf2ac3a4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:47.861492 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b6da09d-c9e0-4455-bc09-6f7edf2ac3a4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:47.861934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2b6da09d-c9e0-4455-bc09-6f7edf2ac3a4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:47.928701 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2b6da09d-c9e0-4455-bc09-6f7edf2ac3a4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272/action" status: 202 len: 0 microversion: 2.1 time: 0.079358 Mar 05 21:37:47.929554 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3183/6327] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:37:47 2022] POST /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:37:47.938858 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-81f897c2-2d1a-442d-8a5f-f74b9d09b5bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:47.939573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-81f897c2-2d1a-442d-8a5f-f74b9d09b5bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:47.947028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81f897c2-2d1a-442d-8a5f-f74b9d09b5bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:47.947525 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81f897c2-2d1a-442d-8a5f-f74b9d09b5bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:47.948322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81f897c2-2d1a-442d-8a5f-f74b9d09b5bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:47.948775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-81f897c2-2d1a-442d-8a5f-f74b9d09b5bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:48.091867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-81f897c2-2d1a-442d-8a5f-f74b9d09b5bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:48.100136 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-81f897c2-2d1a-442d-8a5f-f74b9d09b5bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1688 microversion: 2.1 time: 0.165883 Mar 05 21:37:48.101083 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3145/6328] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:47 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:49.118946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-18de8125-af79-4909-a64f-b0a11d76ec26 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:49.119654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-18de8125-af79-4909-a64f-b0a11d76ec26 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:49.127727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18de8125-af79-4909-a64f-b0a11d76ec26 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:49.128196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18de8125-af79-4909-a64f-b0a11d76ec26 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:49.128963 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18de8125-af79-4909-a64f-b0a11d76ec26 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:49.129405 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18de8125-af79-4909-a64f-b0a11d76ec26 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:49.263360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-18de8125-af79-4909-a64f-b0a11d76ec26 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:49.270732 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-18de8125-af79-4909-a64f-b0a11d76ec26 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1668 microversion: 2.1 time: 0.156080 Mar 05 21:37:49.271303 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3184/6329] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:49 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:50.359753 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2bd8d437-4a65-45d9-8644-9d244805ae7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:37:50.360761 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2bd8d437-4a65-45d9-8644-9d244805ae7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:50.367648 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2bd8d437-4a65-45d9-8644-9d244805ae7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:50.368145 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2bd8d437-4a65-45d9-8644-9d244805ae7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:50.368934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2bd8d437-4a65-45d9-8644-9d244805ae7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:50.369386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2bd8d437-4a65-45d9-8644-9d244805ae7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:50.418627 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2bd8d437-4a65-45d9-8644-9d244805ae7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272/action" status: 200 len: 32615 microversion: 2.1 time: 0.062824 Mar 05 21:37:50.419385 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3146/6330] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:37:50 2022] POST /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272/action => generated 32615 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:37:50.430348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-762e5634-62b2-4ffb-8872-1e89ad4c66e7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:37:50.430893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-762e5634-62b2-4ffb-8872-1e89ad4c66e7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:50.438441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-762e5634-62b2-4ffb-8872-1e89ad4c66e7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:50.438892 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-762e5634-62b2-4ffb-8872-1e89ad4c66e7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:50.439660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-762e5634-62b2-4ffb-8872-1e89ad4c66e7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:50.440134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-762e5634-62b2-4ffb-8872-1e89ad4c66e7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:50.503796 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-762e5634-62b2-4ffb-8872-1e89ad4c66e7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272/action" status: 202 len: 0 microversion: 2.1 time: 0.077173 Mar 05 21:37:50.504504 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3185/6331] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:37:50 2022] POST /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:37:50.513864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-92f5e941-88d9-4bf9-a7de-2c140591dcc8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:50.514586 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-92f5e941-88d9-4bf9-a7de-2c140591dcc8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:50.521737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92f5e941-88d9-4bf9-a7de-2c140591dcc8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:50.522128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92f5e941-88d9-4bf9-a7de-2c140591dcc8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:50.523037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92f5e941-88d9-4bf9-a7de-2c140591dcc8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:50.523508 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-92f5e941-88d9-4bf9-a7de-2c140591dcc8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:50.675698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-92f5e941-88d9-4bf9-a7de-2c140591dcc8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:50.683863 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-92f5e941-88d9-4bf9-a7de-2c140591dcc8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1675 microversion: 2.1 time: 0.174832 Mar 05 21:37:50.685603 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3147/6332] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:50 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:37:51.705758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-00b7e4f3-b6bc-46d3-bf3e-ff24a3cdf311 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:51.706760 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-00b7e4f3-b6bc-46d3-bf3e-ff24a3cdf311 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:51.713689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00b7e4f3-b6bc-46d3-bf3e-ff24a3cdf311 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:51.714483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00b7e4f3-b6bc-46d3-bf3e-ff24a3cdf311 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:51.715287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00b7e4f3-b6bc-46d3-bf3e-ff24a3cdf311 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:51.715779 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00b7e4f3-b6bc-46d3-bf3e-ff24a3cdf311 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:51.870468 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-00b7e4f3-b6bc-46d3-bf3e-ff24a3cdf311 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:51.878757 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-00b7e4f3-b6bc-46d3-bf3e-ff24a3cdf311 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1683 microversion: 2.1 time: 0.179247 Mar 05 21:37:51.879335 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3186/6333] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:51 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:51.975106 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-45f8463b-e1b8-4b08-981d-2eed5d4d5b8b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:37:51.976112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-45f8463b-e1b8-4b08-981d-2eed5d4d5b8b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:51.983833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45f8463b-e1b8-4b08-981d-2eed5d4d5b8b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:51.984304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45f8463b-e1b8-4b08-981d-2eed5d4d5b8b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:51.985096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45f8463b-e1b8-4b08-981d-2eed5d4d5b8b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:51.985599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-45f8463b-e1b8-4b08-981d-2eed5d4d5b8b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:52.037124 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-45f8463b-e1b8-4b08-981d-2eed5d4d5b8b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272/action" status: 200 len: 38367 microversion: 2.1 time: 0.065795 Mar 05 21:37:52.037783 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3148/6334] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:37:51 2022] POST /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272/action => generated 38367 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:37:53.335230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0cb33f50-9184-42ec-8b51-c07cf4cbd1dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:53.335844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0cb33f50-9184-42ec-8b51-c07cf4cbd1dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:53.336302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7c085389-9bba-4e8f-add5-7689ac51f4b7 req-cf740fa8-33b1-43e9-b8b8-b183b3a0560c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42350677-f1bf-4866-84d6-223673f5f272", "tag": "3dce304a-df1e-4e37-ac70-c247e4c082cc"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:37:53.343429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cb33f50-9184-42ec-8b51-c07cf4cbd1dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:53.343926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cb33f50-9184-42ec-8b51-c07cf4cbd1dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:53.344723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cb33f50-9184-42ec-8b51-c07cf4cbd1dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:53.345366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0cb33f50-9184-42ec-8b51-c07cf4cbd1dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:53.346248 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7c085389-9bba-4e8f-add5-7689ac51f4b7 req-cf740fa8-33b1-43e9-b8b8-b183b3a0560c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:53.346946 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7c085389-9bba-4e8f-add5-7689ac51f4b7 req-cf740fa8-33b1-43e9-b8b8-b183b3a0560c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:53.361955 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7c085389-9bba-4e8f-add5-7689ac51f4b7 req-cf740fa8-33b1-43e9-b8b8-b183b3a0560c service nova] Creating event network-changed:3dce304a-df1e-4e37-ac70-c247e4c082cc for instance 42350677-f1bf-4866-84d6-223673f5f272 on nch2-master-1 Mar 05 21:37:53.369133 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7c085389-9bba-4e8f-add5-7689ac51f4b7 req-cf740fa8-33b1-43e9-b8b8-b183b3a0560c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036959 Mar 05 21:37:53.370432 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3149/6335] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:37:53.374782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0cb33f50-9184-42ec-8b51-c07cf4cbd1dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:37:53.459707 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0cb33f50-9184-42ec-8b51-c07cf4cbd1dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "DELETE /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 204 len: 0 microversion: 2.1 time: 0.129457 Mar 05 21:37:53.464451 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3187/6336] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:37:53 2022] DELETE /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:37:53.475626 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ecd24404-d427-4ef9-bfa6-ebf13afee2c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:53.477231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ecd24404-d427-4ef9-bfa6-ebf13afee2c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:53.484711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ecd24404-d427-4ef9-bfa6-ebf13afee2c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:53.485483 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ecd24404-d427-4ef9-bfa6-ebf13afee2c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:53.486550 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ecd24404-d427-4ef9-bfa6-ebf13afee2c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:53.487234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ecd24404-d427-4ef9-bfa6-ebf13afee2c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:53.732924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ecd24404-d427-4ef9-bfa6-ebf13afee2c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:53.742556 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ecd24404-d427-4ef9-bfa6-ebf13afee2c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1689 microversion: 2.1 time: 0.276192 Mar 05 21:37:53.767308 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3150/6337] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:53 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1689 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:54.761142 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-41b1700a-4b9b-41b1-a31d-53939efee6b9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:54.761854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-41b1700a-4b9b-41b1-a31d-53939efee6b9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:54.768701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41b1700a-4b9b-41b1-a31d-53939efee6b9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:54.769154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41b1700a-4b9b-41b1-a31d-53939efee6b9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:54.769922 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41b1700a-4b9b-41b1-a31d-53939efee6b9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:54.770360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-41b1700a-4b9b-41b1-a31d-53939efee6b9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:54.911399 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-41b1700a-4b9b-41b1-a31d-53939efee6b9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:37:54.920210 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-41b1700a-4b9b-41b1-a31d-53939efee6b9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 200 len: 1570 microversion: 2.1 time: 0.162160 Mar 05 21:37:54.920812 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3188/6338] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:54 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:37:55.472795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-1ed6f29a-e461-4805-9097-4695827af0b8 req-26c2c74d-d575-4052-9018-c1fa94bcbc7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42350677-f1bf-4866-84d6-223673f5f272", "name": "network-vif-deleted", "tag": "3dce304a-df1e-4e37-ac70-c247e4c082cc"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:37:55.481183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1ed6f29a-e461-4805-9097-4695827af0b8 req-26c2c74d-d575-4052-9018-c1fa94bcbc7a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:55.482186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1ed6f29a-e461-4805-9097-4695827af0b8 req-26c2c74d-d575-4052-9018-c1fa94bcbc7a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:55.493990 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-1ed6f29a-e461-4805-9097-4695827af0b8 req-26c2c74d-d575-4052-9018-c1fa94bcbc7a service nova] Creating event network-vif-deleted:3dce304a-df1e-4e37-ac70-c247e4c082cc for instance 42350677-f1bf-4866-84d6-223673f5f272 on nch2-master-1 Mar 05 21:37:55.500231 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-1ed6f29a-e461-4805-9097-4695827af0b8 req-26c2c74d-d575-4052-9018-c1fa94bcbc7a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031072 Mar 05 21:37:55.500835 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3151/6339] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:37:55.938390 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-158fa392-64d4-418d-9390-fdcbc89607d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:55.939015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-158fa392-64d4-418d-9390-fdcbc89607d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 42350677-f1bf-4866-84d6-223673f5f272] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:37:55.945427 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-158fa392-64d4-418d-9390-fdcbc89607d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:55.945890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-158fa392-64d4-418d-9390-fdcbc89607d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:55.946676 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-158fa392-64d4-418d-9390-fdcbc89607d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:37:55.947119 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-158fa392-64d4-418d-9390-fdcbc89607d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:37:55.961569 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-158fa392-64d4-418d-9390-fdcbc89607d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] HTTP exception thrown: Instance 42350677-f1bf-4866-84d6-223673f5f272 could not be found. Mar 05 21:37:55.962169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-158fa392-64d4-418d-9390-fdcbc89607d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Returning 404 to user: Instance 42350677-f1bf-4866-84d6-223673f5f272 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:37:55.962998 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-158fa392-64d4-418d-9390-fdcbc89607d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272" status: 404 len: 111 microversion: 2.1 time: 0.029423 Mar 05 21:37:55.963542 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3189/6340] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:37:55 2022] GET /compute/v2.1/servers/42350677-f1bf-4866-84d6-223673f5f272 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:37:58.996935 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d0775839-a2c9-4950-bb3d-017d221e9427 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '.version_select at 0x7fed4ff404c0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:37:59.022532 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d0775839-a2c9-4950-bb3d-017d221e9427 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-885055342" status: 202 len: 0 microversion: 2.1 time: 0.030993 Mar 05 21:37:59.023435 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3152/6341] 10.222.0.15 () {58 vars in 1280 bytes} [Sat Mar 5 21:37:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-885055342 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:37:59.043156 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-edf132f0-2a40-4060-a503-b3e90967296a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'create', calling method: .version_select at 0x7fed5c69e040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2080375555"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:37:59.062606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-edf132f0-2a40-4060-a503-b3e90967296a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:37:59.067890 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-edf132f0-2a40-4060-a503-b3e90967296a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:37:59.336910 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-edf132f0-2a40-4060-a503-b3e90967296a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:37:59.342424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-edf132f0-2a40-4060-a503-b3e90967296a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:37:59.357643 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-edf132f0-2a40-4060-a503-b3e90967296a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.319078 Mar 05 21:37:59.358344 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3190/6342] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:37:59 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:04.856880 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1168460119", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "ace111f7-3a67-4800-aa3e-9d7781364954"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2080375555", "security_groups": [{"name": "tempest-secgroup-smoke-1758699509"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:38:04.972253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] validate_networks() for [('ace111f7-3a67-4800-aa3e-9d7781364954', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:38:05.482714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:38:05.483310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:38:05.483912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:38:05.484339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:38:05.484852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:38:05.494689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:05.495216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:05.496063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:05.497128 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:05.515406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:38:05.520764 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:38:05.533755 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:38:05.536192 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:38:05.586208 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d2930afa-4c6a-4e61-a656-e0b3d5114d77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.734982 Mar 05 21:38:05.587244 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3153/6343] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:38:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:38:05.598215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8c8954b1-05b1-4c2c-8a8d-871b90515d26 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:05.598838 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8c8954b1-05b1-4c2c-8a8d-871b90515d26 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:05.665762 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8c8954b1-05b1-4c2c-8a8d-871b90515d26 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:05.675141 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8c8954b1-05b1-4c2c-8a8d-871b90515d26 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1267 microversion: 2.1 time: 0.081775 Mar 05 21:38:05.675965 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3191/6344] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:05 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:38:06.694414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c113d3ce-ed0c-4915-9903-71c312874000 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:06.695756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c113d3ce-ed0c-4915-9903-71c312874000 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:06.718100 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c113d3ce-ed0c-4915-9903-71c312874000 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:06.719096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c113d3ce-ed0c-4915-9903-71c312874000 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:06.720065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c113d3ce-ed0c-4915-9903-71c312874000 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:06.720520 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c113d3ce-ed0c-4915-9903-71c312874000 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:07.178289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c113d3ce-ed0c-4915-9903-71c312874000 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:07.186819 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c113d3ce-ed0c-4915-9903-71c312874000 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1327 microversion: 2.1 time: 0.497358 Mar 05 21:38:07.187646 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3154/6345] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:06 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1327 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:08.204220 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2733fdcd-22f0-41aa-a6c9-f78095c8c332 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:08.204857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2733fdcd-22f0-41aa-a6c9-f78095c8c332 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:08.212816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2733fdcd-22f0-41aa-a6c9-f78095c8c332 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:08.213266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2733fdcd-22f0-41aa-a6c9-f78095c8c332 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:08.214042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2733fdcd-22f0-41aa-a6c9-f78095c8c332 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:08.214482 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2733fdcd-22f0-41aa-a6c9-f78095c8c332 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:08.375634 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2733fdcd-22f0-41aa-a6c9-f78095c8c332 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:08.383972 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2733fdcd-22f0-41aa-a6c9-f78095c8c332 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1393 microversion: 2.1 time: 0.184366 Mar 05 21:38:08.384618 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3192/6346] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:08 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1393 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:08.621121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f1488f72-32cb-4961-a865-22e3a8db0db2 req-dba7dd25-5c8a-4f3a-911e-e64b103c066d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c64959c1-0a8e-4efa-a248-f9bd6c79ae52", "tag": "d42248b8-2304-4d94-99a1-5245cc3c4391"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:38:08.635905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f1488f72-32cb-4961-a865-22e3a8db0db2 req-dba7dd25-5c8a-4f3a-911e-e64b103c066d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:08.636363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f1488f72-32cb-4961-a865-22e3a8db0db2 req-dba7dd25-5c8a-4f3a-911e-e64b103c066d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:08.656388 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f1488f72-32cb-4961-a865-22e3a8db0db2 req-dba7dd25-5c8a-4f3a-911e-e64b103c066d service nova] Creating event network-changed:d42248b8-2304-4d94-99a1-5245cc3c4391 for instance c64959c1-0a8e-4efa-a248-f9bd6c79ae52 on nch2-master-1 Mar 05 21:38:08.661979 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f1488f72-32cb-4961-a865-22e3a8db0db2 req-dba7dd25-5c8a-4f3a-911e-e64b103c066d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044773 Mar 05 21:38:08.662938 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3155/6347] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:38:09.401549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5d65e330-52d6-492d-ad27-612973e4c97e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:09.402275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5d65e330-52d6-492d-ad27-612973e4c97e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:09.409878 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d65e330-52d6-492d-ad27-612973e4c97e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:09.410439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d65e330-52d6-492d-ad27-612973e4c97e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:09.411298 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d65e330-52d6-492d-ad27-612973e4c97e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:09.411863 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5d65e330-52d6-492d-ad27-612973e4c97e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:09.551807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5d65e330-52d6-492d-ad27-612973e4c97e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:09.560079 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5d65e330-52d6-492d-ad27-612973e4c97e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1393 microversion: 2.1 time: 0.161769 Mar 05 21:38:09.560988 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3193/6348] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:09 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:10.579442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8eff660f-2efc-499b-a650-4e5486580ae7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:10.580042 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8eff660f-2efc-499b-a650-4e5486580ae7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:10.586060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8eff660f-2efc-499b-a650-4e5486580ae7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:10.586529 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8eff660f-2efc-499b-a650-4e5486580ae7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:10.587313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8eff660f-2efc-499b-a650-4e5486580ae7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:10.587796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8eff660f-2efc-499b-a650-4e5486580ae7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:10.721455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8eff660f-2efc-499b-a650-4e5486580ae7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:10.728827 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8eff660f-2efc-499b-a650-4e5486580ae7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1393 microversion: 2.1 time: 0.155652 Mar 05 21:38:10.729415 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3156/6349] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:10 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:11.745691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1147d205-16ee-44af-b7ff-b53680fd240e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:11.746529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1147d205-16ee-44af-b7ff-b53680fd240e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:11.753708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1147d205-16ee-44af-b7ff-b53680fd240e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:11.754169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1147d205-16ee-44af-b7ff-b53680fd240e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:11.754944 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1147d205-16ee-44af-b7ff-b53680fd240e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:11.755384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1147d205-16ee-44af-b7ff-b53680fd240e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:11.901701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1147d205-16ee-44af-b7ff-b53680fd240e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:11.910885 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1147d205-16ee-44af-b7ff-b53680fd240e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1393 microversion: 2.1 time: 0.169078 Mar 05 21:38:11.911605 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3194/6350] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:11 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:12.928165 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3e0c3a64-dd7d-4578-b605-dc7235cc9fbc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:12.928805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3e0c3a64-dd7d-4578-b605-dc7235cc9fbc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:12.936401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e0c3a64-dd7d-4578-b605-dc7235cc9fbc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:12.936875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e0c3a64-dd7d-4578-b605-dc7235cc9fbc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:12.937666 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e0c3a64-dd7d-4578-b605-dc7235cc9fbc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:12.938122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e0c3a64-dd7d-4578-b605-dc7235cc9fbc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:13.077037 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3e0c3a64-dd7d-4578-b605-dc7235cc9fbc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:13.084419 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3e0c3a64-dd7d-4578-b605-dc7235cc9fbc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1393 microversion: 2.1 time: 0.160246 Mar 05 21:38:13.084998 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3157/6351] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:12 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:13.710034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-3edd3c55-087a-404c-97d9-21df5b1d4c02 req-3a587af2-7bab-4057-9dfa-a6ffd8e7280e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64959c1-0a8e-4efa-a248-f9bd6c79ae52", "name": "network-vif-plugged", "status": "completed", "tag": "d42248b8-2304-4d94-99a1-5245cc3c4391"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:38:13.719357 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3edd3c55-087a-404c-97d9-21df5b1d4c02 req-3a587af2-7bab-4057-9dfa-a6ffd8e7280e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:13.720026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-3edd3c55-087a-404c-97d9-21df5b1d4c02 req-3a587af2-7bab-4057-9dfa-a6ffd8e7280e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:13.731505 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-3edd3c55-087a-404c-97d9-21df5b1d4c02 req-3a587af2-7bab-4057-9dfa-a6ffd8e7280e service nova] Creating event network-vif-plugged:d42248b8-2304-4d94-99a1-5245cc3c4391 for instance c64959c1-0a8e-4efa-a248-f9bd6c79ae52 on nch2-master-1 Mar 05 21:38:13.736783 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-3edd3c55-087a-404c-97d9-21df5b1d4c02 req-3a587af2-7bab-4057-9dfa-a6ffd8e7280e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030521 Mar 05 21:38:13.737404 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3195/6352] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:38:14.101900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f0706300-7562-4ea7-9ca0-14bf7dc05975 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:14.102547 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f0706300-7562-4ea7-9ca0-14bf7dc05975 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:14.109625 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0706300-7562-4ea7-9ca0-14bf7dc05975 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:14.110096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0706300-7562-4ea7-9ca0-14bf7dc05975 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:14.110886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0706300-7562-4ea7-9ca0-14bf7dc05975 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:14.111343 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f0706300-7562-4ea7-9ca0-14bf7dc05975 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:14.249017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f0706300-7562-4ea7-9ca0-14bf7dc05975 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:14.256360 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f0706300-7562-4ea7-9ca0-14bf7dc05975 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1393 microversion: 2.1 time: 0.158423 Mar 05 21:38:14.256935 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3158/6353] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:14 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:15.274350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-197e5540-c05c-4531-aabd-749535e74d35 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:15.275073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-197e5540-c05c-4531-aabd-749535e74d35 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:15.282395 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-197e5540-c05c-4531-aabd-749535e74d35 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:15.282860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-197e5540-c05c-4531-aabd-749535e74d35 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:15.283651 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-197e5540-c05c-4531-aabd-749535e74d35 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:15.284128 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-197e5540-c05c-4531-aabd-749535e74d35 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:15.418262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-197e5540-c05c-4531-aabd-749535e74d35 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:15.425970 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-197e5540-c05c-4531-aabd-749535e74d35 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1566 microversion: 2.1 time: 0.156744 Mar 05 21:38:15.426567 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3196/6354] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:15 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:15.442807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9f97c53a-acc5-4fa7-872f-d4c10d45aec7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:15.443444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9f97c53a-acc5-4fa7-872f-d4c10d45aec7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:15.450912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f97c53a-acc5-4fa7-872f-d4c10d45aec7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:15.451389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f97c53a-acc5-4fa7-872f-d4c10d45aec7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:15.452216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f97c53a-acc5-4fa7-872f-d4c10d45aec7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:15.452679 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9f97c53a-acc5-4fa7-872f-d4c10d45aec7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:15.591715 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9f97c53a-acc5-4fa7-872f-d4c10d45aec7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:15.599216 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9f97c53a-acc5-4fa7-872f-d4c10d45aec7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1566 microversion: 2.1 time: 0.160374 Mar 05 21:38:15.599857 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3159/6355] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:15 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:17.209280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ff1a3e9a-37ee-45ab-8355-d8eb441b0049 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:17.209911 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ff1a3e9a-37ee-45ab-8355-d8eb441b0049 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:17.211548 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-3ced02ba-ddf3-428a-a361-4896eea5b9dd req-5d923d97-f072-45a9-b483-552ef5fcd003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c64959c1-0a8e-4efa-a248-f9bd6c79ae52", "tag": "d42248b8-2304-4d94-99a1-5245cc3c4391"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:38:17.217599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff1a3e9a-37ee-45ab-8355-d8eb441b0049 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:17.218063 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff1a3e9a-37ee-45ab-8355-d8eb441b0049 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:17.218860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff1a3e9a-37ee-45ab-8355-d8eb441b0049 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:17.219304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff1a3e9a-37ee-45ab-8355-d8eb441b0049 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:17.221620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3ced02ba-ddf3-428a-a361-4896eea5b9dd req-5d923d97-f072-45a9-b483-552ef5fcd003 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:17.222160 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-3ced02ba-ddf3-428a-a361-4896eea5b9dd req-5d923d97-f072-45a9-b483-552ef5fcd003 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:17.234752 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-3ced02ba-ddf3-428a-a361-4896eea5b9dd req-5d923d97-f072-45a9-b483-552ef5fcd003 service nova] Creating event network-changed:d42248b8-2304-4d94-99a1-5245cc3c4391 for instance c64959c1-0a8e-4efa-a248-f9bd6c79ae52 on nch2-master-1 Mar 05 21:38:17.240256 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-3ced02ba-ddf3-428a-a361-4896eea5b9dd req-5d923d97-f072-45a9-b483-552ef5fcd003 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032267 Mar 05 21:38:17.241011 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3160/6356] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:38:17.377640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ff1a3e9a-37ee-45ab-8355-d8eb441b0049 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:17.385504 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ff1a3e9a-37ee-45ab-8355-d8eb441b0049 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1566 microversion: 2.1 time: 0.180125 Mar 05 21:38:17.389913 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3197/6357] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:17 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:38.644436 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d1dd9c86-115d-428d-aefe-ee3d2e11347a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:38:38.645460 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d1dd9c86-115d-428d-aefe-ee3d2e11347a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:38.651740 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1dd9c86-115d-428d-aefe-ee3d2e11347a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:38.652217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1dd9c86-115d-428d-aefe-ee3d2e11347a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:38.653003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1dd9c86-115d-428d-aefe-ee3d2e11347a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:38.654386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d1dd9c86-115d-428d-aefe-ee3d2e11347a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:38.704092 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d1dd9c86-115d-428d-aefe-ee3d2e11347a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52/action" status: 200 len: 24565 microversion: 2.1 time: 0.064850 Mar 05 21:38:38.704747 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3161/6358] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:38:38 2022] POST /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52/action => generated 24565 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:38:49.700315 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4b598992-8641-4c24-bd52-1a84d0791f09 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:38:49.701274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4b598992-8641-4c24-bd52-1a84d0791f09 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:49.708088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b598992-8641-4c24-bd52-1a84d0791f09 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:49.708542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b598992-8641-4c24-bd52-1a84d0791f09 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:49.709313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b598992-8641-4c24-bd52-1a84d0791f09 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:49.709753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4b598992-8641-4c24-bd52-1a84d0791f09 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:49.783639 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4b598992-8641-4c24-bd52-1a84d0791f09 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52/action" status: 202 len: 0 microversion: 2.1 time: 0.087453 Mar 05 21:38:49.784323 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3198/6359] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:38:49 2022] POST /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:38:49.793448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-79307284-570e-4050-9fb4-1b19c1394b1d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:49.794178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-79307284-570e-4050-9fb4-1b19c1394b1d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:49.803949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79307284-570e-4050-9fb4-1b19c1394b1d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:49.804426 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79307284-570e-4050-9fb4-1b19c1394b1d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:49.805228 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79307284-570e-4050-9fb4-1b19c1394b1d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:49.805722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-79307284-570e-4050-9fb4-1b19c1394b1d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:50.035259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-79307284-570e-4050-9fb4-1b19c1394b1d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:50.042762 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-79307284-570e-4050-9fb4-1b19c1394b1d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1677 microversion: 2.1 time: 0.253613 Mar 05 21:38:50.049659 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3162/6360] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:49 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1677 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:51.063501 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7f8bd5db-af9d-4b14-bf71-7318959976f6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:51.064394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7f8bd5db-af9d-4b14-bf71-7318959976f6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:51.070666 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f8bd5db-af9d-4b14-bf71-7318959976f6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:51.071163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f8bd5db-af9d-4b14-bf71-7318959976f6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:51.072023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f8bd5db-af9d-4b14-bf71-7318959976f6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:51.072472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f8bd5db-af9d-4b14-bf71-7318959976f6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:51.214439 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7f8bd5db-af9d-4b14-bf71-7318959976f6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:51.222283 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7f8bd5db-af9d-4b14-bf71-7318959976f6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1682 microversion: 2.1 time: 0.164667 Mar 05 21:38:51.222863 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3199/6361] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:51 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:52.240488 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c63faa31-8b43-47eb-85c2-e26eb5ed9098 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:52.241040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c63faa31-8b43-47eb-85c2-e26eb5ed9098 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:52.249577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c63faa31-8b43-47eb-85c2-e26eb5ed9098 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:52.250047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c63faa31-8b43-47eb-85c2-e26eb5ed9098 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:52.250844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c63faa31-8b43-47eb-85c2-e26eb5ed9098 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:52.251301 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c63faa31-8b43-47eb-85c2-e26eb5ed9098 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:52.468562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c63faa31-8b43-47eb-85c2-e26eb5ed9098 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:52.476710 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c63faa31-8b43-47eb-85c2-e26eb5ed9098 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1682 microversion: 2.1 time: 0.240393 Mar 05 21:38:52.477695 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3163/6362] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:52 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1682 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:53.494440 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0938a9bf-9324-499c-b89d-58868ac9e0b5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:53.495065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0938a9bf-9324-499c-b89d-58868ac9e0b5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:53.502769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0938a9bf-9324-499c-b89d-58868ac9e0b5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:53.503231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0938a9bf-9324-499c-b89d-58868ac9e0b5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:53.504039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0938a9bf-9324-499c-b89d-58868ac9e0b5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:53.504485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0938a9bf-9324-499c-b89d-58868ac9e0b5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:53.730109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0938a9bf-9324-499c-b89d-58868ac9e0b5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:53.738338 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0938a9bf-9324-499c-b89d-58868ac9e0b5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1682 microversion: 2.1 time: 0.247877 Mar 05 21:38:53.738922 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3200/6363] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:53 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1682 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:54.755655 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-47b37973-e286-4af9-8631-0107e7b93bc2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:54.756307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-47b37973-e286-4af9-8631-0107e7b93bc2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:54.763066 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47b37973-e286-4af9-8631-0107e7b93bc2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:54.763533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47b37973-e286-4af9-8631-0107e7b93bc2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:54.764465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47b37973-e286-4af9-8631-0107e7b93bc2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:54.764854 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-47b37973-e286-4af9-8631-0107e7b93bc2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:54.902658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-47b37973-e286-4af9-8631-0107e7b93bc2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:54.910964 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-47b37973-e286-4af9-8631-0107e7b93bc2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1682 microversion: 2.1 time: 0.159167 Mar 05 21:38:54.911549 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3164/6364] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:54 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:38:55.929349 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-02e29260-af9e-4936-832a-763736fe689c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:55.929969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-02e29260-af9e-4936-832a-763736fe689c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:55.939871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02e29260-af9e-4936-832a-763736fe689c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:55.940341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02e29260-af9e-4936-832a-763736fe689c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:55.941127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02e29260-af9e-4936-832a-763736fe689c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:55.941571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02e29260-af9e-4936-832a-763736fe689c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:56.082223 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-02e29260-af9e-4936-832a-763736fe689c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:56.089668 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-02e29260-af9e-4936-832a-763736fe689c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1682 microversion: 2.1 time: 0.164424 Mar 05 21:38:56.090246 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3201/6365] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:55 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:57.106969 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-182e3227-4a25-479d-b1ea-a1b8620fc04c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:57.107813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-182e3227-4a25-479d-b1ea-a1b8620fc04c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:57.115150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-182e3227-4a25-479d-b1ea-a1b8620fc04c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:57.115620 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-182e3227-4a25-479d-b1ea-a1b8620fc04c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:57.116651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-182e3227-4a25-479d-b1ea-a1b8620fc04c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:57.117111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-182e3227-4a25-479d-b1ea-a1b8620fc04c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:57.593287 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-182e3227-4a25-479d-b1ea-a1b8620fc04c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:57.601031 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-182e3227-4a25-479d-b1ea-a1b8620fc04c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1682 microversion: 2.1 time: 0.498263 Mar 05 21:38:57.601645 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3165/6366] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:57 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1682 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:58.618639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b623077e-44f3-4101-9116-65cf05b9e3dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:58.619291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b623077e-44f3-4101-9116-65cf05b9e3dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:58.627473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b623077e-44f3-4101-9116-65cf05b9e3dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:58.627971 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b623077e-44f3-4101-9116-65cf05b9e3dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:58.628753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b623077e-44f3-4101-9116-65cf05b9e3dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:58.629202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b623077e-44f3-4101-9116-65cf05b9e3dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:58.762250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b623077e-44f3-4101-9116-65cf05b9e3dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:58.770164 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b623077e-44f3-4101-9116-65cf05b9e3dd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1682 microversion: 2.1 time: 0.155492 Mar 05 21:38:58.770782 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3202/6367] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:58 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:38:59.788597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-96365c1d-07f1-4cb5-897c-76bd3b5bb996 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:38:59.789259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-96365c1d-07f1-4cb5-897c-76bd3b5bb996 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:38:59.796855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96365c1d-07f1-4cb5-897c-76bd3b5bb996 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:59.797356 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96365c1d-07f1-4cb5-897c-76bd3b5bb996 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:59.798142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96365c1d-07f1-4cb5-897c-76bd3b5bb996 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:38:59.798629 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-96365c1d-07f1-4cb5-897c-76bd3b5bb996 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:38:59.934591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-96365c1d-07f1-4cb5-897c-76bd3b5bb996 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:38:59.942306 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-96365c1d-07f1-4cb5-897c-76bd3b5bb996 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1682 microversion: 2.1 time: 0.157648 Mar 05 21:38:59.942885 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3166/6368] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:38:59 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:00.959387 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4580f179-b8b6-4d4f-970d-4077c12b52b4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:00.960054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4580f179-b8b6-4d4f-970d-4077c12b52b4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:00.966983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4580f179-b8b6-4d4f-970d-4077c12b52b4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:00.967453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4580f179-b8b6-4d4f-970d-4077c12b52b4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:00.968269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4580f179-b8b6-4d4f-970d-4077c12b52b4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:00.968738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4580f179-b8b6-4d4f-970d-4077c12b52b4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:01.107414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4580f179-b8b6-4d4f-970d-4077c12b52b4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:01.116571 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4580f179-b8b6-4d4f-970d-4077c12b52b4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1682 microversion: 2.1 time: 0.161034 Mar 05 21:39:01.117176 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3203/6369] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:00 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:02.133205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-59cdbd89-47af-47db-bd87-def9d2480a82 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:02.133830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-59cdbd89-47af-47db-bd87-def9d2480a82 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:02.141557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-59cdbd89-47af-47db-bd87-def9d2480a82 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:02.142019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-59cdbd89-47af-47db-bd87-def9d2480a82 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:02.142812 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-59cdbd89-47af-47db-bd87-def9d2480a82 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:02.143262 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-59cdbd89-47af-47db-bd87-def9d2480a82 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:02.332680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-59cdbd89-47af-47db-bd87-def9d2480a82 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:02.340093 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-59cdbd89-47af-47db-bd87-def9d2480a82 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1682 microversion: 2.1 time: 0.210858 Mar 05 21:39:02.340681 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3167/6370] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:02 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1682 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:03.358630 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3e5cbfa6-16e5-4b29-b4cd-597d0f5f5e00 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:03.359277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3e5cbfa6-16e5-4b29-b4cd-597d0f5f5e00 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:03.366153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e5cbfa6-16e5-4b29-b4cd-597d0f5f5e00 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:03.366619 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e5cbfa6-16e5-4b29-b4cd-597d0f5f5e00 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:03.367398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e5cbfa6-16e5-4b29-b4cd-597d0f5f5e00 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:03.367886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e5cbfa6-16e5-4b29-b4cd-597d0f5f5e00 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:03.504216 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3e5cbfa6-16e5-4b29-b4cd-597d0f5f5e00 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:03.511594 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3e5cbfa6-16e5-4b29-b4cd-597d0f5f5e00 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1682 microversion: 2.1 time: 0.157097 Mar 05 21:39:03.512213 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3204/6371] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:03 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:04.529551 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cb8c8875-b5a3-4055-b367-6cdc024d6b6c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:04.530216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cb8c8875-b5a3-4055-b367-6cdc024d6b6c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:04.537295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb8c8875-b5a3-4055-b367-6cdc024d6b6c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:04.537773 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb8c8875-b5a3-4055-b367-6cdc024d6b6c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:04.538558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb8c8875-b5a3-4055-b367-6cdc024d6b6c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:04.539013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cb8c8875-b5a3-4055-b367-6cdc024d6b6c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:04.674470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cb8c8875-b5a3-4055-b367-6cdc024d6b6c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:04.681897 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cb8c8875-b5a3-4055-b367-6cdc024d6b6c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1682 microversion: 2.1 time: 0.156439 Mar 05 21:39:04.682478 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3168/6372] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:04 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:05.699736 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-35f837b5-c00a-437d-b198-d400230ecc0e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:05.700394 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-35f837b5-c00a-437d-b198-d400230ecc0e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:05.707909 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35f837b5-c00a-437d-b198-d400230ecc0e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:05.708368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35f837b5-c00a-437d-b198-d400230ecc0e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:05.709145 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35f837b5-c00a-437d-b198-d400230ecc0e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:05.709586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-35f837b5-c00a-437d-b198-d400230ecc0e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:05.844766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-35f837b5-c00a-437d-b198-d400230ecc0e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:05.852435 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-35f837b5-c00a-437d-b198-d400230ecc0e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1682 microversion: 2.1 time: 0.156736 Mar 05 21:39:05.853023 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3205/6373] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:05 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:06.869840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-4c01e335-d19b-4a4d-9b4d-b6989efbb5c2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:06.870463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-4c01e335-d19b-4a4d-9b4d-b6989efbb5c2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:06.877568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c01e335-d19b-4a4d-9b4d-b6989efbb5c2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:06.878041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c01e335-d19b-4a4d-9b4d-b6989efbb5c2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:06.878825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c01e335-d19b-4a4d-9b4d-b6989efbb5c2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:06.879276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-4c01e335-d19b-4a4d-9b4d-b6989efbb5c2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:07.020278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-4c01e335-d19b-4a4d-9b4d-b6989efbb5c2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:07.027691 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-4c01e335-d19b-4a4d-9b4d-b6989efbb5c2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1685 microversion: 2.1 time: 0.161812 Mar 05 21:39:07.028272 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3169/6374] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:06 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:31.202007 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-952cf9a0-5925-440a-a5e5-06182a0c0911 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:39:31.202861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-952cf9a0-5925-440a-a5e5-06182a0c0911 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:31.209715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-952cf9a0-5925-440a-a5e5-06182a0c0911 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:31.210172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-952cf9a0-5925-440a-a5e5-06182a0c0911 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:31.210937 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-952cf9a0-5925-440a-a5e5-06182a0c0911 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:31.211376 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-952cf9a0-5925-440a-a5e5-06182a0c0911 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:31.270244 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-952cf9a0-5925-440a-a5e5-06182a0c0911 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52/action" status: 200 len: 68970 microversion: 2.1 time: 0.072383 Mar 05 21:39:31.270911 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3206/6375] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:39:31 2022] POST /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52/action => generated 68970 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 21:39:38.378155 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-deba2f8b-aada-432f-a751-24524fba16a2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:38.379390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-deba2f8b-aada-432f-a751-24524fba16a2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:38.381384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-40b5bb43-faa9-4656-9599-45717fc3c90a req-99577b43-6623-47c5-b920-058aa968ea37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c64959c1-0a8e-4efa-a248-f9bd6c79ae52", "tag": "d42248b8-2304-4d94-99a1-5245cc3c4391"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:39:38.385760 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-deba2f8b-aada-432f-a751-24524fba16a2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:38.386309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-deba2f8b-aada-432f-a751-24524fba16a2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:38.387214 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-deba2f8b-aada-432f-a751-24524fba16a2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:38.387781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-deba2f8b-aada-432f-a751-24524fba16a2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:38.392290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-40b5bb43-faa9-4656-9599-45717fc3c90a req-99577b43-6623-47c5-b920-058aa968ea37 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:38.392746 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-40b5bb43-faa9-4656-9599-45717fc3c90a req-99577b43-6623-47c5-b920-058aa968ea37 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:38.405373 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-40b5bb43-faa9-4656-9599-45717fc3c90a req-99577b43-6623-47c5-b920-058aa968ea37 service nova] Creating event network-changed:d42248b8-2304-4d94-99a1-5245cc3c4391 for instance c64959c1-0a8e-4efa-a248-f9bd6c79ae52 on nch2-master-1 Mar 05 21:39:38.410826 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-40b5bb43-faa9-4656-9599-45717fc3c90a req-99577b43-6623-47c5-b920-058aa968ea37 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034043 Mar 05 21:39:38.411787 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3207/6376] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:39:38.415700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-deba2f8b-aada-432f-a751-24524fba16a2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:39:38.501342 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-deba2f8b-aada-432f-a751-24524fba16a2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 204 len: 0 microversion: 2.1 time: 0.127308 Mar 05 21:39:38.502302 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3170/6377] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:39:38 2022] DELETE /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:39:38.514120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3e0ed4d2-b18f-4fe7-a7ae-2ed16201cd68 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:38.514950 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3e0ed4d2-b18f-4fe7-a7ae-2ed16201cd68 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:38.522323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e0ed4d2-b18f-4fe7-a7ae-2ed16201cd68 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:38.522886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e0ed4d2-b18f-4fe7-a7ae-2ed16201cd68 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:38.523712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e0ed4d2-b18f-4fe7-a7ae-2ed16201cd68 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:38.524171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3e0ed4d2-b18f-4fe7-a7ae-2ed16201cd68 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:38.676794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3e0ed4d2-b18f-4fe7-a7ae-2ed16201cd68 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:38.685583 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3e0ed4d2-b18f-4fe7-a7ae-2ed16201cd68 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1691 microversion: 2.1 time: 0.177288 Mar 05 21:39:38.686530 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3208/6378] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:38 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:39.705065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-11129301-e54a-4ce8-9e49-0b6d92f69346 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:39.705711 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-11129301-e54a-4ce8-9e49-0b6d92f69346 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:39.712908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11129301-e54a-4ce8-9e49-0b6d92f69346 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:39.713381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11129301-e54a-4ce8-9e49-0b6d92f69346 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:39.714203 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11129301-e54a-4ce8-9e49-0b6d92f69346 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:39.714661 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11129301-e54a-4ce8-9e49-0b6d92f69346 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:39.870065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-11129301-e54a-4ce8-9e49-0b6d92f69346 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:39.879663 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-11129301-e54a-4ce8-9e49-0b6d92f69346 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1572 microversion: 2.1 time: 0.178758 Mar 05 21:39:39.880484 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3171/6379] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:39 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1572 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:40.497719 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-fbb129d4-4846-4cd9-8f8b-c9ff8796e627 req-fb16ce33-51a6-423a-a874-f52c8f1011ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64959c1-0a8e-4efa-a248-f9bd6c79ae52", "name": "network-vif-deleted", "tag": "d42248b8-2304-4d94-99a1-5245cc3c4391"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:39:40.507323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fbb129d4-4846-4cd9-8f8b-c9ff8796e627 req-fb16ce33-51a6-423a-a874-f52c8f1011ea service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:40.508056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-fbb129d4-4846-4cd9-8f8b-c9ff8796e627 req-fb16ce33-51a6-423a-a874-f52c8f1011ea service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:40.519395 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-fbb129d4-4846-4cd9-8f8b-c9ff8796e627 req-fb16ce33-51a6-423a-a874-f52c8f1011ea service nova] Creating event network-vif-deleted:d42248b8-2304-4d94-99a1-5245cc3c4391 for instance c64959c1-0a8e-4efa-a248-f9bd6c79ae52 on nch2-master-1 Mar 05 21:39:40.524156 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-fbb129d4-4846-4cd9-8f8b-c9ff8796e627 req-fb16ce33-51a6-423a-a874-f52c8f1011ea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030493 Mar 05 21:39:40.524742 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3209/6380] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:39:40.897829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e6d8f334-a6f2-453a-8d70-56fda062c1d8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:40.898471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e6d8f334-a6f2-453a-8d70-56fda062c1d8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:40.906310 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6d8f334-a6f2-453a-8d70-56fda062c1d8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:40.906908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6d8f334-a6f2-453a-8d70-56fda062c1d8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:40.909013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6d8f334-a6f2-453a-8d70-56fda062c1d8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:40.910746 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6d8f334-a6f2-453a-8d70-56fda062c1d8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:40.948781 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6d8f334-a6f2-453a-8d70-56fda062c1d8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:40.949347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e6d8f334-a6f2-453a-8d70-56fda062c1d8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:40.949889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-e6d8f334-a6f2-453a-8d70-56fda062c1d8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lazy-loading 'fault' on Instance uuid c64959c1-0a8e-4efa-a248-f9bd6c79ae52 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:39:40.996572 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e6d8f334-a6f2-453a-8d70-56fda062c1d8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:41.003953 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e6d8f334-a6f2-453a-8d70-56fda062c1d8 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 200 len: 1357 microversion: 2.1 time: 0.111023 Mar 05 21:39:41.005636 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3172/6381] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:40 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 1357 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:42.023600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0f7b80f-6262-4d8a-b194-44161578e632 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:42.024350 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a0f7b80f-6262-4d8a-b194-44161578e632 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: c64959c1-0a8e-4efa-a248-f9bd6c79ae52] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:42.032477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0f7b80f-6262-4d8a-b194-44161578e632 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:42.032972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0f7b80f-6262-4d8a-b194-44161578e632 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:42.033788 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0f7b80f-6262-4d8a-b194-44161578e632 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:42.034229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0f7b80f-6262-4d8a-b194-44161578e632 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:42.049543 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-a0f7b80f-6262-4d8a-b194-44161578e632 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] HTTP exception thrown: Instance c64959c1-0a8e-4efa-a248-f9bd6c79ae52 could not be found. Mar 05 21:39:42.050161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0f7b80f-6262-4d8a-b194-44161578e632 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Returning 404 to user: Instance c64959c1-0a8e-4efa-a248-f9bd6c79ae52 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:39:42.051697 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0f7b80f-6262-4d8a-b194-44161578e632 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52" status: 404 len: 111 microversion: 2.1 time: 0.034168 Mar 05 21:39:42.052261 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3210/6382] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:42 2022] GET /compute/v2.1/servers/c64959c1-0a8e-4efa-a248-f9bd6c79ae52 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:39:45.423938 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a2bc81e1-482c-4376-85ba-12033499e812 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '.version_select at 0x7fed61ace820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:45.444927 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a2bc81e1-482c-4376-85ba-12033499e812 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2080375555" status: 202 len: 0 microversion: 2.1 time: 0.025015 Mar 05 21:39:45.445910 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3173/6383] 10.222.0.15 () {58 vars in 1283 bytes} [Sat Mar 5 21:39:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2080375555 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:39:45.468817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d27fd8d9-c0a1-4a3f-a031-e57786db668c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'create', calling method: .version_select at 0x7fed5c470430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-280585580"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:39:45.485560 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d27fd8d9-c0a1-4a3f-a031-e57786db668c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:39:45.491509 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d27fd8d9-c0a1-4a3f-a031-e57786db668c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:39:45.652233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d27fd8d9-c0a1-4a3f-a031-e57786db668c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:39:45.658389 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-d27fd8d9-c0a1-4a3f-a031-e57786db668c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:39:45.679653 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d27fd8d9-c0a1-4a3f-a031-e57786db668c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.215385 Mar 05 21:39:45.684844 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3211/6384] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:39:45 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:51.166955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-394488378", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "79d0ea1a-c3d0-468e-b156-822d629b6d5c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-280585580", "security_groups": [{"name": "tempest-secgroup-smoke-340070349"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:39:51.309544 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] validate_networks() for [('79d0ea1a-c3d0-468e-b156-822d629b6d5c', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:39:51.794848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:39:51.795979 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:39:51.796978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:39:51.797433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:39:51.797877 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:39:51.813980 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:51.814621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:51.816281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:51.817087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:51.854181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:39:51.860489 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:39:51.876627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:39:51.880370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:39:51.943953 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c8790950-e9cf-44a7-9bfc-92b12fe9aee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.782210 Mar 05 21:39:51.944625 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3174/6385] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:39:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:39:51.958026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-62ea326d-17d2-4a38-b148-92d336b1d0dc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:51.958752 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-62ea326d-17d2-4a38-b148-92d336b1d0dc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:52.067355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-62ea326d-17d2-4a38-b148-92d336b1d0dc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:52.079032 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-62ea326d-17d2-4a38-b148-92d336b1d0dc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1265 microversion: 2.1 time: 0.126369 Mar 05 21:39:52.079884 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3212/6386] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:51 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:53.097952 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a29883f6-a1fa-49d5-afa9-7bd5a59d626e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:53.099528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a29883f6-a1fa-49d5-afa9-7bd5a59d626e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:53.117343 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a29883f6-a1fa-49d5-afa9-7bd5a59d626e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:53.117869 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a29883f6-a1fa-49d5-afa9-7bd5a59d626e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:53.118709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a29883f6-a1fa-49d5-afa9-7bd5a59d626e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:53.119177 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a29883f6-a1fa-49d5-afa9-7bd5a59d626e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:53.219999 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a29883f6-a1fa-49d5-afa9-7bd5a59d626e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:53.228374 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a29883f6-a1fa-49d5-afa9-7bd5a59d626e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1325 microversion: 2.1 time: 0.135418 Mar 05 21:39:53.232185 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3175/6387] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:53 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1325 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:54.250467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3871f5aa-4b4a-4241-a29d-841300c24adc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:54.252039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3871f5aa-4b4a-4241-a29d-841300c24adc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:54.265520 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3871f5aa-4b4a-4241-a29d-841300c24adc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:54.266272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3871f5aa-4b4a-4241-a29d-841300c24adc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:54.267373 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3871f5aa-4b4a-4241-a29d-841300c24adc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:54.267862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3871f5aa-4b4a-4241-a29d-841300c24adc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:54.476281 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3871f5aa-4b4a-4241-a29d-841300c24adc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:54.508281 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3871f5aa-4b4a-4241-a29d-841300c24adc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1390 microversion: 2.1 time: 0.260954 Mar 05 21:39:54.511319 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3213/6388] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:54 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1390 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:54.794365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-1e2aaf23-d151-425d-99ec-ff97b8209d59 req-bb1532d2-31da-43e5-8b33-77ffd5ecf920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c240119-36b9-4cff-8983-17b6e9e9a32f", "tag": "f3096cec-bdde-4445-96b4-77383c490018"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:39:54.805567 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1e2aaf23-d151-425d-99ec-ff97b8209d59 req-bb1532d2-31da-43e5-8b33-77ffd5ecf920 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:54.805992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-1e2aaf23-d151-425d-99ec-ff97b8209d59 req-bb1532d2-31da-43e5-8b33-77ffd5ecf920 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:54.831808 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-1e2aaf23-d151-425d-99ec-ff97b8209d59 req-bb1532d2-31da-43e5-8b33-77ffd5ecf920 service nova] Creating event network-changed:f3096cec-bdde-4445-96b4-77383c490018 for instance 8c240119-36b9-4cff-8983-17b6e9e9a32f on nch1-master-1 Mar 05 21:39:54.838431 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-1e2aaf23-d151-425d-99ec-ff97b8209d59 req-bb1532d2-31da-43e5-8b33-77ffd5ecf920 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047233 Mar 05 21:39:54.840025 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3176/6389] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:39:55.530429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ff15add6-aaaf-4a82-8ee7-3cf00155d764 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:55.531057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ff15add6-aaaf-4a82-8ee7-3cf00155d764 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:55.538519 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff15add6-aaaf-4a82-8ee7-3cf00155d764 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:55.538986 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff15add6-aaaf-4a82-8ee7-3cf00155d764 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:55.539807 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff15add6-aaaf-4a82-8ee7-3cf00155d764 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:55.540266 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ff15add6-aaaf-4a82-8ee7-3cf00155d764 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:55.682906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ff15add6-aaaf-4a82-8ee7-3cf00155d764 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:55.690382 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ff15add6-aaaf-4a82-8ee7-3cf00155d764 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1390 microversion: 2.1 time: 0.163895 Mar 05 21:39:55.691174 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3214/6390] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:55 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:56.709640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-43aaaa8d-c3cc-474f-a956-54d81c1fdc0b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:56.710272 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-43aaaa8d-c3cc-474f-a956-54d81c1fdc0b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:56.716472 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43aaaa8d-c3cc-474f-a956-54d81c1fdc0b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:56.716942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43aaaa8d-c3cc-474f-a956-54d81c1fdc0b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:56.717719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43aaaa8d-c3cc-474f-a956-54d81c1fdc0b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:56.718171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-43aaaa8d-c3cc-474f-a956-54d81c1fdc0b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:56.856028 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-43aaaa8d-c3cc-474f-a956-54d81c1fdc0b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:56.864002 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-43aaaa8d-c3cc-474f-a956-54d81c1fdc0b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1390 microversion: 2.1 time: 0.160460 Mar 05 21:39:56.864581 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3177/6391] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:56 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:57.881712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b73af86a-61da-4636-a53b-95e4437e6b4f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:57.882335 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b73af86a-61da-4636-a53b-95e4437e6b4f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:57.889285 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b73af86a-61da-4636-a53b-95e4437e6b4f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:57.889750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b73af86a-61da-4636-a53b-95e4437e6b4f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:57.890793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b73af86a-61da-4636-a53b-95e4437e6b4f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:57.890967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b73af86a-61da-4636-a53b-95e4437e6b4f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:58.029348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b73af86a-61da-4636-a53b-95e4437e6b4f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:58.037514 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b73af86a-61da-4636-a53b-95e4437e6b4f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1390 microversion: 2.1 time: 0.160384 Mar 05 21:39:58.038098 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3215/6392] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:57 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:39:59.055008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0dcdda41-1008-43fb-ab0f-c04513a1ca75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:39:59.055911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0dcdda41-1008-43fb-ab0f-c04513a1ca75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:39:59.066668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0dcdda41-1008-43fb-ab0f-c04513a1ca75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:59.067015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0dcdda41-1008-43fb-ab0f-c04513a1ca75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:59.067848 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0dcdda41-1008-43fb-ab0f-c04513a1ca75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:39:59.068309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0dcdda41-1008-43fb-ab0f-c04513a1ca75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:39:59.199469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0dcdda41-1008-43fb-ab0f-c04513a1ca75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:39:59.206817 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0dcdda41-1008-43fb-ab0f-c04513a1ca75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1390 microversion: 2.1 time: 0.155782 Mar 05 21:39:59.207398 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3178/6393] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:39:59 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:00.224356 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3f173710-3f5e-44d9-904a-cfc9428d52cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:00.224975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3f173710-3f5e-44d9-904a-cfc9428d52cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:00.231758 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f173710-3f5e-44d9-904a-cfc9428d52cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:00.232215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f173710-3f5e-44d9-904a-cfc9428d52cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:00.232982 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f173710-3f5e-44d9-904a-cfc9428d52cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:00.233423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3f173710-3f5e-44d9-904a-cfc9428d52cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:00.376767 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3f173710-3f5e-44d9-904a-cfc9428d52cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:00.384434 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3f173710-3f5e-44d9-904a-cfc9428d52cd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1390 microversion: 2.1 time: 0.164803 Mar 05 21:40:00.385022 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3216/6394] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:00 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:00.418285 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7f7ad99b-d3c9-4bfc-a986-d9fc0d75ac93 req-d4adb494-b473-4606-a34c-118a1b30401a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c240119-36b9-4cff-8983-17b6e9e9a32f", "name": "network-vif-plugged", "status": "completed", "tag": "f3096cec-bdde-4445-96b4-77383c490018"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:40:00.427569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7f7ad99b-d3c9-4bfc-a986-d9fc0d75ac93 req-d4adb494-b473-4606-a34c-118a1b30401a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:00.428126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7f7ad99b-d3c9-4bfc-a986-d9fc0d75ac93 req-d4adb494-b473-4606-a34c-118a1b30401a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:00.439327 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7f7ad99b-d3c9-4bfc-a986-d9fc0d75ac93 req-d4adb494-b473-4606-a34c-118a1b30401a service nova] Creating event network-vif-plugged:f3096cec-bdde-4445-96b4-77383c490018 for instance 8c240119-36b9-4cff-8983-17b6e9e9a32f on nch1-master-1 Mar 05 21:40:00.445634 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7f7ad99b-d3c9-4bfc-a986-d9fc0d75ac93 req-d4adb494-b473-4606-a34c-118a1b30401a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031524 Mar 05 21:40:00.446402 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3179/6395] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:40:01.401340 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-872a30e1-3d2a-419b-a01d-baf8cafad8e4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:01.401957 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-872a30e1-3d2a-419b-a01d-baf8cafad8e4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:01.408774 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-872a30e1-3d2a-419b-a01d-baf8cafad8e4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:01.409839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-872a30e1-3d2a-419b-a01d-baf8cafad8e4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:01.410614 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-872a30e1-3d2a-419b-a01d-baf8cafad8e4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:01.411055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-872a30e1-3d2a-419b-a01d-baf8cafad8e4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:01.545920 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-872a30e1-3d2a-419b-a01d-baf8cafad8e4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:01.554882 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-872a30e1-3d2a-419b-a01d-baf8cafad8e4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1390 microversion: 2.1 time: 0.157390 Mar 05 21:40:01.555490 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3217/6396] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:01 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:02.575249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ac244bde-567c-44be-b4c4-8e222739a987 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:02.576005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ac244bde-567c-44be-b4c4-8e222739a987 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:02.583008 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac244bde-567c-44be-b4c4-8e222739a987 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:02.583484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac244bde-567c-44be-b4c4-8e222739a987 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:02.584316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac244bde-567c-44be-b4c4-8e222739a987 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:02.584818 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac244bde-567c-44be-b4c4-8e222739a987 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:02.725477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ac244bde-567c-44be-b4c4-8e222739a987 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:02.732854 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ac244bde-567c-44be-b4c4-8e222739a987 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1562 microversion: 2.1 time: 0.162756 Mar 05 21:40:02.733448 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3180/6397] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:02 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:02.749771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-526909c7-72b4-4689-b688-2a6918ecdd75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:02.750386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-526909c7-72b4-4689-b688-2a6918ecdd75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:02.758036 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-526909c7-72b4-4689-b688-2a6918ecdd75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:02.758495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-526909c7-72b4-4689-b688-2a6918ecdd75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:02.759262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-526909c7-72b4-4689-b688-2a6918ecdd75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:02.759733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-526909c7-72b4-4689-b688-2a6918ecdd75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:02.902332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-526909c7-72b4-4689-b688-2a6918ecdd75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:02.914229 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-526909c7-72b4-4689-b688-2a6918ecdd75 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1562 microversion: 2.1 time: 0.168319 Mar 05 21:40:02.914833 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3218/6398] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:02 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:04.831713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ed7f2c33-a509-49aa-a981-9dab8bb0c07c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:04.832479 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ed7f2c33-a509-49aa-a981-9dab8bb0c07c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:04.834578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-856543da-d110-4354-ad7d-ffbaa4a863d4 req-56165eef-9e8c-496f-9389-ba0a147aab81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c240119-36b9-4cff-8983-17b6e9e9a32f", "tag": "f3096cec-bdde-4445-96b4-77383c490018"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:40:04.840060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed7f2c33-a509-49aa-a981-9dab8bb0c07c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:04.840653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed7f2c33-a509-49aa-a981-9dab8bb0c07c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:04.841699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed7f2c33-a509-49aa-a981-9dab8bb0c07c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:04.842259 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ed7f2c33-a509-49aa-a981-9dab8bb0c07c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:04.844629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-856543da-d110-4354-ad7d-ffbaa4a863d4 req-56165eef-9e8c-496f-9389-ba0a147aab81 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:04.845081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-856543da-d110-4354-ad7d-ffbaa4a863d4 req-56165eef-9e8c-496f-9389-ba0a147aab81 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:04.857233 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-856543da-d110-4354-ad7d-ffbaa4a863d4 req-56165eef-9e8c-496f-9389-ba0a147aab81 service nova] Creating event network-changed:f3096cec-bdde-4445-96b4-77383c490018 for instance 8c240119-36b9-4cff-8983-17b6e9e9a32f on nch1-master-1 Mar 05 21:40:04.862917 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-856543da-d110-4354-ad7d-ffbaa4a863d4 req-56165eef-9e8c-496f-9389-ba0a147aab81 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032704 Mar 05 21:40:04.863638 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3219/6399] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:40:05.077241 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ed7f2c33-a509-49aa-a981-9dab8bb0c07c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:05.086285 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ed7f2c33-a509-49aa-a981-9dab8bb0c07c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1562 microversion: 2.1 time: 0.258991 Mar 05 21:40:05.087178 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3181/6400] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:04 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1562 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:12.407119 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:40:12.407764 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 21:40:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:40:26.320487 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-60e87b7f-1a0b-4425-a172-af1e59d8523d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:40:26.321498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-60e87b7f-1a0b-4425-a172-af1e59d8523d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:26.327805 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-60e87b7f-1a0b-4425-a172-af1e59d8523d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:26.328267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-60e87b7f-1a0b-4425-a172-af1e59d8523d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:26.329040 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-60e87b7f-1a0b-4425-a172-af1e59d8523d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:26.329486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-60e87b7f-1a0b-4425-a172-af1e59d8523d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:26.380461 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-60e87b7f-1a0b-4425-a172-af1e59d8523d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f/action" status: 200 len: 24573 microversion: 2.1 time: 0.066253 Mar 05 21:40:26.381320 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3220/6401] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:40:26 2022] POST /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f/action => generated 24573 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:40:37.361574 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:40:37.362562 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:37.369738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:37.370212 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:37.371005 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:37.371738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:37.411549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:37.417684 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Old instance type m1.heat2, new instance type m1.heat {{(pid=141478) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 05 21:40:37.423884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:40:37.424322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:40:37.424808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:40:37.425889 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:40:37.426365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:40:37.489110 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8c6dee38-fdb1-4e3b-b96a-384c3d0fa8f7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f/action" status: 202 len: 0 microversion: 2.1 time: 0.130456 Mar 05 21:40:37.489670 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3182/6402] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:40:37 2022] POST /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:40:37.499159 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-71b3cabe-8b14-411c-898b-17bbb3132bb7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:37.500332 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-71b3cabe-8b14-411c-898b-17bbb3132bb7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:37.508299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71b3cabe-8b14-411c-898b-17bbb3132bb7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:37.508827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71b3cabe-8b14-411c-898b-17bbb3132bb7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:37.509704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71b3cabe-8b14-411c-898b-17bbb3132bb7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:37.510337 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-71b3cabe-8b14-411c-898b-17bbb3132bb7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:38.005486 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-71b3cabe-8b14-411c-898b-17bbb3132bb7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:38.017674 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-71b3cabe-8b14-411c-898b-17bbb3132bb7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1690 microversion: 2.1 time: 0.523095 Mar 05 21:40:38.018262 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3221/6403] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:37 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1690 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:39.036738 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9cfc9ed5-bfb8-49eb-b478-b759f4c6191d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:39.037289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9cfc9ed5-bfb8-49eb-b478-b759f4c6191d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:39.043353 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9cfc9ed5-bfb8-49eb-b478-b759f4c6191d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:39.043867 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9cfc9ed5-bfb8-49eb-b478-b759f4c6191d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:39.044660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9cfc9ed5-bfb8-49eb-b478-b759f4c6191d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:39.045123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9cfc9ed5-bfb8-49eb-b478-b759f4c6191d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:39.192689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9cfc9ed5-bfb8-49eb-b478-b759f4c6191d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:39.200420 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9cfc9ed5-bfb8-49eb-b478-b759f4c6191d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1690 microversion: 2.1 time: 0.168597 Mar 05 21:40:39.201014 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3183/6404] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:39 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:40.218314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d9e0c6e0-0909-4b19-aa15-cb3d1b15642a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:40.218857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d9e0c6e0-0909-4b19-aa15-cb3d1b15642a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:40.229814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9e0c6e0-0909-4b19-aa15-cb3d1b15642a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:40.230269 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9e0c6e0-0909-4b19-aa15-cb3d1b15642a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:40.231067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9e0c6e0-0909-4b19-aa15-cb3d1b15642a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:40.231530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d9e0c6e0-0909-4b19-aa15-cb3d1b15642a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:40.362515 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d9e0c6e0-0909-4b19-aa15-cb3d1b15642a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:40.369981 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d9e0c6e0-0909-4b19-aa15-cb3d1b15642a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.155742 Mar 05 21:40:40.370566 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3222/6405] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:40 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:41.388188 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-48f30c8f-5efd-4a16-b9ad-a1cf8a609d37 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:41.388823 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-48f30c8f-5efd-4a16-b9ad-a1cf8a609d37 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:41.395814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-48f30c8f-5efd-4a16-b9ad-a1cf8a609d37 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:41.396289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-48f30c8f-5efd-4a16-b9ad-a1cf8a609d37 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:41.397077 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-48f30c8f-5efd-4a16-b9ad-a1cf8a609d37 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:41.397533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-48f30c8f-5efd-4a16-b9ad-a1cf8a609d37 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:41.532924 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-48f30c8f-5efd-4a16-b9ad-a1cf8a609d37 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:41.540920 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-48f30c8f-5efd-4a16-b9ad-a1cf8a609d37 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.156750 Mar 05 21:40:41.541501 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3184/6406] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:41 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:42.558768 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-59a84e20-e9cf-4f71-b09e-33d97722be6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:42.559393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-59a84e20-e9cf-4f71-b09e-33d97722be6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:42.567460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59a84e20-e9cf-4f71-b09e-33d97722be6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:42.567954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59a84e20-e9cf-4f71-b09e-33d97722be6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:42.568772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59a84e20-e9cf-4f71-b09e-33d97722be6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:42.569225 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59a84e20-e9cf-4f71-b09e-33d97722be6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:42.702261 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-59a84e20-e9cf-4f71-b09e-33d97722be6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:42.709966 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-59a84e20-e9cf-4f71-b09e-33d97722be6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.155292 Mar 05 21:40:42.710538 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3223/6407] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:42 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:43.726560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ee1d01b2-3afc-4292-8b4e-eb6ad4010ac4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:43.727134 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ee1d01b2-3afc-4292-8b4e-eb6ad4010ac4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:43.734432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee1d01b2-3afc-4292-8b4e-eb6ad4010ac4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:43.735249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee1d01b2-3afc-4292-8b4e-eb6ad4010ac4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:43.736388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee1d01b2-3afc-4292-8b4e-eb6ad4010ac4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:43.738280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ee1d01b2-3afc-4292-8b4e-eb6ad4010ac4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:43.881290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ee1d01b2-3afc-4292-8b4e-eb6ad4010ac4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:43.888804 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ee1d01b2-3afc-4292-8b4e-eb6ad4010ac4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.166324 Mar 05 21:40:43.889588 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3185/6408] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:43 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:44.906381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0c681755-eac8-47b7-9c78-7354cfa98a30 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:44.907083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0c681755-eac8-47b7-9c78-7354cfa98a30 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:44.914627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c681755-eac8-47b7-9c78-7354cfa98a30 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:44.915090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c681755-eac8-47b7-9c78-7354cfa98a30 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:44.915934 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c681755-eac8-47b7-9c78-7354cfa98a30 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:44.916384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0c681755-eac8-47b7-9c78-7354cfa98a30 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:45.056096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0c681755-eac8-47b7-9c78-7354cfa98a30 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:45.063642 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0c681755-eac8-47b7-9c78-7354cfa98a30 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.161242 Mar 05 21:40:45.064259 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3224/6409] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:44 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:46.081709 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-42189666-23a6-4d15-b78f-b7b2e8894b6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:46.082400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-42189666-23a6-4d15-b78f-b7b2e8894b6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:46.089670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-42189666-23a6-4d15-b78f-b7b2e8894b6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:46.090147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-42189666-23a6-4d15-b78f-b7b2e8894b6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:46.090940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-42189666-23a6-4d15-b78f-b7b2e8894b6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:46.091399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-42189666-23a6-4d15-b78f-b7b2e8894b6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:46.230595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-42189666-23a6-4d15-b78f-b7b2e8894b6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:46.237996 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-42189666-23a6-4d15-b78f-b7b2e8894b6a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.160381 Mar 05 21:40:46.238702 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3186/6410] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:46 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:47.255009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e5171ec0-38ef-46cb-ac3a-cccf523d2f3c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:47.255559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e5171ec0-38ef-46cb-ac3a-cccf523d2f3c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:47.262495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5171ec0-38ef-46cb-ac3a-cccf523d2f3c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:47.262960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5171ec0-38ef-46cb-ac3a-cccf523d2f3c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:47.263785 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5171ec0-38ef-46cb-ac3a-cccf523d2f3c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:47.264238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e5171ec0-38ef-46cb-ac3a-cccf523d2f3c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:47.401942 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e5171ec0-38ef-46cb-ac3a-cccf523d2f3c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:47.409355 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e5171ec0-38ef-46cb-ac3a-cccf523d2f3c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.158450 Mar 05 21:40:47.410473 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3225/6411] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:47 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:48.427449 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1386f886-0cb2-4b6c-bcab-513049bf14f0 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:48.428110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1386f886-0cb2-4b6c-bcab-513049bf14f0 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:48.435047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1386f886-0cb2-4b6c-bcab-513049bf14f0 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:48.435522 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1386f886-0cb2-4b6c-bcab-513049bf14f0 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:48.436350 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1386f886-0cb2-4b6c-bcab-513049bf14f0 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:48.436839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1386f886-0cb2-4b6c-bcab-513049bf14f0 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:48.578808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1386f886-0cb2-4b6c-bcab-513049bf14f0 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:48.587035 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1386f886-0cb2-4b6c-bcab-513049bf14f0 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.164115 Mar 05 21:40:48.587620 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3187/6412] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:48 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:49.604260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-95cdd296-2e17-4342-9eee-82fea97629ed tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:49.604871 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-95cdd296-2e17-4342-9eee-82fea97629ed tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:49.611885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95cdd296-2e17-4342-9eee-82fea97629ed tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:49.612353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95cdd296-2e17-4342-9eee-82fea97629ed tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:49.613723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95cdd296-2e17-4342-9eee-82fea97629ed tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:49.614173 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-95cdd296-2e17-4342-9eee-82fea97629ed tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:49.750108 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-95cdd296-2e17-4342-9eee-82fea97629ed tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:49.757585 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-95cdd296-2e17-4342-9eee-82fea97629ed tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.157351 Mar 05 21:40:49.758166 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3226/6413] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:49 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:50.775419 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3402e8a7-66dd-4937-9c55-056b0d75e53e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:50.776073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3402e8a7-66dd-4937-9c55-056b0d75e53e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:50.782835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3402e8a7-66dd-4937-9c55-056b0d75e53e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:50.783303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3402e8a7-66dd-4937-9c55-056b0d75e53e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:50.784112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3402e8a7-66dd-4937-9c55-056b0d75e53e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:50.785445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3402e8a7-66dd-4937-9c55-056b0d75e53e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:50.918813 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3402e8a7-66dd-4937-9c55-056b0d75e53e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:50.926520 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3402e8a7-66dd-4937-9c55-056b0d75e53e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.155030 Mar 05 21:40:50.927097 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3188/6414] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:50 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:51.944050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dc05fd6d-0b45-4833-a2e0-37b0c46e22cf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:51.944673 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dc05fd6d-0b45-4833-a2e0-37b0c46e22cf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:51.951500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc05fd6d-0b45-4833-a2e0-37b0c46e22cf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:51.951988 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc05fd6d-0b45-4833-a2e0-37b0c46e22cf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:51.952766 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc05fd6d-0b45-4833-a2e0-37b0c46e22cf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:51.953212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc05fd6d-0b45-4833-a2e0-37b0c46e22cf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:52.093803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-dc05fd6d-0b45-4833-a2e0-37b0c46e22cf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:52.101752 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dc05fd6d-0b45-4833-a2e0-37b0c46e22cf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.162295 Mar 05 21:40:52.102336 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3227/6415] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:51 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:53.118451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2f0766ef-3ef1-4bc1-ab5f-b7cd8e66ee3d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:53.119076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2f0766ef-3ef1-4bc1-ab5f-b7cd8e66ee3d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:53.126125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f0766ef-3ef1-4bc1-ab5f-b7cd8e66ee3d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:53.126593 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f0766ef-3ef1-4bc1-ab5f-b7cd8e66ee3d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:53.127369 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f0766ef-3ef1-4bc1-ab5f-b7cd8e66ee3d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:53.127853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2f0766ef-3ef1-4bc1-ab5f-b7cd8e66ee3d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:53.261360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2f0766ef-3ef1-4bc1-ab5f-b7cd8e66ee3d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:53.269998 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2f0766ef-3ef1-4bc1-ab5f-b7cd8e66ee3d tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.155470 Mar 05 21:40:53.270567 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3189/6416] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:53 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:54.287814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-99229d4e-df3d-4918-b839-b5cd08995b16 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:54.288616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-99229d4e-df3d-4918-b839-b5cd08995b16 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:54.298915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99229d4e-df3d-4918-b839-b5cd08995b16 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:54.299369 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99229d4e-df3d-4918-b839-b5cd08995b16 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:54.300360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99229d4e-df3d-4918-b839-b5cd08995b16 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:54.300617 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-99229d4e-df3d-4918-b839-b5cd08995b16 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:54.455557 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-99229d4e-df3d-4918-b839-b5cd08995b16 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:54.465305 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-99229d4e-df3d-4918-b839-b5cd08995b16 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.181907 Mar 05 21:40:54.465897 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3228/6417] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:54 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:40:55.482894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a59051c8-2c0f-406f-a3b4-6edb20d8b3aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:55.483560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a59051c8-2c0f-406f-a3b4-6edb20d8b3aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:55.491397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a59051c8-2c0f-406f-a3b4-6edb20d8b3aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:55.491968 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a59051c8-2c0f-406f-a3b4-6edb20d8b3aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:55.492833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a59051c8-2c0f-406f-a3b4-6edb20d8b3aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:55.493286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a59051c8-2c0f-406f-a3b4-6edb20d8b3aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:55.633049 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a59051c8-2c0f-406f-a3b4-6edb20d8b3aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:55.640694 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a59051c8-2c0f-406f-a3b4-6edb20d8b3aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1695 microversion: 2.1 time: 0.161863 Mar 05 21:40:55.641286 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3190/6418] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:55 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:56.658964 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c62e38a4-f66a-48fa-b5f3-6b96c41e6c72 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:56.660355 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c62e38a4-f66a-48fa-b5f3-6b96c41e6c72 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:56.667193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c62e38a4-f66a-48fa-b5f3-6b96c41e6c72 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:56.667661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c62e38a4-f66a-48fa-b5f3-6b96c41e6c72 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:56.668493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c62e38a4-f66a-48fa-b5f3-6b96c41e6c72 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:56.668946 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c62e38a4-f66a-48fa-b5f3-6b96c41e6c72 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:56.806899 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c62e38a4-f66a-48fa-b5f3-6b96c41e6c72 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:56.814269 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c62e38a4-f66a-48fa-b5f3-6b96c41e6c72 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1694 microversion: 2.1 time: 0.159601 Mar 05 21:40:56.814855 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3229/6419] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:56 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:57.048235 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-6d817a1a-f600-43e0-88ec-8ebdbf3ac867 req-58b0f7ac-51dd-4f48-ad28-241df84fa1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c240119-36b9-4cff-8983-17b6e9e9a32f", "name": "network-vif-unplugged", "status": "completed", "tag": "f3096cec-bdde-4445-96b4-77383c490018"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:40:57.057592 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6d817a1a-f600-43e0-88ec-8ebdbf3ac867 req-58b0f7ac-51dd-4f48-ad28-241df84fa1a3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:57.058055 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-6d817a1a-f600-43e0-88ec-8ebdbf3ac867 req-58b0f7ac-51dd-4f48-ad28-241df84fa1a3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:57.070374 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-6d817a1a-f600-43e0-88ec-8ebdbf3ac867 req-58b0f7ac-51dd-4f48-ad28-241df84fa1a3 service nova] Creating event network-vif-unplugged:f3096cec-bdde-4445-96b4-77383c490018 for instance 8c240119-36b9-4cff-8983-17b6e9e9a32f on nch2-master-1 Mar 05 21:40:57.075817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [req-6d817a1a-f600-43e0-88ec-8ebdbf3ac867 req-58b0f7ac-51dd-4f48-ad28-241df84fa1a3 service nova] Instance 8c240119-36b9-4cff-8983-17b6e9e9a32f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:40:57.086789 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-6d817a1a-f600-43e0-88ec-8ebdbf3ac867 req-58b0f7ac-51dd-4f48-ad28-241df84fa1a3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042298 Mar 05 21:40:57.087497 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3191/6420] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:40:57.832476 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-93cc1996-40df-4c0e-8564-f28c9ed540f1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:57.833885 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-93cc1996-40df-4c0e-8564-f28c9ed540f1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:57.840588 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93cc1996-40df-4c0e-8564-f28c9ed540f1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:57.841051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93cc1996-40df-4c0e-8564-f28c9ed540f1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:57.841833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93cc1996-40df-4c0e-8564-f28c9ed540f1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:57.842279 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-93cc1996-40df-4c0e-8564-f28c9ed540f1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:57.979202 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-93cc1996-40df-4c0e-8564-f28c9ed540f1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:57.986690 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-93cc1996-40df-4c0e-8564-f28c9ed540f1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1694 microversion: 2.1 time: 0.158957 Mar 05 21:40:57.987592 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3230/6421] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:57 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:40:59.006680 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-229c84d0-c15c-45cf-aeed-b369c0140f77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:40:59.007531 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-229c84d0-c15c-45cf-aeed-b369c0140f77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:40:59.014179 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-229c84d0-c15c-45cf-aeed-b369c0140f77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:59.014656 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-229c84d0-c15c-45cf-aeed-b369c0140f77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:59.015455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-229c84d0-c15c-45cf-aeed-b369c0140f77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:59.015956 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-229c84d0-c15c-45cf-aeed-b369c0140f77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:59.102675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-887458f0-5bbb-4cef-a05e-8bb4758825f5 req-37020707-2e99-420a-bfd3-82122cb4eb82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c240119-36b9-4cff-8983-17b6e9e9a32f", "tag": "f3096cec-bdde-4445-96b4-77383c490018"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:40:59.113089 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-887458f0-5bbb-4cef-a05e-8bb4758825f5 req-37020707-2e99-420a-bfd3-82122cb4eb82 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:40:59.113627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-887458f0-5bbb-4cef-a05e-8bb4758825f5 req-37020707-2e99-420a-bfd3-82122cb4eb82 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:40:59.125668 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-887458f0-5bbb-4cef-a05e-8bb4758825f5 req-37020707-2e99-420a-bfd3-82122cb4eb82 service nova] Creating event network-changed:f3096cec-bdde-4445-96b4-77383c490018 for instance 8c240119-36b9-4cff-8983-17b6e9e9a32f on nch2-master-1 Mar 05 21:40:59.131589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [req-887458f0-5bbb-4cef-a05e-8bb4758825f5 req-37020707-2e99-420a-bfd3-82122cb4eb82 service nova] Instance 8c240119-36b9-4cff-8983-17b6e9e9a32f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 05 21:40:59.142594 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-887458f0-5bbb-4cef-a05e-8bb4758825f5 req-37020707-2e99-420a-bfd3-82122cb4eb82 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043741 Mar 05 21:40:59.143377 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3231/6422] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:40:59.166282 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-229c84d0-c15c-45cf-aeed-b369c0140f77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:40:59.173959 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-229c84d0-c15c-45cf-aeed-b369c0140f77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1692 microversion: 2.1 time: 0.173550 Mar 05 21:40:59.175752 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3192/6423] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:40:58 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:00.192796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-609db188-b474-4122-ac67-7fffc350f4e3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:00.193418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-609db188-b474-4122-ac67-7fffc350f4e3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:00.200403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-609db188-b474-4122-ac67-7fffc350f4e3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:00.200870 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-609db188-b474-4122-ac67-7fffc350f4e3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:00.201668 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-609db188-b474-4122-ac67-7fffc350f4e3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:00.202112 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-609db188-b474-4122-ac67-7fffc350f4e3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:00.340326 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-609db188-b474-4122-ac67-7fffc350f4e3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:00.347864 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-609db188-b474-4122-ac67-7fffc350f4e3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1689 microversion: 2.1 time: 0.160106 Mar 05 21:41:00.348446 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3232/6424] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:00 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:00.364357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a2440d09-75f5-46ea-a4a4-2defd5b8fcff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:41:00.364945 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a2440d09-75f5-46ea-a4a4-2defd5b8fcff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:00.371603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a2440d09-75f5-46ea-a4a4-2defd5b8fcff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:00.372102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a2440d09-75f5-46ea-a4a4-2defd5b8fcff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:00.372885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a2440d09-75f5-46ea-a4a4-2defd5b8fcff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:00.373338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a2440d09-75f5-46ea-a4a4-2defd5b8fcff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:00.429997 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a2440d09-75f5-46ea-a4a4-2defd5b8fcff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f/action" status: 204 len: 0 microversion: 2.1 time: 0.069663 Mar 05 21:41:00.430645 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3193/6425] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:41:00 2022] POST /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:41:00.438814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-18526af3-2aa0-4076-b843-2ebe2ab05407 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:00.439423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-18526af3-2aa0-4076-b843-2ebe2ab05407 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:00.445969 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18526af3-2aa0-4076-b843-2ebe2ab05407 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:00.446361 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18526af3-2aa0-4076-b843-2ebe2ab05407 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:00.447140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18526af3-2aa0-4076-b843-2ebe2ab05407 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:00.447629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-18526af3-2aa0-4076-b843-2ebe2ab05407 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:00.586000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-18526af3-2aa0-4076-b843-2ebe2ab05407 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:00.593595 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-18526af3-2aa0-4076-b843-2ebe2ab05407 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1689 microversion: 2.1 time: 0.158697 Mar 05 21:41:00.594185 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3233/6426] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:00 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:00.610588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-19794117-6e26-4930-a7fc-54f6eba897ee tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:00.611454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-19794117-6e26-4930-a7fc-54f6eba897ee tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:00.618442 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19794117-6e26-4930-a7fc-54f6eba897ee tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:00.618808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19794117-6e26-4930-a7fc-54f6eba897ee tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:00.619599 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19794117-6e26-4930-a7fc-54f6eba897ee tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:00.620098 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-19794117-6e26-4930-a7fc-54f6eba897ee tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:00.839630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-19794117-6e26-4930-a7fc-54f6eba897ee tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:00.847181 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-19794117-6e26-4930-a7fc-54f6eba897ee tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1689 microversion: 2.1 time: 0.240998 Mar 05 21:41:00.847810 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3194/6427] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:00 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1689 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:01.865880 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5568e249-af79-4f57-8d9d-ae37d76ec17e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:01.866472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5568e249-af79-4f57-8d9d-ae37d76ec17e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:01.872995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5568e249-af79-4f57-8d9d-ae37d76ec17e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:01.873453 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5568e249-af79-4f57-8d9d-ae37d76ec17e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:01.874232 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5568e249-af79-4f57-8d9d-ae37d76ec17e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:01.874675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5568e249-af79-4f57-8d9d-ae37d76ec17e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:02.021401 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5568e249-af79-4f57-8d9d-ae37d76ec17e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:02.029437 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5568e249-af79-4f57-8d9d-ae37d76ec17e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1689 microversion: 2.1 time: 0.168753 Mar 05 21:41:02.030048 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3234/6428] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:01 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:03.047164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-181b0a1b-f5ae-48fc-9bfe-48c0a0aa3835 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:03.047850 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-181b0a1b-f5ae-48fc-9bfe-48c0a0aa3835 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:03.055328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-181b0a1b-f5ae-48fc-9bfe-48c0a0aa3835 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:03.055839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-181b0a1b-f5ae-48fc-9bfe-48c0a0aa3835 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:03.056634 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-181b0a1b-f5ae-48fc-9bfe-48c0a0aa3835 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:03.057094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-181b0a1b-f5ae-48fc-9bfe-48c0a0aa3835 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:03.280739 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-181b0a1b-f5ae-48fc-9bfe-48c0a0aa3835 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:03.288866 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-181b0a1b-f5ae-48fc-9bfe-48c0a0aa3835 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1681 microversion: 2.1 time: 0.245646 Mar 05 21:41:03.289456 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3195/6429] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:03 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:04.335782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-8f177194-37c5-48f5-9f69-12282e9ba815 req-72a174be-0d15-40b4-842c-71a06fca9b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c240119-36b9-4cff-8983-17b6e9e9a32f", "name": "network-vif-plugged", "status": "completed", "tag": "f3096cec-bdde-4445-96b4-77383c490018"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:41:04.344208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8f177194-37c5-48f5-9f69-12282e9ba815 req-72a174be-0d15-40b4-842c-71a06fca9b69 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:04.344661 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8f177194-37c5-48f5-9f69-12282e9ba815 req-72a174be-0d15-40b4-842c-71a06fca9b69 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:04.358301 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-8f177194-37c5-48f5-9f69-12282e9ba815 req-72a174be-0d15-40b4-842c-71a06fca9b69 service nova] Creating event network-vif-plugged:f3096cec-bdde-4445-96b4-77383c490018 for instance 8c240119-36b9-4cff-8983-17b6e9e9a32f on nch2-master-1 Mar 05 21:41:04.363926 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-8f177194-37c5-48f5-9f69-12282e9ba815 req-72a174be-0d15-40b4-842c-71a06fca9b69 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Mar 05 21:41:04.364710 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3235/6430] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:41:25.459808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6c844b3e-cf14-42e3-b746-a21cb0fdb817 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:41:25.460795 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6c844b3e-cf14-42e3-b746-a21cb0fdb817 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:25.467445 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c844b3e-cf14-42e3-b746-a21cb0fdb817 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:25.467961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c844b3e-cf14-42e3-b746-a21cb0fdb817 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:25.468756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c844b3e-cf14-42e3-b746-a21cb0fdb817 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:25.469215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6c844b3e-cf14-42e3-b746-a21cb0fdb817 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:25.517732 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6c844b3e-cf14-42e3-b746-a21cb0fdb817 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f/action" status: 200 len: 24576 microversion: 2.1 time: 0.062546 Mar 05 21:41:25.519165 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3196/6431] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:41:25 2022] POST /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f/action => generated 24576 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:41:32.884928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-e9137b8e-e707-4c40-b6c4-05798a4fdfab req-83bded0d-365b-40eb-a7cd-fc4b770b706c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c240119-36b9-4cff-8983-17b6e9e9a32f", "tag": "f3096cec-bdde-4445-96b4-77383c490018"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:41:32.888182 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2f9b5fd7-856a-4c81-ba58-a851080773d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:32.890809 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2f9b5fd7-856a-4c81-ba58-a851080773d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:32.899087 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e9137b8e-e707-4c40-b6c4-05798a4fdfab req-83bded0d-365b-40eb-a7cd-fc4b770b706c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:32.899552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-e9137b8e-e707-4c40-b6c4-05798a4fdfab req-83bded0d-365b-40eb-a7cd-fc4b770b706c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:32.900135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f9b5fd7-856a-4c81-ba58-a851080773d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:32.900675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f9b5fd7-856a-4c81-ba58-a851080773d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:32.901541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f9b5fd7-856a-4c81-ba58-a851080773d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:32.902061 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2f9b5fd7-856a-4c81-ba58-a851080773d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:32.914424 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-e9137b8e-e707-4c40-b6c4-05798a4fdfab req-83bded0d-365b-40eb-a7cd-fc4b770b706c service nova] Creating event network-changed:f3096cec-bdde-4445-96b4-77383c490018 for instance 8c240119-36b9-4cff-8983-17b6e9e9a32f on nch2-master-1 Mar 05 21:41:32.919659 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-e9137b8e-e707-4c40-b6c4-05798a4fdfab req-83bded0d-365b-40eb-a7cd-fc4b770b706c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038898 Mar 05 21:41:32.920752 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3197/6432] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:41:32.931576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2f9b5fd7-856a-4c81-ba58-a851080773d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:41:33.019982 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2f9b5fd7-856a-4c81-ba58-a851080773d1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 204 len: 0 microversion: 2.1 time: 0.144130 Mar 05 21:41:33.024862 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3236/6433] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:41:32 2022] DELETE /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:41:33.030595 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-575087e8-ff86-4193-86d8-f45e802c0da7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:33.031339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-575087e8-ff86-4193-86d8-f45e802c0da7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:33.039169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-575087e8-ff86-4193-86d8-f45e802c0da7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:33.040010 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-575087e8-ff86-4193-86d8-f45e802c0da7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:33.040948 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-575087e8-ff86-4193-86d8-f45e802c0da7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:33.041418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-575087e8-ff86-4193-86d8-f45e802c0da7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:33.280276 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-575087e8-ff86-4193-86d8-f45e802c0da7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:33.288577 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-575087e8-ff86-4193-86d8-f45e802c0da7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1687 microversion: 2.1 time: 0.262830 Mar 05 21:41:33.298680 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3198/6434] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:33 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1687 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:34.306304 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-59086e08-9f2d-47d4-8698-2a4d3c5e7bef tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:34.306938 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-59086e08-9f2d-47d4-8698-2a4d3c5e7bef tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:34.313800 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59086e08-9f2d-47d4-8698-2a4d3c5e7bef tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:34.314268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59086e08-9f2d-47d4-8698-2a4d3c5e7bef tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:34.315051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59086e08-9f2d-47d4-8698-2a4d3c5e7bef tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:34.315503 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-59086e08-9f2d-47d4-8698-2a4d3c5e7bef tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:34.459507 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-59086e08-9f2d-47d4-8698-2a4d3c5e7bef tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:34.467038 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-59086e08-9f2d-47d4-8698-2a4d3c5e7bef tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 200 len: 1568 microversion: 2.1 time: 0.165104 Mar 05 21:41:34.467615 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3237/6435] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:34 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:41:34.796222 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-25bd401d-f632-4f8e-a5f5-7d24fb8823e6 req-f39173ce-adfe-425f-9f8b-6d4e7683dd4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c240119-36b9-4cff-8983-17b6e9e9a32f", "name": "network-vif-deleted", "tag": "f3096cec-bdde-4445-96b4-77383c490018"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:41:34.805170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-25bd401d-f632-4f8e-a5f5-7d24fb8823e6 req-f39173ce-adfe-425f-9f8b-6d4e7683dd4a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:34.805633 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-25bd401d-f632-4f8e-a5f5-7d24fb8823e6 req-f39173ce-adfe-425f-9f8b-6d4e7683dd4a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:34.817784 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-25bd401d-f632-4f8e-a5f5-7d24fb8823e6 req-f39173ce-adfe-425f-9f8b-6d4e7683dd4a service nova] Creating event network-vif-deleted:f3096cec-bdde-4445-96b4-77383c490018 for instance 8c240119-36b9-4cff-8983-17b6e9e9a32f on nch2-master-1 Mar 05 21:41:34.822700 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-25bd401d-f632-4f8e-a5f5-7d24fb8823e6 req-f39173ce-adfe-425f-9f8b-6d4e7683dd4a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030110 Mar 05 21:41:34.823438 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3199/6436] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:41:35.485728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1355e893-a64b-4d84-bb09-6d253fb8dd77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:35.486348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1355e893-a64b-4d84-bb09-6d253fb8dd77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 8c240119-36b9-4cff-8983-17b6e9e9a32f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:35.493150 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1355e893-a64b-4d84-bb09-6d253fb8dd77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:35.493606 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1355e893-a64b-4d84-bb09-6d253fb8dd77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:35.494379 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1355e893-a64b-4d84-bb09-6d253fb8dd77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:35.494824 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1355e893-a64b-4d84-bb09-6d253fb8dd77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:35.508596 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-1355e893-a64b-4d84-bb09-6d253fb8dd77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] HTTP exception thrown: Instance 8c240119-36b9-4cff-8983-17b6e9e9a32f could not be found. Mar 05 21:41:35.509171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1355e893-a64b-4d84-bb09-6d253fb8dd77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Returning 404 to user: Instance 8c240119-36b9-4cff-8983-17b6e9e9a32f could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:41:35.509991 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1355e893-a64b-4d84-bb09-6d253fb8dd77 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f" status: 404 len: 111 microversion: 2.1 time: 0.028286 Mar 05 21:41:35.510527 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3238/6437] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:35 2022] GET /compute/v2.1/servers/8c240119-36b9-4cff-8983-17b6e9e9a32f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:41:38.546772 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-24b120f6-4042-4fb9-b952-d0ec9581dff4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '.version_select at 0x7fed5c2044c0>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:38.573762 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-24b120f6-4042-4fb9-b952-d0ec9581dff4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-280585580" status: 202 len: 0 microversion: 2.1 time: 0.032046 Mar 05 21:41:38.574750 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3200/6438] 10.222.0.15 () {58 vars in 1280 bytes} [Sat Mar 5 21:41:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-280585580 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:41:38.597744 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-69b627e4-8a2e-4c2b-9149-ed72d52980a6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'create', calling method: .version_select at 0x7fed5c123040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1926026174"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:41:38.612303 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-69b627e4-8a2e-4c2b-9149-ed72d52980a6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:41:38.618979 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-69b627e4-8a2e-4c2b-9149-ed72d52980a6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:41:38.843936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-69b627e4-8a2e-4c2b-9149-ed72d52980a6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:41:38.849709 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-69b627e4-8a2e-4c2b-9149-ed72d52980a6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:41:38.863975 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-69b627e4-8a2e-4c2b-9149-ed72d52980a6 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.270893 Mar 05 21:41:38.864801 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3239/6439] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:41:38 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:41:44.435110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1860848220", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "59d309d2-9366-48d5-8459-0809b8a4c02c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1926026174", "security_groups": [{"name": "tempest-secgroup-smoke-528212507"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:41:44.561181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] validate_networks() for [('59d309d2-9366-48d5-8459-0809b8a4c02c', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:41:44.977139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:41:44.977693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:41:44.978355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:41:44.978852 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:41:44.979283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:41:44.988322 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:44.988786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:44.989820 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:44.990251 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:45.007111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:41:45.012589 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:41:45.025325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:41:45.027744 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:41:45.074277 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e76a219e-20d5-4702-b713-e16b0d165ec4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.644068 Mar 05 21:41:45.079908 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3201/6440] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:41:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:41:45.090148 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-97027725-cc1a-4abb-a743-b175cb4074a7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:45.090882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-97027725-cc1a-4abb-a743-b175cb4074a7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:45.149381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-97027725-cc1a-4abb-a743-b175cb4074a7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:45.156769 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-97027725-cc1a-4abb-a743-b175cb4074a7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1267 microversion: 2.1 time: 0.075388 Mar 05 21:41:45.157695 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3240/6441] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:45 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1267 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:46.174180 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-da165bfa-382b-4964-ab61-22a619887afe tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:46.174972 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-da165bfa-382b-4964-ab61-22a619887afe tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:46.193060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-da165bfa-382b-4964-ab61-22a619887afe tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:46.193540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-da165bfa-382b-4964-ab61-22a619887afe tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:46.194351 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-da165bfa-382b-4964-ab61-22a619887afe tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:46.194810 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-da165bfa-382b-4964-ab61-22a619887afe tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:46.274613 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-da165bfa-382b-4964-ab61-22a619887afe tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:46.282820 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-da165bfa-382b-4964-ab61-22a619887afe tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1325 microversion: 2.1 time: 0.113377 Mar 05 21:41:46.283489 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3202/6442] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:46 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1325 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:41:47.300827 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a0f917cb-a133-486f-bf9c-31a2ef31db73 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:47.302151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a0f917cb-a133-486f-bf9c-31a2ef31db73 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:47.311048 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0f917cb-a133-486f-bf9c-31a2ef31db73 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:47.311522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0f917cb-a133-486f-bf9c-31a2ef31db73 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:47.312353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0f917cb-a133-486f-bf9c-31a2ef31db73 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:47.312803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a0f917cb-a133-486f-bf9c-31a2ef31db73 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:47.564291 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a0f917cb-a133-486f-bf9c-31a2ef31db73 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:47.576136 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a0f917cb-a133-486f-bf9c-31a2ef31db73 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1392 microversion: 2.1 time: 0.279912 Mar 05 21:41:47.587925 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3241/6443] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:47 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1392 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:47.796146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8bd44200-e57e-4b72-8464-d608701967e7 req-86410466-8a06-49b4-b9a6-8a33d323e33d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83db2da3-8d9a-44d0-a5ef-4a83749b4599", "tag": "8e592400-3f76-4823-a4dd-9c5dd6f01dfb"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:41:47.807381 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8bd44200-e57e-4b72-8464-d608701967e7 req-86410466-8a06-49b4-b9a6-8a33d323e33d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:47.808089 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8bd44200-e57e-4b72-8464-d608701967e7 req-86410466-8a06-49b4-b9a6-8a33d323e33d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:47.822942 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8bd44200-e57e-4b72-8464-d608701967e7 req-86410466-8a06-49b4-b9a6-8a33d323e33d service nova] Creating event network-changed:8e592400-3f76-4823-a4dd-9c5dd6f01dfb for instance 83db2da3-8d9a-44d0-a5ef-4a83749b4599 on nch1-master-1 Mar 05 21:41:47.829368 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-8bd44200-e57e-4b72-8464-d608701967e7 req-86410466-8a06-49b4-b9a6-8a33d323e33d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169873 Mar 05 21:41:47.830123 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3203/6444] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:41:48.594205 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4a0fc450-4a66-4b16-8fb1-2967662513c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:48.594753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4a0fc450-4a66-4b16-8fb1-2967662513c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:48.602549 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a0fc450-4a66-4b16-8fb1-2967662513c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:48.603014 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a0fc450-4a66-4b16-8fb1-2967662513c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:48.603845 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a0fc450-4a66-4b16-8fb1-2967662513c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:48.604297 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4a0fc450-4a66-4b16-8fb1-2967662513c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:48.743600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4a0fc450-4a66-4b16-8fb1-2967662513c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:48.751279 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4a0fc450-4a66-4b16-8fb1-2967662513c3 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1392 microversion: 2.1 time: 0.161038 Mar 05 21:41:48.751885 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3242/6445] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:48 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:49.769416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-faa007a8-e56d-4707-b95f-f4b7faf3659b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:49.770068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-faa007a8-e56d-4707-b95f-f4b7faf3659b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:49.777018 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-faa007a8-e56d-4707-b95f-f4b7faf3659b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:49.777487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-faa007a8-e56d-4707-b95f-f4b7faf3659b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:49.778268 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-faa007a8-e56d-4707-b95f-f4b7faf3659b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:49.778722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-faa007a8-e56d-4707-b95f-f4b7faf3659b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:49.917451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-faa007a8-e56d-4707-b95f-f4b7faf3659b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:49.924801 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-faa007a8-e56d-4707-b95f-f4b7faf3659b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1392 microversion: 2.1 time: 0.159937 Mar 05 21:41:49.926068 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3204/6446] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:49 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:50.942312 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0d4598a0-4ea6-47c0-a654-bf2262d2b46b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:50.942967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0d4598a0-4ea6-47c0-a654-bf2262d2b46b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:50.949903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d4598a0-4ea6-47c0-a654-bf2262d2b46b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:50.950359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d4598a0-4ea6-47c0-a654-bf2262d2b46b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:50.951146 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d4598a0-4ea6-47c0-a654-bf2262d2b46b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:50.951596 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0d4598a0-4ea6-47c0-a654-bf2262d2b46b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:51.094654 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0d4598a0-4ea6-47c0-a654-bf2262d2b46b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:51.102196 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0d4598a0-4ea6-47c0-a654-bf2262d2b46b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1392 microversion: 2.1 time: 0.163802 Mar 05 21:41:51.102802 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3243/6447] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:50 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:52.119703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1f673179-58e7-4df0-9563-879ff0161c42 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:52.120389 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1f673179-58e7-4df0-9563-879ff0161c42 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:52.127528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f673179-58e7-4df0-9563-879ff0161c42 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:52.128060 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f673179-58e7-4df0-9563-879ff0161c42 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:52.128856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f673179-58e7-4df0-9563-879ff0161c42 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:52.129346 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1f673179-58e7-4df0-9563-879ff0161c42 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:52.261580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1f673179-58e7-4df0-9563-879ff0161c42 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:52.269546 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1f673179-58e7-4df0-9563-879ff0161c42 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1392 microversion: 2.1 time: 0.154040 Mar 05 21:41:52.270281 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3205/6448] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:52 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:52.954521 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ce407a91-9eab-471b-8b6b-17aca0837d67 req-0a961d9b-ff6b-4a1a-98bf-d12bd204fcab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83db2da3-8d9a-44d0-a5ef-4a83749b4599", "name": "network-vif-plugged", "status": "completed", "tag": "8e592400-3f76-4823-a4dd-9c5dd6f01dfb"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:41:52.963512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ce407a91-9eab-471b-8b6b-17aca0837d67 req-0a961d9b-ff6b-4a1a-98bf-d12bd204fcab service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:52.963913 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ce407a91-9eab-471b-8b6b-17aca0837d67 req-0a961d9b-ff6b-4a1a-98bf-d12bd204fcab service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:52.975376 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ce407a91-9eab-471b-8b6b-17aca0837d67 req-0a961d9b-ff6b-4a1a-98bf-d12bd204fcab service nova] Creating event network-vif-plugged:8e592400-3f76-4823-a4dd-9c5dd6f01dfb for instance 83db2da3-8d9a-44d0-a5ef-4a83749b4599 on nch1-master-1 Mar 05 21:41:52.980468 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ce407a91-9eab-471b-8b6b-17aca0837d67 req-0a961d9b-ff6b-4a1a-98bf-d12bd204fcab service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029769 Mar 05 21:41:52.981074 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3244/6449] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:41:53.335974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2d72e2d9-9596-4477-b864-8109076b532a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:53.336682 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2d72e2d9-9596-4477-b864-8109076b532a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:53.342537 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d72e2d9-9596-4477-b864-8109076b532a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:53.343000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d72e2d9-9596-4477-b864-8109076b532a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:53.343814 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d72e2d9-9596-4477-b864-8109076b532a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:53.344270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2d72e2d9-9596-4477-b864-8109076b532a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:53.477242 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2d72e2d9-9596-4477-b864-8109076b532a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:53.484561 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2d72e2d9-9596-4477-b864-8109076b532a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1392 microversion: 2.1 time: 0.202360 Mar 05 21:41:53.485138 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3206/6450] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:53 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:54.504456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-bb78d32a-b08e-4df1-94cc-4ffa7737cd59 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:54.505082 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-bb78d32a-b08e-4df1-94cc-4ffa7737cd59 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:54.511245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb78d32a-b08e-4df1-94cc-4ffa7737cd59 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:54.511765 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb78d32a-b08e-4df1-94cc-4ffa7737cd59 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:54.512537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb78d32a-b08e-4df1-94cc-4ffa7737cd59 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:54.512976 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-bb78d32a-b08e-4df1-94cc-4ffa7737cd59 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:54.666129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-bb78d32a-b08e-4df1-94cc-4ffa7737cd59 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:54.673651 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-bb78d32a-b08e-4df1-94cc-4ffa7737cd59 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1564 microversion: 2.1 time: 0.174982 Mar 05 21:41:54.674229 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3245/6451] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:54 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:54.690110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-11ad16f7-ee73-43d3-81c5-5bfa4b22b5fa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:54.691577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-11ad16f7-ee73-43d3-81c5-5bfa4b22b5fa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:54.698469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11ad16f7-ee73-43d3-81c5-5bfa4b22b5fa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:54.698943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11ad16f7-ee73-43d3-81c5-5bfa4b22b5fa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:54.699777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11ad16f7-ee73-43d3-81c5-5bfa4b22b5fa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:54.700243 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-11ad16f7-ee73-43d3-81c5-5bfa4b22b5fa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:54.837292 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-11ad16f7-ee73-43d3-81c5-5bfa4b22b5fa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:54.844797 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-11ad16f7-ee73-43d3-81c5-5bfa4b22b5fa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1564 microversion: 2.1 time: 0.158563 Mar 05 21:41:54.845389 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3207/6452] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:54 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:41:56.836850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-df5e6323-c5a2-4eb7-8f54-9cf42c1c1874 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:41:56.837703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-df5e6323-c5a2-4eb7-8f54-9cf42c1c1874 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:41:56.840253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-49bab5fe-3d31-48b0-893e-d9407092c471 req-ea8c77f3-d9e6-4496-8b93-b322c4f00c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83db2da3-8d9a-44d0-a5ef-4a83749b4599", "tag": "8e592400-3f76-4823-a4dd-9c5dd6f01dfb"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:41:56.844994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-df5e6323-c5a2-4eb7-8f54-9cf42c1c1874 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:56.845458 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-df5e6323-c5a2-4eb7-8f54-9cf42c1c1874 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:56.846251 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-df5e6323-c5a2-4eb7-8f54-9cf42c1c1874 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:56.846703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-df5e6323-c5a2-4eb7-8f54-9cf42c1c1874 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:56.855922 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-49bab5fe-3d31-48b0-893e-d9407092c471 req-ea8c77f3-d9e6-4496-8b93-b322c4f00c67 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:41:56.856397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-49bab5fe-3d31-48b0-893e-d9407092c471 req-ea8c77f3-d9e6-4496-8b93-b322c4f00c67 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:41:56.871634 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-49bab5fe-3d31-48b0-893e-d9407092c471 req-ea8c77f3-d9e6-4496-8b93-b322c4f00c67 service nova] Creating event network-changed:8e592400-3f76-4823-a4dd-9c5dd6f01dfb for instance 83db2da3-8d9a-44d0-a5ef-4a83749b4599 on nch1-master-1 Mar 05 21:41:56.877595 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-49bab5fe-3d31-48b0-893e-d9407092c471 req-ea8c77f3-d9e6-4496-8b93-b322c4f00c67 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041623 Mar 05 21:41:56.878235 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3208/6453] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:41:57.003432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-df5e6323-c5a2-4eb7-8f54-9cf42c1c1874 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:41:57.012651 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-df5e6323-c5a2-4eb7-8f54-9cf42c1c1874 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1564 microversion: 2.1 time: 0.180721 Mar 05 21:41:57.013496 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3246/6454] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:41:56 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1564 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:18.279169 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2587195a-f8b4-4d6d-a716-1f11b9e3c98f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:42:18.280144 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2587195a-f8b4-4d6d-a716-1f11b9e3c98f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:18.286376 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2587195a-f8b4-4d6d-a716-1f11b9e3c98f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:18.286837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2587195a-f8b4-4d6d-a716-1f11b9e3c98f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:18.287616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2587195a-f8b4-4d6d-a716-1f11b9e3c98f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:18.288092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2587195a-f8b4-4d6d-a716-1f11b9e3c98f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:18.339773 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2587195a-f8b4-4d6d-a716-1f11b9e3c98f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599/action" status: 200 len: 24571 microversion: 2.1 time: 0.065761 Mar 05 21:42:18.340404 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3209/6455] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:42:18 2022] POST /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:42:29.357967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b4d6c68b-9984-4e84-878d-7ced8c9709c1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:42:29.364763 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4d6c68b-9984-4e84-878d-7ced8c9709c1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:29.365229 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b4d6c68b-9984-4e84-878d-7ced8c9709c1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:29.388330 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b4d6c68b-9984-4e84-878d-7ced8c9709c1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Going to try to stop instance {{(pid=141479) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 05 21:42:29.430698 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b4d6c68b-9984-4e84-878d-7ced8c9709c1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599/action" status: 202 len: 0 microversion: 2.1 time: 0.076576 Mar 05 21:42:29.431310 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3247/6456] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:42:29 2022] POST /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:42:29.440096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ac05c389-759a-4b33-b058-8ede0e337e7f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:29.440884 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ac05c389-759a-4b33-b058-8ede0e337e7f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:29.449122 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac05c389-759a-4b33-b058-8ede0e337e7f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:29.449596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac05c389-759a-4b33-b058-8ede0e337e7f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:29.450789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac05c389-759a-4b33-b058-8ede0e337e7f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:29.451253 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ac05c389-759a-4b33-b058-8ede0e337e7f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:29.600509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ac05c389-759a-4b33-b058-8ede0e337e7f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:29.608096 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ac05c389-759a-4b33-b058-8ede0e337e7f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.172257 Mar 05 21:42:29.608612 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3210/6457] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:29 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:30.626924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-da927f9f-2541-40ec-8536-b6a21dc2a5fc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:30.627638 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-da927f9f-2541-40ec-8536-b6a21dc2a5fc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:30.634772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da927f9f-2541-40ec-8536-b6a21dc2a5fc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:30.635228 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da927f9f-2541-40ec-8536-b6a21dc2a5fc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:30.636037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da927f9f-2541-40ec-8536-b6a21dc2a5fc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:30.636478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da927f9f-2541-40ec-8536-b6a21dc2a5fc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:30.776125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-da927f9f-2541-40ec-8536-b6a21dc2a5fc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:30.783540 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-da927f9f-2541-40ec-8536-b6a21dc2a5fc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.160925 Mar 05 21:42:30.784158 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3248/6458] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:30 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:31.801065 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-db317b7b-2753-4140-9d2f-d5a187c41a3a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:31.801609 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-db317b7b-2753-4140-9d2f-d5a187c41a3a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:31.808587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db317b7b-2753-4140-9d2f-d5a187c41a3a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:31.809057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db317b7b-2753-4140-9d2f-d5a187c41a3a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:31.809836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db317b7b-2753-4140-9d2f-d5a187c41a3a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:31.810286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-db317b7b-2753-4140-9d2f-d5a187c41a3a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:31.946171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-db317b7b-2753-4140-9d2f-d5a187c41a3a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:31.953729 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-db317b7b-2753-4140-9d2f-d5a187c41a3a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.156846 Mar 05 21:42:31.954321 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3211/6459] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:31 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:32.970384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-24e26bbb-beec-445e-9603-74c6f27da769 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:32.971039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-24e26bbb-beec-445e-9603-74c6f27da769 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:32.978090 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-24e26bbb-beec-445e-9603-74c6f27da769 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:32.978541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-24e26bbb-beec-445e-9603-74c6f27da769 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:32.979316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-24e26bbb-beec-445e-9603-74c6f27da769 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:32.979798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-24e26bbb-beec-445e-9603-74c6f27da769 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:33.115198 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-24e26bbb-beec-445e-9603-74c6f27da769 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:33.123074 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-24e26bbb-beec-445e-9603-74c6f27da769 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.156635 Mar 05 21:42:33.123653 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3249/6460] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:32 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:34.141111 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-22213d9c-59ac-4253-9082-3f7c5dcd7a14 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:34.141665 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-22213d9c-59ac-4253-9082-3f7c5dcd7a14 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:34.149003 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22213d9c-59ac-4253-9082-3f7c5dcd7a14 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:34.149467 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22213d9c-59ac-4253-9082-3f7c5dcd7a14 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:34.150278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22213d9c-59ac-4253-9082-3f7c5dcd7a14 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:34.150731 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-22213d9c-59ac-4253-9082-3f7c5dcd7a14 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:34.287295 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-22213d9c-59ac-4253-9082-3f7c5dcd7a14 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:34.294854 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-22213d9c-59ac-4253-9082-3f7c5dcd7a14 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.157748 Mar 05 21:42:34.295652 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3212/6461] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:34 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:35.312712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e3fd6d16-9c5e-4c30-9d95-78f7dd000561 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:35.313259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e3fd6d16-9c5e-4c30-9d95-78f7dd000561 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:35.320787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3fd6d16-9c5e-4c30-9d95-78f7dd000561 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:35.321233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3fd6d16-9c5e-4c30-9d95-78f7dd000561 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:35.322017 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3fd6d16-9c5e-4c30-9d95-78f7dd000561 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:35.322459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e3fd6d16-9c5e-4c30-9d95-78f7dd000561 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:35.462186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e3fd6d16-9c5e-4c30-9d95-78f7dd000561 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:35.469742 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e3fd6d16-9c5e-4c30-9d95-78f7dd000561 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.161106 Mar 05 21:42:35.470323 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3250/6462] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:35 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:36.486300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-503b45d3-6378-431b-a5df-e1a0b53a19a5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:36.487116 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-503b45d3-6378-431b-a5df-e1a0b53a19a5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:36.495630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-503b45d3-6378-431b-a5df-e1a0b53a19a5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:36.496118 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-503b45d3-6378-431b-a5df-e1a0b53a19a5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:36.496903 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-503b45d3-6378-431b-a5df-e1a0b53a19a5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:36.497354 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-503b45d3-6378-431b-a5df-e1a0b53a19a5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:36.634639 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-503b45d3-6378-431b-a5df-e1a0b53a19a5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:36.642031 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-503b45d3-6378-431b-a5df-e1a0b53a19a5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.159671 Mar 05 21:42:36.642820 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3213/6463] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:36 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:37.660129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-00ba0838-051a-4979-9afa-c673d0c77427 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:37.660677 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-00ba0838-051a-4979-9afa-c673d0c77427 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:37.668436 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00ba0838-051a-4979-9afa-c673d0c77427 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:37.668903 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00ba0838-051a-4979-9afa-c673d0c77427 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:37.669686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00ba0838-051a-4979-9afa-c673d0c77427 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:37.670130 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-00ba0838-051a-4979-9afa-c673d0c77427 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:37.804009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-00ba0838-051a-4979-9afa-c673d0c77427 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:37.811696 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-00ba0838-051a-4979-9afa-c673d0c77427 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.155592 Mar 05 21:42:37.812294 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3251/6464] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:37 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:38.829017 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a18db04f-ce13-4390-aa19-6c5100d928fb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:38.829653 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a18db04f-ce13-4390-aa19-6c5100d928fb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:38.836450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a18db04f-ce13-4390-aa19-6c5100d928fb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:38.836974 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a18db04f-ce13-4390-aa19-6c5100d928fb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:38.838204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a18db04f-ce13-4390-aa19-6c5100d928fb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:38.838662 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a18db04f-ce13-4390-aa19-6c5100d928fb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:38.972256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a18db04f-ce13-4390-aa19-6c5100d928fb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:38.980287 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a18db04f-ce13-4390-aa19-6c5100d928fb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.155264 Mar 05 21:42:38.980865 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3214/6465] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:38 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:39.997473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f681f9be-0846-42c3-b72a-3f38203f9599 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:39.998154 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f681f9be-0846-42c3-b72a-3f38203f9599 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:40.004893 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f681f9be-0846-42c3-b72a-3f38203f9599 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:40.005354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f681f9be-0846-42c3-b72a-3f38203f9599 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:40.006135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f681f9be-0846-42c3-b72a-3f38203f9599 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:40.006582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f681f9be-0846-42c3-b72a-3f38203f9599 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:40.144808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f681f9be-0846-42c3-b72a-3f38203f9599 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:40.153302 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f681f9be-0846-42c3-b72a-3f38203f9599 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.160669 Mar 05 21:42:40.153878 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3252/6466] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:39 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:41.170627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9a62de47-89ed-44e8-870f-e1a15392b7ba tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:41.171215 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9a62de47-89ed-44e8-870f-e1a15392b7ba tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:41.178040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a62de47-89ed-44e8-870f-e1a15392b7ba tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:41.178519 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a62de47-89ed-44e8-870f-e1a15392b7ba tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:41.179320 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a62de47-89ed-44e8-870f-e1a15392b7ba tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:41.179832 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9a62de47-89ed-44e8-870f-e1a15392b7ba tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:41.319513 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9a62de47-89ed-44e8-870f-e1a15392b7ba tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:41.327628 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9a62de47-89ed-44e8-870f-e1a15392b7ba tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.161090 Mar 05 21:42:41.328242 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3215/6467] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:41 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:42.344437 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7d3ec09e-d018-45f1-81ad-7e082d5ad36f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:42.345062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7d3ec09e-d018-45f1-81ad-7e082d5ad36f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:42.351840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d3ec09e-d018-45f1-81ad-7e082d5ad36f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:42.352301 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d3ec09e-d018-45f1-81ad-7e082d5ad36f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:42.353858 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d3ec09e-d018-45f1-81ad-7e082d5ad36f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:42.354295 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7d3ec09e-d018-45f1-81ad-7e082d5ad36f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:42.487456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7d3ec09e-d018-45f1-81ad-7e082d5ad36f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:42.495256 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7d3ec09e-d018-45f1-81ad-7e082d5ad36f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.154505 Mar 05 21:42:42.495864 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3253/6468] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:42 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:43.512392 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cc1dd2e9-286d-4d47-b215-dbecc30135ec tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:43.513088 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cc1dd2e9-286d-4d47-b215-dbecc30135ec tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:43.519902 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc1dd2e9-286d-4d47-b215-dbecc30135ec tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:43.520370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc1dd2e9-286d-4d47-b215-dbecc30135ec tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:43.521157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc1dd2e9-286d-4d47-b215-dbecc30135ec tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:43.521606 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cc1dd2e9-286d-4d47-b215-dbecc30135ec tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:43.656309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cc1dd2e9-286d-4d47-b215-dbecc30135ec tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:43.663730 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cc1dd2e9-286d-4d47-b215-dbecc30135ec tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.155243 Mar 05 21:42:43.664305 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3216/6469] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:43 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:44.682339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a9368101-3d29-4797-90b2-e99226889791 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:44.683073 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a9368101-3d29-4797-90b2-e99226889791 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:44.690096 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9368101-3d29-4797-90b2-e99226889791 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:44.690561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9368101-3d29-4797-90b2-e99226889791 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:44.691354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9368101-3d29-4797-90b2-e99226889791 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:44.691832 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a9368101-3d29-4797-90b2-e99226889791 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:44.829365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a9368101-3d29-4797-90b2-e99226889791 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:44.837363 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a9368101-3d29-4797-90b2-e99226889791 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1693 microversion: 2.1 time: 0.159407 Mar 05 21:42:44.838064 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3254/6470] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:44 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:45.854982 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a4add537-d6e6-412d-ac94-a712c6f3c2db tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:45.855622 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a4add537-d6e6-412d-ac94-a712c6f3c2db tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:45.862484 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a4add537-d6e6-412d-ac94-a712c6f3c2db tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:45.862957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a4add537-d6e6-412d-ac94-a712c6f3c2db tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:45.863774 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a4add537-d6e6-412d-ac94-a712c6f3c2db tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:45.864232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a4add537-d6e6-412d-ac94-a712c6f3c2db tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:46.001955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a4add537-d6e6-412d-ac94-a712c6f3c2db tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:46.010113 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a4add537-d6e6-412d-ac94-a712c6f3c2db tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1670 microversion: 2.1 time: 0.159369 Mar 05 21:42:46.010703 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3217/6471] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:45 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:47.103196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1ebe577b-f046-478b-a836-455585e2894c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:42:47.104313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1ebe577b-f046-478b-a836-455585e2894c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:47.111037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ebe577b-f046-478b-a836-455585e2894c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:47.111502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ebe577b-f046-478b-a836-455585e2894c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:47.112317 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ebe577b-f046-478b-a836-455585e2894c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:47.112765 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1ebe577b-f046-478b-a836-455585e2894c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:47.161548 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1ebe577b-f046-478b-a836-455585e2894c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599/action" status: 200 len: 38439 microversion: 2.1 time: 0.062736 Mar 05 21:42:47.162115 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3255/6472] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:42:47 2022] POST /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599/action => generated 38439 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:42:47.173663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-34936ee7-91a3-4f1f-8a34-7ee597f03ee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:42:47.181630 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-34936ee7-91a3-4f1f-8a34-7ee597f03ee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:47.182102 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-34936ee7-91a3-4f1f-8a34-7ee597f03ee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:47.203643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-34936ee7-91a3-4f1f-8a34-7ee597f03ee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Going to try to start instance {{(pid=141478) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 05 21:42:47.245510 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-34936ee7-91a3-4f1f-8a34-7ee597f03ee4 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599/action" status: 202 len: 0 microversion: 2.1 time: 0.075182 Mar 05 21:42:47.246129 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3218/6473] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:42:47 2022] POST /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:42:47.254908 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cce644f1-a45b-4071-afca-60ac56c30416 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:47.255864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cce644f1-a45b-4071-afca-60ac56c30416 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:47.263459 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cce644f1-a45b-4071-afca-60ac56c30416 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:47.263945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cce644f1-a45b-4071-afca-60ac56c30416 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:47.264725 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cce644f1-a45b-4071-afca-60ac56c30416 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:47.265169 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cce644f1-a45b-4071-afca-60ac56c30416 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:47.407607 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cce644f1-a45b-4071-afca-60ac56c30416 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:47.417552 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cce644f1-a45b-4071-afca-60ac56c30416 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1679 microversion: 2.1 time: 0.166674 Mar 05 21:42:47.419836 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3256/6474] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:47 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:42:48.437500 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8cc56850-0f93-4952-a4ef-1250f7c89ecc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:42:48.438229 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8cc56850-0f93-4952-a4ef-1250f7c89ecc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:42:48.444473 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cc56850-0f93-4952-a4ef-1250f7c89ecc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:48.444949 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cc56850-0f93-4952-a4ef-1250f7c89ecc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:48.445744 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cc56850-0f93-4952-a4ef-1250f7c89ecc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:42:48.446868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cc56850-0f93-4952-a4ef-1250f7c89ecc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:42:48.589186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8cc56850-0f93-4952-a4ef-1250f7c89ecc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:42:48.596666 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8cc56850-0f93-4952-a4ef-1250f7c89ecc tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1683 microversion: 2.1 time: 0.164335 Mar 05 21:42:48.597251 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3219/6475] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:42:48 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:12.780993 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-230286b5-6420-4401-84bc-adea58cfd0d9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:43:12.781930 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-230286b5-6420-4401-84bc-adea58cfd0d9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:12.788316 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-230286b5-6420-4401-84bc-adea58cfd0d9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:12.788772 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-230286b5-6420-4401-84bc-adea58cfd0d9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:12.789769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-230286b5-6420-4401-84bc-adea58cfd0d9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:12.790212 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-230286b5-6420-4401-84bc-adea58cfd0d9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:12.840745 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-230286b5-6420-4401-84bc-adea58cfd0d9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599/action" status: 200 len: 62990 microversion: 2.1 time: 0.063746 Mar 05 21:43:12.841411 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3257/6476] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:43:12 2022] POST /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599/action => generated 62990 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:43:20.217390 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1df10f6e-579f-4fd2-98dd-ea33ceac0a18 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:20.218117 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1df10f6e-579f-4fd2-98dd-ea33ceac0a18 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:20.221444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b0369eae-0828-448b-9c7f-8dc04634ef17 req-61e4aba9-1e85-4892-b293-4c8da08f3f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83db2da3-8d9a-44d0-a5ef-4a83749b4599", "tag": "8e592400-3f76-4823-a4dd-9c5dd6f01dfb"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:43:20.224891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1df10f6e-579f-4fd2-98dd-ea33ceac0a18 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:20.225372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1df10f6e-579f-4fd2-98dd-ea33ceac0a18 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:20.226181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1df10f6e-579f-4fd2-98dd-ea33ceac0a18 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:20.226645 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1df10f6e-579f-4fd2-98dd-ea33ceac0a18 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:20.234485 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b0369eae-0828-448b-9c7f-8dc04634ef17 req-61e4aba9-1e85-4892-b293-4c8da08f3f0d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:20.235386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b0369eae-0828-448b-9c7f-8dc04634ef17 req-61e4aba9-1e85-4892-b293-4c8da08f3f0d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:20.248948 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b0369eae-0828-448b-9c7f-8dc04634ef17 req-61e4aba9-1e85-4892-b293-4c8da08f3f0d service nova] Creating event network-changed:8e592400-3f76-4823-a4dd-9c5dd6f01dfb for instance 83db2da3-8d9a-44d0-a5ef-4a83749b4599 on nch1-master-1 Mar 05 21:43:20.253021 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1df10f6e-579f-4fd2-98dd-ea33ceac0a18 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Going to try to terminate instance {{(pid=141478) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:43:20.254927 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b0369eae-0828-448b-9c7f-8dc04634ef17 req-61e4aba9-1e85-4892-b293-4c8da08f3f0d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038132 Mar 05 21:43:20.256108 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3258/6477] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:43:20.340366 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1df10f6e-579f-4fd2-98dd-ea33ceac0a18 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "DELETE /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 204 len: 0 microversion: 2.1 time: 0.126217 Mar 05 21:43:20.342876 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3220/6478] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:43:20 2022] DELETE /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:43:20.352961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cf470a20-5aa3-4c69-93b9-9a156fcd56aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:20.354020 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cf470a20-5aa3-4c69-93b9-9a156fcd56aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:20.361076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf470a20-5aa3-4c69-93b9-9a156fcd56aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:20.362018 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf470a20-5aa3-4c69-93b9-9a156fcd56aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:20.362926 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf470a20-5aa3-4c69-93b9-9a156fcd56aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:20.363449 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cf470a20-5aa3-4c69-93b9-9a156fcd56aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:20.514728 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cf470a20-5aa3-4c69-93b9-9a156fcd56aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:20.523507 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cf470a20-5aa3-4c69-93b9-9a156fcd56aa tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1689 microversion: 2.1 time: 0.176076 Mar 05 21:43:20.524694 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3259/6479] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:20 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:21.543299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d728fb7f-459f-40c8-8e81-d0aa406cfa7a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:21.543964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d728fb7f-459f-40c8-8e81-d0aa406cfa7a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:21.550886 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d728fb7f-459f-40c8-8e81-d0aa406cfa7a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:21.551352 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d728fb7f-459f-40c8-8e81-d0aa406cfa7a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:21.552163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d728fb7f-459f-40c8-8e81-d0aa406cfa7a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:21.552614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d728fb7f-459f-40c8-8e81-d0aa406cfa7a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:21.695221 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d728fb7f-459f-40c8-8e81-d0aa406cfa7a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:21.703478 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d728fb7f-459f-40c8-8e81-d0aa406cfa7a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 200 len: 1570 microversion: 2.1 time: 0.165422 Mar 05 21:43:21.704096 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3221/6480] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:21 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:22.307435 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-a701a2b3-2538-4b40-88b3-5f46efeacb60 req-d08006ce-4622-4f02-bc1e-9bb99598cf04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83db2da3-8d9a-44d0-a5ef-4a83749b4599", "name": "network-vif-deleted", "tag": "8e592400-3f76-4823-a4dd-9c5dd6f01dfb"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:43:22.316505 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a701a2b3-2538-4b40-88b3-5f46efeacb60 req-d08006ce-4622-4f02-bc1e-9bb99598cf04 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:22.316961 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-a701a2b3-2538-4b40-88b3-5f46efeacb60 req-d08006ce-4622-4f02-bc1e-9bb99598cf04 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:22.329350 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-a701a2b3-2538-4b40-88b3-5f46efeacb60 req-d08006ce-4622-4f02-bc1e-9bb99598cf04 service nova] Creating event network-vif-deleted:8e592400-3f76-4823-a4dd-9c5dd6f01dfb for instance 83db2da3-8d9a-44d0-a5ef-4a83749b4599 on nch1-master-1 Mar 05 21:43:22.334104 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-a701a2b3-2538-4b40-88b3-5f46efeacb60 req-d08006ce-4622-4f02-bc1e-9bb99598cf04 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031466 Mar 05 21:43:22.334702 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3260/6481] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:43:22.721713 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6a17d4d-a4e5-4b31-aafe-4913d2bf0b5a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:22.723099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c6a17d4d-a4e5-4b31-aafe-4913d2bf0b5a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: 83db2da3-8d9a-44d0-a5ef-4a83749b4599] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:22.731970 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6a17d4d-a4e5-4b31-aafe-4913d2bf0b5a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:22.732360 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6a17d4d-a4e5-4b31-aafe-4913d2bf0b5a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:22.733186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6a17d4d-a4e5-4b31-aafe-4913d2bf0b5a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:22.733672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c6a17d4d-a4e5-4b31-aafe-4913d2bf0b5a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:22.749468 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-c6a17d4d-a4e5-4b31-aafe-4913d2bf0b5a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] HTTP exception thrown: Instance 83db2da3-8d9a-44d0-a5ef-4a83749b4599 could not be found. Mar 05 21:43:22.750099 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c6a17d4d-a4e5-4b31-aafe-4913d2bf0b5a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Returning 404 to user: Instance 83db2da3-8d9a-44d0-a5ef-4a83749b4599 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:43:22.750966 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c6a17d4d-a4e5-4b31-aafe-4913d2bf0b5a tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599" status: 404 len: 111 microversion: 2.1 time: 0.033641 Mar 05 21:43:22.751534 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3222/6482] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:22 2022] GET /compute/v2.1/servers/83db2da3-8d9a-44d0-a5ef-4a83749b4599 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:43:26.095396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ee4136ba-1771-4443-a20e-27b1f5ba3aef tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '.version_select at 0x7fed5caff820>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:26.116585 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ee4136ba-1771-4443-a20e-27b1f5ba3aef tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1926026174" status: 202 len: 0 microversion: 2.1 time: 0.026637 Mar 05 21:43:26.117198 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3261/6483] 10.222.0.15 () {58 vars in 1283 bytes} [Sat Mar 5 21:43:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1926026174 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:43:26.148693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ebfa6ef2-b31d-467a-b87b-07e9cbf1c87b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'create', calling method: .version_select at 0x7fed5c737ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-78623225"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:43:26.163806 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ebfa6ef2-b31d-467a-b87b-07e9cbf1c87b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:43:26.170575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ebfa6ef2-b31d-467a-b87b-07e9cbf1c87b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:43:26.443839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ebfa6ef2-b31d-467a-b87b-07e9cbf1c87b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:43:26.448857 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-ebfa6ef2-b31d-467a-b87b-07e9cbf1c87b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:43:26.463546 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ebfa6ef2-b31d-467a-b87b-07e9cbf1c87b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.318918 Mar 05 21:43:26.464190 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3223/6484] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:43:26 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:32.102477 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1055052370", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "networks": [{"uuid": "7264d34a-54f5-4395-94f3-0a6479bcd527"}], "key_name": "tempest-TestNetworkAdvancedServerOps-78623225", "security_groups": [{"name": "tempest-secgroup-smoke-1162329402"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:43:32.415539 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:43:32.415986 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 21:43:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Mar 05 21:43:32.551545 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] validate_networks() for [('7264d34a-54f5-4395-94f3-0a6479bcd527', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:43:33.075843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:43:33.076287 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:43:33.076784 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:43:33.077206 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:43:33.077830 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:43:33.088865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:33.089432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:33.090339 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:33.090687 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:33.112062 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for project 48215fb3722343839e21fb0114f6e972. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:43:33.117576 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Getting quotas for user 6661fafcf62c41dd8d297197e6a2055a and project 48215fb3722343839e21fb0114f6e972. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:43:33.132586 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:43:33.135612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:43:33.185529 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5a77bc13-df17-4215-911d-34227059c2bf tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.087039 Mar 05 21:43:33.186993 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3262/6485] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:43:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:43:33.198978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ad1d9fb2-b394-4b5a-86ae-ff09324eb81e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:33.200491 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ad1d9fb2-b394-4b5a-86ae-ff09324eb81e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:33.262281 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ad1d9fb2-b394-4b5a-86ae-ff09324eb81e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:33.268866 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ad1d9fb2-b394-4b5a-86ae-ff09324eb81e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1265 microversion: 2.1 time: 0.076101 Mar 05 21:43:33.269446 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3224/6486] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:33 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1265 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:43:34.286616 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c413cb5a-d1a7-4d2e-b3b5-19dd416b0e7f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:34.287940 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c413cb5a-d1a7-4d2e-b3b5-19dd416b0e7f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:34.343723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c413cb5a-d1a7-4d2e-b3b5-19dd416b0e7f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:34.351642 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c413cb5a-d1a7-4d2e-b3b5-19dd416b0e7f tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1265 microversion: 2.1 time: 0.068751 Mar 05 21:43:34.352139 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3263/6487] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:34 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1265 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:35.369142 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ab1150e3-fc58-4c9b-a99d-8fc6193d08d5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:35.370225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ab1150e3-fc58-4c9b-a99d-8fc6193d08d5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:35.425068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ab1150e3-fc58-4c9b-a99d-8fc6193d08d5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:35.433219 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ab1150e3-fc58-4c9b-a99d-8fc6193d08d5 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1265 microversion: 2.1 time: 0.068011 Mar 05 21:43:35.433933 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3225/6488] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:35 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1265 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:36.450444 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eb9b421d-29e3-493a-8514-5144f509cb1e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:36.451065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eb9b421d-29e3-493a-8514-5144f509cb1e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:36.504255 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eb9b421d-29e3-493a-8514-5144f509cb1e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:36.510802 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eb9b421d-29e3-493a-8514-5144f509cb1e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1265 microversion: 2.1 time: 0.064789 Mar 05 21:43:36.511380 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3264/6489] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:36 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1265 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:37.528597 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-42795cfd-f232-4be5-8926-50a81950ccff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:37.529448 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-42795cfd-f232-4be5-8926-50a81950ccff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:37.536307 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-42795cfd-f232-4be5-8926-50a81950ccff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:37.536782 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-42795cfd-f232-4be5-8926-50a81950ccff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:37.537581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-42795cfd-f232-4be5-8926-50a81950ccff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:37.538040 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-42795cfd-f232-4be5-8926-50a81950ccff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:37.611162 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-42795cfd-f232-4be5-8926-50a81950ccff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:37.619055 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-42795cfd-f232-4be5-8926-50a81950ccff tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1323 microversion: 2.1 time: 0.095616 Mar 05 21:43:37.620406 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3226/6490] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:37 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1323 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:38.580810 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-b10e11e0-bbcf-4c1f-bec6-9e8f29f75d20 req-683d396d-10da-4d17-b75a-6b6d492eae6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f", "tag": "4c0fd2ec-5634-423a-8e2c-e50c1afd0dc4"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:43:38.594612 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b10e11e0-bbcf-4c1f-bec6-9e8f29f75d20 req-683d396d-10da-4d17-b75a-6b6d492eae6b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:38.595344 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-b10e11e0-bbcf-4c1f-bec6-9e8f29f75d20 req-683d396d-10da-4d17-b75a-6b6d492eae6b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:38.614878 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-b10e11e0-bbcf-4c1f-bec6-9e8f29f75d20 req-683d396d-10da-4d17-b75a-6b6d492eae6b service nova] Creating event network-changed:4c0fd2ec-5634-423a-8e2c-e50c1afd0dc4 for instance bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f on nch2-master-1 Mar 05 21:43:38.621596 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-b10e11e0-bbcf-4c1f-bec6-9e8f29f75d20 req-683d396d-10da-4d17-b75a-6b6d492eae6b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044510 Mar 05 21:43:38.622521 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3265/6491] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:43:38.637994 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d33fccb1-d099-4e22-ab80-b54ba1af2dd2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:38.640677 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d33fccb1-d099-4e22-ab80-b54ba1af2dd2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:38.648627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d33fccb1-d099-4e22-ab80-b54ba1af2dd2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:38.649204 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d33fccb1-d099-4e22-ab80-b54ba1af2dd2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:38.650304 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d33fccb1-d099-4e22-ab80-b54ba1af2dd2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:38.650882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d33fccb1-d099-4e22-ab80-b54ba1af2dd2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:38.904883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d33fccb1-d099-4e22-ab80-b54ba1af2dd2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:38.912407 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d33fccb1-d099-4e22-ab80-b54ba1af2dd2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1391 microversion: 2.1 time: 0.279427 Mar 05 21:43:38.912998 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3227/6492] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:38 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1391 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:39.931715 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-668c125e-5417-4c24-b651-ee598e50b65c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:39.932429 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-668c125e-5417-4c24-b651-ee598e50b65c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:39.939367 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-668c125e-5417-4c24-b651-ee598e50b65c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:39.939859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-668c125e-5417-4c24-b651-ee598e50b65c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:39.940629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-668c125e-5417-4c24-b651-ee598e50b65c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:39.941074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-668c125e-5417-4c24-b651-ee598e50b65c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:40.082751 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-668c125e-5417-4c24-b651-ee598e50b65c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:40.091900 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-668c125e-5417-4c24-b651-ee598e50b65c tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1391 microversion: 2.1 time: 0.164932 Mar 05 21:43:40.092516 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3266/6493] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:39 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:41.110146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a6e527fc-47c1-4868-9a45-4e680de74665 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:41.111125 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a6e527fc-47c1-4868-9a45-4e680de74665 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:41.118429 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6e527fc-47c1-4868-9a45-4e680de74665 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:41.119776 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6e527fc-47c1-4868-9a45-4e680de74665 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:41.120671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6e527fc-47c1-4868-9a45-4e680de74665 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:41.121121 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a6e527fc-47c1-4868-9a45-4e680de74665 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:41.262174 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a6e527fc-47c1-4868-9a45-4e680de74665 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:41.269686 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a6e527fc-47c1-4868-9a45-4e680de74665 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1391 microversion: 2.1 time: 0.164284 Mar 05 21:43:41.270295 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3228/6494] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:41 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:42.286541 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-eb6fb948-9a3e-4fa4-9a68-2d9dd9137f29 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:42.287076 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-eb6fb948-9a3e-4fa4-9a68-2d9dd9137f29 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:42.294004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb6fb948-9a3e-4fa4-9a68-2d9dd9137f29 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:42.294456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb6fb948-9a3e-4fa4-9a68-2d9dd9137f29 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:42.295231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb6fb948-9a3e-4fa4-9a68-2d9dd9137f29 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:42.295695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-eb6fb948-9a3e-4fa4-9a68-2d9dd9137f29 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:42.431374 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-eb6fb948-9a3e-4fa4-9a68-2d9dd9137f29 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:42.439457 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-eb6fb948-9a3e-4fa4-9a68-2d9dd9137f29 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1391 microversion: 2.1 time: 0.157001 Mar 05 21:43:42.440059 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3267/6495] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:42 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:43.116380 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-c0882e2c-1a38-4115-b096-559652714653 req-f995fccb-5ee2-4378-9983-f2975d6d823a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f", "name": "network-vif-plugged", "status": "completed", "tag": "4c0fd2ec-5634-423a-8e2c-e50c1afd0dc4"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:43:43.125013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c0882e2c-1a38-4115-b096-559652714653 req-f995fccb-5ee2-4378-9983-f2975d6d823a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:43.125474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c0882e2c-1a38-4115-b096-559652714653 req-f995fccb-5ee2-4378-9983-f2975d6d823a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:43.137310 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-c0882e2c-1a38-4115-b096-559652714653 req-f995fccb-5ee2-4378-9983-f2975d6d823a service nova] Creating event network-vif-plugged:4c0fd2ec-5634-423a-8e2c-e50c1afd0dc4 for instance bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f on nch2-master-1 Mar 05 21:43:43.142490 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-c0882e2c-1a38-4115-b096-559652714653 req-f995fccb-5ee2-4378-9983-f2975d6d823a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088848 Mar 05 21:43:43.143031 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3229/6496] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:43:43.457131 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-98864055-f7a7-451d-950e-1f4d4e0c3d25 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:43.457706 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-98864055-f7a7-451d-950e-1f4d4e0c3d25 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:43.465055 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-98864055-f7a7-451d-950e-1f4d4e0c3d25 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:43.465572 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-98864055-f7a7-451d-950e-1f4d4e0c3d25 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:43.466353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-98864055-f7a7-451d-950e-1f4d4e0c3d25 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:43.466793 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-98864055-f7a7-451d-950e-1f4d4e0c3d25 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:43.601259 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-98864055-f7a7-451d-950e-1f4d4e0c3d25 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:43.608820 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-98864055-f7a7-451d-950e-1f4d4e0c3d25 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1391 microversion: 2.1 time: 0.155775 Mar 05 21:43:43.609435 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3268/6497] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:43 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:44.627211 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b4e4e57f-b8df-4c44-89dd-f7073be2a99e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:44.628043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b4e4e57f-b8df-4c44-89dd-f7073be2a99e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:44.634374 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4e4e57f-b8df-4c44-89dd-f7073be2a99e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:44.634842 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4e4e57f-b8df-4c44-89dd-f7073be2a99e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:44.635649 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4e4e57f-b8df-4c44-89dd-f7073be2a99e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:44.636223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b4e4e57f-b8df-4c44-89dd-f7073be2a99e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:44.782213 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b4e4e57f-b8df-4c44-89dd-f7073be2a99e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:44.789569 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b4e4e57f-b8df-4c44-89dd-f7073be2a99e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1564 microversion: 2.1 time: 0.167409 Mar 05 21:43:44.790152 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3230/6498] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:44 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:44.805639 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-63e7dcdd-c7df-4aef-9bfc-3179095d11a9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:44.806263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-63e7dcdd-c7df-4aef-9bfc-3179095d11a9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:44.813005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63e7dcdd-c7df-4aef-9bfc-3179095d11a9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:44.813473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63e7dcdd-c7df-4aef-9bfc-3179095d11a9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:44.814256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63e7dcdd-c7df-4aef-9bfc-3179095d11a9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:44.814703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-63e7dcdd-c7df-4aef-9bfc-3179095d11a9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:44.961819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-63e7dcdd-c7df-4aef-9bfc-3179095d11a9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:44.969863 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-63e7dcdd-c7df-4aef-9bfc-3179095d11a9 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1564 microversion: 2.1 time: 0.168180 Mar 05 21:43:44.970442 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3269/6499] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:44 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:43:46.554591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f8707984-8090-4abf-b633-4ef4ae0c8746 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:43:46.555232 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f8707984-8090-4abf-b633-4ef4ae0c8746 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:43:46.566286 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8707984-8090-4abf-b633-4ef4ae0c8746 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:46.566766 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8707984-8090-4abf-b633-4ef4ae0c8746 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:46.567575 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8707984-8090-4abf-b633-4ef4ae0c8746 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:46.568076 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f8707984-8090-4abf-b633-4ef4ae0c8746 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:46.627730 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-ab8517ff-b420-45ab-a755-8cdf47a2ed32 req-3b97ca22-f986-41c0-8506-5f90547224c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f", "tag": "4c0fd2ec-5634-423a-8e2c-e50c1afd0dc4"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:43:46.635808 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ab8517ff-b420-45ab-a755-8cdf47a2ed32 req-3b97ca22-f986-41c0-8506-5f90547224c6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:43:46.636548 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-ab8517ff-b420-45ab-a755-8cdf47a2ed32 req-3b97ca22-f986-41c0-8506-5f90547224c6 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:43:46.648515 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-ab8517ff-b420-45ab-a755-8cdf47a2ed32 req-3b97ca22-f986-41c0-8506-5f90547224c6 service nova] Creating event network-changed:4c0fd2ec-5634-423a-8e2c-e50c1afd0dc4 for instance bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f on nch2-master-1 Mar 05 21:43:46.654781 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-ab8517ff-b420-45ab-a755-8cdf47a2ed32 req-3b97ca22-f986-41c0-8506-5f90547224c6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101531 Mar 05 21:43:46.655845 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3270/6500] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:43:46.753199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f8707984-8090-4abf-b633-4ef4ae0c8746 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:43:46.762046 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f8707984-8090-4abf-b633-4ef4ae0c8746 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1564 microversion: 2.1 time: 0.211126 Mar 05 21:43:46.762860 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3231/6501] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:43:46 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1564 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:08.009466 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3d98cdd9-625d-485e-a384-f75536c1893e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:44:08.010495 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3d98cdd9-625d-485e-a384-f75536c1893e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:08.017539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d98cdd9-625d-485e-a384-f75536c1893e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:08.018049 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d98cdd9-625d-485e-a384-f75536c1893e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:08.018838 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d98cdd9-625d-485e-a384-f75536c1893e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:08.019314 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d98cdd9-625d-485e-a384-f75536c1893e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:08.069998 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3d98cdd9-625d-485e-a384-f75536c1893e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f/action" status: 200 len: 24574 microversion: 2.1 time: 0.072972 Mar 05 21:44:08.070657 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3271/6502] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:44:07 2022] POST /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f/action => generated 24574 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:44:19.042866 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3e045e10-7589-4989-823e-ff4113aeffbd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:44:19.043492 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3e045e10-7589-4989-823e-ff4113aeffbd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:19.049790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e045e10-7589-4989-823e-ff4113aeffbd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:19.050252 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e045e10-7589-4989-823e-ff4113aeffbd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:19.051032 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e045e10-7589-4989-823e-ff4113aeffbd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:19.051487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3e045e10-7589-4989-823e-ff4113aeffbd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:19.073202 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-3e045e10-7589-4989-823e-ff4113aeffbd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lazy-loading 'flavor' on Instance uuid bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:44:19.138483 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3e045e10-7589-4989-823e-ff4113aeffbd tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f/action" status: 202 len: 0 microversion: 2.1 time: 0.099977 Mar 05 21:44:19.139199 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3232/6503] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:44:19 2022] POST /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:44:19.148170 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-da44bac1-daa4-424d-b72c-2f8a131f9640 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:19.148811 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-da44bac1-daa4-424d-b72c-2f8a131f9640 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:19.157010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da44bac1-daa4-424d-b72c-2f8a131f9640 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:19.157470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da44bac1-daa4-424d-b72c-2f8a131f9640 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:19.158254 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da44bac1-daa4-424d-b72c-2f8a131f9640 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:19.158695 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-da44bac1-daa4-424d-b72c-2f8a131f9640 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:19.351360 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-da44bac1-daa4-424d-b72c-2f8a131f9640 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:19.359643 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-da44bac1-daa4-424d-b72c-2f8a131f9640 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1691 microversion: 2.1 time: 0.215928 Mar 05 21:44:19.360245 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3272/6504] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:19 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1691 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:20.378864 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-977383ce-7c16-4e0e-8422-2f249db8e744 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:20.379588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-977383ce-7c16-4e0e-8422-2f249db8e744 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:20.385834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-977383ce-7c16-4e0e-8422-2f249db8e744 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:20.386313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-977383ce-7c16-4e0e-8422-2f249db8e744 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:20.387256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-977383ce-7c16-4e0e-8422-2f249db8e744 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:20.387732 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-977383ce-7c16-4e0e-8422-2f249db8e744 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:20.577270 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-977383ce-7c16-4e0e-8422-2f249db8e744 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:20.584741 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-977383ce-7c16-4e0e-8422-2f249db8e744 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1674 microversion: 2.1 time: 0.211173 Mar 05 21:44:20.585318 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3233/6505] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:20 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1674 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:21.675042 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8200c960-6f66-4ecc-8a24-8240d86dcef1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:44:21.675994 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8200c960-6f66-4ecc-8a24-8240d86dcef1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:21.683542 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8200c960-6f66-4ecc-8a24-8240d86dcef1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:21.684068 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8200c960-6f66-4ecc-8a24-8240d86dcef1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:21.684857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8200c960-6f66-4ecc-8a24-8240d86dcef1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:21.685309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8200c960-6f66-4ecc-8a24-8240d86dcef1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:21.734089 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8200c960-6f66-4ecc-8a24-8240d86dcef1 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f/action" status: 200 len: 38361 microversion: 2.1 time: 0.062916 Mar 05 21:44:21.734770 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3273/6506] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:44:21 2022] POST /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f/action => generated 38361 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:44:21.746756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-362b1e13-568c-4542-95ac-3ef432e18d04 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:44:21.747316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-362b1e13-568c-4542-95ac-3ef432e18d04 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:21.754120 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-362b1e13-568c-4542-95ac-3ef432e18d04 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:21.754594 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-362b1e13-568c-4542-95ac-3ef432e18d04 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:21.755388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-362b1e13-568c-4542-95ac-3ef432e18d04 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:21.755883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-362b1e13-568c-4542-95ac-3ef432e18d04 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:21.821082 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-362b1e13-568c-4542-95ac-3ef432e18d04 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f/action" status: 202 len: 0 microversion: 2.1 time: 0.078984 Mar 05 21:44:21.821744 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3234/6507] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:44:21 2022] POST /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:44:21.831094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c880c36c-62e2-49b8-8d1e-488a00cb359e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:21.831848 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c880c36c-62e2-49b8-8d1e-488a00cb359e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:21.839030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c880c36c-62e2-49b8-8d1e-488a00cb359e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:21.840231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c880c36c-62e2-49b8-8d1e-488a00cb359e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:21.841013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c880c36c-62e2-49b8-8d1e-488a00cb359e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:21.841454 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c880c36c-62e2-49b8-8d1e-488a00cb359e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:21.985915 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c880c36c-62e2-49b8-8d1e-488a00cb359e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:21.993289 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c880c36c-62e2-49b8-8d1e-488a00cb359e tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1680 microversion: 2.1 time: 0.166548 Mar 05 21:44:21.994283 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3274/6508] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:21 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:23.013051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fca51a04-44a0-4535-ad68-9de7b0ff5cda tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:23.013778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fca51a04-44a0-4535-ad68-9de7b0ff5cda tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:23.020983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fca51a04-44a0-4535-ad68-9de7b0ff5cda tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:23.021459 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fca51a04-44a0-4535-ad68-9de7b0ff5cda tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:23.022347 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fca51a04-44a0-4535-ad68-9de7b0ff5cda tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:23.022719 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fca51a04-44a0-4535-ad68-9de7b0ff5cda tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:23.162955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-fca51a04-44a0-4535-ad68-9de7b0ff5cda tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:23.171026 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fca51a04-44a0-4535-ad68-9de7b0ff5cda tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1680 microversion: 2.1 time: 0.162956 Mar 05 21:44:23.172023 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3235/6509] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:23 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:24.188757 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b260c2d8-faff-43f8-a1d6-fc704bab3c7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:24.189461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b260c2d8-faff-43f8-a1d6-fc704bab3c7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:24.196582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b260c2d8-faff-43f8-a1d6-fc704bab3c7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:24.197044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b260c2d8-faff-43f8-a1d6-fc704bab3c7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:24.197819 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b260c2d8-faff-43f8-a1d6-fc704bab3c7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:24.198267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b260c2d8-faff-43f8-a1d6-fc704bab3c7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:24.334872 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b260c2d8-faff-43f8-a1d6-fc704bab3c7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:24.342735 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b260c2d8-faff-43f8-a1d6-fc704bab3c7b tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1683 microversion: 2.1 time: 0.158056 Mar 05 21:44:24.343313 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3275/6510] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:24 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:24.431809 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-408b380e-e4e2-4674-b539-8ce51a4f7cc7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:44:24.432985 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-408b380e-e4e2-4674-b539-8ce51a4f7cc7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:24.440396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-408b380e-e4e2-4674-b539-8ce51a4f7cc7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:24.440811 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-408b380e-e4e2-4674-b539-8ce51a4f7cc7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:24.441598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-408b380e-e4e2-4674-b539-8ce51a4f7cc7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:24.442052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-408b380e-e4e2-4674-b539-8ce51a4f7cc7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:24.483386 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-408b380e-e4e2-4674-b539-8ce51a4f7cc7 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "POST /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f/action" status: 200 len: 38361 microversion: 2.1 time: 0.055363 Mar 05 21:44:24.484312 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3236/6511] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:44:24 2022] POST /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f/action => generated 38361 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 21:44:25.469134 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-de6cf377-83a4-48c1-856d-12c8e87cb546 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:25.469658 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-de6cf377-83a4-48c1-856d-12c8e87cb546 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:25.472560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-218e3488-fd36-4a43-a5d0-0e9e08c991b7 req-84d4d416-eed1-43e2-b073-66c9e9704a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f", "tag": "4c0fd2ec-5634-423a-8e2c-e50c1afd0dc4"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:44:25.476272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de6cf377-83a4-48c1-856d-12c8e87cb546 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:25.476737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de6cf377-83a4-48c1-856d-12c8e87cb546 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:25.477533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de6cf377-83a4-48c1-856d-12c8e87cb546 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:25.478248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de6cf377-83a4-48c1-856d-12c8e87cb546 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:25.482737 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-218e3488-fd36-4a43-a5d0-0e9e08c991b7 req-84d4d416-eed1-43e2-b073-66c9e9704a8e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:25.483258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-218e3488-fd36-4a43-a5d0-0e9e08c991b7 req-84d4d416-eed1-43e2-b073-66c9e9704a8e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:25.495515 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-218e3488-fd36-4a43-a5d0-0e9e08c991b7 req-84d4d416-eed1-43e2-b073-66c9e9704a8e service nova] Creating event network-changed:4c0fd2ec-5634-423a-8e2c-e50c1afd0dc4 for instance bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f on nch2-master-1 Mar 05 21:44:25.500534 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-218e3488-fd36-4a43-a5d0-0e9e08c991b7 req-84d4d416-eed1-43e2-b073-66c9e9704a8e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032256 Mar 05 21:44:25.501144 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3237/6512] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:44:25.504675 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-de6cf377-83a4-48c1-856d-12c8e87cb546 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:44:25.592537 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-de6cf377-83a4-48c1-856d-12c8e87cb546 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 204 len: 0 microversion: 2.1 time: 0.127778 Mar 05 21:44:25.593145 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3276/6513] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:44:25 2022] DELETE /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:44:25.602905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f53e5073-ee50-48b5-94a6-3081966e3901 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:25.604000 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f53e5073-ee50-48b5-94a6-3081966e3901 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:25.613836 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f53e5073-ee50-48b5-94a6-3081966e3901 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:25.614309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f53e5073-ee50-48b5-94a6-3081966e3901 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:25.615115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f53e5073-ee50-48b5-94a6-3081966e3901 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:25.615565 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f53e5073-ee50-48b5-94a6-3081966e3901 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:25.850601 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f53e5073-ee50-48b5-94a6-3081966e3901 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:25.858644 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f53e5073-ee50-48b5-94a6-3081966e3901 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1689 microversion: 2.1 time: 0.260290 Mar 05 21:44:25.859436 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3238/6514] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:25 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1689 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:26.877536 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-cb695f2e-e5d9-4f38-9fe5-5995416349eb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:26.878257 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-cb695f2e-e5d9-4f38-9fe5-5995416349eb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:26.885138 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb695f2e-e5d9-4f38-9fe5-5995416349eb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:26.885711 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb695f2e-e5d9-4f38-9fe5-5995416349eb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:26.886562 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb695f2e-e5d9-4f38-9fe5-5995416349eb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:26.887023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-cb695f2e-e5d9-4f38-9fe5-5995416349eb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:27.027293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-cb695f2e-e5d9-4f38-9fe5-5995416349eb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6661fafcf62c41dd8d297197e6a2055a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48215fb3722343839e21fb0114f6e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:27.035138 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-cb695f2e-e5d9-4f38-9fe5-5995416349eb tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 200 len: 1570 microversion: 2.1 time: 0.161944 Mar 05 21:44:27.035755 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3277/6515] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:26 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:27.595722 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8c262512-7a00-4ef0-921e-291241796d52 req-cd3942a5-259e-41a5-b152-a336887068aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f", "name": "network-vif-deleted", "tag": "4c0fd2ec-5634-423a-8e2c-e50c1afd0dc4"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:44:27.604051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8c262512-7a00-4ef0-921e-291241796d52 req-cd3942a5-259e-41a5-b152-a336887068aa service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:27.604451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8c262512-7a00-4ef0-921e-291241796d52 req-cd3942a5-259e-41a5-b152-a336887068aa service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:27.628737 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8c262512-7a00-4ef0-921e-291241796d52 req-cd3942a5-259e-41a5-b152-a336887068aa service nova] Creating event network-vif-deleted:4c0fd2ec-5634-423a-8e2c-e50c1afd0dc4 for instance bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f on nch2-master-1 Mar 05 21:44:27.633561 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-8c262512-7a00-4ef0-921e-291241796d52 req-cd3942a5-259e-41a5-b152-a336887068aa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044046 Mar 05 21:44:27.634173 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3239/6516] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:44:28.055554 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a7831b97-f597-42d6-ba0f-f5067305d4ae tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:28.056685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a7831b97-f597-42d6-ba0f-f5067305d4ae tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] [instance: bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:28.064898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7831b97-f597-42d6-ba0f-f5067305d4ae tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:28.065386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7831b97-f597-42d6-ba0f-f5067305d4ae tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:28.066398 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7831b97-f597-42d6-ba0f-f5067305d4ae tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:28.066844 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7831b97-f597-42d6-ba0f-f5067305d4ae tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:28.083311 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-a7831b97-f597-42d6-ba0f-f5067305d4ae tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] HTTP exception thrown: Instance bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f could not be found. Mar 05 21:44:28.083951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a7831b97-f597-42d6-ba0f-f5067305d4ae tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Returning 404 to user: Instance bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:44:28.084789 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a7831b97-f597-42d6-ba0f-f5067305d4ae tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f" status: 404 len: 111 microversion: 2.1 time: 0.035154 Mar 05 21:44:28.085336 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3278/6517] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:28 2022] GET /compute/v2.1/servers/bb7204fe-8e33-41fc-a0b2-bc04f38a1c4f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:44:31.466156 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fa897e15-e0bb-4627-adac-eb091cc112e2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] Calling method '.version_select at 0x7fed5c27d280>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:31.494925 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fa897e15-e0bb-4627-adac-eb091cc112e2 tempest-TestNetworkAdvancedServerOps-2075768725 tempest-TestNetworkAdvancedServerOps-2075768725-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-78623225" status: 202 len: 0 microversion: 2.1 time: 0.033250 Mar 05 21:44:31.497318 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3240/6518] 10.222.0.15 () {58 vars in 1277 bytes} [Sat Mar 5 21:44:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-78623225 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:44:43.079267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-935edc42-6772-4efc-a01a-8956bc2cd1fe tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Action: 'create', calling method: .version_select at 0x7fed4f653790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1264540085"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:44:43.093906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-935edc42-6772-4efc-a01a-8956bc2cd1fe tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Getting quotas for project d8fd34db08b648489afd4f749b965e2a. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:44:43.100074 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-935edc42-6772-4efc-a01a-8956bc2cd1fe tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Getting quotas for user 47a7c63e175949e1938accdece2a4c95 and project d8fd34db08b648489afd4f749b965e2a. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:44:43.189794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-935edc42-6772-4efc-a01a-8956bc2cd1fe tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Getting quotas for project d8fd34db08b648489afd4f749b965e2a. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:44:43.194951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-935edc42-6772-4efc-a01a-8956bc2cd1fe tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Getting quotas for user 47a7c63e175949e1938accdece2a4c95 and project d8fd34db08b648489afd4f749b965e2a. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:44:43.210531 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-935edc42-6772-4efc-a01a-8956bc2cd1fe tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.311401 Mar 05 21:44:43.211357 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3279/6519] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:44:42 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:44.209590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-959448321", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1264540085", "security_groups": [{"name": "tempest-secgroup-smoke-1686343922"}], "networks": [{"uuid": "7b9e505b-9603-4138-a09d-a6d35f18795c"}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:44:44.315569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] validate_networks() for [('7b9e505b-9603-4138-a09d-a6d35f18795c', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:44:44.794161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:44:44.794611 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:44:44.795113 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:44:44.795614 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:44:44.796082 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:44:44.804838 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:44.805313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:44.806200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:44.806667 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:44.824001 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Getting quotas for project d8fd34db08b648489afd4f749b965e2a. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:44:44.829329 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Getting quotas for user 47a7c63e175949e1938accdece2a4c95 and project d8fd34db08b648489afd4f749b965e2a. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:44:44.842302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:44:44.844762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:44:44.898175 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a880c1de-e107-4c82-8971-34cef70a0e83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.693042 Mar 05 21:44:44.899483 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3241/6520] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:44:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:44:44.914331 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-31a69406-ade9-4e57-b628-c711020cfb34 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:44.915538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-31a69406-ade9-4e57-b628-c711020cfb34 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:44.972721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-31a69406-ade9-4e57-b628-c711020cfb34 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:44.980316 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-31a69406-ade9-4e57-b628-c711020cfb34 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1246 microversion: 2.1 time: 0.074270 Mar 05 21:44:44.981061 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3280/6521] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:44 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:44:45.998332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-27639e4a-b356-4a7f-bcfd-904a1a0566d7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:45.999157 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-27639e4a-b356-4a7f-bcfd-904a1a0566d7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:46.008411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27639e4a-b356-4a7f-bcfd-904a1a0566d7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:46.009043 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27639e4a-b356-4a7f-bcfd-904a1a0566d7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:46.009937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27639e4a-b356-4a7f-bcfd-904a1a0566d7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:46.010894 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-27639e4a-b356-4a7f-bcfd-904a1a0566d7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:46.112988 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-27639e4a-b356-4a7f-bcfd-904a1a0566d7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:46.133192 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-27639e4a-b356-4a7f-bcfd-904a1a0566d7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1316 microversion: 2.1 time: 0.139949 Mar 05 21:44:46.134463 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3242/6522] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:45 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1316 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:47.150414 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d46c4a77-9449-4a4f-828f-66dbd73b291f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:47.152978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d46c4a77-9449-4a4f-828f-66dbd73b291f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:47.161382 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d46c4a77-9449-4a4f-828f-66dbd73b291f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:47.161936 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d46c4a77-9449-4a4f-828f-66dbd73b291f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:47.163008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d46c4a77-9449-4a4f-828f-66dbd73b291f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:47.163512 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d46c4a77-9449-4a4f-828f-66dbd73b291f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:47.326854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d46c4a77-9449-4a4f-828f-66dbd73b291f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:47.337797 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d46c4a77-9449-4a4f-828f-66dbd73b291f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1372 microversion: 2.1 time: 0.191245 Mar 05 21:44:47.344288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-ede98f68-cfe1-4a4d-93b3-504e4dc27064 req-cc7bb135-8ec6-4b24-a469-cdb0c8f03c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3257ffcb-79f9-4899-992b-52fc2f4fbf81", "tag": "91cfe995-5aba-45d6-b097-baf8fce1776c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:44:47.349172 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3281/6523] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:47 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:47.362775 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ede98f68-cfe1-4a4d-93b3-504e4dc27064 req-cc7bb135-8ec6-4b24-a469-cdb0c8f03c6b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:47.363332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ede98f68-cfe1-4a4d-93b3-504e4dc27064 req-cc7bb135-8ec6-4b24-a469-cdb0c8f03c6b service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:47.384951 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ede98f68-cfe1-4a4d-93b3-504e4dc27064 req-cc7bb135-8ec6-4b24-a469-cdb0c8f03c6b service nova] Creating event network-changed:91cfe995-5aba-45d6-b097-baf8fce1776c for instance 3257ffcb-79f9-4899-992b-52fc2f4fbf81 on nch1-master-1 Mar 05 21:44:47.390988 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-ede98f68-cfe1-4a4d-93b3-504e4dc27064 req-cc7bb135-8ec6-4b24-a469-cdb0c8f03c6b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054865 Mar 05 21:44:47.391601 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3243/6524] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:44:48.356705 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fe2e985f-35f1-4e3a-9b2a-9cb49a07a708 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:48.357692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fe2e985f-35f1-4e3a-9b2a-9cb49a07a708 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:48.364896 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe2e985f-35f1-4e3a-9b2a-9cb49a07a708 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:48.365393 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe2e985f-35f1-4e3a-9b2a-9cb49a07a708 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:48.366237 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe2e985f-35f1-4e3a-9b2a-9cb49a07a708 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:48.366742 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe2e985f-35f1-4e3a-9b2a-9cb49a07a708 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:48.510124 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fe2e985f-35f1-4e3a-9b2a-9cb49a07a708 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:48.517854 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fe2e985f-35f1-4e3a-9b2a-9cb49a07a708 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1372 microversion: 2.1 time: 0.165462 Mar 05 21:44:48.518580 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3282/6525] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:48 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:49.535885 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8cfc71ba-c7a7-4105-9870-dba01933451d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:49.536603 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8cfc71ba-c7a7-4105-9870-dba01933451d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:49.543456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cfc71ba-c7a7-4105-9870-dba01933451d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:49.543953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cfc71ba-c7a7-4105-9870-dba01933451d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:49.544734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cfc71ba-c7a7-4105-9870-dba01933451d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:49.545184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8cfc71ba-c7a7-4105-9870-dba01933451d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:49.683632 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8cfc71ba-c7a7-4105-9870-dba01933451d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:49.690956 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8cfc71ba-c7a7-4105-9870-dba01933451d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1372 microversion: 2.1 time: 0.160199 Mar 05 21:44:49.691531 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3244/6526] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:49 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:50.707906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9892068a-e455-43ac-b116-df4fbef125ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:50.708531 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9892068a-e455-43ac-b116-df4fbef125ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:50.715380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9892068a-e455-43ac-b116-df4fbef125ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:50.715888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9892068a-e455-43ac-b116-df4fbef125ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:50.716659 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9892068a-e455-43ac-b116-df4fbef125ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:50.717097 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9892068a-e455-43ac-b116-df4fbef125ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:50.855798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9892068a-e455-43ac-b116-df4fbef125ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:50.866238 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9892068a-e455-43ac-b116-df4fbef125ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1372 microversion: 2.1 time: 0.162308 Mar 05 21:44:50.866908 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3283/6527] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:50 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:51.887011 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-601d82d3-6d36-4a83-a407-d5c34c6c3cec tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:51.887729 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-601d82d3-6d36-4a83-a407-d5c34c6c3cec tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:51.894741 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-601d82d3-6d36-4a83-a407-d5c34c6c3cec tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:51.895348 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-601d82d3-6d36-4a83-a407-d5c34c6c3cec tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:51.896189 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-601d82d3-6d36-4a83-a407-d5c34c6c3cec tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:51.896643 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-601d82d3-6d36-4a83-a407-d5c34c6c3cec tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:52.041225 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-601d82d3-6d36-4a83-a407-d5c34c6c3cec tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:52.049406 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-601d82d3-6d36-4a83-a407-d5c34c6c3cec tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1372 microversion: 2.1 time: 0.169043 Mar 05 21:44:52.049994 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3245/6528] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:51 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:53.065877 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6cdbc505-5b15-42b3-a3cd-f89771934720 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:53.066424 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6cdbc505-5b15-42b3-a3cd-f89771934720 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:53.073592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6cdbc505-5b15-42b3-a3cd-f89771934720 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:53.074052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6cdbc505-5b15-42b3-a3cd-f89771934720 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:53.074825 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6cdbc505-5b15-42b3-a3cd-f89771934720 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:53.075268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6cdbc505-5b15-42b3-a3cd-f89771934720 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:53.210093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6cdbc505-5b15-42b3-a3cd-f89771934720 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:53.217395 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6cdbc505-5b15-42b3-a3cd-f89771934720 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1372 microversion: 2.1 time: 0.155527 Mar 05 21:44:53.217969 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3284/6529] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:53 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:53.719006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f55f82bf-8891-4ad9-97b3-3dcc06fb61a8 req-1321f3ea-5be8-4fd4-9d1d-5321632ba995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3257ffcb-79f9-4899-992b-52fc2f4fbf81", "name": "network-vif-plugged", "status": "completed", "tag": "91cfe995-5aba-45d6-b097-baf8fce1776c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:44:53.728337 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f55f82bf-8891-4ad9-97b3-3dcc06fb61a8 req-1321f3ea-5be8-4fd4-9d1d-5321632ba995 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:53.728833 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f55f82bf-8891-4ad9-97b3-3dcc06fb61a8 req-1321f3ea-5be8-4fd4-9d1d-5321632ba995 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:53.740413 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f55f82bf-8891-4ad9-97b3-3dcc06fb61a8 req-1321f3ea-5be8-4fd4-9d1d-5321632ba995 service nova] Creating event network-vif-plugged:91cfe995-5aba-45d6-b097-baf8fce1776c for instance 3257ffcb-79f9-4899-992b-52fc2f4fbf81 on nch1-master-1 Mar 05 21:44:53.746306 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f55f82bf-8891-4ad9-97b3-3dcc06fb61a8 req-1321f3ea-5be8-4fd4-9d1d-5321632ba995 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031129 Mar 05 21:44:53.746916 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3246/6530] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:44:54.234859 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af9e3913-002c-4b04-8586-a33c29e0b3b7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:54.235432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-af9e3913-002c-4b04-8586-a33c29e0b3b7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:54.242227 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af9e3913-002c-4b04-8586-a33c29e0b3b7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:54.242678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af9e3913-002c-4b04-8586-a33c29e0b3b7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:54.243727 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af9e3913-002c-4b04-8586-a33c29e0b3b7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:54.244171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af9e3913-002c-4b04-8586-a33c29e0b3b7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:54.376380 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-af9e3913-002c-4b04-8586-a33c29e0b3b7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:54.383653 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-af9e3913-002c-4b04-8586-a33c29e0b3b7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1372 microversion: 2.1 time: 0.152905 Mar 05 21:44:54.384255 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3285/6531] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:54 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:55.403576 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2be9aecc-365b-470b-af88-d40cfe923567 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:55.404332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2be9aecc-365b-470b-af88-d40cfe923567 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:55.410588 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2be9aecc-365b-470b-af88-d40cfe923567 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:55.411059 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2be9aecc-365b-470b-af88-d40cfe923567 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:55.411955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2be9aecc-365b-470b-af88-d40cfe923567 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:55.412411 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2be9aecc-365b-470b-af88-d40cfe923567 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:55.549323 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2be9aecc-365b-470b-af88-d40cfe923567 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:55.556858 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2be9aecc-365b-470b-af88-d40cfe923567 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1556 microversion: 2.1 time: 0.160061 Mar 05 21:44:55.558160 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3247/6532] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:55 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:55.573407 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7bfe7c1b-0b95-473c-a836-15d74324f2f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:44:55.574022 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7bfe7c1b-0b95-473c-a836-15d74324f2f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:44:55.580523 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7bfe7c1b-0b95-473c-a836-15d74324f2f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:55.580978 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7bfe7c1b-0b95-473c-a836-15d74324f2f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:55.581748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7bfe7c1b-0b95-473c-a836-15d74324f2f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:55.582186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7bfe7c1b-0b95-473c-a836-15d74324f2f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:55.725253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7bfe7c1b-0b95-473c-a836-15d74324f2f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:44:55.733814 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7bfe7c1b-0b95-473c-a836-15d74324f2f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1556 microversion: 2.1 time: 0.164315 Mar 05 21:44:55.734802 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3286/6533] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:44:55 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:44:57.703839 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-c95746e3-88d9-4236-b878-09e7b8325f4c req-dc4f6ac9-b87f-4c78-a1f0-4ed8fb84d8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3257ffcb-79f9-4899-992b-52fc2f4fbf81", "tag": "91cfe995-5aba-45d6-b097-baf8fce1776c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:44:57.712624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c95746e3-88d9-4236-b878-09e7b8325f4c req-dc4f6ac9-b87f-4c78-a1f0-4ed8fb84d8a5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:44:57.713187 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c95746e3-88d9-4236-b878-09e7b8325f4c req-dc4f6ac9-b87f-4c78-a1f0-4ed8fb84d8a5 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:44:57.725375 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-c95746e3-88d9-4236-b878-09e7b8325f4c req-dc4f6ac9-b87f-4c78-a1f0-4ed8fb84d8a5 service nova] Creating event network-changed:91cfe995-5aba-45d6-b097-baf8fce1776c for instance 3257ffcb-79f9-4899-992b-52fc2f4fbf81 on nch1-master-1 Mar 05 21:44:57.731576 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-c95746e3-88d9-4236-b878-09e7b8325f4c req-dc4f6ac9-b87f-4c78-a1f0-4ed8fb84d8a5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031405 Mar 05 21:44:57.732285 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3248/6534] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:46:51.823511 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:46:51.824164 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 21:46:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:46:51.881056 ncdv-master-1 devstack@n-api.service[141479]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f4676b75-9eec-4512-826f-cf92fa0c9e09] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 05 21:46:51.885104 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a584f192-631c-4db6-8c55-ddd213e54609 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:46:51.885678 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a584f192-631c-4db6-8c55-ddd213e54609 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:46:51.892161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a584f192-631c-4db6-8c55-ddd213e54609 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:51.892626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a584f192-631c-4db6-8c55-ddd213e54609 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:51.893416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a584f192-631c-4db6-8c55-ddd213e54609 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:51.893868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a584f192-631c-4db6-8c55-ddd213e54609 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:51.917201 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-a584f192-631c-4db6-8c55-ddd213e54609 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lazy-loading 'flavor' on Instance uuid 3257ffcb-79f9-4899-992b-52fc2f4fbf81 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:46:52.365823 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:46:52.368040 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:46:52.368182 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 21:46:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:46:52.368747 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 21:46:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81/action (ip 10.222.0.15) !!! Mar 05 21:46:52.424353 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:46:52.424620 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 21:46:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81/action (ip 10.222.0.15) !!! Mar 05 21:46:52.446742 ncdv-master-1 devstack@n-api.service[141479]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a584f192-631c-4db6-8c55-ddd213e54609 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [1c1b5e5d-b955-493f-813e-154ae3564984] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 05 21:46:52.889732 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] [f4676b75-9eec-4512-826f-cf92fa0c9e09] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 33732. Mar 05 21:46:53.454992 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [None req-a584f192-631c-4db6-8c55-ddd213e54609 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [1c1b5e5d-b955-493f-813e-154ae3564984] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 33734. Mar 05 21:46:53.458712 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a584f192-631c-4db6-8c55-ddd213e54609 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "POST /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81/action" status: 202 len: 0 microversion: 2.1 time: 1.579892 Mar 05 21:46:53.459492 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3287/6535] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:46:51 2022] POST /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81/action => generated 0 bytes in 1581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 21:46:53.465827 ncdv-master-1 devstack@n-api.service[141478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6a0c9ad-ada5-4110-a451-98e637deeab0] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 05 21:46:53.466791 ncdv-master-1 devstack@n-api.service[141478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [acc7cacd-1878-4025-b503-960cdc977e32] AMQP server on 10.222.0.15:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Mar 05 21:46:53.471730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1a095ce7-bf77-4fb1-82ef-62228712afb2 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:46:53.472450 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1a095ce7-bf77-4fb1-82ef-62228712afb2 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:46:53.481912 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a095ce7-bf77-4fb1-82ef-62228712afb2 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:53.482375 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a095ce7-bf77-4fb1-82ef-62228712afb2 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:53.484224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a095ce7-bf77-4fb1-82ef-62228712afb2 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:53.484685 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a095ce7-bf77-4fb1-82ef-62228712afb2 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:53.742096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1a095ce7-bf77-4fb1-82ef-62228712afb2 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:46:53.749578 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1a095ce7-bf77-4fb1-82ef-62228712afb2 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1681 microversion: 2.1 time: 0.285559 Mar 05 21:46:53.750149 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3249/6536] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:46:53 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1681 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:46:54.768447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c2863641-a3bc-465f-ad8c-05d3052aef71 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:46:54.769162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c2863641-a3bc-465f-ad8c-05d3052aef71 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:46:54.776333 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2863641-a3bc-465f-ad8c-05d3052aef71 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:54.776794 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2863641-a3bc-465f-ad8c-05d3052aef71 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:54.777570 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2863641-a3bc-465f-ad8c-05d3052aef71 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:54.778013 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c2863641-a3bc-465f-ad8c-05d3052aef71 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:54.914290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-c2863641-a3bc-465f-ad8c-05d3052aef71 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:46:54.922801 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c2863641-a3bc-465f-ad8c-05d3052aef71 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1681 microversion: 2.1 time: 0.160161 Mar 05 21:46:54.923449 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3288/6537] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:46:54 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:46:55.939805 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7106ebdf-6599-4379-9824-44e4e1202091 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:46:55.940431 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7106ebdf-6599-4379-9824-44e4e1202091 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:46:55.957727 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7106ebdf-6599-4379-9824-44e4e1202091 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:55.958164 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7106ebdf-6599-4379-9824-44e4e1202091 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:55.958997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7106ebdf-6599-4379-9824-44e4e1202091 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:55.959452 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7106ebdf-6599-4379-9824-44e4e1202091 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:55.960142 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6a0c9ad-ada5-4110-a451-98e637deeab0] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 33754. Mar 05 21:46:55.963855 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] [acc7cacd-1878-4025-b503-960cdc977e32] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 33756. Mar 05 21:46:56.105289 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7106ebdf-6599-4379-9824-44e4e1202091 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:46:56.113134 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7106ebdf-6599-4379-9824-44e4e1202091 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1681 microversion: 2.1 time: 0.177423 Mar 05 21:46:56.113714 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3250/6538] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:46:55 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:46:57.130873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-663e7d55-721f-4ba5-a510-4728aeba8c17 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:46:57.131479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-663e7d55-721f-4ba5-a510-4728aeba8c17 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:46:57.138056 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-663e7d55-721f-4ba5-a510-4728aeba8c17 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:57.138518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-663e7d55-721f-4ba5-a510-4728aeba8c17 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:57.139341 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-663e7d55-721f-4ba5-a510-4728aeba8c17 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:57.140127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-663e7d55-721f-4ba5-a510-4728aeba8c17 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:57.276464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-663e7d55-721f-4ba5-a510-4728aeba8c17 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:46:57.284343 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-663e7d55-721f-4ba5-a510-4728aeba8c17 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1681 microversion: 2.1 time: 0.157594 Mar 05 21:46:57.284929 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3289/6539] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:46:57 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:46:58.302700 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-660cee65-5314-4783-9451-ea67ec1b3a8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:46:58.303257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-660cee65-5314-4783-9451-ea67ec1b3a8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:46:58.310083 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-660cee65-5314-4783-9451-ea67ec1b3a8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:58.310552 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-660cee65-5314-4783-9451-ea67ec1b3a8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:58.312064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-660cee65-5314-4783-9451-ea67ec1b3a8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:58.312560 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-660cee65-5314-4783-9451-ea67ec1b3a8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:58.447469 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-660cee65-5314-4783-9451-ea67ec1b3a8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:46:58.455375 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-660cee65-5314-4783-9451-ea67ec1b3a8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1681 microversion: 2.1 time: 0.156708 Mar 05 21:46:58.455996 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3251/6540] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:46:58 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:46:59.472490 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e6fa42a1-72d0-4800-9642-ac4e44031a08 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:46:59.473093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-e6fa42a1-72d0-4800-9642-ac4e44031a08 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:46:59.479941 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6fa42a1-72d0-4800-9642-ac4e44031a08 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:59.480396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6fa42a1-72d0-4800-9642-ac4e44031a08 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:59.481161 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6fa42a1-72d0-4800-9642-ac4e44031a08 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:46:59.481600 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-e6fa42a1-72d0-4800-9642-ac4e44031a08 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:46:59.616571 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-e6fa42a1-72d0-4800-9642-ac4e44031a08 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:46:59.624300 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e6fa42a1-72d0-4800-9642-ac4e44031a08 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1681 microversion: 2.1 time: 0.155722 Mar 05 21:46:59.624874 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3290/6541] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:46:59 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:00.642178 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c2008ed0-0cd8-4956-abbb-85f9197d6b13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:00.642817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c2008ed0-0cd8-4956-abbb-85f9197d6b13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:00.649789 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2008ed0-0cd8-4956-abbb-85f9197d6b13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:00.650264 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2008ed0-0cd8-4956-abbb-85f9197d6b13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:00.651051 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2008ed0-0cd8-4956-abbb-85f9197d6b13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:00.651506 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c2008ed0-0cd8-4956-abbb-85f9197d6b13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:00.803829 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c2008ed0-0cd8-4956-abbb-85f9197d6b13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:00.811699 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c2008ed0-0cd8-4956-abbb-85f9197d6b13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1681 microversion: 2.1 time: 0.173738 Mar 05 21:47:00.812267 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3252/6542] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:00 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:01.829066 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a952cf55-ca33-47a5-8217-b363b8783786 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:01.829680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a952cf55-ca33-47a5-8217-b363b8783786 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:01.836484 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a952cf55-ca33-47a5-8217-b363b8783786 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:01.836943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a952cf55-ca33-47a5-8217-b363b8783786 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:01.837707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a952cf55-ca33-47a5-8217-b363b8783786 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:01.838147 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a952cf55-ca33-47a5-8217-b363b8783786 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:01.977158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a952cf55-ca33-47a5-8217-b363b8783786 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:01.985655 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a952cf55-ca33-47a5-8217-b363b8783786 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1681 microversion: 2.1 time: 0.161215 Mar 05 21:47:01.986234 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3291/6543] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:01 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:03.003698 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-abf8742f-717e-4cb4-9c0c-e0fe72854e10 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:03.004321 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-abf8742f-717e-4cb4-9c0c-e0fe72854e10 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:03.011056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abf8742f-717e-4cb4-9c0c-e0fe72854e10 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:03.011528 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abf8742f-717e-4cb4-9c0c-e0fe72854e10 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:03.012339 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abf8742f-717e-4cb4-9c0c-e0fe72854e10 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:03.012801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-abf8742f-717e-4cb4-9c0c-e0fe72854e10 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:03.150126 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-abf8742f-717e-4cb4-9c0c-e0fe72854e10 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:03.157665 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-abf8742f-717e-4cb4-9c0c-e0fe72854e10 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1681 microversion: 2.1 time: 0.158099 Mar 05 21:47:03.158249 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3253/6544] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:02 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:04.175497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3624d421-4eb0-4e75-944b-fb11fd5414ac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:04.176136 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3624d421-4eb0-4e75-944b-fb11fd5414ac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:04.183009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3624d421-4eb0-4e75-944b-fb11fd5414ac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:04.183473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3624d421-4eb0-4e75-944b-fb11fd5414ac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:04.184284 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3624d421-4eb0-4e75-944b-fb11fd5414ac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:04.184733 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3624d421-4eb0-4e75-944b-fb11fd5414ac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:04.321726 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3624d421-4eb0-4e75-944b-fb11fd5414ac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:04.330251 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3624d421-4eb0-4e75-944b-fb11fd5414ac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1702 microversion: 2.1 time: 0.159360 Mar 05 21:47:04.330835 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3292/6545] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:04 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1702 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:05.348133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ff56f539-902d-4b91-8616-b03f921b3b9b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:05.348827 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ff56f539-902d-4b91-8616-b03f921b3b9b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:05.355514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff56f539-902d-4b91-8616-b03f921b3b9b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:05.356015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff56f539-902d-4b91-8616-b03f921b3b9b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:05.356807 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff56f539-902d-4b91-8616-b03f921b3b9b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:05.357258 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ff56f539-902d-4b91-8616-b03f921b3b9b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:05.504305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ff56f539-902d-4b91-8616-b03f921b3b9b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:05.512198 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ff56f539-902d-4b91-8616-b03f921b3b9b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1702 microversion: 2.1 time: 0.168198 Mar 05 21:47:05.512795 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3254/6546] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:05 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1702 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:06.531260 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1c9165bd-1954-4132-85cd-59df0a40e8be tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:06.532217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1c9165bd-1954-4132-85cd-59df0a40e8be tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:06.542133 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c9165bd-1954-4132-85cd-59df0a40e8be tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:06.542905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c9165bd-1954-4132-85cd-59df0a40e8be tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:06.543948 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c9165bd-1954-4132-85cd-59df0a40e8be tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:06.544565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1c9165bd-1954-4132-85cd-59df0a40e8be tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:06.728388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1c9165bd-1954-4132-85cd-59df0a40e8be tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:06.740642 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1c9165bd-1954-4132-85cd-59df0a40e8be tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1697 microversion: 2.1 time: 0.214264 Mar 05 21:47:06.741613 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3293/6547] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:06 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1697 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:07.763336 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-20243a5c-cc6a-4659-afbe-b88e764adb1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:07.763997 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-20243a5c-cc6a-4659-afbe-b88e764adb1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:07.771325 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20243a5c-cc6a-4659-afbe-b88e764adb1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:07.771953 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20243a5c-cc6a-4659-afbe-b88e764adb1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:07.772873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20243a5c-cc6a-4659-afbe-b88e764adb1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:07.773568 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-20243a5c-cc6a-4659-afbe-b88e764adb1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:07.928451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-20243a5c-cc6a-4659-afbe-b88e764adb1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:07.937474 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-20243a5c-cc6a-4659-afbe-b88e764adb1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1697 microversion: 2.1 time: 0.178025 Mar 05 21:47:07.947442 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3255/6548] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:07 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:08.630186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-db525dc6-7d53-49cc-af12-a245a2896b34 req-be74ff3b-bd05-4754-a27b-a44f39894560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3257ffcb-79f9-4899-992b-52fc2f4fbf81", "name": "network-vif-plugged", "status": "completed", "tag": "91cfe995-5aba-45d6-b097-baf8fce1776c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:47:08.639945 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-db525dc6-7d53-49cc-af12-a245a2896b34 req-be74ff3b-bd05-4754-a27b-a44f39894560 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:08.640729 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-db525dc6-7d53-49cc-af12-a245a2896b34 req-be74ff3b-bd05-4754-a27b-a44f39894560 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:08.654597 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-db525dc6-7d53-49cc-af12-a245a2896b34 req-be74ff3b-bd05-4754-a27b-a44f39894560 service nova] Creating event network-vif-plugged:91cfe995-5aba-45d6-b097-baf8fce1776c for instance 3257ffcb-79f9-4899-992b-52fc2f4fbf81 on nch1-master-1 Mar 05 21:47:08.661275 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-db525dc6-7d53-49cc-af12-a245a2896b34 req-be74ff3b-bd05-4754-a27b-a44f39894560 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100690 Mar 05 21:47:08.665143 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3294/6549] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:47:08.954837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5110b276-b1a8-45dc-b3fe-7bc4789de530 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:08.955846 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5110b276-b1a8-45dc-b3fe-7bc4789de530 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:08.962693 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5110b276-b1a8-45dc-b3fe-7bc4789de530 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:08.963231 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5110b276-b1a8-45dc-b3fe-7bc4789de530 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:08.964110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5110b276-b1a8-45dc-b3fe-7bc4789de530 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:08.964627 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5110b276-b1a8-45dc-b3fe-7bc4789de530 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:09.123168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5110b276-b1a8-45dc-b3fe-7bc4789de530 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:09.132468 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5110b276-b1a8-45dc-b3fe-7bc4789de530 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1697 microversion: 2.1 time: 0.182064 Mar 05 21:47:09.133282 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3256/6550] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:08 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:10.151857 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7449df1d-dc3c-42c1-b8de-c4036556c70a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:10.153256 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7449df1d-dc3c-42c1-b8de-c4036556c70a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:10.160816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7449df1d-dc3c-42c1-b8de-c4036556c70a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:10.161635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7449df1d-dc3c-42c1-b8de-c4036556c70a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:10.162674 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7449df1d-dc3c-42c1-b8de-c4036556c70a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:10.163345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7449df1d-dc3c-42c1-b8de-c4036556c70a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:10.315009 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7449df1d-dc3c-42c1-b8de-c4036556c70a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:10.323324 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7449df1d-dc3c-42c1-b8de-c4036556c70a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1697 microversion: 2.1 time: 0.176668 Mar 05 21:47:10.324228 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3295/6551] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:10 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:11.346454 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b21a68a5-6f64-4883-9211-a27bed39e182 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:11.347835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b21a68a5-6f64-4883-9211-a27bed39e182 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:11.357015 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b21a68a5-6f64-4883-9211-a27bed39e182 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:11.357745 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b21a68a5-6f64-4883-9211-a27bed39e182 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:11.359509 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b21a68a5-6f64-4883-9211-a27bed39e182 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:11.360234 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b21a68a5-6f64-4883-9211-a27bed39e182 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:11.524333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b21a68a5-6f64-4883-9211-a27bed39e182 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:11.532843 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b21a68a5-6f64-4883-9211-a27bed39e182 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1697 microversion: 2.1 time: 0.192862 Mar 05 21:47:11.533646 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3257/6552] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:11 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1697 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:12.551868 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7f6d770b-d903-48c6-9b1d-83b0ecc5a761 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:12.552739 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7f6d770b-d903-48c6-9b1d-83b0ecc5a761 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:12.559703 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f6d770b-d903-48c6-9b1d-83b0ecc5a761 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:12.563072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f6d770b-d903-48c6-9b1d-83b0ecc5a761 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:12.563072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f6d770b-d903-48c6-9b1d-83b0ecc5a761 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:12.563072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7f6d770b-d903-48c6-9b1d-83b0ecc5a761 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:12.726816 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7f6d770b-d903-48c6-9b1d-83b0ecc5a761 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:12.734874 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7f6d770b-d903-48c6-9b1d-83b0ecc5a761 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1697 microversion: 2.1 time: 0.187710 Mar 05 21:47:12.735805 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3296/6553] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:12 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:13.752582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-55a3d887-fb49-4b5e-b398-a7687dac24cf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:13.753233 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-55a3d887-fb49-4b5e-b398-a7687dac24cf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:13.759904 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-55a3d887-fb49-4b5e-b398-a7687dac24cf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:13.760383 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-55a3d887-fb49-4b5e-b398-a7687dac24cf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:13.761183 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-55a3d887-fb49-4b5e-b398-a7687dac24cf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:13.763702 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-55a3d887-fb49-4b5e-b398-a7687dac24cf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:13.937220 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-55a3d887-fb49-4b5e-b398-a7687dac24cf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:13.944581 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-55a3d887-fb49-4b5e-b398-a7687dac24cf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1697 microversion: 2.1 time: 0.195946 Mar 05 21:47:13.945201 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3258/6554] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:13 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1697 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:14.964464 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4e3e77b3-1d97-4fe2-bca1-4a9df339cf8c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:14.965083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4e3e77b3-1d97-4fe2-bca1-4a9df339cf8c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:14.972467 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e3e77b3-1d97-4fe2-bca1-4a9df339cf8c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:14.972924 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e3e77b3-1d97-4fe2-bca1-4a9df339cf8c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:14.973753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e3e77b3-1d97-4fe2-bca1-4a9df339cf8c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:14.974195 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4e3e77b3-1d97-4fe2-bca1-4a9df339cf8c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:15.118420 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4e3e77b3-1d97-4fe2-bca1-4a9df339cf8c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:15.126245 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4e3e77b3-1d97-4fe2-bca1-4a9df339cf8c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1697 microversion: 2.1 time: 0.165646 Mar 05 21:47:15.126818 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3297/6555] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:14 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:16.144406 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cd223d77-d3f9-409e-b0de-1f3fd94d2943 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:16.145047 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cd223d77-d3f9-409e-b0de-1f3fd94d2943 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:16.151897 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd223d77-d3f9-409e-b0de-1f3fd94d2943 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:16.152370 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd223d77-d3f9-409e-b0de-1f3fd94d2943 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:16.153161 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd223d77-d3f9-409e-b0de-1f3fd94d2943 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:16.153621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd223d77-d3f9-409e-b0de-1f3fd94d2943 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:16.288036 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cd223d77-d3f9-409e-b0de-1f3fd94d2943 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:16.295552 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cd223d77-d3f9-409e-b0de-1f3fd94d2943 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1679 microversion: 2.1 time: 0.155007 Mar 05 21:47:16.296152 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3259/6556] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:16 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:17.319643 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b1358290-4d42-4ba7-b414-b28d397b1631 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:17.320293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b1358290-4d42-4ba7-b414-b28d397b1631 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:17.327286 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1358290-4d42-4ba7-b414-b28d397b1631 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:17.327781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1358290-4d42-4ba7-b414-b28d397b1631 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:17.328565 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1358290-4d42-4ba7-b414-b28d397b1631 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:17.329015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1358290-4d42-4ba7-b414-b28d397b1631 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:17.477430 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b1358290-4d42-4ba7-b414-b28d397b1631 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:17.486151 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b1358290-4d42-4ba7-b414-b28d397b1631 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1679 microversion: 2.1 time: 0.170388 Mar 05 21:47:17.486760 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3298/6557] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:17 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:18.475937 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b136c957-76d7-46b5-88dd-51e3a7537e85 req-920b4cc2-81d0-44aa-91c1-e67a4cfdea7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3257ffcb-79f9-4899-992b-52fc2f4fbf81", "name": "network-vif-unplugged", "status": "completed", "tag": "91cfe995-5aba-45d6-b097-baf8fce1776c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:47:18.485200 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b136c957-76d7-46b5-88dd-51e3a7537e85 req-920b4cc2-81d0-44aa-91c1-e67a4cfdea7a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:18.485673 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b136c957-76d7-46b5-88dd-51e3a7537e85 req-920b4cc2-81d0-44aa-91c1-e67a4cfdea7a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:18.497386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.compute.server_external_events [req-b136c957-76d7-46b5-88dd-51e3a7537e85 req-920b4cc2-81d0-44aa-91c1-e67a4cfdea7a service nova] Unable to find a host for instance 3257ffcb-79f9-4899-992b-52fc2f4fbf81. Dropping event network-vif-unplugged {{(pid=141478) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 05 21:47:18.498392 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b136c957-76d7-46b5-88dd-51e3a7537e85 req-920b4cc2-81d0-44aa-91c1-e67a4cfdea7a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026445 Mar 05 21:47:18.499140 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3260/6558] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Mar 05 21:47:18.503263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7bc65954-651c-4bb8-9e27-3278ea277983 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:18.504094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7bc65954-651c-4bb8-9e27-3278ea277983 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:18.510980 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7bc65954-651c-4bb8-9e27-3278ea277983 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:18.511433 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7bc65954-651c-4bb8-9e27-3278ea277983 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:18.512231 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7bc65954-651c-4bb8-9e27-3278ea277983 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:18.512670 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7bc65954-651c-4bb8-9e27-3278ea277983 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:18.647263 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7bc65954-651c-4bb8-9e27-3278ea277983 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:18.654792 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7bc65954-651c-4bb8-9e27-3278ea277983 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1622 microversion: 2.1 time: 0.155616 Mar 05 21:47:18.656536 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3299/6559] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:18 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1622 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:18.672355 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f96846a6-8a7f-412e-beea-1b54cfc6b162 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:47:18.672951 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f96846a6-8a7f-412e-beea-1b54cfc6b162 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:18.678940 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f96846a6-8a7f-412e-beea-1b54cfc6b162 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:18.679413 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f96846a6-8a7f-412e-beea-1b54cfc6b162 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:18.680230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f96846a6-8a7f-412e-beea-1b54cfc6b162 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:18.680689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-f96846a6-8a7f-412e-beea-1b54cfc6b162 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:18.843058 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f96846a6-8a7f-412e-beea-1b54cfc6b162 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "POST /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81/action" status: 202 len: 0 microversion: 2.1 time: 0.174658 Mar 05 21:47:18.843881 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3261/6560] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:47:18 2022] POST /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:47:18.851951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3028fa8c-05e4-4cbd-b6f9-f7bbd2d13af7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:18.852566 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3028fa8c-05e4-4cbd-b6f9-f7bbd2d13af7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:18.858384 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3028fa8c-05e4-4cbd-b6f9-f7bbd2d13af7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:18.858843 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3028fa8c-05e4-4cbd-b6f9-f7bbd2d13af7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:18.859615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3028fa8c-05e4-4cbd-b6f9-f7bbd2d13af7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:18.860088 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3028fa8c-05e4-4cbd-b6f9-f7bbd2d13af7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:19.010850 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3028fa8c-05e4-4cbd-b6f9-f7bbd2d13af7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:19.019392 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3028fa8c-05e4-4cbd-b6f9-f7bbd2d13af7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1630 microversion: 2.1 time: 0.171313 Mar 05 21:47:19.020031 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3300/6561] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:18 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1630 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:20.037256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0688c8f8-ea41-4544-9e77-1ee1b3cbe9c5 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:20.037900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0688c8f8-ea41-4544-9e77-1ee1b3cbe9c5 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:20.044801 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0688c8f8-ea41-4544-9e77-1ee1b3cbe9c5 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:20.045332 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0688c8f8-ea41-4544-9e77-1ee1b3cbe9c5 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:20.046208 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0688c8f8-ea41-4544-9e77-1ee1b3cbe9c5 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:20.046672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0688c8f8-ea41-4544-9e77-1ee1b3cbe9c5 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:20.570909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0688c8f8-ea41-4544-9e77-1ee1b3cbe9c5 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:20.578859 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0688c8f8-ea41-4544-9e77-1ee1b3cbe9c5 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.546316 Mar 05 21:47:20.579444 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3262/6562] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:20 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:21.388798 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-bc7c6fe8-9d96-4f65-8476-d22036dc93b4 req-2407696d-29de-4a71-8e12-ef8daefbdd9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3257ffcb-79f9-4899-992b-52fc2f4fbf81", "tag": "91cfe995-5aba-45d6-b097-baf8fce1776c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:47:21.398734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-bc7c6fe8-9d96-4f65-8476-d22036dc93b4 req-2407696d-29de-4a71-8e12-ef8daefbdd9c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:21.399196 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-bc7c6fe8-9d96-4f65-8476-d22036dc93b4 req-2407696d-29de-4a71-8e12-ef8daefbdd9c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:21.412290 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-bc7c6fe8-9d96-4f65-8476-d22036dc93b4 req-2407696d-29de-4a71-8e12-ef8daefbdd9c service nova] Creating event network-changed:91cfe995-5aba-45d6-b097-baf8fce1776c for instance 3257ffcb-79f9-4899-992b-52fc2f4fbf81 on nch2-master-1 Mar 05 21:47:21.418418 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-bc7c6fe8-9d96-4f65-8476-d22036dc93b4 req-2407696d-29de-4a71-8e12-ef8daefbdd9c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100221 Mar 05 21:47:21.419332 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3301/6563] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:47:21.596571 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-acbab0df-4a83-4a81-971b-97c5f891cb1e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:21.597288 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-acbab0df-4a83-4a81-971b-97c5f891cb1e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:21.604114 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-acbab0df-4a83-4a81-971b-97c5f891cb1e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:21.604580 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-acbab0df-4a83-4a81-971b-97c5f891cb1e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:21.605371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-acbab0df-4a83-4a81-971b-97c5f891cb1e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:21.605835 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-acbab0df-4a83-4a81-971b-97c5f891cb1e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:21.860542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-acbab0df-4a83-4a81-971b-97c5f891cb1e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:21.868196 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-acbab0df-4a83-4a81-971b-97c5f891cb1e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.275703 Mar 05 21:47:21.868785 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3263/6564] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:21 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:22.888599 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-f2c389d6-2852-4920-8f14-15ee2f1a96ff tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:22.891443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-f2c389d6-2852-4920-8f14-15ee2f1a96ff tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:22.899171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2c389d6-2852-4920-8f14-15ee2f1a96ff tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:22.899737 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2c389d6-2852-4920-8f14-15ee2f1a96ff tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:22.900601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2c389d6-2852-4920-8f14-15ee2f1a96ff tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:22.901120 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-f2c389d6-2852-4920-8f14-15ee2f1a96ff tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:23.055210 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-f2c389d6-2852-4920-8f14-15ee2f1a96ff tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:23.063613 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-f2c389d6-2852-4920-8f14-15ee2f1a96ff tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.179764 Mar 05 21:47:23.064246 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3302/6565] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:22 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:24.081862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-58411220-fa18-4766-acbe-345134c5c439 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:24.083490 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-58411220-fa18-4766-acbe-345134c5c439 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:24.089699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-58411220-fa18-4766-acbe-345134c5c439 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:24.090168 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-58411220-fa18-4766-acbe-345134c5c439 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:24.090961 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-58411220-fa18-4766-acbe-345134c5c439 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:24.091414 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-58411220-fa18-4766-acbe-345134c5c439 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:24.251435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-58411220-fa18-4766-acbe-345134c5c439 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:24.259652 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-58411220-fa18-4766-acbe-345134c5c439 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.182737 Mar 05 21:47:24.260342 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3264/6566] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:24 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:25.278094 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-105d55ac-6128-4de6-aabc-90e2c543897a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:25.278721 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-105d55ac-6128-4de6-aabc-90e2c543897a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:25.287989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-105d55ac-6128-4de6-aabc-90e2c543897a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:25.288456 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-105d55ac-6128-4de6-aabc-90e2c543897a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:25.289250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-105d55ac-6128-4de6-aabc-90e2c543897a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:25.289699 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-105d55ac-6128-4de6-aabc-90e2c543897a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:25.434171 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-105d55ac-6128-4de6-aabc-90e2c543897a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:25.443597 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-105d55ac-6128-4de6-aabc-90e2c543897a tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.169389 Mar 05 21:47:25.444251 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3303/6567] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:25 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:26.461792 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-ae783916-7a31-472b-a7ec-007138048fac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:26.462868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-ae783916-7a31-472b-a7ec-007138048fac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:26.469943 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae783916-7a31-472b-a7ec-007138048fac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:26.470434 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae783916-7a31-472b-a7ec-007138048fac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:26.471302 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae783916-7a31-472b-a7ec-007138048fac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:26.471843 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-ae783916-7a31-472b-a7ec-007138048fac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:26.632250 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-ae783916-7a31-472b-a7ec-007138048fac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:26.640991 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-ae783916-7a31-472b-a7ec-007138048fac tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.183421 Mar 05 21:47:26.641852 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3265/6568] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:26 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:27.661689 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6643c6d0-41e2-47c8-bd7f-c847bdc85580 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:27.662500 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6643c6d0-41e2-47c8-bd7f-c847bdc85580 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:27.669322 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6643c6d0-41e2-47c8-bd7f-c847bdc85580 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:27.669782 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6643c6d0-41e2-47c8-bd7f-c847bdc85580 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:27.671268 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6643c6d0-41e2-47c8-bd7f-c847bdc85580 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:27.671755 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6643c6d0-41e2-47c8-bd7f-c847bdc85580 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:27.836012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6643c6d0-41e2-47c8-bd7f-c847bdc85580 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:27.845203 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6643c6d0-41e2-47c8-bd7f-c847bdc85580 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.187295 Mar 05 21:47:27.846048 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3304/6569] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:27 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:28.862543 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9665eb40-518d-4970-bba1-9cae0c3d9612 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:28.863217 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9665eb40-518d-4970-bba1-9cae0c3d9612 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:28.870305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9665eb40-518d-4970-bba1-9cae0c3d9612 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:28.870771 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9665eb40-518d-4970-bba1-9cae0c3d9612 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:28.871563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9665eb40-518d-4970-bba1-9cae0c3d9612 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:28.872041 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9665eb40-518d-4970-bba1-9cae0c3d9612 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:29.028512 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9665eb40-518d-4970-bba1-9cae0c3d9612 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:29.036456 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9665eb40-518d-4970-bba1-9cae0c3d9612 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.177802 Mar 05 21:47:29.037237 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3266/6570] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:28 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:30.054686 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a65d3cf8-f3cd-4518-b118-a5266d2a4646 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:30.055289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a65d3cf8-f3cd-4518-b118-a5266d2a4646 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:30.062886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a65d3cf8-f3cd-4518-b118-a5266d2a4646 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:30.063345 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a65d3cf8-f3cd-4518-b118-a5266d2a4646 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:30.064162 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a65d3cf8-f3cd-4518-b118-a5266d2a4646 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:30.064610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a65d3cf8-f3cd-4518-b118-a5266d2a4646 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:30.202812 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a65d3cf8-f3cd-4518-b118-a5266d2a4646 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:30.210274 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a65d3cf8-f3cd-4518-b118-a5266d2a4646 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.159720 Mar 05 21:47:30.210850 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3305/6571] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:30 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:31.227497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e8dce266-6e67-4e9e-ba89-573fa6ea2b7f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:31.228186 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e8dce266-6e67-4e9e-ba89-573fa6ea2b7f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:31.235256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8dce266-6e67-4e9e-ba89-573fa6ea2b7f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:31.235750 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8dce266-6e67-4e9e-ba89-573fa6ea2b7f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:31.236533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8dce266-6e67-4e9e-ba89-573fa6ea2b7f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:31.236984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e8dce266-6e67-4e9e-ba89-573fa6ea2b7f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:31.372608 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e8dce266-6e67-4e9e-ba89-573fa6ea2b7f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:31.380062 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e8dce266-6e67-4e9e-ba89-573fa6ea2b7f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.156526 Mar 05 21:47:31.380649 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3267/6572] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:31 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:32.397065 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2dc601bf-7777-45c0-bc15-ab9ba020ecdf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:32.397684 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2dc601bf-7777-45c0-bc15-ab9ba020ecdf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:32.404538 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dc601bf-7777-45c0-bc15-ab9ba020ecdf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:32.405626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dc601bf-7777-45c0-bc15-ab9ba020ecdf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:32.406483 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dc601bf-7777-45c0-bc15-ab9ba020ecdf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:32.406921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2dc601bf-7777-45c0-bc15-ab9ba020ecdf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:32.540325 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2dc601bf-7777-45c0-bc15-ab9ba020ecdf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:32.547801 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2dc601bf-7777-45c0-bc15-ab9ba020ecdf tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.154629 Mar 05 21:47:32.548372 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3306/6573] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:32 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:33.565184 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-dd82df3f-a543-4374-a39b-9c4f67cc8d6c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:33.565865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-dd82df3f-a543-4374-a39b-9c4f67cc8d6c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:33.572895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd82df3f-a543-4374-a39b-9c4f67cc8d6c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:33.573435 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd82df3f-a543-4374-a39b-9c4f67cc8d6c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:33.574263 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd82df3f-a543-4374-a39b-9c4f67cc8d6c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:33.574718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-dd82df3f-a543-4374-a39b-9c4f67cc8d6c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:33.715365 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-dd82df3f-a543-4374-a39b-9c4f67cc8d6c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:33.724222 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-dd82df3f-a543-4374-a39b-9c4f67cc8d6c tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.163420 Mar 05 21:47:33.724855 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3268/6574] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:33 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:34.741972 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ca865e67-03cf-48fd-9f05-e51d5152bcad tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:34.742592 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ca865e67-03cf-48fd-9f05-e51d5152bcad tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:34.749787 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca865e67-03cf-48fd-9f05-e51d5152bcad tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:34.750242 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca865e67-03cf-48fd-9f05-e51d5152bcad tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:34.751037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca865e67-03cf-48fd-9f05-e51d5152bcad tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:34.751479 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ca865e67-03cf-48fd-9f05-e51d5152bcad tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:34.888277 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ca865e67-03cf-48fd-9f05-e51d5152bcad tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:34.896275 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ca865e67-03cf-48fd-9f05-e51d5152bcad tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.158519 Mar 05 21:47:34.896860 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3307/6575] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:34 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:35.914303 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-a080ab54-c38f-4efe-a597-d312f9900bb7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:35.914957 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-a080ab54-c38f-4efe-a597-d312f9900bb7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:35.923150 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a080ab54-c38f-4efe-a597-d312f9900bb7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:35.923624 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a080ab54-c38f-4efe-a597-d312f9900bb7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:35.924457 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a080ab54-c38f-4efe-a597-d312f9900bb7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:35.924905 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-a080ab54-c38f-4efe-a597-d312f9900bb7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:35.927354 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-f6bfbc55-1601-4a00-b9ad-d34606097c49 req-f7e93c11-988f-476a-8274-e50c0d8e77f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3257ffcb-79f9-4899-992b-52fc2f4fbf81", "name": "network-vif-plugged", "status": "completed", "tag": "91cfe995-5aba-45d6-b097-baf8fce1776c"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:47:35.939030 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f6bfbc55-1601-4a00-b9ad-d34606097c49 req-f7e93c11-988f-476a-8274-e50c0d8e77f9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:35.939622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-f6bfbc55-1601-4a00-b9ad-d34606097c49 req-f7e93c11-988f-476a-8274-e50c0d8e77f9 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:35.953167 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-f6bfbc55-1601-4a00-b9ad-d34606097c49 req-f7e93c11-988f-476a-8274-e50c0d8e77f9 service nova] Creating event network-vif-plugged:91cfe995-5aba-45d6-b097-baf8fce1776c for instance 3257ffcb-79f9-4899-992b-52fc2f4fbf81 on nch2-master-1 Mar 05 21:47:35.960064 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-f6bfbc55-1601-4a00-b9ad-d34606097c49 req-f7e93c11-988f-476a-8274-e50c0d8e77f9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036635 Mar 05 21:47:35.960959 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3308/6576] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:47:36.071384 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-a080ab54-c38f-4efe-a597-d312f9900bb7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:36.080509 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-a080ab54-c38f-4efe-a597-d312f9900bb7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.170277 Mar 05 21:47:36.081179 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3269/6577] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:35 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:37.098708 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-29f0b0a0-9262-40c4-a577-38226d60ec95 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:37.099451 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-29f0b0a0-9262-40c4-a577-38226d60ec95 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:37.106432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29f0b0a0-9262-40c4-a577-38226d60ec95 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:37.106887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29f0b0a0-9262-40c4-a577-38226d60ec95 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:37.108443 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29f0b0a0-9262-40c4-a577-38226d60ec95 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:37.108813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-29f0b0a0-9262-40c4-a577-38226d60ec95 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:37.247662 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-29f0b0a0-9262-40c4-a577-38226d60ec95 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:37.259191 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-29f0b0a0-9262-40c4-a577-38226d60ec95 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1688 microversion: 2.1 time: 0.164652 Mar 05 21:47:37.260116 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3309/6578] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:37 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:47:38.279362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7ecdf4f0-3756-4891-a3e0-47ef50faa22e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:47:38.280199 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7ecdf4f0-3756-4891-a3e0-47ef50faa22e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:47:38.286730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ecdf4f0-3756-4891-a3e0-47ef50faa22e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:38.287223 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ecdf4f0-3756-4891-a3e0-47ef50faa22e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:38.288048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ecdf4f0-3756-4891-a3e0-47ef50faa22e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:47:38.288497 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7ecdf4f0-3756-4891-a3e0-47ef50faa22e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:47:38.427558 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7ecdf4f0-3756-4891-a3e0-47ef50faa22e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:47:38.434900 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7ecdf4f0-3756-4891-a3e0-47ef50faa22e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1675 microversion: 2.1 time: 0.159575 Mar 05 21:47:38.435474 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3270/6579] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:47:38 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:48:48.145152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-afc603e1-1015-40b9-8427-1a3eb36e5073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:48:48.145707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-afc603e1-1015-40b9-8427-1a3eb36e5073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:48:48.156867 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afc603e1-1015-40b9-8427-1a3eb36e5073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:48.157327 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afc603e1-1015-40b9-8427-1a3eb36e5073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:48.158135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afc603e1-1015-40b9-8427-1a3eb36e5073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:48.158582 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-afc603e1-1015-40b9-8427-1a3eb36e5073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:48.189388 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-afc603e1-1015-40b9-8427-1a3eb36e5073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:48:48.248371 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a08f4978-1530-4906-81fd-91283e3de031 req-351b024e-a9d2-43bd-9986-0073728eb1cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3257ffcb-79f9-4899-992b-52fc2f4fbf81", "tag": "91cfe995-5aba-45d6-b097-baf8fce1776c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:48:48.260871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a08f4978-1530-4906-81fd-91283e3de031 req-351b024e-a9d2-43bd-9986-0073728eb1cb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:48.261424 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a08f4978-1530-4906-81fd-91283e3de031 req-351b024e-a9d2-43bd-9986-0073728eb1cb service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:48.279226 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a08f4978-1530-4906-81fd-91283e3de031 req-351b024e-a9d2-43bd-9986-0073728eb1cb service nova] Creating event network-changed:91cfe995-5aba-45d6-b097-baf8fce1776c for instance 3257ffcb-79f9-4899-992b-52fc2f4fbf81 on nch2-master-1 Mar 05 21:48:48.284571 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a08f4978-1530-4906-81fd-91283e3de031 req-351b024e-a9d2-43bd-9986-0073728eb1cb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097305 Mar 05 21:48:48.285295 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3271/6580] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:48:48.309519 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-afc603e1-1015-40b9-8427-1a3eb36e5073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 204 len: 0 microversion: 2.1 time: 0.169752 Mar 05 21:48:48.310461 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3310/6581] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:48:48 2022] DELETE /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:48:48.320432 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-33618754-8af8-401b-a306-ad3fce8e1400 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:48:48.321176 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-33618754-8af8-401b-a306-ad3fce8e1400 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:48:48.330026 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33618754-8af8-401b-a306-ad3fce8e1400 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:48.330796 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33618754-8af8-401b-a306-ad3fce8e1400 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:48.331607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33618754-8af8-401b-a306-ad3fce8e1400 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:48.332094 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-33618754-8af8-401b-a306-ad3fce8e1400 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:48.587542 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-33618754-8af8-401b-a306-ad3fce8e1400 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:48:48.595387 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-33618754-8af8-401b-a306-ad3fce8e1400 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1681 microversion: 2.1 time: 0.280311 Mar 05 21:48:48.596012 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3272/6582] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:48:48 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:48:49.614569 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-1dcbc36a-d10c-4184-ab6c-1b197874e04e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:48:49.615288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-1dcbc36a-d10c-4184-ab6c-1b197874e04e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:48:49.622578 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1dcbc36a-d10c-4184-ab6c-1b197874e04e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:49.623037 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1dcbc36a-d10c-4184-ab6c-1b197874e04e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:49.623854 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1dcbc36a-d10c-4184-ab6c-1b197874e04e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:49.624296 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-1dcbc36a-d10c-4184-ab6c-1b197874e04e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:49.767460 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-1dcbc36a-d10c-4184-ab6c-1b197874e04e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:48:49.776676 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-1dcbc36a-d10c-4184-ab6c-1b197874e04e tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 200 len: 1562 microversion: 2.1 time: 0.166447 Mar 05 21:48:49.777472 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3311/6583] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:48:49 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:48:50.084477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-f75b6100-c7f0-440f-a944-7590326323f8 req-6651d440-fa2e-408b-a665-e3d6eda20214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3257ffcb-79f9-4899-992b-52fc2f4fbf81", "name": "network-vif-deleted", "tag": "91cfe995-5aba-45d6-b097-baf8fce1776c"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:48:50.094538 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f75b6100-c7f0-440f-a944-7590326323f8 req-6651d440-fa2e-408b-a665-e3d6eda20214 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:50.095013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-f75b6100-c7f0-440f-a944-7590326323f8 req-6651d440-fa2e-408b-a665-e3d6eda20214 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:50.107230 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-f75b6100-c7f0-440f-a944-7590326323f8 req-6651d440-fa2e-408b-a665-e3d6eda20214 service nova] Creating event network-vif-deleted:91cfe995-5aba-45d6-b097-baf8fce1776c for instance 3257ffcb-79f9-4899-992b-52fc2f4fbf81 on nch2-master-1 Mar 05 21:48:50.112452 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-f75b6100-c7f0-440f-a944-7590326323f8 req-6651d440-fa2e-408b-a665-e3d6eda20214 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031921 Mar 05 21:48:50.113060 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3273/6584] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:48:50.794321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c7f44a41-8a79-4d61-9a42-38a6d6a7aaa0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:48:50.794882 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c7f44a41-8a79-4d61-9a42-38a6d6a7aaa0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 3257ffcb-79f9-4899-992b-52fc2f4fbf81] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:48:50.801620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7f44a41-8a79-4d61-9a42-38a6d6a7aaa0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:50.802086 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7f44a41-8a79-4d61-9a42-38a6d6a7aaa0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:50.802947 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7f44a41-8a79-4d61-9a42-38a6d6a7aaa0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:50.803386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c7f44a41-8a79-4d61-9a42-38a6d6a7aaa0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:50.819044 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-c7f44a41-8a79-4d61-9a42-38a6d6a7aaa0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] HTTP exception thrown: Instance 3257ffcb-79f9-4899-992b-52fc2f4fbf81 could not be found. Mar 05 21:48:50.819647 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c7f44a41-8a79-4d61-9a42-38a6d6a7aaa0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Returning 404 to user: Instance 3257ffcb-79f9-4899-992b-52fc2f4fbf81 could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:48:50.820500 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c7f44a41-8a79-4d61-9a42-38a6d6a7aaa0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81" status: 404 len: 111 microversion: 2.1 time: 0.030322 Mar 05 21:48:50.821053 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3312/6585] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:48:50 2022] GET /compute/v2.1/servers/3257ffcb-79f9-4899-992b-52fc2f4fbf81 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:48:50.982440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-74db84d4-0b42-47f4-a72f-68769ee7e75d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '.version_select at 0x7fed4f92c820>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:48:51.008643 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-74db84d4-0b42-47f4-a72f-68769ee7e75d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1264540085" status: 202 len: 0 microversion: 2.1 time: 0.030413 Mar 05 21:48:51.009330 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3274/6586] 10.222.0.15 () {58 vars in 1253 bytes} [Sat Mar 5 21:48:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1264540085 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:48:51.027990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b5ccb359-66fb-4b72-8075-3543db7e9f1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Action: 'create', calling method: .version_select at 0x7fed5c241e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-566622529"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:48:51.044021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b5ccb359-66fb-4b72-8075-3543db7e9f1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Getting quotas for project d8fd34db08b648489afd4f749b965e2a. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:48:51.050054 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b5ccb359-66fb-4b72-8075-3543db7e9f1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Getting quotas for user 47a7c63e175949e1938accdece2a4c95 and project d8fd34db08b648489afd4f749b965e2a. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:48:51.264544 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b5ccb359-66fb-4b72-8075-3543db7e9f1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Getting quotas for project d8fd34db08b648489afd4f749b965e2a. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:48:51.269514 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-b5ccb359-66fb-4b72-8075-3543db7e9f1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Getting quotas for user 47a7c63e175949e1938accdece2a4c95 and project d8fd34db08b648489afd4f749b965e2a. Resources: {'key_pairs'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:48:51.284242 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b5ccb359-66fb-4b72-8075-3543db7e9f1f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.260335 Mar 05 21:48:51.284845 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3313/6587] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:48:51 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:48:54.682019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-455443186", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-566622529", "security_groups": [{"name": "tempest-secgroup-smoke-1164283825"}], "networks": [{"uuid": "7b9e505b-9603-4138-a09d-a6d35f18795c"}], "block_device_mapping_v2": [{"uuid": "5bac931b-1247-4175-9eba-facd71a337a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:48:54.793057 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.network.neutron [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] validate_networks() for [('7b9e505b-9603-4138-a09d-a6d35f18795c', None, None, None, None, None)] {{(pid=141478) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:48:55.169372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Flavor limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:48:55.169923 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Image limits 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:48:55.170418 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Flavor pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:48:55.170844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Image pref 0:0:0 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:48:55.171271 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.virt.hardware [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:48:55.182934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:55.183400 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:55.184257 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:55.184733 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:55.203338 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Getting quotas for project d8fd34db08b648489afd4f749b965e2a. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:48:55.208474 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Getting quotas for user 47a7c63e175949e1938accdece2a4c95 and project d8fd34db08b648489afd4f749b965e2a. Resources: {'instances', 'ram', 'cores'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:48:55.265230 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Going to run 1 instances... {{(pid=141478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:48:55.267433 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5bac931b-1247-4175-9eba-facd71a337a4',volume_size=None,volume_type=None)] {{(pid=141478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:48:55.391191 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7c73c027-5a94-4c1c-bec8-e89b8fe8ce3d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.714617 Mar 05 21:48:55.391879 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3275/6588] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:48:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:48:55.404157 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-61a5a0bc-adf8-4d8e-a58b-803fe7b4970b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:48:55.404840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-61a5a0bc-adf8-4d8e-a58b-803fe7b4970b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:48:55.460129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-61a5a0bc-adf8-4d8e-a58b-803fe7b4970b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:48:55.466868 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-61a5a0bc-adf8-4d8e-a58b-803fe7b4970b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1087 microversion: 2.1 time: 0.068200 Mar 05 21:48:55.471315 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3314/6589] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:48:55 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1087 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:48:56.487053 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-cd550cfa-668e-46b8-ab17-b9fa50500a1d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:48:56.487694 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-cd550cfa-668e-46b8-ab17-b9fa50500a1d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:48:56.494916 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd550cfa-668e-46b8-ab17-b9fa50500a1d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:56.495386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd550cfa-668e-46b8-ab17-b9fa50500a1d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:56.496206 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd550cfa-668e-46b8-ab17-b9fa50500a1d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:56.496658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-cd550cfa-668e-46b8-ab17-b9fa50500a1d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:56.580158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-cd550cfa-668e-46b8-ab17-b9fa50500a1d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:48:56.587975 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-cd550cfa-668e-46b8-ab17-b9fa50500a1d tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1203 microversion: 2.1 time: 0.105600 Mar 05 21:48:56.588747 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3276/6590] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:48:56 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1203 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:48:57.606109 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-23e24384-1b65-498f-b283-6a328fed9123 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:48:57.606771 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-23e24384-1b65-498f-b283-6a328fed9123 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:48:57.615685 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-23e24384-1b65-498f-b283-6a328fed9123 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:57.616696 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-23e24384-1b65-498f-b283-6a328fed9123 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:57.617567 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-23e24384-1b65-498f-b283-6a328fed9123 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:57.618087 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-23e24384-1b65-498f-b283-6a328fed9123 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:57.772461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-23e24384-1b65-498f-b283-6a328fed9123 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:48:57.782128 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-23e24384-1b65-498f-b283-6a328fed9123 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1259 microversion: 2.1 time: 0.180195 Mar 05 21:48:57.783376 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3315/6591] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:48:57 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:48:57.851029 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-51453371-7db0-472e-9827-ef9d1eee9cde req-cc578acd-99ec-4191-a0c0-2ad34c39d019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ffbb17-44b3-4d00-ab3d-97591ba831c4", "tag": "93180cd6-f4ad-461c-b8ed-acd6a04868b7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:48:57.865993 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-51453371-7db0-472e-9827-ef9d1eee9cde req-cc578acd-99ec-4191-a0c0-2ad34c39d019 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:57.866734 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-51453371-7db0-472e-9827-ef9d1eee9cde req-cc578acd-99ec-4191-a0c0-2ad34c39d019 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:57.879593 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-51453371-7db0-472e-9827-ef9d1eee9cde req-cc578acd-99ec-4191-a0c0-2ad34c39d019 service nova] Creating event network-changed:93180cd6-f4ad-461c-b8ed-acd6a04868b7 for instance 34ffbb17-44b3-4d00-ab3d-97591ba831c4 on nch1-master-1 Mar 05 21:48:57.885946 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-51453371-7db0-472e-9827-ef9d1eee9cde req-cc578acd-99ec-4191-a0c0-2ad34c39d019 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040607 Mar 05 21:48:57.886989 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3277/6592] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:48:58.799989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a1383e6f-73b8-4fb9-87cc-970865f1df88 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:48:58.800610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a1383e6f-73b8-4fb9-87cc-970865f1df88 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:48:58.808010 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a1383e6f-73b8-4fb9-87cc-970865f1df88 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:58.808472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a1383e6f-73b8-4fb9-87cc-970865f1df88 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:58.809250 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a1383e6f-73b8-4fb9-87cc-970865f1df88 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:58.809691 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a1383e6f-73b8-4fb9-87cc-970865f1df88 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:58.947886 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a1383e6f-73b8-4fb9-87cc-970865f1df88 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:48:58.955321 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a1383e6f-73b8-4fb9-87cc-970865f1df88 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1259 microversion: 2.1 time: 0.159250 Mar 05 21:48:58.955929 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3316/6593] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:48:58 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:48:59.972686 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1a2e0a32-43aa-4ae3-8a40-ea14a5304c8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:48:59.973493 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1a2e0a32-43aa-4ae3-8a40-ea14a5304c8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:48:59.981449 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a2e0a32-43aa-4ae3-8a40-ea14a5304c8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:59.981855 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a2e0a32-43aa-4ae3-8a40-ea14a5304c8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:48:59.982663 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a2e0a32-43aa-4ae3-8a40-ea14a5304c8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:48:59.983112 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1a2e0a32-43aa-4ae3-8a40-ea14a5304c8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:00.118063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1a2e0a32-43aa-4ae3-8a40-ea14a5304c8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:49:00.125431 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1a2e0a32-43aa-4ae3-8a40-ea14a5304c8f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1259 microversion: 2.1 time: 0.157031 Mar 05 21:49:00.126010 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3278/6594] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:48:59 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:49:01.143181 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-130ef8cf-d202-4950-a0a6-7ec6e5a04714 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:49:01.143852 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-130ef8cf-d202-4950-a0a6-7ec6e5a04714 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:49:01.151233 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-130ef8cf-d202-4950-a0a6-7ec6e5a04714 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:01.151712 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-130ef8cf-d202-4950-a0a6-7ec6e5a04714 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:01.152498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-130ef8cf-d202-4950-a0a6-7ec6e5a04714 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:01.152939 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-130ef8cf-d202-4950-a0a6-7ec6e5a04714 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:01.291491 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-130ef8cf-d202-4950-a0a6-7ec6e5a04714 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:49:01.298750 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-130ef8cf-d202-4950-a0a6-7ec6e5a04714 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1259 microversion: 2.1 time: 0.159625 Mar 05 21:49:01.299316 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3317/6595] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:49:01 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:49:02.315703 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7cb41ca4-f4fb-4e3b-8015-3f125f9b7dd7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:49:02.316391 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-7cb41ca4-f4fb-4e3b-8015-3f125f9b7dd7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:49:02.323616 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cb41ca4-f4fb-4e3b-8015-3f125f9b7dd7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:02.324123 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cb41ca4-f4fb-4e3b-8015-3f125f9b7dd7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:02.324910 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cb41ca4-f4fb-4e3b-8015-3f125f9b7dd7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:02.325396 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-7cb41ca4-f4fb-4e3b-8015-3f125f9b7dd7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:02.461942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-7cb41ca4-f4fb-4e3b-8015-3f125f9b7dd7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:49:02.469371 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7cb41ca4-f4fb-4e3b-8015-3f125f9b7dd7 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1259 microversion: 2.1 time: 0.157709 Mar 05 21:49:02.469966 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3279/6596] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:49:02 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:49:03.487748 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-de96630f-7346-424a-b4f5-6743a5466fc0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:49:03.488306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-de96630f-7346-424a-b4f5-6743a5466fc0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:49:03.496238 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de96630f-7346-424a-b4f5-6743a5466fc0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:03.496704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de96630f-7346-424a-b4f5-6743a5466fc0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:03.497498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de96630f-7346-424a-b4f5-6743a5466fc0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:03.497954 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-de96630f-7346-424a-b4f5-6743a5466fc0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:03.634943 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-de96630f-7346-424a-b4f5-6743a5466fc0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:49:03.642407 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-de96630f-7346-424a-b4f5-6743a5466fc0 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1259 microversion: 2.1 time: 0.158710 Mar 05 21:49:03.642995 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3318/6597] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:49:03 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:49:04.659210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5a330aa7-ea51-4e2a-9fbb-84b8404cfa83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:49:04.659887 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5a330aa7-ea51-4e2a-9fbb-84b8404cfa83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:49:04.667401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a330aa7-ea51-4e2a-9fbb-84b8404cfa83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:04.667908 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a330aa7-ea51-4e2a-9fbb-84b8404cfa83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:04.668825 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a330aa7-ea51-4e2a-9fbb-84b8404cfa83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:04.669294 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5a330aa7-ea51-4e2a-9fbb-84b8404cfa83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:04.803052 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5a330aa7-ea51-4e2a-9fbb-84b8404cfa83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:49:04.810426 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5a330aa7-ea51-4e2a-9fbb-84b8404cfa83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1259 microversion: 2.1 time: 0.155180 Mar 05 21:49:04.811021 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3280/6598] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:49:04 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:49:05.162704 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-e7ab7056-c673-4211-819c-6183b34ca713 req-585fa968-5a80-49b5-8032-2c4d86aa9776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ffbb17-44b3-4d00-ab3d-97591ba831c4", "name": "network-vif-plugged", "status": "completed", "tag": "93180cd6-f4ad-461c-b8ed-acd6a04868b7"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:49:05.172003 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e7ab7056-c673-4211-819c-6183b34ca713 req-585fa968-5a80-49b5-8032-2c4d86aa9776 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:05.172590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-e7ab7056-c673-4211-819c-6183b34ca713 req-585fa968-5a80-49b5-8032-2c4d86aa9776 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:05.184170 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-e7ab7056-c673-4211-819c-6183b34ca713 req-585fa968-5a80-49b5-8032-2c4d86aa9776 service nova] Creating event network-vif-plugged:93180cd6-f4ad-461c-b8ed-acd6a04868b7 for instance 34ffbb17-44b3-4d00-ab3d-97591ba831c4 on nch1-master-1 Mar 05 21:49:05.189196 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-e7ab7056-c673-4211-819c-6183b34ca713 req-585fa968-5a80-49b5-8032-2c4d86aa9776 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030908 Mar 05 21:49:05.189807 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3319/6599] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:49:05.828004 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-477c11c9-c0da-4b05-8ea6-84333f81b1c4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:49:05.828636 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-477c11c9-c0da-4b05-8ea6-84333f81b1c4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:49:05.835363 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-477c11c9-c0da-4b05-8ea6-84333f81b1c4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:05.835868 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-477c11c9-c0da-4b05-8ea6-84333f81b1c4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:05.836641 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-477c11c9-c0da-4b05-8ea6-84333f81b1c4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:05.837115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-477c11c9-c0da-4b05-8ea6-84333f81b1c4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:05.971210 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-477c11c9-c0da-4b05-8ea6-84333f81b1c4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:49:05.978719 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-477c11c9-c0da-4b05-8ea6-84333f81b1c4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1259 microversion: 2.1 time: 0.154614 Mar 05 21:49:05.979300 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3281/6600] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:49:05 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:49:06.997561 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-68c17c13-f687-48ce-9076-919eb9a72b76 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:49:06.998282 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-68c17c13-f687-48ce-9076-919eb9a72b76 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:49:07.004628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68c17c13-f687-48ce-9076-919eb9a72b76 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:07.005587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68c17c13-f687-48ce-9076-919eb9a72b76 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:07.006370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68c17c13-f687-48ce-9076-919eb9a72b76 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:07.006846 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68c17c13-f687-48ce-9076-919eb9a72b76 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:07.142983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-68c17c13-f687-48ce-9076-919eb9a72b76 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:49:07.151127 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-68c17c13-f687-48ce-9076-919eb9a72b76 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1443 microversion: 2.1 time: 0.158681 Mar 05 21:49:07.151748 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3320/6601] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:49:06 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:49:07.167133 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e1fcd3cb-96c9-4ce3-8352-2e9acd2d2b00 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:49:07.167794 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e1fcd3cb-96c9-4ce3-8352-2e9acd2d2b00 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:49:07.174440 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e1fcd3cb-96c9-4ce3-8352-2e9acd2d2b00 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:07.174909 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e1fcd3cb-96c9-4ce3-8352-2e9acd2d2b00 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:07.175712 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e1fcd3cb-96c9-4ce3-8352-2e9acd2d2b00 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:07.176170 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e1fcd3cb-96c9-4ce3-8352-2e9acd2d2b00 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:07.308386 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e1fcd3cb-96c9-4ce3-8352-2e9acd2d2b00 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:49:07.315740 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e1fcd3cb-96c9-4ce3-8352-2e9acd2d2b00 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1443 microversion: 2.1 time: 0.152463 Mar 05 21:49:07.316326 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3282/6602] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:49:07 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:49:09.725064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-7ee5299e-60b1-4e2f-b14f-2903e1f519e0 req-2a153f4d-a98e-45a2-a699-543736c8f7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ffbb17-44b3-4d00-ab3d-97591ba831c4", "tag": "93180cd6-f4ad-461c-b8ed-acd6a04868b7"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:49:09.735165 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7ee5299e-60b1-4e2f-b14f-2903e1f519e0 req-2a153f4d-a98e-45a2-a699-543736c8f7c1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:49:09.735888 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-7ee5299e-60b1-4e2f-b14f-2903e1f519e0 req-2a153f4d-a98e-45a2-a699-543736c8f7c1 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:49:09.749503 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-7ee5299e-60b1-4e2f-b14f-2903e1f519e0 req-2a153f4d-a98e-45a2-a699-543736c8f7c1 service nova] Creating event network-changed:93180cd6-f4ad-461c-b8ed-acd6a04868b7 for instance 34ffbb17-44b3-4d00-ab3d-97591ba831c4 on nch1-master-1 Mar 05 21:49:09.756961 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-7ee5299e-60b1-4e2f-b14f-2903e1f519e0 req-2a153f4d-a98e-45a2-a699-543736c8f7c1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035694 Mar 05 21:49:09.757650 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3321/6603] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:50:12.433294 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:50:12.434020 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 21:50:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:51:14.704932 ncdv-master-1 devstack@n-api.service[141478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [acc7cacd-1878-4025-b503-960cdc977e32] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 05 21:51:14.705863 ncdv-master-1 devstack@n-api.service[141478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6a0c9ad-ada5-4110-a451-98e637deeab0] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 05 21:51:14.808333 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-70bf597e-5f7e-45e9-b10e-5e1e34752a21 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:51:14.808930 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-70bf597e-5f7e-45e9-b10e-5e1e34752a21 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:14.814879 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70bf597e-5f7e-45e9-b10e-5e1e34752a21 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:14.815359 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70bf597e-5f7e-45e9-b10e-5e1e34752a21 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:14.816191 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70bf597e-5f7e-45e9-b10e-5e1e34752a21 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:14.816651 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-70bf597e-5f7e-45e9-b10e-5e1e34752a21 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:14.838344 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.objects.instance [None req-70bf597e-5f7e-45e9-b10e-5e1e34752a21 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lazy-loading 'flavor' on Instance uuid 34ffbb17-44b3-4d00-ab3d-97591ba831c4 {{(pid=141478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:51:14.911247 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-70bf597e-5f7e-45e9-b10e-5e1e34752a21 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "POST /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4/action" status: 202 len: 0 microversion: 2.1 time: 0.207931 Mar 05 21:51:14.912655 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3283/6604] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:51:14 2022] POST /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:51:14.918358 ncdv-master-1 devstack@n-api.service[141479]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f4676b75-9eec-4512-826f-cf92fa0c9e09] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 05 21:51:14.919200 ncdv-master-1 devstack@n-api.service[141479]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7d5eb8e-fc88-4581-82a8-5abda8610d81] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 05 21:51:14.923353 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3266f3af-f3ca-409b-8f19-831f6542a0a8 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:14.924101 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3266f3af-f3ca-409b-8f19-831f6542a0a8 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:14.931274 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3266f3af-f3ca-409b-8f19-831f6542a0a8 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:14.931874 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3266f3af-f3ca-409b-8f19-831f6542a0a8 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:14.932669 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3266f3af-f3ca-409b-8f19-831f6542a0a8 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:14.933122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3266f3af-f3ca-409b-8f19-831f6542a0a8 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:15.082125 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3266f3af-f3ca-409b-8f19-831f6542a0a8 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:15.089632 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3266f3af-f3ca-409b-8f19-831f6542a0a8 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1568 microversion: 2.1 time: 0.173064 Mar 05 21:51:15.090214 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3322/6605] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:14 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:16.109554 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-b2949f53-69e8-406e-8c9b-4331f23319ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:16.110196 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-b2949f53-69e8-406e-8c9b-4331f23319ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:16.118642 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6a0c9ad-ada5-4110-a451-98e637deeab0] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 34380. Mar 05 21:51:16.120244 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2949f53-69e8-406e-8c9b-4331f23319ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:16.120714 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2949f53-69e8-406e-8c9b-4331f23319ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:16.121501 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2949f53-69e8-406e-8c9b-4331f23319ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:16.121955 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-b2949f53-69e8-406e-8c9b-4331f23319ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:16.127502 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] [acc7cacd-1878-4025-b503-960cdc977e32] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 34378. Mar 05 21:51:16.258007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-b2949f53-69e8-406e-8c9b-4331f23319ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:16.265572 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-b2949f53-69e8-406e-8c9b-4331f23319ca tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1568 microversion: 2.1 time: 0.162176 Mar 05 21:51:16.266155 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3284/6606] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:16 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:17.284635 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-5e465a7d-03e8-4f2f-bc1d-92cf8cd48114 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:17.285185 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-5e465a7d-03e8-4f2f-bc1d-92cf8cd48114 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:17.295160 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e465a7d-03e8-4f2f-bc1d-92cf8cd48114 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:17.295628 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e465a7d-03e8-4f2f-bc1d-92cf8cd48114 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:17.296450 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e465a7d-03e8-4f2f-bc1d-92cf8cd48114 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:17.297021 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-5e465a7d-03e8-4f2f-bc1d-92cf8cd48114 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:17.303354 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7d5eb8e-fc88-4581-82a8-5abda8610d81] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 34386. Mar 05 21:51:17.314128 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] [f4676b75-9eec-4512-826f-cf92fa0c9e09] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 34384. Mar 05 21:51:17.432348 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-5e465a7d-03e8-4f2f-bc1d-92cf8cd48114 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:17.439759 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-5e465a7d-03e8-4f2f-bc1d-92cf8cd48114 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1568 microversion: 2.1 time: 0.159135 Mar 05 21:51:17.440335 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3323/6607] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:17 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:18.457557 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-6313f536-c95d-4aa9-83e3-29a950a5e3da tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:18.458181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-6313f536-c95d-4aa9-83e3-29a950a5e3da tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:18.464900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6313f536-c95d-4aa9-83e3-29a950a5e3da tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:18.465362 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6313f536-c95d-4aa9-83e3-29a950a5e3da tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:18.466146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6313f536-c95d-4aa9-83e3-29a950a5e3da tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:18.466596 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-6313f536-c95d-4aa9-83e3-29a950a5e3da tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:18.602124 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-6313f536-c95d-4aa9-83e3-29a950a5e3da tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:18.609937 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-6313f536-c95d-4aa9-83e3-29a950a5e3da tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1568 microversion: 2.1 time: 0.156295 Mar 05 21:51:18.610526 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3285/6608] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:18 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:19.628051 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-218ab4ba-b8e7-4467-8752-b1db2f7d1c8b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:19.628626 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-218ab4ba-b8e7-4467-8752-b1db2f7d1c8b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:19.635990 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-218ab4ba-b8e7-4467-8752-b1db2f7d1c8b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:19.636447 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-218ab4ba-b8e7-4467-8752-b1db2f7d1c8b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:19.637215 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-218ab4ba-b8e7-4467-8752-b1db2f7d1c8b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:19.637655 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-218ab4ba-b8e7-4467-8752-b1db2f7d1c8b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:19.773465 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-218ab4ba-b8e7-4467-8752-b1db2f7d1c8b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:19.780909 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-218ab4ba-b8e7-4467-8752-b1db2f7d1c8b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1568 microversion: 2.1 time: 0.157015 Mar 05 21:51:19.781482 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3324/6609] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:19 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:20.798342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-d7ef73c0-9aa6-4eac-a3f0-4161df4a99a3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:20.798964 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-d7ef73c0-9aa6-4eac-a3f0-4161df4a99a3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:20.806372 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7ef73c0-9aa6-4eac-a3f0-4161df4a99a3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:20.806831 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7ef73c0-9aa6-4eac-a3f0-4161df4a99a3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:20.807607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7ef73c0-9aa6-4eac-a3f0-4161df4a99a3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:20.808081 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-d7ef73c0-9aa6-4eac-a3f0-4161df4a99a3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:20.948983 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-d7ef73c0-9aa6-4eac-a3f0-4161df4a99a3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:20.956483 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-d7ef73c0-9aa6-4eac-a3f0-4161df4a99a3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1568 microversion: 2.1 time: 0.162077 Mar 05 21:51:20.957058 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3286/6610] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:20 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:21.975239 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8ffb8e9e-f155-4942-b12f-48e41e41e542 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:21.975989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8ffb8e9e-f155-4942-b12f-48e41e41e542 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:21.982732 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ffb8e9e-f155-4942-b12f-48e41e41e542 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:21.983186 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ffb8e9e-f155-4942-b12f-48e41e41e542 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:21.983998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ffb8e9e-f155-4942-b12f-48e41e41e542 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:21.984879 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8ffb8e9e-f155-4942-b12f-48e41e41e542 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:22.130050 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8ffb8e9e-f155-4942-b12f-48e41e41e542 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:22.138113 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8ffb8e9e-f155-4942-b12f-48e41e41e542 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1568 microversion: 2.1 time: 0.167580 Mar 05 21:51:22.138684 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3325/6611] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:21 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:23.156246 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-15a3749b-79a8-4005-a6f5-8ab01d72f031 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:23.156837 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-15a3749b-79a8-4005-a6f5-8ab01d72f031 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:23.164109 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15a3749b-79a8-4005-a6f5-8ab01d72f031 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:23.164587 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15a3749b-79a8-4005-a6f5-8ab01d72f031 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:23.165401 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15a3749b-79a8-4005-a6f5-8ab01d72f031 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:23.165865 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-15a3749b-79a8-4005-a6f5-8ab01d72f031 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:23.299549 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-15a3749b-79a8-4005-a6f5-8ab01d72f031 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:23.306972 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-15a3749b-79a8-4005-a6f5-8ab01d72f031 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1568 microversion: 2.1 time: 0.154873 Mar 05 21:51:23.307691 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3287/6612] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:23 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:24.324960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9d228aed-4d78-48f9-be01-89c1fd5925f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:24.325597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9d228aed-4d78-48f9-be01-89c1fd5925f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:24.332743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d228aed-4d78-48f9-be01-89c1fd5925f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:24.333193 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d228aed-4d78-48f9-be01-89c1fd5925f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:24.333968 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d228aed-4d78-48f9-be01-89c1fd5925f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:24.334418 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9d228aed-4d78-48f9-be01-89c1fd5925f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:24.472967 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-9d228aed-4d78-48f9-be01-89c1fd5925f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:24.480998 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9d228aed-4d78-48f9-be01-89c1fd5925f4 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1568 microversion: 2.1 time: 0.160225 Mar 05 21:51:24.481588 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3326/6613] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:24 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:51:25.498660 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0b619dcd-79bd-4e9e-bdb7-3f783f39ffb3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:25.499313 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-0b619dcd-79bd-4e9e-bdb7-3f783f39ffb3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:25.506670 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b619dcd-79bd-4e9e-bdb7-3f783f39ffb3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:25.507139 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b619dcd-79bd-4e9e-bdb7-3f783f39ffb3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:25.507976 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b619dcd-79bd-4e9e-bdb7-3f783f39ffb3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:25.508428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-0b619dcd-79bd-4e9e-bdb7-3f783f39ffb3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:25.682328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-0b619dcd-79bd-4e9e-bdb7-3f783f39ffb3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:25.689900 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0b619dcd-79bd-4e9e-bdb7-3f783f39ffb3 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1568 microversion: 2.1 time: 0.195365 Mar 05 21:51:25.690484 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3288/6614] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:25 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:26.707071 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-40d357e9-804b-49dd-816b-7de80a367933 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:26.707970 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-40d357e9-804b-49dd-816b-7de80a367933 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:26.715044 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40d357e9-804b-49dd-816b-7de80a367933 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:26.715498 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40d357e9-804b-49dd-816b-7de80a367933 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:26.716299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40d357e9-804b-49dd-816b-7de80a367933 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:26.716740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-40d357e9-804b-49dd-816b-7de80a367933 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:26.856158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-40d357e9-804b-49dd-816b-7de80a367933 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:26.863887 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-40d357e9-804b-49dd-816b-7de80a367933 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1568 microversion: 2.1 time: 0.160540 Mar 05 21:51:26.864458 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3327/6615] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:26 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:27.882240 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-9aa7ee40-1c18-447d-bb1d-dde7977d4782 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:27.882900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-9aa7ee40-1c18-447d-bb1d-dde7977d4782 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:27.890023 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9aa7ee40-1c18-447d-bb1d-dde7977d4782 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:27.890752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9aa7ee40-1c18-447d-bb1d-dde7977d4782 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:27.891342 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9aa7ee40-1c18-447d-bb1d-dde7977d4782 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:27.891844 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-9aa7ee40-1c18-447d-bb1d-dde7977d4782 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:28.023875 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-9aa7ee40-1c18-447d-bb1d-dde7977d4782 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:28.031419 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-9aa7ee40-1c18-447d-bb1d-dde7977d4782 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1509 microversion: 2.1 time: 0.153873 Mar 05 21:51:28.032050 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3289/6616] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:27 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:28.047539 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-9cd79e6a-4053-4565-a2b1-4131c5d10a28 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:51:28.048140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-9cd79e6a-4053-4565-a2b1-4131c5d10a28 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:28.055273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9cd79e6a-4053-4565-a2b1-4131c5d10a28 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:28.055750 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9cd79e6a-4053-4565-a2b1-4131c5d10a28 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:28.056518 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9cd79e6a-4053-4565-a2b1-4131c5d10a28 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:28.056962 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-9cd79e6a-4053-4565-a2b1-4131c5d10a28 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:28.256817 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-9cd79e6a-4053-4565-a2b1-4131c5d10a28 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "POST /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4/action" status: 202 len: 0 microversion: 2.1 time: 0.213110 Mar 05 21:51:28.257446 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3328/6617] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:51:28 2022] POST /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:51:28.265770 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-8fc0bcf2-6257-4042-86f6-359f964837c9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:28.266487 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-8fc0bcf2-6257-4042-86f6-359f964837c9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:28.272475 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8fc0bcf2-6257-4042-86f6-359f964837c9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:28.272873 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8fc0bcf2-6257-4042-86f6-359f964837c9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:28.273668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8fc0bcf2-6257-4042-86f6-359f964837c9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:28.274420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-8fc0bcf2-6257-4042-86f6-359f964837c9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:28.413131 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-8fc0bcf2-6257-4042-86f6-359f964837c9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:28.420873 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-8fc0bcf2-6257-4042-86f6-359f964837c9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1517 microversion: 2.1 time: 0.159177 Mar 05 21:51:28.421468 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3290/6618] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:28 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:29.439264 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b65c0c2c-a38c-4931-af7e-80582a306da6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:29.439895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b65c0c2c-a38c-4931-af7e-80582a306da6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:29.447310 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b65c0c2c-a38c-4931-af7e-80582a306da6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:29.447790 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b65c0c2c-a38c-4931-af7e-80582a306da6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:29.448556 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b65c0c2c-a38c-4931-af7e-80582a306da6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:29.448995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b65c0c2c-a38c-4931-af7e-80582a306da6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:29.591839 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b65c0c2c-a38c-4931-af7e-80582a306da6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:29.599964 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b65c0c2c-a38c-4931-af7e-80582a306da6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1519 microversion: 2.1 time: 0.165111 Mar 05 21:51:29.600552 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3329/6619] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:29 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:29.964079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-00410ab8-098b-4a85-862b-58e803d2ce6b req-e7831916-f8b8-4532-bbf6-2bf53ae8133a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ffbb17-44b3-4d00-ab3d-97591ba831c4", "name": "network-vif-unplugged", "status": "completed", "tag": "93180cd6-f4ad-461c-b8ed-acd6a04868b7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:51:29.976068 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-00410ab8-098b-4a85-862b-58e803d2ce6b req-e7831916-f8b8-4532-bbf6-2bf53ae8133a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:29.976545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-00410ab8-098b-4a85-862b-58e803d2ce6b req-e7831916-f8b8-4532-bbf6-2bf53ae8133a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:29.990934 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.compute.server_external_events [req-00410ab8-098b-4a85-862b-58e803d2ce6b req-e7831916-f8b8-4532-bbf6-2bf53ae8133a service nova] Unable to find a host for instance 34ffbb17-44b3-4d00-ab3d-97591ba831c4. Dropping event network-vif-unplugged {{(pid=141478) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 05 21:51:29.992145 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-00410ab8-098b-4a85-862b-58e803d2ce6b req-e7831916-f8b8-4532-bbf6-2bf53ae8133a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032219 Mar 05 21:51:29.993531 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3291/6620] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 05 21:51:30.617290 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-04ef1392-3818-43d5-bfaa-1b0ced98505f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:30.618005 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-04ef1392-3818-43d5-bfaa-1b0ced98505f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:30.624796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04ef1392-3818-43d5-bfaa-1b0ced98505f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:30.625252 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04ef1392-3818-43d5-bfaa-1b0ced98505f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:30.626026 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04ef1392-3818-43d5-bfaa-1b0ced98505f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:30.626470 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-04ef1392-3818-43d5-bfaa-1b0ced98505f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:30.773359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-04ef1392-3818-43d5-bfaa-1b0ced98505f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:30.783183 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-04ef1392-3818-43d5-bfaa-1b0ced98505f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1575 microversion: 2.1 time: 0.169945 Mar 05 21:51:30.793924 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3330/6621] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:30 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:31.085647 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-37cdcb0a-4220-49ac-bb4a-8d09212e142f req-d58f31d8-6501-4fb7-a2e3-61e12e5304d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ffbb17-44b3-4d00-ab3d-97591ba831c4", "tag": "93180cd6-f4ad-461c-b8ed-acd6a04868b7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:51:31.094324 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-37cdcb0a-4220-49ac-bb4a-8d09212e142f req-d58f31d8-6501-4fb7-a2e3-61e12e5304d8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:31.094780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-37cdcb0a-4220-49ac-bb4a-8d09212e142f req-d58f31d8-6501-4fb7-a2e3-61e12e5304d8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:31.106938 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-37cdcb0a-4220-49ac-bb4a-8d09212e142f req-d58f31d8-6501-4fb7-a2e3-61e12e5304d8 service nova] Creating event network-changed:93180cd6-f4ad-461c-b8ed-acd6a04868b7 for instance 34ffbb17-44b3-4d00-ab3d-97591ba831c4 on nch2-master-1 Mar 05 21:51:31.112382 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-37cdcb0a-4220-49ac-bb4a-8d09212e142f req-d58f31d8-6501-4fb7-a2e3-61e12e5304d8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031122 Mar 05 21:51:31.113565 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3292/6622] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:51:31.801309 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-584fd8fd-ace4-40c7-93c7-e80ac69e5b2f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:31.801928 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-584fd8fd-ace4-40c7-93c7-e80ac69e5b2f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:31.809180 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-584fd8fd-ace4-40c7-93c7-e80ac69e5b2f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:31.809640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-584fd8fd-ace4-40c7-93c7-e80ac69e5b2f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:31.810416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-584fd8fd-ace4-40c7-93c7-e80ac69e5b2f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:31.810855 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-584fd8fd-ace4-40c7-93c7-e80ac69e5b2f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:31.955803 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-584fd8fd-ace4-40c7-93c7-e80ac69e5b2f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:31.963625 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-584fd8fd-ace4-40c7-93c7-e80ac69e5b2f tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1575 microversion: 2.1 time: 0.166420 Mar 05 21:51:31.964580 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3331/6623] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:31 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:32.982416 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-eca2ead0-23af-4b3e-9eac-e5f245fd2e3b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:32.983163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-eca2ead0-23af-4b3e-9eac-e5f245fd2e3b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:32.989671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eca2ead0-23af-4b3e-9eac-e5f245fd2e3b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:32.990283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eca2ead0-23af-4b3e-9eac-e5f245fd2e3b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:32.991063 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eca2ead0-23af-4b3e-9eac-e5f245fd2e3b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:32.991514 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-eca2ead0-23af-4b3e-9eac-e5f245fd2e3b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:33.125529 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-eca2ead0-23af-4b3e-9eac-e5f245fd2e3b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:33.134182 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-eca2ead0-23af-4b3e-9eac-e5f245fd2e3b tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1575 microversion: 2.1 time: 0.156973 Mar 05 21:51:33.134764 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3293/6624] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:32 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:34.152093 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-4f486c42-879c-44cb-a492-fb9d3bd36c90 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:34.152672 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-4f486c42-879c-44cb-a492-fb9d3bd36c90 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:34.159701 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f486c42-879c-44cb-a492-fb9d3bd36c90 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:34.160179 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f486c42-879c-44cb-a492-fb9d3bd36c90 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:34.160960 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f486c42-879c-44cb-a492-fb9d3bd36c90 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:34.161441 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-4f486c42-879c-44cb-a492-fb9d3bd36c90 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:34.297840 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-4f486c42-879c-44cb-a492-fb9d3bd36c90 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:34.306000 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-4f486c42-879c-44cb-a492-fb9d3bd36c90 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1575 microversion: 2.1 time: 0.157941 Mar 05 21:51:34.306600 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3332/6625] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:34 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:35.323090 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e52cacfe-131c-413e-a9d2-0d74f098ca83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:35.323790 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e52cacfe-131c-413e-a9d2-0d74f098ca83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:35.330545 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e52cacfe-131c-413e-a9d2-0d74f098ca83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:35.331019 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e52cacfe-131c-413e-a9d2-0d74f098ca83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:35.331840 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e52cacfe-131c-413e-a9d2-0d74f098ca83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:35.332300 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e52cacfe-131c-413e-a9d2-0d74f098ca83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:35.471540 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e52cacfe-131c-413e-a9d2-0d74f098ca83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:35.479154 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e52cacfe-131c-413e-a9d2-0d74f098ca83 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1575 microversion: 2.1 time: 0.160008 Mar 05 21:51:35.479761 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3294/6626] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:35 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:36.496620 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-ebfb0c83-fe6e-46cf-8343-db5f7081c9e6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:36.497240 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-ebfb0c83-fe6e-46cf-8343-db5f7081c9e6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:36.504004 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ebfb0c83-fe6e-46cf-8343-db5f7081c9e6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:36.504463 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ebfb0c83-fe6e-46cf-8343-db5f7081c9e6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:36.505230 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ebfb0c83-fe6e-46cf-8343-db5f7081c9e6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:36.506244 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-ebfb0c83-fe6e-46cf-8343-db5f7081c9e6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:36.644802 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-ebfb0c83-fe6e-46cf-8343-db5f7081c9e6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:36.652784 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-ebfb0c83-fe6e-46cf-8343-db5f7081c9e6 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1575 microversion: 2.1 time: 0.160116 Mar 05 21:51:36.653363 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3333/6627] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:36 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:37.042205 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-cfffd534-37e0-4435-a3d8-3bc3afd30e1d req-e9e20813-88b3-4f52-9cdf-99033f3c819f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ffbb17-44b3-4d00-ab3d-97591ba831c4", "name": "network-vif-plugged", "status": "completed", "tag": "93180cd6-f4ad-461c-b8ed-acd6a04868b7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:51:37.051821 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-cfffd534-37e0-4435-a3d8-3bc3afd30e1d req-e9e20813-88b3-4f52-9cdf-99033f3c819f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:37.053895 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-cfffd534-37e0-4435-a3d8-3bc3afd30e1d req-e9e20813-88b3-4f52-9cdf-99033f3c819f service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:37.066698 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-cfffd534-37e0-4435-a3d8-3bc3afd30e1d req-e9e20813-88b3-4f52-9cdf-99033f3c819f service nova] Creating event network-vif-plugged:93180cd6-f4ad-461c-b8ed-acd6a04868b7 for instance 34ffbb17-44b3-4d00-ab3d-97591ba831c4 on nch2-master-1 Mar 05 21:51:37.072594 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-cfffd534-37e0-4435-a3d8-3bc3afd30e1d req-e9e20813-88b3-4f52-9cdf-99033f3c819f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034196 Mar 05 21:51:37.073216 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3295/6628] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:51:37.671293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6fb5fe7f-af87-434a-b284-1a5290da6401 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:37.671955 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6fb5fe7f-af87-434a-b284-1a5290da6401 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:37.678895 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6fb5fe7f-af87-434a-b284-1a5290da6401 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:37.679359 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6fb5fe7f-af87-434a-b284-1a5290da6401 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:37.680219 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6fb5fe7f-af87-434a-b284-1a5290da6401 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:37.680700 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6fb5fe7f-af87-434a-b284-1a5290da6401 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:37.814769 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6fb5fe7f-af87-434a-b284-1a5290da6401 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:37.822795 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6fb5fe7f-af87-434a-b284-1a5290da6401 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1575 microversion: 2.1 time: 0.156189 Mar 05 21:51:37.823371 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3334/6629] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:37 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:38.841817 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3858fac3-1bc1-48f8-9966-a0ba965c3775 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:51:38.842573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3858fac3-1bc1-48f8-9966-a0ba965c3775 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:51:38.848778 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3858fac3-1bc1-48f8-9966-a0ba965c3775 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:38.849305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3858fac3-1bc1-48f8-9966-a0ba965c3775 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:38.850103 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3858fac3-1bc1-48f8-9966-a0ba965c3775 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:51:38.850566 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3858fac3-1bc1-48f8-9966-a0ba965c3775 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:51:38.986465 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3858fac3-1bc1-48f8-9966-a0ba965c3775 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:51:38.994350 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3858fac3-1bc1-48f8-9966-a0ba965c3775 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1562 microversion: 2.1 time: 0.157703 Mar 05 21:51:38.994931 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3296/6630] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:51:38 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:51:51.835432 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:51:51.836285 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 21:51:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:51:52.382956 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:51:52.383653 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:51:52.383800 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 21:51:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:51:52.383917 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 21:51:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:52:07.854541 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:52:07.854989 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 21:52:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:53:03.233135 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-68c609d1-9b02-49e6-bb96-11160d6e1073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:03.233813 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-68c609d1-9b02-49e6-bb96-11160d6e1073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:03.234689 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-68b99333-81a8-4537-9196-e4234bcba9e4 req-3b385b42-19b3-4bf0-bdab-2b62d5318bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ffbb17-44b3-4d00-ab3d-97591ba831c4", "tag": "93180cd6-f4ad-461c-b8ed-acd6a04868b7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:53:03.240370 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68c609d1-9b02-49e6-bb96-11160d6e1073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:03.240905 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68c609d1-9b02-49e6-bb96-11160d6e1073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:03.241764 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68c609d1-9b02-49e6-bb96-11160d6e1073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:03.242280 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-68c609d1-9b02-49e6-bb96-11160d6e1073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:03.242987 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-68b99333-81a8-4537-9196-e4234bcba9e4 req-3b385b42-19b3-4bf0-bdab-2b62d5318bf4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:03.243456 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-68b99333-81a8-4537-9196-e4234bcba9e4 req-3b385b42-19b3-4bf0-bdab-2b62d5318bf4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:03.255162 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-68b99333-81a8-4537-9196-e4234bcba9e4 req-3b385b42-19b3-4bf0-bdab-2b62d5318bf4 service nova] Creating event network-changed:93180cd6-f4ad-461c-b8ed-acd6a04868b7 for instance 34ffbb17-44b3-4d00-ab3d-97591ba831c4 on nch2-master-1 Mar 05 21:53:03.261843 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-68b99333-81a8-4537-9196-e4234bcba9e4 req-3b385b42-19b3-4bf0-bdab-2b62d5318bf4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032249 Mar 05 21:53:03.262650 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3297/6631] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:53:03.268718 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-68c609d1-9b02-49e6-bb96-11160d6e1073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:53:03.365650 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-68c609d1-9b02-49e6-bb96-11160d6e1073 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "DELETE /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 204 len: 0 microversion: 2.1 time: 0.137858 Mar 05 21:53:03.370083 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3335/6632] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:53:03 2022] DELETE /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 05 21:53:03.377278 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-2a4ca521-7d53-431c-9ab6-723ae98b46cd tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:03.378007 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-2a4ca521-7d53-431c-9ab6-723ae98b46cd tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:03.385862 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a4ca521-7d53-431c-9ab6-723ae98b46cd tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:03.386335 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a4ca521-7d53-431c-9ab6-723ae98b46cd tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:03.387136 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a4ca521-7d53-431c-9ab6-723ae98b46cd tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:03.387591 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-2a4ca521-7d53-431c-9ab6-723ae98b46cd tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:03.703299 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-2a4ca521-7d53-431c-9ab6-723ae98b46cd tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:53:03.711521 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-2a4ca521-7d53-431c-9ab6-723ae98b46cd tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1568 microversion: 2.1 time: 0.339835 Mar 05 21:53:03.712192 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3298/6633] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:03 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1568 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:53:04.729404 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6d57a81d-b4c8-499a-9107-15e1a4a389b9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:04.730122 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6d57a81d-b4c8-499a-9107-15e1a4a389b9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:04.737815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d57a81d-b4c8-499a-9107-15e1a4a389b9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:04.738270 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d57a81d-b4c8-499a-9107-15e1a4a389b9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:04.739034 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d57a81d-b4c8-499a-9107-15e1a4a389b9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:04.739473 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6d57a81d-b4c8-499a-9107-15e1a4a389b9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:04.915887 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6d57a81d-b4c8-499a-9107-15e1a4a389b9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:53:04.923801 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6d57a81d-b4c8-499a-9107-15e1a4a389b9 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1449 microversion: 2.1 time: 0.198654 Mar 05 21:53:04.924565 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3336/6634] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:04 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1449 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:53:05.494856 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a6416e11-91a5-4663-9731-2e7f529b8310 req-0036da3b-2926-4337-8fb8-169130de5e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ffbb17-44b3-4d00-ab3d-97591ba831c4", "name": "network-vif-deleted", "tag": "93180cd6-f4ad-461c-b8ed-acd6a04868b7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:53:05.503577 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a6416e11-91a5-4663-9731-2e7f529b8310 req-0036da3b-2926-4337-8fb8-169130de5e95 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:05.504079 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a6416e11-91a5-4663-9731-2e7f529b8310 req-0036da3b-2926-4337-8fb8-169130de5e95 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:05.515065 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a6416e11-91a5-4663-9731-2e7f529b8310 req-0036da3b-2926-4337-8fb8-169130de5e95 service nova] Creating event network-vif-deleted:93180cd6-f4ad-461c-b8ed-acd6a04868b7 for instance 34ffbb17-44b3-4d00-ab3d-97591ba831c4 on nch2-master-1 Mar 05 21:53:05.520286 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a6416e11-91a5-4663-9731-2e7f529b8310 req-0036da3b-2926-4337-8fb8-169130de5e95 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081326 Mar 05 21:53:05.520897 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3299/6635] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:53:05.942478 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-495ac23f-761f-418c-969a-da7cdb708acc tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:05.943273 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-495ac23f-761f-418c-969a-da7cdb708acc tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:05.952248 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-495ac23f-761f-418c-969a-da7cdb708acc tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:05.952983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-495ac23f-761f-418c-969a-da7cdb708acc tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:05.954153 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-495ac23f-761f-418c-969a-da7cdb708acc tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:05.954601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-495ac23f-761f-418c-969a-da7cdb708acc tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:05.994008 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-495ac23f-761f-418c-969a-da7cdb708acc tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:05.994517 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-495ac23f-761f-418c-969a-da7cdb708acc tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:05.994998 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-495ac23f-761f-418c-969a-da7cdb708acc tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lazy-loading 'fault' on Instance uuid 34ffbb17-44b3-4d00-ab3d-97591ba831c4 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:53:06.044814 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-495ac23f-761f-418c-969a-da7cdb708acc tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a7c63e175949e1938accdece2a4c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fd34db08b648489afd4f749b965e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:53:06.053381 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-495ac23f-761f-418c-969a-da7cdb708acc tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 200 len: 1177 microversion: 2.1 time: 0.115447 Mar 05 21:53:06.054241 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3337/6636] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:05 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 1177 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:53:07.071786 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fdc5054d-41f5-4387-ba4c-6fb28cc9ad13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:07.072640 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-fdc5054d-41f5-4387-ba4c-6fb28cc9ad13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] [instance: 34ffbb17-44b3-4d00-ab3d-97591ba831c4] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:07.079920 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc5054d-41f5-4387-ba4c-6fb28cc9ad13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:07.080399 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc5054d-41f5-4387-ba4c-6fb28cc9ad13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:07.081226 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc5054d-41f5-4387-ba4c-6fb28cc9ad13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:07.081687 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-fdc5054d-41f5-4387-ba4c-6fb28cc9ad13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:07.095843 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-fdc5054d-41f5-4387-ba4c-6fb28cc9ad13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] HTTP exception thrown: Instance 34ffbb17-44b3-4d00-ab3d-97591ba831c4 could not be found. Mar 05 21:53:07.096463 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-fdc5054d-41f5-4387-ba4c-6fb28cc9ad13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Returning 404 to user: Instance 34ffbb17-44b3-4d00-ab3d-97591ba831c4 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:53:07.097314 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-fdc5054d-41f5-4387-ba4c-6fb28cc9ad13 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4" status: 404 len: 111 microversion: 2.1 time: 0.030676 Mar 05 21:53:07.097890 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3300/6637] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:07 2022] GET /compute/v2.1/servers/34ffbb17-44b3-4d00-ab3d-97591ba831c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:53:07.257000 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-e306beb8-4312-4819-9393-8d361ff43140 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] Calling method '.version_select at 0x7fed4f88bee0>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:07.283931 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-e306beb8-4312-4819-9393-8d361ff43140 tempest-TestShelveInstance-783328256 tempest-TestShelveInstance-783328256-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-566622529" status: 202 len: 0 microversion: 2.1 time: 0.030720 Mar 05 21:53:07.284464 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3338/6638] 10.222.0.15 () {58 vars in 1250 bytes} [Sat Mar 5 21:53:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-566622529 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:53:25.459249 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-7f451767-6deb-4701-8395-54e1f49a2a0a tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Action: 'create', calling method: .version_select at 0x7fed5c5e75e0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1189705558"}} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:53:25.473668 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-7f451767-6deb-4701-8395-54e1f49a2a0a tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Getting quotas for project ab0fea440ec3497494381b3c3133b704. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:53:25.478803 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-7f451767-6deb-4701-8395-54e1f49a2a0a tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Getting quotas for user 378a9897110a45948025fbf1e825c7d8 and project ab0fea440ec3497494381b3c3133b704. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:53:25.641143 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-7f451767-6deb-4701-8395-54e1f49a2a0a tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Getting quotas for project ab0fea440ec3497494381b3c3133b704. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:53:25.646917 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.quota [None req-7f451767-6deb-4701-8395-54e1f49a2a0a tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Getting quotas for user 378a9897110a45948025fbf1e825c7d8 and project ab0fea440ec3497494381b3c3133b704. Resources: {'key_pairs'} {{(pid=141478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:53:25.661335 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-7f451767-6deb-4701-8395-54e1f49a2a0a tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.380519 Mar 05 21:53:25.661880 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3301/6639] 10.222.0.15 () {60 vars in 1157 bytes} [Sat Mar 5 21:53:25 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:53:26.615610 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-727757671", "imageRef": "81837c2f-28ec-46e4-b5d6-afa9c9233d80", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1189705558", "security_groups": [{"name": "tempest-secgroup-smoke-1906000963"}], "networks": [{"uuid": "b0f1030a-d3fb-4f0a-b565-a4aaa9fcfd4f"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:53:26.723865 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] validate_networks() for [('b0f1030a-d3fb-4f0a-b565-a4aaa9fcfd4f', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:53:27.135072 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:53:27.135763 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:53:27.136311 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:53:27.136797 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:53:27.137833 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:53:27.150692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:27.151158 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:27.152043 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:27.152493 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:27.176738 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Getting quotas for project ab0fea440ec3497494381b3c3133b704. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:53:27.182640 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Getting quotas for user 378a9897110a45948025fbf1e825c7d8 and project ab0fea440ec3497494381b3c3133b704. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:53:27.196434 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:53:27.198834 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81837c2f-28ec-46e4-b5d6-afa9c9233d80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:53:27.249152 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-107c00f5-2b5f-4d69-9505-8130950aa617 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.638593 Mar 05 21:53:27.249912 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3339/6640] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:53:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:53:27.259925 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-35ae1fc7-244d-49ae-8625-da1aaea99f3d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:27.260563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-35ae1fc7-244d-49ae-8625-da1aaea99f3d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:27.328802 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-35ae1fc7-244d-49ae-8625-da1aaea99f3d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:53:27.335969 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-35ae1fc7-244d-49ae-8625-da1aaea99f3d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 200 len: 1248 microversion: 2.1 time: 0.079893 Mar 05 21:53:27.336892 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3302/6641] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:27 2022] GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 1248 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:53:28.354992 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-af6a4cac-ba4b-41e1-a751-777238836f45 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:28.356841 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-af6a4cac-ba4b-41e1-a751-777238836f45 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:28.363368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af6a4cac-ba4b-41e1-a751-777238836f45 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:28.363862 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af6a4cac-ba4b-41e1-a751-777238836f45 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:28.364861 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af6a4cac-ba4b-41e1-a751-777238836f45 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:28.365472 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-af6a4cac-ba4b-41e1-a751-777238836f45 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:28.433723 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-af6a4cac-ba4b-41e1-a751-777238836f45 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:53:28.441482 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-af6a4cac-ba4b-41e1-a751-777238836f45 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 200 len: 1318 microversion: 2.1 time: 0.091138 Mar 05 21:53:28.442539 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3340/6642] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:28 2022] GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 1318 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:53:29.461991 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-318b9a06-d95c-406c-938d-4a6b96c93124 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:29.462777 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-318b9a06-d95c-406c-938d-4a6b96c93124 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:29.470671 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-318b9a06-d95c-406c-938d-4a6b96c93124 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:29.471147 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-318b9a06-d95c-406c-938d-4a6b96c93124 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:29.471992 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-318b9a06-d95c-406c-938d-4a6b96c93124 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:29.472621 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-318b9a06-d95c-406c-938d-4a6b96c93124 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:29.699914 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-318b9a06-d95c-406c-938d-4a6b96c93124 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:53:29.709117 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-318b9a06-d95c-406c-938d-4a6b96c93124 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 200 len: 1374 microversion: 2.1 time: 0.252051 Mar 05 21:53:29.710339 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3303/6643] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:29 2022] GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 1374 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:53:29.954052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-9453c7df-8f2c-48c5-812c-2bebd4a843ce req-11c31c7f-6bb2-4a31-9465-2bc0378f939d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c863dcf5-1511-497b-ba16-393b31bc43fd", "tag": "180562de-3bda-4a98-b4f8-2780b266e045"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:53:29.982176 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9453c7df-8f2c-48c5-812c-2bebd4a843ce req-11c31c7f-6bb2-4a31-9465-2bc0378f939d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:29.982629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-9453c7df-8f2c-48c5-812c-2bebd4a843ce req-11c31c7f-6bb2-4a31-9465-2bc0378f939d service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:30.011849 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-9453c7df-8f2c-48c5-812c-2bebd4a843ce req-11c31c7f-6bb2-4a31-9465-2bc0378f939d service nova] Creating event network-changed:180562de-3bda-4a98-b4f8-2780b266e045 for instance c863dcf5-1511-497b-ba16-393b31bc43fd on nch1-master-1 Mar 05 21:53:30.018688 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-9453c7df-8f2c-48c5-812c-2bebd4a843ce req-11c31c7f-6bb2-4a31-9465-2bc0378f939d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074700 Mar 05 21:53:30.019863 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3341/6644] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:53:30.725672 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5d339992-13e2-41a8-86f1-44bdda33a10e tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:30.726410 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5d339992-13e2-41a8-86f1-44bdda33a10e tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:30.734283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d339992-13e2-41a8-86f1-44bdda33a10e tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:30.734780 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d339992-13e2-41a8-86f1-44bdda33a10e tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:30.735598 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d339992-13e2-41a8-86f1-44bdda33a10e tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:30.736216 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5d339992-13e2-41a8-86f1-44bdda33a10e tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:30.978928 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5d339992-13e2-41a8-86f1-44bdda33a10e tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:53:30.988070 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5d339992-13e2-41a8-86f1-44bdda33a10e tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 200 len: 1374 microversion: 2.1 time: 0.266293 Mar 05 21:53:30.988756 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3304/6645] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:30 2022] GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 1374 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:53:32.006575 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-2be7654d-abac-4616-b5f8-50415a2c337d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:32.007245 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-2be7654d-abac-4616-b5f8-50415a2c337d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:32.014396 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2be7654d-abac-4616-b5f8-50415a2c337d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:32.014847 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2be7654d-abac-4616-b5f8-50415a2c337d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:32.015615 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2be7654d-abac-4616-b5f8-50415a2c337d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:32.016083 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-2be7654d-abac-4616-b5f8-50415a2c337d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:32.150629 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-2be7654d-abac-4616-b5f8-50415a2c337d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:53:32.161686 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-2be7654d-abac-4616-b5f8-50415a2c337d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 200 len: 1374 microversion: 2.1 time: 0.158795 Mar 05 21:53:32.161686 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3342/6646] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:32 2022] GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:53:33.178464 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-c35c9c84-3ded-464d-8353-e94fc3276244 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:33.179044 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-c35c9c84-3ded-464d-8353-e94fc3276244 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:33.185800 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c35c9c84-3ded-464d-8353-e94fc3276244 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:33.186273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c35c9c84-3ded-464d-8353-e94fc3276244 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:33.187064 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c35c9c84-3ded-464d-8353-e94fc3276244 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:33.187524 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-c35c9c84-3ded-464d-8353-e94fc3276244 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:33.325815 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-c35c9c84-3ded-464d-8353-e94fc3276244 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:53:33.333175 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-c35c9c84-3ded-464d-8353-e94fc3276244 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 200 len: 1374 microversion: 2.1 time: 0.158743 Mar 05 21:53:33.333758 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3305/6647] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:33 2022] GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:53:34.350671 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-8225d907-a8d6-4372-86e1-093249fa2f80 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:34.351293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-8225d907-a8d6-4372-86e1-093249fa2f80 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:34.358707 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8225d907-a8d6-4372-86e1-093249fa2f80 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:34.359163 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8225d907-a8d6-4372-86e1-093249fa2f80 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:34.359975 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8225d907-a8d6-4372-86e1-093249fa2f80 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:34.360421 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-8225d907-a8d6-4372-86e1-093249fa2f80 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:34.497368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-8225d907-a8d6-4372-86e1-093249fa2f80 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:53:34.504807 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-8225d907-a8d6-4372-86e1-093249fa2f80 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 200 len: 1374 microversion: 2.1 time: 0.158050 Mar 05 21:53:34.505394 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3343/6648] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:34 2022] GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:53:34.755723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-a14f0a96-1e95-4d10-ae3b-1757e032d066 req-19bc8b1d-0dfb-4b6c-9a3d-cc2d059a8d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c863dcf5-1511-497b-ba16-393b31bc43fd", "name": "network-vif-plugged", "status": "completed", "tag": "180562de-3bda-4a98-b4f8-2780b266e045"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:53:34.764762 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a14f0a96-1e95-4d10-ae3b-1757e032d066 req-19bc8b1d-0dfb-4b6c-9a3d-cc2d059a8d75 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:34.765236 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-a14f0a96-1e95-4d10-ae3b-1757e032d066 req-19bc8b1d-0dfb-4b6c-9a3d-cc2d059a8d75 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:34.776530 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-a14f0a96-1e95-4d10-ae3b-1757e032d066 req-19bc8b1d-0dfb-4b6c-9a3d-cc2d059a8d75 service nova] Creating event network-vif-plugged:180562de-3bda-4a98-b4f8-2780b266e045 for instance c863dcf5-1511-497b-ba16-393b31bc43fd on nch1-master-1 Mar 05 21:53:34.782695 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-a14f0a96-1e95-4d10-ae3b-1757e032d066 req-19bc8b1d-0dfb-4b6c-9a3d-cc2d059a8d75 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091810 Mar 05 21:53:34.783337 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3306/6649] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:53:35.521796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-3d30ad6f-c630-4862-b857-bdf05de19485 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:35.522364 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-3d30ad6f-c630-4862-b857-bdf05de19485 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:35.529590 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d30ad6f-c630-4862-b857-bdf05de19485 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:35.530052 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d30ad6f-c630-4862-b857-bdf05de19485 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:35.530835 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d30ad6f-c630-4862-b857-bdf05de19485 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:35.531275 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-3d30ad6f-c630-4862-b857-bdf05de19485 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:35.665127 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-3d30ad6f-c630-4862-b857-bdf05de19485 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:53:35.673021 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-3d30ad6f-c630-4862-b857-bdf05de19485 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 200 len: 1374 microversion: 2.1 time: 0.155244 Mar 05 21:53:35.673595 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3344/6650] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:35 2022] GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:53:36.691305 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-472347f9-c5c2-4315-9a42-fb60352000d7 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:36.692062 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-472347f9-c5c2-4315-9a42-fb60352000d7 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:36.698699 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-472347f9-c5c2-4315-9a42-fb60352000d7 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:36.699163 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-472347f9-c5c2-4315-9a42-fb60352000d7 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:36.700119 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-472347f9-c5c2-4315-9a42-fb60352000d7 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:36.700573 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-472347f9-c5c2-4315-9a42-fb60352000d7 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:36.834290 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-472347f9-c5c2-4315-9a42-fb60352000d7 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:53:36.842180 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-472347f9-c5c2-4315-9a42-fb60352000d7 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 200 len: 1558 microversion: 2.1 time: 0.156104 Mar 05 21:53:36.842754 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3307/6651] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:36 2022] GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:53:36.858875 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fe48a110-e5ce-4ac2-91cc-52cfb0acec00 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:53:36.859513 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fe48a110-e5ce-4ac2-91cc-52cfb0acec00 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:53:36.866595 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe48a110-e5ce-4ac2-91cc-52cfb0acec00 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:36.867057 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe48a110-e5ce-4ac2-91cc-52cfb0acec00 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:36.867919 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe48a110-e5ce-4ac2-91cc-52cfb0acec00 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:36.868319 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fe48a110-e5ce-4ac2-91cc-52cfb0acec00 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:37.005740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-fe48a110-e5ce-4ac2-91cc-52cfb0acec00 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:53:37.014258 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fe48a110-e5ce-4ac2-91cc-52cfb0acec00 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 200 len: 1558 microversion: 2.1 time: 0.160038 Mar 05 21:53:37.014844 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3345/6652] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:53:36 2022] GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:53:38.654602 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-61973755-e8b6-4caf-878c-04f5a93300fc req-4d53793b-eff8-484e-99f1-0c2ce5ae217c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c863dcf5-1511-497b-ba16-393b31bc43fd", "tag": "180562de-3bda-4a98-b4f8-2780b266e045"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:53:38.663328 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-61973755-e8b6-4caf-878c-04f5a93300fc req-4d53793b-eff8-484e-99f1-0c2ce5ae217c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:53:38.663830 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-61973755-e8b6-4caf-878c-04f5a93300fc req-4d53793b-eff8-484e-99f1-0c2ce5ae217c service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:53:38.675088 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-61973755-e8b6-4caf-878c-04f5a93300fc req-4d53793b-eff8-484e-99f1-0c2ce5ae217c service nova] Creating event network-changed:180562de-3bda-4a98-b4f8-2780b266e045 for instance c863dcf5-1511-497b-ba16-393b31bc43fd on nch1-master-1 Mar 05 21:53:38.680101 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-61973755-e8b6-4caf-878c-04f5a93300fc req-4d53793b-eff8-484e-99f1-0c2ce5ae217c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031522 Mar 05 21:53:38.680695 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3308/6653] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:55:12.391738 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:55:12.392446 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 21:55:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:55:33.847350 ncdv-master-1 devstack@n-api.service[141479]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f4676b75-9eec-4512-826f-cf92fa0c9e09] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 05 21:55:33.849481 ncdv-master-1 devstack@n-api.service[141479]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7d5eb8e-fc88-4581-82a8-5abda8610d81] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 05 21:55:33.853476 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-fd6934da-4b0a-4e61-bc27-7a0df397344d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-61060101"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:55:33.854502 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-fd6934da-4b0a-4e61-bc27-7a0df397344d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:55:33.860753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd6934da-4b0a-4e61-bc27-7a0df397344d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:33.861208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd6934da-4b0a-4e61-bc27-7a0df397344d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:33.861983 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd6934da-4b0a-4e61-bc27-7a0df397344d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:33.862428 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-fd6934da-4b0a-4e61-bc27-7a0df397344d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:34.135493 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-fd6934da-4b0a-4e61-bc27-7a0df397344d tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "POST /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd/action" status: 202 len: 0 microversion: 2.1 time: 0.289839 Mar 05 21:55:34.136094 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3346/6654] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:55:33 2022] POST /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 21:55:39.420979 ncdv-master-1 devstack@n-api.service[141478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6a0c9ad-ada5-4110-a451-98e637deeab0] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 05 21:55:39.421574 ncdv-master-1 devstack@n-api.service[141478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [acc7cacd-1878-4025-b503-960cdc977e32] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 05 21:55:39.425563 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-8d423832-a0f9-491a-af07-e14fb3beaba6 req-e3070246-247e-416d-977d-937a6af99b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c863dcf5-1511-497b-ba16-393b31bc43fd", "name": "network-vif-plugged", "status": "completed", "tag": "180562de-3bda-4a98-b4f8-2780b266e045"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:55:39.435181 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8d423832-a0f9-491a-af07-e14fb3beaba6 req-e3070246-247e-416d-977d-937a6af99b38 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:39.435658 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-8d423832-a0f9-491a-af07-e14fb3beaba6 req-e3070246-247e-416d-977d-937a6af99b38 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:39.447039 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-8d423832-a0f9-491a-af07-e14fb3beaba6 req-e3070246-247e-416d-977d-937a6af99b38 service nova] Creating event network-vif-plugged:180562de-3bda-4a98-b4f8-2780b266e045 for instance c863dcf5-1511-497b-ba16-393b31bc43fd on nch1-master-1 Mar 05 21:55:39.452346 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-8d423832-a0f9-491a-af07-e14fb3beaba6 req-e3070246-247e-416d-977d-937a6af99b38 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033253 Mar 05 21:55:39.455057 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3309/6655] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:55:47.661015 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1531542270", "imageRef": "e8dbb465-e1f2-4e65-af97-638f6ddfab6b", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1189705558", "security_groups": [{"name": "tempest-secgroup-smoke-1906000963"}], "networks": [{"uuid": "b0f1030a-d3fb-4f0a-b565-a4aaa9fcfd4f"}]}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:55:47.682629 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] [f4676b75-9eec-4512-826f-cf92fa0c9e09] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 34996. Mar 05 21:55:47.683140 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7d5eb8e-fc88-4581-82a8-5abda8610d81] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 34998. Mar 05 21:55:47.769601 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.network.neutron [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] validate_networks() for [('b0f1030a-d3fb-4f0a-b565-a4aaa9fcfd4f', None, None, None, None, None)] {{(pid=141479) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 21:55:48.445951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Flavor limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 21:55:48.446516 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Image limits 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 21:55:48.447012 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Flavor pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 21:55:48.447432 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Image pref 0:0:0 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 21:55:48.447906 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.virt.hardware [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 21:55:48.456692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:48.457152 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:48.457958 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:48.458403 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:48.475497 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Getting quotas for project ab0fea440ec3497494381b3c3133b704. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 21:55:48.481522 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.quota [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Getting quotas for user 378a9897110a45948025fbf1e825c7d8 and project ab0fea440ec3497494381b3c3133b704. Resources: {'instances', 'ram', 'cores'} {{(pid=141479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 21:55:48.494174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Going to run 1 instances... {{(pid=141479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 21:55:48.496642 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8dbb465-e1f2-4e65-af97-638f6ddfab6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 21:55:48.541329 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-dc74dc7a-2cb2-4bda-aece-bd9997e39994 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.886033 Mar 05 21:55:48.541995 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3347/6656] 10.222.0.15 () {60 vars in 1146 bytes} [Sat Mar 5 21:55:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 21:55:48.562973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-f3ff1ca8-e388-4992-afd2-fdf06ac60edc tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:55:48.562973 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-f3ff1ca8-e388-4992-afd2-fdf06ac60edc tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:55:48.567016 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] [acc7cacd-1878-4025-b503-960cdc977e32] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 35014. Mar 05 21:55:48.592887 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6a0c9ad-ada5-4110-a451-98e637deeab0] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 35012. Mar 05 21:55:48.626756 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-f3ff1ca8-e388-4992-afd2-fdf06ac60edc tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:55:48.634593 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-f3ff1ca8-e388-4992-afd2-fdf06ac60edc tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1249 microversion: 2.1 time: 0.086297 Mar 05 21:55:48.635158 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3310/6657] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:55:48 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:55:49.232796 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [req-8f6a2342-d4c0-48d8-8fa6-b766e16f8f1f req-f723a123-72b6-4006-bbc4-81c7f4889079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c863dcf5-1511-497b-ba16-393b31bc43fd", "name": "network-vif-unplugged", "status": "completed", "tag": "180562de-3bda-4a98-b4f8-2780b266e045"}]} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:55:49.242740 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8f6a2342-d4c0-48d8-8fa6-b766e16f8f1f req-f723a123-72b6-4006-bbc4-81c7f4889079 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:49.244321 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [req-8f6a2342-d4c0-48d8-8fa6-b766e16f8f1f req-f723a123-72b6-4006-bbc4-81c7f4889079 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:49.255008 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.compute.server_external_events [req-8f6a2342-d4c0-48d8-8fa6-b766e16f8f1f req-f723a123-72b6-4006-bbc4-81c7f4889079 service nova] Creating event network-vif-unplugged:180562de-3bda-4a98-b4f8-2780b266e045 for instance c863dcf5-1511-497b-ba16-393b31bc43fd on nch1-master-1 Mar 05 21:55:49.260817 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [req-8f6a2342-d4c0-48d8-8fa6-b766e16f8f1f req-f723a123-72b6-4006-bbc4-81c7f4889079 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033432 Mar 05 21:55:49.261419 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3348/6658] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:55:49.652071 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1ba700fa-880e-4742-8493-edfb9da7fceb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:55:49.652785 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1ba700fa-880e-4742-8493-edfb9da7fceb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:55:49.659751 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ba700fa-880e-4742-8493-edfb9da7fceb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:49.660309 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ba700fa-880e-4742-8493-edfb9da7fceb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:49.661224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ba700fa-880e-4742-8493-edfb9da7fceb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:49.661765 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1ba700fa-880e-4742-8493-edfb9da7fceb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:49.737581 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1ba700fa-880e-4742-8493-edfb9da7fceb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:55:49.747148 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1ba700fa-880e-4742-8493-edfb9da7fceb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1307 microversion: 2.1 time: 0.099567 Mar 05 21:55:49.748099 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3311/6659] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:55:49 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:55:50.765587 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-828ccb22-80a2-494c-9231-1819189dcd0c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:55:50.768597 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-828ccb22-80a2-494c-9231-1819189dcd0c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:55:50.776506 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-828ccb22-80a2-494c-9231-1819189dcd0c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:50.777184 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-828ccb22-80a2-494c-9231-1819189dcd0c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:50.778205 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-828ccb22-80a2-494c-9231-1819189dcd0c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:50.778653 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-828ccb22-80a2-494c-9231-1819189dcd0c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:50.932324 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-828ccb22-80a2-494c-9231-1819189dcd0c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:55:50.940053 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-828ccb22-80a2-494c-9231-1819189dcd0c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1375 microversion: 2.1 time: 0.179175 Mar 05 21:55:50.940707 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3349/6660] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:55:50 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:55:51.974747 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-256ecf94-e3ed-4bd5-8f61-7e5cf966c75c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:55:51.976451 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-256ecf94-e3ed-4bd5-8f61-7e5cf966c75c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:55:51.983871 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-256ecf94-e3ed-4bd5-8f61-7e5cf966c75c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:51.984723 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-256ecf94-e3ed-4bd5-8f61-7e5cf966c75c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:51.994718 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-256ecf94-e3ed-4bd5-8f61-7e5cf966c75c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:51.995470 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-256ecf94-e3ed-4bd5-8f61-7e5cf966c75c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:52.153605 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-256ecf94-e3ed-4bd5-8f61-7e5cf966c75c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:55:52.162031 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-256ecf94-e3ed-4bd5-8f61-7e5cf966c75c tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1375 microversion: 2.1 time: 0.208295 Mar 05 21:55:52.162682 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3312/6661] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:55:51 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1375 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:55:53.180253 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-b1d898d7-10f2-4677-9b7e-1c55d2a48f18 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:55:53.181989 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-b1d898d7-10f2-4677-9b7e-1c55d2a48f18 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:55:53.188912 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1d898d7-10f2-4677-9b7e-1c55d2a48f18 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:53.189368 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1d898d7-10f2-4677-9b7e-1c55d2a48f18 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:53.190151 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1d898d7-10f2-4677-9b7e-1c55d2a48f18 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:53.190591 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-b1d898d7-10f2-4677-9b7e-1c55d2a48f18 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:53.340023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-b1d898d7-10f2-4677-9b7e-1c55d2a48f18 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:55:53.347610 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-b1d898d7-10f2-4677-9b7e-1c55d2a48f18 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1375 microversion: 2.1 time: 0.171491 Mar 05 21:55:53.348230 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3350/6662] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:55:53 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:55:54.367569 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-376c766e-1969-42ba-b4cf-c38fe6d0c9a9 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:55:54.368293 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-376c766e-1969-42ba-b4cf-c38fe6d0c9a9 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:55:54.375403 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-376c766e-1969-42ba-b4cf-c38fe6d0c9a9 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:54.376006 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-376c766e-1969-42ba-b4cf-c38fe6d0c9a9 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:54.376890 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-376c766e-1969-42ba-b4cf-c38fe6d0c9a9 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:54.377444 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-376c766e-1969-42ba-b4cf-c38fe6d0c9a9 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:54.533471 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-376c766e-1969-42ba-b4cf-c38fe6d0c9a9 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:55:54.547302 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-376c766e-1969-42ba-b4cf-c38fe6d0c9a9 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1375 microversion: 2.1 time: 0.185963 Mar 05 21:55:54.548266 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3313/6663] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:55:54 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:55:55.565504 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-6564f547-c049-410f-ae9d-05bec5e61594 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:55:55.566288 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-6564f547-c049-410f-ae9d-05bec5e61594 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:55:55.574323 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6564f547-c049-410f-ae9d-05bec5e61594 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:55.574921 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6564f547-c049-410f-ae9d-05bec5e61594 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:55.575864 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6564f547-c049-410f-ae9d-05bec5e61594 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:55.576386 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-6564f547-c049-410f-ae9d-05bec5e61594 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:55.728313 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-6564f547-c049-410f-ae9d-05bec5e61594 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:55:55.736377 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-6564f547-c049-410f-ae9d-05bec5e61594 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1375 microversion: 2.1 time: 0.174719 Mar 05 21:55:55.737300 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3351/6664] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:55:55 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:55:56.754158 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-1545661c-4736-4ff3-973c-957ed3ea56dd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:55:56.754808 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-1545661c-4736-4ff3-973c-957ed3ea56dd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:55:56.762397 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1545661c-4736-4ff3-973c-957ed3ea56dd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:56.762881 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1545661c-4736-4ff3-973c-957ed3ea56dd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:56.769092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1545661c-4736-4ff3-973c-957ed3ea56dd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:56.769092 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-1545661c-4736-4ff3-973c-957ed3ea56dd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:56.916016 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-1545661c-4736-4ff3-973c-957ed3ea56dd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:55:56.923603 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-1545661c-4736-4ff3-973c-957ed3ea56dd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1375 microversion: 2.1 time: 0.173466 Mar 05 21:55:56.924209 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3314/6665] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:55:56 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 21:55:57.942530 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d337901b-a9b6-4be5-90cb-6fb459ce52d1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:55:57.943189 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d337901b-a9b6-4be5-90cb-6fb459ce52d1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:55:57.950817 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d337901b-a9b6-4be5-90cb-6fb459ce52d1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:57.951272 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d337901b-a9b6-4be5-90cb-6fb459ce52d1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:57.952116 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d337901b-a9b6-4be5-90cb-6fb459ce52d1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:57.952555 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d337901b-a9b6-4be5-90cb-6fb459ce52d1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:58.099873 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d337901b-a9b6-4be5-90cb-6fb459ce52d1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:55:58.107340 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d337901b-a9b6-4be5-90cb-6fb459ce52d1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1375 microversion: 2.1 time: 0.169718 Mar 05 21:55:58.107960 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3352/6666] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:55:57 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:55:58.383265 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-dd62a5ba-fd4b-4f3c-bfcc-4ec7a55c9a26 req-3383a363-0339-424a-84f1-90f7dc7bb918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56a439a-08cc-4b17-a084-eb5be23ac240", "tag": "3abf485e-1682-4f34-86cc-c20a3a2a71c7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:55:58.417013 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-dd62a5ba-fd4b-4f3c-bfcc-4ec7a55c9a26 req-3383a363-0339-424a-84f1-90f7dc7bb918 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:58.417883 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-dd62a5ba-fd4b-4f3c-bfcc-4ec7a55c9a26 req-3383a363-0339-424a-84f1-90f7dc7bb918 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:58.437750 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-dd62a5ba-fd4b-4f3c-bfcc-4ec7a55c9a26 req-3383a363-0339-424a-84f1-90f7dc7bb918 service nova] Creating event network-changed:3abf485e-1682-4f34-86cc-c20a3a2a71c7 for instance c56a439a-08cc-4b17-a084-eb5be23ac240 on nch2-master-1 Mar 05 21:55:58.446421 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-dd62a5ba-fd4b-4f3c-bfcc-4ec7a55c9a26 req-3383a363-0339-424a-84f1-90f7dc7bb918 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068598 Mar 05 21:55:58.448036 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3315/6667] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:55:59.125533 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-7c516138-b4b1-4b2e-91d2-0b7c744c0dfb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:55:59.128559 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-7c516138-b4b1-4b2e-91d2-0b7c744c0dfb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:55:59.136916 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c516138-b4b1-4b2e-91d2-0b7c744c0dfb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:59.137660 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c516138-b4b1-4b2e-91d2-0b7c744c0dfb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:59.138627 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c516138-b4b1-4b2e-91d2-0b7c744c0dfb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:55:59.139079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-7c516138-b4b1-4b2e-91d2-0b7c744c0dfb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:55:59.288423 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-7c516138-b4b1-4b2e-91d2-0b7c744c0dfb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:55:59.299094 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-7c516138-b4b1-4b2e-91d2-0b7c744c0dfb tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1375 microversion: 2.1 time: 0.178156 Mar 05 21:55:59.299918 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3353/6668] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:55:59 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:56:00.318256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-e9bef026-5088-4813-a003-1dc8bec1adad tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:56:00.318911 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-e9bef026-5088-4813-a003-1dc8bec1adad tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:56:00.325582 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9bef026-5088-4813-a003-1dc8bec1adad tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:56:00.326048 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9bef026-5088-4813-a003-1dc8bec1adad tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:56:00.326834 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9bef026-5088-4813-a003-1dc8bec1adad tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:56:00.327283 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-e9bef026-5088-4813-a003-1dc8bec1adad tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:56:00.464929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-e9bef026-5088-4813-a003-1dc8bec1adad tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:56:00.472271 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-e9bef026-5088-4813-a003-1dc8bec1adad tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1375 microversion: 2.1 time: 0.159204 Mar 05 21:56:00.472864 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3316/6669] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:56:00 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:56:01.489475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-02b7ac17-4e82-412c-a2ae-e0d767cc58b2 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:56:01.490024 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-02b7ac17-4e82-412c-a2ae-e0d767cc58b2 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:56:01.497734 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02b7ac17-4e82-412c-a2ae-e0d767cc58b2 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:56:01.498129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02b7ac17-4e82-412c-a2ae-e0d767cc58b2 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:56:01.499289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02b7ac17-4e82-412c-a2ae-e0d767cc58b2 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:56:01.499289 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-02b7ac17-4e82-412c-a2ae-e0d767cc58b2 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:56:01.644365 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-02b7ac17-4e82-412c-a2ae-e0d767cc58b2 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:56:01.652346 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-02b7ac17-4e82-412c-a2ae-e0d767cc58b2 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1375 microversion: 2.1 time: 0.167027 Mar 05 21:56:01.652922 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3354/6670] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:56:01 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:56:02.192420 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-7266d233-32f2-4c80-a62e-b64f4b8e1d93 req-43bc3cc5-4270-4c31-8054-f02edb6612a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56a439a-08cc-4b17-a084-eb5be23ac240", "name": "network-vif-plugged", "status": "completed", "tag": "3abf485e-1682-4f34-86cc-c20a3a2a71c7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:56:02.202736 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7266d233-32f2-4c80-a62e-b64f4b8e1d93 req-43bc3cc5-4270-4c31-8054-f02edb6612a2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:56:02.203280 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-7266d233-32f2-4c80-a62e-b64f4b8e1d93 req-43bc3cc5-4270-4c31-8054-f02edb6612a2 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:56:02.216201 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-7266d233-32f2-4c80-a62e-b64f4b8e1d93 req-43bc3cc5-4270-4c31-8054-f02edb6612a2 service nova] Creating event network-vif-plugged:3abf485e-1682-4f34-86cc-c20a3a2a71c7 for instance c56a439a-08cc-4b17-a084-eb5be23ac240 on nch2-master-1 Mar 05 21:56:02.221409 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-7266d233-32f2-4c80-a62e-b64f4b8e1d93 req-43bc3cc5-4270-4c31-8054-f02edb6612a2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033164 Mar 05 21:56:02.222019 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3317/6671] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:56:02.669475 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-576aa053-ef3b-440d-87d5-ee69ff335a52 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:56:02.670081 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-576aa053-ef3b-440d-87d5-ee69ff335a52 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:56:02.676951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-576aa053-ef3b-440d-87d5-ee69ff335a52 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:56:02.677410 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-576aa053-ef3b-440d-87d5-ee69ff335a52 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:56:02.678217 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-576aa053-ef3b-440d-87d5-ee69ff335a52 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:56:02.678698 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-576aa053-ef3b-440d-87d5-ee69ff335a52 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:56:02.815137 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-576aa053-ef3b-440d-87d5-ee69ff335a52 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:56:02.823215 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-576aa053-ef3b-440d-87d5-ee69ff335a52 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1375 microversion: 2.1 time: 0.157732 Mar 05 21:56:02.823823 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3355/6672] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:56:02 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:56:03.841357 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-99017d89-2854-4b21-9466-8de624bbb411 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:56:03.842086 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-99017d89-2854-4b21-9466-8de624bbb411 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:56:03.848477 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99017d89-2854-4b21-9466-8de624bbb411 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:56:03.848929 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99017d89-2854-4b21-9466-8de624bbb411 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:56:03.849726 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99017d89-2854-4b21-9466-8de624bbb411 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:56:03.850188 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-99017d89-2854-4b21-9466-8de624bbb411 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:56:03.990891 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-99017d89-2854-4b21-9466-8de624bbb411 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:56:03.998807 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-99017d89-2854-4b21-9466-8de624bbb411 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1559 microversion: 2.1 time: 0.162541 Mar 05 21:56:03.999400 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3318/6673] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:56:03 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:56:04.015657 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0f11fbd0-d1ba-4d89-949d-b26e0d4a3864 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:56:04.016299 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0f11fbd0-d1ba-4d89-949d-b26e0d4a3864 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:56:04.022995 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f11fbd0-d1ba-4d89-949d-b26e0d4a3864 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:56:04.023448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f11fbd0-d1ba-4d89-949d-b26e0d4a3864 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:56:04.024743 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f11fbd0-d1ba-4d89-949d-b26e0d4a3864 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:56:04.025267 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0f11fbd0-d1ba-4d89-949d-b26e0d4a3864 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:56:04.160262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-0f11fbd0-d1ba-4d89-949d-b26e0d4a3864 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:56:04.167688 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0f11fbd0-d1ba-4d89-949d-b26e0d4a3864 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1559 microversion: 2.1 time: 0.156185 Mar 05 21:56:04.168269 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3356/6674] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:56:04 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:56:05.843061 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-96eec0c7-c43a-4d21-a066-d60425c084f4 req-210e3916-2682-4a1a-b210-07b1f9bd83d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56a439a-08cc-4b17-a084-eb5be23ac240", "tag": "3abf485e-1682-4f34-86cc-c20a3a2a71c7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:56:05.851073 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-96eec0c7-c43a-4d21-a066-d60425c084f4 req-210e3916-2682-4a1a-b210-07b1f9bd83d3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:56:05.851533 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-96eec0c7-c43a-4d21-a066-d60425c084f4 req-210e3916-2682-4a1a-b210-07b1f9bd83d3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:56:05.863321 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-96eec0c7-c43a-4d21-a066-d60425c084f4 req-210e3916-2682-4a1a-b210-07b1f9bd83d3 service nova] Creating event network-changed:3abf485e-1682-4f34-86cc-c20a3a2a71c7 for instance c56a439a-08cc-4b17-a084-eb5be23ac240 on nch2-master-1 Mar 05 21:56:05.868548 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-96eec0c7-c43a-4d21-a066-d60425c084f4 req-210e3916-2682-4a1a-b210-07b1f9bd83d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086311 Mar 05 21:56:05.869212 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3319/6675] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:57:33.050079 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-90665367-0d0f-4412-84ee-cc62dbff85a8 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-65882991"}} {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:57:33.051172 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-90665367-0d0f-4412-84ee-cc62dbff85a8 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:57:33.057694 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90665367-0d0f-4412-84ee-cc62dbff85a8 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:33.058149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90665367-0d0f-4412-84ee-cc62dbff85a8 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:33.059416 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90665367-0d0f-4412-84ee-cc62dbff85a8 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:33.059898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-90665367-0d0f-4412-84ee-cc62dbff85a8 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:33.334611 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-90665367-0d0f-4412-84ee-cc62dbff85a8 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "POST /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240/action" status: 202 len: 0 microversion: 2.1 time: 0.289534 Mar 05 21:57:33.335314 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3357/6676] 10.222.0.15 () {60 vars in 1277 bytes} [Sat Mar 5 21:57:33 2022] POST /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 05 21:57:38.650607 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-9634fcfb-5572-4668-b47d-b5354021ad6b req-63f53ecc-20ac-4b17-8888-d484badf2cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56a439a-08cc-4b17-a084-eb5be23ac240", "name": "network-vif-plugged", "status": "completed", "tag": "3abf485e-1682-4f34-86cc-c20a3a2a71c7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:57:38.663096 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9634fcfb-5572-4668-b47d-b5354021ad6b req-63f53ecc-20ac-4b17-8888-d484badf2cc8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:38.663900 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9634fcfb-5572-4668-b47d-b5354021ad6b req-63f53ecc-20ac-4b17-8888-d484badf2cc8 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:38.679943 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-9634fcfb-5572-4668-b47d-b5354021ad6b req-63f53ecc-20ac-4b17-8888-d484badf2cc8 service nova] Creating event network-vif-plugged:3abf485e-1682-4f34-86cc-c20a3a2a71c7 for instance c56a439a-08cc-4b17-a084-eb5be23ac240 on nch2-master-1 Mar 05 21:57:38.686547 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-9634fcfb-5572-4668-b47d-b5354021ad6b req-63f53ecc-20ac-4b17-8888-d484badf2cc8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042037 Mar 05 21:57:38.688186 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3320/6677] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:57:46.943529 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-c9200429-e1fc-46d0-ae9d-dafcfbda2199 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:57:46.945448 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c9200429-e1fc-46d0-ae9d-dafcfbda2199 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:57:46.945752 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-9bee7fd6-1975-4b70-bfeb-de85966008b5 req-a1596f1a-e5f8-4df0-bd20-029c9e45ed0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56a439a-08cc-4b17-a084-eb5be23ac240", "tag": "3abf485e-1682-4f34-86cc-c20a3a2a71c7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:57:46.954351 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9200429-e1fc-46d0-ae9d-dafcfbda2199 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:46.955293 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9200429-e1fc-46d0-ae9d-dafcfbda2199 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:46.956692 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9200429-e1fc-46d0-ae9d-dafcfbda2199 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:46.957092 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-c9200429-e1fc-46d0-ae9d-dafcfbda2199 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:46.963428 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9bee7fd6-1975-4b70-bfeb-de85966008b5 req-a1596f1a-e5f8-4df0-bd20-029c9e45ed0a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:46.964146 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-9bee7fd6-1975-4b70-bfeb-de85966008b5 req-a1596f1a-e5f8-4df0-bd20-029c9e45ed0a service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:46.977376 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-9bee7fd6-1975-4b70-bfeb-de85966008b5 req-a1596f1a-e5f8-4df0-bd20-029c9e45ed0a service nova] Creating event network-changed:3abf485e-1682-4f34-86cc-c20a3a2a71c7 for instance c56a439a-08cc-4b17-a084-eb5be23ac240 on nch2-master-1 Mar 05 21:57:46.982770 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-9bee7fd6-1975-4b70-bfeb-de85966008b5 req-a1596f1a-e5f8-4df0-bd20-029c9e45ed0a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042242 Mar 05 21:57:46.983956 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3321/6678] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:57:46.986925 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-c9200429-e1fc-46d0-ae9d-dafcfbda2199 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:57:47.077653 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-c9200429-e1fc-46d0-ae9d-dafcfbda2199 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 204 len: 0 microversion: 2.1 time: 0.136689 Mar 05 21:57:47.080345 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3358/6679] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:57:46 2022] DELETE /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:57:47.088331 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-5927dcc7-6092-4fb9-a9ff-67285e58edc1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:57:47.089171 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-5927dcc7-6092-4fb9-a9ff-67285e58edc1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:57:47.095978 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5927dcc7-6092-4fb9-a9ff-67285e58edc1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:47.096455 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5927dcc7-6092-4fb9-a9ff-67285e58edc1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:47.097273 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5927dcc7-6092-4fb9-a9ff-67285e58edc1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:47.097730 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-5927dcc7-6092-4fb9-a9ff-67285e58edc1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:47.327388 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-5927dcc7-6092-4fb9-a9ff-67285e58edc1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:57:47.336834 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-5927dcc7-6092-4fb9-a9ff-67285e58edc1 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1684 microversion: 2.1 time: 0.252834 Mar 05 21:57:47.337434 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3322/6680] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:57:47 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1684 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:57:48.356064 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-87d7a1fb-ef5e-4806-8e1b-739517aa3496 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:57:48.357262 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-87d7a1fb-ef5e-4806-8e1b-739517aa3496 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:57:48.363547 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87d7a1fb-ef5e-4806-8e1b-739517aa3496 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:48.364039 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87d7a1fb-ef5e-4806-8e1b-739517aa3496 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:48.364806 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87d7a1fb-ef5e-4806-8e1b-739517aa3496 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:48.365246 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-87d7a1fb-ef5e-4806-8e1b-739517aa3496 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:48.499461 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-87d7a1fb-ef5e-4806-8e1b-739517aa3496 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:57:48.506803 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-87d7a1fb-ef5e-4806-8e1b-739517aa3496 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1565 microversion: 2.1 time: 0.155352 Mar 05 21:57:48.507382 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3359/6681] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:57:48 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:57:49.435443 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-c2e15f5e-eab6-4e39-b526-f6e51a3b1937 req-35406d56-e4ed-4ebf-b335-61d340f569a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56a439a-08cc-4b17-a084-eb5be23ac240", "name": "network-vif-deleted", "tag": "3abf485e-1682-4f34-86cc-c20a3a2a71c7"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:57:49.444316 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c2e15f5e-eab6-4e39-b526-f6e51a3b1937 req-35406d56-e4ed-4ebf-b335-61d340f569a4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:49.444783 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-c2e15f5e-eab6-4e39-b526-f6e51a3b1937 req-35406d56-e4ed-4ebf-b335-61d340f569a4 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:49.456102 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-c2e15f5e-eab6-4e39-b526-f6e51a3b1937 req-35406d56-e4ed-4ebf-b335-61d340f569a4 service nova] Creating event network-vif-deleted:3abf485e-1682-4f34-86cc-c20a3a2a71c7 for instance c56a439a-08cc-4b17-a084-eb5be23ac240 on nch2-master-1 Mar 05 21:57:49.461175 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-c2e15f5e-eab6-4e39-b526-f6e51a3b1937 req-35406d56-e4ed-4ebf-b335-61d340f569a4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030084 Mar 05 21:57:49.461723 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3323/6682] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:57:49.524033 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-a7a8367a-cb25-4023-98ee-46e4853d1b69 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:57:49.524722 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-a7a8367a-cb25-4023-98ee-46e4853d1b69 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:57:49.532149 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7a8367a-cb25-4023-98ee-46e4853d1b69 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:49.532622 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7a8367a-cb25-4023-98ee-46e4853d1b69 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:49.533415 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7a8367a-cb25-4023-98ee-46e4853d1b69 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:49.533860 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7a8367a-cb25-4023-98ee-46e4853d1b69 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:49.566680 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7a8367a-cb25-4023-98ee-46e4853d1b69 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:49.567129 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-a7a8367a-cb25-4023-98ee-46e4853d1b69 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:49.567583 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.objects.instance [None req-a7a8367a-cb25-4023-98ee-46e4853d1b69 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lazy-loading 'fault' on Instance uuid c56a439a-08cc-4b17-a084-eb5be23ac240 {{(pid=141479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 21:57:49.612208 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-a7a8367a-cb25-4023-98ee-46e4853d1b69 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:57:49.619721 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-a7a8367a-cb25-4023-98ee-46e4853d1b69 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 200 len: 1339 microversion: 2.1 time: 0.099681 Mar 05 21:57:49.620300 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3360/6683] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:57:49 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:57:50.638959 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-939aaab5-3f07-4b6f-adbb-3b24ab98fe78 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:57:50.639853 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-939aaab5-3f07-4b6f-adbb-3b24ab98fe78 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c56a439a-08cc-4b17-a084-eb5be23ac240] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:57:50.646115 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-939aaab5-3f07-4b6f-adbb-3b24ab98fe78 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:50.646590 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-939aaab5-3f07-4b6f-adbb-3b24ab98fe78 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:50.647387 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-939aaab5-3f07-4b6f-adbb-3b24ab98fe78 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:50.647882 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-939aaab5-3f07-4b6f-adbb-3b24ab98fe78 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:50.661432 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.wsgi [None req-939aaab5-3f07-4b6f-adbb-3b24ab98fe78 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] HTTP exception thrown: Instance c56a439a-08cc-4b17-a084-eb5be23ac240 could not be found. Mar 05 21:57:50.662056 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-939aaab5-3f07-4b6f-adbb-3b24ab98fe78 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Returning 404 to user: Instance c56a439a-08cc-4b17-a084-eb5be23ac240 could not be found. {{(pid=141478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:57:50.662913 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-939aaab5-3f07-4b6f-adbb-3b24ab98fe78 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240" status: 404 len: 111 microversion: 2.1 time: 0.029495 Mar 05 21:57:50.663485 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3324/6684] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:57:50 2022] GET /compute/v2.1/servers/c56a439a-08cc-4b17-a084-eb5be23ac240 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:57:52.019589 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-beb9d003-fb2d-4893-a37f-5e9236a48fa6 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:57:52.020258 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-beb9d003-fb2d-4893-a37f-5e9236a48fa6 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:57:52.021757 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-b07bee5f-62bb-4284-ba31-c045cb8e1893 req-d41f08b1-d405-4102-b48d-b8611ab85ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c863dcf5-1511-497b-ba16-393b31bc43fd", "tag": "180562de-3bda-4a98-b4f8-2780b266e045"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:57:52.028753 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-beb9d003-fb2d-4893-a37f-5e9236a48fa6 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:52.029366 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-beb9d003-fb2d-4893-a37f-5e9236a48fa6 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:52.030174 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-beb9d003-fb2d-4893-a37f-5e9236a48fa6 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:52.030781 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-beb9d003-fb2d-4893-a37f-5e9236a48fa6 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:52.033501 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b07bee5f-62bb-4284-ba31-c045cb8e1893 req-d41f08b1-d405-4102-b48d-b8611ab85ed3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:52.033984 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-b07bee5f-62bb-4284-ba31-c045cb8e1893 req-d41f08b1-d405-4102-b48d-b8611ab85ed3 service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:52.045203 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-b07bee5f-62bb-4284-ba31-c045cb8e1893 req-d41f08b1-d405-4102-b48d-b8611ab85ed3 service nova] Creating event network-changed:180562de-3bda-4a98-b4f8-2780b266e045 for instance c863dcf5-1511-497b-ba16-393b31bc43fd on nch1-master-1 Mar 05 21:57:52.050326 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-b07bee5f-62bb-4284-ba31-c045cb8e1893 req-d41f08b1-d405-4102-b48d-b8611ab85ed3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032606 Mar 05 21:57:52.051799 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3325/6685] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 21:57:52.058997 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-beb9d003-fb2d-4893-a37f-5e9236a48fa6 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Going to try to terminate instance {{(pid=141479) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 21:57:52.150268 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-beb9d003-fb2d-4893-a37f-5e9236a48fa6 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 204 len: 0 microversion: 2.1 time: 0.133903 Mar 05 21:57:52.151140 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3361/6686] 10.222.0.15 () {58 vars in 1238 bytes} [Sat Mar 5 21:57:52 2022] DELETE /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 21:57:52.165140 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-3edcc4bd-9504-4783-aa57-bba2b0ae4d5f tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:57:52.167182 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.compute.api [None req-3edcc4bd-9504-4783-aa57-bba2b0ae4d5f tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141478) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:57:52.174942 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3edcc4bd-9504-4783-aa57-bba2b0ae4d5f tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:52.175503 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3edcc4bd-9504-4783-aa57-bba2b0ae4d5f tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:52.176564 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3edcc4bd-9504-4783-aa57-bba2b0ae4d5f tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:52.177084 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [None req-3edcc4bd-9504-4783-aa57-bba2b0ae4d5f tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:52.410256 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.policy [None req-3edcc4bd-9504-4783-aa57-bba2b0ae4d5f tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141478) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:57:52.418300 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-3edcc4bd-9504-4783-aa57-bba2b0ae4d5f tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 200 len: 1683 microversion: 2.1 time: 0.261806 Mar 05 21:57:52.419836 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3326/6687] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:57:52 2022] GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 1683 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:57:53.437023 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-d0111923-053d-4af8-ad1a-b69f0a8d00cd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:57:53.437791 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-d0111923-053d-4af8-ad1a-b69f0a8d00cd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:57:53.444815 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d0111923-053d-4af8-ad1a-b69f0a8d00cd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:53.445306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d0111923-053d-4af8-ad1a-b69f0a8d00cd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:53.446084 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d0111923-053d-4af8-ad1a-b69f0a8d00cd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:53.446537 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-d0111923-053d-4af8-ad1a-b69f0a8d00cd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:53.585067 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.policy [None req-d0111923-053d-4af8-ad1a-b69f0a8d00cd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378a9897110a45948025fbf1e825c7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0fea440ec3497494381b3c3133b704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141479) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 21:57:53.593216 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-d0111923-053d-4af8-ad1a-b69f0a8d00cd tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 200 len: 1564 microversion: 2.1 time: 0.160607 Mar 05 21:57:53.593791 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3362/6688] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:57:53 2022] GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 21:57:54.173224 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [req-ea82674e-5e20-4026-b437-dba5334150d6 req-e35a3789-b7ad-4e20-9ae7-f2815a552f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c863dcf5-1511-497b-ba16-393b31bc43fd", "name": "network-vif-deleted", "tag": "180562de-3bda-4a98-b4f8-2780b266e045"}]} {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 21:57:54.182547 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ea82674e-5e20-4026-b437-dba5334150d6 req-e35a3789-b7ad-4e20-9ae7-f2815a552f1e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:54.183012 ncdv-master-1 devstack@n-api.service[141478]: DEBUG oslo_concurrency.lockutils [req-ea82674e-5e20-4026-b437-dba5334150d6 req-e35a3789-b7ad-4e20-9ae7-f2815a552f1e service nova] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:54.195180 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.compute.server_external_events [req-ea82674e-5e20-4026-b437-dba5334150d6 req-e35a3789-b7ad-4e20-9ae7-f2815a552f1e service nova] Creating event network-vif-deleted:180562de-3bda-4a98-b4f8-2780b266e045 for instance c863dcf5-1511-497b-ba16-393b31bc43fd on nch1-master-1 Mar 05 21:57:54.201178 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [req-ea82674e-5e20-4026-b437-dba5334150d6 req-e35a3789-b7ad-4e20-9ae7-f2815a552f1e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032557 Mar 05 21:57:54.201783 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3327/6689] 10.222.0.15 () {64 vars in 1317 bytes} [Sat Mar 5 21:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 21:57:54.611140 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0de3efb0-ff6b-4df8-93c4-170c5a76f869 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '>' {{(pid=141479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:57:54.612381 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.compute.api [None req-0de3efb0-ff6b-4df8-93c4-170c5a76f869 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [instance: c863dcf5-1511-497b-ba16-393b31bc43fd] Fetching instance by UUID {{(pid=141479) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 21:57:54.619392 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0de3efb0-ff6b-4df8-93c4-170c5a76f869 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:54.619951 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0de3efb0-ff6b-4df8-93c4-170c5a76f869 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:54.621001 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0de3efb0-ff6b-4df8-93c4-170c5a76f869 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 21:57:54.622306 ncdv-master-1 devstack@n-api.service[141479]: DEBUG oslo_concurrency.lockutils [None req-0de3efb0-ff6b-4df8-93c4-170c5a76f869 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Lock "591cc087-7d9b-4967-a4cd-9c96e8077593" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 21:57:54.637179 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.wsgi [None req-0de3efb0-ff6b-4df8-93c4-170c5a76f869 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] HTTP exception thrown: Instance c863dcf5-1511-497b-ba16-393b31bc43fd could not be found. Mar 05 21:57:54.637898 ncdv-master-1 devstack@n-api.service[141479]: DEBUG nova.api.openstack.wsgi [None req-0de3efb0-ff6b-4df8-93c4-170c5a76f869 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Returning 404 to user: Instance c863dcf5-1511-497b-ba16-393b31bc43fd could not be found. {{(pid=141479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 21:57:54.638857 ncdv-master-1 devstack@n-api.service[141479]: INFO nova.api.openstack.requestlog [None req-0de3efb0-ff6b-4df8-93c4-170c5a76f869 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd" status: 404 len: 111 microversion: 2.1 time: 0.033004 Mar 05 21:57:54.639774 ncdv-master-1 devstack@n-api.service[141479]: [pid: 141479|app: 0|req: 3363/6690] 10.222.0.15 () {58 vars in 1235 bytes} [Sat Mar 5 21:57:54 2022] GET /compute/v2.1/servers/c863dcf5-1511-497b-ba16-393b31bc43fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 21:57:54.798110 ncdv-master-1 devstack@n-api.service[141478]: DEBUG nova.api.openstack.wsgi [None req-0d9443c3-8278-49f7-89bb-69e41cb0bd99 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] Calling method '.version_select at 0x7fed4ffaf160>' {{(pid=141478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 21:57:54.801306 ncdv-master-1 devstack@n-api.service[141478]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0d9443c3-8278-49f7-89bb-69e41cb0bd99 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [9556d23d-768b-4ba7-81ab-e8d6bfa150f7] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 05 21:57:55.814481 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [None req-0d9443c3-8278-49f7-89bb-69e41cb0bd99 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] [9556d23d-768b-4ba7-81ab-e8d6bfa150f7] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 35386. Mar 05 21:57:55.833632 ncdv-master-1 devstack@n-api.service[141478]: INFO nova.api.openstack.requestlog [None req-0d9443c3-8278-49f7-89bb-69e41cb0bd99 tempest-TestSnapshotPattern-1581000206 tempest-TestSnapshotPattern-1581000206-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1189705558" status: 202 len: 0 microversion: 2.1 time: 1.040157 Mar 05 21:57:55.834219 ncdv-master-1 devstack@n-api.service[141478]: [pid: 141478|app: 0|req: 3328/6691] 10.222.0.15 () {58 vars in 1256 bytes} [Sat Mar 5 21:57:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1189705558 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 21:58:32.396509 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:58:32.397090 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 21:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:58:32.401839 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:58:32.402318 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 21:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 21:58:32.445906 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 21:58:32.446068 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 21:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 22:00:27.868599 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 22:00:27.869335 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 22:00:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 22:01:52.404890 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 22:01:52.405604 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 22:01:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 22:01:52.410397 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 22:01:52.410868 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 22:01:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 22:01:52.453246 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 22:01:52.453396 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 22:01:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 22:03:31.852513 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 22:03:31.853168 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 22:03:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 22:03:47.876632 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 22:03:47.877253 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 22:03:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 22:03:48.015874 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 22:03:48.016377 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 22:03:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 22:05:12.413715 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 22:05:12.414921 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 22:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 22:05:12.417698 ncdv-master-1 devstack@n-api.service[141478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 22:05:12.418160 ncdv-master-1 devstack@n-api.service[141478]: Sat Mar 5 22:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 22:05:12.460448 ncdv-master-1 devstack@n-api.service[141479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 22:05:12.460618 ncdv-master-1 devstack@n-api.service[141479]: Sat Mar 5 22:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!